-- Logs begin at Mon 2022-10-17 14:36:51 UTC, end at Mon 2022-10-17 17:13:38 UTC. -- Oct 17 15:11:16.307028 n-d-854441-12 systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 15:11:16.315001 n-d-854441-12 devstack@n-api.service[104488]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 15:11:16 2022] *** Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: nodename: n-d-854441-12 Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: machine: x86_64 Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: clock source: unix Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: pcre jit disabled Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: detected number of CPU cores: 4 Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: current working directory: / Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: detected binary path: /usr/bin/uwsgi-core Oct 17 15:11:16.316904 n-d-854441-12 devstack@n-api.service[104488]: your processes number limit is 47680 Oct 17 15:11:16.317868 n-d-854441-12 devstack@n-api.service[104488]: your memory page size is 4096 bytes Oct 17 15:11:16.317868 n-d-854441-12 devstack@n-api.service[104488]: detected max file descriptor number: 2048 Oct 17 15:11:16.317868 n-d-854441-12 devstack@n-api.service[104488]: lock engine: pthread robust mutexes Oct 17 15:11:16.317868 n-d-854441-12 devstack@n-api.service[104488]: thunder lock: enabled Oct 17 15:11:16.317868 n-d-854441-12 devstack@n-api.service[104488]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 15:11:16.317868 n-d-854441-12 devstack@n-api.service[104488]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 15:11:16.356664 n-d-854441-12 devstack@n-api.service[104488]: Python main interpreter initialized at 0x55da57bb69c0 Oct 17 15:11:16.356664 n-d-854441-12 devstack@n-api.service[104488]: python threads support enabled Oct 17 15:11:16.356664 n-d-854441-12 devstack@n-api.service[104488]: your server socket listen backlog is limited to 100 connections Oct 17 15:11:16.356664 n-d-854441-12 devstack@n-api.service[104488]: your mercy for graceful operations on workers is 90 seconds Oct 17 15:11:16.357050 n-d-854441-12 devstack@n-api.service[104488]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 15:11:16.357130 n-d-854441-12 devstack@n-api.service[104488]: *** Operational MODE: preforking *** Oct 17 15:11:16.357371 n-d-854441-12 devstack@n-api.service[104488]: *** uWSGI is running in multiple interpreter mode *** Oct 17 15:11:16.357371 n-d-854441-12 devstack@n-api.service[104488]: spawned uWSGI master process (pid: 104488) Oct 17 15:11:16.357594 n-d-854441-12 systemd[1]: Started Devstack devstack@n-api.service. Oct 17 15:11:16.362591 n-d-854441-12 devstack@n-api.service[104488]: spawned uWSGI worker 1 (pid: 104489, cores: 1) Oct 17 15:11:16.362591 n-d-854441-12 devstack@n-api.service[104488]: spawned uWSGI worker 2 (pid: 104490, cores: 1) Oct 17 15:11:16.362591 n-d-854441-12 devstack@n-api.service[104488]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 15:11:17.008588 n-d-854441-12 devstack@n-api.service[104489]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 15:11:17.010012 n-d-854441-12 devstack@n-api.service[104490]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 15:11:18.078540 n-d-854441-12 devstack@n-api.service[104489]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 15:11:18.078540 n-d-854441-12 devstack@n-api.service[104489]: from cryptography.utils import int_from_bytes Oct 17 15:11:18.079152 n-d-854441-12 devstack@n-api.service[104489]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 15:11:18.079152 n-d-854441-12 devstack@n-api.service[104489]: from cryptography.utils import int_from_bytes Oct 17 15:11:18.086723 n-d-854441-12 devstack@n-api.service[104490]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 15:11:18.086723 n-d-854441-12 devstack@n-api.service[104490]: from cryptography.utils import int_from_bytes Oct 17 15:11:18.087240 n-d-854441-12 devstack@n-api.service[104490]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 15:11:18.087240 n-d-854441-12 devstack@n-api.service[104490]: from cryptography.utils import int_from_bytes Oct 17 15:11:20.533061 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 15:11:20.533661 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 15:11:20.533815 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 15:11:20.534185 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 15:11:20.534444 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 15:11:20.534850 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.535172 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.535488 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.535799 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.536164 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 15:11:20.536567 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.536649 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 15:11:20.536737 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.536737 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.536946 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 15:11:20.537040 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.537314 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 15:11:20.537447 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.537529 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 15:11:20.537595 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.537918 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.538048 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.538234 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854441-12 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.538375 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.538546 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.538657 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.538875 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.539007 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.539148 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.539272 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.539481 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.539678 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.539811 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.539931 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.540052 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.540176 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.540353 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.540490 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.540662 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.540848 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.540993 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.542050 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.542190 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854441-12 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.542302 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.542423 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.542571 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.542700 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.542700 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.542944 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.543104 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.543223 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.543339 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.543456 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.543583 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.543718 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.543846 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.543966 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.543966 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.544231 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.544375 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.544497 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.544622 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854441-12 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.544752 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.544881 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.545000 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.545123 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.545247 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.545356 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.545471 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.545628 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.545771 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.545943 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.546069 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.546246 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.546385 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.546585 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.546713 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.546898 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.547024 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.547182 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.547304 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854441-12 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.547515 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.547650 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.547830 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.547965 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.548138 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.548272 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.548453 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.548589 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.548732 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.548854 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.549035 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.549161 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.549337 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.549479 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.549650 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.549784 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.549942 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.550070 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.550248 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.550381 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.550525 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.550713 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.550840 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.551032 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.551175 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.551355 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.551502 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.551682 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.551818 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.551948 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.552081 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.552209 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.552343 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.552463 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.552582 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.552780 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.552908 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.553088 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.553226 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.553385 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.553527 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.553687 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.553812 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.553995 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.554151 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.554338 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.554461 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.554619 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.554771 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.554902 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.555022 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.555147 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.555355 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.555479 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.555606 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.555726 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.555845 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.556026 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.556155 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.556328 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.556462 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.556643 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.556770 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.556951 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.557079 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.557253 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.557380 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.557553 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.557677 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.557858 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.557983 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.558167 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.558294 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.558474 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.558617 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.558809 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.558934 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.559123 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.559239 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.559428 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.559544 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.559728 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.559841 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.560038 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.560152 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.560351 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.560472 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.560657 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.560768 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.560952 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.561069 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.561202 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.561323 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.561506 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.561628 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.561800 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.561930 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.562114 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.562251 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.562410 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.562604 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.562739 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.562859 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.563036 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.563172 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.563322 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.563447 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.563630 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.563758 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.563920 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.564047 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.564228 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.564355 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.564527 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.564658 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.564796 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.564923 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.565105 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.565231 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.565405 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.565532 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.565704 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.565837 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.566005 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.566130 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.566301 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.566424 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.566628 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.566765 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.566935 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.567076 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.567302 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.567427 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.567560 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.567681 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.567868 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.567997 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.568166 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.568292 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.568469 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.568594 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.568767 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.568902 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.569074 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.569207 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.569365 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.569497 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.569673 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.569799 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.569971 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.570114 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.570253 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.570375 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.570601 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.570741 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.570872 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.571004 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.571196 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.571323 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.571497 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.571630 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.571779 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.571914 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.572098 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.572231 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.572406 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.572531 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.572688 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.572828 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.572988 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.573115 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.573293 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.573417 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.573589 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.573724 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.573894 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.574028 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.574179 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.574305 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.574486 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.574654 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.574785 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.574904 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.575104 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.575233 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.575395 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.575521 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.575711 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.575836 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.575998 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.576124 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.576308 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.576434 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.576607 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.576732 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.576906 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.577041 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.577200 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.577335 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.577515 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.577642 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.577815 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.577953 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.578138 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.578265 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.578439 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.578583 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.578786 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.578920 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.579098 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.579233 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.579404 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.579483 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.579718 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:11:20.579807 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.580030 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.580113 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.580339 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.580414 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.580644 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.580728 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.580958 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.581033 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.581273 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.581354 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.581690 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.581781 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.581924 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.582081 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.582209 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.582329 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.582562 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.582730 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.582863 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.582997 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.583189 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.583315 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.583498 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.583626 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.583826 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.583954 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.584103 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.584228 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.584430 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.584558 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.585219 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.585345 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.585466 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.585594 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.585717 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.585837 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.585955 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.586078 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.586196 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.586324 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.586324 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.586566 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.586691 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.586827 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.586948 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.587084 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.587205 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.587333 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.587461 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.587583 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.587775 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.587907 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.588085 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.588215 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.588400 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.588530 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.588706 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.588835 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.589015 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.589142 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.589320 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.589454 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.589633 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.589761 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.589933 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.590061 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.590262 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.590390 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.590597 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.590728 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.590910 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.591050 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.591219 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.591354 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.591523 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.591649 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.591833 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.591967 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.592137 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.592273 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.592442 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.592569 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.592750 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.592883 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.593053 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.593192 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.593365 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.593492 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.593664 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.593790 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.593964 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.594102 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.594251 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.594388 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.594592 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.594715 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.594892 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.595018 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.595191 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.595313 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.595500 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.595623 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.595805 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.595927 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.596106 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.596237 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.596409 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.596531 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.596711 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.596834 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.597007 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.597128 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.597309 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.597442 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.597610 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.597733 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.597912 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.598034 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.598231 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.598428 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.598615 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.598742 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.598921 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.599046 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.599231 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.599371 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.599529 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.599659 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.599832 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.599963 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.600135 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.600265 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.600440 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.600563 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.600748 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.600869 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.601053 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.601184 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.601360 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.601487 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.601668 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.601790 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.601970 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.602094 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.602274 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.602412 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.602610 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.602734 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.602921 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.603049 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.603232 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.603354 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.603540 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.603663 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.603863 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.603986 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.604153 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.604277 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.604449 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.604575 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.604756 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.604881 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.605056 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.605181 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.605349 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.605481 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.605642 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.605761 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.605945 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.606071 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.606243 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.606385 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.606569 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.606697 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.606869 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.606992 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.607169 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.607305 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.607468 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.607592 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.607784 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.607921 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.608088 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.608222 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.608389 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.608514 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.608687 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.608810 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.608999 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.609140 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.609265 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.609383 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.609570 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.609693 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.609874 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.609999 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.610239 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.610373 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.610586 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.610726 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.610905 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.611030 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.611215 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.611339 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.611515 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.611646 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.611822 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.611947 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.612124 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.612248 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.612429 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.612552 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.612734 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.612859 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.613056 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.613187 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.613361 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.613494 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.613675 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.613799 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.614003 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.614138 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.614321 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.614464 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.614657 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.614779 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.614970 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.615110 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.615270 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.615403 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.615578 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.615700 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.615889 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.616023 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.616209 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.616344 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.616546 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.616676 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.616829 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.616998 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.617135 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.617257 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.617424 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.617550 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.617729 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.617854 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.618035 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.618160 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.618339 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.618463 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.618679 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.618802 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.619019 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.619145 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.619331 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.619454 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.619643 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.619774 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.619946 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.620080 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.620254 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.620386 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.620555 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.620677 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.620864 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.620994 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.621160 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.621283 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.621467 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.621601 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.621770 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.621892 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.622101 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.622223 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.622407 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.622570 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.622738 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.622863 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.623058 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.623182 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.623362 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.623495 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.623667 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.623791 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.623973 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.624107 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.624273 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.624409 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.624571 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.624694 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.624875 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.625019 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.625186 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.625311 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.625492 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.625617 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.625797 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.625920 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.626095 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.626220 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.626403 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.626573 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.626732 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.626856 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.627030 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.627156 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.627329 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.627453 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.627632 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.627755 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.627945 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.628068 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.628248 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.628371 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.628556 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.628688 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.628869 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.629002 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.629167 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.629290 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.629467 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.629652 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.629822 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.629946 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.630131 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.630255 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.630440 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.630596 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.630769 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.630893 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.631070 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.631194 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.631386 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.631517 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.631698 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.631821 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.632000 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.632124 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.632332 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.632455 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.632574 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.632693 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.632899 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.633023 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.633212 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.633345 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.633516 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.633646 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.633819 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.633936 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.634124 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.634249 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.634431 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.634601 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.634772 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.634895 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.635080 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.635206 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.635387 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.635510 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.635694 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.635826 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.636005 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.636121 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.636322 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.636450 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.636623 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.636753 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.636930 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.637053 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.637237 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.637360 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.637540 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.637677 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.637848 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.637971 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.638163 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.638289 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.638537 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.638765 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.638891 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.639095 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.639227 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.639750 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.639883 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.640067 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.640192 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.640375 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.640495 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.640690 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.640822 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.640998 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.641129 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.641314 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.641435 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.641627 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.641747 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.641931 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.642196 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.642328 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.642545 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.642683 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.642855 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.642986 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.643165 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.643288 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.643467 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.643589 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.643767 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.643900 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.644069 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.644198 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.644376 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.644501 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.644675 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.644810 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.644977 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.645101 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.645375 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.645499 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.645682 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.645814 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.645989 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.646415 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.646593 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.646723 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.646844 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.647037 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.647193 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.647345 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.647470 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.647657 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.647780 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.647967 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.648092 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.648274 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.648397 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.648577 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.648701 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.648876 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.649000 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.649184 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.649305 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.649487 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.649610 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.649799 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.649924 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.650103 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.650235 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.650424 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.650580 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.650758 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.650890 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.651062 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.651193 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.651363 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.651498 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.651669 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.651796 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.651964 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.652086 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.652265 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.652397 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.652571 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.652696 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.652884 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.653007 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.653184 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.653324 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.653493 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.653616 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.653799 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.653924 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.654108 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.654233 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.654413 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.654591 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.654736 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.654877 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.655043 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.655168 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.655343 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.655470 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.655650 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.655771 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.655951 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.656067 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.656248 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.656374 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.656545 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.656675 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.656866 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.656989 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.657139 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.657262 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.657438 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.657569 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.657740 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.657861 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.658036 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.658160 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.658347 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.658487 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.658678 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.658800 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.658975 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.659109 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.659275 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.659418 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.659582 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.659704 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.659883 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.660004 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.660181 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.660320 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.660488 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.660611 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.660812 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.660962 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.661153 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.661278 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.661456 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.661588 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.661756 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.661878 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.662053 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.662176 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.662350 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.662466 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.662682 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.662817 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.662988 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.663113 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.663301 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.663424 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.663600 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.663723 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.663903 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.664028 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.664200 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.664321 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.664500 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.664638 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.664798 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.664920 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.665098 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.665227 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.665394 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.665527 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.665692 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.665815 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.665990 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.666122 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.666288 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.666422 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.666620 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.666747 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.666927 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.667053 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.667230 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.667362 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.667529 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.667653 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.667829 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.667961 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.668127 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.668251 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.668432 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.668556 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.668735 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.668858 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.669038 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.669163 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.669343 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.669467 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.669664 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.669787 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.669975 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.670098 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.670278 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.670400 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.670604 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.670731 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.670907 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.671031 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.671204 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.671327 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.671515 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.671648 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.671821 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.671944 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.672129 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.672252 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.672427 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.672566 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.672725 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.672850 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.673044 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.673174 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.673348 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.673482 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.673653 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.673778 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.673955 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.674077 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.674268 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.674399 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.674598 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.674721 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.674899 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.675021 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.675203 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.675338 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.675506 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.675629 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.675809 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.675941 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.676112 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.676237 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.676438 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.676566 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.676741 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.676872 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.677049 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.677174 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.677356 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.677480 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.677657 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.677779 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.677961 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.678087 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.678259 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.678386 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.678587 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.678712 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.678892 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.679026 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.679192 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.679316 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.679498 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.679629 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.679801 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.679924 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.680099 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.680223 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.680402 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.680534 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.680702 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.680825 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.681004 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.681135 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.681301 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.681432 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.681610 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.681741 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.681914 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.682037 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.682239 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.682374 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.682570 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.682696 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.682877 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.683000 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.683189 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.683316 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.683493 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.683617 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.683804 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.683973 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.684107 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.684237 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.684520 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.684642 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.684836 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.684958 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.685149 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.685352 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.685477 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.685669 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.685791 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.685969 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.686105 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.686267 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.686403 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.686604 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.686724 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.686930 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.687056 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.687231 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.687361 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.687534 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.687658 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.687835 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.687960 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.688151 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.688275 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.688452 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.688578 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.688766 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.688898 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.689114 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.689245 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.689438 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.689563 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.689743 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.689879 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.690049 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.690172 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.690354 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.690490 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.690699 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.690822 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.691005 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.691128 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.691326 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.691460 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.691659 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.691782 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.691964 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.692157 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.692351 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.692479 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.692662 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.692797 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.693061 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.693185 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.693288 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.693389 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.693593 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.693730 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.693905 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.694029 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.694206 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.694330 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.694546 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.694694 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.694870 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.695002 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.695183 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.695314 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.695515 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.695640 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.695814 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.695939 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.696127 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.696252 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.696441 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.696566 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.696746 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.696870 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.697069 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.697186 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.697382 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.697505 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.697682 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.697792 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.697988 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.698114 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.698289 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.698415 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.698627 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.698764 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.698947 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.699082 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.699248 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.699379 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.699556 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.699681 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.699863 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.700001 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.700167 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.700292 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.700469 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.700594 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.700769 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.700903 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.701085 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.701210 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.701385 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.701524 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.701693 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.701825 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.701997 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.702120 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.702304 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.702425 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.702637 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.702774 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.702942 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.703066 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.703245 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.703369 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.703549 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.703672 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.703849 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.703980 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.704150 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.704283 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.704450 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.704573 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.704771 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.704892 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.705077 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.705198 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.705386 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.705516 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.705707 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.705818 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.706018 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.706129 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.706323 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.706421 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.706652 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.706748 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.706976 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.707083 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.707282 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.707370 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.707591 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.707742 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.707955 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.708066 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.708278 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.708389 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.708579 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.708666 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.708878 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.708975 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.709185 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.709272 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.709486 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.709572 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.709786 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.709884 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.710086 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.710180 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.710391 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.710479 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.710714 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.710803 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.711014 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.711146 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.711311 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.711461 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.711630 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.711775 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.711928 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.712080 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.712242 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.712386 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.712548 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.712690 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.712853 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.713003 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.713152 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.713306 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.713450 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.713611 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.713788 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.713914 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.714090 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.714237 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.714413 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.714560 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.714743 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.714884 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.715061 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.715193 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.715372 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.715497 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.715686 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.715802 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.715997 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.716096 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.716306 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.716428 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.716614 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.716733 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.716922 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.717064 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.717300 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.717446 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.717582 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.717717 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.717870 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.718006 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.718140 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.718295 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.718437 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.718642 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.718939 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.719080 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.719256 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.719407 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.719564 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.719704 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.719876 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.720026 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.720168 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.720311 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.720477 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.720627 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.720774 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.720909 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.721079 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.721220 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.721387 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.721613 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.721756 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.721946 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.722095 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.722264 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.722413 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.722604 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.722759 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.722921 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.723063 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.723237 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.723461 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.723622 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.723762 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.723933 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.724075 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.724245 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.724466 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.724605 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.724748 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.724883 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.725023 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.725179 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.725314 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.725471 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.725641 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.725777 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.725911 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.726075 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.726218 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.726367 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.726582 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.726724 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.726858 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.727005 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.727141 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.727298 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.727437 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.727572 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.727715 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.727874 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.728016 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.728180 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.728335 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.728471 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.728614 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.728786 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.728927 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.729103 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.729245 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.729431 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.729574 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.729745 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.729895 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.730039 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.730184 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.730349 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.730493 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.730685 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.730825 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.730994 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.731198 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.731355 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.731492 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.731625 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.731821 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.731963 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.732141 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.732301 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.732458 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.732599 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.732775 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.732915 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.733089 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.733231 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.733407 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.733549 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.733708 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.733958 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.734107 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.734268 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.734404 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.734618 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.734771 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.734906 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.735047 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.735223 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.735371 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.735513 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.735649 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.735814 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.735969 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.736138 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.736290 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.736425 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.736558 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.736760 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.736958 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.737099 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.737310 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.737450 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.737623 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.737773 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.737945 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.738086 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.738266 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.738424 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.738583 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.738732 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.738924 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.739077 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.739220 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.739362 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.739535 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.739790 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.739935 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.740141 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.740282 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.740461 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.740612 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.740748 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.740882 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.741043 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.741183 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.741402 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.741562 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.741730 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.742110 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.742272 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.742423 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.742599 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.742777 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.742919 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.743056 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.743192 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.743327 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.743472 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.743609 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.743745 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.743889 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.744027 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.744163 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.744307 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.744444 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.744590 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.744726 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.744862 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.744997 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.745142 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.745279 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.745415 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.745551 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.745687 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.745829 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.745974 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.746111 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.746255 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.746410 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.746566 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.746718 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.746857 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.746999 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.747161 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.747308 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.747452 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.747598 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.747746 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.747882 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.748025 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.748172 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.748310 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.748454 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.748599 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.748736 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.748873 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.749008 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.749142 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.749294 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.749433 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.749569 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.749744 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.749895 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.750043 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.750188 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.750326 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.750462 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.750676 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.750799 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.750983 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.751290 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.751377 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.751610 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.751696 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.751922 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.752021 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.752247 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.752332 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.752568 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.752660 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.752868 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.753034 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.753176 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.753262 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.753475 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.753561 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.753795 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.754045 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.754141 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.754384 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.754492 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.754775 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.754913 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.755107 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.755194 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.755416 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.755503 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.755722 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.755836 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.756025 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.756117 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.756328 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.756412 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.756634 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.756737 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.756940 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.757027 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.757245 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.757330 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.757557 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.757745 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.757893 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.758033 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.758197 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.758338 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.758486 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.758653 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.758802 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.758939 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.759077 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.759214 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.759359 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.759497 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.759666 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.759811 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.759975 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.760142 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.760281 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.760417 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.760574 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.760718 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.760880 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.761031 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.761169 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.761303 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.761475 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.761627 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.761798 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.761969 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.762107 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.762243 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.762379 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.762586 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.762753 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.763041 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.763183 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.763352 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.763495 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.763664 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.763817 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.763955 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.764102 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.764273 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.764762 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.764965 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.765119 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.765266 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.765403 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.765572 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.765714 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.765885 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.766183 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.766325 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.766526 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.766674 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.766868 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.767034 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.767180 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.767322 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.767503 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.767671 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.767817 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.767978 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.768122 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.768272 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.768428 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.768570 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.768725 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.768868 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.769011 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.769152 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.769294 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.769444 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.769600 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.769768 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.769962 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.770108 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.770252 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.770405 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.770588 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.770737 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.770881 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.771022 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.771169 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.771313 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.771469 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.771613 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.771763 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.771906 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.772047 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.772197 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.772367 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.772515 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.772658 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.772800 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.772942 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.773091 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.773241 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.773394 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.773537 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.773680 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.773821 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.773971 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.774132 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.774275 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.774426 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.774426 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.774756 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.774908 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.775051 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.775200 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.775352 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.775352 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.775639 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.775782 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.775923 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.776085 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.776228 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.776370 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.776533 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.776678 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.776819 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.776970 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.777118 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.777267 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.777419 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.777562 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.777705 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.777854 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.778007 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.778149 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.778299 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.778442 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.778608 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.778753 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.778898 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.779051 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.779196 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.779338 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.779480 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.779630 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.779773 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.779934 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.780080 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.780221 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.780362 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.780502 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.780651 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.780809 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.780952 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.781095 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.781236 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.781377 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.781594 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.781761 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.781905 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.782058 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.782200 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.782349 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.782542 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.782695 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.782841 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.782983 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.783169 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.783322 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.783473 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.783617 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.783772 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.783915 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.784057 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.784198 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.784354 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.784497 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.784649 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.784792 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.784942 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.785093 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.785244 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.785385 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.785537 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.785688 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.785863 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.786041 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.786190 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.786332 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.786473 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.786644 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.786787 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.786953 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.787098 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.787241 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.787393 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.787536 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.787691 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.787836 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.787978 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.788121 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.788262 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.788404 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.788553 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.788696 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.788840 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.788981 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.789122 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.789277 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.789431 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.789583 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.789725 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.789866 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.790015 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.790168 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 15:11:20.790311 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.790553 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.790855 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.791204 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.791520 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.791865 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.792194 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.792510 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.792829 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.793133 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:11:20.793377 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 15:11:20.944165 n-d-854441-12 devstack@n-api.service[104489]: INFO dbcounter [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Registered counter for database nova_api Oct 17 15:11:20.947359 n-d-854441-12 devstack@n-api.service[104490]: INFO dbcounter [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Registered counter for database nova_api Oct 17 15:11:20.964581 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_db.sqlalchemy.engines [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:11:20.967166 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_db.sqlalchemy.engines [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104490) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:11:20.971449 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writer thread running {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:11:20.973820 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writer thread running {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:11:21.027755 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.context [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ec06080-01b5-4793-9448-66de7d08c56d(cell1) {{(pid=104489) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 15:11:21.030544 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.context [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ec06080-01b5-4793-9448-66de7d08c56d(cell1) {{(pid=104490) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 15:11:21.031699 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:11:21.032168 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:11:21.033786 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:11:21.034428 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_concurrency.lockutils [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104490) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:11:21.034620 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:11:21.034906 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:11:21.035041 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_concurrency.lockutils [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104490) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:11:21.036518 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_concurrency.lockutils [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104490) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:11:21.036926 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:11:21.037253 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_concurrency.lockutils [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104490) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:11:21.037699 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_concurrency.lockutils [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104490) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:11:21.038937 n-d-854441-12 devstack@n-api.service[104489]: INFO dbcounter [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Registered counter for database nova_cell0 Oct 17 15:11:21.039715 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_concurrency.lockutils [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104490) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:11:21.041820 n-d-854441-12 devstack@n-api.service[104490]: INFO dbcounter [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Registered counter for database nova_cell0 Oct 17 15:11:21.042960 n-d-854441-12 devstack@n-api.service[104489]: INFO dbcounter [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Registered counter for database nova_cell1 Oct 17 15:11:21.046048 n-d-854441-12 devstack@n-api.service[104490]: INFO dbcounter [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Registered counter for database nova_cell1 Oct 17 15:11:21.054524 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_db.sqlalchemy.engines [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:11:21.054524 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_db.sqlalchemy.engines [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:11:21.054828 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_db.sqlalchemy.engines [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104490) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:11:21.058224 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writer thread running {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:11:21.058887 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_db.sqlalchemy.engines [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104490) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:11:21.059624 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writer thread running {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:11:21.061123 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writer thread running {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:11:21.198971 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writer thread running {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:11:21.204991 n-d-854441-12 devstack@n-api.service[104489]: INFO dbcounter [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Registered counter for database nova_cell0 Oct 17 15:11:21.208209 n-d-854441-12 devstack@n-api.service[104490]: INFO dbcounter [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Registered counter for database nova_cell0 Oct 17 15:11:21.212612 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_db.sqlalchemy.engines [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:11:21.216994 n-d-854441-12 devstack@n-api.service[104490]: DEBUG oslo_db.sqlalchemy.engines [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104490) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:11:21.217618 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writer thread running {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:11:21.222540 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writer thread running {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:11:21.560927 n-d-854441-12 devstack@n-api.service[104489]: WARNING keystonemiddleware.auth_token [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 15:11:21.561640 n-d-854441-12 devstack@n-api.service[104490]: WARNING keystonemiddleware.auth_token [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 15:11:21.568448 n-d-854441-12 devstack@n-api.service[104489]: WARNING keystonemiddleware.auth_token [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 15:11:21.568956 n-d-854441-12 devstack@n-api.service[104490]: WARNING keystonemiddleware.auth_token [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 15:11:21.906352 n-d-854441-12 devstack@n-api.service[104490]: WARNING keystonemiddleware.auth_token [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 15:11:21.907290 n-d-854441-12 devstack@n-api.service[104489]: WARNING keystonemiddleware.auth_token [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 15:11:21.912274 n-d-854441-12 devstack@n-api.service[104490]: WARNING keystonemiddleware.auth_token [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 15:11:21.913273 n-d-854441-12 devstack@n-api.service[104489]: WARNING keystonemiddleware.auth_token [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 15:11:21.917558 n-d-854441-12 devstack@n-api.service[104490]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da57bb69c0 pid: 104490 (default app) Oct 17 15:11:21.918617 n-d-854441-12 devstack@n-api.service[104489]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da57bb69c0 pid: 104489 (default app) Oct 17 15:11:21.919677 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:11:21.920880 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-cbfd5c9b-1399-479d-8030-32418493dbb3 None None] 10.222.0.87 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Oct 17 15:11:21.921290 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 1/1] 10.222.0.87 () {50 vars in 788 bytes} [Mon Oct 17 15:11:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:12:44.222328 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:12:44.224318 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002689 Oct 17 15:12:44.226951 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 1/2] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:12:44.236429 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writing DB stats nova_api:SELECT=3 {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:12:44.238077 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writing DB stats nova_cell0:SELECT=3 {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:12:44.240599 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writing DB stats nova_cell1:SELECT=3 {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:12:44.241624 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:12:45.105313 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-2c9d6319-b799-4cc9-9db2-fb68ced764e3 admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:12:45.139588 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-2c9d6319-b799-4cc9-9db2-fb68ced764e3 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.908553 Oct 17 15:12:45.140509 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 2/3] 10.222.0.87 () {60 vars in 1292 bytes} [Mon Oct 17 15:12:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:12:47.747459 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:12:47.748493 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-17eec501-b31e-4c03-bd68-161a3b807094 None None] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 17 15:12:47.749425 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 2/4] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:12:48.247041 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-875056ed-553a-48d1-a2ad-09076201306b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "name": "cirros256"}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:12:48.302679 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-875056ed-553a-48d1-a2ad-09076201306b admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.547343 Oct 17 15:12:48.303282 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 3/5] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:12:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:12:48.317315 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writing DB stats nova_api:SELECT=3 {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:12:48.318117 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writing DB stats nova_cell1:SELECT=3 {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:12:48.320059 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writing DB stats nova_cell0:SELECT=3 {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:12:48.320816 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:12:48.533215 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-4734675a-2d0d-4e51-bed8-24b6dbb4c43c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:12:48.604963 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-4734675a-2d0d-4e51-bed8-24b6dbb4c43c admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290906 Oct 17 15:12:48.604963 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 3/6] 10.222.0.87 () {64 vars in 1336 bytes} [Mon Oct 17 15:12:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:12:51.249205 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-875056ed-553a-48d1-a2ad-09076201306b admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:12:51.250675 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-875056ed-553a-48d1-a2ad-09076201306b admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001912 Oct 17 15:12:51.251402 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 4/7] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:12:52.058462 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-3ef86c44-6858-4850-83ba-442e62f327d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "vcpus": 1, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:12:52.113789 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-3ef86c44-6858-4850-83ba-442e62f327d0 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.855295 Oct 17 15:12:52.115054 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 4/8] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:12:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:12:52.128094 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-1604c9ff-e330-4d13-be65-9ee777b085f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:12:52.199900 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-1604c9ff-e330-4d13-be65-9ee777b085f9 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076923 Oct 17 15:12:52.201257 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 5/9] 10.222.0.87 () {64 vars in 1336 bytes} [Mon Oct 17 15:12:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:12:55.067787 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-3ef86c44-6858-4850-83ba-442e62f327d0 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:12:55.068714 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-3ef86c44-6858-4850-83ba-442e62f327d0 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 17 15:12:55.074021 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 5/10] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:12:55.669658 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-7b1c9a5d-ce93-4f44-9124-c7a988379328 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:12:55.689785 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-7b1c9a5d-ce93-4f44-9124-c7a988379328 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.614288 Oct 17 15:12:55.690752 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 6/11] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:12:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:12:55.702756 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-dfff677a-e1ef-48aa-84d0-aa67ff0afe3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:12:55.737699 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-dfff677a-e1ef-48aa-84d0-aa67ff0afe3e admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038779 Oct 17 15:12:55.739002 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 6/12] 10.222.0.87 () {64 vars in 1336 bytes} [Mon Oct 17 15:12:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:12:58.319482 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-7b1c9a5d-ce93-4f44-9124-c7a988379328 admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:12:58.320520 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-7b1c9a5d-ce93-4f44-9124-c7a988379328 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Oct 17 15:12:58.321129 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 7/13] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:12:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:12:58.783667 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-a20cb94e-4681-4e25-bfdf-02920e365422 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "swap": 0}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:12:58.808105 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-a20cb94e-4681-4e25-bfdf-02920e365422 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480117 Oct 17 15:12:58.808846 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 7/14] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:12:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:12:58.820950 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-f58a4472-cca4-40ae-a59b-442832e81183 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:12:58.852059 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-f58a4472-cca4-40ae-a59b-442832e81183 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034652 Oct 17 15:12:58.852882 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 8/15] 10.222.0.87 () {64 vars in 1336 bytes} [Mon Oct 17 15:12:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:13:01.568876 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-a20cb94e-4681-4e25-bfdf-02920e365422 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:01.569905 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-a20cb94e-4681-4e25-bfdf-02920e365422 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 17 15:13:01.570489 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 8/16] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:13:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:02.006906 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-280fca6d-5df3-4914-a919-803502ac5b8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "ram": 4096, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:02.043290 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-280fca6d-5df3-4914-a919-803502ac5b8f admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465763 Oct 17 15:13:02.044414 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 9/17] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:13:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:13:02.058735 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-bdcdb930-2e5f-41db-9d16-7c6659e9cb3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:02.095231 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-bdcdb930-2e5f-41db-9d16-7c6659e9cb3d admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040576 Oct 17 15:13:02.107571 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 9/18] 10.222.0.87 () {64 vars in 1336 bytes} [Mon Oct 17 15:13:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:13:04.812110 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-280fca6d-5df3-4914-a919-803502ac5b8f admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:04.813610 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-280fca6d-5df3-4914-a919-803502ac5b8f admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Oct 17 15:13:04.814185 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 10/19] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:13:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:05.269412 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-59364542-46f5-40dc-b38c-9c209fb4be37 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:05.300357 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-59364542-46f5-40dc-b38c-9c209fb4be37 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477640 Oct 17 15:13:05.301213 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 10/20] 10.222.0.87 () {60 vars in 1292 bytes} [Mon Oct 17 15:13:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:13:08.212222 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-280fca6d-5df3-4914-a919-803502ac5b8f admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:08.214146 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-280fca6d-5df3-4914-a919-803502ac5b8f admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002679 Oct 17 15:13:08.214618 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 11/21] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:08.690154 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-7ac3ee1f-88e3-4eb7-a360-710cc7c7018c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 1, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:08.715752 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-7ac3ee1f-88e3-4eb7-a360-710cc7c7018c admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.494291 Oct 17 15:13:08.716375 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 11/22] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:13:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:13:08.729537 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-9c606a54-ca32-4e5d-862e-8061d146e33c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:08.765600 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-9c606a54-ca32-4e5d-862e-8061d146e33c admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040030 Oct 17 15:13:08.766283 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 12/23] 10.222.0.87 () {64 vars in 1333 bytes} [Mon Oct 17 15:13:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:13:11.582053 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-7ac3ee1f-88e3-4eb7-a360-710cc7c7018c admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:11.583112 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-7ac3ee1f-88e3-4eb7-a360-710cc7c7018c admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Oct 17 15:13:11.583478 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 12/24] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:13:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:13:12.018327 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-b802418e-a999-491d-a997-8ab6c280e64a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "name": "m1.small"}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:12.038797 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-b802418e-a999-491d-a997-8ab6c280e64a admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448765 Oct 17 15:13:12.039547 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 13/25] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:13:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:13:12.051737 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-23421843-f842-4238-9248-8ec23583cddb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:12.077667 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-23421843-f842-4238-9248-8ec23583cddb admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029718 Oct 17 15:13:12.078229 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 13/26] 10.222.0.87 () {64 vars in 1333 bytes} [Mon Oct 17 15:13:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:13:14.718580 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-b802418e-a999-491d-a997-8ab6c280e64a admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:14.719747 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-b802418e-a999-491d-a997-8ab6c280e64a admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 17 15:13:14.720155 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 14/27] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:13:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:15.193219 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-0208fe9c-8556-4629-83bb-2129ba6d6277 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:15.216607 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-0208fe9c-8556-4629-83bb-2129ba6d6277 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.489816 Oct 17 15:13:15.217362 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 14/28] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:13:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:13:15.233001 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-25f03db8-87e2-42a4-9629-05d31b0c616e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:15.238790 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:13:15.270706 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-25f03db8-87e2-42a4-9629-05d31b0c616e admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041409 Oct 17 15:13:15.271495 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 15/29] 10.222.0.87 () {64 vars in 1333 bytes} [Mon Oct 17 15:13:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:13:17.945656 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-0208fe9c-8556-4629-83bb-2129ba6d6277 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:17.946741 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-0208fe9c-8556-4629-83bb-2129ba6d6277 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 17 15:13:17.947351 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 15/30] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:13:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:18.414281 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-5a7884a1-a189-4857-81dc-6d447652a45d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "disk": 80, "swap": 0}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:18.439992 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-5a7884a1-a189-4857-81dc-6d447652a45d admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.485961 Oct 17 15:13:18.440627 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 16/31] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:13:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:13:18.453005 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-90c4b618-9ab1-4eff-91e0-0c5d07734ca5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:18.478462 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-90c4b618-9ab1-4eff-91e0-0c5d07734ca5 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029171 Oct 17 15:13:18.479083 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 16/32] 10.222.0.87 () {64 vars in 1333 bytes} [Mon Oct 17 15:13:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:13:21.111196 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-5a7884a1-a189-4857-81dc-6d447652a45d admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:21.113018 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-5a7884a1-a189-4857-81dc-6d447652a45d admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002409 Oct 17 15:13:21.122603 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 17/33] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:13:21 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:21.578863 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-608c4556-cbc0-4731-85d5-0063eb6d1698 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "name": "m1.xlarge"}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:21.587082 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:13:21.604838 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-608c4556-cbc0-4731-85d5-0063eb6d1698 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.484794 Oct 17 15:13:21.605881 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 17/34] 10.222.0.87 () {64 vars in 1283 bytes} [Mon Oct 17 15:13:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:13:21.618562 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-fedf0cd3-3403-4097-8c3f-ce0a24ce48bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:21.648741 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-fedf0cd3-3403-4097-8c3f-ce0a24ce48bd admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033798 Oct 17 15:13:21.649359 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 18/35] 10.222.0.87 () {64 vars in 1333 bytes} [Mon Oct 17 15:13:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:13:42.183455 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-608c4556-cbc0-4731-85d5-0063eb6d1698 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:42.184727 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-608c4556-cbc0-4731-85d5-0063eb6d1698 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Oct 17 15:13:42.185263 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 18/36] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:13:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:42.198759 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:13:42.639331 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-3f1e6971-85fb-4b1c-b018-fe0a6b1d060d admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:42.658411 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-3f1e6971-85fb-4b1c-b018-fe0a6b1d060d admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.464466 Oct 17 15:13:42.659015 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 19/37] 10.222.0.87 () {60 vars in 1292 bytes} [Mon Oct 17 15:13:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:13:44.040925 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-608c4556-cbc0-4731-85d5-0063eb6d1698 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:44.041953 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-608c4556-cbc0-4731-85d5-0063eb6d1698 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 17 15:13:44.042647 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 19/38] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:13:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:44.593582 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-187044e5-885b-406f-ba89-99263cfd80f2 admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:44.599150 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.wsgi [None req-187044e5-885b-406f-ba89-99263cfd80f2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-187044e5-885b-406f-ba89-99263cfd80f2 admin admin] Request method failure captured: Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: Accept: application/json Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: Accept-Encoding: gzip, deflate Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: Connection: keep-alive Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: Content-Length: 0 Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: Host: 10.222.0.87 Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: Openstack-Api-Version: compute 2.92 Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: Openstack-System-Scope: None Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: User-Agent: python-novaclient Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Auth-Token: gAAAAABjTXEnEQoFdzMZFwTwHi-hL7zxkLvSyuUVNjUwYLU00QDMDkhOxpQew4pl3bbO7XydYhfnIwzmlQjvlFOZs7gB9aWn1-WMRjLV7SGvccicUJ9I3A0ayqZftm-nzQWWURU9wlxEEqS16y2F0bhuiW3LoOUK1dPtQ9E5eSo4-JIHbWpSF4c Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Domain-Id: None Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Domain-Name: None Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Identity-Status: Confirmed Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Is-Admin-Project: True Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Domain-Id: default Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Domain-Name: Default Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Name: admin Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Role: member,reader,admin Oct 17 15:13:44.602347 n-d-854441-12 devstack@n-api.service[104490]: X-Roles: member,reader,admin Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: X-Tenant: admin Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: X-Tenant-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: X-Tenant-Name: admin Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: X-User: admin Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: X-User-Domain-Id: default Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: X-User-Domain-Name: Default Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: X-User-Id: 3eb73d13511b4df586f6a1f6a2e863b7 Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: X-User-Name: admin Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: method: > Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: exception: Flavor 42 could not be found. Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: action_args: {'id': '42'} Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:13:44.604991 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:44.606820 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.609091 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-187044e5-885b-406f-ba89-99263cfd80f2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104490) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:13:44.611421 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-187044e5-885b-406f-ba89-99263cfd80f2 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398206 Oct 17 15:13:44.611421 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 20/39] 10.222.0.87 () {60 vars in 1190 bytes} [Mon Oct 17 15:13:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:13:44.615275 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-99bf1d6c-ca03-49b7-9354-a4c596de47cf admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:44.638722 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-99bf1d6c-ca03-49b7-9354-a4c596de47cf admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027794 Oct 17 15:13:44.639283 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 20/40] 10.222.0.87 () {60 vars in 1210 bytes} [Mon Oct 17 15:13:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:13:44.650944 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-5b81a7b7-c24f-475e-89e8-5da5b87ba422 admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:44.673636 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-5b81a7b7-c24f-475e-89e8-5da5b87ba422 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027290 Oct 17 15:13:44.674269 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 21/41] 10.222.0.87 () {60 vars in 1210 bytes} [Mon Oct 17 15:13:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:13:44.684274 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-7eae4fdd-db1e-4c7a-a201-556cc7319b14 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:44.689873 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.wsgi [None req-7eae4fdd-db1e-4c7a-a201-556cc7319b14 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-7eae4fdd-db1e-4c7a-a201-556cc7319b14 admin admin] Request method failure captured: Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: Accept: application/json Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: Accept-Encoding: gzip, deflate Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: Connection: keep-alive Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: Content-Length: 0 Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: Host: 10.222.0.87 Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: Openstack-Api-Version: compute 2.92 Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: Openstack-System-Scope: None Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: User-Agent: python-novaclient Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Auth-Token: gAAAAABjTXEnEQoFdzMZFwTwHi-hL7zxkLvSyuUVNjUwYLU00QDMDkhOxpQew4pl3bbO7XydYhfnIwzmlQjvlFOZs7gB9aWn1-WMRjLV7SGvccicUJ9I3A0ayqZftm-nzQWWURU9wlxEEqS16y2F0bhuiW3LoOUK1dPtQ9E5eSo4-JIHbWpSF4c Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Domain-Id: None Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Domain-Name: None Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Identity-Status: Confirmed Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Is-Admin-Project: True Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Domain-Id: default Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Domain-Name: Default Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Name: admin Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Role: member,reader,admin Oct 17 15:13:44.693191 n-d-854441-12 devstack@n-api.service[104489]: X-Roles: member,reader,admin Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: X-Tenant: admin Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: X-Tenant-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: X-Tenant-Name: admin Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: X-User: admin Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: X-User-Domain-Id: default Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: X-User-Domain-Name: Default Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: X-User-Id: 3eb73d13511b4df586f6a1f6a2e863b7 Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: X-User-Name: admin Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: method: > Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: exception: Flavor 42 could not be found. Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: action_args: {'id': '42'} Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:13:44.695570 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:44.697097 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:44.699111 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-7eae4fdd-db1e-4c7a-a201-556cc7319b14 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:13:44.701073 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-7eae4fdd-db1e-4c7a-a201-556cc7319b14 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013980 Oct 17 15:13:44.701073 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 21/42] 10.222.0.87 () {60 vars in 1190 bytes} [Mon Oct 17 15:13:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:13:45.942669 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-5b81a7b7-c24f-475e-89e8-5da5b87ba422 admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:45.943738 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-5b81a7b7-c24f-475e-89e8-5da5b87ba422 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Oct 17 15:13:45.944148 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 22/43] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:13:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:46.478765 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-abe1eb47-9ad2-4755-b808-763c2dd031b9 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:46.484140 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.wsgi [None req-abe1eb47-9ad2-4755-b808-763c2dd031b9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-abe1eb47-9ad2-4755-b808-763c2dd031b9 admin admin] Request method failure captured: Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: Accept: application/json Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: Accept-Encoding: gzip, deflate Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: Connection: keep-alive Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: Content-Length: 0 Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: Host: 10.222.0.87 Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: Openstack-Api-Version: compute 2.92 Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: Openstack-System-Scope: None Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: User-Agent: python-novaclient Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Auth-Token: gAAAAABjTXEpK4Wj7gu6rIS8Ml50ha7qPYb52e1VOhxGz-hotgMS4sDXeqNz5A-yST0ZPp5-0dQlOZU7jcH8tZtzbso96_OebctAUSRslncgcVuI5lznqS5Y2jxKkf9MIkNFvJamao5T-DGh5ptLazX1hefSkIRU8HY6-u_ax16MGekCVX1Gej8 Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Domain-Id: None Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Domain-Name: None Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Identity-Status: Confirmed Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Is-Admin-Project: True Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Domain-Id: default Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Domain-Name: Default Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Name: admin Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Role: member,reader,admin Oct 17 15:13:46.485643 n-d-854441-12 devstack@n-api.service[104489]: X-Roles: member,reader,admin Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: X-Tenant: admin Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: X-Tenant-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: X-Tenant-Name: admin Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: X-User: admin Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: X-User-Domain-Id: default Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: X-User-Domain-Name: Default Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: X-User-Id: 3eb73d13511b4df586f6a1f6a2e863b7 Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: X-User-Name: admin Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: method: > Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: exception: Flavor 84 could not be found. Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: action_args: {'id': '84'} Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:13:46.487156 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:46.488047 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.489233 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-abe1eb47-9ad2-4755-b808-763c2dd031b9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:13:46.490375 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-abe1eb47-9ad2-4755-b808-763c2dd031b9 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.409321 Oct 17 15:13:46.490375 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 22/44] 10.222.0.87 () {60 vars in 1190 bytes} [Mon Oct 17 15:13:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:13:46.497138 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-d569e256-c623-4c6c-ad2d-b1e17f5a370c admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:46.512720 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-d569e256-c623-4c6c-ad2d-b1e17f5a370c admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019234 Oct 17 15:13:46.513270 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 23/45] 10.222.0.87 () {60 vars in 1210 bytes} [Mon Oct 17 15:13:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:13:46.523012 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-28f0c4f0-ae6a-434d-8a2a-336b5d9497ed admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:46.539206 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-28f0c4f0-ae6a-434d-8a2a-336b5d9497ed admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019700 Oct 17 15:13:46.539754 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 23/46] 10.222.0.87 () {60 vars in 1210 bytes} [Mon Oct 17 15:13:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:13:46.549992 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-6c5997b6-16c4-4bf0-ac90-0eeed2ed91c5 admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:46.555440 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.wsgi [None req-6c5997b6-16c4-4bf0-ac90-0eeed2ed91c5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-6c5997b6-16c4-4bf0-ac90-0eeed2ed91c5 admin admin] Request method failure captured: Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: Accept: application/json Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: Accept-Encoding: gzip, deflate Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: Connection: keep-alive Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: Content-Length: 0 Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: Host: 10.222.0.87 Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: Openstack-Api-Version: compute 2.92 Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: Openstack-System-Scope: None Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: User-Agent: python-novaclient Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Auth-Token: gAAAAABjTXEpK4Wj7gu6rIS8Ml50ha7qPYb52e1VOhxGz-hotgMS4sDXeqNz5A-yST0ZPp5-0dQlOZU7jcH8tZtzbso96_OebctAUSRslncgcVuI5lznqS5Y2jxKkf9MIkNFvJamao5T-DGh5ptLazX1hefSkIRU8HY6-u_ax16MGekCVX1Gej8 Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Domain-Id: None Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Domain-Name: None Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Identity-Status: Confirmed Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Is-Admin-Project: True Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Domain-Id: default Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Domain-Name: Default Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Name: admin Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Role: member,reader,admin Oct 17 15:13:46.556995 n-d-854441-12 devstack@n-api.service[104490]: X-Roles: member,reader,admin Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: X-Tenant: admin Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: X-Tenant-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: X-Tenant-Name: admin Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: X-User: admin Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: X-User-Domain-Id: default Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: X-User-Domain-Name: Default Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: X-User-Id: 3eb73d13511b4df586f6a1f6a2e863b7 Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: X-User-Name: admin Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: method: > Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: exception: Flavor 84 could not be found. Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: action_args: {'id': '84'} Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:13:46.558667 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:46.559510 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:46.560546 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-6c5997b6-16c4-4bf0-ac90-0eeed2ed91c5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104490) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:13:46.561614 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-6c5997b6-16c4-4bf0-ac90-0eeed2ed91c5 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012355 Oct 17 15:13:46.561614 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 24/47] 10.222.0.87 () {60 vars in 1190 bytes} [Mon Oct 17 15:13:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:13:47.795244 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-28f0c4f0-ae6a-434d-8a2a-336b5d9497ed admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:47.796285 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-28f0c4f0-ae6a-434d-8a2a-336b5d9497ed admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Oct 17 15:13:47.796710 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 24/48] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:13:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:48.328130 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-b989d977-46e5-4765-a193-abd4600a73a5 admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:48.335016 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.wsgi [None req-b989d977-46e5-4765-a193-abd4600a73a5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-b989d977-46e5-4765-a193-abd4600a73a5 admin admin] Request method failure captured: Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: Accept: application/json Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: Accept-Encoding: gzip, deflate Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: Connection: keep-alive Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: Content-Length: 0 Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: Host: 10.222.0.87 Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: Openstack-Api-Version: compute 2.92 Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: Openstack-System-Scope: None Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: User-Agent: python-novaclient Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Auth-Token: gAAAAABjTXErlVLv-UAd7OTqM_WLtfcSpJbS36fboxp3aBOW8_Jl58rrx8tb_hcKV_qSdpgC-LeOj7mYcCflU8CX01BeBHkL3sNoIeaVdn_zgbiEpcVo-NNlKCDdLSZj9zoaoDnTGmEUuT-BxkXOp5E-zINY3zXLUSikjHrEfWm7yQdcvXkQPcE Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Domain-Id: None Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Domain-Name: None Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Identity-Status: Confirmed Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Is-Admin-Project: True Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Domain-Id: default Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Domain-Name: Default Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Project-Name: admin Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Role: member,reader,admin Oct 17 15:13:48.336536 n-d-854441-12 devstack@n-api.service[104490]: X-Roles: member,reader,admin Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: X-Tenant: admin Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: X-Tenant-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: X-Tenant-Name: admin Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: X-User: admin Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: X-User-Domain-Id: default Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: X-User-Domain-Name: Default Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: X-User-Id: 3eb73d13511b4df586f6a1f6a2e863b7 Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: X-User-Name: admin Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: method: > Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: exception: Flavor 451 could not be found. Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: action_args: {'id': '451'} Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:13:48.337871 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:48.338679 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.339786 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-b989d977-46e5-4765-a193-abd4600a73a5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104490) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:13:48.340780 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-b989d977-46e5-4765-a193-abd4600a73a5 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.408310 Oct 17 15:13:48.340780 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 25/49] 10.222.0.87 () {60 vars in 1193 bytes} [Mon Oct 17 15:13:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:13:48.348440 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-b9960815-a76d-4a51-b66b-073363cb47e1 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:48.364012 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-b9960815-a76d-4a51-b66b-073363cb47e1 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019317 Oct 17 15:13:48.364558 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 25/50] 10.222.0.87 () {60 vars in 1210 bytes} [Mon Oct 17 15:13:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:13:48.374321 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:48.389811 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019083 Oct 17 15:13:48.390393 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 26/51] 10.222.0.87 () {60 vars in 1210 bytes} [Mon Oct 17 15:13:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:13:48.400015 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-028d7d86-90d1-437f-a61b-afaea1f470a2 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:48.405321 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.wsgi [None req-028d7d86-90d1-437f-a61b-afaea1f470a2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-028d7d86-90d1-437f-a61b-afaea1f470a2 admin admin] Request method failure captured: Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: Accept: application/json Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: Accept-Encoding: gzip, deflate Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: Connection: keep-alive Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: Content-Length: 0 Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: Host: 10.222.0.87 Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: Openstack-Api-Version: compute 2.92 Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: Openstack-System-Scope: None Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: User-Agent: python-novaclient Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Auth-Token: gAAAAABjTXErlVLv-UAd7OTqM_WLtfcSpJbS36fboxp3aBOW8_Jl58rrx8tb_hcKV_qSdpgC-LeOj7mYcCflU8CX01BeBHkL3sNoIeaVdn_zgbiEpcVo-NNlKCDdLSZj9zoaoDnTGmEUuT-BxkXOp5E-zINY3zXLUSikjHrEfWm7yQdcvXkQPcE Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Domain-Id: None Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Domain-Name: None Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Identity-Status: Confirmed Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Is-Admin-Project: True Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Domain-Id: default Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Domain-Name: Default Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Project-Name: admin Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Role: member,reader,admin Oct 17 15:13:48.406947 n-d-854441-12 devstack@n-api.service[104489]: X-Roles: member,reader,admin Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5091ac65290e46d7b4a36ff20cccb016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: X-Tenant: admin Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: X-Tenant-Id: 5091ac65290e46d7b4a36ff20cccb016 Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: X-Tenant-Name: admin Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: X-User: admin Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: X-User-Domain-Id: default Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: X-User-Domain-Name: Default Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: X-User-Id: 3eb73d13511b4df586f6a1f6a2e863b7 Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: X-User-Name: admin Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: method: > Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: exception: Flavor 451 could not be found. Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: action_args: {'id': '451'} Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:13:48.408239 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:48.409010 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: ERROR nova.api.openstack.wsgi Oct 17 15:13:48.410163 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-028d7d86-90d1-437f-a61b-afaea1f470a2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:13:48.411502 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-028d7d86-90d1-437f-a61b-afaea1f470a2 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012050 Oct 17 15:13:48.411502 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 26/52] 10.222.0.87 () {60 vars in 1193 bytes} [Mon Oct 17 15:13:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:13:49.632612 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:49.633634 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 17 15:13:49.634026 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 27/53] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:13:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:50.169951 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-6399ce2c-e190-49e6-9961-1db8ebe1e365 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:50.192168 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-6399ce2c-e190-49e6-9961-1db8ebe1e365 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.422860 Oct 17 15:13:50.192732 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 27/54] 10.222.0.87 () {64 vars in 1235 bytes} [Mon Oct 17 15:13:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:13:51.416062 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:51.417080 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 17 15:13:51.417483 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 28/55] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:13:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:13:51.953444 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-8c448c1d-5ed5-4e6d-9b20-42e1e4ff16f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:51.974230 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-8c448c1d-5ed5-4e6d-9b20-42e1e4ff16f5 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.420765 Oct 17 15:13:51.974832 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 28/56] 10.222.0.87 () {64 vars in 1235 bytes} [Mon Oct 17 15:13:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:13:53.203127 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:53.204188 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Oct 17 15:13:53.204586 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 29/57] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:53.747677 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-d6331678-10be-4db3-b1bc-54ee236f4a89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:53.768433 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-d6331678-10be-4db3-b1bc-54ee236f4a89 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.428540 Oct 17 15:13:53.768987 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 29/58] 10.222.0.87 () {64 vars in 1235 bytes} [Mon Oct 17 15:13:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:13:55.006066 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:55.007113 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Oct 17 15:13:55.007484 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 30/59] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:13:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:55.583024 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-06ec927d-7cbe-4b8a-a0e6-d361e95ec6bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:13:55.607420 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-06ec927d-7cbe-4b8a-a0e6-d361e95ec6bd admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.457990 Oct 17 15:13:55.607976 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 30/60] 10.222.0.87 () {64 vars in 1235 bytes} [Mon Oct 17 15:13:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:13:56.865537 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:56.866583 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 17 15:13:56.867008 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 31/61] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:13:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:13:57.436692 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-e8887389-53f2-4082-ad5a-f891232e5fb0 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:13:57.458036 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-e8887389-53f2-4082-ad5a-f891232e5fb0 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.450184 Oct 17 15:13:57.458610 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 31/62] 10.222.0.87 () {60 vars in 1202 bytes} [Mon Oct 17 15:13:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:14:55.908050 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:14:55.909007 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-00999240-65fa-4177-a3b5-3ab30d686dae admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 17 15:14:55.909385 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 32/63] 10.222.0.87 () {54 vars in 931 bytes} [Mon Oct 17 15:14:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:14:55.920533 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:14:56.327940 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-7387781c-7a31-4a03-827d-d71843754375 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:14:56.348804 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-7387781c-7a31-4a03-827d-d71843754375 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.432840 Oct 17 15:14:56.349328 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 32/64] 10.222.0.87 () {60 vars in 1292 bytes} [Mon Oct 17 15:14:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:14:56.371332 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writing DB stats nova_api:SELECT=14 {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:14:56.375338 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-a640411c-8049-4eeb-82cf-0487c1152d83 admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:14:56.383300 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-a640411c-8049-4eeb-82cf-0487c1152d83 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013558 Oct 17 15:14:56.383862 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 33/65] 10.222.0.87 () {60 vars in 1283 bytes} [Mon Oct 17 15:14:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:14:56.396654 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-da39e45e-2e92-4909-a80b-41de43d86020 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:14:56.404305 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-da39e45e-2e92-4909-a80b-41de43d86020 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011372 Oct 17 15:14:56.404859 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 33/66] 10.222.0.87 () {60 vars in 1286 bytes} [Mon Oct 17 15:14:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:14:56.417002 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-c889347a-5587-474c-94bb-f5a1007d866a admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:14:56.424630 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-c889347a-5587-474c-94bb-f5a1007d866a admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011385 Oct 17 15:14:56.425168 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 34/67] 10.222.0.87 () {60 vars in 1286 bytes} [Mon Oct 17 15:14:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:14:56.437154 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-ffcd2965-6d48-4ba2-b109-991bed67deea admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:14:56.444773 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-ffcd2965-6d48-4ba2-b109-991bed67deea admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011324 Oct 17 15:14:56.445276 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 34/68] 10.222.0.87 () {60 vars in 1283 bytes} [Mon Oct 17 15:14:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:20:22.935999 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-c889347a-5587-474c-94bb-f5a1007d866a admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:20:22.937022 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-c889347a-5587-474c-94bb-f5a1007d866a admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 17 15:20:22.937425 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 35/69] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:20:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:20:23.074596 n-d-854441-12 devstack@n-api.service[104489]: DEBUG dbcounter [-] [104489] Writing DB stats nova_api:SELECT=6 {{(pid=104489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:20:23.225379 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-113dc857-c104-4162-8c31-0b504ee128a8 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:20:23.230205 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-113dc857-c104-4162-8c31-0b504ee128a8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:20:23.230720 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-113dc857-c104-4162-8c31-0b504ee128a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:20:23.231140 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-113dc857-c104-4162-8c31-0b504ee128a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:20:23.231846 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-113dc857-c104-4162-8c31-0b504ee128a8 admin admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:20:23.232284 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-113dc857-c104-4162-8c31-0b504ee128a8 admin admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:20:23.232705 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-113dc857-c104-4162-8c31-0b504ee128a8 admin admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:20:23.271271 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-113dc857-c104-4162-8c31-0b504ee128a8 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.197834 Oct 17 15:20:23.271836 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 35/70] 10.222.0.87 () {60 vars in 1193 bytes} [Mon Oct 17 15:20:23 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:20:24.374851 n-d-854441-12 devstack@n-api.service[104490]: DEBUG nova.api.openstack.wsgi [None req-c889347a-5587-474c-94bb-f5a1007d866a admin admin] Calling method '>' {{(pid=104490) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:20:24.375876 n-d-854441-12 devstack@n-api.service[104490]: INFO nova.api.openstack.requestlog [None req-c889347a-5587-474c-94bb-f5a1007d866a admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Oct 17 15:20:24.376285 n-d-854441-12 devstack@n-api.service[104490]: [pid: 104490|app: 0|req: 36/71] 10.222.0.87 () {56 vars in 1074 bytes} [Mon Oct 17 15:20:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:20:24.581115 n-d-854441-12 devstack@n-api.service[104489]: DEBUG nova.api.openstack.wsgi [None req-0936a505-5cbb-40d5-9d0f-435d2fffd438 admin admin] Calling method '>' {{(pid=104489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:20:24.584741 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-0936a505-5cbb-40d5-9d0f-435d2fffd438 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:20:24.585645 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-0936a505-5cbb-40d5-9d0f-435d2fffd438 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:20:24.585645 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-0936a505-5cbb-40d5-9d0f-435d2fffd438 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:20:24.586361 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-0936a505-5cbb-40d5-9d0f-435d2fffd438 admin admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:20:24.586837 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-0936a505-5cbb-40d5-9d0f-435d2fffd438 admin admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:20:24.587255 n-d-854441-12 devstack@n-api.service[104489]: DEBUG oslo_concurrency.lockutils [None req-0936a505-5cbb-40d5-9d0f-435d2fffd438 admin admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:20:24.611116 n-d-854441-12 devstack@n-api.service[104489]: INFO nova.api.openstack.requestlog [None req-0936a505-5cbb-40d5-9d0f-435d2fffd438 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.090126 Oct 17 15:20:24.611715 n-d-854441-12 devstack@n-api.service[104489]: [pid: 104489|app: 0|req: 36/72] 10.222.0.87 () {60 vars in 1193 bytes} [Mon Oct 17 15:20:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:21:10.999871 n-d-854441-12 devstack@n-api.service[104488]: Mon Oct 17 15:21:10 2022 - graceful shutdown triggered... Oct 17 15:21:10.999987 n-d-854441-12 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 15:21:11.001100 n-d-854441-12 devstack@n-api.service[104489]: Gracefully killing worker 1 (pid: 104489)... Oct 17 15:21:11.001493 n-d-854441-12 devstack@n-api.service[104490]: Gracefully killing worker 2 (pid: 104490)... Oct 17 15:21:11.137344 n-d-854441-12 devstack@n-api.service[104490]: DEBUG dbcounter [-] [104490] Writing DB stats nova_api:SELECT=4 {{(pid=104490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:21:12.002170 n-d-854441-12 devstack@n-api.service[104488]: worker 1 buried after 1 seconds Oct 17 15:21:12.002170 n-d-854441-12 devstack@n-api.service[104488]: worker 2 buried after 1 seconds Oct 17 15:21:12.002170 n-d-854441-12 devstack@n-api.service[104488]: goodbye to uWSGI. Oct 17 15:21:12.003821 n-d-854441-12 systemd[1]: devstack@n-api.service: Succeeded. Oct 17 15:21:12.004408 n-d-854441-12 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 15:21:12.007362 n-d-854441-12 systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 15:21:12.028543 n-d-854441-12 devstack@n-api.service[120397]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 15:21:12 2022] *** Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: nodename: n-d-854441-12 Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: machine: x86_64 Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: clock source: unix Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: pcre jit disabled Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: detected number of CPU cores: 4 Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: current working directory: / Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: detected binary path: /usr/bin/uwsgi-core Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: your processes number limit is 47680 Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: your memory page size is 4096 bytes Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: detected max file descriptor number: 2048 Oct 17 15:21:12.052933 n-d-854441-12 devstack@n-api.service[120397]: lock engine: pthread robust mutexes Oct 17 15:21:12.054795 n-d-854441-12 devstack@n-api.service[120397]: thunder lock: enabled Oct 17 15:21:12.054795 n-d-854441-12 devstack@n-api.service[120397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 15:21:12.054795 n-d-854441-12 devstack@n-api.service[120397]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 15:21:12.095631 n-d-854441-12 devstack@n-api.service[120397]: Python main interpreter initialized at 0x56418724d9c0 Oct 17 15:21:12.095631 n-d-854441-12 devstack@n-api.service[120397]: python threads support enabled Oct 17 15:21:12.095631 n-d-854441-12 devstack@n-api.service[120397]: your server socket listen backlog is limited to 100 connections Oct 17 15:21:12.095631 n-d-854441-12 devstack@n-api.service[120397]: your mercy for graceful operations on workers is 90 seconds Oct 17 15:21:12.096264 n-d-854441-12 devstack@n-api.service[120397]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 15:21:12.096264 n-d-854441-12 devstack@n-api.service[120397]: *** Operational MODE: preforking *** Oct 17 15:21:12.096493 n-d-854441-12 devstack@n-api.service[120397]: *** uWSGI is running in multiple interpreter mode *** Oct 17 15:21:12.096493 n-d-854441-12 devstack@n-api.service[120397]: spawned uWSGI master process (pid: 120397) Oct 17 15:21:12.096642 n-d-854441-12 systemd[1]: Started Devstack devstack@n-api.service. Oct 17 15:21:12.097690 n-d-854441-12 devstack@n-api.service[120397]: spawned uWSGI worker 1 (pid: 120406, cores: 1) Oct 17 15:21:12.097690 n-d-854441-12 devstack@n-api.service[120397]: spawned uWSGI worker 2 (pid: 120407, cores: 1) Oct 17 15:21:12.097690 n-d-854441-12 devstack@n-api.service[120397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 15:21:12.758538 n-d-854441-12 devstack@n-api.service[120407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 15:21:12.761863 n-d-854441-12 devstack@n-api.service[120406]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 15:21:13.921783 n-d-854441-12 devstack@n-api.service[120407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 15:21:13.921783 n-d-854441-12 devstack@n-api.service[120407]: from cryptography.utils import int_from_bytes Oct 17 15:21:13.922415 n-d-854441-12 devstack@n-api.service[120407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 15:21:13.922415 n-d-854441-12 devstack@n-api.service[120407]: from cryptography.utils import int_from_bytes Oct 17 15:21:13.926247 n-d-854441-12 devstack@n-api.service[120406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 15:21:13.926247 n-d-854441-12 devstack@n-api.service[120406]: from cryptography.utils import int_from_bytes Oct 17 15:21:13.926833 n-d-854441-12 devstack@n-api.service[120406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 15:21:13.926833 n-d-854441-12 devstack@n-api.service[120406]: from cryptography.utils import int_from_bytes Oct 17 15:21:16.400006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 15:21:16.400678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 15:21:16.400678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 15:21:16.401053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 15:21:16.401295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 15:21:16.401686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.402012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.402333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.402702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.403033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.403344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.403685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.403983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.404318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.404569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.404880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.405425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854441-12 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.405750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.406056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.406354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.406713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.407034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.407359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.407668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.408181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.409651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.409651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.409651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.409651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.410002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.410230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.410546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.410823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.411146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.411459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.411862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854441-12 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.412187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.412487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.413306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.413306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.413510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.413849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.414156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.414489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.414825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.415187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.415503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.415825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.416160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.416464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.416762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.417084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.417403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.417711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.418024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.418275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.418649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.418978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.419299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.419627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.419888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.420137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.420458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.420869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.421264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.421492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.421796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.422235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.422441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.422757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.423029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.423343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.423679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.423997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.424328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.424637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.424962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.425375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.425628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.425935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.426284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.426725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.427050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.427362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.427682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.427996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.428317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.428626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.428935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.429273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.429581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.429832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.430132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.430444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.430797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.431106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.431406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.431717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.432018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.432354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.432624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.432928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.433236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.433541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.433878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.434182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.434488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.434827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.435235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.435472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.435798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.436112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.436474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.436786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.437093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.437419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.437720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.438033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.438365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.438709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.439019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.439339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.439656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.439964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.440283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.440585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.440893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.441212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.441522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.441828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.442137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.442447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.442792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.443095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.443397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.443711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.444039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.444335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.444663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.444982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.445283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.445589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.445919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.446259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.446629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.446987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.447304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.447642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.447974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.448296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.448618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.448935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.449270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.449581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.449897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.450208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.450553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.450882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.451221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.451542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.451901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.452264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.452581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.452901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.453244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.453573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.453896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.454242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.454624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.454944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.455271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.455602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.455917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.456232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.456556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.456905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.457225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.457534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.457858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.458442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.458709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.458941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.459181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.459408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.460902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.460902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.460902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.460902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.461850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.461850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.461850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.462553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.462553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.462553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.463226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.463226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.463655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.463883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.464118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.464433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.464677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.466193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.466193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.466193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.466193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.466193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.467060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.467060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.467060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.467495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.467936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.468101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.468364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.468675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.468984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.469314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.469620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.469930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.470252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.470591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.471098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.471580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.472067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.472559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.473046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.473514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.474026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.474540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.475044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.475379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.475718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.476041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.476502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.477095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.477411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.477720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.478031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.478349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.478685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.479216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.479884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.479884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.480113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.480619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.480940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.481253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.481562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.481869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.482382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.482587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.482951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.483392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.483728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.484096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.484414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.484738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.485077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.485368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.485701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.486005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.486568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.486832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.487061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.487728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.487728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.488039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.488220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.488530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.488852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.489199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.489539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.489862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.490189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.490526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.490851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.491164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.491479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.491793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.492105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.492429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.492741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.493061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.493375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.493708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.494018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.494340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.494683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.495000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.495336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.495875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.496999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.497388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.497905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.498059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.498438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.498986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.499306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.499627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.499946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.500275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.500594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.500910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.501228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.501547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.501864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.502173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.502482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.502836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.503172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.503489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.503822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.504149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.504459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.504768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.505098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.505411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.505720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.506028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.506339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.506719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.507029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.507337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.507656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.507976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.508288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.508610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.508924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.509238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.509558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.509876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.510185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.510517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.510835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.511149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.511464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.511789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.512471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.512570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 15:21:16.512997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 15:21:16.513087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.513087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.513263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 15:21:16.513380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.513634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 15:21:16.513724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.513896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 15:21:16.514058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.514287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.514658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.514782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.515000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.515090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.515321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.515436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.515643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.515732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.515959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.516046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.516284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.516387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.516608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.516721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.516945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.517045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.517204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.517301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.517521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.517619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.517847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.517994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854441-12 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.518153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.518325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.518459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.518668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.518798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.518970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.519089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.519298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.519458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.519609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.519699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.519937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.520033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.520250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.520365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.520566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.520778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.520928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.521102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.521276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.521404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.522207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.522312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.522385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.522464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.522581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.522657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.522726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.522802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.522923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.523014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.523235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.523315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.523543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.523629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.523986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.524092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.524235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.524335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854441-12 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.524502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.524628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.524814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.524955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.525165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.525304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.525499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.525679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.525840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.526144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.526276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.526455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.526817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.527074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.527195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.527420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.527729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.527841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.528041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.528156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.528351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.528495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.528657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.528828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.528974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.529163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.529277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.529500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.529646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.529828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.530013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.530270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.530363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.530727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.530868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.531043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.531181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.531368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.531667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.531764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.532120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.532217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.532292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.532390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.532531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.532646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.532844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.532938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.533177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.533308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.533506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.533631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.533840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.533943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.534101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.534318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.534545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.534673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.534807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.534977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.535097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.535192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.535315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.535464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.535630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.535780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.535943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.536084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.536257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.536421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.536567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.536740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.536878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.537048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.537186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.537353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.537496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.537669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.537825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.537952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.538147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.538272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.538479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.538651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.538819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.538972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.539172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.539358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.539507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.539662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.539833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.539920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.540073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.540162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.540378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.540506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.540685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.540777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.540993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.541090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.541298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.541389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.541602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.541692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.541905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.542010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.542218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.542308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.542544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.542651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.542880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.542992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.543191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.543290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.543496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.543599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.543750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.543848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.544055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.544152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.544366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.544455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.544687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.544785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.544997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.545113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.545307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.545402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.545656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.545772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.545962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.546059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.546271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.546415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.546605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.546718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.546916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.547077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.547227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.547363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.547535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.547663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.547843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.547984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.548150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.548278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.548575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.548722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.548848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.549137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.549137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.549386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.549524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.549612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.549737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.549970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.549970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.550148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.550272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.550372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.550615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.550884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.550976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.551059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.551274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.551409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.551516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.551608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.551923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.552033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.552143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.552232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.552450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.552548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.552766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.552856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.553080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.553176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.553389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.553519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.553699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.553833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.554017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.554106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.554319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.554440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.554654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.554791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.554966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.555071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.555274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.555414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.555605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.555696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.555918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.556016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.556225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.556330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.556529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.556619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.556833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.556931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.557134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.557221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.557439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.557528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.557742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.557889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.558064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.558204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.558390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.559111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.559262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.559372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.559493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.559602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.559709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.559821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.559944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 15:21:16.560110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.560241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.560349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.560455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.560573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.560742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.560856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.560970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.561084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.561322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.561546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.561677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.561978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.562156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.562326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.562524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.562665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.562845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.563063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.563189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.563298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.563410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.563527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.563636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.563848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.563963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.564171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.564301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.566602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.566729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.566837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.566927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.567998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.568079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.568326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.568421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.568505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.568586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.568716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.568840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.568973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.569069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.569204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.569335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.569429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.569526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.569626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.569717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.569896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.569991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.570084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.570176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.570268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.570357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.570441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.570597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.570716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.570933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.571034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.571264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.571354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.571584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.571682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.571914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.572011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.572268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.572357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.572583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.572684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.572900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.572990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.573218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.573309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.573533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.573637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.573878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.573976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.574185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.574275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.574537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.574648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.574844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.574982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.575161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.575297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.575483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.575693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.575820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.575943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.576099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.576189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.576406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.576498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.576717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.576807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.577067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.577165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.577374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.577464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.577689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.577780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.577993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.578128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.578317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.578451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.579022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.579148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.579148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.579362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.579362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.579578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.579684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.579789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.579903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.580017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.580199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.580322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.580509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.580633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.580816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.580945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.581122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.581244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.581433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.581546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.581741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.581865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.582071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.582185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.582387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.582611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.582738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.582858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.583041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.583156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.583358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.583480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.583670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.583792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.583990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.584116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.584305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.584447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.586272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.586946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.587915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.588995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.589937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.590077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.590171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.590262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.590346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.590471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.590627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.590721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.590811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.591009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.591100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.591326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.591427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.591651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.591739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.591964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.592056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.592273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.592374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.592646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.592738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.592958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.593049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.593286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.593391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.593603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.593690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.593927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.594024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.594244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.594335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.594597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.594704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.594921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.595017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.595235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.595325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.595554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.595814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.595932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.596147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.596278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.596468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.596582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.596783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.596910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.597097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.597194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.597410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.597505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.597727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.597822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.598039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.598134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.598353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.598449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.598693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.598783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.599008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.599106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.599315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.599411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.599636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.599732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.599976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.600066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.600317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.600416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.600637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.600741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.600956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.601052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.601272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.601359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.601588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.601689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.601901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.601992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.602222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.602456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.602577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.602664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.602857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.602955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.603182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.603271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.603497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.603598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.603819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.603915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.604132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.604231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.604447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.604543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.604760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.604855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.605071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.605173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.605376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.605464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.605693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.605820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.606011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.606135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.606339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.606454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.606680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.606794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.607000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.607113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.607319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.607406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.607637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.607734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.607951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.608043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.608296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.608523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.608622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.608835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.609005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.609173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.609265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.609506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.609605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.609822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.609929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.610145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.610241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.610452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.610561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.610799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.610918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.611115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.611205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.611422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.611514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.611731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.611823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.612045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.612135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.612355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.612446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.612673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.612764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.612990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.613081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.613298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.613389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.613612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.613709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.613920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.614011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.614249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.614457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.614656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.614833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.614968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.615154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.615280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.615485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.615575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.615821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.616072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.616202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.616388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.616590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.616689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.616819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.617000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.617140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.617322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.617427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.617637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.617726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.617948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.618075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.618257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.618360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.618606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.618786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.618952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.619109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.619299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.619453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.619603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.619744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.619880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.620018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.620178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.620328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.620465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.620602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.620732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.620862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.621009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.621146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.621284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.621418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.621596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.621697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.621905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.621987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.622212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.622312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.622534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.622628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.622847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.622939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.623158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.623465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.623572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.623862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.623962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.624190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.624270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.624514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.624612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.624874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.624972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.625197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.625298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.625506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.625601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.625832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.625954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.626141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.626265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.626449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.626591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.626786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.626912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.627096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.627226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.627404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.627528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.627721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.627850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.628031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.628148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.628342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.628443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.628652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.628751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.628967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.629230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.629320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.629567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.629668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.629878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.629976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.630187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.630278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.630557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.630666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.630833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.630925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.631147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.631235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.631453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.631552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.631776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.631873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.632088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.632178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.632394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.632495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.632704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.632803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.633014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.633104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.633325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.633427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.633637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.633726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.633952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.634050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.634264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.634363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.634605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.634697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.634921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.635012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.635233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.635327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.635543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.635639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.635853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.635942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.636162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.636295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.636468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.636569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.636781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.637355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.637454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.637577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.637757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.637849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.638074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.638205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.638388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.638487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.638725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.638823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.639037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.639135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.639367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.639460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.639682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.639781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.639988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.640085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.640310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.640403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.640623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.640710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.640928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.641016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.641236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.641360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.641548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.641679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.641862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.642000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.642170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.642313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.642485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.642642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.642812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.642970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.643132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.643298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.643443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.643614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.643751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.643947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.644057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.644261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.644371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.644596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.644694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.644940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.645029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.645274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.645369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.645600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.645691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.645907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.645997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.646212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.646310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.646631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.646765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.646885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.646975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.647139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.647258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.647450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.647543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.647753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.647884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.648058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.648190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.648370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.648497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.648678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.648772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.648985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.649087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.649289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.649385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.649593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.649683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.649902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.649999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.650255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.650354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.650527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.650660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.650833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.650934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.651137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.651233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.651442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.651542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.651747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.651844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.652055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.652145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.652360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.652454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.652666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.652766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.652969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.653074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.653284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.653455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.653622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.653773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.653920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.654052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.654239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.654360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.654582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.654689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.654911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.655025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.655292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.655396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.655613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.655705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.655925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.656025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.656232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.656368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.656552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.656690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.656872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.657011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.657183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.657289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.657493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.657591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.657807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.657928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.658120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.658213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.658437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.658578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.658778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.658857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.659092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.659183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.659405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.659505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.659738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.659834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.660046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.660141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.660359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.660456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.660677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.660805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.660995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.661093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.661314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.661412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.661628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.661735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.661941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.662038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.662255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.662355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.662593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.662707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.662910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.663000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.663221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.663318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.663531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.663670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.663845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.663943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.664155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.664248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.664464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.664558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.664776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.664866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.665093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.665190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.665401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.665499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.665714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.665809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.666023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.666121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.666337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.666435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.666672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.666774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.667017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.667109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.667366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.667448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.667682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.667770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.668027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.668163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.668345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.668473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.668663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.668758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.668978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.669076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.669286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.669383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.669528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 15:21:16.669626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.670015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.670336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.670761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.671075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.671390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.671704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.672023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.672710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.672710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.672961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.673271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.673602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.673913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.674243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.674732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.675018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.675337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.675755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.676074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.676393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.676725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.677067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.677400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.677747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.678030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.678350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.678710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.679041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.679377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.679703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.680018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.680353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.680687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.681010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.681343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.681768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.682098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.682417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.682773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.683105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.683418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.683729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.684045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.684358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.684672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.685002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.685313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.685632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.685950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.686330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.686704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.687019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.687351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.687658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.687992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.688313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.688652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.688978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.689293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.689626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.689941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.690252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.690584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.690897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.691810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.691810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.691978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.692194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.692530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.692845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.693188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.693517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.693843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.694158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.694480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.694833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.695143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.695453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.695769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.696079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.696389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.696699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.697008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.697352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.697619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.697927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.698260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.698602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.698953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.699259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.699569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.699879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.700189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.700542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.700856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.701194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.701512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.701873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.702227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.702576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.702904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.703227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.703550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.703874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.704197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.704511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.704833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.705154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.705478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.706057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.706393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.706779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.707072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.707413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.707715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.708036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.708356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.708676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.709055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.709315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.709654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.709985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.710318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.710687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.711018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.711340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.711662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.711987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.712350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.712673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.712986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.713306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.713628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.713951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.714264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.714606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.714929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.715248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.715563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.715878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.716197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.716517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.716848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.717188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.717563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.717889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.718208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.718546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.719164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.719408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.719745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.720079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.720408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.720731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.721055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.721389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.721701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.722121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.722328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.722670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.722984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.723315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.723631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.723942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.724265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.724581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.725130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.725488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.725808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.726141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.726474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.726819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.727131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.727462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.727774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.728086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.728409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.728725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.729038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.729357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.729680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.730121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.730298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.730639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.730786 n-d-854441-12 devstack@n-api.service[120406]: INFO dbcounter [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Registered counter for database nova_api Oct 17 15:21:16.730951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.731281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.731591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.731926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.732258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.732528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.732838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.733186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.733494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.733801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.734116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.734428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.734874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.735185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.735503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.735857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.736171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.736480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.736810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.737120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.737427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.737754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.738074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.738406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.738747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.739062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.739426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.739745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.740315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.740654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.740975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.741316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.741653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.741964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.742274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.742606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.742935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.743250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.743566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.743881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.744194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.744506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.744821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.745135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.745449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.745775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.746089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.746409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.746746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.747059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.747370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.747691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.748042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.748370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.748891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.749086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.749418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.749734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.750049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.750365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.750799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.751126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.751466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.751785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.752106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.752734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.752869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.753196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.753514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_db.sqlalchemy.engines [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:21:16.753604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.753831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.754163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.754493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.754836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.755165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.755482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.755820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.756171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.756507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.756845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.757160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.757467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.757777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.758096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.758423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.758764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.759079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.759394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.759717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.760028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.760340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.760647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.760952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.761109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writer thread running {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:21:16.761265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.761625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.762300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.762657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.762981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.763366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.763680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.763998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.764312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.764666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.764983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.765274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.765581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.765922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.766263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.766609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.766944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.767270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.767603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.767922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.768249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.768580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.768907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.769234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.769570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.769898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.770218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.770574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.770889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.771447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.771694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.772035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.772375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.772687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.773030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.773347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.773677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.774001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.774322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.774684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.775004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.775322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.775641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.775960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.776277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.776601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.776974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.777297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.777621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.777943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.778276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.778658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.778952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.779290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.779623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.780029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.780378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.780735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.781071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.781390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.781707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.782017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 15:21:16.782264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 15:21:16.817833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.context [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ec06080-01b5-4793-9448-66de7d08c56d(cell1) {{(pid=120406) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 15:21:16.821906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:21:16.822380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:21:16.823993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:21:16.824759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:21:16.825212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:21:16.827311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:21:16.829361 n-d-854441-12 devstack@n-api.service[120406]: INFO dbcounter [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Registered counter for database nova_cell0 Oct 17 15:21:16.833550 n-d-854441-12 devstack@n-api.service[120406]: INFO dbcounter [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Registered counter for database nova_cell1 Oct 17 15:21:16.841597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_db.sqlalchemy.engines [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:21:16.844275 n-d-854441-12 devstack@n-api.service[120407]: INFO dbcounter [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Registered counter for database nova_api Oct 17 15:21:16.844523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_db.sqlalchemy.engines [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:21:16.848986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writer thread running {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:21:16.855050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writer thread running {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:21:16.876562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_db.sqlalchemy.engines [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:21:16.883940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writer thread running {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:21:16.940698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.context [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ec06080-01b5-4793-9448-66de7d08c56d(cell1) {{(pid=120407) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 15:21:16.944778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:21:16.945245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:21:16.946848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:21:16.947617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:21:16.948058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:21:16.950086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:21:16.952249 n-d-854441-12 devstack@n-api.service[120407]: INFO dbcounter [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Registered counter for database nova_cell0 Oct 17 15:21:16.956474 n-d-854441-12 devstack@n-api.service[120407]: INFO dbcounter [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Registered counter for database nova_cell1 Oct 17 15:21:16.964023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_db.sqlalchemy.engines [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:21:16.966538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_db.sqlalchemy.engines [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:21:16.971663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writer thread running {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:21:16.974160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writer thread running {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:21:17.001291 n-d-854441-12 devstack@n-api.service[120406]: INFO dbcounter [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Registered counter for database nova_cell0 Oct 17 15:21:17.009390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_db.sqlalchemy.engines [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:21:17.014822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writer thread running {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:21:17.120909 n-d-854441-12 devstack@n-api.service[120407]: INFO dbcounter [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Registered counter for database nova_cell0 Oct 17 15:21:17.129945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_db.sqlalchemy.engines [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 15:21:17.135096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writer thread running {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 15:21:17.348776 n-d-854441-12 devstack@n-api.service[120406]: WARNING keystonemiddleware.auth_token [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 15:21:17.356771 n-d-854441-12 devstack@n-api.service[120406]: WARNING keystonemiddleware.auth_token [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 15:21:17.474357 n-d-854441-12 devstack@n-api.service[120407]: WARNING keystonemiddleware.auth_token [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 15:21:17.481833 n-d-854441-12 devstack@n-api.service[120407]: WARNING keystonemiddleware.auth_token [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 15:21:17.710124 n-d-854441-12 devstack@n-api.service[120406]: WARNING keystonemiddleware.auth_token [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 15:21:17.717536 n-d-854441-12 devstack@n-api.service[120406]: WARNING keystonemiddleware.auth_token [None req-58fd12b6-55ed-499e-9772-5b313b746ec6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 15:21:17.723375 n-d-854441-12 devstack@n-api.service[120406]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56418724d9c0 pid: 120406 (default app) Oct 17 15:21:17.837414 n-d-854441-12 devstack@n-api.service[120407]: WARNING keystonemiddleware.auth_token [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 15:21:17.843687 n-d-854441-12 devstack@n-api.service[120407]: WARNING keystonemiddleware.auth_token [None req-2d301e48-5cee-4178-87a5-f1d85d072a1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 15:21:17.849115 n-d-854441-12 devstack@n-api.service[120407]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56418724d9c0 pid: 120407 (default app) Oct 17 15:22:00.314898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:00.316507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:00.317677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:00.319171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:01.911007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:01.911668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:01.912364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:01.914741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:02.059963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f340bb7-f1c8-44dd-981d-a89904f2d9a6 tempest-FlavorMetadataValidation-1847711176 tempest-FlavorMetadataValidation-1847711176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-312772539", "id": 1278573198, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:02.127073 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f340bb7-f1c8-44dd-981d-a89904f2d9a6 tempest-FlavorMetadataValidation-1847711176 tempest-FlavorMetadataValidation-1847711176-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 1.823732 Oct 17 15:22:02.128191 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1/1] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:22:00 2022] POST /compute/v2.1/flavors => generated 470 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:02.156390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8970015-251c-4d1c-828b-470f6359b630 tempest-FlavorMetadataValidation-1847711176 tempest-FlavorMetadataValidation-1847711176-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:02.376570 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8970015-251c-4d1c-828b-470f6359b630 tempest-FlavorMetadataValidation-1847711176 tempest-FlavorMetadataValidation-1847711176-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/1278573198/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.228040 Oct 17 15:22:02.377648 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2/2] 10.222.0.87 () {62 vars in 1265 bytes} [Mon Oct 17 15:22:02 2022] POST /compute/v2.1/flavors/1278573198/os-extra_specs => generated 62 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:02.395369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4abd3ae-a4f4-44c6-9c38-c650a7e691d5 tempest-FlavorMetadataValidation-1847711176 tempest-FlavorMetadataValidation-1847711176-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:02.440085 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4abd3ae-a4f4-44c6-9c38-c650a7e691d5 tempest-FlavorMetadataValidation-1847711176 tempest-FlavorMetadataValidation-1847711176-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1278573198" status: 202 len: 0 microversion: 2.86 time: 0.053711 Oct 17 15:22:02.440677 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3/3] 10.222.0.87 () {60 vars in 1202 bytes} [Mon Oct 17 15:22:02 2022] DELETE /compute/v2.1/flavors/1278573198 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:22:02.452502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b86b058-ca07-48c9-9bba-956787187c36 tempest-FlavorMetadataValidation-1847711176 tempest-FlavorMetadataValidation-1847711176-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:02.483957 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b86b058-ca07-48c9-9bba-956787187c36 tempest-FlavorMetadataValidation-1847711176 tempest-FlavorMetadataValidation-1847711176-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.035202 Oct 17 15:22:02.484552 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4/4] 10.222.0.87 () {60 vars in 1187 bytes} [Mon Oct 17 15:22:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:22:03.504846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '.version_select at 0x7f28c0703700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:03.512465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ec06080-01b5-4793-9448-66de7d08c56d(cell1) {{(pid=120407) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 15:22:03.513329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:03.513832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:03.514305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:03.529973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8247c5f2-1222-442a-b67c-79ce41f64fbf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:03.537206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8247c5f2-1222-442a-b67c-79ce41f64fbf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:03.537800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8247c5f2-1222-442a-b67c-79ce41f64fbf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:03.540143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8247c5f2-1222-442a-b67c-79ce41f64fbf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:03.541590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8247c5f2-1222-442a-b67c-79ce41f64fbf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:03.544035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8247c5f2-1222-442a-b67c-79ce41f64fbf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:03.545369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8247c5f2-1222-442a-b67c-79ce41f64fbf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:03.545519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:03.545966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:03.546537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:03.564842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:03.565477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:03.565928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:03.573288 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6ce3499-8e75-4273-a177-d5c7b67d6acb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.668167 Oct 17 15:22:03.574260 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1/5] 10.222.0.87 () {58 vars in 1167 bytes} [Mon Oct 17 15:22:01 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:03.619160 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8247c5f2-1222-442a-b67c-79ce41f64fbf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.745505 Oct 17 15:22:03.628857 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 5/6] 10.222.0.87 () {58 vars in 1176 bytes} [Mon Oct 17 15:22:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:03.628857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d1a86ed-d810-4f75-a4f8-83cc94f08124 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-130316042", "name": "tempest-test_aggregate-1513622254"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:03.667714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-8d1a86ed-d810-4f75-a4f8-83cc94f08124 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Generated uuid 932c6f98-4728-40ce-a57f-c5d5b060d297 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:03.766983 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d1a86ed-d810-4f75-a4f8-83cc94f08124 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.144044 Oct 17 15:22:03.768655 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 6/7] 10.222.0.87 () {60 vars in 1165 bytes} [Mon Oct 17 15:22:03 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:03.786991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28df8727-8ad0-4915-8674-b409d2407440 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:03.802956 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28df8727-8ad0-4915-8674-b409d2407440 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.024280 Oct 17 15:22:03.803588 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 7/8] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:22:03 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:03.818391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80e8dbde-f3bb-4770-9c9e-3a240cbd3316 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:03.838161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80e8dbde-f3bb-4770-9c9e-3a240cbd3316 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:03.838974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80e8dbde-f3bb-4770-9c9e-3a240cbd3316 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:03.839576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80e8dbde-f3bb-4770-9c9e-3a240cbd3316 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:04.016764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Calling method '.version_select at 0x7f28c0649820>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:04.022304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:04.023104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:04.023584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:04.061883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:04.061883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:04.061883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:04.076401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:04.076922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:04.077555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:04.085503 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cdf05cb8-a0a1-4aa5-bed2-23221d7e4cdd tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.509871 Oct 17 15:22:04.086367 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2/9] 10.222.0.87 () {60 vars in 1208 bytes} [Mon Oct 17 15:22:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:22:04.241517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-238d9fcc-4c52-499e-af98-bec35ae475db tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877 tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:04.245309 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-238d9fcc-4c52-499e-af98-bec35ae475db tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877 tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-238d9fcc-4c52-499e-af98-bec35ae475db tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877 tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877-project-admin] Request method failure captured: Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMbs9RNWRPzsbL5eJ84L9K8OHnR-ZpJ1vXGB0uh6FQva7dM_M22UrtTiXVO3yRa3JXJA4Rh60BBGgzMJQOU6jr8M7FvPOreE6y7bpCIK3lm5bTW2AzyxB2RPQb5MEqaEqwD30gw-tKXJQrE4JoP3I-ucUwGH6nKfYZ3WmuIe8qe6Sw Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 06efd71eba444dd48938aabba666ab01 Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877 Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:22:04.254144 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06efd71eba444dd48938aabba666ab01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/06efd71eba444dd48938aabba666ab01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_06efd71eba444dd48938aabba666ab01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06efd71eba444dd48938aabba666ab01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877 Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 06efd71eba444dd48938aabba666ab01 Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877 Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877-project-admin Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 50fb80a229ec4b02939fba5942141bf3 Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877-project-admin Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:04.255621 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid timestamp for date invalid_time Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'invalid_time'} Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:04.256368 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 17 15:22:04.257607 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:04.261656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-238d9fcc-4c52-499e-af98-bec35ae475db tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877 tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:04.265029 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-238d9fcc-4c52-499e-af98-bec35ae475db tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877 tempest-InstanceUsageAuditLogNegativeTestJSON-2000868877-project-admin] 10.222.0.87 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.175082 Oct 17 15:22:04.269605 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3/10] 10.222.0.87 () {58 vars in 1224 bytes} [Mon Oct 17 15:22:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:22:04.347523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-464830853", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:04.557043 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80e8dbde-f3bb-4770-9c9e-3a240cbd3316 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 0.743381 Oct 17 15:22:04.558241 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 8/11] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:03 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:04.846425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:22:04.894550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66c716be-add8-46a7-8149-6c3d70f9d1be tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:04.899211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66c716be-add8-46a7-8149-6c3d70f9d1be tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:04.900527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66c716be-add8-46a7-8149-6c3d70f9d1be tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:04.901955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66c716be-add8-46a7-8149-6c3d70f9d1be tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:04.903900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66c716be-add8-46a7-8149-6c3d70f9d1be tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:04.904758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66c716be-add8-46a7-8149-6c3d70f9d1be tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:04.906714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66c716be-add8-46a7-8149-6c3d70f9d1be tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:04.964596 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66c716be-add8-46a7-8149-6c3d70f9d1be tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] 10.222.0.87 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.403893 Oct 17 15:22:04.965877 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 9/12] 10.222.0.87 () {58 vars in 1164 bytes} [Mon Oct 17 15:22:04 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:05.131899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-714038376", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:05.254040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:22:05.254484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:22:05.255270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:22:05.255457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:22:05.256227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:22:05.289484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:05.290000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:05.290488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:05.291295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:05.291816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:05.292257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:05.329916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:22:05.337651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for user 5ec3b5fbeafd47558718a7a9638d0c9e and project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:22:05.351001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:22:05.354329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:22:05.443362 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8787b1b0-ef4a-4ee5-a009-5fb8c24ce2b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170376 Oct 17 15:22:05.445286 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 4/13] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:22:05.595548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:22:05.690241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c8bc27c-e41a-4694-a7e9-88b0ff602d38 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:05.692835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0c8bc27c-e41a-4694-a7e9-88b0ff602d38 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '1d57900c41a442ad8a5c86cbb5ffd95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78320667ef36408db420622077c3e6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c8bc27c-e41a-4694-a7e9-88b0ff602d38 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] Request method failure captured: Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMYKT_NBYtzroAZ0XUxZilOHSCSqhq_1wonPYdHJCxe6mHg1ULg8EVG8AObo2pMuDO2zZV_F1PghYF1FbfKS6nhT3-YxbYYtjLh9nbosbSZ0b1BKZyAHLnX6m1J6BmMq_5NWKw7skIJunz01x8sWp2kke_yiMKEVAL1dZLpYf6Vu60 Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 78320667ef36408db420622077c3e6fc Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:05.697945 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/78320667ef36408db420622077c3e6fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/78320667ef36408db420622077c3e6fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_78320667ef36408db420622077c3e6fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/78320667ef36408db420622077c3e6fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 78320667ef36408db420622077c3e6fc Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 1d57900c41a442ad8a5c86cbb5ffd95d Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project Oct 17 15:22:05.699509 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: action_args: {} Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:05.700088 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 15:22:05.701093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:05.703948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c8bc27c-e41a-4694-a7e9-88b0ff602d38 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:05.706324 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0c8bc27c-e41a-4694-a7e9-88b0ff602d38 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] 10.222.0.87 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.257527 Oct 17 15:22:05.707725 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 5/14] 10.222.0.87 () {58 vars in 1185 bytes} [Mon Oct 17 15:22:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 261 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:06.059926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:22:06.060617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:22:06.061466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:22:06.062161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:22:06.062817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:22:06.114116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:06.114835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:06.115448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:06.116368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:06.118607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:06.124977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:06.133795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-865997839", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "availability_zone": "tempest-test_az-130316042"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:06.153875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:06.154781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:06.155625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:06.156670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:06.157420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:06.158108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:06.187953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Getting quotas for project 68a3e4c52bdf488283a305f15f904509. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:22:06.200569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Getting quotas for user 0078ab28d52b4741aa81a5ee515acc04 and project 68a3e4c52bdf488283a305f15f904509. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:22:06.228575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:22:06.232377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:22:06.319642 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea58c632-7fe8-47d9-9275-d6fda376f2d2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342877 Oct 17 15:22:06.320351 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 10/15] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:22:06.326307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-223e882f-e7a3-4621-bfeb-6ce43cddb95b tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:06.328353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223e882f-e7a3-4621-bfeb-6ce43cddb95b tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:06.328865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223e882f-e7a3-4621-bfeb-6ce43cddb95b tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:06.329319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223e882f-e7a3-4621-bfeb-6ce43cddb95b tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:06.330070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223e882f-e7a3-4621-bfeb-6ce43cddb95b tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:06.330580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223e882f-e7a3-4621-bfeb-6ce43cddb95b tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:06.330986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223e882f-e7a3-4621-bfeb-6ce43cddb95b tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:06.331087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:22:06.360272 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-223e882f-e7a3-4621-bfeb-6ce43cddb95b tempest-AZAdminV2TestJSON-1792484668 tempest-AZAdminV2TestJSON-1792484668-project-admin] 10.222.0.87 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 703 microversion: 2.1 time: 0.038591 Oct 17 15:22:06.361308 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 11/16] 10.222.0.87 () {58 vars in 1185 bytes} [Mon Oct 17 15:22:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 703 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:06.367125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b8a3fdb-0734-4466-993a-467198a5e35e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:06.367782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b8a3fdb-0734-4466-993a-467198a5e35e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:06.632753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b8a3fdb-0734-4466-993a-467198a5e35e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:06.664227 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b8a3fdb-0734-4466-993a-467198a5e35e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1212 microversion: 2.1 time: 0.301272 Oct 17 15:22:06.668372 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 12/17] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:06 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1212 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:06.686942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c0c0d69-2d0a-4a9b-baab-dad7ad0c22e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:06.689154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c0c0d69-2d0a-4a9b-baab-dad7ad0c22e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '1d57900c41a442ad8a5c86cbb5ffd95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78320667ef36408db420622077c3e6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c0c0d69-2d0a-4a9b-baab-dad7ad0c22e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] Request method failure captured: Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2015:22:05 HTTP/1.1 Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMYKT_NBYtzroAZ0XUxZilOHSCSqhq_1wonPYdHJCxe6mHg1ULg8EVG8AObo2pMuDO2zZV_F1PghYF1FbfKS6nhT3-YxbYYtjLh9nbosbSZ0b1BKZyAHLnX6m1J6BmMq_5NWKw7skIJunz01x8sWp2kke_yiMKEVAL1dZLpYf6Vu60 Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 78320667ef36408db420622077c3e6fc Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:06.693425 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/78320667ef36408db420622077c3e6fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/78320667ef36408db420622077c3e6fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_78320667ef36408db420622077c3e6fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/78320667ef36408db420622077c3e6fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 78320667ef36408db420622077c3e6fc Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1d57900c41a442ad8a5c86cbb5ffd95d Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project Oct 17 15:22:06.694479 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '2022-10-17 15:22:05'} Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:06.695261 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 15:22:06.696151 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:06.705796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c0c0d69-2d0a-4a9b-baab-dad7ad0c22e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:06.707190 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c0c0d69-2d0a-4a9b-baab-dad7ad0c22e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192 tempest-InstanceUsageAuditLogNegativeTestJSON-1879473192-project] 10.222.0.87 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17 15:22:05" status: 403 len: 128 microversion: 2.1 time: 0.037413 Oct 17 15:22:06.708310 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 13/18] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:22:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2015%3A22%3A05 => generated 128 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:06.721562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e6891ed-9c60-4a7e-a8f5-3ddbd6d248fd tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:06.722458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e6891ed-9c60-4a7e-a8f5-3ddbd6d248fd tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:06.814213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e6891ed-9c60-4a7e-a8f5-3ddbd6d248fd tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:06.824341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e6891ed-9c60-4a7e-a8f5-3ddbd6d248fd tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1219 microversion: 2.1 time: 0.114503 Oct 17 15:22:06.829396 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 14/19] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:06 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:06.857929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:22:06.858654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:22:06.859328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:22:06.859993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:22:06.860595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:22:06.885134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:06.886991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:06.888681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:06.892662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:06.893803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:06.896841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:06.970539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Getting quotas for project 72a8a8c2ca3d48b98d2192c05f5d49ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:22:06.992293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Getting quotas for user e97b5bbbf3484cdbb80f133d8df77dc3 and project 72a8a8c2ca3d48b98d2192c05f5d49ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:22:07.040685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:22:07.047489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:22:07.140031 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bcd7f322-2e01-4088-b14c-1c96f17d8532 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.430351 Oct 17 15:22:07.148526 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 6/20] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:22:07.154163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-406d6702-635c-4e1e-9a7a-95fe37de2e9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:07.154863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-406d6702-635c-4e1e-9a7a-95fe37de2e9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:07.431540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-406d6702-635c-4e1e-9a7a-95fe37de2e9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:07.446834 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-406d6702-635c-4e1e-9a7a-95fe37de2e9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1241 microversion: 2.1 time: 0.296947 Oct 17 15:22:07.447783 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 15/21] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:07 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1241 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:07.692534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:07.693752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:07.741296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:07.743203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:07.744238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:07.747918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:07.750959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:07.751987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:07.864233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-933ec8eb-d92d-47de-a807-e942d1b72f2c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:07.871303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-933ec8eb-d92d-47de-a807-e942d1b72f2c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:08.180596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-933ec8eb-d92d-47de-a807-e942d1b72f2c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:08.192909 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-933ec8eb-d92d-47de-a807-e942d1b72f2c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1219 microversion: 2.1 time: 0.339077 Oct 17 15:22:08.193556 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 16/22] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:07 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1219 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:08.444487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:08.474906 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-549dc485-30ec-4c42-b0e9-fad79d58a874 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1229 microversion: 2.1 time: 0.786787 Oct 17 15:22:08.477069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:08.478634 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 7/23] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:07 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1229 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:08.495248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:08.505567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:08.506332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:08.506939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:08.508292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:08.508923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:08.509490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:08.777255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:08.793408 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c582e0a7-9c42-4f58-b4b5-64bac27611ef tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1241 microversion: 2.1 time: 0.326817 Oct 17 15:22:08.794689 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 17/24] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:08 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1241 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:09.233537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:09.234560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:09.246223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:09.248213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:09.249390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:09.252280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:09.253201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:09.254809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:09.353347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:09.362368 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d8e519e6-567c-40e0-b6db-c8060d41a785 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1292 microversion: 2.1 time: 0.133489 Oct 17 15:22:09.379935 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 8/25] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:09 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1292 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:09.502377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:09.503140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:09.518578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:09.519587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:09.522608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:09.523597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:09.525622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:09.527942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:09.640021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c2e20c8-02a7-4aed-a7b8-585cec6804c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1347555173", "ram": 512, "vcpus": 1, "disk": 10, "id": 1176471929, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:09.674355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:09.678109 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c2e20c8-02a7-4aed-a7b8-585cec6804c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.241458 Oct 17 15:22:09.681131 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 18/26] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:09 2022] POST /compute/v2.1/flavors => generated 416 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:09.701162 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1c5e6c32-1144-4d7d-9233-3f4c625f1748 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1291 microversion: 2.1 time: 0.203410 Oct 17 15:22:09.701769 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 9/27] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:09 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1291 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:09.822460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:09.823305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:09.834007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:09.840282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:09.841578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:09.844883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:09.846588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:09.847811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:10.104419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:10.140257 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c2fe6ca0-b76d-41ef-8a42-a85375b861f2 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1289 microversion: 2.1 time: 0.321398 Oct 17 15:22:10.144651 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 10/28] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:09 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1289 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:10.179106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b2aa955-b969-4806-8ef2-98c1bd949e70 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:10.194643 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9b2aa955-b969-4806-8ef2-98c1bd949e70 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] HTTP exception thrown: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b2aa955-b969-4806-8ef2-98c1bd949e70 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Request method failure captured: Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/flavors/1176471929/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMfghzZCg6u11bg9OnqNH1fFXb3QZZ8AFNojxhzYlxn6j9V4IYibiUbb00mPpgSun0DzAzgqA-4MflYjYnyME59DqGQa_uneKfI71jWgvCLdTJr0crfP5mrwk7fYwvRGYGI43g2D777NyBikYMxF-Yw5tCcMkU4FCHREqRjKfSZG84 Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6727f3c717c54176a37a393ebda59bb7 Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:10.197591 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6727f3c717c54176a37a393ebda59bb7 Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 69a33995eea04f6bb83b5b3137548c9c Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:10.199038 n-d-854441-12 devstack@n-api.service[120406]: exception: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'flavor_id': '1176471929', 'id': 'hw:cpu_thread_policy'} Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.199720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.201227 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.201227 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.201227 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.201227 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:10.201227 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:10.201227 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. Oct 17 15:22:10.201227 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.205611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b2aa955-b969-4806-8ef2-98c1bd949e70 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Returning 404 to user: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:10.207013 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b2aa955-b969-4806-8ef2-98c1bd949e70 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] 10.222.0.87 "GET /compute/v2.1/flavors/1176471929/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.516039 Oct 17 15:22:10.208087 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 19/29] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:22:09 2022] GET /compute/v2.1/flavors/1176471929/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 518 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:10.228817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d89c57bd-163c-4cf1-8469-8ef935841d8c tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:10.236428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d89c57bd-163c-4cf1-8469-8ef935841d8c tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '69a33995eea04f6bb83b5b3137548c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6727f3c717c54176a37a393ebda59bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d89c57bd-163c-4cf1-8469-8ef935841d8c tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Request method failure captured: Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/flavors/1176471929/os-extra_specs HTTP/1.1 Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 66 Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMfghzZCg6u11bg9OnqNH1fFXb3QZZ8AFNojxhzYlxn6j9V4IYibiUbb00mPpgSun0DzAzgqA-4MflYjYnyME59DqGQa_uneKfI71jWgvCLdTJr0crfP5mrwk7fYwvRGYGI43g2D777NyBikYMxF-Yw5tCcMkU4FCHREqRjKfSZG84 Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6727f3c717c54176a37a393ebda59bb7 Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:10.241207 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6727f3c717c54176a37a393ebda59bb7 Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 69a33995eea04f6bb83b5b3137548c9c Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 17 15:22:10.242483 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'flavor_id': '1176471929', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:10.243309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 15:22:10.244382 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.249602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d89c57bd-163c-4cf1-8469-8ef935841d8c tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:10.250865 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d89c57bd-163c-4cf1-8469-8ef935841d8c tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] 10.222.0.87 "POST /compute/v2.1/flavors/1176471929/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.034359 Oct 17 15:22:10.252415 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 11/30] 10.222.0.87 () {60 vars in 1224 bytes} [Mon Oct 17 15:22:10 2022] POST /compute/v2.1/flavors/1176471929/os-extra_specs => generated 124 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:10.263088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6553595-caed-4e52-a9db-3bfd612b9531 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:10.270440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:10.308589 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6553595-caed-4e52-a9db-3bfd612b9531 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/1176471929/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050886 Oct 17 15:22:10.320452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d62a8863-37a0-4992-9b1c-683719cd2239 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:10.322165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d62a8863-37a0-4992-9b1c-683719cd2239 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '69a33995eea04f6bb83b5b3137548c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6727f3c717c54176a37a393ebda59bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d62a8863-37a0-4992-9b1c-683719cd2239 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Request method failure captured: Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMfghzZCg6u11bg9OnqNH1fFXb3QZZ8AFNojxhzYlxn6j9V4IYibiUbb00mPpgSun0DzAzgqA-4MflYjYnyME59DqGQa_uneKfI71jWgvCLdTJr0crfP5mrwk7fYwvRGYGI43g2D777NyBikYMxF-Yw5tCcMkU4FCHREqRjKfSZG84 Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6727f3c717c54176a37a393ebda59bb7 Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:10.324620 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6727f3c717c54176a37a393ebda59bb7 Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 69a33995eea04f6bb83b5b3137548c9c Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:10.326915 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'flavor_id': '1176471929', 'id': 'hw:numa_nodes'} Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:10.328068 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.330170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d62a8863-37a0-4992-9b1c-683719cd2239 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:10.336005 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 20/31] 10.222.0.87 () {60 vars in 1224 bytes} [Mon Oct 17 15:22:10 2022] POST /compute/v2.1/flavors/1176471929/os-extra_specs => generated 66 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:22:10.339058 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d62a8863-37a0-4992-9b1c-683719cd2239 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] 10.222.0.87 "DELETE /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011108 Oct 17 15:22:10.339058 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 12/32] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:22:10 2022] DELETE /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:10.340448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de6a660d-69e9-491c-9b98-d07103d22db1 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:10.388661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:10.389546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:10.393748 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de6a660d-69e9-491c-9b98-d07103d22db1 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/1176471929/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059687 Oct 17 15:22:10.394431 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 21/33] 10.222.0.87 () {60 vars in 1224 bytes} [Mon Oct 17 15:22:10 2022] POST /compute/v2.1/flavors/1176471929/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:22:10.411054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1a70e0d-4350-43ca-a1ae-7d5143370fca tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:10.417052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:10.417743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:10.422322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:10.423367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:10.425455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1a70e0d-4350-43ca-a1ae-7d5143370fca tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '69a33995eea04f6bb83b5b3137548c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6727f3c717c54176a37a393ebda59bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:10.428110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:10.428735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1a70e0d-4350-43ca-a1ae-7d5143370fca tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Request method failure captured: Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 22 Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMfghzZCg6u11bg9OnqNH1fFXb3QZZ8AFNojxhzYlxn6j9V4IYibiUbb00mPpgSun0DzAzgqA-4MflYjYnyME59DqGQa_uneKfI71jWgvCLdTJr0crfP5mrwk7fYwvRGYGI43g2D777NyBikYMxF-Yw5tCcMkU4FCHREqRjKfSZG84 Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6727f3c717c54176a37a393ebda59bb7 Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:10.431416 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6727f3c717c54176a37a393ebda59bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6727f3c717c54176a37a393ebda59bb7 Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 69a33995eea04f6bb83b5b3137548c9c Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: {"hw:numa_nodes": "1"} Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:10.432559 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'flavor_id': '1176471929', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:10.433570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 15:22:10.434628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.435660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1a70e0d-4350-43ca-a1ae-7d5143370fca tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:10.435660 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1a70e0d-4350-43ca-a1ae-7d5143370fca tempest-FlavorsExtraSpecsNegativeTestJSON-393114690 tempest-FlavorsExtraSpecsNegativeTestJSON-393114690-project] 10.222.0.87 "PUT /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034485 Oct 17 15:22:10.436601 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 22/34] 10.222.0.87 () {60 vars in 1265 bytes} [Mon Oct 17 15:22:10 2022] PUT /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:10.453515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2d1ee0c-ba1c-420e-b5d6-4dc305165680 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:10.478630 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c2d1ee0c-ba1c-420e-b5d6-4dc305165680 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] HTTP exception thrown: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2d1ee0c-ba1c-420e-b5d6-4dc305165680 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Request method failure captured: Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/flavors/1176471929/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMhc7Dl_CwmaIN7WqIII5JaApTvfW4gEZSzLwKJFkUDkJbUqEMoHLOOxyStu-Gkpyg9IY_XMoEEeybgAD6naqcWiymc5w-FfYHJs2ml9vaAVGsZjlexcLwu9rzZStqDHlg4_x1epOEWh0ajL3BJJfwsDlRkGGGH01peQQ5SI-6MHo8 Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 28ff8183aebc4289ae861cbff0e1945f Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:10.480502 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 28ff8183aebc4289ae861cbff0e1945f Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 0d0bd36df321474b826880b9e0de3d9e Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:10.482069 n-d-854441-12 devstack@n-api.service[120406]: exception: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'flavor_id': '1176471929', 'id': 'hw:cpu_thread_policy'} Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.482817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.484106 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.484106 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.484106 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.484106 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:10.484106 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:10.484106 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. Oct 17 15:22:10.484106 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.485360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2d1ee0c-ba1c-420e-b5d6-4dc305165680 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Returning 404 to user: Flavor 1176471929 has no extra specs with key hw:cpu_thread_policy. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:10.486407 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2d1ee0c-ba1c-420e-b5d6-4dc305165680 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1176471929/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.044094 Oct 17 15:22:10.488252 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 23/35] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:22:10 2022] DELETE /compute/v2.1/flavors/1176471929/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:10.498108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16e445a2-c7e1-4a4f-90c4-a074ec1b8756 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:10.506704 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-16e445a2-c7e1-4a4f-90c4-a074ec1b8756 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16e445a2-c7e1-4a4f-90c4-a074ec1b8756 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Request method failure captured: Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 27 Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMhc7Dl_CwmaIN7WqIII5JaApTvfW4gEZSzLwKJFkUDkJbUqEMoHLOOxyStu-Gkpyg9IY_XMoEEeybgAD6naqcWiymc5w-FfYHJs2ml9vaAVGsZjlexcLwu9rzZStqDHlg4_x1epOEWh0ajL3BJJfwsDlRkGGGH01peQQ5SI-6MHo8 Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 28ff8183aebc4289ae861cbff0e1945f Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:10.508562 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 28ff8183aebc4289ae861cbff0e1945f Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 0d0bd36df321474b826880b9e0de3d9e Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: {"hw:cpu_policy": "shared"} Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:10.509937 n-d-854441-12 devstack@n-api.service[120406]: exception: Request body and URI mismatch Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'flavor_id': '1176471929', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.510770 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.512526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:10.512526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:10.512526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 17 15:22:10.512526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.515359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16e445a2-c7e1-4a4f-90c4-a074ec1b8756 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:10.516490 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16e445a2-c7e1-4a4f-90c4-a074ec1b8756 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] 10.222.0.87 "PUT /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.022799 Oct 17 15:22:10.519693 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 24/36] 10.222.0.87 () {60 vars in 1265 bytes} [Mon Oct 17 15:22:10 2022] PUT /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 17 15:22:10.529564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdf3b3cc-5bcd-4040-8be1-c315718543a5 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdf3b3cc-5bcd-4040-8be1-c315718543a5 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Request method failure captured: Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 49 Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMhc7Dl_CwmaIN7WqIII5JaApTvfW4gEZSzLwKJFkUDkJbUqEMoHLOOxyStu-Gkpyg9IY_XMoEEeybgAD6naqcWiymc5w-FfYHJs2ml9vaAVGsZjlexcLwu9rzZStqDHlg4_x1epOEWh0ajL3BJJfwsDlRkGGGH01peQQ5SI-6MHo8 Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 28ff8183aebc4289ae861cbff0e1945f Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:10.541507 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/28ff8183aebc4289ae861cbff0e1945f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 28ff8183aebc4289ae861cbff0e1945f Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 0d0bd36df321474b826880b9e0de3d9e Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 17 15:22:10.543925 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'flavor_id': '1176471929', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance: Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 17 15:22:10.544728 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.546171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:10.547286 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:10.547286 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:10.547286 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:22:10.547286 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:22:10.547286 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 15:22:10.547286 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:10.547286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdf3b3cc-5bcd-4040-8be1-c315718543a5 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:10.547286 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bdf3b3cc-5bcd-4040-8be1-c315718543a5 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] 10.222.0.87 "PUT /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017943 Oct 17 15:22:10.554952 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 25/37] 10.222.0.87 () {60 vars in 1265 bytes} [Mon Oct 17 15:22:10 2022] PUT /compute/v2.1/flavors/1176471929/os-extra_specs/hw:numa_nodes => generated 117 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:22:10.564871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c036daee-b5d1-45a2-9281-e0e28ff4645c tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:10.609312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c036daee-b5d1-45a2-9281-e0e28ff4645c tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1176471929" status: 202 len: 0 microversion: 2.1 time: 0.053113 Oct 17 15:22:10.609928 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 26/38] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:22:10 2022] DELETE /compute/v2.1/flavors/1176471929 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:22:10.618636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef76f66e-664f-4ae0-8a5b-957c119eff15 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:10.653534 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef76f66e-664f-4ae0-8a5b-957c119eff15 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232 tempest-FlavorsExtraSpecsNegativeTestJSON-1996922232-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038599 Oct 17 15:22:10.667312 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 27/39] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:10.715587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:10.726870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:10.727775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:10.735800 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0fb178f8-82ef-4638-a599-621f7927f693 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1298 microversion: 2.1 time: 0.352917 Oct 17 15:22:10.747611 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 13/40] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:10 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1298 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:10.749216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:10.749719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:10.750157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:10.750898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:10.751505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:10.752052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:10.888866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:10.909515 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b2344ed-2781-474c-9384-5c20989307b3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1291 microversion: 2.1 time: 0.181361 Oct 17 15:22:10.924043 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 28/41] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:10 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1291 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:11.171112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:11.171829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:11.187197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:11.187547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:11.196845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:11.197792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:11.199299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:11.200116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:11.473779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:11.492175 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f91b02b-3895-4b1f-adc6-60c36ca1ca7f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1295 microversion: 2.1 time: 0.329010 Oct 17 15:22:11.508428 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 14/42] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:11 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1295 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:11.773989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:11.774720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:11.781793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:11.782266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:11.785812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:11.787512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:11.795145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:11.795596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:11.941196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:11.942558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:11.970287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:11.974280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:11.981530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:11.982729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:11.983424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:11.991918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:12.130029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:12.144572 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8aad686-f7f2-49ac-9c70-00df5b28e62c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1298 microversion: 2.1 time: 0.374374 Oct 17 15:22:12.150664 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 29/43] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:11 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1298 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:12.522397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:12.526818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:12.545609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:12.546868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:12.551463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:12.553915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:12.555680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:12.557840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:12.728802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:12.751604 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1ab5abff-d353-4c4e-8359-1acd216e33d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.814821 Oct 17 15:22:12.756586 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 15/44] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:11 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:12.772586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:12.791832 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3c9fc83-3ea7-4393-8523-42adb246cbda tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1295 microversion: 2.1 time: 0.276079 Oct 17 15:22:12.812046 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 30/45] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:12 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1295 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:13.173412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:13.175394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:13.193483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:13.196582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:13.197282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:13.198772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:13.201085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:13.202291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:13.750773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:13.773376 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fb3b2073-c8a9-4648-9076-4b21f83751b3 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1298 microversion: 2.1 time: 0.602967 Oct 17 15:22:13.784933 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 16/46] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:13 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1298 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:13.787532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:13.788331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:13.807628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:13.809300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:13.815313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:13.816800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:13.818086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:13.819118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:13.831932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:13.833147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:13.845541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:13.846744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:13.847866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:13.849287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:13.849946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:13.850714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:14.239516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:14.260121 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3be4310d-b492-4eec-bb67-7aa460569998 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.478060 Oct 17 15:22:14.271521 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 31/47] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:13 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:14.273173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:14.301184 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-37dc0374-8f97-49a1-aa78-33d672581581 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.476101 Oct 17 15:22:14.327468 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 17/48] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:13 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:14.811636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:14.812543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:14.832636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:14.833402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:14.833846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:14.834623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:14.835100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:14.835596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:15.202904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-889e3e84-7141-4cb6-a4c0-fe0b1b6c984d tempest-QuotaClassesAdmin257Test-1464312833 tempest-QuotaClassesAdmin257Test-1464312833-project-admin] Calling method '.version_select at 0x7f28bfb61430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:15.251411 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-889e3e84-7141-4cb6-a4c0-fe0b1b6c984d tempest-QuotaClassesAdmin257Test-1464312833 tempest-QuotaClassesAdmin257Test-1464312833-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.254302 Oct 17 15:22:15.254559 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 18/49] 10.222.0.87 () {60 vars in 1226 bytes} [Mon Oct 17 15:22:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:15.273284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3da57b9b-cd42-4353-ad9b-c06add4e0fc6 tempest-QuotaClassesAdmin257Test-1464312833 tempest-QuotaClassesAdmin257Test-1464312833-project-admin] Action: 'update', calling method: .version_select at 0x7f28bfb8fd30>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:15.644002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=12,nova_api:UPDATE=7 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:15.694164 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3da57b9b-cd42-4353-ad9b-c06add4e0fc6 tempest-QuotaClassesAdmin257Test-1464312833 tempest-QuotaClassesAdmin257Test-1464312833-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.426781 Oct 17 15:22:15.695424 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 19/50] 10.222.0.87 () {62 vars in 1247 bytes} [Mon Oct 17 15:22:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:15.700918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:15.701540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:15.718438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:15.718987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:15.719467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:15.720316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:15.720899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:15.721416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:16.049854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:16.059673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:16.069880 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f62bf1b6-447c-4e30-b57c-441d82a6df48 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 1.263216 Oct 17 15:22:16.070119 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2abc26f8-6ba8-43f9-b511-abd3b10451dd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.373027 Oct 17 15:22:16.075988 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 32/51] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:14 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:16.087474 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 20/52] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:15 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:16.106583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:16.108408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:16.127473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:16.128640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:16.129701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:16.130951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:16.131933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:16.132804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:16.342597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:16.558359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:16.576757 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a00a6f9-d8a2-42c4-9b9f-abe140f0f29c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.499174 Oct 17 15:22:16.579428 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 33/53] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:16 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:16.606706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8f6849c-ec76-4067-9130-e770f5ffa074 tempest-QuotaClassesAdmin257Test-1464312833 tempest-QuotaClassesAdmin257Test-1464312833-project-admin] Calling method '.version_select at 0x7f28bfa96670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:16.647679 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8f6849c-ec76-4067-9130-e770f5ffa074 tempest-QuotaClassesAdmin257Test-1464312833 tempest-QuotaClassesAdmin257Test-1464312833-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.065893 Oct 17 15:22:16.649126 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 34/54] 10.222.0.87 () {60 vars in 1226 bytes} [Mon Oct 17 15:22:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:16.685709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b56b62c-44f1-4874-8dd6-fc55a48eccb3 tempest-QuotaClassesAdmin257Test-1464312833 tempest-QuotaClassesAdmin257Test-1464312833-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf9be820>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:16.941248 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b56b62c-44f1-4874-8dd6-fc55a48eccb3 tempest-QuotaClassesAdmin257Test-1464312833 tempest-QuotaClassesAdmin257Test-1464312833-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.276149 Oct 17 15:22:16.944177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:16.967002 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 35/55] 10.222.0.87 () {62 vars in 1247 bytes} [Mon Oct 17 15:22:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:17.009325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a08f6e3-9a89-4b4e-b2e1-dc32dc0bde0f tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-75568614", "id": 1663831621, "os-flavor-access:is_public": "True"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:17.113923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:17.115320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:17.159206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:17.164111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:17.166117 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a08f6e3-9a89-4b4e-b2e1-dc32dc0bde0f tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 1.074167 Oct 17 15:22:17.167555 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 21/56] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:16 2022] POST /compute/v2.1/flavors => generated 428 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:17.181247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:17.182920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:17.189913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:17.191343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:17.192461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:17.193435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:17.209623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:17.211248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:17.212300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:17.213933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:17.215236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:17.216527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:17.882000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:17.897240 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b375bff-58a2-4230-a56b-da0901d3cf15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.727573 Oct 17 15:22:17.898303 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 22/57] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:17 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:17.906597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-940970ae-ad3a-49df-a7b4-1a43a0fb16f7 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:17.963182 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-940970ae-ad3a-49df-a7b4-1a43a0fb16f7 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1663831621" status: 202 len: 0 microversion: 2.1 time: 0.063815 Oct 17 15:22:17.963954 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 23/58] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:22:17 2022] DELETE /compute/v2.1/flavors/1663831621 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:22:17.968980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:17.969599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:18.008541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:18.009345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:18.009875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:18.011024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:18.011895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:18.012315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:18.354527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:18.414015 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3728ed9a-598f-4228-b4b1-dacee804beaa tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 1.314147 Oct 17 15:22:18.418120 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 36/59] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:17 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:18.425344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3167e61b-64d8-4284-a4b8-745836ab8615 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:18.476899 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3167e61b-64d8-4284-a4b8-745836ab8615 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055494 Oct 17 15:22:18.478958 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 37/60] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:18.885901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-37a44511-0993-4cdf-ab7e-0d584f7e4361 req-48753385-2868-4366-970f-e43e4d23f506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382fe0d4-2f91-4289-8eea-4619e645a500", "tag": "86a21e24-7531-494a-88d1-d4be7315e896"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:18.987323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37a44511-0993-4cdf-ab7e-0d584f7e4361 req-48753385-2868-4366-970f-e43e4d23f506 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:18.989061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37a44511-0993-4cdf-ab7e-0d584f7e4361 req-48753385-2868-4366-970f-e43e4d23f506 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:18.989514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37a44511-0993-4cdf-ab7e-0d584f7e4361 req-48753385-2868-4366-970f-e43e4d23f506 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.086140 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-37a44511-0993-4cdf-ab7e-0d584f7e4361 req-48753385-2868-4366-970f-e43e4d23f506 service nova] Creating event network-changed:86a21e24-7531-494a-88d1-d4be7315e896 for instance 382fe0d4-2f91-4289-8eea-4619e645a500 on n-h1-854441-12 Oct 17 15:22:19.086705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37a44511-0993-4cdf-ab7e-0d584f7e4361 req-48753385-2868-4366-970f-e43e4d23f506 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:22:19.087267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37a44511-0993-4cdf-ab7e-0d584f7e4361 req-48753385-2868-4366-970f-e43e4d23f506 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:22:19.092835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b10484-4073-4fd2-877c-62868d0def90 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:19.093315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b10484-4073-4fd2-877c-62868d0def90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:19.098603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b10484-4073-4fd2-877c-62868d0def90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.102021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b10484-4073-4fd2-877c-62868d0def90 None None] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:19.102791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b10484-4073-4fd2-877c-62868d0def90 None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:19.103427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b10484-4073-4fd2-877c-62868d0def90 None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.124281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:19.131408 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.compute.rpcapi [None req-82b10484-4073-4fd2-877c-62868d0def90 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 15:22:19.134108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82b10484-4073-4fd2-877c-62868d0def90 None None] Releasing lock "compute-rpcapi-router" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:22:19.137477 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-655f96e7-e377-4860-a2e9-98f947b583ba tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 1.172161 Oct 17 15:22:19.138389 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 24/61] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:17 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:19.166729 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82b10484-4073-4fd2-877c-62868d0def90 None None] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.686074 Oct 17 15:22:19.171293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-537dd6be-5932-40f3-a22c-ad429c52721c tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-264518838", "id": 1114132555, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:19.173304 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 38/62] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:19.191690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:19.194621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:19.218484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:19.219790 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-537dd6be-5932-40f3-a22c-ad429c52721c tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.057624 Oct 17 15:22:19.220929 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 25/63] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:19 2022] POST /compute/v2.1/flavors => generated 416 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:19.230250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:19.230250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.230250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:19.230250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:19.230593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.576508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-74323d6f-f4bf-41fd-8f6c-b36e3d32be55 req-dbbb4f4e-44ce-48ae-a98d-3fb5221d9ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b972480-ce14-4f7f-87c1-1b97fa848e2f", "tag": "de78e63f-5fcf-47d1-a747-d45683d5ffc2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:19.605288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-74323d6f-f4bf-41fd-8f6c-b36e3d32be55 req-dbbb4f4e-44ce-48ae-a98d-3fb5221d9ad0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:19.617297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-74323d6f-f4bf-41fd-8f6c-b36e3d32be55 req-dbbb4f4e-44ce-48ae-a98d-3fb5221d9ad0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:19.619293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-74323d6f-f4bf-41fd-8f6c-b36e3d32be55 req-dbbb4f4e-44ce-48ae-a98d-3fb5221d9ad0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.650375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-74323d6f-f4bf-41fd-8f6c-b36e3d32be55 req-dbbb4f4e-44ce-48ae-a98d-3fb5221d9ad0 service nova] Creating event network-changed:de78e63f-5fcf-47d1-a747-d45683d5ffc2 for instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f on n-h1-854441-12 Oct 17 15:22:19.651408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-74323d6f-f4bf-41fd-8f6c-b36e3d32be55 req-dbbb4f4e-44ce-48ae-a98d-3fb5221d9ad0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:22:19.652003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-74323d6f-f4bf-41fd-8f6c-b36e3d32be55 req-dbbb4f4e-44ce-48ae-a98d-3fb5221d9ad0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:22:19.653410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cab3296f-7edd-418f-8836-19f6f6ccdafb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:19.654073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cab3296f-7edd-418f-8836-19f6f6ccdafb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:19.654737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cab3296f-7edd-418f-8836-19f6f6ccdafb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.655800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cab3296f-7edd-418f-8836-19f6f6ccdafb None None] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:19.656470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cab3296f-7edd-418f-8836-19f6f6ccdafb None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:19.657499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cab3296f-7edd-418f-8836-19f6f6ccdafb None None] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.682077 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.rpcapi [None req-cab3296f-7edd-418f-8836-19f6f6ccdafb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 15:22:19.683532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cab3296f-7edd-418f-8836-19f6f6ccdafb None None] Releasing lock "compute-rpcapi-router" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:22:19.735675 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cab3296f-7edd-418f-8836-19f6f6ccdafb None None] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502274 Oct 17 15:22:19.741804 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 26/64] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:19.766185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-602c1bfb-12ab-4188-ac1d-7c98415922e7 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:19.834697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:19.877384 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88d0ccc4-311d-4be3-a1e8-e1df80691ef5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.699633 Oct 17 15:22:19.878817 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 39/65] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:19 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:19.890858 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-602c1bfb-12ab-4188-ac1d-7c98415922e7 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.137426 Oct 17 15:22:19.895056 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 27/66] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:19 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:19.899417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:19.905518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:19.916886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f168a2b0-1877-401c-8ad6-3762ee168787 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:19.918007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:19.920919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:19.926714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.928503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:19.929323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:19.929968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:19.963448 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f168a2b0-1877-401c-8ad6-3762ee168787 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1114132555" status: 202 len: 0 microversion: 2.1 time: 0.052530 Oct 17 15:22:19.970320 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 28/67] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:22:19 2022] DELETE /compute/v2.1/flavors/1114132555 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:22:19.982927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f72d3e94-0545-477e-8085-edd97b2cc80f tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:20.062568 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f72d3e94-0545-477e-8085-edd97b2cc80f tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085026 Oct 17 15:22:20.081065 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 29/68] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:20.095300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc68a2a4-e894-415c-833d-48272cb2e6ef tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-692685545", "id": 1058782820, "os-flavor-access:is_public": "True"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:20.140909 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc68a2a4-e894-415c-833d-48272cb2e6ef tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.052890 Oct 17 15:22:20.156456 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 30/69] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:20 2022] POST /compute/v2.1/flavors => generated 428 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:20.161744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-94616e72-9a76-4d62-bee9-d36d35f4be45 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:20.204317 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-94616e72-9a76-4d62-bee9-d36d35f4be45 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1058782820" status: 202 len: 0 microversion: 2.1 time: 0.046553 Oct 17 15:22:20.205465 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 31/70] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:22:20 2022] DELETE /compute/v2.1/flavors/1058782820 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:22:20.215667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:20.216469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:20.235726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:20.237059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:20.237514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:20.238273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:20.239119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:20.239591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:20.638171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:20.659697 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-873c5f40-87e0-4e0e-acff-8fc5746e3f32 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.769138 Oct 17 15:22:20.661731 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 40/71] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:19 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:20.674628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15bd8999-53b5-4447-a224-022c03a53d49 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:20.724598 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15bd8999-53b5-4447-a224-022c03a53d49 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061356 Oct 17 15:22:20.728653 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 41/72] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:20.731218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15bd8999-53b5-4447-a224-022c03a53d49 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:20.734384 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15bd8999-53b5-4447-a224-022c03a53d49 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004325 Oct 17 15:22:20.735302 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 42/73] 10.222.0.87 () {56 vars in 886 bytes} [Mon Oct 17 15:22:20 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 15:22:20.771721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63db5fa7-c742-4dda-8889-0079074d56da tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2129020481", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:20.830347 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63db5fa7-c742-4dda-8889-0079074d56da tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.071565 Oct 17 15:22:20.832766 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 43/74] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:20 2022] POST /compute/v2.1/flavors => generated 507 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:20.850808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d863dec-cf56-40dd-b4b5-be804b0ff115 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:20.901961 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d863dec-cf56-40dd-b4b5-be804b0ff115 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/91dc81a9-a109-490b-92c4-4e17410a37f7" status: 202 len: 0 microversion: 2.1 time: 0.059849 Oct 17 15:22:20.903361 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 44/75] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:22:20 2022] DELETE /compute/v2.1/flavors/91dc81a9-a109-490b-92c4-4e17410a37f7 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:22:20.914657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:20.915921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:20.932486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:20.936761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:20.938729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:20.943422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:20.945111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:20.948094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:21.342349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:21.347573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:21.360426 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02e5786a-5808-432a-a453-dcc7fdd2c679 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 1.153607 Oct 17 15:22:21.361048 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 32/76] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:20 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:21.384959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-900ee1cb-9994-41a2-9b60-7ec516fc44eb tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:21.452595 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-900ee1cb-9994-41a2-9b60-7ec516fc44eb tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081493 Oct 17 15:22:21.453363 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 33/77] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:21.479096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-871084e7-a4a6-4f97-95a7-0f493a66839a tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-445433400", "id": "aa7e5337-3695-4d90-87a1-a71edc39fd0f", "os-flavor-access:is_public": "True"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:21.489152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:21.499438 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-05863864-d9f4-4aed-8d74-6666c8c24be8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.593874 Oct 17 15:22:21.500513 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 45/78] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:20 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:21.543057 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-871084e7-a4a6-4f97-95a7-0f493a66839a tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.067947 Oct 17 15:22:21.549656 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 34/79] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:21 2022] POST /compute/v2.1/flavors => generated 506 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:21.557453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00a20152-4dc2-481f-813d-7b63db939215 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:21.614034 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00a20152-4dc2-481f-813d-7b63db939215 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/aa7e5337-3695-4d90-87a1-a71edc39fd0f" status: 202 len: 0 microversion: 2.1 time: 0.060321 Oct 17 15:22:21.619913 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 46/80] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:22:21 2022] DELETE /compute/v2.1/flavors/aa7e5337-3695-4d90-87a1-a71edc39fd0f => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:22:21.625206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1bd7ec04-31c2-498a-87e4-1c7b30ca3646 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:21.650553 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1bd7ec04-31c2-498a-87e4-1c7b30ca3646 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030797 Oct 17 15:22:21.663334 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 35/81] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:21.675226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a5f89c6-c7a4-4036-88bb-2bfe74288c6b tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-647093652", "id": 1084951361, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:21.697548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:21.704845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:21.720145 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a5f89c6-c7a4-4036-88bb-2bfe74288c6b tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.049268 Oct 17 15:22:21.729958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:21.736335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:21.742689 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 47/82] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:21 2022] POST /compute/v2.1/flavors => generated 413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:21.748567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55c5a888-b731-4e2e-a164-4d74535d8c68 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:21.752248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:21.753434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:21.754143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:21.758830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:21.760161 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55c5a888-b731-4e2e-a164-4d74535d8c68 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/1084951361" status: 200 len: 413 microversion: 2.1 time: 0.016074 Oct 17 15:22:21.771726 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 48/83] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:22:21 2022] GET /compute/v2.1/flavors/1084951361 => generated 413 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:22.056861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9cca907-da2d-47c8-8310-ea322a3b2fdd tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.089964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=72,nova_api:SAVEPOINT=4,nova_api:INSERT=4,nova_api:RELEASE=4,nova_api:DELETE=9,nova_api:UPDATE=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:22.114177 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9cca907-da2d-47c8-8310-ea322a3b2fdd tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.340592 Oct 17 15:22:22.115493 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 49/84] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:21 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:22.121349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9f4d8c88-a9bc-49ae-bea4-b86ead0a0046 req-ee49d5b7-e16c-4a72-9f2c-f434e5b1e5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f02af31-9081-4bdb-bd3c-a8404fe9f13e", "tag": "3c42a293-ed18-4cf7-aaee-0cccfb225301"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:22.135134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f4d8c88-a9bc-49ae-bea4-b86ead0a0046 req-ee49d5b7-e16c-4a72-9f2c-f434e5b1e5ec service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:22.135623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f4d8c88-a9bc-49ae-bea4-b86ead0a0046 req-ee49d5b7-e16c-4a72-9f2c-f434e5b1e5ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:22.136401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f4d8c88-a9bc-49ae-bea4-b86ead0a0046 req-ee49d5b7-e16c-4a72-9f2c-f434e5b1e5ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:22.149244 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9f4d8c88-a9bc-49ae-bea4-b86ead0a0046 req-ee49d5b7-e16c-4a72-9f2c-f434e5b1e5ec service nova] Creating event network-changed:3c42a293-ed18-4cf7-aaee-0cccfb225301 for instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e on n-h1-854441-12 Oct 17 15:22:22.157020 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9f4d8c88-a9bc-49ae-bea4-b86ead0a0046 req-ee49d5b7-e16c-4a72-9f2c-f434e5b1e5ec service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039799 Oct 17 15:22:22.157985 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 50/85] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:22.164454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61bad5fd-c0d5-488f-9c3c-9b54b60e11c9 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.187773 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61bad5fd-c0d5-488f-9c3c-9b54b60e11c9 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1084951361" status: 202 len: 0 microversion: 2.1 time: 0.028001 Oct 17 15:22:22.193665 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 51/86] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:22:22 2022] DELETE /compute/v2.1/flavors/1084951361 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:22:22.200016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9005c2ac-e368-464b-84ff-65a95cc87f67 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.226427 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9005c2ac-e368-464b-84ff-65a95cc87f67 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030391 Oct 17 15:22:22.238128 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 52/87] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:22.252304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77a9ceff-7ef3-4134-a7be-8f68bf7a0a89 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1368297975", "id": 38464532, "os-flavor-access:is_public": "False"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:22.274977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:22.282126 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77a9ceff-7ef3-4134-a7be-8f68bf7a0a89 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.037260 Oct 17 15:22:22.283359 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 53/88] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:22 2022] POST /compute/v2.1/flavors => generated 424 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:22.284039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5659a88-7036-4a83-986a-6789905b3a0e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.593767 Oct 17 15:22:22.284772 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 36/89] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:21 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:22.312115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a1fc1f2-a2c3-4bad-a431-eb94f7e50d5b tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "38464532"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:22.325304 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7a1fc1f2-a2c3-4bad-a431-eb94f7e50d5b tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] HTTP exception thrown: Flavor 38464532 could not be found. Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a1fc1f2-a2c3-4bad-a431-eb94f7e50d5b tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] Request method failure captured: Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 105 Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMk4TPkYC2U7nWsgnUHNnhqTEyferpMf4vO77RjhxZEVsE_DYAwIgcG_bmpsxUVXNaIrv8XQ4eUqkzF1A27BeAvr_OVjlsJGgwvtEC1K3SJk1Rb2Fp_0pc6FZn_vZzblK15Qq3ZcNNHJGwml35XeuySNe7gRSLLXqkPDJkQNREtw98 Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8a80c39830b44fc4ae32020090352528 Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsAdminTestJSON-403481319 Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:22.328933 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8a80c39830b44fc4ae32020090352528"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8a80c39830b44fc4ae32020090352528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8a80c39830b44fc4ae32020090352528"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8a80c39830b44fc4ae32020090352528"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsAdminTestJSON-403481319 Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8a80c39830b44fc4ae32020090352528 Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-403481319 Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsAdminTestJSON-403481319-project Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: f21bfa20819b49d083d8267e0c34b5c1 Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsAdminTestJSON-403481319-project Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "test", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "38464532"}} Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:22.331693 n-d-854441-12 devstack@n-api.service[120406]: exception: Flavor 38464532 could not be found. Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '38464532'}}} Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 38464532 could not be found. Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:22.335236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 38464532 could not be found. Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:22.336317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:22.337490 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:22.337490 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:22.337490 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:22.337490 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 38464532 could not be found. Oct 17 15:22:22.337490 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:22.337490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a1fc1f2-a2c3-4bad-a431-eb94f7e50d5b tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] Returning 400 to user: Flavor 38464532 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:22.337490 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a1fc1f2-a2c3-4bad-a431-eb94f7e50d5b tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 79 microversion: 2.1 time: 0.024352 Oct 17 15:22:22.337490 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 54/90] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:22 2022] POST /compute/v2.1/servers => generated 79 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:22:22.342408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-afe6c93b-3d57-400e-84af-461f88b0f321 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.362763 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-afe6c93b-3d57-400e-84af-461f88b0f321 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/38464532" status: 202 len: 0 microversion: 2.1 time: 0.023953 Oct 17 15:22:22.363690 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 37/91] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:22 2022] DELETE /compute/v2.1/flavors/38464532 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:22:22.377996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94ed2a19-ceaf-4dd0-8855-928ab2211f37 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.389356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.390289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:22.397432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:22.397921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:22.398350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:22.399154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:22.399602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:22.400251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:22.405798 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94ed2a19-ceaf-4dd0-8855-928ab2211f37 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035001 Oct 17 15:22:22.421559 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 55/92] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:22.426801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35fc603a-11bb-45e6-bc88-0779a505fe9d tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-112820087", "id": 594747898, "os-flavor-access:is_public": "False"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:22.451695 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35fc603a-11bb-45e6-bc88-0779a505fe9d tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.028636 Oct 17 15:22:22.452472 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 56/93] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:22 2022] POST /compute/v2.1/flavors => generated 411 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:22.467810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63a8a224-785f-453c-9e40-febd24d72dec tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-30725521", "id": 1610840091, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:22.487894 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63a8a224-785f-453c-9e40-febd24d72dec tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.023926 Oct 17 15:22:22.488517 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 57/94] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:22 2022] POST /compute/v2.1/flavors => generated 412 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:22.502270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d50eb37c-7100-4c47-83a3-368278319cc8 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.523870 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d50eb37c-7100-4c47-83a3-368278319cc8 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.025908 Oct 17 15:22:22.530671 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 58/95] 10.222.0.87 () {58 vars in 1169 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:22.537995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.540100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:22.548403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:22.548895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:22.549536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:22.550654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:22.551114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:22.551598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:22.657458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:22.665318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07ef0c9a-53e0-4e83-ae85-60adcebf527b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.280500 Oct 17 15:22:22.666270 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 38/96] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:22.671096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b0c0d47-55eb-4653-a87d-1f7e1ee02b20 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.689392 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b0c0d47-55eb-4653-a87d-1f7e1ee02b20 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.021811 Oct 17 15:22:22.690715 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 39/97] 10.222.0.87 () {58 vars in 1177 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:22.704204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22d4c542-89b2-4507-b858-fd3c4598c0f8 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.714928 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22d4c542-89b2-4507-b858-fd3c4598c0f8 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.014451 Oct 17 15:22:22.715614 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 40/98] 10.222.0.87 () {58 vars in 1171 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:22.729447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc06791e-7979-4a10-b2b2-3651dd86be5f tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.741096 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc06791e-7979-4a10-b2b2-3651dd86be5f tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.015213 Oct 17 15:22:22.747515 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 41/99] 10.222.0.87 () {58 vars in 1169 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:22.760640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-28e6f57b-5234-4605-86b1-cb649fefb984 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.785161 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-28e6f57b-5234-4605-86b1-cb649fefb984 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5393 microversion: 2.1 time: 0.032740 Oct 17 15:22:22.786709 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 42/100] 10.222.0.87 () {58 vars in 1169 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5393 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:22.803885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:22.809539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-213cc65b-cd30-45f6-833d-801ab9f9dad6 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.813751 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34fb8c8c-1972-4537-92c9-bb650d2bdf09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.281352 Oct 17 15:22:22.814368 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 59/101] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:22.831967 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-213cc65b-cd30-45f6-833d-801ab9f9dad6 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5393 microversion: 2.1 time: 0.030889 Oct 17 15:22:22.832687 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 43/102] 10.222.0.87 () {58 vars in 1175 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5393 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:22.866048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eca540cf-c17f-43b5-862e-16aa2498d5bf tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.893823 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eca540cf-c17f-43b5-862e-16aa2498d5bf tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5393 microversion: 2.1 time: 0.031831 Oct 17 15:22:22.894099 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 60/103] 10.222.0.87 () {58 vars in 1173 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5393 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:22.916910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-394a6e9c-779f-4d82-9bd8-3d4989e1e582 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.947360 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-394a6e9c-779f-4d82-9bd8-3d4989e1e582 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5393 microversion: 2.1 time: 0.038091 Oct 17 15:22:22.948457 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 44/104] 10.222.0.87 () {58 vars in 1169 bytes} [Mon Oct 17 15:22:22 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5393 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:22.967658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ab35a8b-a976-4300-9bed-b08a4e3d1b83 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:22.995711 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ab35a8b-a976-4300-9bed-b08a4e3d1b83 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1610840091" status: 202 len: 0 microversion: 2.1 time: 0.032266 Oct 17 15:22:22.996878 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 61/105] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:22:22 2022] DELETE /compute/v2.1/flavors/1610840091 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:22:23.008805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe8d53a6-f5f8-473f-8039-f1775e509ba3 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.034838 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe8d53a6-f5f8-473f-8039-f1775e509ba3 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032494 Oct 17 15:22:23.035449 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 45/106] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:23.053730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12bb0e5d-45a1-4092-a4fe-d8d3ab4e9700 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.073580 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-12bb0e5d-45a1-4092-a4fe-d8d3ab4e9700 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/594747898" status: 202 len: 0 microversion: 2.1 time: 0.023681 Oct 17 15:22:23.074445 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 62/107] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:22:23 2022] DELETE /compute/v2.1/flavors/594747898 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:22:23.083059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-86464678-f0fe-4601-be25-cdb38cd3cfcd tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.104695 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-86464678-f0fe-4601-be25-cdb38cd3cfcd tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025760 Oct 17 15:22:23.105308 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 46/108] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:23.125217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5d1e936-6065-4932-8ca9-539a67a0b73d tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1304430979", "id": 1291784992, "os-flavor-access:is_public": "False"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:23.145178 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5d1e936-6065-4932-8ca9-539a67a0b73d tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.023985 Oct 17 15:22:23.145916 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 63/109] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:23 2022] POST /compute/v2.1/flavors => generated 415 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:23.161532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5048f3e3-9f8f-4d33-9104-631a18a9d9f5 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.189272 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5048f3e3-9f8f-4d33-9104-631a18a9d9f5 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033765 Oct 17 15:22:23.190335 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 47/110] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:23.212583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0dc661c6-cc36-416e-8126-4f8722ec7d92 tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.235601 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0dc661c6-cc36-416e-8126-4f8722ec7d92 tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027616 Oct 17 15:22:23.236400 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 64/111] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:23.254383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-90a2322f-ebea-4683-8c05-a05fc498fd1d tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.276209 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-90a2322f-ebea-4683-8c05-a05fc498fd1d tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1291784992" status: 202 len: 0 microversion: 2.1 time: 0.025494 Oct 17 15:22:23.276918 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 48/112] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:22:23 2022] DELETE /compute/v2.1/flavors/1291784992 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:22:23.285613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9ed434b-8cc8-4b2f-b6f1-abda769b2780 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.307037 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9ed434b-8cc8-4b2f-b6f1-abda769b2780 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025041 Oct 17 15:22:23.307659 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 65/113] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:23.316477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.317428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:23.328224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:23.329047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:23.329608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:23.330633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:23.331434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:23.332207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:23.334306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f9cfe25-25ae-4833-a18b-c2cf8877741d tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1761211177", "id": 1909430674, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:23.364982 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f9cfe25-25ae-4833-a18b-c2cf8877741d tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.036748 Oct 17 15:22:23.367568 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 66/114] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:23 2022] POST /compute/v2.1/flavors => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:23.394484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0d7cae2e-3da8-470e-872a-c03d80ee4352 tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.433563 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0d7cae2e-3da8-470e-872a-c03d80ee4352 tempest-FlavorsAdminTestJSON-403481319 tempest-FlavorsAdminTestJSON-403481319-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.054487 Oct 17 15:22:23.434106 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 67/115] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:23.452342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83936b6e-2368-49e6-a796-0197a9e41d7a tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.475457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83936b6e-2368-49e6-a796-0197a9e41d7a tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1909430674" status: 202 len: 0 microversion: 2.1 time: 0.026568 Oct 17 15:22:23.476229 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 68/116] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:22:23 2022] DELETE /compute/v2.1/flavors/1909430674 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:22:23.488093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3369a77-6d36-4ff4-b42a-385a18a4a455 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.509037 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3369a77-6d36-4ff4-b42a-385a18a4a455 tempest-FlavorsAdminTestJSON-616184096 tempest-FlavorsAdminTestJSON-616184096-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025143 Oct 17 15:22:23.509636 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 69/117] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:23.689638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.690433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:23.702478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:23.704485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:23.705351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:23.707119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:23.709054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:23.710116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:23.726325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:23.742929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5efa121d-18c1-4258-a62c-e6c5fcaa85fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.430554 Oct 17 15:22:23.747079 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 49/118] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:23.857586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:23.858439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:23.868533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:23.876867 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1642d3cd-e764-4528-b112-f13a9759c3ea tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.191984 Oct 17 15:22:23.890528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:23.890528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:23.890528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:23.890528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:23.890990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:23.890990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:23.891141 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 70/119] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:24.061404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:24.072851 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e280812-3749-4584-ac27-3468df84f029 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.220531 Oct 17 15:22:24.073763 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 50/120] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:23 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:24.769770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:24.770637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:24.778083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:24.778612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:24.779144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:24.779792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:24.780496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:24.781068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:24.803768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:24.962039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:24.970587 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71bd0f76-c514-4304-af9e-6ce601a4061f tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.204682 Oct 17 15:22:24.971783 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 71/121] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:24 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:24.977560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:24.978157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:24.984626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:24.985130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:24.985565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:24.986262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:24.992458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:24.994931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:25.216308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1765389420", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:25.243321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=80,nova_api:DELETE=15 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:25.358674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:22:25.417757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:25.427490 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0af43848-62a3-4238-a783-73b0ed282eb3 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.454366 Oct 17 15:22:25.428285 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 72/122] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:24 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:25.433638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:25.434728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:25.442748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:25.445653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:25.446424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:25.454176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:25.454478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:25.455073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:25.681376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=7 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:25.747794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:25.775482 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3e0b5d2-40ec-4da4-928e-7c376899da92 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.345572 Oct 17 15:22:25.777911 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 73/123] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:25 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:25.799254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:22:25.800007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:22:25.800690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:22:25.801763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:22:25.802400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:22:25.813028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:25.813890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:25.815094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:25.816066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:25.817222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:25.817879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:25.839184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Getting quotas for project a56244de709340a3b979ad0ffed87591. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:22:25.844547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Getting quotas for user 026f3d5447f24497b95b136a29f9489d and project a56244de709340a3b979ad0ffed87591. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:22:25.858732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:22:25.861149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:22:25.927323 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-389bc3fe-289a-47a2-a07d-4b54842d5887 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052897 Oct 17 15:22:25.928359 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 51/124] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:22:25.939543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eeb5a94d-ec3e-4a41-8639-a96ae6272b52 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:25.940145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eeb5a94d-ec3e-4a41-8639-a96ae6272b52 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:26.016780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:26.017410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:26.023914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.024416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.024854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.025571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.026017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.026468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.096433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eeb5a94d-ec3e-4a41-8639-a96ae6272b52 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:26.117974 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eeb5a94d-ec3e-4a41-8639-a96ae6272b52 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1214 microversion: 2.1 time: 0.177161 Oct 17 15:22:26.134349 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 74/125] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:25 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:26.245606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:26.259410 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31cc9017-aa56-4a62-a0c4-4506cba5045c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.252329 Oct 17 15:22:26.260170 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 52/126] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:26 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:26.463079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:26.463079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:26.486942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.487553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.490666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.492494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.494057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.499205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.741711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Calling method '.version_select at 0x7f28bfb61550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:26.744383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:26.752476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.753594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.754694 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-964a17ea-91a3-4365-a43f-2bacc49a97c4 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.301263 Oct 17 15:22:26.755659 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 75/127] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:26 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:26.755991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.788376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.791123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.796080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.802385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:26.803214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:26.810729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.811671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.811804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.813474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.813934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.814538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.867365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.868137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.868654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.882213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.883434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.884258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.911511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.912302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.912773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.922445 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dcb0338e-241d-40a4-b06a-19175a4c3d84 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1826 microversion: 2.53 time: 0.412326 Oct 17 15:22:26.923545 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 53/128] 10.222.0.87 () {60 vars in 1243 bytes} [Mon Oct 17 15:22:26 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1826 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:22:26.942632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Calling method '.version_select at 0x7f28bfb7a670>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:26.946462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.947394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.947951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:26.967819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:26.968126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:26.968686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.003453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.004084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.004496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.018902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.019405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.019851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.037801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.038340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.039257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.047945 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7763fdf-c77c-410a-b2e6-339a37becb9b tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 517 microversion: 2.53 time: 0.110270 Oct 17 15:22:27.057454 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 54/129] 10.222.0.87 () {60 vars in 1222 bytes} [Mon Oct 17 15:22:26 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 517 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:22:27.057804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:27.065575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c75ed3d-d88b-4c56-bc20-40191c2d7000 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Calling method '.version_select at 0x7f28bfbe0b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:27.068512 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f929d39-3b61-41a2-954e-364a8838d8fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.270875 Oct 17 15:22:27.069614 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 76/130] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:26 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:27.070023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c75ed3d-d88b-4c56-bc20-40191c2d7000 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.070596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c75ed3d-d88b-4c56-bc20-40191c2d7000 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.071122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c75ed3d-d88b-4c56-bc20-40191c2d7000 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.101441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c75ed3d-d88b-4c56-bc20-40191c2d7000 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.102061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c75ed3d-d88b-4c56-bc20-40191c2d7000 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.102770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c75ed3d-d88b-4c56-bc20-40191c2d7000 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.110283 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0c75ed3d-d88b-4c56-bc20-40191c2d7000 tempest-HypervisorAdminV253TestBase-697002518 tempest-HypervisorAdminV253TestBase-697002518-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/0498e363-e3c9-4c22-b3db-404fa38f5ddb" status: 200 len: 794 microversion: 2.53 time: 0.048533 Oct 17 15:22:27.111101 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 55/131] 10.222.0.87 () {60 vars in 1298 bytes} [Mon Oct 17 15:22:27 2022] GET /compute/v2.1/os-hypervisors/0498e363-e3c9-4c22-b3db-404fa38f5ddb => generated 794 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:27.144001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:27.144884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:27.152516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.152984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.156485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.158401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.159100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.159581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.242238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:27.251654 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff8d1142-1d9c-4be0-8971-167e8a8581f6 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1266 microversion: 2.1 time: 0.111357 Oct 17 15:22:27.266632 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 77/132] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:27 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:27.283508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:27.284143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:27.291655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.292459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.293858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.296293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.297273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.297854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.504196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:27.515455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f87f7791-3462-4f35-8ef1-1a050ef7ee7c tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.235718 Oct 17 15:22:27.516471 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 56/133] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:27 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:27.795671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:27.796673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:27.803852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.805168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.805816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:27.806840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:27.807350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:27.807966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:28.026797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:28.039503 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c00e03e9-47fe-4e3c-b8d6-b1622d11b001 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.247414 Oct 17 15:22:28.055828 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 78/134] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:27 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:28.108711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:28.109336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:28.116713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:28.117173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:28.117764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:28.119215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:28.119853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:28.120920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:28.292165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:28.293675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:28.310176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:28.311487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:28.312060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:28.312927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:28.313593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:28.314198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:28.391268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:28.410960 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2943a736-a80b-4cea-9009-03232a063f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.313093 Oct 17 15:22:28.413665 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 57/135] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:28 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:28.535477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:28.550790 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7fc0f956-bb0e-4374-a6b4-c768cc854a71 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1272 microversion: 2.1 time: 0.272314 Oct 17 15:22:28.565862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:28.567186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:28.572309 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 79/136] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:28 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:28.588975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:28.592367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:28.593106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:28.594634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:28.598698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:28.599498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:28.913464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e32f00a-a80d-4b1b-a6e4-6bda550b571f tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Calling method '.version_select at 0x7f28bfbcfdc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:28.921146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e32f00a-a80d-4b1b-a6e4-6bda550b571f tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:28.921837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e32f00a-a80d-4b1b-a6e4-6bda550b571f tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:28.922682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e32f00a-a80d-4b1b-a6e4-6bda550b571f tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:28.923841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e32f00a-a80d-4b1b-a6e4-6bda550b571f tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:28.924309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e32f00a-a80d-4b1b-a6e4-6bda550b571f tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:28.924736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e32f00a-a80d-4b1b-a6e4-6bda550b571f tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:28.969070 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e32f00a-a80d-4b1b-a6e4-6bda550b571f tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.350670 Oct 17 15:22:28.971116 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 80/137] 10.222.0.87 () {58 vars in 1128 bytes} [Mon Oct 17 15:22:28 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:29.030943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:29.089773 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-70278e99-c846-416c-9b76-af989619cc08 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.504538 Oct 17 15:22:29.096606 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 58/138] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:28 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:29.110755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:29.123146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:29.145154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:29.146479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:29.147530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:29.152478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:29.153891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:29.155217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:29.390558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-890ab83c-062c-47da-8d3f-45d0e70c4da0 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Calling method '.version_select at 0x7f28bfa5d5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:29.397075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-890ab83c-062c-47da-8d3f-45d0e70c4da0 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '80e45d52b2b043ab967597eb1c83caa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfa2c25161346ae8008bcfa3ed6c8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-890ab83c-062c-47da-8d3f-45d0e70c4da0 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Request method failure captured: Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMzJeVVu6Iv87r_tNy7yLLukOwGdr1aDq5p593e2RnnbUNx9S6VifTbzD-VlDUkIxljd-nUSYY_YvuzKeyj0jN1OHKzXDjvkyaWFXxdqoAYSHevSNGliDbH4ViqbdoKpC7OvMTQlm9XCug2QEkfHa1nVN61Iqvp9Ynkd6fM1hpTVcI Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:29.401648 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 80e45d52b2b043ab967597eb1c83caa8 Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: action_args: {} Oct 17 15:22:29.403915 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:29.405312 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 15:22:29.407054 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.411524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-890ab83c-062c-47da-8d3f-45d0e70c4da0 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:29.413505 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-890ab83c-062c-47da-8d3f-45d0e70c4da0 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] 10.222.0.87 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.431698 Oct 17 15:22:29.423405 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 81/139] 10.222.0.87 () {58 vars in 1128 bytes} [Mon Oct 17 15:22:28 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 442 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:29.511618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:29.541407 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e087c3cd-cd02-478b-b511-1971e619ef81 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.442734 Oct 17 15:22:29.542224 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 59/140] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:29 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:29.568191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a034c012-f7bd-4912-8363-23bf1eec4e93 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Calling method '.version_select at 0x7f28bfaca1f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:29.570142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a034c012-f7bd-4912-8363-23bf1eec4e93 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '80e45d52b2b043ab967597eb1c83caa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfa2c25161346ae8008bcfa3ed6c8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a034c012-f7bd-4912-8363-23bf1eec4e93 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Request method failure captured: Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hosts/n-d-854441-12/reboot HTTP/1.1 Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMzJeVVu6Iv87r_tNy7yLLukOwGdr1aDq5p593e2RnnbUNx9S6VifTbzD-VlDUkIxljd-nUSYY_YvuzKeyj0jN1OHKzXDjvkyaWFXxdqoAYSHevSNGliDbH4ViqbdoKpC7OvMTQlm9XCug2QEkfHa1nVN61Iqvp9Ynkd6fM1hpTVcI Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:29.579096 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 80e45d52b2b043ab967597eb1c83caa8 Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'n-d-854441-12'} Oct 17 15:22:29.580321 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:29.581020 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 15:22:29.582369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.583227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a034c012-f7bd-4912-8363-23bf1eec4e93 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:29.583227 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a034c012-f7bd-4912-8363-23bf1eec4e93 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] 10.222.0.87 "GET /compute/v2.1/os-hosts/n-d-854441-12/reboot" status: 403 len: 111 microversion: 2.1 time: 0.026150 Oct 17 15:22:29.583227 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 60/141] 10.222.0.87 () {58 vars in 1191 bytes} [Mon Oct 17 15:22:29 2022] GET /compute/v2.1/os-hosts/n-d-854441-12/reboot => generated 111 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:29.605952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:29.605952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:29.606699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3565ca1a-fed8-45a9-ae0b-a0b4fbf75843 req-3f407806-bf91-4901-b1f2-91b47948466d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b972480-ce14-4f7f-87c1-1b97fa848e2f", "name": "network-vif-plugged", "status": "completed", "tag": "de78e63f-5fcf-47d1-a747-d45683d5ffc2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:29.618134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3565ca1a-fed8-45a9-ae0b-a0b4fbf75843 req-3f407806-bf91-4901-b1f2-91b47948466d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:29.618417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:29.618659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:29.619081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:29.619986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:29.620581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:29.621299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:29.625371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3565ca1a-fed8-45a9-ae0b-a0b4fbf75843 req-3f407806-bf91-4901-b1f2-91b47948466d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:29.625983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3565ca1a-fed8-45a9-ae0b-a0b4fbf75843 req-3f407806-bf91-4901-b1f2-91b47948466d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:29.653485 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3565ca1a-fed8-45a9-ae0b-a0b4fbf75843 req-3f407806-bf91-4901-b1f2-91b47948466d service nova] Creating event network-vif-plugged:de78e63f-5fcf-47d1-a747-d45683d5ffc2 for instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f on n-h1-854441-12 Oct 17 15:22:29.667856 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3565ca1a-fed8-45a9-ae0b-a0b4fbf75843 req-3f407806-bf91-4901-b1f2-91b47948466d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242253 Oct 17 15:22:29.671154 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 82/142] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:29.681401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6436b205-afc5-4f78-ab3f-fa9a21ea5ed4 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Calling method '.version_select at 0x7f28bf9bedc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:29.685574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:29.701468 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6436b205-afc5-4f78-ab3f-fa9a21ea5ed4 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6436b205-afc5-4f78-ab3f-fa9a21ea5ed4 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Request method failure captured: Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXM0zH-XN1KmHP2iQvVgBE6UUgJg-5TzAfihMkgs2cWk8p1PZTyLHtCkEiIQnfAEKXrjg6KxfeRTOSmVYJWPwDifTCyRFJ_0cWpjyaZxsqEYjCF3dPciB-UYxY50u8GF0fpVge9KUYi1jnBke-_smG3A9grj8--S0SU42PWojjAX0Lg Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:29.710446 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b304dd669c2d41d68f10234861afe927 Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'nonexistent_hostname'} Oct 17 15:22:29.711813 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:29.712505 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 15:22:29.713428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.714364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.716468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6436b205-afc5-4f78-ab3f-fa9a21ea5ed4 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:29.717518 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6436b205-afc5-4f78-ab3f-fa9a21ea5ed4 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.043970 Oct 17 15:22:29.718325 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 83/143] 10.222.0.87 () {58 vars in 1212 bytes} [Mon Oct 17 15:22:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:29.731009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:29.732106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:29.745781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:29.746689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:29.747872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:29.748854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:29.750269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:29.750930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:29.898375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:29.908437 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f93fc414-7d7b-4570-af09-db665ca51534 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.326259 Oct 17 15:22:29.909294 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 61/144] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:29 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:29.928400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-409a217d-f2be-4b12-a727-0d74455b9a2f tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Calling method '.version_select at 0x7f28bfadbb80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:29.930326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-409a217d-f2be-4b12-a727-0d74455b9a2f tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '80e45d52b2b043ab967597eb1c83caa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfa2c25161346ae8008bcfa3ed6c8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-409a217d-f2be-4b12-a727-0d74455b9a2f tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Request method failure captured: Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hosts/n-d-854441-12 HTTP/1.1 Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMzJeVVu6Iv87r_tNy7yLLukOwGdr1aDq5p593e2RnnbUNx9S6VifTbzD-VlDUkIxljd-nUSYY_YvuzKeyj0jN1OHKzXDjvkyaWFXxdqoAYSHevSNGliDbH4ViqbdoKpC7OvMTQlm9XCug2QEkfHa1nVN61Iqvp9Ynkd6fM1hpTVcI Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:29.931996 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 80e45d52b2b043ab967597eb1c83caa8 Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'n-d-854441-12'} Oct 17 15:22:29.933134 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:29.934050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 15:22:29.935271 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.936195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-409a217d-f2be-4b12-a727-0d74455b9a2f tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:29.936195 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-409a217d-f2be-4b12-a727-0d74455b9a2f tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] 10.222.0.87 "GET /compute/v2.1/os-hosts/n-d-854441-12" status: 403 len: 109 microversion: 2.1 time: 0.023186 Oct 17 15:22:29.946883 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 62/145] 10.222.0.87 () {58 vars in 1170 bytes} [Mon Oct 17 15:22:29 2022] GET /compute/v2.1/os-hosts/n-d-854441-12 => generated 109 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:29.952192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8230272a-8337-4fa3-b4fb-d9722ac25c51 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Calling method '.version_select at 0x7f28bfa20040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:29.963422 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8230272a-8337-4fa3-b4fb-d9722ac25c51 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8230272a-8337-4fa3-b4fb-d9722ac25c51 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Request method failure captured: Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXM0zH-XN1KmHP2iQvVgBE6UUgJg-5TzAfihMkgs2cWk8p1PZTyLHtCkEiIQnfAEKXrjg6KxfeRTOSmVYJWPwDifTCyRFJ_0cWpjyaZxsqEYjCF3dPciB-UYxY50u8GF0fpVge9KUYi1jnBke-_smG3A9grj8--S0SU42PWojjAX0Lg Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:22:29.968591 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b304dd669c2d41d68f10234861afe927 Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'nonexistent_hostname'} Oct 17 15:22:29.969779 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.970623 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:29.972087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.973014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8230272a-8337-4fa3-b4fb-d9722ac25c51 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:29.973014 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8230272a-8337-4fa3-b4fb-d9722ac25c51 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022195 Oct 17 15:22:29.976835 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 63/146] 10.222.0.87 () {58 vars in 1191 bytes} [Mon Oct 17 15:22:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:29.982148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aba556f3-e51e-4fcf-ab54-a35d30ca2c2d tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Calling method '.version_select at 0x7f28bfb618b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:29.984046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aba556f3-e51e-4fcf-ab54-a35d30ca2c2d tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '80e45d52b2b043ab967597eb1c83caa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfa2c25161346ae8008bcfa3ed6c8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aba556f3-e51e-4fcf-ab54-a35d30ca2c2d tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Request method failure captured: Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hosts/n-d-854441-12/shutdown HTTP/1.1 Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMzJeVVu6Iv87r_tNy7yLLukOwGdr1aDq5p593e2RnnbUNx9S6VifTbzD-VlDUkIxljd-nUSYY_YvuzKeyj0jN1OHKzXDjvkyaWFXxdqoAYSHevSNGliDbH4ViqbdoKpC7OvMTQlm9XCug2QEkfHa1nVN61Iqvp9Ynkd6fM1hpTVcI Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:29.985689 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 80e45d52b2b043ab967597eb1c83caa8 Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'n-d-854441-12'} Oct 17 15:22:29.987057 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:29.987824 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 15:22:29.989093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:29.990103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aba556f3-e51e-4fcf-ab54-a35d30ca2c2d tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:29.990103 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aba556f3-e51e-4fcf-ab54-a35d30ca2c2d tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] 10.222.0.87 "GET /compute/v2.1/os-hosts/n-d-854441-12/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009163 Oct 17 15:22:29.996925 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 64/147] 10.222.0.87 () {58 vars in 1197 bytes} [Mon Oct 17 15:22:29 2022] GET /compute/v2.1/os-hosts/n-d-854441-12/shutdown => generated 113 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:30.002806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d88f655a-3b0e-425f-8b90-61ad2cb2f251 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Calling method '.version_select at 0x7f28bfa0f700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:30.047914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d88f655a-3b0e-425f-8b90-61ad2cb2f251 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d88f655a-3b0e-425f-8b90-61ad2cb2f251 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Request method failure captured: Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXM0zH-XN1KmHP2iQvVgBE6UUgJg-5TzAfihMkgs2cWk8p1PZTyLHtCkEiIQnfAEKXrjg6KxfeRTOSmVYJWPwDifTCyRFJ_0cWpjyaZxsqEYjCF3dPciB-UYxY50u8GF0fpVge9KUYi1jnBke-_smG3A9grj8--S0SU42PWojjAX0Lg Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:22:30.053060 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b304dd669c2d41d68f10234861afe927 Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'nonexistent_hostname'} Oct 17 15:22:30.054222 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:30.054888 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 15:22:30.055786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.056703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.063051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d88f655a-3b0e-425f-8b90-61ad2cb2f251 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:30.064282 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d88f655a-3b0e-425f-8b90-61ad2cb2f251 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.066055 Oct 17 15:22:30.065097 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 65/148] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:22:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:30.080748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-83aeccec-620c-46ce-b435-e4f283fc9a94 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Calling method '.version_select at 0x7f28bf8f7dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:30.082589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-83aeccec-620c-46ce-b435-e4f283fc9a94 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '80e45d52b2b043ab967597eb1c83caa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfa2c25161346ae8008bcfa3ed6c8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-83aeccec-620c-46ce-b435-e4f283fc9a94 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Request method failure captured: Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hosts/n-d-854441-12/startup HTTP/1.1 Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMzJeVVu6Iv87r_tNy7yLLukOwGdr1aDq5p593e2RnnbUNx9S6VifTbzD-VlDUkIxljd-nUSYY_YvuzKeyj0jN1OHKzXDjvkyaWFXxdqoAYSHevSNGliDbH4ViqbdoKpC7OvMTQlm9XCug2QEkfHa1nVN61Iqvp9Ynkd6fM1hpTVcI Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:30.084639 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 80e45d52b2b043ab967597eb1c83caa8 Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'n-d-854441-12'} Oct 17 15:22:30.085740 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:30.086383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 15:22:30.087542 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.092244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-83aeccec-620c-46ce-b435-e4f283fc9a94 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:30.093554 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-83aeccec-620c-46ce-b435-e4f283fc9a94 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] 10.222.0.87 "GET /compute/v2.1/os-hosts/n-d-854441-12/startup" status: 403 len: 110 microversion: 2.1 time: 0.016794 Oct 17 15:22:30.094812 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 66/149] 10.222.0.87 () {58 vars in 1194 bytes} [Mon Oct 17 15:22:30 2022] GET /compute/v2.1/os-hosts/n-d-854441-12/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:22:30.105646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8b6cf4cb-fa76-46d2-914e-680babc476ee tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Calling method '.version_select at 0x7f28bf8f7790>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:30.120793 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8b6cf4cb-fa76-46d2-914e-680babc476ee tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8b6cf4cb-fa76-46d2-914e-680babc476ee tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Request method failure captured: Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXM0zH-XN1KmHP2iQvVgBE6UUgJg-5TzAfihMkgs2cWk8p1PZTyLHtCkEiIQnfAEKXrjg6KxfeRTOSmVYJWPwDifTCyRFJ_0cWpjyaZxsqEYjCF3dPciB-UYxY50u8GF0fpVge9KUYi1jnBke-_smG3A9grj8--S0SU42PWojjAX0Lg Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:22:30.122939 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b304dd669c2d41d68f10234861afe927 Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'nonexistent_hostname'} Oct 17 15:22:30.124110 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:30.125203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 15:22:30.126114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.127090 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.129666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8b6cf4cb-fa76-46d2-914e-680babc476ee tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:30.132051 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8b6cf4cb-fa76-46d2-914e-680babc476ee tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.032059 Oct 17 15:22:30.133169 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 67/150] 10.222.0.87 () {58 vars in 1215 bytes} [Mon Oct 17 15:22:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:30.138989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:30.141563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:30.142255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:30.149517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:30.150095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:30.150784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:30.151771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:30.152574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:30.153288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:30.162825 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9da38c1d-bdcb-4a6a-9e7b-07ea0d871b3d tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.436152 Oct 17 15:22:30.165023 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 84/151] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:29 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:30.186895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62bab221-3e5a-4b1e-8c23-a734e70c5272 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Action: 'update', calling method: .version_select at 0x7f28bfae9a60>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62bab221-3e5a-4b1e-8c23-a734e70c5272 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Request method failure captured: Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/n-d-854441-12 HTTP/1.1 Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 51 Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXM0zH-XN1KmHP2iQvVgBE6UUgJg-5TzAfihMkgs2cWk8p1PZTyLHtCkEiIQnfAEKXrjg6KxfeRTOSmVYJWPwDifTCyRFJ_0cWpjyaZxsqEYjCF3dPciB-UYxY50u8GF0fpVge9KUYi1jnBke-_smG3A9grj8--S0SU42PWojjAX0Lg Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:30.201835 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b304dd669c2d41d68f10234861afe927 Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: {"status": "enable", "maintenance_mode": "invalid"} Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:30.204206 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'n-d-854441-12', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance: Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.205481 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.207913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.209917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.209917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:22:30.209917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:22:30.209917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 15:22:30.209917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.216914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62bab221-3e5a-4b1e-8c23-a734e70c5272 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:30.225887 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62bab221-3e5a-4b1e-8c23-a734e70c5272 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-hosts/n-d-854441-12" status: 400 len: 199 microversion: 2.1 time: 0.057177 Oct 17 15:22:30.226977 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 85/152] 10.222.0.87 () {60 vars in 1190 bytes} [Mon Oct 17 15:22:30 2022] PUT /compute/v2.1/os-hosts/n-d-854441-12 => generated 199 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:22:30.245993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d858750-277d-4210-bd65-6b2e6d810550 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf818040>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d858750-277d-4210-bd65-6b2e6d810550 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Request method failure captured: Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/n-d-854441-12 HTTP/1.1 Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 51 Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXM0zH-XN1KmHP2iQvVgBE6UUgJg-5TzAfihMkgs2cWk8p1PZTyLHtCkEiIQnfAEKXrjg6KxfeRTOSmVYJWPwDifTCyRFJ_0cWpjyaZxsqEYjCF3dPciB-UYxY50u8GF0fpVge9KUYi1jnBke-_smG3A9grj8--S0SU42PWojjAX0Lg Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:30.251719 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b304dd669c2d41d68f10234861afe927 Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: {"status": "invalid", "maintenance_mode": "enable"} Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:30.253038 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'n-d-854441-12', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance: Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.253810 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.255363 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.256594 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.256594 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:22:30.256594 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:22:30.256594 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 15:22:30.256594 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.257944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d858750-277d-4210-bd65-6b2e6d810550 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:30.259002 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d858750-277d-4210-bd65-6b2e6d810550 tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-hosts/n-d-854441-12" status: 400 len: 189 microversion: 2.1 time: 0.021870 Oct 17 15:22:30.259740 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 86/153] 10.222.0.87 () {60 vars in 1190 bytes} [Mon Oct 17 15:22:30 2022] PUT /compute/v2.1/os-hosts/n-d-854441-12 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:22:30.274125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c796c61-8913-41f6-acb7-70f7a7c0e0d4 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Action: 'update', calling method: .version_select at 0x7f28bfa96430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:30.279225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c796c61-8913-41f6-acb7-70f7a7c0e0d4 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '80e45d52b2b043ab967597eb1c83caa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfa2c25161346ae8008bcfa3ed6c8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c796c61-8913-41f6-acb7-70f7a7c0e0d4 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Request method failure captured: Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/n-d-854441-12 HTTP/1.1 Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 50 Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMzJeVVu6Iv87r_tNy7yLLukOwGdr1aDq5p593e2RnnbUNx9S6VifTbzD-VlDUkIxljd-nUSYY_YvuzKeyj0jN1OHKzXDjvkyaWFXxdqoAYSHevSNGliDbH4ViqbdoKpC7OvMTQlm9XCug2QEkfHa1nVN61Iqvp9Ynkd6fM1hpTVcI Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:30.281291 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2cfa2c25161346ae8008bcfa3ed6c8ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2cfa2c25161346ae8008bcfa3ed6c8ad Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1136963071 Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 80e45d52b2b043ab967597eb1c83caa8 Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1136963071-project Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: {"status": "enable", "maintenance_mode": "enable"} Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 15:22:30.282384 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'n-d-854441-12', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:30.283220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 15:22:30.284198 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.286744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c796c61-8913-41f6-acb7-70f7a7c0e0d4 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:30.287852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c796c61-8913-41f6-acb7-70f7a7c0e0d4 tempest-HostsAdminNegativeTestJSON-1136963071 tempest-HostsAdminNegativeTestJSON-1136963071-project] 10.222.0.87 "PUT /compute/v2.1/os-hosts/n-d-854441-12" status: 403 len: 111 microversion: 2.1 time: 0.022187 Oct 17 15:22:30.288953 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 87/154] 10.222.0.87 () {60 vars in 1190 bytes} [Mon Oct 17 15:22:30 2022] PUT /compute/v2.1/os-hosts/n-d-854441-12 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:22:30.301180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b989408-6388-450e-95eb-54a496b5e58e tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf820a60>, body: {"status": null, "maintenance_mode": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b989408-6388-450e-95eb-54a496b5e58e tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Request method failure captured: Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/n-d-854441-12 HTTP/1.1 Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 42 Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXM0zH-XN1KmHP2iQvVgBE6UUgJg-5TzAfihMkgs2cWk8p1PZTyLHtCkEiIQnfAEKXrjg6KxfeRTOSmVYJWPwDifTCyRFJ_0cWpjyaZxsqEYjCF3dPciB-UYxY50u8GF0fpVge9KUYi1jnBke-_smG3A9grj8--S0SU42PWojjAX0Lg Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:30.305800 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b304dd669c2d41d68f10234861afe927 Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: {"status": null, "maintenance_mode": null} Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 15:22:30.306989 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'n-d-854441-12', 'body': {'status': None, 'maintenance_mode': None}} Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance: Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi None Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.307721 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.308996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.309882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:22:30.309882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:22:30.309882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 15:22:30.309882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.312152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b989408-6388-450e-95eb-54a496b5e58e tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:30.314056 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b989408-6388-450e-95eb-54a496b5e58e tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-hosts/n-d-854441-12" status: 400 len: 127 microversion: 2.1 time: 0.018406 Oct 17 15:22:30.315011 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 88/155] 10.222.0.87 () {60 vars in 1190 bytes} [Mon Oct 17 15:22:30 2022] PUT /compute/v2.1/os-hosts/n-d-854441-12 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:22:30.325768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5f4c795-8dea-4d6b-935a-e6648b42386d tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf81b8b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:30.329580 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.hosts [None req-f5f4c795-8dea-4d6b-935a-e6648b42386d tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Enabling host nonexistent_hostname. Oct 17 15:22:30.339702 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f5f4c795-8dea-4d6b-935a-e6648b42386d tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5f4c795-8dea-4d6b-935a-e6648b42386d tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Request method failure captured: Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 50 Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXM0zH-XN1KmHP2iQvVgBE6UUgJg-5TzAfihMkgs2cWk8p1PZTyLHtCkEiIQnfAEKXrjg6KxfeRTOSmVYJWPwDifTCyRFJ_0cWpjyaZxsqEYjCF3dPciB-UYxY50u8GF0fpVge9KUYi1jnBke-_smG3A9grj8--S0SU42PWojjAX0Lg Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:30.342136 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ccd8362fed3a443a85b78e66fc2dcb28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ccd8362fed3a443a85b78e66fc2dcb28 Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-800485806 Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b304dd669c2d41d68f10234861afe927 Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-800485806-project-admin Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: {"status": "enable", "maintenance_mode": "enable"} Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.343323 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 15:22:30.344375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:30.345409 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 15:22:30.347187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:30.350419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5f4c795-8dea-4d6b-935a-e6648b42386d tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:30.351355 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5f4c795-8dea-4d6b-935a-e6648b42386d tempest-HostsAdminNegativeTestJSON-800485806 tempest-HostsAdminNegativeTestJSON-800485806-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030277 Oct 17 15:22:30.351949 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 89/156] 10.222.0.87 () {60 vars in 1211 bytes} [Mon Oct 17 15:22:30 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:30.402436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:30.419202 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef53efe1-f399-4362-ae62-4c36ba106b85 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.284354 Oct 17 15:22:30.425818 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 68/157] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:30 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:30.565676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:30.566348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:30.574812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:30.575579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:30.576236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:30.577141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:30.577949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:30.587861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:30.810286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:30.824081 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f297b315-a888-4cd2-975b-e39f505f5ca5 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.262884 Oct 17 15:22:30.825481 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 90/158] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:30 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:30.934026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:30.936399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:30.949318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:30.957044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:30.957728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:30.958492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:30.959017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:30.959439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:30.983383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:31.116065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:31.131540 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-963dad5e-b36a-4f34-87bd-644bd7a08117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.204055 Oct 17 15:22:31.141915 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 69/159] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:30 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:31.200137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:31.202330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:31.220745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:31.221627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:31.222418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:31.223972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:31.225024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:31.226072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:31.449206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:31.450168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:31.456534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:31.457037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:31.457434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:31.458343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:31.458994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:31.459556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:31.622122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:31.638368 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54991368-a5f4-45e3-b932-9741371e5e34 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.448698 Oct 17 15:22:31.654549 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 91/160] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:31 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:31.695567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:31.697658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2140b0e1-6325-4b64-81ed-e754a0dbb8b1 req-a1f66175-be35-4041-933f-289302a7a385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f02af31-9081-4bdb-bd3c-a8404fe9f13e", "name": "network-vif-plugged", "status": "completed", "tag": "3c42a293-ed18-4cf7-aaee-0cccfb225301"}, {"server_uuid": "382fe0d4-2f91-4289-8eea-4619e645a500", "name": "network-vif-plugged", "status": "completed", "tag": "86a21e24-7531-494a-88d1-d4be7315e896"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:31.711985 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f5e77b16-d49c-4207-9927-3ed26aa3d6b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.266443 Oct 17 15:22:31.716956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2140b0e1-6325-4b64-81ed-e754a0dbb8b1 req-a1f66175-be35-4041-933f-289302a7a385 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:31.717577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2140b0e1-6325-4b64-81ed-e754a0dbb8b1 req-a1f66175-be35-4041-933f-289302a7a385 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:31.718022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2140b0e1-6325-4b64-81ed-e754a0dbb8b1 req-a1f66175-be35-4041-933f-289302a7a385 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:31.725813 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 70/161] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:31 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:31.736246 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2140b0e1-6325-4b64-81ed-e754a0dbb8b1 req-a1f66175-be35-4041-933f-289302a7a385 service nova] Creating event network-vif-plugged:3c42a293-ed18-4cf7-aaee-0cccfb225301 for instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e on n-h1-854441-12 Oct 17 15:22:31.736818 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2140b0e1-6325-4b64-81ed-e754a0dbb8b1 req-a1f66175-be35-4041-933f-289302a7a385 service nova] Creating event network-vif-plugged:86a21e24-7531-494a-88d1-d4be7315e896 for instance 382fe0d4-2f91-4289-8eea-4619e645a500 on n-h1-854441-12 Oct 17 15:22:31.747014 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2140b0e1-6325-4b64-81ed-e754a0dbb8b1 req-a1f66175-be35-4041-933f-289302a7a385 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052873 Oct 17 15:22:31.748713 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 92/162] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:31.867191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:31.868571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:31.878847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:31.880575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:31.891988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:31.892908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:31.893506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:31.893935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:32.094629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6cb2f4af-adab-49c6-8ede-aaf733ee7769 tempest-InstanceUsageAuditLogTestJSON-380255894 tempest-InstanceUsageAuditLogTestJSON-380255894-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:32.117223 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6cb2f4af-adab-49c6-8ede-aaf733ee7769 tempest-InstanceUsageAuditLogTestJSON-380255894 tempest-InstanceUsageAuditLogTestJSON-380255894-project-admin] 10.222.0.87 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17 15:22:31" status: 200 len: 318 microversion: 2.1 time: 0.268414 Oct 17 15:22:32.119635 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 71/163] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:22:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2015%3A22%3A31 => generated 318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:32.138716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8908689d-5caf-473a-9428-63cb909e3d3b tempest-InstanceUsageAuditLogTestJSON-380255894 tempest-InstanceUsageAuditLogTestJSON-380255894-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:32.176874 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8908689d-5caf-473a-9428-63cb909e3d3b tempest-InstanceUsageAuditLogTestJSON-380255894 tempest-InstanceUsageAuditLogTestJSON-380255894-project-admin] 10.222.0.87 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.043675 Oct 17 15:22:32.180316 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 72/164] 10.222.0.87 () {58 vars in 1185 bytes} [Mon Oct 17 15:22:32 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:32.197890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:32.198894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:32.215952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:32.216762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:32.218238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:32.219959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:32.223054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:32.224066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:32.235316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:32.243783 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a043867-41b0-49ec-a2cc-faeb4048799b tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1337 microversion: 2.1 time: 0.384793 Oct 17 15:22:32.244386 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 93/165] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:31 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1337 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:32.414012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:32.424742 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad544233-a00c-40ff-bef9-03746279f7d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.240544 Oct 17 15:22:32.425359 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 73/166] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:32 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:32.667471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:32.668763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:32.675575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:32.676281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:32.677118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:32.677916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:32.678586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:32.679335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:32.735909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:32.736901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:32.743685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:32.744433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:32.744863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:32.745677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:32.746257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:32.746858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:32.890740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:32.900381 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f987675-2b62-44c3-a770-1b73945f8d45 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.240613 Oct 17 15:22:32.901458 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 94/167] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:32 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:32.970215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:32.980268 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3183bb51-cf53-4148-86cd-2ab8bf7e26e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1340 microversion: 2.1 time: 0.247853 Oct 17 15:22:32.981251 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 74/168] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:32 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1340 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:33.272336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:33.272997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:33.279732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:33.280210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:33.280683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:33.281369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:33.282010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:33.282543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:33.447707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:33.449122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:33.461006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:33.461679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:33.463462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:33.464869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:33.466177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:33.467295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:33.468055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:33.476718 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3679cb5f-8f0e-40f1-a7a6-f06cc0390d9c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1487 microversion: 2.1 time: 0.208941 Oct 17 15:22:33.478093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 95/169] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:33 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1487 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:33.501200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91fa24e8-6639-4939-8e92-e8f7c572d412 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:33.501803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91fa24e8-6639-4939-8e92-e8f7c572d412 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:33.514742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91fa24e8-6639-4939-8e92-e8f7c572d412 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:33.515239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91fa24e8-6639-4939-8e92-e8f7c572d412 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:33.515662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91fa24e8-6639-4939-8e92-e8f7c572d412 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:33.516524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91fa24e8-6639-4939-8e92-e8f7c572d412 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:33.517321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91fa24e8-6639-4939-8e92-e8f7c572d412 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:33.517998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91fa24e8-6639-4939-8e92-e8f7c572d412 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:33.692136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:33.704824 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb35e216-c358-403c-a7f5-b51c5092684a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1333 microversion: 2.1 time: 0.261085 Oct 17 15:22:33.706246 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 75/170] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:33 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1333 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:33.923988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:33.924835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:33.935214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:33.935737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:33.936869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:33.938201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:33.939344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:33.940106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:33.963828 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91fa24e8-6639-4939-8e92-e8f7c572d412 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1640 microversion: 2.1 time: 0.466281 Oct 17 15:22:33.966590 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 96/171] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:33 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1640 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:33.992230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:33.993787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:34.003280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.004227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.004679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.005391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.005869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.006654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.093298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:22:34.141096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:34.154354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:34.163057 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4e627e7-0ec0-4edc-a0f7-099c0357b490 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.242893 Oct 17 15:22:34.164200 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 76/172] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:33 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:34.170786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:34.171639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:34.178040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.178794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.179468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.180402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.181156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.181698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.287236 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3edbf6a-bd31-421c-b2b3-0ac5990e0c13 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 204 len: 0 microversion: 2.1 time: 0.302725 Oct 17 15:22:34.290796 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 97/173] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:22:33 2022] DELETE /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:22:34.300166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:34.301102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:34.309172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.309846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.310757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.311745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.312336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.312896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.358827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:34.367957 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a3c5376-b53e-4b91-ab30-657aa67df64d tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1490 microversion: 2.1 time: 0.202212 Oct 17 15:22:34.368968 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 77/174] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:34 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1490 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:34.486281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:34.494752 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fce2f2fc-6046-49ea-83d3-c2df6d71f04c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1493 microversion: 2.1 time: 0.199286 Oct 17 15:22:34.495654 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 98/175] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:34 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1493 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:34.687479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:34.689683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:34.696235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.696718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.697141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.697827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.698265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.698941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.728860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:34.729537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:34.739227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.739726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.740160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.740868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:34.747478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:34.748011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:34.788421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:22:34.961799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:34.972394 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-339f445d-d856-4efe-87c3-0cf41eb3fdca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1483 microversion: 2.1 time: 0.247540 Oct 17 15:22:34.973360 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 99/176] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:34 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1483 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:35.032155 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-335c9b6f-8e4b-4cc1-9806-1921e1235fcc tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] 10.222.0.87 "DELETE /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 204 len: 0 microversion: 2.1 time: 0.643463 Oct 17 15:22:35.033650 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 78/177] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:22:34 2022] DELETE /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:22:35.169927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Calling method '.version_select at 0x7f28bf7544c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:35.178347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ec06080-01b5-4793-9448-66de7d08c56d(cell1) {{(pid=120406) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 15:22:35.179767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.180402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.181095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.206108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.206844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.207815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.223437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.224436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.225096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.232697 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d479e24b-fc8e-4fe7-8904-6c51ab43ba11 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.257948 Oct 17 15:22:35.233631 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 100/178] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:35.239137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:35.240301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:35.247187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.247677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.248098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.248953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.249584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.250325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.289111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c9007a3-9b0e-4818-9f2f-e16616237919 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:35.290327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0c9007a3-9b0e-4818-9f2f-e16616237919 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:35.299122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c9007a3-9b0e-4818-9f2f-e16616237919 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.300255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c9007a3-9b0e-4818-9f2f-e16616237919 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.300873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c9007a3-9b0e-4818-9f2f-e16616237919 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.302048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c9007a3-9b0e-4818-9f2f-e16616237919 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.302841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c9007a3-9b0e-4818-9f2f-e16616237919 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.303428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c9007a3-9b0e-4818-9f2f-e16616237919 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.401507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:35.409855 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a1460de-e6c2-417f-8563-6fcde68d8268 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1496 microversion: 2.1 time: 0.174787 Oct 17 15:22:35.410443 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 101/179] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:35 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1496 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:35.432143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:35.432747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:35.441770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.442856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.443354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.444242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.444693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.445109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.628856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:35.641893 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de32a9f0-8ace-4969-b8fd-b66b34e9567b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.217382 Oct 17 15:22:35.643060 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 102/180] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:35 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:35.826919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:35.842728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0482c7bf-e503-4677-82dd-2fb28b8c3478 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] Calling method '.version_select at 0x7f28bf8668b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:35.844563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0482c7bf-e503-4677-82dd-2fb28b8c3478 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'cb26146826504c04a512c0a82c6a01fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a40d4907c4f058aa6bac4b0923b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0482c7bf-e503-4677-82dd-2fb28b8c3478 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] Request method failure captured: Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/n-h1-854441-12/search HTTP/1.1 Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXM51KTmuxv2xeOiUzreDRePNNb-R7uJFM_E8JagYoywR9L_I0pk97uYIXEW5TDvdDEtUpC2ymtCNxA1hxjJpLEExht6hDXkwCZVDpUwqxA6s6zzOQcGHXqEaNre86twrIVVP4CJ7701cxlKZBEjCg34uknwdmI3CE9CitSsVFzgb7c Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 928a40d4907c4f058aa6bac4b0923b6b Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1410054444 Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:35.846573 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/928a40d4907c4f058aa6bac4b0923b6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/928a40d4907c4f058aa6bac4b0923b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_928a40d4907c4f058aa6bac4b0923b6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/928a40d4907c4f058aa6bac4b0923b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1410054444 Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 928a40d4907c4f058aa6bac4b0923b6b Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1410054444 Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: cb26146826504c04a512c0a82c6a01fe Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 15:22:35.847709 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'n-h1-854441-12'} Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:35.848497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 15:22:35.849407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:35.856253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0482c7bf-e503-4677-82dd-2fb28b8c3478 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:35.856253 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0482c7bf-e503-4677-82dd-2fb28b8c3478 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/n-h1-854441-12/search" status: 403 len: 117 microversion: 2.1 time: 0.204065 Oct 17 15:22:35.856253 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 103/181] 10.222.0.87 () {58 vars in 1212 bytes} [Mon Oct 17 15:22:35 2022] GET /compute/v2.1/os-hypervisors/n-h1-854441-12/search => generated 117 bytes in 206 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:35.856475 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0c9007a3-9b0e-4818-9f2f-e16616237919 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1636 microversion: 2.1 time: 0.815699 Oct 17 15:22:35.856475 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 79/182] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:35 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1636 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:35.858037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:35.858700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:35.870688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0ab951fa-4b73-4f6a-89ad-668d8a9bd869 req-87e1d2ee-e408-4d91-9ce4-024ea3a1b4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caac14a7-f9c8-4131-9dc4-de1068ad1181", "tag": "2c33c9ef-20b0-41d8-a88a-29c91521a517"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:35.872455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.872843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.873285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.873996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.874443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.874892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.885727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ab951fa-4b73-4f6a-89ad-668d8a9bd869 req-87e1d2ee-e408-4d91-9ce4-024ea3a1b4c8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.886817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ab951fa-4b73-4f6a-89ad-668d8a9bd869 req-87e1d2ee-e408-4d91-9ce4-024ea3a1b4c8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.887325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ab951fa-4b73-4f6a-89ad-668d8a9bd869 req-87e1d2ee-e408-4d91-9ce4-024ea3a1b4c8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.899780 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0ab951fa-4b73-4f6a-89ad-668d8a9bd869 req-87e1d2ee-e408-4d91-9ce4-024ea3a1b4c8 service nova] Creating event network-changed:2c33c9ef-20b0-41d8-a88a-29c91521a517 for instance caac14a7-f9c8-4131-9dc4-de1068ad1181 on n-h2-854441-12 Oct 17 15:22:35.906191 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0ab951fa-4b73-4f6a-89ad-668d8a9bd869 req-87e1d2ee-e408-4d91-9ce4-024ea3a1b4c8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053467 Oct 17 15:22:35.907513 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 80/183] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:35.914916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-89156b48-58fd-4897-bb77-54bef93f3f47 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Calling method '.version_select at 0x7f28bf8f7790>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:35.917392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89156b48-58fd-4897-bb77-54bef93f3f47 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.918352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89156b48-58fd-4897-bb77-54bef93f3f47 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.919040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89156b48-58fd-4897-bb77-54bef93f3f47 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.929473 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-89156b48-58fd-4897-bb77-54bef93f3f47 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-89156b48-58fd-4897-bb77-54bef93f3f47 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Request method failure captured: Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXM6Od-Z4l-qeXXafpz_g5zHkx1HsaLdJwb3Sxiqap0N6k-wmXtVL_R-shLTfhqqt5JzMuQLYIKDnEAPABkQKgv0mtXwuW3A3RNTyKAmpjluV9IWjich889RmvJsuCD_RJTN6MeavmHkowyP4MxZRjmw5qy8-riqFL8h4ALv8-e4rFU Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 9e28402a948f4bb1bb6caa0150eadbd4 Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-96169829 Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:22:35.932257 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/9e28402a948f4bb1bb6caa0150eadbd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/9e28402a948f4bb1bb6caa0150eadbd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_9e28402a948f4bb1bb6caa0150eadbd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/9e28402a948f4bb1bb6caa0150eadbd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-96169829 Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 9e28402a948f4bb1bb6caa0150eadbd4 Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-96169829 Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a66f35344019401e88320abee28174d9 Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 15:22:35.933336 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:35.933975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:35.935264 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:35.935264 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:35.935264 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:35.935264 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 15:22:35.935264 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:35.936980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-89156b48-58fd-4897-bb77-54bef93f3f47 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:35.938090 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-89156b48-58fd-4897-bb77-54bef93f3f47 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.029205 Oct 17 15:22:35.939119 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 81/184] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:22:35 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:35.944562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:35.945427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:35.953108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.953108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.954043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:35.954404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:35.955070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:35.955600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:36.107180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=20 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:36.238889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:36.250051 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21856f5b-eb24-4077-a0f1-bd3d040a3467 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1493 microversion: 2.1 time: 0.399516 Oct 17 15:22:36.263820 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 104/185] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:35 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1493 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:36.272701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Calling method '.version_select at 0x7f28bf7543a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:36.274719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:36.275568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:36.276065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:36.290871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:36.291477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:36.292001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:36.314321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:36.314926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:36.315361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:36.322721 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c46fab8a-c55c-4912-afc4-c98f7a51b461 tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.057107 Oct 17 15:22:36.323930 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 105/186] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:22:36 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:36.336621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b07c7d0e-be36-41f2-9f40-262da6cefde7 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] Calling method '.version_select at 0x7f28bf754790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:36.339038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b07c7d0e-be36-41f2-9f40-262da6cefde7 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'cb26146826504c04a512c0a82c6a01fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a40d4907c4f058aa6bac4b0923b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b07c7d0e-be36-41f2-9f40-262da6cefde7 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] Request method failure captured: Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXM51KTmuxv2xeOiUzreDRePNNb-R7uJFM_E8JagYoywR9L_I0pk97uYIXEW5TDvdDEtUpC2ymtCNxA1hxjJpLEExht6hDXkwCZVDpUwqxA6s6zzOQcGHXqEaNre86twrIVVP4CJ7701cxlKZBEjCg34uknwdmI3CE9CitSsVFzgb7c Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 928a40d4907c4f058aa6bac4b0923b6b Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1410054444 Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:36.340817 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/928a40d4907c4f058aa6bac4b0923b6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/928a40d4907c4f058aa6bac4b0923b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_928a40d4907c4f058aa6bac4b0923b6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/928a40d4907c4f058aa6bac4b0923b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1410054444 Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 928a40d4907c4f058aa6bac4b0923b6b Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1410054444 Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: cb26146826504c04a512c0a82c6a01fe Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 15:22:36.342182 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1'} Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:36.342919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 15:22:36.344079 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:36.346679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b07c7d0e-be36-41f2-9f40-262da6cefde7 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:36.347978 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b07c7d0e-be36-41f2-9f40-262da6cefde7 tempest-HypervisorAdminNegativeUnderV252Test-1410054444 tempest-HypervisorAdminNegativeUnderV252Test-1410054444-project] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.016613 Oct 17 15:22:36.351614 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 106/187] 10.222.0.87 () {58 vars in 1176 bytes} [Mon Oct 17 15:22:36 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:36.358462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c90e5ca8-7d3d-4604-807f-f0b2f73c3f0e tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Calling method '.version_select at 0x7f28bfafd3a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:36.360441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c90e5ca8-7d3d-4604-807f-f0b2f73c3f0e tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:36.364539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c90e5ca8-7d3d-4604-807f-f0b2f73c3f0e tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:36.364539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c90e5ca8-7d3d-4604-807f-f0b2f73c3f0e tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:36.375650 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c90e5ca8-7d3d-4604-807f-f0b2f73c3f0e tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] HTTP exception thrown: No hypervisor matching '797af900-57ef-45e9-88a2-97e0b4ac285f' could be found. Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c90e5ca8-7d3d-4604-807f-f0b2f73c3f0e tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Request method failure captured: Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/797af900-57ef-45e9-88a2-97e0b4ac285f/servers HTTP/1.1 Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXM6Od-Z4l-qeXXafpz_g5zHkx1HsaLdJwb3Sxiqap0N6k-wmXtVL_R-shLTfhqqt5JzMuQLYIKDnEAPABkQKgv0mtXwuW3A3RNTyKAmpjluV9IWjich889RmvJsuCD_RJTN6MeavmHkowyP4MxZRjmw5qy8-riqFL8h4ALv8-e4rFU Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 9e28402a948f4bb1bb6caa0150eadbd4 Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-96169829 Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:36.377673 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/9e28402a948f4bb1bb6caa0150eadbd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/9e28402a948f4bb1bb6caa0150eadbd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_9e28402a948f4bb1bb6caa0150eadbd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/9e28402a948f4bb1bb6caa0150eadbd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-96169829 Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 9e28402a948f4bb1bb6caa0150eadbd4 Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-96169829 Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a66f35344019401e88320abee28174d9 Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: exception: No hypervisor matching '797af900-57ef-45e9-88a2-97e0b4ac285f' could be found. Oct 17 15:22:36.379345 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '797af900-57ef-45e9-88a2-97e0b4ac285f'} Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '797af900-57ef-45e9-88a2-97e0b4ac285f' could be found. Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:36.380347 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:36.381368 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:36.381368 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:36.381368 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:36.381368 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:36.381368 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '797af900-57ef-45e9-88a2-97e0b4ac285f' could be found. Oct 17 15:22:36.381368 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:36.381368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c90e5ca8-7d3d-4604-807f-f0b2f73c3f0e tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] Returning 404 to user: No hypervisor matching '797af900-57ef-45e9-88a2-97e0b4ac285f' could be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:36.381368 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c90e5ca8-7d3d-4604-807f-f0b2f73c3f0e tempest-HypervisorAdminNegativeUnderV252Test-96169829 tempest-HypervisorAdminNegativeUnderV252Test-96169829-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/797af900-57ef-45e9-88a2-97e0b4ac285f/servers" status: 404 len: 123 microversion: 2.1 time: 0.024752 Oct 17 15:22:36.385043 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 107/188] 10.222.0.87 () {58 vars in 1281 bytes} [Mon Oct 17 15:22:36 2022] GET /compute/v2.1/os-hypervisors/797af900-57ef-45e9-88a2-97e0b4ac285f/servers => generated 123 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:22:36.386973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a72c1cb213b049e195ccf33d522a70a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ac94e595be49668e583193e0d5d4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:36.387750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] flavor_id is None. Assuming migration. {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 15:22:36.388366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 15:22:36.438458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:36.440111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:36.449225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:36.449977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:36.450412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:36.451154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:36.451604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:36.452018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:36.720917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:36.745105 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1b9b4b6-ef26-495a-920f-9f98896f89e7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1496 microversion: 2.1 time: 0.311322 Oct 17 15:22:36.762393 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 108/189] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:36 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1496 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:36.782890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:36.784612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:36.795834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:36.796662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:36.797386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:36.798294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:36.798962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:36.799623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:37.039818 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5bf277ee-9bc0-46cc-927e-c02046cec202 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500/action" status: 202 len: 0 microversion: 2.1 time: 1.091470 Oct 17 15:22:37.045466 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 82/190] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:22:35 2022] POST /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500/action => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:22:37.052910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:37.053674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:37.066049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:37.066908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:37.067532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:37.068468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:37.069104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:37.069730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:37.135702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:37.150169 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60d1e3d4-bab9-43c5-8759-de145db19480 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.385874 Oct 17 15:22:37.150804 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 109/191] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:36 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:37.280615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:37.281427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:37.289503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:37.290456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:37.291174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:37.292440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:37.293224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:37.294326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:37.474566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:37.487588 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e447a08-98a6-456f-a8f4-b2c3b31997b6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1492 microversion: 2.1 time: 0.439445 Oct 17 15:22:37.488493 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 83/192] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:37 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1492 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:37.748908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:37.759518 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-066fff21-0c26-4758-80bf-3680e6ff6580 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1493 microversion: 2.1 time: 0.485117 Oct 17 15:22:37.762243 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 110/193] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:37 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1493 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:37.789038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:37.790973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:37.809210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:37.810469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:37.811230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:37.821156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:37.822516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:37.823494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:38.173766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:38.174390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:38.197869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:38.198371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:38.206618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:38.207431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:38.207922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:38.208621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:38.301404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:38.314476 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d45e8ece-e9dd-4fd4-9cda-38a149c80a83 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1454 microversion: 2.1 time: 0.532542 Oct 17 15:22:38.322672 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 84/194] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:37 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1454 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:38.378841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-aacad3d7-54cd-496b-8dfd-86496a7e64ec req-020c1807-8b27-4a0c-9e7e-fbc3030cb8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b972480-ce14-4f7f-87c1-1b97fa848e2f", "name": "network-vif-deleted", "tag": "de78e63f-5fcf-47d1-a747-d45683d5ffc2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:38.432566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-aacad3d7-54cd-496b-8dfd-86496a7e64ec req-020c1807-8b27-4a0c-9e7e-fbc3030cb8d2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:38.435095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-aacad3d7-54cd-496b-8dfd-86496a7e64ec req-020c1807-8b27-4a0c-9e7e-fbc3030cb8d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:38.436244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-aacad3d7-54cd-496b-8dfd-86496a7e64ec req-020c1807-8b27-4a0c-9e7e-fbc3030cb8d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:38.489247 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-aacad3d7-54cd-496b-8dfd-86496a7e64ec req-020c1807-8b27-4a0c-9e7e-fbc3030cb8d2 service nova] Creating event network-vif-deleted:de78e63f-5fcf-47d1-a747-d45683d5ffc2 for instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f on n-h1-854441-12 Oct 17 15:22:38.510012 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-aacad3d7-54cd-496b-8dfd-86496a7e64ec req-020c1807-8b27-4a0c-9e7e-fbc3030cb8d2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146158 Oct 17 15:22:38.514944 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 85/195] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:38.537568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:38.540619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:38.561450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:38.562457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:38.563052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:38.564401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:38.567676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:38.570226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:38.935961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:38.943272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:38.952148 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c26b8e81-2409-4f6c-830d-2f0a6f923e39 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.782997 Oct 17 15:22:38.954835 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 111/196] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:38 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:38.965279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-dcc0b17f-1c23-4553-95cc-b5912e228ad9 req-5a4bfa75-eae8-468a-86a1-59336b087b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f02af31-9081-4bdb-bd3c-a8404fe9f13e", "name": "network-vif-deleted", "tag": "3c42a293-ed18-4cf7-aaee-0cccfb225301"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:38.986342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dcc0b17f-1c23-4553-95cc-b5912e228ad9 req-5a4bfa75-eae8-468a-86a1-59336b087b24 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:38.991754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dcc0b17f-1c23-4553-95cc-b5912e228ad9 req-5a4bfa75-eae8-468a-86a1-59336b087b24 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:38.992436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dcc0b17f-1c23-4553-95cc-b5912e228ad9 req-5a4bfa75-eae8-468a-86a1-59336b087b24 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:39.020232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-dcc0b17f-1c23-4553-95cc-b5912e228ad9 req-5a4bfa75-eae8-468a-86a1-59336b087b24 service nova] Creating event network-vif-deleted:3c42a293-ed18-4cf7-aaee-0cccfb225301 for instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e on n-h1-854441-12 Oct 17 15:22:39.032487 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-dcc0b17f-1c23-4553-95cc-b5912e228ad9 req-5a4bfa75-eae8-468a-86a1-59336b087b24 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075551 Oct 17 15:22:39.034683 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 112/197] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:39.050152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:39.051106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:39.057779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:39.058133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:39.058683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:39.067078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:39.067573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:39.068372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:39.122661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:39.130534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:39.131826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:39.132731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:39.132949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:39.134022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lazy-loading 'fault' on Instance uuid 5b972480-ce14-4f7f-87c1-1b97fa848e2f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:22:39.144665 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bd7265f8-f230-48c3-bed9-109f9b9e363f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1492 microversion: 2.1 time: 0.626144 Oct 17 15:22:39.163324 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 86/198] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:38 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1492 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:39.246123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b5bbbf3484cdbb80f133d8df77dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a8a8c2ca3d48b98d2192c05f5d49ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:39.267752 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b25ec084-8e8c-48af-b8d5-b0300e9dba2c tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 200 len: 1327 microversion: 2.1 time: 0.231374 Oct 17 15:22:39.270935 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 113/199] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:39 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 1327 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:39.347375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:39.349244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:39.357927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:39.359036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:39.359626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:39.360640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:39.361273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:39.361844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:39.402803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:39.403527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:39.403971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:39.404438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lazy-loading 'fault' on Instance uuid 7f02af31-9081-4bdb-bd3c-a8404fe9f13e {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:22:39.457275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:39.471453 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7219220d-3583-4cc8-91c9-a906c14851d4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 200 len: 1330 microversion: 2.1 time: 0.129703 Oct 17 15:22:39.473402 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 87/200] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:39 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:39.980295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:39.981007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:39.989286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:39.989772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:39.991042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:39.991979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:40.009181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:40.011628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:40.186390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:40.189211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:40.210990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:40.211988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:40.212717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:40.213770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:40.214473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:40.215129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:40.325496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:40.334789 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb332c96-15d2-49c1-b0c5-8782269ed307 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.360862 Oct 17 15:22:40.338942 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 114/201] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:39 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:40.344636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:40.345430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:40.365504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:40.366013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:40.368907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:40.372412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:40.373103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:40.374763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:40.408398 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] HTTP exception thrown: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Request method failure captured: Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f HTTP/1.1 Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMWkgroNnKDGyyYXU1gNGt-KQy11VUbhD7hAXtvaUaQQqlFWhNu4GmxH3SToYuaY-SO_vG4eS30hB0uFowBkl5Rt_MivCGO3bAqGX4voGu7w0ounjz54ruIAaQKOkDHyo14EcxsP_vvzyM3nzKisGAr7GGXV52vj-EyP3uufVHPhlk Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 72a8a8c2ca3d48b98d2192c05f5d49ca Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminTestJSON-1230300401 Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:40.412200 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminTestJSON-1230300401 Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 72a8a8c2ca3d48b98d2192c05f5d49ca Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1230300401 Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminTestJSON-1230300401-project Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: e97b5bbbf3484cdbb80f133d8df77dc3 Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminTestJSON-1230300401-project Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:40.413380 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5b972480-ce14-4f7f-87c1-1b97fa848e2f'} Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:40.414158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:40.415277 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.418220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Returning 404 to user: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:40.419253 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3fb53513-4cd7-4adf-948c-964a254f60c8 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 404 len: 111 microversion: 2.1 time: 0.079129 Oct 17 15:22:40.421463 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 115/202] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:40 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:40.431473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-22eb2eca-703a-49dc-8b76-f966ffc3ffff tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:40.460246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eb2eca-703a-49dc-8b76-f966ffc3ffff tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:40.461191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eb2eca-703a-49dc-8b76-f966ffc3ffff tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:40.461492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eb2eca-703a-49dc-8b76-f966ffc3ffff tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:40.551492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:40.570011 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a45fd005-205a-4c17-b3fd-16deb22f8956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1492 microversion: 2.1 time: 0.392649 Oct 17 15:22:40.570653 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 88/203] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:40 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1492 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:40.588242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:40.589039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:40.597171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:40.604046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:40.604928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:40.605636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:40.608876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:40.610963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:40.611672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:40.671227 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] HTTP exception thrown: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Request method failure captured: Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e HTTP/1.1 Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMYuTRue_SwQpoQLTUdL7K7vnHlrl00lXgHeFqx2ZM7jfLLmrxbIE4G-w9I5vRxANq1fRoeJHWIYZFccwPzIG1RD6pN2imzhAUIsKGFtKOUNzyFUslaPjZouA21l_KIouE8sDue7WOASizoAxEzw_PlEvRREoO3B10E4ZoCz2p49uA Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:40.678576 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_68a3e4c52bdf488283a305f15f904509"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0078ab28d52b4741aa81a5ee515acc04 Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:22:40.679913 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7f02af31-9081-4bdb-bd3c-a8404fe9f13e'} Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:40.680686 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:22:40.681714 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:40.682706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Returning 404 to user: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:40.683661 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-debf80cb-5ed5-494a-957a-216155b512a4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 404 len: 111 microversion: 2.1 time: 0.111752 Oct 17 15:22:40.702076 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 89/204] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:40 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:40.829319 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-22eb2eca-703a-49dc-8b76-f966ffc3ffff tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.403472 Oct 17 15:22:40.831675 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 116/205] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:40.845303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e97244dc-b215-4f5a-bcfa-7645b88604fc tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:40.916587 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e97244dc-b215-4f5a-bcfa-7645b88604fc tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.074959 Oct 17 15:22:40.918603 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 90/206] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:40 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:40.935439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1891570800", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:40.937720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9417d923-7a4d-410f-8a66-67b4475311a5 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1734533832"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:40.942020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.aggregate [None req-9417d923-7a4d-410f-8a66-67b4475311a5 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Generated uuid 0d0cc39d-102b-4b44-97d9-e52b31b4bb8f for aggregate {{(pid=120407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:41.024958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:22:41.034396 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9417d923-7a4d-410f-8a66-67b4475311a5 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.098823 Oct 17 15:22:41.035917 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 91/207] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:41.049929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e502ffad-690c-4ca3-b28b-5ac9451abe4e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:41.092149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e502ffad-690c-4ca3-b28b-5ac9451abe4e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:41.100098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e502ffad-690c-4ca3-b28b-5ac9451abe4e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:41.100583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e502ffad-690c-4ca3-b28b-5ac9451abe4e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:41.339004 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e502ffad-690c-4ca3-b28b-5ac9451abe4e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.294545 Oct 17 15:22:41.340344 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 92/208] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:22:41.353368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-471c2779-1e92-4847-a867-be61711693ea tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:41.374965 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-471c2779-1e92-4847-a867-be61711693ea tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.025363 Oct 17 15:22:41.376491 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 93/209] 10.222.0.87 () {58 vars in 1149 bytes} [Mon Oct 17 15:22:41 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:41.389344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:41.391257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:41.405785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:41.408825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:41.410052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:41.413942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:41.415129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:41.415979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:41.708768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:22:41.709541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:22:41.710260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:22:41.711354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:22:41.712235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:22:41.725832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:41.727312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:41.728000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:41.729032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:41.729749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:41.730546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:41.742269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:41.768020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Getting quotas for project 68a3e4c52bdf488283a305f15f904509. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:22:41.778694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Getting quotas for user 0078ab28d52b4741aa81a5ee515acc04 and project 68a3e4c52bdf488283a305f15f904509. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:22:41.807228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:22:41.811470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:22:41.880155 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-706d0903-e2a1-4504-a7d9-4d4fd079d528 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949783 Oct 17 15:22:41.888952 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 117/210] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:22:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:22:41.897107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d8f81b7-5146-47ac-beef-84f6c66000a4 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:41.928782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8f81b7-5146-47ac-beef-84f6c66000a4 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:41.931179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8f81b7-5146-47ac-beef-84f6c66000a4 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:41.931917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d8f81b7-5146-47ac-beef-84f6c66000a4 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:41.980648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:41.997166 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-83ecd34d-0ce4-4370-af13-7cf1804c5300 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.609897 Oct 17 15:22:41.999638 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 94/211] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:41 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:42.021178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:42.024220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:42.041027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:42.044471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:42.046156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:42.049422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:42.050126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:42.050826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:42.149619 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d8f81b7-5146-47ac-beef-84f6c66000a4 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.258173 Oct 17 15:22:42.159549 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 118/212] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:42.165123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fe40905-8594-4358-b30f-2000b1d41f2a tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:42.166099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2fe40905-8594-4358-b30f-2000b1d41f2a tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:42.168417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=14 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:42.179742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:42.240837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fe40905-8594-4358-b30f-2000b1d41f2a tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:42.251317 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2fe40905-8594-4358-b30f-2000b1d41f2a tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1220 microversion: 2.1 time: 0.090322 Oct 17 15:22:42.254337 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 119/213] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:42 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:42.281042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c460b4a-7f81-4270-8a2a-afdca01b3865 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:42.325818 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c460b4a-7f81-4270-8a2a-afdca01b3865 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.069788 Oct 17 15:22:42.327316 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 120/214] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:42 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:42.359983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a5eb4a0-fd40-4604-b2bb-8250dbbef4a2 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-560215889"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:42.375214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-0a5eb4a0-fd40-4604-b2bb-8250dbbef4a2 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Generated uuid 554ce19f-9720-42de-a442-6f2fc0abb7be for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:42.427627 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a5eb4a0-fd40-4604-b2bb-8250dbbef4a2 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074950 Oct 17 15:22:42.429319 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 121/215] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:42.555850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:42.567144 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-41880f09-e0ee-4989-af71-6073c0d419ff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1471 microversion: 2.1 time: 0.565209 Oct 17 15:22:42.568422 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 95/216] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:41 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1471 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:42.573663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b98a2fce-63a5-4437-92e2-142fd5427179 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:42.596518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b98a2fce-63a5-4437-92e2-142fd5427179 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:42.597014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b98a2fce-63a5-4437-92e2-142fd5427179 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:42.597435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b98a2fce-63a5-4437-92e2-142fd5427179 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:42.640652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf6e845d-b645-4312-b8a1-10c15802b5e0 tempest-NetworksTest-234491461 tempest-NetworksTest-234491461-project-admin] Calling method '.version_select at 0x7f28bf8669d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:42.788214 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b98a2fce-63a5-4437-92e2-142fd5427179 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.218428 Oct 17 15:22:42.789053 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 96/217] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:42 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:42.802167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a6082e1-270f-4205-a48f-e05c4dee497a tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:42.824270 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a6082e1-270f-4205-a48f-e05c4dee497a tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.026785 Oct 17 15:22:42.827683 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 97/218] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:22:42 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:42.842182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7bbe14a8-b5b4-4e46-b44e-885232a5f03b tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:42.865072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bbe14a8-b5b4-4e46-b44e-885232a5f03b tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:42.866397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bbe14a8-b5b4-4e46-b44e-885232a5f03b tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:42.866963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bbe14a8-b5b4-4e46-b44e-885232a5f03b tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:42.928866 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf6e845d-b645-4312-b8a1-10c15802b5e0 tempest-NetworksTest-234491461 tempest-NetworksTest-234491461-project-admin] 10.222.0.87 "GET /compute/v2.1/os-networks" status: 200 len: 2632 microversion: 2.1 time: 0.498212 Oct 17 15:22:42.934618 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 122/219] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:22:42 2022] GET /compute/v2.1/os-networks => generated 2632 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:42.949976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-726e8cd1-15b0-4141-9372-f42f402fed9d tempest-NetworksTest-234491461 tempest-NetworksTest-234491461-project-admin] Calling method '.version_select at 0x7f28bf9d0700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:43.116632 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7bbe14a8-b5b4-4e46-b44e-885232a5f03b tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.281177 Oct 17 15:22:43.124737 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 98/220] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:42 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:43.125998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9c5a678f-10f4-4672-aee5-430b4e833a52 req-6d83e26a-0edb-4f43-936e-dde8b7a91410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caac14a7-f9c8-4131-9dc4-de1068ad1181", "name": "network-vif-plugged", "status": "completed", "tag": "2c33c9ef-20b0-41d8-a88a-29c91521a517"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:43.157464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9c5a678f-10f4-4672-aee5-430b4e833a52 req-6d83e26a-0edb-4f43-936e-dde8b7a91410 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:43.158150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9c5a678f-10f4-4672-aee5-430b4e833a52 req-6d83e26a-0edb-4f43-936e-dde8b7a91410 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:43.159249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9c5a678f-10f4-4672-aee5-430b4e833a52 req-6d83e26a-0edb-4f43-936e-dde8b7a91410 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:43.172658 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9c5a678f-10f4-4672-aee5-430b4e833a52 req-6d83e26a-0edb-4f43-936e-dde8b7a91410 service nova] Creating event network-vif-plugged:2c33c9ef-20b0-41d8-a88a-29c91521a517 for instance caac14a7-f9c8-4131-9dc4-de1068ad1181 on n-h2-854441-12 Oct 17 15:22:43.181627 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9c5a678f-10f4-4672-aee5-430b4e833a52 req-6d83e26a-0edb-4f43-936e-dde8b7a91410 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061029 Oct 17 15:22:43.187851 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 99/221] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:43.202290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:43.203234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:43.211216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:43.211813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:43.212474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:43.213286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:43.213806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:43.214324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:43.322637 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-726e8cd1-15b0-4141-9372-f42f402fed9d tempest-NetworksTest-234491461 tempest-NetworksTest-234491461-project-admin] 10.222.0.87 "GET /compute/v2.1/os-networks/f639fbac-39b1-4034-aba2-9393df7f148c" status: 200 len: 652 microversion: 2.1 time: 0.386573 Oct 17 15:22:43.325387 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 123/222] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:22:42 2022] GET /compute/v2.1/os-networks/f639fbac-39b1-4034-aba2-9393df7f148c => generated 652 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:43.338188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5fd0574-616b-4906-97ce-3912e762b909 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:43.374768 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5fd0574-616b-4906-97ce-3912e762b909 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.048118 Oct 17 15:22:43.375651 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 124/223] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:43 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:43.380885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:43.381491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:43.401425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:43.402021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:43.402457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:43.403193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:43.403668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:43.404047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:43.525613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:43.534903 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-908af143-c4d0-4d5c-85bc-cf5a47690fef tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1272 microversion: 2.1 time: 0.157809 Oct 17 15:22:43.536618 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 125/224] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:43 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:43.547732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da7c2bff-408d-4cd5-b20a-293d97a09621 tempest-NetworksTest-234491461 tempest-NetworksTest-234491461-project-admin] Calling method '.version_select at 0x7f28bf7543a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:43.554785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:43.564262 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3d10713f-130d-41df-93bd-9aa23418e027 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.374851 Oct 17 15:22:43.564863 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 100/225] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:43 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:43.575459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-369912c0-eba3-4330-9752-afddc4b992c5 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1350775190"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:43.583132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.aggregate [None req-369912c0-eba3-4330-9752-afddc4b992c5 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Generated uuid 872345c6-ab43-4367-b8d4-77be2ebd5b63 for aggregate {{(pid=120407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:43.616284 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-369912c0-eba3-4330-9752-afddc4b992c5 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050267 Oct 17 15:22:43.617100 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 101/226] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:43.634131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:43.635298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:43.643459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:43.644051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:43.644551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:43.646059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:43.646642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:43.647139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:43.714288 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da7c2bff-408d-4cd5-b20a-293d97a09621 tempest-NetworksTest-234491461 tempest-NetworksTest-234491461-project-admin] 10.222.0.87 "GET /compute/v2.1/os-networks" status: 200 len: 2632 microversion: 2.1 time: 0.175924 Oct 17 15:22:43.715135 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 126/227] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:22:43 2022] GET /compute/v2.1/os-networks => generated 2632 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:43.720995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cfc743b-d416-40bf-80ff-06aadd43e8f6 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:43.744650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cfc743b-d416-40bf-80ff-06aadd43e8f6 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:43.745139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cfc743b-d416-40bf-80ff-06aadd43e8f6 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:43.745773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cfc743b-d416-40bf-80ff-06aadd43e8f6 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:44.017750 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cfc743b-d416-40bf-80ff-06aadd43e8f6 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.300895 Oct 17 15:22:44.024962 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 127/228] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:43 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:44.033861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2e26da6-49ab-4be5-9394-0ac591db513a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:44.059487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2e26da6-49ab-4be5-9394-0ac591db513a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:44.062730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2e26da6-49ab-4be5-9394-0ac591db513a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:44.064372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2e26da6-49ab-4be5-9394-0ac591db513a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:44.107694 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a2e26da6-49ab-4be5-9394-0ac591db513a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] HTTP exception thrown: Aggregate 4 already has host n-h1-854441-12. Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2e26da6-49ab-4be5-9394-0ac591db513a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Request method failure captured: Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 40 Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMabvuKVN_xWjHhBTHvDKFkxXnLaUyYkSmr9RQGIXeAuEk4kWCMvzkwdNuiLifneiwLU_0smLO8XxVBzHfL3OLr1d7fo0SKDMfurlQsUjBf6HO8fGyG7he5J_wRnHOz41cUGaehvEGSXWHds3vtfQDCw3-ZcUauY9XAuOlI3xWoBhk Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:44.140578 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88061e4944824c9a81658feef9f257e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88061e4944824c9a81658feef9f257e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 52e59befde0849abb476dda69cf09842 Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: {"add_host": {"host": "n-h1-854441-12"}} Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:44.142162 n-d-854441-12 devstack@n-api.service[120406]: exception: Aggregate 4 already has host n-h1-854441-12. Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h1-854441-12'}}} Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result.read() Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 15:22:44.146358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-854441-12-4' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 15:22:44.147569 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 15:22:44.149291 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 15:22:44.150483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result.read() Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-854441-12-4' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 15, 22, 44, 97824), 'updated_at': None, 'host': 'n-h1-854441-12', 'aggregate_id': 4}] Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:44.151623 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 4 already has host n-h1-854441-12. Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:44.153099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 4 already has host n-h1-854441-12. Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:44.154361 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:44.158211 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 4 already has host n-h1-854441-12. Oct 17 15:22:44.158211 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:44.158211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2e26da6-49ab-4be5-9394-0ac591db513a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Returning 409 to user: Aggregate 4 already has host n-h1-854441-12. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:44.158211 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2e26da6-49ab-4be5-9394-0ac591db513a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/4/action" status: 409 len: 96 microversion: 2.1 time: 0.114819 Oct 17 15:22:44.158211 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 128/229] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:44 2022] POST /compute/v2.1/os-aggregates/4/action => generated 96 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 17 15:22:44.159926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c894c47b-ec04-4a2f-bbfa-89cb53656e56 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:44.182781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c894c47b-ec04-4a2f-bbfa-89cb53656e56 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:44.183320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c894c47b-ec04-4a2f-bbfa-89cb53656e56 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:44.183834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c894c47b-ec04-4a2f-bbfa-89cb53656e56 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:44.314988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:44.335475 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-10d5140c-0f85-49f8-bf7e-605ff76c10fd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.708722 Oct 17 15:22:44.340168 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 102/230] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:43 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:44.391407 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c894c47b-ec04-4a2f-bbfa-89cb53656e56 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.235286 Oct 17 15:22:44.393614 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 129/231] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:44 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:44.411512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-01b11da5-ed59-4d5a-998d-747755cb7e67 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:44.439979 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-01b11da5-ed59-4d5a-998d-747755cb7e67 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.037326 Oct 17 15:22:44.441468 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 103/232] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:44 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:44.454746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b1436c28-7f00-4f5e-a027-787626658812 tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1337026604"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:44.459364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.aggregate [None req-b1436c28-7f00-4f5e-a027-787626658812 tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Generated uuid 82e2d5ac-e9ef-4de3-aa54-db44bda1cbce for aggregate {{(pid=120407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:44.461474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88580a9d-982c-4ce3-8cb9-f93d50f5dce6 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-897893873"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:44.473212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-88580a9d-982c-4ce3-8cb9-f93d50f5dce6 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Generated uuid 1545381f-0a71-4aa8-bee9-95d664451e64 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:44.499192 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b1436c28-7f00-4f5e-a027-787626658812 tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.049618 Oct 17 15:22:44.499827 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 104/233] 10.222.0.87 () {62 vars in 1205 bytes} [Mon Oct 17 15:22:44 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:22:44.528733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a6b41eb8-30c9-402e-b2d1-bca144a01e4a tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-311949611"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:44.575327 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88580a9d-982c-4ce3-8cb9-f93d50f5dce6 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.126340 Oct 17 15:22:44.575864 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 130/234] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:44.590138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:44.591993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:44.608024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:44.609740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:44.610403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:44.611700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:44.612695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:44.613440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:44.694152 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a6b41eb8-30c9-402e-b2d1-bca144a01e4a tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-aggregates/5" status: 200 len: 298 microversion: 2.41 time: 0.178672 Oct 17 15:22:44.695623 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 105/235] 10.222.0.87 () {62 vars in 1210 bytes} [Mon Oct 17 15:22:44 2022] PUT /compute/v2.1/os-aggregates/5 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:44.786320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:44.832120 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f24abe93-8d04-42a6-8e79-a18862fc1f29 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1278 microversion: 2.1 time: 0.251086 Oct 17 15:22:44.834195 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 131/236] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:44 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1278 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:44.847436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:44.853603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:44.870716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:44.871524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:44.872247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:44.873457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:44.874176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:44.876686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:45.037202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-764a2a97-19f0-487f-bac7-9d9f85cf8adb tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.042686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-764a2a97-19f0-487f-bac7-9d9f85cf8adb tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '8fe961b1ea794d2497d29b5cc447adb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efbf191c3b4007a9f25d5d56f9e6d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-764a2a97-19f0-487f-bac7-9d9f85cf8adb tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Request method failure captured: Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 40 Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMXgO9V0BMYkbkxk-OxP6bRbrCjpc5FUhP2psnYhN4DFwal7q20RH1UXTsuBmzdhmQ6zmpgUJaSSsOHgr2Bq9dMRsPxUv3CVp9D1U19l5ErZgcDVc7N5otOMSiJfm6JTqMuPJA0TNPPH-x1yzmzi26_95y3lVvfgi2wF7hPQQ8JclE Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:45.045097 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8fe961b1ea794d2497d29b5cc447adb2 Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: {"add_host": {"host": "n-h1-854441-12"}} Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:45.046380 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h1-854441-12'}}} Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:45.047121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 15:22:45.048958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.051207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-764a2a97-19f0-487f-bac7-9d9f85cf8adb tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:45.051207 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-764a2a97-19f0-487f-bac7-9d9f85cf8adb tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] 10.222.0.87 "POST /compute/v2.1/os-aggregates/6/action" status: 403 len: 118 microversion: 2.1 time: 0.349633 Oct 17 15:22:45.051207 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 106/237] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:44 2022] POST /compute/v2.1/os-aggregates/6/action => generated 118 bytes in 352 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:45.057380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a03e4e6-dff6-4e18-a78e-2922244c7c7b tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:45.073166 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a03e4e6-dff6-4e18-a78e-2922244c7c7b tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates/5" status: 200 len: 298 microversion: 2.41 time: 0.023567 Oct 17 15:22:45.074118 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 107/238] 10.222.0.87 () {60 vars in 1190 bytes} [Mon Oct 17 15:22:45 2022] GET /compute/v2.1/os-aggregates/5 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:45.079282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3357a1e9-11eb-46ce-be61-816d4deda79d tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:45.111806 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3357a1e9-11eb-46ce-be61-816d4deda79d tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.036442 Oct 17 15:22:45.117377 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 108/239] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:45 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:45.130204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cbc543d1-bf86-4293-90bc-6d75ad9ecdef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.141226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:45.146073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cbc543d1-bf86-4293-90bc-6d75ad9ecdef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:45.146701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cbc543d1-bf86-4293-90bc-6d75ad9ecdef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:45.148004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cbc543d1-bf86-4293-90bc-6d75ad9ecdef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:45.151383 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-963e1bc6-eae1-45a4-bbe5-f745d104ed2c tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1314 microversion: 2.1 time: 0.315825 Oct 17 15:22:45.162528 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 132/240] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:44 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:45.162528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd3b0b4d-e21d-4982-97e6-e5583aafda57 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1677219010"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.163820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-fd3b0b4d-e21d-4982-97e6-e5583aafda57 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Generated uuid ffdafaaf-fd1b-41f6-a44a-83118d8ee52d for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:45.204380 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd3b0b4d-e21d-4982-97e6-e5583aafda57 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050340 Oct 17 15:22:45.211731 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 133/241] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:45.220066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1233260013"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.249351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:45.249897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:45.250281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:45.260203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:45.261416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:45.261645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:45.273335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1233260013 could not be found. Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Request method failure captured: Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 58 Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMabvuKVN_xWjHhBTHvDKFkxXnLaUyYkSmr9RQGIXeAuEk4kWCMvzkwdNuiLifneiwLU_0smLO8XxVBzHfL3OLr1d7fo0SKDMfurlQsUjBf6HO8fGyG7he5J_wRnHOz41cUGaehvEGSXWHds3vtfQDCw3-ZcUauY9XAuOlI3xWoBhk Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:45.276652 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88061e4944824c9a81658feef9f257e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88061e4944824c9a81658feef9f257e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 52e59befde0849abb476dda69cf09842 Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: {"add_host": {"host": "tempest-nonexist_host-1233260013"}} Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:45.278198 n-d-854441-12 devstack@n-api.service[120406]: exception: Compute host tempest-nonexist_host-1233260013 could not be found. Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '7', 'body': {'add_host': {'host': 'tempest-nonexist_host-1233260013'}}} Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1233260013' is not mapped to any cell Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.278919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 17 15:22:45.279986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1233260013 could not be found. Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1233260013 could not be found. Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.281055 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1233260013 could not be found. Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1233260013 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42ea017e-673d-479e-9be7-b270f2e6f481 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/7/action" status: 404 len: 111 microversion: 2.1 time: 0.067658 Oct 17 15:22:45.284223 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 134/242] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:45 2022] POST /compute/v2.1/os-aggregates/7/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:22:45.302586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04f7f9e0-432a-4e63-ab92-ce24abd5c371 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:45.346555 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04f7f9e0-432a-4e63-ab92-ce24abd5c371 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.051830 Oct 17 15:22:45.348743 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 135/243] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:45 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:45.376579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40f6e81e-b076-4d9f-b359-6139d9148776 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40f6e81e-b076-4d9f-b359-6139d9148776 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Request method failure captured: Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 283 Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMabvuKVN_xWjHhBTHvDKFkxXnLaUyYkSmr9RQGIXeAuEk4kWCMvzkwdNuiLifneiwLU_0smLO8XxVBzHfL3OLr1d7fo0SKDMfurlQsUjBf6HO8fGyG7he5J_wRnHOz41cUGaehvEGSXWHds3vtfQDCw3-ZcUauY9XAuOlI3xWoBhk Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:45.391519 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88061e4944824c9a81658feef9f257e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88061e4944824c9a81658feef9f257e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 52e59befde0849abb476dda69cf09842 Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:45.393444 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:22:45.393963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:45.394882 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.395753 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.396809 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:22:45.396809 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:22:45.396809 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:22:45.396809 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.396809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40f6e81e-b076-4d9f-b359-6139d9148776 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:45.397308 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40f6e81e-b076-4d9f-b359-6139d9148776 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.035800 Oct 17 15:22:45.397387 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 136/244] 10.222.0.87 () {60 vars in 1165 bytes} [Mon Oct 17 15:22:45 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 15:22:45.410123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:45.412077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:45.424254 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cbc543d1-bf86-4293-90bc-6d75ad9ecdef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 314 microversion: 2.41 time: 0.307207 Oct 17 15:22:45.432490 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 109/245] 10.222.0.87 () {62 vars in 1232 bytes} [Mon Oct 17 15:22:45 2022] POST /compute/v2.1/os-aggregates/5/action => generated 314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:45.441156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:45.441662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:45.441760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1302225-1001-43a4-8467-ab9f05b9f765 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.442100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:45.445844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:45.446361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:45.446995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1302225-1001-43a4-8467-ab9f05b9f765 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Request method failure captured: Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 27 Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMabvuKVN_xWjHhBTHvDKFkxXnLaUyYkSmr9RQGIXeAuEk4kWCMvzkwdNuiLifneiwLU_0smLO8XxVBzHfL3OLr1d7fo0SKDMfurlQsUjBf6HO8fGyG7he5J_wRnHOz41cUGaehvEGSXWHds3vtfQDCw3-ZcUauY9XAuOlI3xWoBhk Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:22:45.453826 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88061e4944824c9a81658feef9f257e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88061e4944824c9a81658feef9f257e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 52e59befde0849abb476dda69cf09842 Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: {"aggregate": {"name": ""}} Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:45.455192 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '' Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:45.455856 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:22:45.456982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.457984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1302225-1001-43a4-8467-ab9f05b9f765 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:45.457984 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1302225-1001-43a4-8467-ab9f05b9f765 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.022443 Oct 17 15:22:45.457984 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 110/246] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:45 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:22:45.464918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4eaf799d-75f0-4e47-a8f0-84a2462697ef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.498082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eaf799d-75f0-4e47-a8f0-84a2462697ef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:45.498762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eaf799d-75f0-4e47-a8f0-84a2462697ef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:45.499286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eaf799d-75f0-4e47-a8f0-84a2462697ef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:45.758794 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4eaf799d-75f0-4e47-a8f0-84a2462697ef tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 298 microversion: 2.41 time: 0.300581 Oct 17 15:22:45.761130 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 111/247] 10.222.0.87 () {62 vars in 1232 bytes} [Mon Oct 17 15:22:45 2022] POST /compute/v2.1/os-aggregates/5/action => generated 298 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:45.769531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1bcffe15-7c29-474d-8ef7-44664f02713d tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1513405752"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.777382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1bcffe15-7c29-474d-8ef7-44664f02713d tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '8fe961b1ea794d2497d29b5cc447adb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efbf191c3b4007a9f25d5d56f9e6d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1bcffe15-7c29-474d-8ef7-44664f02713d tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Request method failure captured: Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 60 Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMXgO9V0BMYkbkxk-OxP6bRbrCjpc5FUhP2psnYhN4DFwal7q20RH1UXTsuBmzdhmQ6zmpgUJaSSsOHgr2Bq9dMRsPxUv3CVp9D1U19l5ErZgcDVc7N5otOMSiJfm6JTqMuPJA0TNPPH-x1yzmzi26_95y3lVvfgi2wF7hPQQ8JclE Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:45.780351 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8fe961b1ea794d2497d29b5cc447adb2 Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: {"aggregate": {"name": "tempest-test_aggregate-1513405752"}} Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:45.781601 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1513405752'}}} Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:45.782273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:45.783312 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 15:22:45.784481 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.794097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1bcffe15-7c29-474d-8ef7-44664f02713d tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:45.794759 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1bcffe15-7c29-474d-8ef7-44664f02713d tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.031359 Oct 17 15:22:45.798290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:45.801213 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 112/248] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:45 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:45.807820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-875e867b-5b74-4d0c-bd1d-3847e4971315 tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:45.814387 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a939398-fbe2-475a-9fc7-5e26fb53ea26 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.415497 Oct 17 15:22:45.817471 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 137/249] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:45 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:45.829431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a10a69a0-3aee-4161-8876-bb021cc1a3e8 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-665727038"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.837881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-a10a69a0-3aee-4161-8876-bb021cc1a3e8 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Generated uuid 31d37fbe-e3cd-4303-b930-d2e1b1f8b219 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:45.858824 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-875e867b-5b74-4d0c-bd1d-3847e4971315 tempest-AggregatesAdminTestV241-428177706 tempest-AggregatesAdminTestV241-428177706-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.41 time: 0.055834 Oct 17 15:22:45.859424 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 113/250] 10.222.0.87 () {60 vars in 1193 bytes} [Mon Oct 17 15:22:45 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:45.893898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:45.897196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:45.901912 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a10a69a0-3aee-4161-8876-bb021cc1a3e8 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.080456 Oct 17 15:22:45.903480 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 138/251] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:45.925309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:45.927474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:45.929106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff75e108-6a38-4b43-ad97-36875cd083c9 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-665727038"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:45.929486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:45.930951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:45.932829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:45.936171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:45.942922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-ff75e108-6a38-4b43-ad97-36875cd083c9 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Generated uuid df29cf92-2e96-4d24-ae61-1a58efc36104 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:45.975826 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ff75e108-6a38-4b43-ad97-36875cd083c9 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-665727038 already exists. Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff75e108-6a38-4b43-ad97-36875cd083c9 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Request method failure captured: Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 59 Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMabvuKVN_xWjHhBTHvDKFkxXnLaUyYkSmr9RQGIXeAuEk4kWCMvzkwdNuiLifneiwLU_0smLO8XxVBzHfL3OLr1d7fo0SKDMfurlQsUjBf6HO8fGyG7he5J_wRnHOz41cUGaehvEGSXWHds3vtfQDCw3-ZcUauY9XAuOlI3xWoBhk Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:45.982376 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88061e4944824c9a81658feef9f257e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88061e4944824c9a81658feef9f257e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 52e59befde0849abb476dda69cf09842 Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: {"aggregate": {"name": "tempest-test_aggregate-665727038"}} Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:45.983933 n-d-854441-12 devstack@n-api.service[120406]: exception: Aggregate tempest-test_aggregate-665727038 already exists. Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-665727038'}}} Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 17 15:22:45.984774 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-665727038 already exists. Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:45.985936 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-665727038 already exists. Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-665727038 already exists. Oct 17 15:22:45.987185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:45.990867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff75e108-6a38-4b43-ad97-36875cd083c9 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-665727038 already exists. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:46.002050 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff75e108-6a38-4b43-ad97-36875cd083c9 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.086406 Oct 17 15:22:46.005238 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 139/252] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:45 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:46.014463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1aaa9b5a-d51a-4357-9aca-0f8708761721 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1397081676"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:46.024108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-1aaa9b5a-d51a-4357-9aca-0f8708761721 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Generated uuid 016bce38-2466-4ac8-beaa-77c80a966c21 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:46.074186 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1aaa9b5a-d51a-4357-9aca-0f8708761721 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064857 Oct 17 15:22:46.075670 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 140/253] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:46.081769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39050479-f87b-407d-b3d4-ccf75b1f547c tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:46.125512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:46.137651 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-74333e8a-caac-4642-905e-682ad258c73e tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1278 microversion: 2.1 time: 0.254750 Oct 17 15:22:46.156675 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 114/254] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:45 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:46.160376 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39050479-f87b-407d-b3d4-ccf75b1f547c tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.083541 Oct 17 15:22:46.160981 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 141/255] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:46 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:46.169387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-00c5dc45-0ba4-4568-af96-b4fb7d8d6d95 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:46.196433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b3def5e-7f12-429f-a9d2-e9a4225dbfaf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1179946109"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:46.208987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-7b3def5e-7f12-429f-a9d2-e9a4225dbfaf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Generated uuid b17b03ca-16e8-41e5-857f-cd2ff235d5fd for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:46.236635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00c5dc45-0ba4-4568-af96-b4fb7d8d6d95 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:46.239612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00c5dc45-0ba4-4568-af96-b4fb7d8d6d95 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:46.242420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00c5dc45-0ba4-4568-af96-b4fb7d8d6d95 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:46.267908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:46.271829 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b3def5e-7f12-429f-a9d2-e9a4225dbfaf tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.092956 Oct 17 15:22:46.274149 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 142/256] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:46.289761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:46.293422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:46.321253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:46.321960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:46.322458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:46.323424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:46.324258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:46.325234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:46.495049 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-00c5dc45-0ba4-4568-af96-b4fb7d8d6d95 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.337342 Oct 17 15:22:46.503274 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 115/257] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:46 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:46.503274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1366fa3-5619-4d8e-8bbe-2cd2a2f57bac tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:46.503274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e1366fa3-5619-4d8e-8bbe-2cd2a2f57bac tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '8fe961b1ea794d2497d29b5cc447adb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efbf191c3b4007a9f25d5d56f9e6d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1366fa3-5619-4d8e-8bbe-2cd2a2f57bac tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Request method failure captured: Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-aggregates/10 HTTP/1.1 Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMXgO9V0BMYkbkxk-OxP6bRbrCjpc5FUhP2psnYhN4DFwal7q20RH1UXTsuBmzdhmQ6zmpgUJaSSsOHgr2Bq9dMRsPxUv3CVp9D1U19l5ErZgcDVc7N5otOMSiJfm6JTqMuPJA0TNPPH-x1yzmzi26_95y3lVvfgi2wF7hPQQ8JclE Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:46.509991 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8fe961b1ea794d2497d29b5cc447adb2 Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 15:22:46.511721 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '10'} Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:46.512449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:46.513574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1366fa3-5619-4d8e-8bbe-2cd2a2f57bac tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:46.515653 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e1366fa3-5619-4d8e-8bbe-2cd2a2f57bac tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/10" status: 403 len: 116 microversion: 2.1 time: 0.014845 Oct 17 15:22:46.515653 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 116/258] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:46 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:46.537623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a24b680-b33f-43d2-a3e6-764148228ecb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:46.571489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a24b680-b33f-43d2-a3e6-764148228ecb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:46.571993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a24b680-b33f-43d2-a3e6-764148228ecb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:46.572432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a24b680-b33f-43d2-a3e6-764148228ecb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:46.590616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:46.605544 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65ff8952-4c5e-499b-b87d-586ed6bf648b tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1464 microversion: 2.1 time: 0.323534 Oct 17 15:22:46.609067 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 143/259] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:46 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1464 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:46.617148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a007ae60-f7a8-46a0-993f-cd474f2d515a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:46.668760 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a007ae60-f7a8-46a0-993f-cd474f2d515a tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.056864 Oct 17 15:22:46.670631 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 144/260] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:46 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:46.799738 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a24b680-b33f-43d2-a3e6-764148228ecb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.286264 Oct 17 15:22:46.800661 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 117/261] 10.222.0.87 () {60 vars in 1191 bytes} [Mon Oct 17 15:22:46 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:46.814349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed10b95c-74d2-4703-92cd-c8e60ec0279f tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:46.841029 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-ed10b95c-74d2-4703-92cd-c8e60ec0279f tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed10b95c-74d2-4703-92cd-c8e60ec0279f tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Request method failure captured: Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMabvuKVN_xWjHhBTHvDKFkxXnLaUyYkSmr9RQGIXeAuEk4kWCMvzkwdNuiLifneiwLU_0smLO8XxVBzHfL3OLr1d7fo0SKDMfurlQsUjBf6HO8fGyG7he5J_wRnHOz41cUGaehvEGSXWHds3vtfQDCw3-ZcUauY9XAuOlI3xWoBhk Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:22:46.843498 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88061e4944824c9a81658feef9f257e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88061e4944824c9a81658feef9f257e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 52e59befde0849abb476dda69cf09842 Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: exception: Aggregate -1 could not be found. Oct 17 15:22:46.845013 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '-1'} Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 15:22:46.845836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:46.847246 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:46.848359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:46.848359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:46.848359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:46.848359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:46.848359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 17 15:22:46.848359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:46.857736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed10b95c-74d2-4703-92cd-c8e60ec0279f tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:46.860209 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed10b95c-74d2-4703-92cd-c8e60ec0279f tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.056043 Oct 17 15:22:46.868094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 118/262] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:46 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:46.877523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d16fd3e5-2d1b-4f05-90ee-f70cc8d28ba0 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:46.925490 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d16fd3e5-2d1b-4f05-90ee-f70cc8d28ba0 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.056030 Oct 17 15:22:46.926384 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 119/263] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:46 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:46.934253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:46.938206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:46.952520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:46.953020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:46.953941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:46.956836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:46.957812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:46.961533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:47.106288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-475ebbb3-5883-4a82-955d-ad4b4f2d1f91 tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Calling method '.version_select at 0x7f28bf4ca820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.131941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-475ebbb3-5883-4a82-955d-ad4b4f2d1f91 tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:47.132488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-475ebbb3-5883-4a82-955d-ad4b4f2d1f91 tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:47.132877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-475ebbb3-5883-4a82-955d-ad4b4f2d1f91 tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:47.176092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-475ebbb3-5883-4a82-955d-ad4b4f2d1f91 tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:47.176631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-475ebbb3-5883-4a82-955d-ad4b4f2d1f91 tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:47.177060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-475ebbb3-5883-4a82-955d-ad4b4f2d1f91 tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:47.220727 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-475ebbb3-5883-4a82-955d-ad4b4f2d1f91 tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] 10.222.0.87 "GET /compute/v2.1/os-simple-tenant-usage/a56244de709340a3b979ad0ffed87591?start=2022-10-16T15%3A22%3A46.628473&end=2022-10-18T15%3A22%3A46.628473" status: 200 len: 695 microversion: 2.1 time: 0.548481 Oct 17 15:22:47.221341 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 145/264] 10.222.0.87 () {58 vars in 1412 bytes} [Mon Oct 17 15:22:46 2022] GET /compute/v2.1/os-simple-tenant-usage/a56244de709340a3b979ad0ffed87591?start=2022-10-16T15%3A22%3A46.628473&end=2022-10-18T15%3A22%3A46.628473 => generated 695 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:47.225827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95e11768-1608-4206-a6bc-c0fc3e9ae7b7 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1551124591"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:47.242960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-95e11768-1608-4206-a6bc-c0fc3e9ae7b7 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Generated uuid a46fc282-351f-4efd-9077-af356728e699 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:47.279614 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95e11768-1608-4206-a6bc-c0fc3e9ae7b7 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056806 Oct 17 15:22:47.280565 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 146/265] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:47.285338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-562bb651-6cec-449d-bfd3-114aede0c119 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1478253729"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:47.288861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-562bb651-6cec-449d-bfd3-114aede0c119 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Generated uuid 47beb958-e729-46dc-87c3-2bdb2ed3b9f2 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:47.302775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=11,nova_api:INSERT=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:47.342921 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-562bb651-6cec-449d-bfd3-114aede0c119 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061181 Oct 17 15:22:47.343542 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 147/266] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:47.358959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.359590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:47.370236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:47.371251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:47.371847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:47.372942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:47.373625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:47.374255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:47.433628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:47.444357 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-759f13f7-b86c-4f73-b082-b336aa64c53b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.516679 Oct 17 15:22:47.447790 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 120/267] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:46 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:47.461487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-de7799d0-8ed0-435c-96e8-257f069c1533 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '.version_select at 0x7f28bf689dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.506201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7799d0-8ed0-435c-96e8-257f069c1533 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:47.509292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7799d0-8ed0-435c-96e8-257f069c1533 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:47.510378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7799d0-8ed0-435c-96e8-257f069c1533 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:47.572945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7799d0-8ed0-435c-96e8-257f069c1533 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:47.573785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7799d0-8ed0-435c-96e8-257f069c1533 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:47.574236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7799d0-8ed0-435c-96e8-257f069c1533 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:47.602630 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-de7799d0-8ed0-435c-96e8-257f069c1533 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/os-simple-tenant-usage/a56244de709340a3b979ad0ffed87591?start=2022-10-16T15%3A22%3A46.628473&end=2022-10-18T15%3A22%3A46.628473" status: 200 len: 691 microversion: 2.1 time: 0.152595 Oct 17 15:22:47.604214 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 121/268] 10.222.0.87 () {58 vars in 1412 bytes} [Mon Oct 17 15:22:47 2022] GET /compute/v2.1/os-simple-tenant-usage/a56244de709340a3b979ad0ffed87591?start=2022-10-16T15%3A22%3A46.628473&end=2022-10-18T15%3A22%3A46.628473 => generated 691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:47.611779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6cc5a977-9bff-4458-9601-2d923ab73859 tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.615325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6cc5a977-9bff-4458-9601-2d923ab73859 tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '8fe961b1ea794d2497d29b5cc447adb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efbf191c3b4007a9f25d5d56f9e6d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6cc5a977-9bff-4458-9601-2d923ab73859 tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Request method failure captured: Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMXgO9V0BMYkbkxk-OxP6bRbrCjpc5FUhP2psnYhN4DFwal7q20RH1UXTsuBmzdhmQ6zmpgUJaSSsOHgr2Bq9dMRsPxUv3CVp9D1U19l5ErZgcDVc7N5otOMSiJfm6JTqMuPJA0TNPPH-x1yzmzi26_95y3lVvfgi2wF7hPQQ8JclE Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:47.619141 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8fe961b1ea794d2497d29b5cc447adb2 Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 15:22:47.620353 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '11'} Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:47.621125 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 15:22:47.622155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:47.637057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6cc5a977-9bff-4458-9601-2d923ab73859 tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:47.639285 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6cc5a977-9bff-4458-9601-2d923ab73859 tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] 10.222.0.87 "GET /compute/v2.1/os-aggregates/11" status: 403 len: 114 microversion: 2.1 time: 0.032940 Oct 17 15:22:47.641194 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 122/269] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:47 2022] GET /compute/v2.1/os-aggregates/11 => generated 114 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:47.649310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24170a13-61bc-4d76-97af-01df53d60eb2 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.715972 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24170a13-61bc-4d76-97af-01df53d60eb2 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.073335 Oct 17 15:22:47.716567 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 123/270] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:47 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:47.741081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0af58549-1efa-4ece-bec4-834a2aff129c tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Calling method '.version_select at 0x7f28bf6574c0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.761062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:47.768742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0af58549-1efa-4ece-bec4-834a2aff129c tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:47.769224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0af58549-1efa-4ece-bec4-834a2aff129c tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:47.769647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0af58549-1efa-4ece-bec4-834a2aff129c tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:47.780539 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83cd823e-2600-4dce-aa7c-a60d45dcbd5b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1320 microversion: 2.1 time: 0.435906 Oct 17 15:22:47.786847 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 148/271] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:47 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1320 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:47.802382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7aac3ba-dc1e-4e6c-ae17-9cdcdda9dbac tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.834649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0af58549-1efa-4ece-bec4-834a2aff129c tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:47.839248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0af58549-1efa-4ece-bec4-834a2aff129c tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:47.849561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0af58549-1efa-4ece-bec4-834a2aff129c tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:47.897737 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7aac3ba-dc1e-4e6c-ae17-9cdcdda9dbac tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.108398 Oct 17 15:22:47.903259 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 149/272] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:47 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:47.920909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d68fec6e-fcc3-4fbc-8796-75c794721bfb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.953161 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0af58549-1efa-4ece-bec4-834a2aff129c tempest-TenantUsagesTestJSON-1951184766 tempest-TenantUsagesTestJSON-1951184766-project-admin] 10.222.0.87 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T15%3A22%3A46.628473&end=2022-10-18T15%3A22%3A46.628473&detailed=1" status: 200 len: 2788 microversion: 2.1 time: 0.230784 Oct 17 15:22:47.953321 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d68fec6e-fcc3-4fbc-8796-75c794721bfb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d68fec6e-fcc3-4fbc-8796-75c794721bfb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Request method failure captured: Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMZyU_FHveBKYm-XNHvFPIfR059t2Ny7-X7QFpxw4nsPSC9b1ppYU1pJwOzjljq0oGr1Qlg1IuZUxOiktKsyt989thMVfzh-dnpOM_WuSDz0UZtTQbNzHVmlGtkLAieJDHBBkEM1tqPVFaMqClGb9cF5-IFfSJPDODxRvN1cv7CXwg Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4e6f94bbe2224bb28fe32e72591d5e0a Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:47.957515 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4e6f94bbe2224bb28fe32e72591d5e0a Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminTestJSON-1577156232-project-admin Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 9e7f4e002d154939b8d1d7cc2a5f6bb5 Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminTestJSON-1577156232-project-admin Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: exception: Aggregate 12 could not be found. Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '12'} Oct 17 15:22:47.958779 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:47.959506 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 17 15:22:47.960473 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:47.961496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d68fec6e-fcc3-4fbc-8796-75c794721bfb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:47.962286 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d68fec6e-fcc3-4fbc-8796-75c794721bfb tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.054778 Oct 17 15:22:47.964699 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 150/273] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:47 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:47.970800 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 124/274] 10.222.0.87 () {58 vars in 1335 bytes} [Mon Oct 17 15:22:47 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T15%3A22%3A46.628473&end=2022-10-18T15%3A22%3A46.628473&detailed=1 => generated 2788 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:47.984885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b319c324-6cf2-44b1-9f31-d459f667c0f4 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.994320 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b319c324-6cf2-44b1-9f31-d459f667c0f4 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 17 15:22:47.997461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a792b1fa-03c8-41ae-a7a6-2647ae0f422e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b319c324-6cf2-44b1-9f31-d459f667c0f4 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Request method failure captured: Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMabvuKVN_xWjHhBTHvDKFkxXnLaUyYkSmr9RQGIXeAuEk4kWCMvzkwdNuiLifneiwLU_0smLO8XxVBzHfL3OLr1d7fo0SKDMfurlQsUjBf6HO8fGyG7he5J_wRnHOz41cUGaehvEGSXWHds3vtfQDCw3-ZcUauY9XAuOlI3xWoBhk Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:47.998183 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88061e4944824c9a81658feef9f257e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88061e4944824c9a81658feef9f257e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 52e59befde0849abb476dda69cf09842 Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: exception: Aggregate -1 could not be found. Oct 17 15:22:47.999481 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '-1'} Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.000127 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 17 15:22:48.001170 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.005134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b319c324-6cf2-44b1-9f31-d459f667c0f4 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:48.006431 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b319c324-6cf2-44b1-9f31-d459f667c0f4 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040463 Oct 17 15:22:48.008771 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 151/275] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:47 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:48.016165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:48.016771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:48.026874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.027600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.028257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:48.029226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.029991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.030218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:48.031513 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-a792b1fa-03c8-41ae-a7a6-2647ae0f422e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a792b1fa-03c8-41ae-a7a6-2647ae0f422e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Request method failure captured: Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMZyU_FHveBKYm-XNHvFPIfR059t2Ny7-X7QFpxw4nsPSC9b1ppYU1pJwOzjljq0oGr1Qlg1IuZUxOiktKsyt989thMVfzh-dnpOM_WuSDz0UZtTQbNzHVmlGtkLAieJDHBBkEM1tqPVFaMqClGb9cF5-IFfSJPDODxRvN1cv7CXwg Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e6f94bbe2224bb28fe32e72591d5e0a Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:22:48.033897 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e6f94bbe2224bb28fe32e72591d5e0a Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AggregatesAdminTestJSON-1577156232-project-admin Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 9e7f4e002d154939b8d1d7cc2a5f6bb5 Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AggregatesAdminTestJSON-1577156232-project-admin Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: exception: Aggregate 12 could not be found. Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '12'} Oct 17 15:22:48.035083 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:48.035813 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.036786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.037840 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.037840 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:48.037840 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:48.037840 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 17 15:22:48.037840 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.037840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a792b1fa-03c8-41ae-a7a6-2647ae0f422e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:48.037840 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a792b1fa-03c8-41ae-a7a6-2647ae0f422e tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.048669 Oct 17 15:22:48.037840 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 125/276] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:47 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:48.046016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e819f372-660c-47d7-a6a6-e177b401af6f tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:48.048816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e819f372-660c-47d7-a6a6-e177b401af6f tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '8fe961b1ea794d2497d29b5cc447adb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efbf191c3b4007a9f25d5d56f9e6d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e819f372-660c-47d7-a6a6-e177b401af6f tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Request method failure captured: Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMXgO9V0BMYkbkxk-OxP6bRbrCjpc5FUhP2psnYhN4DFwal7q20RH1UXTsuBmzdhmQ6zmpgUJaSSsOHgr2Bq9dMRsPxUv3CVp9D1U19l5ErZgcDVc7N5otOMSiJfm6JTqMuPJA0TNPPH-x1yzmzi26_95y3lVvfgi2wF7hPQQ8JclE Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:22:48.052886 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8fe961b1ea794d2497d29b5cc447adb2 Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 15:22:48.054355 n-d-854441-12 devstack@n-api.service[120407]: action_args: {} Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:48.055116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.056143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e819f372-660c-47d7-a6a6-e177b401af6f tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:48.057040 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e819f372-660c-47d7-a6a6-e177b401af6f tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] 10.222.0.87 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.015740 Oct 17 15:22:48.057040 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 126/277] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:22:48 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:48.061738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea2fbe15-a0c6-441d-98b0-1c44f111971d tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-40751107", "name": "tempest-test_aggregate-949269525"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:48.066411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:22:48.095529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.aggregate [None req-ea2fbe15-a0c6-441d-98b0-1c44f111971d tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Generated uuid 7ec564aa-7e20-4cb5-b162-7aa2dcf9276f for aggregate {{(pid=120407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:48.153775 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea2fbe15-a0c6-441d-98b0-1c44f111971d tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.096615 Oct 17 15:22:48.160529 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 127/278] 10.222.0.87 () {60 vars in 1165 bytes} [Mon Oct 17 15:22:48 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:48.165371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-76ac9487-2192-4123-9611-8b8dbfddc28d tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-516336501"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:48.173116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.aggregate [None req-76ac9487-2192-4123-9611-8b8dbfddc28d tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Generated uuid cd6d4c3d-eecb-45a0-b27c-5081772cda34 for aggregate {{(pid=120407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:48.214019 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db27da30-9f99-46b7-a78e-e4555e95586f tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "DELETE /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 204 len: 0 microversion: 2.1 time: 0.202875 Oct 17 15:22:48.218592 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 152/279] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:22:48 2022] DELETE /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:22:48.218798 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-76ac9487-2192-4123-9611-8b8dbfddc28d tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056147 Oct 17 15:22:48.225781 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 128/280] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:48.229526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78e7109c-8b63-40c0-9bf1-9b65743cb7ac tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:48.243620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:48.244256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:48.258431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.258958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.259447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:48.260162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.261065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.262823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:48.315301 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78e7109c-8b63-40c0-9bf1-9b65743cb7ac tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.094397 Oct 17 15:22:48.317767 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 153/281] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:48 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:48.343325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3eab032a-48a0-43d4-b463-837eb513f5cc tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:48.382160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3eab032a-48a0-43d4-b463-837eb513f5cc tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.384009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3eab032a-48a0-43d4-b463-837eb513f5cc tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.384630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3eab032a-48a0-43d4-b463-837eb513f5cc tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:48.707761 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3eab032a-48a0-43d4-b463-837eb513f5cc tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 243 microversion: 2.1 time: 0.385481 Oct 17 15:22:48.715127 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 154/282] 10.222.0.87 () {60 vars in 1194 bytes} [Mon Oct 17 15:22:48 2022] POST /compute/v2.1/os-aggregates/14/action => generated 243 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:48.715127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c437fab-5a05-40bf-889e-636b4ed3dd54 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:48.728457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:48.741380 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1112ac95-b421-4e95-bb72-2deb7dc63fa8 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1470 microversion: 2.1 time: 0.511686 Oct 17 15:22:48.744575 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 129/283] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:48 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1470 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:48.749317 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8c437fab-5a05-40bf-889e-636b4ed3dd54 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 17 15:22:48.750285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c437fab-5a05-40bf-889e-636b4ed3dd54 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Request method failure captured: Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMZyU_FHveBKYm-XNHvFPIfR059t2Ny7-X7QFpxw4nsPSC9b1ppYU1pJwOzjljq0oGr1Qlg1IuZUxOiktKsyt989thMVfzh-dnpOM_WuSDz0UZtTQbNzHVmlGtkLAieJDHBBkEM1tqPVFaMqClGb9cF5-IFfSJPDODxRvN1cv7CXwg Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4e6f94bbe2224bb28fe32e72591d5e0a Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:48.754729 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4e6f94bbe2224bb28fe32e72591d5e0a Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminTestJSON-1577156232-project-admin Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 9e7f4e002d154939b8d1d7cc2a5f6bb5 Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminTestJSON-1577156232-project-admin Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: exception: Aggregate 13 could not be found. Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '13'} Oct 17 15:22:48.755885 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.756576 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 17 15:22:48.757534 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.758443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c437fab-5a05-40bf-889e-636b4ed3dd54 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:48.760080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:48.767961 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c437fab-5a05-40bf-889e-636b4ed3dd54 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.058057 Oct 17 15:22:48.773609 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 155/284] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:48 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:48.783285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.783709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.784219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:48.788198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.788717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.788991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-722c95cc-a4ad-489a-89c7-c6c4cb55b2a3 req-7481737f-4dc7-4a4e-ab69-0d5eccf1807b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e62615f-3b86-48ab-afc3-d09c1a8788a6", "tag": "c60325ef-a43a-4dfa-a6a3-943b0a7549dc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:48.789179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:48.812179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-722c95cc-a4ad-489a-89c7-c6c4cb55b2a3 req-7481737f-4dc7-4a4e-ab69-0d5eccf1807b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.812780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-722c95cc-a4ad-489a-89c7-c6c4cb55b2a3 req-7481737f-4dc7-4a4e-ab69-0d5eccf1807b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.813246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-722c95cc-a4ad-489a-89c7-c6c4cb55b2a3 req-7481737f-4dc7-4a4e-ab69-0d5eccf1807b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:48.842874 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-722c95cc-a4ad-489a-89c7-c6c4cb55b2a3 req-7481737f-4dc7-4a4e-ab69-0d5eccf1807b service nova] Creating event network-changed:c60325ef-a43a-4dfa-a6a3-943b0a7549dc for instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 on n-h1-854441-12 Oct 17 15:22:48.854237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-722c95cc-a4ad-489a-89c7-c6c4cb55b2a3 req-7481737f-4dc7-4a4e-ab69-0d5eccf1807b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079281 Oct 17 15:22:48.859242 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 156/285] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:48.882623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab5bfa0e-0cda-4972-8573-18c1072b591e tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:48.894338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab5bfa0e-0cda-4972-8573-18c1072b591e tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '8fe961b1ea794d2497d29b5cc447adb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efbf191c3b4007a9f25d5d56f9e6d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab5bfa0e-0cda-4972-8573-18c1072b591e tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Request method failure captured: Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates/14/action HTTP/1.1 Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 43 Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMXgO9V0BMYkbkxk-OxP6bRbrCjpc5FUhP2psnYhN4DFwal7q20RH1UXTsuBmzdhmQ6zmpgUJaSSsOHgr2Bq9dMRsPxUv3CVp9D1U19l5ErZgcDVc7N5otOMSiJfm6JTqMuPJA0TNPPH-x1yzmzi26_95y3lVvfgi2wF7hPQQ8JclE Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:48.896560 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/82efbf191c3b4007a9f25d5d56f9e6d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 82efbf191c3b4007a9f25d5d56f9e6d8 Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817838309 Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8fe961b1ea794d2497d29b5cc447adb2 Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817838309-project Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: {"remove_host": {"host": "n-h1-854441-12"}} Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:48.898095 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '14', 'body': {'remove_host': {'host': 'n-h1-854441-12'}}} Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:48.898877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 15:22:48.899917 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.907349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab5bfa0e-0cda-4972-8573-18c1072b591e tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:48.909144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab5bfa0e-0cda-4972-8573-18c1072b591e tempest-AggregatesAdminNegativeTestJSON-817838309 tempest-AggregatesAdminNegativeTestJSON-817838309-project] 10.222.0.87 "POST /compute/v2.1/os-aggregates/14/action" status: 403 len: 121 microversion: 2.1 time: 0.047440 Oct 17 15:22:48.909946 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 157/286] 10.222.0.87 () {60 vars in 1194 bytes} [Mon Oct 17 15:22:48 2022] POST /compute/v2.1/os-aggregates/14/action => generated 121 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:48.923132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdeecf24-42f6-4205-a904-668618290520 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:48.957487 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fdeecf24-42f6-4205-a904-668618290520 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdeecf24-42f6-4205-a904-668618290520 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Request method failure captured: Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMZyU_FHveBKYm-XNHvFPIfR059t2Ny7-X7QFpxw4nsPSC9b1ppYU1pJwOzjljq0oGr1Qlg1IuZUxOiktKsyt989thMVfzh-dnpOM_WuSDz0UZtTQbNzHVmlGtkLAieJDHBBkEM1tqPVFaMqClGb9cF5-IFfSJPDODxRvN1cv7CXwg Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4e6f94bbe2224bb28fe32e72591d5e0a Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:48.959383 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e6f94bbe2224bb28fe32e72591d5e0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4e6f94bbe2224bb28fe32e72591d5e0a Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1577156232 Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminTestJSON-1577156232-project-admin Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 9e7f4e002d154939b8d1d7cc2a5f6bb5 Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminTestJSON-1577156232-project-admin Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: exception: Aggregate 13 could not be found. Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '13'} Oct 17 15:22:48.960598 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:48.961290 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:48.962375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:48.963479 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:48.963479 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:48.963479 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:48.963479 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 17 15:22:48.963479 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:48.963479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdeecf24-42f6-4205-a904-668618290520 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:48.963479 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdeecf24-42f6-4205-a904-668618290520 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.049739 Oct 17 15:22:48.966349 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 158/287] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:48 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:48.971544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:48.972528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:48.980030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.980845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.981484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:48.982525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:48.983213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:48.983845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:49.259888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:49.284042 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea12d7c2-4b71-42f6-b9b4-d8eeae5665e4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1320 microversion: 2.1 time: 0.315339 Oct 17 15:22:49.287174 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 159/288] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:48 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:49.304675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36291bda-a64f-49a5-b260-d3bc4e0205a1 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:49.320373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:49.339072 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dfc990e0-51e7-4474-8395-2fa8fe61965c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.587586 Oct 17 15:22:49.354556 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 130/289] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:48 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:49.355105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36291bda-a64f-49a5-b260-d3bc4e0205a1 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:49.355105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36291bda-a64f-49a5-b260-d3bc4e0205a1 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:49.355105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36291bda-a64f-49a5-b260-d3bc4e0205a1 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:49.365403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cde02728-ffa7-4693-9951-5a2d568a360b tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-979242127"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:49.377326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.aggregate [None req-cde02728-ffa7-4693-9951-5a2d568a360b tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Generated uuid a217a11a-bd6e-4cca-b24b-bc33d09b955f for aggregate {{(pid=120407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:49.406807 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cde02728-ffa7-4693-9951-5a2d568a360b tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060419 Oct 17 15:22:49.407862 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 131/290] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:49.420347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b83a4271-68ce-4376-9633-82f23a1801f6 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:49.432677 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b83a4271-68ce-4376-9633-82f23a1801f6 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.016689 Oct 17 15:22:49.443926 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 132/291] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:49 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:49.463316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c13f989-05b4-4e61-b906-53d89fdc9eef tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:49.528189 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c13f989-05b4-4e61-b906-53d89fdc9eef tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.083964 Oct 17 15:22:49.538621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 133/292] 10.222.0.87 () {60 vars in 1194 bytes} [Mon Oct 17 15:22:49 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:49.548782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5724f1e2-c35d-4b96-bed9-f36c6b8a7c4a tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:49.569928 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5724f1e2-c35d-4b96-bed9-f36c6b8a7c4a tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.030089 Oct 17 15:22:49.581619 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 134/293] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:22:49 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:49.593155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-522813b9-1159-48f0-a2fe-639620286db8 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:49.618783 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36291bda-a64f-49a5-b260-d3bc4e0205a1 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 227 microversion: 2.1 time: 0.326209 Oct 17 15:22:49.619766 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 160/294] 10.222.0.87 () {60 vars in 1194 bytes} [Mon Oct 17 15:22:49 2022] POST /compute/v2.1/os-aggregates/14/action => generated 227 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:49.642642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f395cbc2-761e-4e96-aa18-fb4903d06eaa tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:49.665146 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-522813b9-1159-48f0-a2fe-639620286db8 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.081858 Oct 17 15:22:49.669718 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 135/295] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:49 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:49.678020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-366640c0-9ae0-4a9d-b18d-b296c3718f5a tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1791277645", "availability_zone": "tempest-test_az-1827933118"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:49.701312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.aggregate [None req-366640c0-9ae0-4a9d-b18d-b296c3718f5a tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Generated uuid 5d0f0d98-9c15-45ba-9a60-4307a18b0a5d for aggregate {{(pid=120407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:49.706710 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f395cbc2-761e-4e96-aa18-fb4903d06eaa tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.069850 Oct 17 15:22:49.714680 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 161/296] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:49 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:49.725358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42640697-9be6-4e9c-9007-d82a48b12cf8 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1879945487"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:49.730296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-42640697-9be6-4e9c-9007-d82a48b12cf8 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Generated uuid 2594cca8-2dee-4338-b347-11b48fd0eaad for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:49.761360 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-366640c0-9ae0-4a9d-b18d-b296c3718f5a tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.084678 Oct 17 15:22:49.762832 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 136/297] 10.222.0.87 () {60 vars in 1165 bytes} [Mon Oct 17 15:22:49 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:49.767218 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42640697-9be6-4e9c-9007-d82a48b12cf8 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050784 Oct 17 15:22:49.774492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:49.775498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:49.779060 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 162/298] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:49.791425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:49.791956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0386857-a9a9-4de8-a486-197623f2798c tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1791277645_new", "availability_zone": "tempest-test_az-1827933118_new"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:49.794841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:49.797968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:49.798997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:49.799488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:49.799922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:49.815573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:50.030111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0386857-a9a9-4de8-a486-197623f2798c tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:50.030955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0386857-a9a9-4de8-a486-197623f2798c tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:50.031554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0386857-a9a9-4de8-a486-197623f2798c tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:50.097712 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0386857-a9a9-4de8-a486-197623f2798c tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.312672 Oct 17 15:22:50.099442 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 163/299] 10.222.0.87 () {60 vars in 1173 bytes} [Mon Oct 17 15:22:49 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:50.117456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:50.135259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:50.136565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:50.137575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:50.149216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:50.150384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:50.151170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:50.174092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.compute.aggregates [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 17 15:22:50.176486 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Request method failure captured: Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 42 Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMabvuKVN_xWjHhBTHvDKFkxXnLaUyYkSmr9RQGIXeAuEk4kWCMvzkwdNuiLifneiwLU_0smLO8XxVBzHfL3OLr1d7fo0SKDMfurlQsUjBf6HO8fGyG7he5J_wRnHOz41cUGaehvEGSXWHds3vtfQDCw3-ZcUauY9XAuOlI3xWoBhk Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:22:50.186130 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88061e4944824c9a81658feef9f257e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88061e4944824c9a81658feef9f257e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88061e4944824c9a81658feef9f257e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 88061e4944824c9a81658feef9f257e0 Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-281271801 Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 52e59befde0849abb476dda69cf09842 Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: {"remove_host": {"host": "nonexist_host"}} Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:50.187744 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot remove host nonexist_host in aggregate 17 Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 17 15:22:50.188595 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 17 15:22:50.190035 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:50.191544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:50.194583 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:50.194583 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:50.194583 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:50.194583 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:50.194583 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Oct 17 15:22:50.194583 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:50.198888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:50.202144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10d31d23-f44e-486c-8fe4-69fd775c7f78 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.101140 Oct 17 15:22:50.205343 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 164/300] 10.222.0.87 () {60 vars in 1194 bytes} [Mon Oct 17 15:22:50 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:22:50.222345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a1339f5-64f2-4214-bb7c-6495ebc0f5aa tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:50.244936 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a1339f5-64f2-4214-bb7c-6495ebc0f5aa tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates" status: 200 len: 555 microversion: 2.1 time: 0.037082 Oct 17 15:22:50.246387 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 165/301] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:22:50 2022] GET /compute/v2.1/os-aggregates => generated 555 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:50.256804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-daec4299-e24f-475a-b92d-871c5068c098 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:50.331311 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-daec4299-e24f-475a-b92d-871c5068c098 tempest-AggregatesAdminNegativeTestJSON-281271801 tempest-AggregatesAdminNegativeTestJSON-281271801-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.083402 Oct 17 15:22:50.333151 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 166/302] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:50 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:50.341591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6adaafe0-4170-455b-b39f-2ec7b0d711c9 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:50.394157 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6adaafe0-4170-455b-b39f-2ec7b0d711c9 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.059066 Oct 17 15:22:50.395271 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 167/303] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:50 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:50.407357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:50.416448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:50.432334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:50.435158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:50.436763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:50.437676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:50.439865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:50.440486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:50.626998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:50.645305 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80afa630-69a8-4726-b5b1-f7d169b6a250 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1470 microversion: 2.1 time: 0.879929 Oct 17 15:22:50.665312 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 137/304] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:49 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1470 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:50.679051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:50.680031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:50.707861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:50.708362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:50.708797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:50.713948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:50.715694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:50.720399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:50.891400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:50.903508 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20a59405-fe3f-43ac-85cd-127e532ca1f8 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1320 microversion: 2.1 time: 0.501536 Oct 17 15:22:50.906327 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 168/305] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:50 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1320 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:50.921488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9eed2d2c-86c2-4779-82df-065af0f4cf19 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1534025830"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:50.930981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-9eed2d2c-86c2-4779-82df-065af0f4cf19 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Generated uuid 6132cbc9-d685-4a98-b612-5b71489980f1 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 15:22:50.979764 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9eed2d2c-86c2-4779-82df-065af0f4cf19 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072077 Oct 17 15:22:50.988729 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 169/306] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 15:22:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:51.014175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a126bd74-79fd-4388-807a-4fe13c63cb75 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:51.042407 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a126bd74-79fd-4388-807a-4fe13c63cb75 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.046604 Oct 17 15:22:51.044635 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 170/307] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:22:50 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:51.059150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cc335235-cd08-456a-872a-51cdc3514467 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:51.112130 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cc335235-cd08-456a-872a-51cdc3514467 tempest-AggregatesAdminTestJSON-1577156232 tempest-AggregatesAdminTestJSON-1577156232-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.057893 Oct 17 15:22:51.116869 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 171/308] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:22:51 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:22:51.142116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:51.142699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:51.156962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=80,nova_api:DELETE=13,nova_api:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:51.158556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:51.162929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:51.168896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:51.168896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:51.168896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:51.169321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:51.217689 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] HTTP exception thrown: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Request method failure captured: Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f HTTP/1.1 Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMWkgroNnKDGyyYXU1gNGt-KQy11VUbhD7hAXtvaUaQQqlFWhNu4GmxH3SToYuaY-SO_vG4eS30hB0uFowBkl5Rt_MivCGO3bAqGX4voGu7w0ounjz54ruIAaQKOkDHyo14EcxsP_vvzyM3nzKisGAr7GGXV52vj-EyP3uufVHPhlk Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 72a8a8c2ca3d48b98d2192c05f5d49ca Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminTestJSON-1230300401 Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:51.222102 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminTestJSON-1230300401 Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 72a8a8c2ca3d48b98d2192c05f5d49ca Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1230300401 Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminTestJSON-1230300401-project Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: e97b5bbbf3484cdbb80f133d8df77dc3 Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminTestJSON-1230300401-project Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.223497 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5b972480-ce14-4f7f-87c1-1b97fa848e2f'} Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:51.224153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.225238 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.226263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Returning 404 to user: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:51.226263 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b9d281b-9b0e-408d-a7c8-c02aa3d5177f tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 404 len: 111 microversion: 2.1 time: 0.101848 Oct 17 15:22:51.227339 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 172/309] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:22:51 2022] DELETE /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:51.238251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:51.238962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] [instance: 5b972480-ce14-4f7f-87c1-1b97fa848e2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:51.259473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:51.270076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:51.272742 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0cc2f687-a225-4124-b950-8656fdf4cad9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.606252 Oct 17 15:22:51.274049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:51.276496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:51.280451 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 138/310] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:50 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:51.281432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:51.282079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:51.289502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:51.322844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:51.360930 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] HTTP exception thrown: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Request method failure captured: Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f HTTP/1.1 Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMWkgroNnKDGyyYXU1gNGt-KQy11VUbhD7hAXtvaUaQQqlFWhNu4GmxH3SToYuaY-SO_vG4eS30hB0uFowBkl5Rt_MivCGO3bAqGX4voGu7w0ounjz54ruIAaQKOkDHyo14EcxsP_vvzyM3nzKisGAr7GGXV52vj-EyP3uufVHPhlk Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 72a8a8c2ca3d48b98d2192c05f5d49ca Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AggregatesAdminTestJSON-1230300401 Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:51.363029 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72a8a8c2ca3d48b98d2192c05f5d49ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AggregatesAdminTestJSON-1230300401 Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 72a8a8c2ca3d48b98d2192c05f5d49ca Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1230300401 Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AggregatesAdminTestJSON-1230300401-project Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: e97b5bbbf3484cdbb80f133d8df77dc3 Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AggregatesAdminTestJSON-1230300401-project Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.364418 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5b972480-ce14-4f7f-87c1-1b97fa848e2f'} Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:51.365171 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. Oct 17 15:22:51.366413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:51.368987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] Returning 404 to user: Instance 5b972480-ce14-4f7f-87c1-1b97fa848e2f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:51.370093 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9e9f9bc-547b-4005-b36a-4a5f4b933c91 tempest-AggregatesAdminTestJSON-1230300401 tempest-AggregatesAdminTestJSON-1230300401-project] 10.222.0.87 "GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f" status: 404 len: 111 microversion: 2.1 time: 0.139546 Oct 17 15:22:51.371387 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 173/311] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:51 2022] GET /compute/v2.1/servers/5b972480-ce14-4f7f-87c1-1b97fa848e2f => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:51.558721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-45b514fb-030c-4dbe-8547-1bc7b874fda0 req-c1e73bbf-759f-477b-824a-7b8d0495e520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caac14a7-f9c8-4131-9dc4-de1068ad1181", "name": "network-vif-deleted", "tag": "2c33c9ef-20b0-41d8-a88a-29c91521a517"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:51.583622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-45b514fb-030c-4dbe-8547-1bc7b874fda0 req-c1e73bbf-759f-477b-824a-7b8d0495e520 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:51.584397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-45b514fb-030c-4dbe-8547-1bc7b874fda0 req-c1e73bbf-759f-477b-824a-7b8d0495e520 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:51.587858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-45b514fb-030c-4dbe-8547-1bc7b874fda0 req-c1e73bbf-759f-477b-824a-7b8d0495e520 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:51.657318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-45b514fb-030c-4dbe-8547-1bc7b874fda0 req-c1e73bbf-759f-477b-824a-7b8d0495e520 service nova] Creating event network-vif-deleted:2c33c9ef-20b0-41d8-a88a-29c91521a517 for instance caac14a7-f9c8-4131-9dc4-de1068ad1181 on n-h2-854441-12 Oct 17 15:22:51.678113 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-45b514fb-030c-4dbe-8547-1bc7b874fda0 req-c1e73bbf-759f-477b-824a-7b8d0495e520 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122394 Oct 17 15:22:51.681493 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 139/312] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:51.697065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:51.698300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:51.715317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:51.716094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:51.716631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:51.717538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:51.719021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:51.719560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:52.094718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-097c4da2-5d9f-477b-b477-24ae3ccfeb6d tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf4b4820>, body: {"quota_set": {"ram": "5120"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:52.109247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026f3d5447f24497b95b136a29f9489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56244de709340a3b979ad0ffed87591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:52.120065 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-296605c6-6b11-49bc-a1e8-fb3a99912044 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 200 len: 1299 microversion: 2.1 time: 0.435901 Oct 17 15:22:52.136412 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 140/313] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:51 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 1299 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:52.144645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:52.145669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:52.153395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:52.154301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:52.155032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:52.156090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:52.159194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:52.159963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:52.245005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:52.686864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:52.696471 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf09055a-171d-4a40-ae0a-6adecfa82082 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1320 microversion: 2.1 time: 0.558375 Oct 17 15:22:52.702717 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 141/314] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:52 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1320 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:52.707708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:52.713041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:52.725828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:52.731536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:52.732140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:52.733033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:52.733635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:52.734203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:53.022602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097c4da2-5d9f-477b-b477-24ae3ccfeb6d tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:53.025708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097c4da2-5d9f-477b-b477-24ae3ccfeb6d tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:53.027857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097c4da2-5d9f-477b-b477-24ae3ccfeb6d tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:53.028769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097c4da2-5d9f-477b-b477-24ae3ccfeb6d tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:53.029543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097c4da2-5d9f-477b-b477-24ae3ccfeb6d tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:53.033725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-097c4da2-5d9f-477b-b477-24ae3ccfeb6d tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:53.167339 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-097c4da2-5d9f-477b-b477-24ae3ccfeb6d tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/08e953e3a78b4d7fa82f807757659254" status: 200 len: 148 microversion: 2.57 time: 1.503638 Oct 17 15:22:53.168363 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 174/315] 10.222.0.87 () {62 vars in 1303 bytes} [Mon Oct 17 15:22:51 2022] PUT /compute/v2.1/os-quota-sets/08e953e3a78b4d7fa82f807757659254 => generated 148 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:53.174173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:53.174882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] [instance: caac14a7-f9c8-4131-9dc4-de1068ad1181] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:53.185353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:53.185910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:53.186938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:53.188424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:53.190102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:53.190491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:53.240850 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] HTTP exception thrown: Instance caac14a7-f9c8-4131-9dc4-de1068ad1181 could not be found. Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Request method failure captured: Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 HTTP/1.1 Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMvJ_CKbGur22JyMlMxUSwBySILOWbdWJVEAnCxSTO2xsTl1Ha9FlIZoXsVIckYR87UDsFpVrzCubH-TIwmnx55MbsFumUlaNugpKKeDsa2Xw1oP9lgaFSxlMwtk03PpK5eSgLP2Vr8gCCXqHRxxekG9Ny79E6QNbDcMkXXyCW828U Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: a56244de709340a3b979ad0ffed87591 Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TenantUsagesTestJSON-1059963908 Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:22:53.247832 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a56244de709340a3b979ad0ffed87591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a56244de709340a3b979ad0ffed87591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a56244de709340a3b979ad0ffed87591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a56244de709340a3b979ad0ffed87591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TenantUsagesTestJSON-1059963908 Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: a56244de709340a3b979ad0ffed87591 Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1059963908 Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TenantUsagesTestJSON-1059963908-project Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 026f3d5447f24497b95b136a29f9489d Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TenantUsagesTestJSON-1059963908-project Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance caac14a7-f9c8-4131-9dc4-de1068ad1181 could not be found. Oct 17 15:22:53.249766 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'caac14a7-f9c8-4131-9dc4-de1068ad1181'} Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caac14a7-f9c8-4131-9dc4-de1068ad1181 could not be found. Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:22:53.250697 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caac14a7-f9c8-4131-9dc4-de1068ad1181 could not be found. Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caac14a7-f9c8-4131-9dc4-de1068ad1181 could not be found. Oct 17 15:22:53.252012 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:22:53.253171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] Returning 404 to user: Instance caac14a7-f9c8-4131-9dc4-de1068ad1181 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:22:53.253171 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3419de4e-141e-436c-8489-892307104f22 tempest-TenantUsagesTestJSON-1059963908 tempest-TenantUsagesTestJSON-1059963908-project] 10.222.0.87 "GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181" status: 404 len: 111 microversion: 2.1 time: 0.080382 Oct 17 15:22:53.253171 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 175/316] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:53 2022] GET /compute/v2.1/servers/caac14a7-f9c8-4131-9dc4-de1068ad1181 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:22:53.257556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-559ca9b8-a407-4a27-afba-dcc1b15a25a3 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Calling method '.version_select at 0x7f28bf9d05e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:53.452016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:53.465594 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a851883a-4495-4293-baa8-42209780193d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.761563 Oct 17 15:22:53.468943 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 142/317] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:52 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:53.750880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:53.751794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:53.776411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:53.782828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:53.782828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:53.784794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:53.790001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:53.791247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:54.720606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559ca9b8-a407-4a27-afba-dcc1b15a25a3 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:54.721844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559ca9b8-a407-4a27-afba-dcc1b15a25a3 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:54.723121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559ca9b8-a407-4a27-afba-dcc1b15a25a3 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:54.725241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559ca9b8-a407-4a27-afba-dcc1b15a25a3 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:54.727184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559ca9b8-a407-4a27-afba-dcc1b15a25a3 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:54.729111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-559ca9b8-a407-4a27-afba-dcc1b15a25a3 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:54.753955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:54.775511 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-64452fa0-c2ed-415f-87ee-ad00d43dcf20 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1320 microversion: 2.1 time: 1.036822 Oct 17 15:22:54.778666 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 143/318] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:53 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1320 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:54.798582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:54.799226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:54.810657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:54.811219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:54.811669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:54.812413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:54.812874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:54.813299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:54.820036 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-559ca9b8-a407-4a27-afba-dcc1b15a25a3 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/08e953e3a78b4d7fa82f807757659254/detail" status: 200 len: 463 microversion: 2.57 time: 1.567245 Oct 17 15:22:54.836058 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 176/319] 10.222.0.87 () {60 vars in 1304 bytes} [Mon Oct 17 15:22:53 2022] GET /compute/v2.1/os-quota-sets/08e953e3a78b4d7fa82f807757659254/detail => generated 463 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:55.266116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:55.283529 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-496763a4-0f2b-4b82-9207-4113354fdd4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.503419 Oct 17 15:22:55.299438 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 144/320] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:54 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:55.493087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf3fcee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:55.799887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:55.800505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:55.818918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:55.819784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:55.820392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:55.831584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:55.832323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:55.832934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:56.202144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:56.226281 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20bb6b73-dfa6-441c-a47c-5068183be2fe tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1320 microversion: 2.1 time: 0.430404 Oct 17 15:22:56.240699 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 145/321] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:55 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1320 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:56.298071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:56.299470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:56.300847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:56.305496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:56.308270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:56.316442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:56.317290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:56.325405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:56.341025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:56.342200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:56.346576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:56.355931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:56.356702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:56.358226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:56.474542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:56.475045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:56.475480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:56.476216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:56.476673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:56.486907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:56.635477 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55c0f1ae-fec0-4407-b6b3-e9c942a7eaf7 tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/08e953e3a78b4d7fa82f807757659254?user_id=6d21b2d67a194866a738a6bed34cb284" status: 200 len: 148 microversion: 2.57 time: 1.147696 Oct 17 15:22:56.636566 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 177/322] 10.222.0.87 () {62 vars in 1384 bytes} [Mon Oct 17 15:22:55 2022] PUT /compute/v2.1/os-quota-sets/08e953e3a78b4d7fa82f807757659254?user_id=6d21b2d67a194866a738a6bed34cb284 => generated 148 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:22:56.648389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a9c4cd1-7863-438d-a290-d46eaa767caf tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] Calling method '.version_select at 0x7f28bf466e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:56.752419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:56.769819 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d3928832-2eb2-4edf-9471-e46b7e8f56de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.455756 Oct 17 15:22:56.772020 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 146/323] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:56 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:57.255044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:57.257041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:57.269810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:57.271424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:57.272106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:57.273795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:57.274460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:57.275289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:57.277941 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a9c4cd1-7863-438d-a290-d46eaa767caf tempest-QuotasAdminTestV257-1305283019 tempest-QuotasAdminTestV257-1305283019-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/08e953e3a78b4d7fa82f807757659254?user_id=6d21b2d67a194866a738a6bed34cb284" status: 200 len: 190 microversion: 2.57 time: 0.633410 Oct 17 15:22:57.284519 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 178/324] 10.222.0.87 () {60 vars in 1364 bytes} [Mon Oct 17 15:22:56 2022] GET /compute/v2.1/os-quota-sets/08e953e3a78b4d7fa82f807757659254?user_id=6d21b2d67a194866a738a6bed34cb284 => generated 190 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:22:57.796404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:57.799212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:57.812792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:57.814472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:57.816702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:57.818990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:22:57.821443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:57.822381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:57.824476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:58.278058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:58.289776 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-72cbe668-1ed1-471a-aee5-477cdc11bc8b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1320 microversion: 2.1 time: 1.040580 Oct 17 15:22:58.291206 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 147/325] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:57 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1320 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:22:58.305183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:22:58.317194 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3eb3a1ff-faf4-4b3f-8106-5e7c465d1192 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.525038 Oct 17 15:22:58.320081 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 179/326] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:57 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:22:58.851816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0ed5bf3c-5afd-4b18-85ad-e51bfe26b3ce req-fcf82169-50db-490f-baad-3c5e7d365625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e62615f-3b86-48ab-afc3-d09c1a8788a6", "name": "network-vif-plugged", "status": "completed", "tag": "c60325ef-a43a-4dfa-a6a3-943b0a7549dc"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:22:58.884617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ed5bf3c-5afd-4b18-85ad-e51bfe26b3ce req-fcf82169-50db-490f-baad-3c5e7d365625 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:58.885060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ed5bf3c-5afd-4b18-85ad-e51bfe26b3ce req-fcf82169-50db-490f-baad-3c5e7d365625 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:58.885886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ed5bf3c-5afd-4b18-85ad-e51bfe26b3ce req-fcf82169-50db-490f-baad-3c5e7d365625 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:58.926160 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0ed5bf3c-5afd-4b18-85ad-e51bfe26b3ce req-fcf82169-50db-490f-baad-3c5e7d365625 service nova] Creating event network-vif-plugged:c60325ef-a43a-4dfa-a6a3-943b0a7549dc for instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 on n-h1-854441-12 Oct 17 15:22:58.938067 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0ed5bf3c-5afd-4b18-85ad-e51bfe26b3ce req-fcf82169-50db-490f-baad-3c5e7d365625 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091830 Oct 17 15:22:58.941982 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 148/327] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:22:59.315477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:59.316192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:59.336768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:59.337405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:59.337863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:59.338641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:59.339187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:59.339619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:59.344555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:22:59.347307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:22:59.360032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:59.360695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:59.361142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:22:59.364333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:22:59.364884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:22:59.367595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:00.058020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:00.077870 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-46a3513e-a9ac-43d6-bfb5-fca4c1903a11 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.738019 Oct 17 15:23:00.081257 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 149/328] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:59 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:00.295978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:00.312699 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fe60413-46a2-4811-a777-5cef9f4326a9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1320 microversion: 2.1 time: 0.995483 Oct 17 15:23:00.326636 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 180/329] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:22:59 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1320 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:00.925948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c954ac5-3e19-49d7-856e-65ddce70b384 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Calling method '.version_select at 0x7f28bf689e50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:01.110842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:01.112906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:01.123581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:01.125131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:01.126795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:01.129826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:01.132236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:01.132928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:01.554241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:01.566375 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c08781f0-7ba7-428e-9ffb-3b6d553057b1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.461491 Oct 17 15:23:01.567008 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 181/330] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:01 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:01.593721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:01.594833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:01.610999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:01.611521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:01.611970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:01.612700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:01.613159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:01.613579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:02.003436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=85,nova_api:DELETE=7 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:02.033689 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3c954ac5-3e19-49d7-856e-65ddce70b384 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/13e758a41ddf4929b5ec7c79cba0a8b1" status: 200 len: 371 microversion: 2.1 time: 1.433035 Oct 17 15:23:02.041229 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 150/331] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 15:23:00 2022] GET /compute/v2.1/os-quota-sets/13e758a41ddf4929b5ec7c79cba0a8b1 => generated 371 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:02.059025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a003d58-be83-4468-b23d-039c2feb4857 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf57fe50>, body: {"quota_set": {"ram": "5120"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:02.377378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:02.390272 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b4c85add-8ae8-4615-b8d4-22bc16439382 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1470 microversion: 2.1 time: 0.815437 Oct 17 15:23:02.391185 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 182/332] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:01 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1470 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:02.416648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57d7267d-a002-4de8-8652-1fab5aec321d tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:02.420856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57d7267d-a002-4de8-8652-1fab5aec321d tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:02.435782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d7267d-a002-4de8-8652-1fab5aec321d tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:02.439792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d7267d-a002-4de8-8652-1fab5aec321d tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:02.443107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d7267d-a002-4de8-8652-1fab5aec321d tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:02.449813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d7267d-a002-4de8-8652-1fab5aec321d tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:02.453747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d7267d-a002-4de8-8652-1fab5aec321d tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:02.456192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d7267d-a002-4de8-8652-1fab5aec321d tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:02.809046 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57d7267d-a002-4de8-8652-1fab5aec321d tempest-DeleteServersAdminTestJSON-528314435 tempest-DeleteServersAdminTestJSON-528314435-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6/action" status: 202 len: 0 microversion: 2.1 time: 0.397164 Oct 17 15:23:02.810562 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 183/333] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:23:02 2022] POST /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:23:02.818813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:02.819766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:02.829080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:02.829966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:02.830824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:02.831878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:02.832477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:02.833335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:02.948174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a003d58-be83-4468-b23d-039c2feb4857 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:02.949125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a003d58-be83-4468-b23d-039c2feb4857 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:02.949729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a003d58-be83-4468-b23d-039c2feb4857 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:02.951018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a003d58-be83-4468-b23d-039c2feb4857 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:02.952033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a003d58-be83-4468-b23d-039c2feb4857 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:02.952478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a003d58-be83-4468-b23d-039c2feb4857 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:03.026795 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a003d58-be83-4468-b23d-039c2feb4857 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/13e758a41ddf4929b5ec7c79cba0a8b1" status: 200 len: 328 microversion: 2.1 time: 0.972261 Oct 17 15:23:03.028000 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 151/334] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:23:02 2022] PUT /compute/v2.1/os-quota-sets/13e758a41ddf4929b5ec7c79cba0a8b1 => generated 328 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:03.035543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:03.036697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:03.045636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:03.047323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:03.048130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:03.049023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:03.049677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:03.050986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:03.102434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:03.103227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:03.103831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:03.104683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lazy-loading 'fault' on Instance uuid 3e62615f-3b86-48ab-afc3-d09c1a8788a6 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:23:03.548401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:03.562040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:03.575301 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b4f49c6c-0f50-4e58-a03e-778a78d71e96 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 0.763247 Oct 17 15:23:03.577346 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b80312cb-35df-43ab-8ff2-132d6cf22a71 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1453 microversion: 2.1 time: 0.547143 Oct 17 15:23:03.592717 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 184/335] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:02 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:03.597713 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 152/336] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:03 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1453 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:03.623692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-16a3fab3-0f7f-4c57-9447-e66026ae1ce3 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:03.664027 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-16a3fab3-0f7f-4c57-9447-e66026ae1ce3 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-quota-sets/13e758a41ddf4929b5ec7c79cba0a8b1" status: 202 len: 0 microversion: 2.1 time: 0.064755 Oct 17 15:23:03.665280 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 153/337] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:23:03 2022] DELETE /compute/v2.1/os-quota-sets/13e758a41ddf4929b5ec7c79cba0a8b1 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:23:03.673029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:03.680218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:03.707208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:03.708145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:03.710555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:03.714349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:03.715946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:03.717029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:03.800310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:23:03.941301 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f444aaa-8c56-483e-86fc-2acece320e80 tempest-TenantUsagesNegativeTestJSON-414297465 tempest-TenantUsagesNegativeTestJSON-414297465-project-admin] 10.222.0.87 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-16T15%3A23%3A02.969059&end=2022-10-18T15%3A23%3A02.969059" status: 404 len: 112 microversion: - time: 0.347223 Oct 17 15:23:03.942834 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 185/338] 10.222.0.87 () {58 vars in 1316 bytes} [Mon Oct 17 15:23:03 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-16T15%3A23%3A02.969059&end=2022-10-18T15%3A23%3A02.969059 => generated 112 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 15:23:03.952027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-806b47e6-0aeb-4ba3-84db-050c224dac66 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Calling method '.version_select at 0x7f28bf4cad30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:04.278239 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b0549175-77d8-4aad-944e-d276426f2401 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 204 len: 0 microversion: 2.1 time: 0.611172 Oct 17 15:23:04.280131 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 154/339] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:23:03 2022] DELETE /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:23:04.310275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d708517a-b888-4ea5-8076-743003ca8817 tempest-TenantUsagesNegativeTestJSON-414297465 tempest-TenantUsagesNegativeTestJSON-414297465-project-admin] Calling method '.version_select at 0x7f28bf6cedc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:04.346176 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d708517a-b888-4ea5-8076-743003ca8817 tempest-TenantUsagesNegativeTestJSON-414297465 tempest-TenantUsagesNegativeTestJSON-414297465-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d708517a-b888-4ea5-8076-743003ca8817 tempest-TenantUsagesNegativeTestJSON-414297465 tempest-TenantUsagesNegativeTestJSON-414297465-project-admin] Request method failure captured: Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-simple-tenant-usage/5abb7464daf849f694efc227ff4c6f03?start=2022-10-18T15%3A23%3A02.969059&end=2022-10-16T15%3A23%3A02.969059 HTTP/1.1 Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNWYqk1yweotZlxyYUzTCXt_QFzl3GDbWBeRyLfmR8sZOnzde_AfVpAwfqRXZo1JQvxZXkAh12dsDIsIXzU5e3p8I3fyTBbijO9NYQo_ffoMrvEoGhuxpNqgG4apHbqD-DF7CemocETGuuz0thAH8w3S0DSS6cVmHIP8x4pHmD_JFc Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 24e63764e4aa4f1abfdfe67e3b2148c1 Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-414297465 Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:23:04.350344 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/24e63764e4aa4f1abfdfe67e3b2148c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/24e63764e4aa4f1abfdfe67e3b2148c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_24e63764e4aa4f1abfdfe67e3b2148c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/24e63764e4aa4f1abfdfe67e3b2148c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-414297465 Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 24e63764e4aa4f1abfdfe67e3b2148c1 Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-414297465 Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TenantUsagesNegativeTestJSON-414297465-project-admin Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8f72ff9cc5144bb7b6a71d37609140c4 Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-414297465-project-admin Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid start time. The start time cannot occur after the end time. Oct 17 15:23:04.351943 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '5abb7464daf849f694efc227ff4c6f03'} Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 15:23:04.352750 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 17 15:23:04.354233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:04.361592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d708517a-b888-4ea5-8076-743003ca8817 tempest-TenantUsagesNegativeTestJSON-414297465 tempest-TenantUsagesNegativeTestJSON-414297465-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:04.362847 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d708517a-b888-4ea5-8076-743003ca8817 tempest-TenantUsagesNegativeTestJSON-414297465 tempest-TenantUsagesNegativeTestJSON-414297465-project-admin] 10.222.0.87 "GET /compute/v2.1/os-simple-tenant-usage/5abb7464daf849f694efc227ff4c6f03?start=2022-10-18T15%3A23%3A02.969059&end=2022-10-16T15%3A23%3A02.969059" status: 400 len: 111 microversion: 2.1 time: 0.075114 Oct 17 15:23:04.367696 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 155/340] 10.222.0.87 () {58 vars in 1412 bytes} [Mon Oct 17 15:23:04 2022] GET /compute/v2.1/os-simple-tenant-usage/5abb7464daf849f694efc227ff4c6f03?start=2022-10-18T15%3A23%3A02.969059&end=2022-10-16T15%3A23%3A02.969059 => generated 111 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:23:04.397020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:04.400651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:04.446709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:04.447297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:04.447761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:04.455749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:04.458354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:04.462330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:04.614922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:04.615548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:04.616753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:04.617728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lazy-loading 'fault' on Instance uuid 3e62615f-3b86-48ab-afc3-d09c1a8788a6 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:23:04.622554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:04.831036 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-806b47e6-0aeb-4ba3-84db-050c224dac66 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/13e758a41ddf4929b5ec7c79cba0a8b1" status: 200 len: 371 microversion: 2.1 time: 0.886890 Oct 17 15:23:04.843170 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 186/341] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 15:23:03 2022] GET /compute/v2.1/os-quota-sets/13e758a41ddf4929b5ec7c79cba0a8b1 => generated 371 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:05.208870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d2612b9-eefa-435f-9be4-c193ac396a36 tempest-TenantUsagesNegativeTestJSON-683781151 tempest-TenantUsagesNegativeTestJSON-683781151-project] Calling method '.version_select at 0x7f28bf3e7040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:05.213600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d2612b9-eefa-435f-9be4-c193ac396a36 tempest-TenantUsagesNegativeTestJSON-683781151 tempest-TenantUsagesNegativeTestJSON-683781151-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '0c973940e2914c20bc59fd88191c4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abb7464daf849f694efc227ff4c6f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d2612b9-eefa-435f-9be4-c193ac396a36 tempest-TenantUsagesNegativeTestJSON-683781151 tempest-TenantUsagesNegativeTestJSON-683781151-project] Request method failure captured: Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T15%3A23%3A02.969059&end=2022-10-18T15%3A23%3A02.969059&detailed=1 HTTP/1.1 Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNU-wzIbIIzOhPgiWk9_tAl-0TlBJRLuZyisH1wa8OE0Bbc7pHHTkU9iQHQQZrV_XwhocCwbrdux4yj8btDD_g74RhJ4fuEMtmVuqx_tLrMugS6DSKucgSVRtKbNpAO6XgnzwcrHMI4jQ24-xd_nNsBiwyWTu6XXurMd6jdJHb7MIw Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 5abb7464daf849f694efc227ff4c6f03 Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-683781151 Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:23:05.218070 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5abb7464daf849f694efc227ff4c6f03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5abb7464daf849f694efc227ff4c6f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5abb7464daf849f694efc227ff4c6f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5abb7464daf849f694efc227ff4c6f03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-683781151 Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 5abb7464daf849f694efc227ff4c6f03 Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-683781151 Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TenantUsagesNegativeTestJSON-683781151-project Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 0c973940e2914c20bc59fd88191c4fe1 Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-683781151-project Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: action_args: {} Oct 17 15:23:05.219481 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:23:05.220631 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:23:05.223039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:23:05.225211 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 15:23:05.225211 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:05.225211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d2612b9-eefa-435f-9be4-c193ac396a36 tempest-TenantUsagesNegativeTestJSON-683781151 tempest-TenantUsagesNegativeTestJSON-683781151-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:05.225211 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d2612b9-eefa-435f-9be4-c193ac396a36 tempest-TenantUsagesNegativeTestJSON-683781151 tempest-TenantUsagesNegativeTestJSON-683781151-project] 10.222.0.87 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T15%3A23%3A02.969059&end=2022-10-18T15%3A23%3A02.969059&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.381130 Oct 17 15:23:05.232218 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 187/342] 10.222.0.87 () {58 vars in 1335 bytes} [Mon Oct 17 15:23:04 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T15%3A23%3A02.969059&end=2022-10-18T15%3A23%3A02.969059&detailed=1 => generated 123 bytes in 392 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:05.259191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:05.259818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:05.299071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:05.300210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:05.309097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:05.312823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:05.313400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:05.319970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:05.320426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:05.328420 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7ba9441-9709-441e-8680-cc3fa9b0eee9 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1459 microversion: 2.1 time: 0.956303 Oct 17 15:23:05.331221 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 156/343] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:04 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1459 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:05.346974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e7df7398-1beb-48f7-accb-0ad102d09359 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Calling method '.version_select at 0x7f28bf535b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:06.513890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=17 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:06.532791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:06.550850 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b64b96b5-a032-4715-a3ed-6c4abc29b9f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1476 microversion: 2.1 time: 1.313179 Oct 17 15:23:06.552075 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 188/344] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:05 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1476 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:06.565532 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e7df7398-1beb-48f7-accb-0ad102d09359 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/918a0ca4ede040a583792140b16ebc50/defaults" status: 200 len: 371 microversion: 2.1 time: 1.232637 Oct 17 15:23:06.566717 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 157/345] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:23:05 2022] GET /compute/v2.1/os-quota-sets/918a0ca4ede040a583792140b16ebc50/defaults => generated 371 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:06.574308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:06.574651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:06.601803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:06.602314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:06.605473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:06.605973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:06.606472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:06.607091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:06.697401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:06.698008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:06.700213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:06.706229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lazy-loading 'fault' on Instance uuid 3e62615f-3b86-48ab-afc3-d09c1a8788a6 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:23:07.113664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-68cc2177-b7f7-4fa6-a572-8714e2923746 req-f3fa250e-8f61-4d70-8b10-e67f1e296f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e62615f-3b86-48ab-afc3-d09c1a8788a6", "name": "network-vif-deleted", "tag": "c60325ef-a43a-4dfa-a6a3-943b0a7549dc"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:07.143581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-68cc2177-b7f7-4fa6-a572-8714e2923746 req-f3fa250e-8f61-4d70-8b10-e67f1e296f9a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:07.147245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-68cc2177-b7f7-4fa6-a572-8714e2923746 req-f3fa250e-8f61-4d70-8b10-e67f1e296f9a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:07.148245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-68cc2177-b7f7-4fa6-a572-8714e2923746 req-f3fa250e-8f61-4d70-8b10-e67f1e296f9a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:07.218578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-68cc2177-b7f7-4fa6-a572-8714e2923746 req-f3fa250e-8f61-4d70-8b10-e67f1e296f9a service nova] Creating event network-vif-deleted:c60325ef-a43a-4dfa-a6a3-943b0a7549dc for instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 on n-h1-854441-12 Oct 17 15:23:07.241136 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-68cc2177-b7f7-4fa6-a572-8714e2923746 req-f3fa250e-8f61-4d70-8b10-e67f1e296f9a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131944 Oct 17 15:23:07.243737 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 158/346] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:07.577843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:07.580425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:07.599641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:07.605750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:07.606460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:07.610646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:07.612082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:07.612996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:08.041228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0078ab28d52b4741aa81a5ee515acc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3e4c52bdf488283a305f15f904509', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:08.092295 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d5311b0-db7c-41c3-a2fd-41f5d8793b0b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 200 len: 1459 microversion: 2.1 time: 1.527857 Oct 17 15:23:08.092893 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 189/347] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:06 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 1459 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:08.119419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1e22257-97f3-4afe-8b76-70a0827b2b34 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf374d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:08.462800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:08.472428 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef8d1c06-546a-4881-8a53-c3382d9e016c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1475 microversion: 2.1 time: 0.899328 Oct 17 15:23:08.473017 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 159/348] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:07 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1475 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:08.798406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1e22257-97f3-4afe-8b76-70a0827b2b34 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:08.801603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1e22257-97f3-4afe-8b76-70a0827b2b34 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:08.802802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1e22257-97f3-4afe-8b76-70a0827b2b34 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:08.805043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1e22257-97f3-4afe-8b76-70a0827b2b34 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:08.806168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1e22257-97f3-4afe-8b76-70a0827b2b34 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:08.808307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1e22257-97f3-4afe-8b76-70a0827b2b34 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:08.858649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-46128413-7ef3-46d0-a7db-e2ed89b58bb0 req-4d674c14-e98a-46b7-8d7d-0ceae5d557ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382fe0d4-2f91-4289-8eea-4619e645a500", "name": "network-vif-unplugged", "status": "completed", "tag": "86a21e24-7531-494a-88d1-d4be7315e896"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:08.884171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-46128413-7ef3-46d0-a7db-e2ed89b58bb0 req-4d674c14-e98a-46b7-8d7d-0ceae5d557ae service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:08.884171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-46128413-7ef3-46d0-a7db-e2ed89b58bb0 req-4d674c14-e98a-46b7-8d7d-0ceae5d557ae service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:08.889449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-46128413-7ef3-46d0-a7db-e2ed89b58bb0 req-4d674c14-e98a-46b7-8d7d-0ceae5d557ae service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:08.926937 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1e22257-97f3-4afe-8b76-70a0827b2b34 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/ff8398cfef5f4f3198aee4dacd2a0a66" status: 200 len: 328 microversion: 2.1 time: 0.815824 Oct 17 15:23:08.927777 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 190/349] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:23:08 2022] PUT /compute/v2.1/os-quota-sets/ff8398cfef5f4f3198aee4dacd2a0a66 => generated 328 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:08.945869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-554996a3-bcae-4f5a-9276-56ab995b61b2 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Calling method '.version_select at 0x7f28bf374e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:08.946460 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-46128413-7ef3-46d0-a7db-e2ed89b58bb0 req-4d674c14-e98a-46b7-8d7d-0ceae5d557ae service nova] Creating event network-vif-unplugged:86a21e24-7531-494a-88d1-d4be7315e896 for instance 382fe0d4-2f91-4289-8eea-4619e645a500 on n-h2-854441-12 Oct 17 15:23:08.992276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-46128413-7ef3-46d0-a7db-e2ed89b58bb0 req-4d674c14-e98a-46b7-8d7d-0ceae5d557ae service nova] Instance 382fe0d4-2f91-4289-8eea-4619e645a500 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:23:09.021315 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-46128413-7ef3-46d0-a7db-e2ed89b58bb0 req-4d674c14-e98a-46b7-8d7d-0ceae5d557ae service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166131 Oct 17 15:23:09.026286 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 160/350] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:23:09.123598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:09.124782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:09.133525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.134413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.135885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.136901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.137876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.139521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.158068 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] HTTP exception thrown: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Request method failure captured: Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 HTTP/1.1 Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMYuTRue_SwQpoQLTUdL7K7vnHlrl00lXgHeFqx2ZM7jfLLmrxbIE4G-w9I5vRxANq1fRoeJHWIYZFccwPzIG1RD6pN2imzhAUIsKGFtKOUNzyFUslaPjZouA21l_KIouE8sDue7WOASizoAxEzw_PlEvRREoO3B10E4ZoCz2p49uA Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:09.160303 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_68a3e4c52bdf488283a305f15f904509"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0078ab28d52b4741aa81a5ee515acc04 Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.161590 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '3e62615f-3b86-48ab-afc3-d09c1a8788a6'} Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:09.162294 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.163369 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.165986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Returning 404 to user: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:09.167224 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1fa0a7fb-974f-4071-b1c9-3fe33828f5b7 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 404 len: 111 microversion: 2.1 time: 0.049633 Oct 17 15:23:09.168400 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 161/351] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:09 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:09.186862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:09.189729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:09.204407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.206256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.207997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.210103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.211173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.211917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.230415 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] HTTP exception thrown: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Request method failure captured: Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 HTTP/1.1 Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMYuTRue_SwQpoQLTUdL7K7vnHlrl00lXgHeFqx2ZM7jfLLmrxbIE4G-w9I5vRxANq1fRoeJHWIYZFccwPzIG1RD6pN2imzhAUIsKGFtKOUNzyFUslaPjZouA21l_KIouE8sDue7WOASizoAxEzw_PlEvRREoO3B10E4ZoCz2p49uA Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:09.232925 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_68a3e4c52bdf488283a305f15f904509"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0078ab28d52b4741aa81a5ee515acc04 Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.234391 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '3e62615f-3b86-48ab-afc3-d09c1a8788a6'} Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:09.235739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.236769 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.239614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Returning 404 to user: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:09.241162 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab78d5e1-4854-41b1-a30a-490fe06d061b tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 404 len: 111 microversion: 2.1 time: 0.066917 Oct 17 15:23:09.241931 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 162/352] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:23:09 2022] DELETE /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:09.256108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:09.257380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 3e62615f-3b86-48ab-afc3-d09c1a8788a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:09.272369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.276273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.279006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.280244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.280997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.282354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.314952 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] HTTP exception thrown: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Request method failure captured: Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 HTTP/1.1 Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMYuTRue_SwQpoQLTUdL7K7vnHlrl00lXgHeFqx2ZM7jfLLmrxbIE4G-w9I5vRxANq1fRoeJHWIYZFccwPzIG1RD6pN2imzhAUIsKGFtKOUNzyFUslaPjZouA21l_KIouE8sDue7WOASizoAxEzw_PlEvRREoO3B10E4ZoCz2p49uA Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:09.323592 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_68a3e4c52bdf488283a305f15f904509"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0078ab28d52b4741aa81a5ee515acc04 Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.324853 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '3e62615f-3b86-48ab-afc3-d09c1a8788a6'} Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:09.325487 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. Oct 17 15:23:09.326562 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.329515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Returning 404 to user: Instance 3e62615f-3b86-48ab-afc3-d09c1a8788a6 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:09.333909 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8bb50d8a-4aff-429d-886c-62f2dd30d4f2 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6" status: 404 len: 111 microversion: 2.1 time: 0.084056 Oct 17 15:23:09.336073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 163/353] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:09 2022] GET /compute/v2.1/servers/3e62615f-3b86-48ab-afc3-d09c1a8788a6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:09.346769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:09.349308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:09.367269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.369422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.371553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.372451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.375258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.375740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.404095 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] HTTP exception thrown: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Request method failure captured: Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e HTTP/1.1 Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMYuTRue_SwQpoQLTUdL7K7vnHlrl00lXgHeFqx2ZM7jfLLmrxbIE4G-w9I5vRxANq1fRoeJHWIYZFccwPzIG1RD6pN2imzhAUIsKGFtKOUNzyFUslaPjZouA21l_KIouE8sDue7WOASizoAxEzw_PlEvRREoO3B10E4ZoCz2p49uA Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:09.407027 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_68a3e4c52bdf488283a305f15f904509"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0078ab28d52b4741aa81a5ee515acc04 Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.408349 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7f02af31-9081-4bdb-bd3c-a8404fe9f13e'} Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:09.409001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.410032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.413836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Returning 404 to user: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:09.416785 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a8a905da-953c-4b33-8ac1-4af5271a18c4 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 404 len: 111 microversion: 2.1 time: 0.074561 Oct 17 15:23:09.417591 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 164/354] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:23:09 2022] DELETE /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:23:09.438873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:09.439630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] [instance: 7f02af31-9081-4bdb-bd3c-a8404fe9f13e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:09.451383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.451892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.452607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.453755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.454268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.454930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.481544 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] HTTP exception thrown: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Request method failure captured: Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e HTTP/1.1 Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMYuTRue_SwQpoQLTUdL7K7vnHlrl00lXgHeFqx2ZM7jfLLmrxbIE4G-w9I5vRxANq1fRoeJHWIYZFccwPzIG1RD6pN2imzhAUIsKGFtKOUNzyFUslaPjZouA21l_KIouE8sDue7WOASizoAxEzw_PlEvRREoO3B10E4ZoCz2p49uA Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:09.483437 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_68a3e4c52bdf488283a305f15f904509"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/68a3e4c52bdf488283a305f15f904509"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 68a3e4c52bdf488283a305f15f904509 Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1746306508 Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0078ab28d52b4741aa81a5ee515acc04 Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1746306508-project Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.484810 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7f02af31-9081-4bdb-bd3c-a8404fe9f13e'} Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:09.485465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. Oct 17 15:23:09.486663 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:09.488296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] Returning 404 to user: Instance 7f02af31-9081-4bdb-bd3c-a8404fe9f13e could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:09.488296 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b675bb95-60bf-4b71-8214-1498e8d49988 tempest-DeleteServersAdminTestJSON-1746306508 tempest-DeleteServersAdminTestJSON-1746306508-project] 10.222.0.87 "GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e" status: 404 len: 111 microversion: 2.1 time: 0.061413 Oct 17 15:23:09.488296 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 165/355] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:09 2022] GET /compute/v2.1/servers/7f02af31-9081-4bdb-bd3c-a8404fe9f13e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:09.501989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:09.515015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:09.532074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.532619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.533037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:09.533837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:09.534302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:09.534760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:10.056172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:10.074491 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d9c262e4-8de6-4b26-b717-1f3558b32b21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1475 microversion: 2.1 time: 0.572345 Oct 17 15:23:10.078849 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 166/356] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:09 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:10.140893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554996a3-bcae-4f5a-9276-56ab995b61b2 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:10.146380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554996a3-bcae-4f5a-9276-56ab995b61b2 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:10.152279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554996a3-bcae-4f5a-9276-56ab995b61b2 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:10.166267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554996a3-bcae-4f5a-9276-56ab995b61b2 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:10.178649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554996a3-bcae-4f5a-9276-56ab995b61b2 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:10.186439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554996a3-bcae-4f5a-9276-56ab995b61b2 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:10.321083 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-554996a3-bcae-4f5a-9276-56ab995b61b2 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/ff8398cfef5f4f3198aee4dacd2a0a66/detail" status: 200 len: 916 microversion: 2.1 time: 1.377462 Oct 17 15:23:10.336571 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 191/357] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:23:08 2022] GET /compute/v2.1/os-quota-sets/ff8398cfef5f4f3198aee4dacd2a0a66/detail => generated 916 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:11.063540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-745ea75e-d054-43d6-b7c2-c652e70d1911 req-fdd4b0e0-d8c0-456b-9b2d-fa6fe60c9d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382fe0d4-2f91-4289-8eea-4619e645a500", "tag": "86a21e24-7531-494a-88d1-d4be7315e896"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:11.087298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-745ea75e-d054-43d6-b7c2-c652e70d1911 req-fdd4b0e0-d8c0-456b-9b2d-fa6fe60c9d40 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:11.098874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-745ea75e-d054-43d6-b7c2-c652e70d1911 req-fdd4b0e0-d8c0-456b-9b2d-fa6fe60c9d40 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:11.099374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-745ea75e-d054-43d6-b7c2-c652e70d1911 req-fdd4b0e0-d8c0-456b-9b2d-fa6fe60c9d40 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:11.143639 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-745ea75e-d054-43d6-b7c2-c652e70d1911 req-fdd4b0e0-d8c0-456b-9b2d-fa6fe60c9d40 service nova] Creating event network-changed:86a21e24-7531-494a-88d1-d4be7315e896 for instance 382fe0d4-2f91-4289-8eea-4619e645a500 on n-h2-854441-12 Oct 17 15:23:11.197133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-745ea75e-d054-43d6-b7c2-c652e70d1911 req-fdd4b0e0-d8c0-456b-9b2d-fa6fe60c9d40 service nova] Instance 382fe0d4-2f91-4289-8eea-4619e645a500 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:23:11.232475 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-745ea75e-d054-43d6-b7c2-c652e70d1911 req-fdd4b0e0-d8c0-456b-9b2d-fa6fe60c9d40 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172719 Oct 17 15:23:11.239380 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 192/358] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:23:11.254922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:11.261143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:11.282257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:11.285449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:11.288769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:11.291415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:11.294642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:11.295273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:11.509356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-810ee9c4-1493-41af-9f7d-6af7ea4cf0b8 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Calling method '.version_select at 0x7f28bf689790>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:11.908786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:11.924106 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67546066-f3af-40d2-be32-e0cc02e5cde5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1475 microversion: 2.1 time: 0.680408 Oct 17 15:23:11.928685 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 193/359] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:11 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1475 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:12.282827 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-810ee9c4-1493-41af-9f7d-6af7ea4cf0b8 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 200 len: 371 microversion: 2.1 time: 1.757099 Oct 17 15:23:12.291511 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 167/360] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 15:23:10 2022] GET /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 371 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:12.302134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf4d6700>, body: {"quota_set": {"ram": "2048"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:12.503348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3422e100-d0fe-46da-a75a-0c6244217cef tempest-AZAdminNegativeTestJSON-1919773912 tempest-AZAdminNegativeTestJSON-1919773912-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:12.508038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3422e100-d0fe-46da-a75a-0c6244217cef tempest-AZAdminNegativeTestJSON-1919773912 tempest-AZAdminNegativeTestJSON-1919773912-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '23533cbf44d442b7a25214584602ec82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7d83aa33fd4b248aac018f1034f17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3422e100-d0fe-46da-a75a-0c6244217cef tempest-AZAdminNegativeTestJSON-1919773912 tempest-AZAdminNegativeTestJSON-1919773912-project] Request method failure captured: Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNcu9iKHl8yXSo-vLzQDG11iMDt23sWTFuK2xWYQX-E4KdkuiHCzrJ-ZzmkP4EjSDGtUoMKeeGUDzFcusTfBpEvLc_rZmFmMW3k0e3vQ35s9UxlkLoEByBwt9WRxUYQHqkYDEgOpi-VTotwBJ8Y77AYk8spjV2yevQUPnbMM3kRrwE Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e7d83aa33fd4b248aac018f1034f17c Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1919773912 Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:23:12.522092 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e7d83aa33fd4b248aac018f1034f17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e7d83aa33fd4b248aac018f1034f17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e7d83aa33fd4b248aac018f1034f17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e7d83aa33fd4b248aac018f1034f17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AZAdminNegativeTestJSON-1919773912 Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e7d83aa33fd4b248aac018f1034f17c Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1919773912 Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AZAdminNegativeTestJSON-1919773912-project Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 23533cbf44d442b7a25214584602ec82 Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AZAdminNegativeTestJSON-1919773912-project Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 15:23:12.525441 n-d-854441-12 devstack@n-api.service[120406]: action_args: {} Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:23:12.526176 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:12.532604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3422e100-d0fe-46da-a75a-0c6244217cef tempest-AZAdminNegativeTestJSON-1919773912 tempest-AZAdminNegativeTestJSON-1919773912-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:12.534954 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3422e100-d0fe-46da-a75a-0c6244217cef tempest-AZAdminNegativeTestJSON-1919773912 tempest-AZAdminNegativeTestJSON-1919773912-project] 10.222.0.87 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.366190 Oct 17 15:23:12.536305 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 194/361] 10.222.0.87 () {58 vars in 1185 bytes} [Mon Oct 17 15:23:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 377 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:12.544256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd114699-8bd7-468d-aba5-a2f7ba27363e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf3e70d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:12.730855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:12.731292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:12.731733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:12.732476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:12.732936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:12.733364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:12.860523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:12.861080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:12.861700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:12.863769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:12.864411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:12.864993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:13.042423 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-103c4f2f-8da6-440d-ac1c-97488584c67a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/ff8398cfef5f4f3198aee4dacd2a0a66?user_id=45e129cd92fb4d84ade381dd67b5c9fd" status: 200 len: 328 microversion: 2.1 time: 0.747656 Oct 17 15:23:13.045603 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 168/362] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:23:12 2022] PUT /compute/v2.1/os-quota-sets/ff8398cfef5f4f3198aee4dacd2a0a66?user_id=45e129cd92fb4d84ade381dd67b5c9fd => generated 328 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:13.057248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:13.060802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:13.075290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:13.078757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:13.079413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:13.083003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:13.085795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:13.087620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:13.458167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:13.538307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd114699-8bd7-468d-aba5-a2f7ba27363e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:13.546152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd114699-8bd7-468d-aba5-a2f7ba27363e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:13.546691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd114699-8bd7-468d-aba5-a2f7ba27363e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:13.549725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd114699-8bd7-468d-aba5-a2f7ba27363e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:13.553049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd114699-8bd7-468d-aba5-a2f7ba27363e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:13.555185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd114699-8bd7-468d-aba5-a2f7ba27363e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:13.754599 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd114699-8bd7-468d-aba5-a2f7ba27363e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 200 len: 328 microversion: 2.1 time: 1.217889 Oct 17 15:23:13.763401 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 195/363] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:23:12 2022] PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 328 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:13.768286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2c4c859-6a18-472b-bac9-98ea4887a1cc tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Calling method '.version_select at 0x7f28bf3a4a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:14.084621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:14.121442 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c03aebc6-3aea-4386-9d42-ee5cd465cf1e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1475 microversion: 2.1 time: 1.073095 Oct 17 15:23:14.126612 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 169/364] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:13 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1475 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:14.483317 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2c4c859-6a18-472b-bac9-98ea4887a1cc tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/ff8398cfef5f4f3198aee4dacd2a0a66?user_id=45e129cd92fb4d84ade381dd67b5c9fd" status: 200 len: 370 microversion: 2.1 time: 0.718684 Oct 17 15:23:14.487701 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 196/365] 10.222.0.87 () {58 vars in 1323 bytes} [Mon Oct 17 15:23:13 2022] GET /compute/v2.1/os-quota-sets/ff8398cfef5f4f3198aee4dacd2a0a66?user_id=45e129cd92fb4d84ade381dd67b5c9fd => generated 370 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:14.722845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-293258ee-4b9c-4a77-9732-89c2f5fe9d0f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Calling method '.version_select at 0x7f28bf4d8700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:14.764709 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-293258ee-4b9c-4a77-9732-89c2f5fe9d0f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] HTTP exception thrown: Image not found. Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-293258ee-4b9c-4a77-9732-89c2f5fe9d0f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Request method failure captured: Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/568480e1-90bb-4be8-85c8-f51efcf1dc22/metadata/os_distro HTTP/1.1 Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNhcIb1DA_Ek7gtBGOVfL61Z1j2L66wpFKLE5pxIlRu_q9B_lkFJ3BOC-UiaJBITNRPz2ZCi1B82TL3-6NTJodVIFp1wMURQiyrg4BoNpFc8ZaK_hlTYncYW3YscZe2eC1-Irv5AmLq6I8cu8L4lu_kANgriacV332N8VyJG4ROUXw Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:14.783918 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1593b481a85242359876c8b39307c2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1593b481a85242359876c8b39307c2d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b421c2c1b76e40c7b35015fd4f4fade0 Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'image_id': '568480e1-90bb-4be8-85c8-f51efcf1dc22', 'id': 'os_distro'} Oct 17 15:23:14.785183 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:14.785932 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 568480e1-90bb-4be8-85c8-f51efcf1dc22 Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:14.786972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 568480e1-90bb-4be8-85c8-f51efcf1dc22 could not be found. Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:23:14.788022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.789018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-293258ee-4b9c-4a77-9732-89c2f5fe9d0f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:14.789984 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-293258ee-4b9c-4a77-9732-89c2f5fe9d0f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] 10.222.0.87 "DELETE /compute/v2.1/images/568480e1-90bb-4be8-85c8-f51efcf1dc22/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.657881 Oct 17 15:23:14.789984 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 170/366] 10.222.0.87 () {58 vars in 1293 bytes} [Mon Oct 17 15:23:14 2022] DELETE /compute/v2.1/images/568480e1-90bb-4be8-85c8-f51efcf1dc22/metadata/os_distro => generated 62 bytes in 660 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:23:14.806775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f4c97a08-d645-4191-b447-0878735db74f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Calling method '.version_select at 0x7f28bf57fe50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:14.851273 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-f4c97a08-d645-4191-b447-0878735db74f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] HTTP exception thrown: Image not found. Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f4c97a08-d645-4191-b447-0878735db74f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Request method failure captured: Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/images/ccaa7cd8-ab43-4e98-808e-7a243785f2c0/metadata/os_version HTTP/1.1 Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNhcIb1DA_Ek7gtBGOVfL61Z1j2L66wpFKLE5pxIlRu_q9B_lkFJ3BOC-UiaJBITNRPz2ZCi1B82TL3-6NTJodVIFp1wMURQiyrg4BoNpFc8ZaK_hlTYncYW3YscZe2eC1-Irv5AmLq6I8cu8L4lu_kANgriacV332N8VyJG4ROUXw Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:14.853766 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1593b481a85242359876c8b39307c2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1593b481a85242359876c8b39307c2d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b421c2c1b76e40c7b35015fd4f4fade0 Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'image_id': 'ccaa7cd8-ab43-4e98-808e-7a243785f2c0', 'id': 'os_version'} Oct 17 15:23:14.855439 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:14.856263 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ccaa7cd8-ab43-4e98-808e-7a243785f2c0 Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:14.857430 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ccaa7cd8-ab43-4e98-808e-7a243785f2c0 could not be found. Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:23:14.859301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:23:14.861429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.866198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f4c97a08-d645-4191-b447-0878735db74f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:14.867404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f4c97a08-d645-4191-b447-0878735db74f tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] 10.222.0.87 "GET /compute/v2.1/images/ccaa7cd8-ab43-4e98-808e-7a243785f2c0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.074043 Oct 17 15:23:14.869342 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 171/367] 10.222.0.87 () {58 vars in 1293 bytes} [Mon Oct 17 15:23:14 2022] GET /compute/v2.1/images/ccaa7cd8-ab43-4e98-808e-7a243785f2c0/metadata/os_version => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:23:14.884001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79ca3f68-a82c-4ea3-ae3d-769fd998cc42 tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Calling method '.version_select at 0x7f28bf4d8670>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:14.922437 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-79ca3f68-a82c-4ea3-ae3d-769fd998cc42 tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] HTTP exception thrown: Image not found. Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79ca3f68-a82c-4ea3-ae3d-769fd998cc42 tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Request method failure captured: Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/images/829535a4-c07f-4975-8971-c8b4899c3763/metadata HTTP/1.1 Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNhcIb1DA_Ek7gtBGOVfL61Z1j2L66wpFKLE5pxIlRu_q9B_lkFJ3BOC-UiaJBITNRPz2ZCi1B82TL3-6NTJodVIFp1wMURQiyrg4BoNpFc8ZaK_hlTYncYW3YscZe2eC1-Irv5AmLq6I8cu8L4lu_kANgriacV332N8VyJG4ROUXw Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:14.924822 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1593b481a85242359876c8b39307c2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1593b481a85242359876c8b39307c2d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b421c2c1b76e40c7b35015fd4f4fade0 Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'image_id': '829535a4-c07f-4975-8971-c8b4899c3763'} Oct 17 15:23:14.926037 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:14.926752 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 829535a4-c07f-4975-8971-c8b4899c3763 Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:14.927647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 829535a4-c07f-4975-8971-c8b4899c3763 could not be found. Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:23:14.928668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:23:14.929786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:14.933715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79ca3f68-a82c-4ea3-ae3d-769fd998cc42 tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:14.936058 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-79ca3f68-a82c-4ea3-ae3d-769fd998cc42 tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] 10.222.0.87 "GET /compute/v2.1/images/829535a4-c07f-4975-8971-c8b4899c3763/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058753 Oct 17 15:23:14.938876 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 172/368] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:23:14 2022] GET /compute/v2.1/images/829535a4-c07f-4975-8971-c8b4899c3763/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:23:14.950104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0a8acd3-75af-4381-b853-63e9be7a507c tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Action: 'update_all', calling method: .version_select at 0x7f28bf4d89d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:14.997303 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-c0a8acd3-75af-4381-b853-63e9be7a507c tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] HTTP exception thrown: Image not found. Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0a8acd3-75af-4381-b853-63e9be7a507c tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Request method failure captured: Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: request: PUT /compute/v2.1/images/d5aa3fb9-767c-4929-8039-f27b7b958796/metadata HTTP/1.1 Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 57 Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNhcIb1DA_Ek7gtBGOVfL61Z1j2L66wpFKLE5pxIlRu_q9B_lkFJ3BOC-UiaJBITNRPz2ZCi1B82TL3-6NTJodVIFp1wMURQiyrg4BoNpFc8ZaK_hlTYncYW3YscZe2eC1-Irv5AmLq6I8cu8L4lu_kANgriacV332N8VyJG4ROUXw Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:15.000565 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1593b481a85242359876c8b39307c2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1593b481a85242359876c8b39307c2d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b421c2c1b76e40c7b35015fd4f4fade0 Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:23:15.001719 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'image_id': 'd5aa3fb9-767c-4929-8039-f27b7b958796', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:15.002409 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d5aa3fb9-767c-4929-8039-f27b7b958796 Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:15.003376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d5aa3fb9-767c-4929-8039-f27b7b958796 could not be found. Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:15.004426 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:23:15.005384 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.009545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0a8acd3-75af-4381-b853-63e9be7a507c tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:15.012905 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c0a8acd3-75af-4381-b853-63e9be7a507c tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] 10.222.0.87 "PUT /compute/v2.1/images/d5aa3fb9-767c-4929-8039-f27b7b958796/metadata" status: 404 len: 62 microversion: 2.1 time: 0.066911 Oct 17 15:23:15.015199 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 173/369] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:23:14 2022] PUT /compute/v2.1/images/d5aa3fb9-767c-4929-8039-f27b7b958796/metadata => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 15:23:15.029701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2dd7e54d-968b-4248-b26d-4e5b9a332bcd tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Action: 'update', calling method: .version_select at 0x7f28bf57f160>, body: {"meta": {"os_distro": "alt"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:15.076759 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-2dd7e54d-968b-4248-b26d-4e5b9a332bcd tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] HTTP exception thrown: Image not found. Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2dd7e54d-968b-4248-b26d-4e5b9a332bcd tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Request method failure captured: Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: request: PUT /compute/v2.1/images/ac239544-a50a-4500-b18c-816f75dc63c4/metadata/os_distro HTTP/1.1 Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 30 Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNhcIb1DA_Ek7gtBGOVfL61Z1j2L66wpFKLE5pxIlRu_q9B_lkFJ3BOC-UiaJBITNRPz2ZCi1B82TL3-6NTJodVIFp1wMURQiyrg4BoNpFc8ZaK_hlTYncYW3YscZe2eC1-Irv5AmLq6I8cu8L4lu_kANgriacV332N8VyJG4ROUXw Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:15.084620 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1593b481a85242359876c8b39307c2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1593b481a85242359876c8b39307c2d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b421c2c1b76e40c7b35015fd4f4fade0 Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: {"meta": {"os_distro": "alt"}} Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:23:15.086235 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'image_id': 'ac239544-a50a-4500-b18c-816f75dc63c4', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:15.087078 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ac239544-a50a-4500-b18c-816f75dc63c4 Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:15.088024 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac239544-a50a-4500-b18c-816f75dc63c4 could not be found. Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:15.089196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:23:15.092203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.095799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2dd7e54d-968b-4248-b26d-4e5b9a332bcd tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:15.096945 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2dd7e54d-968b-4248-b26d-4e5b9a332bcd tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] 10.222.0.87 "PUT /compute/v2.1/images/ac239544-a50a-4500-b18c-816f75dc63c4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.075464 Oct 17 15:23:15.100561 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 174/370] 10.222.0.87 () {60 vars in 1310 bytes} [Mon Oct 17 15:23:15 2022] PUT /compute/v2.1/images/ac239544-a50a-4500-b18c-816f75dc63c4/metadata/os_distro => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:23:15.129108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c7a92e1-6dac-4a69-b785-a54f9218985a tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Action: 'create', calling method: .version_select at 0x7f28bf57f670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:15.189805 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-7c7a92e1-6dac-4a69-b785-a54f9218985a tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] HTTP exception thrown: Image not found. Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c7a92e1-6dac-4a69-b785-a54f9218985a tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Request method failure captured: Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/images/0f57071e-410d-43c7-a34b-1a4bbe84b327/metadata HTTP/1.1 Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 57 Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNhcIb1DA_Ek7gtBGOVfL61Z1j2L66wpFKLE5pxIlRu_q9B_lkFJ3BOC-UiaJBITNRPz2ZCi1B82TL3-6NTJodVIFp1wMURQiyrg4BoNpFc8ZaK_hlTYncYW3YscZe2eC1-Irv5AmLq6I8cu8L4lu_kANgriacV332N8VyJG4ROUXw Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:15.192645 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1593b481a85242359876c8b39307c2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1593b481a85242359876c8b39307c2d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1593b481a85242359876c8b39307c2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1593b481a85242359876c8b39307c2d3 Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291 Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b421c2c1b76e40c7b35015fd4f4fade0 Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2099091291-project Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:23:15.193872 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'image_id': '0f57071e-410d-43c7-a34b-1a4bbe84b327', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:15.194648 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0f57071e-410d-43c7-a34b-1a4bbe84b327 Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:23:15.195583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f57071e-410d-43c7-a34b-1a4bbe84b327 could not be found. Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:15.196659 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:23:15.198145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:15.205578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c7a92e1-6dac-4a69-b785-a54f9218985a tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:15.206751 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c7a92e1-6dac-4a69-b785-a54f9218985a tempest-ImagesMetadataNegativeTestJSON-2099091291 tempest-ImagesMetadataNegativeTestJSON-2099091291-project] 10.222.0.87 "POST /compute/v2.1/images/0f57071e-410d-43c7-a34b-1a4bbe84b327/metadata" status: 404 len: 62 microversion: 2.1 time: 0.082663 Oct 17 15:23:15.209983 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 175/371] 10.222.0.87 () {60 vars in 1281 bytes} [Mon Oct 17 15:23:15 2022] POST /compute/v2.1/images/0f57071e-410d-43c7-a34b-1a4bbe84b327/metadata => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:23:15.224837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:15.227865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:15.240925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:15.245282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:15.246043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:15.247807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:15.248578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:15.249233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:15.343898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1561955883", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:15.470312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:23:15.727257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:15.740247 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-655bc9cf-ff84-4cf7-94ea-69caa4093f14 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1470 microversion: 2.1 time: 0.525521 Oct 17 15:23:15.754071 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 176/372] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:15 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1470 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:15.759650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-997d4618-22a4-42ce-ba9a-17ad47b54004 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Calling method '.version_select at 0x7f28bf4d6c10>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:16.297264 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-997d4618-22a4-42ce-ba9a-17ad47b54004 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/918a0ca4ede040a583792140b16ebc50/defaults" status: 200 len: 371 microversion: 2.1 time: 0.541448 Oct 17 15:23:16.306125 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 177/373] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:23:15 2022] GET /compute/v2.1/os-quota-sets/918a0ca4ede040a583792140b16ebc50/defaults => generated 371 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:16.311722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-596848bf-9e12-43cb-a7ec-05c0c2eea359 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:16.312594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-596848bf-9e12-43cb-a7ec-05c0c2eea359 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:16.319633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-596848bf-9e12-43cb-a7ec-05c0c2eea359 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:16.320473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-596848bf-9e12-43cb-a7ec-05c0c2eea359 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:16.321165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-596848bf-9e12-43cb-a7ec-05c0c2eea359 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:16.322114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-596848bf-9e12-43cb-a7ec-05c0c2eea359 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:16.322999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-596848bf-9e12-43cb-a7ec-05c0c2eea359 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:16.323713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-596848bf-9e12-43cb-a7ec-05c0c2eea359 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:16.421033 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-596848bf-9e12-43cb-a7ec-05c0c2eea359 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500/action" status: 204 len: 0 microversion: 2.1 time: 0.106477 Oct 17 15:23:16.422192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 178/374] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:23:16 2022] POST /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500/action => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:23:16.430168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-87f29164-d26e-413c-8323-5f4a8fcca590 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf485d30>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:16.842571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f29164-d26e-413c-8323-5f4a8fcca590 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:16.847358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:16.848626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:16.849274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:16.849838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:16.850416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:16.855527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f29164-d26e-413c-8323-5f4a8fcca590 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:16.856691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f29164-d26e-413c-8323-5f4a8fcca590 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:16.859387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f29164-d26e-413c-8323-5f4a8fcca590 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:16.862281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f29164-d26e-413c-8323-5f4a8fcca590 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:16.862942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f29164-d26e-413c-8323-5f4a8fcca590 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:16.871364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:16.873664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:16.874399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:16.877194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:16.878974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:16.879360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:17.006969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Getting quotas for project b1fa6409de074f4fbdcf42b678021af3. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:17.024218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Getting quotas for user 146966e6e562449d9996d6773edd748b and project b1fa6409de074f4fbdcf42b678021af3. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:17.052615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:17.091727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.utils [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] cores quota exceeded for b1fa6409de074f4fbdcf42b678021af3, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120406) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 15:23:17.092583 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Request method failure captured: Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 145 Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNb69pbMMtXzuR6j7JM1TK5H2nEmd9U9ovqD11dn_2B1kcQNu3OTX_SSa65h4KHXVTa-CF1NJGDcayY2pP73umxVpE_L5Qbbpb2jrnZCxue-BTYhmBkUmGy9DRZoVaQhTbfiyErQ6pwxjPiY1FmanHTkiDBTzHhxoIwyGRxoqeiXo0 Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b1fa6409de074f4fbdcf42b678021af3 Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:23:17.116194 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b1fa6409de074f4fbdcf42b678021af3 Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-QuotasAdminNegativeTest-1343918722-project Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 146966e6e562449d9996d6773edd748b Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-QuotasAdminNegativeTest-1343918722-project Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1561955883", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} Oct 17 15:23:17.117695 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1561955883', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452'}}} Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 15:23:17.118606 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:17.120428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:17.123318 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:17.127088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:17.127088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:17.127088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:17.127088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:17.127088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 15:23:17.127088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:17.132221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:17.133475 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1eedbaba-106c-413c-b93c-f85fdb6d08b9 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.644425 Oct 17 15:23:17.142365 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 197/375] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:14 2022] POST /compute/v2.1/servers => generated 111 bytes in 2654 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:17.154790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:17.156333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:17.168561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:17.169355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:17.169956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:17.171874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:17.172699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:17.173593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:17.445658 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-87f29164-d26e-413c-8323-5f4a8fcca590 tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/918a0ca4ede040a583792140b16ebc50" status: 200 len: 329 microversion: 2.1 time: 1.021110 Oct 17 15:23:17.455140 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 179/376] 10.222.0.87 () {60 vars in 1263 bytes} [Mon Oct 17 15:23:16 2022] PUT /compute/v2.1/os-quota-sets/918a0ca4ede040a583792140b16ebc50 => generated 329 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:17.461521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8fb2da3e-e166-4dbf-aa25-bd72b960707f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf463280>, body: {"quota_set": {"cores": 20}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:17.809387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:17.828774 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5940d0af-956c-409b-8e52-e3de4ad89c38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1470 microversion: 2.1 time: 0.681753 Oct 17 15:23:17.831585 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 198/377] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:17 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1470 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:17.849939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15b66030-2290-47cd-98b7-b31693eb711a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf3a0280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:18.133566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fb2da3e-e166-4dbf-aa25-bd72b960707f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:18.134054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fb2da3e-e166-4dbf-aa25-bd72b960707f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:18.134547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fb2da3e-e166-4dbf-aa25-bd72b960707f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:18.143237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fb2da3e-e166-4dbf-aa25-bd72b960707f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:18.143873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fb2da3e-e166-4dbf-aa25-bd72b960707f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:18.144389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fb2da3e-e166-4dbf-aa25-bd72b960707f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:18.272053 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8fb2da3e-e166-4dbf-aa25-bd72b960707f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 200 len: 329 microversion: 2.1 time: 0.819549 Oct 17 15:23:18.273007 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 180/378] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:23:17 2022] PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 329 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:18.290596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c907e774-ebe4-414a-9e1c-e070abd516a5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Calling method '.version_select at 0x7f28bf657550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:18.690565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15b66030-2290-47cd-98b7-b31693eb711a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:18.691080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15b66030-2290-47cd-98b7-b31693eb711a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:18.691511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15b66030-2290-47cd-98b7-b31693eb711a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:18.692267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15b66030-2290-47cd-98b7-b31693eb711a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:18.692714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15b66030-2290-47cd-98b7-b31693eb711a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:18.702552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15b66030-2290-47cd-98b7-b31693eb711a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:19.338240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=15,nova_api:UPDATE=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:19.349790 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15b66030-2290-47cd-98b7-b31693eb711a tempest-QuotasAdminTestJSON-793982851 tempest-QuotasAdminTestJSON-793982851-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/918a0ca4ede040a583792140b16ebc50" status: 200 len: 329 microversion: 2.1 time: 1.513031 Oct 17 15:23:19.360326 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 199/379] 10.222.0.87 () {60 vars in 1263 bytes} [Mon Oct 17 15:23:17 2022] PUT /compute/v2.1/os-quota-sets/918a0ca4ede040a583792140b16ebc50 => generated 329 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:19.371098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:19.373008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:19.404411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:19.404949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:19.405399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:19.406141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:19.406625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:19.407057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:19.499896 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c907e774-ebe4-414a-9e1c-e070abd516a5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 200 len: 371 microversion: 2.1 time: 1.217491 Oct 17 15:23:19.508204 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 181/380] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 15:23:18 2022] GET /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 371 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:23:19.518763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d12e193-cb1a-48d8-be76-8b08e82b94e5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf45c0d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:19.525909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:19.861399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:19.869565 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e6a5055-c40f-4db1-861c-484a66188eca tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1462 microversion: 2.1 time: 0.508878 Oct 17 15:23:19.882827 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 200/381] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:19 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1462 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:19.900062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-420b27c5-b0e9-406f-9efe-c9d598a9fb5c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:19.900741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-420b27c5-b0e9-406f-9efe-c9d598a9fb5c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:19.908162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-420b27c5-b0e9-406f-9efe-c9d598a9fb5c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:19.908659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-420b27c5-b0e9-406f-9efe-c9d598a9fb5c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:19.909119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-420b27c5-b0e9-406f-9efe-c9d598a9fb5c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:19.909818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-420b27c5-b0e9-406f-9efe-c9d598a9fb5c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:19.910264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-420b27c5-b0e9-406f-9efe-c9d598a9fb5c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:19.910716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-420b27c5-b0e9-406f-9efe-c9d598a9fb5c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:20.560856 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-420b27c5-b0e9-406f-9efe-c9d598a9fb5c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1615 microversion: 2.1 time: 0.667675 Oct 17 15:23:20.574942 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 201/382] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:19 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1615 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:20.576439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0a816c09-925f-4fcb-a1ee-ff947b3c4389 req-80a22864-5aec-4b83-8f9b-3bd26b5b217d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382fe0d4-2f91-4289-8eea-4619e645a500", "name": "network-vif-plugged", "status": "completed", "tag": "86a21e24-7531-494a-88d1-d4be7315e896"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:20.628533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0a816c09-925f-4fcb-a1ee-ff947b3c4389 req-80a22864-5aec-4b83-8f9b-3bd26b5b217d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:20.641531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0a816c09-925f-4fcb-a1ee-ff947b3c4389 req-80a22864-5aec-4b83-8f9b-3bd26b5b217d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:20.645890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d12e193-cb1a-48d8-be76-8b08e82b94e5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:20.647805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0a816c09-925f-4fcb-a1ee-ff947b3c4389 req-80a22864-5aec-4b83-8f9b-3bd26b5b217d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:20.655233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d12e193-cb1a-48d8-be76-8b08e82b94e5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:20.655850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d12e193-cb1a-48d8-be76-8b08e82b94e5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:20.665279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d12e193-cb1a-48d8-be76-8b08e82b94e5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:20.670820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d12e193-cb1a-48d8-be76-8b08e82b94e5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:20.679299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d12e193-cb1a-48d8-be76-8b08e82b94e5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:20.717360 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0a816c09-925f-4fcb-a1ee-ff947b3c4389 req-80a22864-5aec-4b83-8f9b-3bd26b5b217d service nova] Creating event network-vif-plugged:86a21e24-7531-494a-88d1-d4be7315e896 for instance 382fe0d4-2f91-4289-8eea-4619e645a500 on n-h2-854441-12 Oct 17 15:23:20.737568 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0a816c09-925f-4fcb-a1ee-ff947b3c4389 req-80a22864-5aec-4b83-8f9b-3bd26b5b217d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171856 Oct 17 15:23:20.743901 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 202/383] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:20.763866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91bcb380-c51a-41eb-ba40-85fa555e95c6 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '.version_select at 0x7f28bf3e7d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:20.782344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91bcb380-c51a-41eb-ba40-85fa555e95c6 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:20.782904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91bcb380-c51a-41eb-ba40-85fa555e95c6 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:20.783352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91bcb380-c51a-41eb-ba40-85fa555e95c6 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:20.834948 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91bcb380-c51a-41eb-ba40-85fa555e95c6 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.089535 Oct 17 15:23:20.835590 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 203/384] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:23:20 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:20.905358 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d12e193-cb1a-48d8-be76-8b08e82b94e5 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 200 len: 328 microversion: 2.1 time: 1.395626 Oct 17 15:23:20.906258 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 182/385] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:23:19 2022] PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 328 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:21.305341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-16088883", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:21.305620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1366587548", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:21.448991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:23:21.466676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:23:22.293500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:22.294051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:22.294810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:22.295168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:22.295578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:22.307731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=77 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:22.315856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:22.316603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:22.317180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:22.318143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:22.325878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:22.326486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:22.373664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:22.383489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for user 5ec3b5fbeafd47558718a7a9638d0c9e and project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:22.413650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:23:22.436160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:23:22.531202 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-03e815e2-9219-444e-98e9-0cf47f0ffca4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230079 Oct 17 15:23:22.539884 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 183/386] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:23:22.725521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:22.725521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:22.726352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:22.726352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:22.728640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:22.750611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=91 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:22.753464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:22.754662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:22.757763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:22.758848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:22.759494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:22.761419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:22.812998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Getting quotas for project b1fa6409de074f4fbdcf42b678021af3. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:22.822466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Getting quotas for user 146966e6e562449d9996d6773edd748b and project b1fa6409de074f4fbdcf42b678021af3. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:22.867566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.utils [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] instances quota exceeded for b1fa6409de074f4fbdcf42b678021af3, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120406) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 15:23:22.868116 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Request method failure captured: Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 145 Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNb69pbMMtXzuR6j7JM1TK5H2nEmd9U9ovqD11dn_2B1kcQNu3OTX_SSa65h4KHXVTa-CF1NJGDcayY2pP73umxVpE_L5Qbbpb2jrnZCxue-BTYhmBkUmGy9DRZoVaQhTbfiyErQ6pwxjPiY1FmanHTkiDBTzHhxoIwyGRxoqeiXo0 Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b1fa6409de074f4fbdcf42b678021af3 Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:23:22.870266 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b1fa6409de074f4fbdcf42b678021af3 Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-QuotasAdminNegativeTest-1343918722-project Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 146966e6e562449d9996d6773edd748b Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-QuotasAdminNegativeTest-1343918722-project Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1366587548", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} Oct 17 15:23:22.871713 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1366587548', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452'}}} Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 15:23:22.872360 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:22.873305 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:22.874394 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:22.875567 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:22.875567 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:22.875567 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:22.875567 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:22.875567 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 15:23:22.875567 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:22.887654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:22.888555 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-185f1510-d71b-4c49-a8cc-4e9319891d89 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.587971 Oct 17 15:23:22.892680 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 204/387] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:21 2022] POST /compute/v2.1/servers => generated 119 bytes in 1593 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:22.897639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d118b1f8-6b7c-4c13-aa67-8ee933a7fa72 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:22.898378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d118b1f8-6b7c-4c13-aa67-8ee933a7fa72 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:23.009903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-76d0032c-6d44-4621-ad2b-720a99e98d71 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1887988696", "id": 1296642438, "os-flavor-access:is_public": "False"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:23.095855 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-76d0032c-6d44-4621-ad2b-720a99e98d71 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.554334 Oct 17 15:23:23.106760 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 184/388] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:22 2022] POST /compute/v2.1/flavors => generated 431 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:23.113155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-33049957-b750-4083-8e87-1af14cd36e7d tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf40b310>, body: {"quota_set": {"instances": 10}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:23.115219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d118b1f8-6b7c-4c13-aa67-8ee933a7fa72 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:23.127540 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d118b1f8-6b7c-4c13-aa67-8ee933a7fa72 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1211 microversion: 2.1 time: 0.233699 Oct 17 15:23:23.134422 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 205/389] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:22 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1211 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:23.153291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40f62595-5768-417d-b21d-6f9e83a31f9e tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "95b3d3e0cff44645ad6a7906be44b7df"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:23.753076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33049957-b750-4083-8e87-1af14cd36e7d tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:23.754893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33049957-b750-4083-8e87-1af14cd36e7d tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:23.758391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33049957-b750-4083-8e87-1af14cd36e7d tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:23.759439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33049957-b750-4083-8e87-1af14cd36e7d tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:23.760168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33049957-b750-4083-8e87-1af14cd36e7d tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:23.763053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33049957-b750-4083-8e87-1af14cd36e7d tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:23.846569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=20,nova_api:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:23.853009 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-33049957-b750-4083-8e87-1af14cd36e7d tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 200 len: 329 microversion: 2.1 time: 0.743893 Oct 17 15:23:23.854885 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 185/390] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:23:23 2022] PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 329 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:23.869141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73105970-f215-4875-ae5c-8602e52c9c42 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Calling method '.version_select at 0x7f28bf45caf0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:23.983913 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40f62595-5768-417d-b21d-6f9e83a31f9e tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/1296642438/action" status: 200 len: 97 microversion: 2.1 time: 0.845834 Oct 17 15:23:23.987316 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 206/391] 10.222.0.87 () {60 vars in 1200 bytes} [Mon Oct 17 15:23:23 2022] POST /compute/v2.1/flavors/1296642438/action => generated 97 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:24.444901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a94e220a-90b5-4a5f-934b-b77b5daf3f95 tempest-FlavorsAccessTestJSON-46299876 tempest-FlavorsAccessTestJSON-46299876-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:24.486108 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a94e220a-90b5-4a5f-934b-b77b5daf3f95 tempest-FlavorsAccessTestJSON-46299876 tempest-FlavorsAccessTestJSON-46299876-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.495226 Oct 17 15:23:24.505187 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 207/392] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:23 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:24.536189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:24.541063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:24.571310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:24.572774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:24.573808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:24.575461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:24.579109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:24.580213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:24.767306 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-73105970-f215-4875-ae5c-8602e52c9c42 tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 200 len: 371 microversion: 2.1 time: 0.901961 Oct 17 15:23:24.782932 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 186/393] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 15:23:23 2022] GET /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 371 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:24.865499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:24.894418 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc1dcc65-2405-438f-a487-3f6fa04414f7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1263 microversion: 2.1 time: 0.368851 Oct 17 15:23:24.915415 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 208/394] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:24 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1263 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:24.941790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61342637-9bda-4858-b384-38ee5a784f26 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "95b3d3e0cff44645ad6a7906be44b7df"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:25.059590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7a0ce16e-76bc-4f94-b516-459d1b91276a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:25.083862 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7a0ce16e-76bc-4f94-b516-459d1b91276a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.295549 Oct 17 15:23:25.084831 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 187/395] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:23:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:25.324702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57540066-0517-4946-b9b8-24fb62aa1668 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-922805732", "id": 704811315, "os-flavor-access:is_public": "False"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:25.338238 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61342637-9bda-4858-b384-38ee5a784f26 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/1296642438/action" status: 200 len: 21 microversion: 2.1 time: 0.420202 Oct 17 15:23:25.352388 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 209/396] 10.222.0.87 () {60 vars in 1200 bytes} [Mon Oct 17 15:23:24 2022] POST /compute/v2.1/flavors/1296642438/action => generated 21 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:25.365472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae8d179c-ce78-470b-b94d-a61a40fc118e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf4c2ca0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:25.368459 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57540066-0517-4946-b9b8-24fb62aa1668 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.282518 Oct 17 15:23:25.369190 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 188/397] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:25 2022] POST /compute/v2.1/flavors => generated 435 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:25.467997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fcad17b2-0437-4e3b-b229-ecc26372d6a3 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-797524306", "id": 1007262630, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:25.504953 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fcad17b2-0437-4e3b-b229-ecc26372d6a3 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.126001 Oct 17 15:23:25.505621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 189/398] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:25 2022] POST /compute/v2.1/flavors => generated 424 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:25.516302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cee406b9-0a2a-47da-a98f-65860f7d5cbc tempest-FlavorsAccessTestJSON-46299876 tempest-FlavorsAccessTestJSON-46299876-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:25.588971 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cee406b9-0a2a-47da-a98f-65860f7d5cbc tempest-FlavorsAccessTestJSON-46299876 tempest-FlavorsAccessTestJSON-46299876-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.080814 Oct 17 15:23:25.589607 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 190/399] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:25 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:25.602406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-807865f0-b57f-45a4-bb74-91cf87aad015 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:25.615694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae8d179c-ce78-470b-b94d-a61a40fc118e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:25.617153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae8d179c-ce78-470b-b94d-a61a40fc118e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:25.618310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae8d179c-ce78-470b-b94d-a61a40fc118e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:25.620112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae8d179c-ce78-470b-b94d-a61a40fc118e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:25.642804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae8d179c-ce78-470b-b94d-a61a40fc118e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:25.644582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae8d179c-ce78-470b-b94d-a61a40fc118e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:25.753151 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-807865f0-b57f-45a4-bb74-91cf87aad015 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/704811315/action" status: 200 len: 96 microversion: 2.1 time: 0.159453 Oct 17 15:23:25.754293 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 191/400] 10.222.0.87 () {60 vars in 1197 bytes} [Mon Oct 17 15:23:25 2022] POST /compute/v2.1/flavors/704811315/action => generated 96 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:25.759372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04487f3f-ad4e-4a32-b9f0-17316f0e5115 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:25.776175 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-04487f3f-ad4e-4a32-b9f0-17316f0e5115 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019494 Oct 17 15:23:25.777181 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 192/401] 10.222.0.87 () {58 vars in 1182 bytes} [Mon Oct 17 15:23:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:25.787114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-77085b1c-229c-426c-91e2-302abce709ee tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:25.795977 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae8d179c-ce78-470b-b94d-a61a40fc118e tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 200 len: 325 microversion: 2.1 time: 0.440338 Oct 17 15:23:25.810535 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 210/402] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:23:25 2022] PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:25.815989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be29472c-20fd-4dc6-8b00-d74220c285a1 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:25.837487 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-77085b1c-229c-426c-91e2-302abce709ee tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1296642438" status: 202 len: 0 microversion: 2.1 time: 0.058220 Oct 17 15:23:25.841560 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 193/403] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:23:25 2022] DELETE /compute/v2.1/flavors/1296642438 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:23:25.858574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-21e81bd3-a259-4c36-b7ed-9ffcea0e48a4 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-127005427", "id": 1833926121, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:25.908142 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-21e81bd3-a259-4c36-b7ed-9ffcea0e48a4 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.065381 Oct 17 15:23:25.908955 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 194/404] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:25 2022] POST /compute/v2.1/flavors => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:25.926320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ae4ba403-bb99-401d-83db-6027aeefb51b tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:25.977336 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-be29472c-20fd-4dc6-8b00-d74220c285a1 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project 453d81fb7f944ac4b33f156a6228c528 combination. Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be29472c-20fd-4dc6-8b00-d74220c285a1 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Request method failure captured: Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/flavors/704811315/action HTTP/1.1 Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 67 Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNqiPDBEn4GD_yBSplRc3qMoe3XT2o5Nz92zHo-_zaLywa8mzEXGJp_sBY9uf6rWV99jPefnjG45-caGluwQ-7f3evjXpQXeRLb0fRubVpO3o6COErpevgKYpDeNR3o_ogMpZNJFw_dfTIb1SCYAHO8pSZW3jyV_Gaazljn_pWTbq4 Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 06813311d2404b008079b025fed99052 Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1041842256 Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:23:25.983221 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06813311d2404b008079b025fed99052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/06813311d2404b008079b025fed99052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_06813311d2404b008079b025fed99052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06813311d2404b008079b025fed99052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1041842256 Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 06813311d2404b008079b025fed99052 Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1041842256 Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 00e0b26a67054bba8b62e93aec287b8e Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: {"addTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} Oct 17 15:23:25.984740 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: exception: Flavor access already exists for flavor 29 and project 453d81fb7f944ac4b33f156a6228c528 combination. Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '704811315', 'body': {'addTenantAccess': {'tenant': '453d81fb7f944ac4b33f156a6228c528'}}} Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result.read() Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 15:23:25.985800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-453d81fb7f944ac4b33f156a6228c528' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 15:23:25.987075 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 15:23:25.988279 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 15:23:25.989758 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result.read() Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-453d81fb7f944ac4b33f156a6228c528' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 15, 23, 25, 968592), 'updated_at': None, 'flavor_id': 29, 'project_id': '453d81fb7f944ac4b33f156a6228c528'}] Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:25.991408 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project 453d81fb7f944ac4b33f156a6228c528 combination. Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:25.992468 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project 453d81fb7f944ac4b33f156a6228c528 combination. Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:25.995196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:25.996511 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project 453d81fb7f944ac4b33f156a6228c528 combination. Oct 17 15:23:25.996511 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:25.997031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be29472c-20fd-4dc6-8b00-d74220c285a1 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project 453d81fb7f944ac4b33f156a6228c528 combination. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:25.997260 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ae4ba403-bb99-401d-83db-6027aeefb51b tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.084202 Oct 17 15:23:25.998035 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 195/405] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:25 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:26.012697 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be29472c-20fd-4dc6-8b00-d74220c285a1 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/704811315/action" status: 409 len: 152 microversion: 2.1 time: 0.197710 Oct 17 15:23:26.013402 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 211/406] 10.222.0.87 () {60 vars in 1197 bytes} [Mon Oct 17 15:23:25 2022] POST /compute/v2.1/flavors/704811315/action => generated 152 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:23:26.018236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8dcc30a6-9f1a-4284-9351-ee1e382e305c tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:26.021790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:26.022408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:26.030332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:26.030873 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8dcc30a6-9f1a-4284-9351-ee1e382e305c tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030008 Oct 17 15:23:26.031307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:26.031910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:26.033114 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 196/407] 10.222.0.87 () {58 vars in 1182 bytes} [Mon Oct 17 15:23:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:26.042611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:26.043375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:26.044142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:26.045039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d9510f12-a890-4ee6-94f1-68209b5d6d8b tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:26.281159 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d9510f12-a890-4ee6-94f1-68209b5d6d8b tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/704811315/action" status: 200 len: 21 microversion: 2.1 time: 0.246561 Oct 17 15:23:26.281899 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 197/408] 10.222.0.87 () {60 vars in 1197 bytes} [Mon Oct 17 15:23:26 2022] POST /compute/v2.1/flavors/704811315/action => generated 21 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:26.299074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e38ed78-befa-4e40-a47b-be8569ce5394 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1224868669", "id": 1157449332, "os-flavor-access:is_public": "False"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:26.338565 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e38ed78-befa-4e40-a47b-be8569ce5394 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.050313 Oct 17 15:23:26.339161 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 198/409] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:26 2022] POST /compute/v2.1/flavors => generated 431 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:26.354685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4b2d9322-9b52-4454-b54d-a79e7b03c1af tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Action: 'create', calling method: .version_select at 0x7f28bf57f700>, body: {"keypair": {"name": "tempest-keypair-1193477078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwtETDzxre56GqWlx+7v0XaChnXyQ+IGnXxs6nPky7+N5+u+1mbaJuYWMyjGH9qMGLGBXok4oAmPeLVRfUn+cu9KP5vreWHPFU+iItx5ZH0tJ3GExU9ZMmuAvOvKig9ZQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:26.412411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-4b2d9322-9b52-4454-b54d-a79e7b03c1af tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Getting quotas for project 526aebb581ba4845835d901c0475af9f. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:26.447472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-4b2d9322-9b52-4454-b54d-a79e7b03c1af tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Getting quotas for user a31b571ec20642bc8c31ce18fefb962c and project 526aebb581ba4845835d901c0475af9f. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:26.504878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:26.515857 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4b2d9322-9b52-4454-b54d-a79e7b03c1af tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168730 Oct 17 15:23:26.515857 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 199/410] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:23:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:26.524865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9acc76b-5f01-426b-92a9-64719b67caff tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1269 microversion: 2.1 time: 0.506908 Oct 17 15:23:26.538579 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 212/411] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:26 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1269 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:26.538824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-273186103", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:26.550168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c02b86f7-6c77-4062-9aa3-8754e84bd4ec tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:26.594709 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c02b86f7-6c77-4062-9aa3-8754e84bd4ec tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/704811315" status: 202 len: 0 microversion: 2.1 time: 0.067417 Oct 17 15:23:26.596690 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 213/412] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:23:26 2022] DELETE /compute/v2.1/flavors/704811315 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:23:26.605856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ae82aaa-61f5-4e5e-8a5d-ba0370c47b29 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:26.652750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:23:26.653504 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ae82aaa-61f5-4e5e-8a5d-ba0370c47b29 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/1157449332/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.055234 Oct 17 15:23:26.656752 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 214/413] 10.222.0.87 () {58 vars in 1209 bytes} [Mon Oct 17 15:23:26 2022] GET /compute/v2.1/flavors/1157449332/os-flavor-access => generated 21 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:26.672983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ae02133-b6e5-4ef8-ab0a-e475d50f6290 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:26.722340 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ae02133-b6e5-4ef8-ab0a-e475d50f6290 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.049133 Oct 17 15:23:26.723633 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 215/414] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:26 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:26.728679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2934277a-e6a6-4345-af39-cdeb5cb8de5b tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:26.754979 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2934277a-e6a6-4345-af39-cdeb5cb8de5b tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1157449332" status: 202 len: 0 microversion: 2.1 time: 0.028221 Oct 17 15:23:26.755396 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 216/415] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:23:26 2022] DELETE /compute/v2.1/flavors/1157449332 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:23:26.767151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ab0be95-ce92-4e3c-b4cf-f376827d8d2b tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1926855371", "id": 1519581422, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:26.807764 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ab0be95-ce92-4e3c-b4cf-f376827d8d2b tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.049531 Oct 17 15:23:26.809090 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 217/416] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:26 2022] POST /compute/v2.1/flavors => generated 438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:26.825619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72a82c02-af39-460d-8863-951c06ca7176 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:26.856000 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72a82c02-af39-460d-8863-951c06ca7176 tempest-FlavorsAccessTestJSON-1396579946 tempest-FlavorsAccessTestJSON-1396579946-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.1 time: 0.045446 Oct 17 15:23:26.857270 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 218/417] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:26 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:26.862912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30e762fb-b3bc-4914-93cb-0cc0abf81e18 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:26.871267 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-30e762fb-b3bc-4914-93cb-0cc0abf81e18 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30e762fb-b3bc-4914-93cb-0cc0abf81e18 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Request method failure captured: Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/flavors/1519581422/os-flavor-access HTTP/1.1 Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNqiPDBEn4GD_yBSplRc3qMoe3XT2o5Nz92zHo-_zaLywa8mzEXGJp_sBY9uf6rWV99jPefnjG45-caGluwQ-7f3evjXpQXeRLb0fRubVpO3o6COErpevgKYpDeNR3o_ogMpZNJFw_dfTIb1SCYAHO8pSZW3jyV_Gaazljn_pWTbq4 Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 06813311d2404b008079b025fed99052 Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1041842256 Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:23:26.872918 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06813311d2404b008079b025fed99052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/06813311d2404b008079b025fed99052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_06813311d2404b008079b025fed99052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06813311d2404b008079b025fed99052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1041842256 Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 06813311d2404b008079b025fed99052 Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1041842256 Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 00e0b26a67054bba8b62e93aec287b8e Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: exception: Access list not available for public flavors. Oct 17 15:23:26.874349 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'flavor_id': '1519581422'} Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 17 15:23:26.875174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:26.877668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30e762fb-b3bc-4914-93cb-0cc0abf81e18 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:26.878757 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30e762fb-b3bc-4914-93cb-0cc0abf81e18 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/1519581422/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020282 Oct 17 15:23:26.880124 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 219/418] 10.222.0.87 () {58 vars in 1209 bytes} [Mon Oct 17 15:23:26 2022] GET /compute/v2.1/flavors/1519581422/os-flavor-access => generated 91 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:23:26.897597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e7d31a1-b390-481e-938f-bcdb8ca360c0 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:26.928394 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e7d31a1-b390-481e-938f-bcdb8ca360c0 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1519581422" status: 202 len: 0 microversion: 2.1 time: 0.035472 Oct 17 15:23:26.929627 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 220/419] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:23:26 2022] DELETE /compute/v2.1/flavors/1519581422 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:23:26.948087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e6f3d64-21a5-4470-ba33-4b1ecad319e7 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:27.026359 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e6f3d64-21a5-4470-ba33-4b1ecad319e7 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.091629 Oct 17 15:23:27.028577 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 221/420] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:26 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:27.059185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd0bf816-e805-4405-aa49-1f6c8e65bd4d tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-586961662", "id": 1232621803, "os-flavor-access:is_public": "False"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:27.136986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:27.149140 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd0bf816-e805-4405-aa49-1f6c8e65bd4d tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.096802 Oct 17 15:23:27.167859 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 222/421] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:27 2022] POST /compute/v2.1/flavors => generated 438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:27.591843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80b15c6a-69e2-402b-ae8e-b268e3c31787 tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:27.595272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80b15c6a-69e2-402b-ae8e-b268e3c31787 tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fc34d316069047f78897b2f90e0f88c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453d81fb7f944ac4b33f156a6228c528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80b15c6a-69e2-402b-ae8e-b268e3c31787 tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] Request method failure captured: Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/flavors/1232621803/action HTTP/1.1 Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 67 Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNo-rBM5vK6d3EDVSfmOC9w9Lh0nUBt-WFyY0WZeHvRAiihkRHU4mXyJTjz1tLv7nbo4sPRIksTYQZdUyyx5Wq24dlcuZtdoC68JcwNU0g4Oh82djGmz01heySxagHOHq2Kf2wZCuKS9Sc7AzsiNKLDlPXLOeqhr5P9tE4J4OrRGRo Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 453d81fb7f944ac4b33f156a6228c528 Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-90297709 Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:23:27.602141 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/453d81fb7f944ac4b33f156a6228c528"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/453d81fb7f944ac4b33f156a6228c528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_453d81fb7f944ac4b33f156a6228c528"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/453d81fb7f944ac4b33f156a6228c528"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-90297709 Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 453d81fb7f944ac4b33f156a6228c528 Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-90297709 Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsAccessNegativeTestJSON-90297709-project Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: fc34d316069047f78897b2f90e0f88c3 Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-90297709-project Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: {"addTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} Oct 17 15:23:27.603649 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1232621803', 'body': {'addTenantAccess': {'tenant': '453d81fb7f944ac4b33f156a6228c528'}}} Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:23:27.604391 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 15:23:27.605497 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.610435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80b15c6a-69e2-402b-ae8e-b268e3c31787 tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:27.610435 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80b15c6a-69e2-402b-ae8e-b268e3c31787 tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] 10.222.0.87 "POST /compute/v2.1/flavors/1232621803/action" status: 403 len: 130 microversion: 2.1 time: 0.443097 Oct 17 15:23:27.610893 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 223/422] 10.222.0.87 () {60 vars in 1200 bytes} [Mon Oct 17 15:23:27 2022] POST /compute/v2.1/flavors/1232621803/action => generated 130 bytes in 451 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:27.625275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:27.626565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:27.641068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:27.642528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:27.642995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:27.643392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:27.643868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:27.644389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:27.648533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:27.651223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:27.652240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:27.655131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:27.656155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:27.663872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:27.664368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:27.664807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:27.675790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:27.676738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:27.677067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:27.741893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Getting quotas for project b1fa6409de074f4fbdcf42b678021af3. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:27.754098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Getting quotas for user 146966e6e562449d9996d6773edd748b and project b1fa6409de074f4fbdcf42b678021af3. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:27.792845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.utils [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] ram quota exceeded for b1fa6409de074f4fbdcf42b678021af3, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120407) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 15:23:27.800178 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Request method failure captured: Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 144 Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNb69pbMMtXzuR6j7JM1TK5H2nEmd9U9ovqD11dn_2B1kcQNu3OTX_SSa65h4KHXVTa-CF1NJGDcayY2pP73umxVpE_L5Qbbpb2jrnZCxue-BTYhmBkUmGy9DRZoVaQhTbfiyErQ6pwxjPiY1FmanHTkiDBTzHhxoIwyGRxoqeiXo0 Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b1fa6409de074f4fbdcf42b678021af3 Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:27.812355 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b1fa6409de074f4fbdcf42b678021af3 Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-QuotasAdminNegativeTest-1343918722-project Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 146966e6e562449d9996d6773edd748b Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-QuotasAdminNegativeTest-1343918722-project Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-273186103", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} Oct 17 15:23:27.813781 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-273186103', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452'}}} Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 15:23:27.814631 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:27.816818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.819153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:27.821486 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:27.821486 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:27.821486 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:27.821486 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:27.821486 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 15:23:27.821486 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:27.822374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:27.823426 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c2db645-fc72-4d9c-aa2d-c7f6f2328092 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.300869 Oct 17 15:23:27.827079 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 200/423] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:26 2022] POST /compute/v2.1/servers => generated 110 bytes in 1313 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:27.832892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7d97b14f-98f0-4e8b-828e-10f86e2b9283 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:27.892959 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7d97b14f-98f0-4e8b-828e-10f86e2b9283 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1232621803" status: 202 len: 0 microversion: 2.1 time: 0.064553 Oct 17 15:23:27.896994 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 201/424] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:23:27 2022] DELETE /compute/v2.1/flavors/1232621803 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:23:27.903990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-403df8c4-2fa3-48d2-b219-37f451c8a39f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf4d6700>, body: {"quota_set": {"ram": 51200}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:27.936368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:27.947949 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6391915a-072b-4969-aa2b-b10677d4c9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1269 microversion: 2.1 time: 0.334922 Oct 17 15:23:27.949963 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 224/425] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:27 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1269 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:27.966603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9b32a16-abd7-4a74-8a03-f6dea4d5c2cb tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:28.015466 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9b32a16-abd7-4a74-8a03-f6dea4d5c2cb tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.061627 Oct 17 15:23:28.027957 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 225/426] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:27 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:28.044597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9d55922-6727-406a-9c42-5dfd7a37fdd3 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-976684052", "id": 752729423, "os-flavor-access:is_public": "False"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:28.079951 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9d55922-6727-406a-9c42-5dfd7a37fdd3 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.040418 Oct 17 15:23:28.081548 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 226/427] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:28 2022] POST /compute/v2.1/flavors => generated 435 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:28.108291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97180413-88d1-49a4-93bd-c9ee28d3b989 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:28.433829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403df8c4-2fa3-48d2-b219-37f451c8a39f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:28.434404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403df8c4-2fa3-48d2-b219-37f451c8a39f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:28.437652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403df8c4-2fa3-48d2-b219-37f451c8a39f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:28.444370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403df8c4-2fa3-48d2-b219-37f451c8a39f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:28.447019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403df8c4-2fa3-48d2-b219-37f451c8a39f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:28.453281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403df8c4-2fa3-48d2-b219-37f451c8a39f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:28.480167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=20 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:28.631095 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-403df8c4-2fa3-48d2-b219-37f451c8a39f tempest-QuotasAdminNegativeTest-325374287 tempest-QuotasAdminNegativeTest-325374287-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 200 len: 329 microversion: 2.1 time: 0.731731 Oct 17 15:23:28.632485 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 202/428] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:23:27 2022] PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 329 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:28.650016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81f80614-222a-4a5d-b75b-c8018197ded3 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Action: 'update', calling method: .version_select at 0x7f28bf40bee0>, body: {"quota_set": {"ram": 0}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:28.662797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-81f80614-222a-4a5d-b75b-c8018197ded3 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '146966e6e562449d9996d6773edd748b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1fa6409de074f4fbdcf42b678021af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81f80614-222a-4a5d-b75b-c8018197ded3 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Request method failure captured: Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: request: PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 HTTP/1.1 Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 25 Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNb69pbMMtXzuR6j7JM1TK5H2nEmd9U9ovqD11dn_2B1kcQNu3OTX_SSa65h4KHXVTa-CF1NJGDcayY2pP73umxVpE_L5Qbbpb2jrnZCxue-BTYhmBkUmGy9DRZoVaQhTbfiyErQ6pwxjPiY1FmanHTkiDBTzHhxoIwyGRxoqeiXo0 Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b1fa6409de074f4fbdcf42b678021af3 Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:28.665845 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b1fa6409de074f4fbdcf42b678021af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b1fa6409de074f4fbdcf42b678021af3 Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1343918722 Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-QuotasAdminNegativeTest-1343918722-project Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 146966e6e562449d9996d6773edd748b Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-QuotasAdminNegativeTest-1343918722-project Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: {"quota_set": {"ram": 0}} Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 15:23:28.667391 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'b1fa6409de074f4fbdcf42b678021af3', 'body': {'quota_set': {'ram': 0}}} Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:28.668310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:28.669662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:28.670986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:28.670986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:28.670986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:23:28.670986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:23:28.670986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 15:23:28.670986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:28.674609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81f80614-222a-4a5d-b75b-c8018197ded3 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:28.680594 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81f80614-222a-4a5d-b75b-c8018197ded3 tempest-QuotasAdminNegativeTest-1343918722 tempest-QuotasAdminNegativeTest-1343918722-project] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3" status: 403 len: 116 microversion: 2.1 time: 0.032890 Oct 17 15:23:28.684271 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 203/429] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:23:28 2022] PUT /compute/v2.1/os-quota-sets/b1fa6409de074f4fbdcf42b678021af3 => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:28.853396 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97180413-88d1-49a4-93bd-c9ee28d3b989 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/752729423/action" status: 200 len: 96 microversion: 2.1 time: 0.762536 Oct 17 15:23:28.868572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-473a8012-776d-443f-a76f-6fe156d64fee tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:28.873873 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 227/430] 10.222.0.87 () {60 vars in 1197 bytes} [Mon Oct 17 15:23:28 2022] POST /compute/v2.1/flavors/752729423/action => generated 96 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:28.874082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-473a8012-776d-443f-a76f-6fe156d64fee tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fc34d316069047f78897b2f90e0f88c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453d81fb7f944ac4b33f156a6228c528', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-473a8012-776d-443f-a76f-6fe156d64fee tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] Request method failure captured: Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/flavors/752729423/action HTTP/1.1 Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 70 Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNo-rBM5vK6d3EDVSfmOC9w9Lh0nUBt-WFyY0WZeHvRAiihkRHU4mXyJTjz1tLv7nbo4sPRIksTYQZdUyyx5Wq24dlcuZtdoC68JcwNU0g4Oh82djGmz01heySxagHOHq2Kf2wZCuKS9Sc7AzsiNKLDlPXLOeqhr5P9tE4J4OrRGRo Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 453d81fb7f944ac4b33f156a6228c528 Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-90297709 Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:23:28.876874 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/453d81fb7f944ac4b33f156a6228c528"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/453d81fb7f944ac4b33f156a6228c528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_453d81fb7f944ac4b33f156a6228c528"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/453d81fb7f944ac4b33f156a6228c528"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-90297709 Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 453d81fb7f944ac4b33f156a6228c528 Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-90297709 Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FlavorsAccessNegativeTestJSON-90297709-project Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: fc34d316069047f78897b2f90e0f88c3 Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-90297709-project Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: {"removeTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} Oct 17 15:23:28.878458 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '752729423', 'body': {'removeTenantAccess': {'tenant': '453d81fb7f944ac4b33f156a6228c528'}}} Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can( Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:23:28.879596 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 15:23:28.881712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:28.884748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-473a8012-776d-443f-a76f-6fe156d64fee tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:28.884748 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-473a8012-776d-443f-a76f-6fe156d64fee tempest-FlavorsAccessNegativeTestJSON-90297709 tempest-FlavorsAccessNegativeTestJSON-90297709-project] 10.222.0.87 "POST /compute/v2.1/flavors/752729423/action" status: 403 len: 133 microversion: 2.1 time: 0.014979 Oct 17 15:23:28.891457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fb1d4b1-4def-4b68-af77-37a979ff9b2e tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "453d81fb7f944ac4b33f156a6228c528"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:28.891923 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 204/431] 10.222.0.87 () {60 vars in 1197 bytes} [Mon Oct 17 15:23:28 2022] POST /compute/v2.1/flavors/752729423/action => generated 133 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:28.977198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:28.979202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:28.993477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:28.995368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:28.996472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:29.000982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:29.002218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:29.003209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:30.139371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:30.177464 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ae890735-6642-4c86-bb50-5e9013925639 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1311 microversion: 2.1 time: 1.205667 Oct 17 15:23:30.178321 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 205/432] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:28 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1311 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:30.544892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fb1d4b1-4def-4b68-af77-37a979ff9b2e tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/752729423/action" status: 200 len: 21 microversion: 2.1 time: 1.658479 Oct 17 15:23:30.547013 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 228/433] 10.222.0.87 () {60 vars in 1197 bytes} [Mon Oct 17 15:23:28 2022] POST /compute/v2.1/flavors/752729423/action => generated 21 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:30.559085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20b5163d-d02e-4036-867d-f05a4fa85dde tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:30.563175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:30.651501 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20b5163d-d02e-4036-867d-f05a4fa85dde tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/752729423" status: 202 len: 0 microversion: 2.1 time: 0.098000 Oct 17 15:23:30.652917 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 206/434] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:23:30 2022] DELETE /compute/v2.1/flavors/752729423 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:23:30.662939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e86f3282-b7b5-4609-bfc2-942a1c2efeb6 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:30.711692 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e86f3282-b7b5-4609-bfc2-942a1c2efeb6 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.054700 Oct 17 15:23:30.717595 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 229/435] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:30 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:30.740854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd4b51cf-8ff9-460a-8f62-664f0fa0f646 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-270523720", "id": 602798125, "os-flavor-access:is_public": "False"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:30.780806 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dd4b51cf-8ff9-460a-8f62-664f0fa0f646 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.044227 Oct 17 15:23:30.786941 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 207/436] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:30 2022] POST /compute/v2.1/flavors => generated 435 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:30.800755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b229c662-71a1-4df7-a914-d7a91ed9cab2 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "120cfe6f889c4dfcb269b46a43700de3"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:31.211186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:31.212804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:31.224877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:31.225929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:31.227092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:31.229665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:31.230478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:31.232437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:31.602821 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b229c662-71a1-4df7-a914-d7a91ed9cab2 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] HTTP exception thrown: Flavor access not found for 36 / 120cfe6f889c4dfcb269b46a43700de3 combination. Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b229c662-71a1-4df7-a914-d7a91ed9cab2 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Request method failure captured: Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/flavors/602798125/action HTTP/1.1 Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 70 Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNqiPDBEn4GD_yBSplRc3qMoe3XT2o5Nz92zHo-_zaLywa8mzEXGJp_sBY9uf6rWV99jPefnjG45-caGluwQ-7f3evjXpQXeRLb0fRubVpO3o6COErpevgKYpDeNR3o_ogMpZNJFw_dfTIb1SCYAHO8pSZW3jyV_Gaazljn_pWTbq4 Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 06813311d2404b008079b025fed99052 Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1041842256 Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:23:31.607070 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06813311d2404b008079b025fed99052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/06813311d2404b008079b025fed99052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_06813311d2404b008079b025fed99052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06813311d2404b008079b025fed99052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1041842256 Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 06813311d2404b008079b025fed99052 Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1041842256 Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 00e0b26a67054bba8b62e93aec287b8e Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: {"removeTenantAccess": {"tenant": "120cfe6f889c4dfcb269b46a43700de3"}} Oct 17 15:23:31.608632 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: exception: Flavor access not found for 36 / 120cfe6f889c4dfcb269b46a43700de3 combination. Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '602798125', 'body': {'removeTenantAccess': {'tenant': '120cfe6f889c4dfcb269b46a43700de3'}}} Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 17 15:23:31.609666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 120cfe6f889c4dfcb269b46a43700de3 combination. Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 120cfe6f889c4dfcb269b46a43700de3 combination. Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:31.611041 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:31.612421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:31.612421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:31.612421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:31.612421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:31.612421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 120cfe6f889c4dfcb269b46a43700de3 combination. Oct 17 15:23:31.612421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:23:31.617738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b229c662-71a1-4df7-a914-d7a91ed9cab2 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Returning 404 to user: Flavor access not found for 36 / 120cfe6f889c4dfcb269b46a43700de3 combination. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:31.619112 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b229c662-71a1-4df7-a914-d7a91ed9cab2 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/602798125/action" status: 404 len: 124 microversion: 2.1 time: 0.822857 Oct 17 15:23:31.624441 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 230/437] 10.222.0.87 () {60 vars in 1197 bytes} [Mon Oct 17 15:23:30 2022] POST /compute/v2.1/flavors/602798125/action => generated 124 bytes in 825 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:31.994619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:32.015707 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f268dd64-3d1b-442d-8164-d5b76bb9b62c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1311 microversion: 2.1 time: 0.808726 Oct 17 15:23:32.017567 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 208/438] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:31 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1311 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:32.022582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7236682-9cdf-4393-8f4b-bf11cb19ad0d tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:32.114297 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b7236682-9cdf-4393-8f4b-bf11cb19ad0d tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/602798125" status: 202 len: 0 microversion: 2.1 time: 0.095030 Oct 17 15:23:32.116176 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 209/439] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:23:32 2022] DELETE /compute/v2.1/flavors/602798125 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:23:32.129443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5705e86-1387-4102-8c1e-1489d1e709d5 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:32.167069 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5705e86-1387-4102-8c1e-1489d1e709d5 tempest-FlavorsAccessNegativeTestJSON-1041842256 tempest-FlavorsAccessNegativeTestJSON-1041842256-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.044884 Oct 17 15:23:32.168432 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 210/440] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:32 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:32.171788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2075024959", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:32.255201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-25ad6946-441c-4aa8-9efd-c25efe5e9107 req-66813f5b-813e-40f8-9b72-121da01b299c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88c7d5d-8596-4064-b313-10976ecf63fa", "tag": "d40489a8-5c88-4b32-a52a-751ce1cb2d44"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:32.283250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-25ad6946-441c-4aa8-9efd-c25efe5e9107 req-66813f5b-813e-40f8-9b72-121da01b299c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:32.298180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-25ad6946-441c-4aa8-9efd-c25efe5e9107 req-66813f5b-813e-40f8-9b72-121da01b299c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:32.298397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:23:32.300850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-25ad6946-441c-4aa8-9efd-c25efe5e9107 req-66813f5b-813e-40f8-9b72-121da01b299c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:32.329489 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-25ad6946-441c-4aa8-9efd-c25efe5e9107 req-66813f5b-813e-40f8-9b72-121da01b299c service nova] Creating event network-changed:d40489a8-5c88-4b32-a52a-751ce1cb2d44 for instance b88c7d5d-8596-4064-b313-10976ecf63fa on n-h2-854441-12 Oct 17 15:23:32.345135 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-25ad6946-441c-4aa8-9efd-c25efe5e9107 req-66813f5b-813e-40f8-9b72-121da01b299c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094482 Oct 17 15:23:32.347138 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 211/441] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:33.045379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:33.046200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:33.064952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:33.069615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:33.070866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:33.072900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:33.074423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:33.075097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:33.375259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:33.378949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:33.379740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:33.381183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:33.383235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:33.434430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:33.438293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:33.440477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:33.444248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:33.445872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:33.448658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:33.517995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Getting quotas for project 70295fa3676c40c88cee677a1dd84ac6. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:33.527165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Getting quotas for user 4610d60e4c154bd6ab5b66e238d4541e and project 70295fa3676c40c88cee677a1dd84ac6. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:33.547801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:23:33.556414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:23:33.636578 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2fac1b8-1b87-474c-8f56-9f196c572f46 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.010904 Oct 17 15:23:33.637578 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 231/442] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:23:33.652353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a2eaaa0-19de-4f2c-8bea-569e88c79083 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:33.653531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a2eaaa0-19de-4f2c-8bea-569e88c79083 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:33.717285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:33.731875 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-506dc890-e05d-4d42-b5ec-0f27c67e2e42 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1311 microversion: 2.1 time: 0.691451 Oct 17 15:23:33.747728 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 212/443] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:33 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1311 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:33.852014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a2eaaa0-19de-4f2c-8bea-569e88c79083 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:33.860922 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a2eaaa0-19de-4f2c-8bea-569e88c79083 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1222 microversion: 2.1 time: 0.213493 Oct 17 15:23:33.863569 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 232/444] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:33 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1222 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:34.352080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-870399922", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "f38459d6-73d9-41c5-933a-567ea7658889"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:34.379252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1034586545", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "1833926121", "adminPass": "***", "networks": [{"uuid": "95fad76e-f3b2-47f0-aea3-f34beb499496"}], "security_groups": [{"name": "tempest-securitygroup--1266887381"}], "key_name": "tempest-keypair-1193477078", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:34.487051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] validate_networks() for [('f38459d6-73d9-41c5-933a-567ea7658889', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:23:34.624617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] validate_networks() for [('95fad76e-f3b2-47f0-aea3-f34beb499496', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:23:36.403261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:36.403813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:36.404388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:36.405195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:36.407171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:36.429154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:36.430099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:36.430765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:36.432106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:36.433642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:36.434716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:36.462667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:36.479672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Getting quotas for project 7270241d5a1941dca114d49e3920ef9e. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:36.487489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Getting quotas for user 62b27f5649414601a1b66c0a63b8f3b2 and project 7270241d5a1941dca114d49e3920ef9e. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:36.507696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:23:36.516207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:23:36.631870 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f7958d31-8e4e-4a80-90d5-fb74cb71bd72 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.530754 Oct 17 15:23:36.643264 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 213/445] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:23:36.653600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:36.661549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:36.695521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:36.696062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:36.696510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:36.697310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:36.697767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:36.698195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:37.206452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:37.215647 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-54535d16-1cbd-4ba6-bfe9-c38dc4c9d956 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1311 microversion: 2.1 time: 0.571039 Oct 17 15:23:37.235978 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 214/446] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:36 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1311 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:37.254051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:37.255218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:37.262351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:37.263564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:37.264475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:37.265103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:37.265743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:37.278692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:37.280147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:37.280680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:37.281122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:37.282179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:37.282942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:37.283992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:37.284476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:37.285897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:37.287409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:37.289907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:37.292431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:37.306519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=17 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:37.336511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Getting quotas for project 526aebb581ba4845835d901c0475af9f. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:37.342771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Getting quotas for user a31b571ec20642bc8c31ce18fefb962c and project 526aebb581ba4845835d901c0475af9f. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:37.388920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:23:37.391712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:23:37.546023 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2399d41a-4490-4531-8837-658aca591fda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.171830 Oct 17 15:23:37.551883 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 233/447] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 3178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:23:37.588804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30bb41f9-ff6f-4abd-81c1-e25190542f5b tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:37.593782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30bb41f9-ff6f-4abd-81c1-e25190542f5b tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:37.729413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30bb41f9-ff6f-4abd-81c1-e25190542f5b tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:37.741899 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30bb41f9-ff6f-4abd-81c1-e25190542f5b tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1215 microversion: 2.1 time: 0.188207 Oct 17 15:23:37.742534 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 234/448] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:37 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:37.758743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-615cec66-6427-4b6f-bcf8-5582cd43264a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:37.759779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-615cec66-6427-4b6f-bcf8-5582cd43264a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:37.916758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:37.951833 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4ed21b99-cb55-4d86-bb69-c5c6bdabddf7 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1280 microversion: 2.1 time: 0.714585 Oct 17 15:23:37.960208 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 215/449] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:37 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1280 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:37.989246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-615cec66-6427-4b6f-bcf8-5582cd43264a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:38.015762 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-615cec66-6427-4b6f-bcf8-5582cd43264a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1265 microversion: 2.1 time: 0.272019 Oct 17 15:23:38.023013 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 235/450] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:37 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:38.253065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:38.255297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:38.284843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:38.294120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:38.294823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:38.298176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:38.298675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:38.299242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:38.778666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:38.780870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:38.809986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:38.810730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:38.814157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:38.818132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:38.823304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:38.824217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:38.876645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:38.901122 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8bb69bdb-ca28-46c2-b4d2-8a2a0fde6c57 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1311 microversion: 2.1 time: 0.655516 Oct 17 15:23:38.909283 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 216/451] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:38 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1311 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:38.991900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:38.996256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:39.024810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:39.025640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:39.033582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:39.036136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:39.036692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:39.037147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:39.039781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:39.053551 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-668319a2-8b77-4ce9-9900-429d3d1a8695 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1267 microversion: 2.1 time: 0.289499 Oct 17 15:23:39.055788 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 236/452] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:38 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:39.064484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:39.065608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:39.077018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:39.078290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:39.079448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:39.081772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:39.082881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:39.084613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:39.464014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:39.477229 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03b2e505-ef6a-499f-99e9-8459f6fd2dd1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1261 microversion: 2.1 time: 0.418061 Oct 17 15:23:39.479976 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 237/453] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:39 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1261 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:39.843427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62180b09-0bdd-4393-a58f-dbde2abac8c1 tempest-FlavorsV255TestJSON-2110166066 tempest-FlavorsV255TestJSON-2110166066-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1066167598", "id": 1255268936, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:39.872400 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62180b09-0bdd-4393-a58f-dbde2abac8c1 tempest-FlavorsV255TestJSON-2110166066 tempest-FlavorsV255TestJSON-2110166066-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.388892 Oct 17 15:23:39.884119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:39.886347 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 238/454] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:23:39 2022] POST /compute/v2.1/flavors => generated 449 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:23:39.898128 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a027b1b-3b07-4f73-994f-3aa0e52b0d80 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1322 microversion: 2.1 time: 0.910633 Oct 17 15:23:39.922912 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 217/455] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:38 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1322 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:39.932256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:39.947052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:39.961952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:39.962550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:39.962997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:39.963710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:39.964164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:39.964661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:40.502297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:40.515258 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a5af1201-530a-4a0f-a047-921bda385f9b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1311 microversion: 2.1 time: 0.586904 Oct 17 15:23:40.515891 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 218/456] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:39 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1311 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:40.525405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:40.526026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:40.550676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04c57087-6d08-4268-b594-15d83a634bff tempest-FlavorsV255TestJSON-1595590999 tempest-FlavorsV255TestJSON-1595590999-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:40.565854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:40.566275 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04c57087-6d08-4268-b594-15d83a634bff tempest-FlavorsV255TestJSON-1595590999 tempest-FlavorsV255TestJSON-1595590999-project] 10.222.0.87 "GET /compute/v2.1/flavors/1255268936" status: 200 len: 449 microversion: 2.55 time: 0.678041 Oct 17 15:23:40.566538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:40.566919 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 239/457] 10.222.0.87 () {60 vars in 1199 bytes} [Mon Oct 17 15:23:39 2022] GET /compute/v2.1/flavors/1255268936 => generated 449 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:23:40.567299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:40.568199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:40.575050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:40.575743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:40.749540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1770973034", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:40.828435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:23:41.043915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:41.056442 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e8d08fa0-9b87-45cb-b9de-c9147c9c5fb5 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1315 microversion: 2.1 time: 0.539358 Oct 17 15:23:41.057861 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 219/458] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:40 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:41.077039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:41.077719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:41.089242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:41.090629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:41.091087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:41.092991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:41.093822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:41.095110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:41.234422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:41.248453 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-00dfff4f-34b3-4efb-b146-071a6d597dda tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1323 microversion: 2.1 time: 0.182493 Oct 17 15:23:41.249112 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 220/459] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:41 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:41.261267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-016ba762-fea4-451c-9ac9-c53eff1da643 tempest-FlavorsV255TestJSON-2110166066 tempest-FlavorsV255TestJSON-2110166066-project-admin] Action: 'update', calling method: .version_select at 0x7f28c0ac1d30>, body: {"flavor": {"description": "new"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:41.329512 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-016ba762-fea4-451c-9ac9-c53eff1da643 tempest-FlavorsV255TestJSON-2110166066 tempest-FlavorsV255TestJSON-2110166066-project-admin] 10.222.0.87 "PUT /compute/v2.1/flavors/1255268936" status: 200 len: 450 microversion: 2.55 time: 0.077798 Oct 17 15:23:41.331672 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 221/460] 10.222.0.87 () {62 vars in 1219 bytes} [Mon Oct 17 15:23:41 2022] PUT /compute/v2.1/flavors/1255268936 => generated 450 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:23:41.356475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:41.358871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:41.376039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:41.376962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:41.378884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:41.380337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:41.381111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:41.381719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:41.448701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:41.449994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:41.450801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:41.451615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:41.452299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:41.462280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:41.463491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:41.464180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:41.465153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:41.465855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:41.466481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:41.487224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Getting quotas for project cae57be8e41a4dea89fbefef358d0ed1. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:41.492762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Getting quotas for user 91084e2fdf5d4a7c8c8b0fb7b4a6b001 and project cae57be8e41a4dea89fbefef358d0ed1. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:41.507354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:23:41.510702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:23:41.617938 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39d377be-9917-4673-99c9-e1c7124f0b65 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049813 Oct 17 15:23:41.626080 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 240/461] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:23:41.631790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2850e89-1c5d-4e1c-87ab-bdf76737a0fc tempest-FlavorsV255TestJSON-1595590999 tempest-FlavorsV255TestJSON-1595590999-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:41.643849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=12,nova_api:DELETE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:41.684718 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2850e89-1c5d-4e1c-87ab-bdf76737a0fc tempest-FlavorsV255TestJSON-1595590999 tempest-FlavorsV255TestJSON-1595590999-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 6595 microversion: 2.55 time: 0.052106 Oct 17 15:23:41.688478 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 241/462] 10.222.0.87 () {60 vars in 1187 bytes} [Mon Oct 17 15:23:41 2022] GET /compute/v2.1/flavors/detail => generated 6595 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:23:41.704935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:41.705947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:41.715989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:41.717083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:41.717939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:41.719282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:41.720053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:41.720955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:41.911717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:41.929986 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-406f0979-c91d-4354-921e-f9ab6492c84d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1322 microversion: 2.1 time: 0.592760 Oct 17 15:23:41.955183 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 222/463] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:41 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1322 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:41.967665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-32a209a6-66f4-4a00-b6a1-c0e3cb9aa845 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:41.971499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-32a209a6-66f4-4a00-b6a1-c0e3cb9aa845 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:42.394152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-32a209a6-66f4-4a00-b6a1-c0e3cb9aa845 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:42.430346 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-32a209a6-66f4-4a00-b6a1-c0e3cb9aa845 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1223 microversion: 2.1 time: 0.462935 Oct 17 15:23:42.431473 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 223/464] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:41 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1223 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:42.443982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99f076b3-588b-4e54-805e-27fac05fe112 tempest-FlavorsV255TestJSON-1595590999 tempest-FlavorsV255TestJSON-1595590999-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:42.495059 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99f076b3-588b-4e54-805e-27fac05fe112 tempest-FlavorsV255TestJSON-1595590999 tempest-FlavorsV255TestJSON-1595590999-project] 10.222.0.87 "GET /compute/v2.1/flavors" status: 200 len: 3685 microversion: 2.55 time: 0.052983 Oct 17 15:23:42.496048 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 224/465] 10.222.0.87 () {60 vars in 1166 bytes} [Mon Oct 17 15:23:42 2022] GET /compute/v2.1/flavors => generated 3685 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:23:42.505722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9ce6501d-b21b-4101-8cf2-59acbfd262a3 req-85334336-d162-4eb9-b7a8-bdf21f4dce4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1eb4e3f-2a07-451d-8093-1390b98f0454", "tag": "9230af05-af45-49db-91ef-84165b1b5de5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:42.519393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:42.532640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9ce6501d-b21b-4101-8cf2-59acbfd262a3 req-85334336-d162-4eb9-b7a8-bdf21f4dce4f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:42.533135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9ce6501d-b21b-4101-8cf2-59acbfd262a3 req-85334336-d162-4eb9-b7a8-bdf21f4dce4f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:42.533568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9ce6501d-b21b-4101-8cf2-59acbfd262a3 req-85334336-d162-4eb9-b7a8-bdf21f4dce4f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:42.535416 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-360389ed-e3fa-48b2-9924-ccd8e7b68888 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1311 microversion: 2.1 time: 0.844592 Oct 17 15:23:42.536240 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 242/466] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:41 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1311 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:42.541141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:42.541959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:42.555313 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9ce6501d-b21b-4101-8cf2-59acbfd262a3 req-85334336-d162-4eb9-b7a8-bdf21f4dce4f service nova] Creating event network-changed:9230af05-af45-49db-91ef-84165b1b5de5 for instance b1eb4e3f-2a07-451d-8093-1390b98f0454 on n-h1-854441-12 Oct 17 15:23:42.568483 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9ce6501d-b21b-4101-8cf2-59acbfd262a3 req-85334336-d162-4eb9-b7a8-bdf21f4dce4f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070941 Oct 17 15:23:42.571661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:42.572372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:42.572814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:42.573532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:42.573989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:42.574429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:42.574882 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 225/467] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:42.580342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:42.590304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:42.597649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:42.601320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:42.601972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:42.603023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:42.603674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:42.606262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:42.756473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:42.768415 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bb314eaa-7c07-48ba-baec-5aaf346d950e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1323 microversion: 2.1 time: 0.192144 Oct 17 15:23:42.772294 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 226/468] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:42 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:42.779388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-56ce798a-9d3f-4d34-a37e-1e41f889ecd3 req-560cb712-059a-4463-80aa-57fb2d548a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88c7d5d-8596-4064-b313-10976ecf63fa", "name": "network-vif-plugged", "status": "completed", "tag": "d40489a8-5c88-4b32-a52a-751ce1cb2d44"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:42.801961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-56ce798a-9d3f-4d34-a37e-1e41f889ecd3 req-560cb712-059a-4463-80aa-57fb2d548a3e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:42.807279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-56ce798a-9d3f-4d34-a37e-1e41f889ecd3 req-560cb712-059a-4463-80aa-57fb2d548a3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:42.809139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-56ce798a-9d3f-4d34-a37e-1e41f889ecd3 req-560cb712-059a-4463-80aa-57fb2d548a3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:42.831432 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-56ce798a-9d3f-4d34-a37e-1e41f889ecd3 req-560cb712-059a-4463-80aa-57fb2d548a3e service nova] Creating event network-vif-plugged:d40489a8-5c88-4b32-a52a-751ce1cb2d44 for instance b88c7d5d-8596-4064-b313-10976ecf63fa on n-h2-854441-12 Oct 17 15:23:42.837599 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-56ce798a-9d3f-4d34-a37e-1e41f889ecd3 req-560cb712-059a-4463-80aa-57fb2d548a3e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063600 Oct 17 15:23:42.841802 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 227/469] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:42.854881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20ff0920-432a-408d-8c99-a0b48b207812 tempest-FlavorsV255TestJSON-2110166066 tempest-FlavorsV255TestJSON-2110166066-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:42.936345 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20ff0920-432a-408d-8c99-a0b48b207812 tempest-FlavorsV255TestJSON-2110166066 tempest-FlavorsV255TestJSON-2110166066-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1255268936" status: 202 len: 0 microversion: 2.55 time: 0.092988 Oct 17 15:23:42.938137 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 228/470] 10.222.0.87 () {60 vars in 1202 bytes} [Mon Oct 17 15:23:42 2022] DELETE /compute/v2.1/flavors/1255268936 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:23:43.229276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8c58e7e4-2f6b-47fd-83a2-7d7f5ea10630 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Calling method '.version_select at 0x7f28bf32f940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:43.233196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c58e7e4-2f6b-47fd-83a2-7d7f5ea10630 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.233698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c58e7e4-2f6b-47fd-83a2-7d7f5ea10630 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.234147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c58e7e4-2f6b-47fd-83a2-7d7f5ea10630 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.240884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c58e7e4-2f6b-47fd-83a2-7d7f5ea10630 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.241394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c58e7e4-2f6b-47fd-83a2-7d7f5ea10630 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.241827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c58e7e4-2f6b-47fd-83a2-7d7f5ea10630 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.268800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:43.283315 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f85331a3-945d-4712-a6e4-dc44a5fed751 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1315 microversion: 2.1 time: 0.745829 Oct 17 15:23:43.283917 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 243/471] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:42 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:43.290144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88971ae0-c2e1-4b6e-8c8e-9c289a1fb079 tempest-FlavorsV255TestJSON-2110166066 tempest-FlavorsV255TestJSON-2110166066-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:43.311131 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8c58e7e4-2f6b-47fd-83a2-7d7f5ea10630 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.371554 Oct 17 15:23:43.312378 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 229/472] 10.222.0.87 () {58 vars in 1128 bytes} [Mon Oct 17 15:23:42 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:43.319401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:43.320472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:43.328658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.333676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.334548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.337694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.338242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.340341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.344903 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88971ae0-c2e1-4b6e-8c8e-9c289a1fb079 tempest-FlavorsV255TestJSON-2110166066 tempest-FlavorsV255TestJSON-2110166066-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 6155 microversion: 2.55 time: 0.059877 Oct 17 15:23:43.348224 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 244/473] 10.222.0.87 () {60 vars in 1187 bytes} [Mon Oct 17 15:23:43 2022] GET /compute/v2.1/flavors/detail => generated 6155 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:23:43.354561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ddf966f8-e174-42af-8d5b-8ee7a6756a92 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Calling method '.version_select at 0x7f28bf326f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:43.358127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf966f8-e174-42af-8d5b-8ee7a6756a92 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.358636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf966f8-e174-42af-8d5b-8ee7a6756a92 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.359069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf966f8-e174-42af-8d5b-8ee7a6756a92 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.379190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf966f8-e174-42af-8d5b-8ee7a6756a92 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.380262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf966f8-e174-42af-8d5b-8ee7a6756a92 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.381963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddf966f8-e174-42af-8d5b-8ee7a6756a92 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.426332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ddf966f8-e174-42af-8d5b-8ee7a6756a92 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.076521 Oct 17 15:23:43.427675 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 245/474] 10.222.0.87 () {58 vars in 1139 bytes} [Mon Oct 17 15:23:43 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:43.445100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-283196a0-bbe5-4611-a0d3-8fd3b1c4862f tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Calling method '.version_select at 0x7f28bf4c24c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:43.449702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-283196a0-bbe5-4611-a0d3-8fd3b1c4862f tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.450258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-283196a0-bbe5-4611-a0d3-8fd3b1c4862f tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.450792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-283196a0-bbe5-4611-a0d3-8fd3b1c4862f tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.451554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-283196a0-bbe5-4611-a0d3-8fd3b1c4862f tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.452231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-283196a0-bbe5-4611-a0d3-8fd3b1c4862f tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.452725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-283196a0-bbe5-4611-a0d3-8fd3b1c4862f tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.487040 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-283196a0-bbe5-4611-a0d3-8fd3b1c4862f tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.050435 Oct 17 15:23:43.495871 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 246/475] 10.222.0.87 () {58 vars in 1145 bytes} [Mon Oct 17 15:23:43 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:23:43.511505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:43.512603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:43.522358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.523693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.524416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.526122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.527941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.528848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.688351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:43.724305 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7758d3a6-35f6-4c4c-bc5e-fe1ebade7e71 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1275 microversion: 2.1 time: 0.224074 Oct 17 15:23:43.726482 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 247/476] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:43 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:43.736887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39f572aa-44c6-45a0-ab7b-a387afd0c4a2 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Calling method '.version_select at 0x7f28bf3a4940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:43.750890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39f572aa-44c6-45a0-ab7b-a387afd0c4a2 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.751590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39f572aa-44c6-45a0-ab7b-a387afd0c4a2 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.752718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39f572aa-44c6-45a0-ab7b-a387afd0c4a2 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.753805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39f572aa-44c6-45a0-ab7b-a387afd0c4a2 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.754566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39f572aa-44c6-45a0-ab7b-a387afd0c4a2 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.756772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39f572aa-44c6-45a0-ab7b-a387afd0c4a2 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.815164 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39f572aa-44c6-45a0-ab7b-a387afd0c4a2 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.086897 Oct 17 15:23:43.815973 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 248/477] 10.222.0.87 () {58 vars in 1128 bytes} [Mon Oct 17 15:23:43 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:43.828337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:43.830431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:43.861396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.866262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.866815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.867841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.869020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.869433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.874165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:43.889453 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a424927a-f26a-43de-a3a6-e389bfedaca2 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1322 microversion: 2.1 time: 0.571329 Oct 17 15:23:43.891507 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 230/478] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:43 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1322 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:43.915183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-aaa65575-7234-4c88-9689-87bd23a80156 req-c72afcd9-17a7-4b12-9a8e-dc2511632622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63b183b4-a45b-41de-8816-0081abe33337", "tag": "30109548-6b0a-419e-b2a6-52a8b6d8c480"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:43.935460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-aaa65575-7234-4c88-9689-87bd23a80156 req-c72afcd9-17a7-4b12-9a8e-dc2511632622 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:43.935948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-aaa65575-7234-4c88-9689-87bd23a80156 req-c72afcd9-17a7-4b12-9a8e-dc2511632622 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:43.936377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-aaa65575-7234-4c88-9689-87bd23a80156 req-c72afcd9-17a7-4b12-9a8e-dc2511632622 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:43.973223 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-aaa65575-7234-4c88-9689-87bd23a80156 req-c72afcd9-17a7-4b12-9a8e-dc2511632622 service nova] Creating event network-changed:30109548-6b0a-419e-b2a6-52a8b6d8c480 for instance 63b183b4-a45b-41de-8816-0081abe33337 on n-h2-854441-12 Oct 17 15:23:43.981905 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-aaa65575-7234-4c88-9689-87bd23a80156 req-c72afcd9-17a7-4b12-9a8e-dc2511632622 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089040 Oct 17 15:23:43.983259 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 231/479] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:43.994044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:43.995225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:44.008689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.009599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.010666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.011662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.012402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.013054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.332601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:44.345843 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-86a0c0d8-efa0-488a-aa2f-f62cdf58218f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.361101 Oct 17 15:23:44.346453 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 232/480] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:43 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:44.354083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d3566762-db00-4ee5-b229-4eb664a18722 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Calling method '.version_select at 0x7f28bf32f3a0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:44.357840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3566762-db00-4ee5-b229-4eb664a18722 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.358328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3566762-db00-4ee5-b229-4eb664a18722 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.358790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3566762-db00-4ee5-b229-4eb664a18722 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.359516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3566762-db00-4ee5-b229-4eb664a18722 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.359962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3566762-db00-4ee5-b229-4eb664a18722 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.360384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3566762-db00-4ee5-b229-4eb664a18722 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.398454 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d3566762-db00-4ee5-b229-4eb664a18722 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.050855 Oct 17 15:23:44.401045 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 233/481] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:23:44 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:44.413720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:44.414606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:44.422533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.423418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.424059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.424972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.425776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.426351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.643229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:44.656684 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f771189-3dfb-4d82-8339-32be2976945a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1311 microversion: 2.1 time: 0.839688 Oct 17 15:23:44.657279 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 249/482] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:43 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1311 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:44.661859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b264380-bdfb-49e3-a02f-4da3c3be48f9 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Calling method '.version_select at 0x7f28bf4c2ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:44.665710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b264380-bdfb-49e3-a02f-4da3c3be48f9 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.666468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b264380-bdfb-49e3-a02f-4da3c3be48f9 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.667166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b264380-bdfb-49e3-a02f-4da3c3be48f9 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.668139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b264380-bdfb-49e3-a02f-4da3c3be48f9 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.668806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b264380-bdfb-49e3-a02f-4da3c3be48f9 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.669479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b264380-bdfb-49e3-a02f-4da3c3be48f9 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.696744 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b264380-bdfb-49e3-a02f-4da3c3be48f9 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.038083 Oct 17 15:23:44.704234 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 250/483] 10.222.0.87 () {58 vars in 1128 bytes} [Mon Oct 17 15:23:44 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:44.709581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-914d76eb-5df7-4226-ad10-a5620d2dfab3 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Calling method '.version_select at 0x7f28bf3a4af0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:44.717456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-914d76eb-5df7-4226-ad10-a5620d2dfab3 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.718330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-914d76eb-5df7-4226-ad10-a5620d2dfab3 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.719107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-914d76eb-5df7-4226-ad10-a5620d2dfab3 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.732954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-914d76eb-5df7-4226-ad10-a5620d2dfab3 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.733613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-914d76eb-5df7-4226-ad10-a5620d2dfab3 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.734228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-914d76eb-5df7-4226-ad10-a5620d2dfab3 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.775638 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-914d76eb-5df7-4226-ad10-a5620d2dfab3 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts/n-h1-854441-12" status: 200 len: 603 microversion: 2.1 time: 0.069980 Oct 17 15:23:44.782730 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 251/484] 10.222.0.87 () {58 vars in 1173 bytes} [Mon Oct 17 15:23:44 2022] GET /compute/v2.1/os-hosts/n-h1-854441-12 => generated 603 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:44.788415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:44.789031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:44.816996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.818895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.819745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.820949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.821510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.822051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.917856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:44.928032 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b0fc970-4161-47c7-8668-963d599acc35 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1315 microversion: 2.1 time: 0.523611 Oct 17 15:23:44.929919 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 234/485] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:44 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:44.950982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-27de1ad9-c66f-4165-8a72-5c56b20a2ac8 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Calling method '.version_select at 0x7f28bf4d6e50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:44.956607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=86,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:44.964211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27de1ad9-c66f-4165-8a72-5c56b20a2ac8 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:44.964958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27de1ad9-c66f-4165-8a72-5c56b20a2ac8 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:44.965393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27de1ad9-c66f-4165-8a72-5c56b20a2ac8 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:44.998726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:45.002918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27de1ad9-c66f-4165-8a72-5c56b20a2ac8 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.003760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27de1ad9-c66f-4165-8a72-5c56b20a2ac8 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.004353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27de1ad9-c66f-4165-8a72-5c56b20a2ac8 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:45.015224 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ea683dd-41b9-48f2-9d3c-7e34c7825d34 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1281 microversion: 2.1 time: 0.230672 Oct 17 15:23:45.016169 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 252/486] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:44 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:45.020824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:45.021854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:45.039101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.039597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.040040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:45.040796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.041384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.041756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:45.047839 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-27de1ad9-c66f-4165-8a72-5c56b20a2ac8 tempest-HostsAdminTestJSON-324475876 tempest-HostsAdminTestJSON-324475876-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hosts/n-h2-854441-12" status: 200 len: 735 microversion: 2.1 time: 0.115147 Oct 17 15:23:45.049257 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 235/487] 10.222.0.87 () {58 vars in 1173 bytes} [Mon Oct 17 15:23:44 2022] GET /compute/v2.1/os-hosts/n-h2-854441-12 => generated 735 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:45.081035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:45.370199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:45.371137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:45.383899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.384817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.387139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:45.388057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.389657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.390083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:45.589834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:45.606221 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c36a3a2d-0c28-4061-8ea8-41adf007d285 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1322 microversion: 2.1 time: 0.588893 Oct 17 15:23:45.607559 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 253/488] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:45 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1322 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:45.612385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2f8e5407-0758-4a5e-8252-e61e3483a0e4 req-a5084410-faaf-4bb8-ab79-39adf2dbd80c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c92757-4ed7-4d61-9156-4add9affe762", "tag": "4a53f88e-978b-458e-8666-a0b33c244e39"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:45.632450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2f8e5407-0758-4a5e-8252-e61e3483a0e4 req-a5084410-faaf-4bb8-ab79-39adf2dbd80c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.633752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2f8e5407-0758-4a5e-8252-e61e3483a0e4 req-a5084410-faaf-4bb8-ab79-39adf2dbd80c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.634360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2f8e5407-0758-4a5e-8252-e61e3483a0e4 req-a5084410-faaf-4bb8-ab79-39adf2dbd80c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:45.647115 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2f8e5407-0758-4a5e-8252-e61e3483a0e4 req-a5084410-faaf-4bb8-ab79-39adf2dbd80c service nova] Creating event network-changed:4a53f88e-978b-458e-8666-a0b33c244e39 for instance 24c92757-4ed7-4d61-9156-4add9affe762 on n-h2-854441-12 Oct 17 15:23:45.664354 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2f8e5407-0758-4a5e-8252-e61e3483a0e4 req-a5084410-faaf-4bb8-ab79-39adf2dbd80c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055085 Oct 17 15:23:45.665413 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 254/489] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:45.683715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:45.684632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:45.691804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.692578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.693179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:45.694058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.694700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.695469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:45.855375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:45.873742 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5a3e9ab3-73ce-498b-a223-c16c947db480 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.509280 Oct 17 15:23:45.876068 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 236/490] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:45 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:45.962560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:45.963279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:45.975194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.976953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.977404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:45.979498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:45.980004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:45.980411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:46.426282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:46.439052 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6f34a6a-ddaf-477d-8d02-a548f200407f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1460 microversion: 2.1 time: 0.761427 Oct 17 15:23:46.441463 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 255/491] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:45 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1460 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:46.447800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:46.449302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:46.458234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:46.458788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:46.460324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:46.460324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:46.460680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:46.461293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:46.464942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:46.467720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:46.475242 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e81f91b-f7e5-49af-b9b5-7d5d4fb0f185 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1315 microversion: 2.1 time: 0.517430 Oct 17 15:23:46.476554 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 237/492] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:45 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:46.482091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:46.484866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:46.491750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:46.492504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:46.493132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:46.494066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:46.494694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:46.495321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:46.583998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:46.595833 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6eed2873-f5c6-4226-9ccc-d27ab15e1bca tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1281 microversion: 2.1 time: 0.152587 Oct 17 15:23:46.596566 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 256/493] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:46 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:46.619020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:46.629777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:46.630632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:46.637246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Old instance type m1.heat2, new instance type m1.heat {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 15:23:46.646258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:46.647239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:46.647798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:46.648420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:46.648860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:46.649960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:46.672017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:46.674977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:46.676888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:46.679099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:46.679382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:46.881322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5c41f8e-8a95-463c-b851-b1e0c2e899b5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa/action" status: 202 len: 0 microversion: 2.1 time: 0.403426 Oct 17 15:23:46.888849 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 238/494] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:23:46 2022] POST /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:23:46.901520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:46.902150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:46.922065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:46.922652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:46.923107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:46.927082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:46.928896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:46.929724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:47.185274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:47.199778 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44ed88ef-750b-4125-b43c-fc3dc6569c9e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1322 microversion: 2.1 time: 0.574096 Oct 17 15:23:47.211190 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 257/495] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:46 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1322 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:47.212880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:47.223087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:47.223937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:47.228104 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9ec52ea-8847-4e3a-a573-0887f39ebe16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1469 microversion: 2.1 time: 0.337660 Oct 17 15:23:47.229125 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 239/496] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:46 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:47.247209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:47.248078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:47.248706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:47.249415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:47.250011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:47.250604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:47.508426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:47.509261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:47.527018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:47.529465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:47.530071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:47.530979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:47.533058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:47.535425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:47.807679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:47.816073 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-186b9456-6b42-4129-80d2-9ef134901fa9 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.603527 Oct 17 15:23:47.818779 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 258/497] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:47 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:47.834880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:47.835922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:47.853128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:47.853995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:47.854830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:47.855782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:47.856389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:47.857095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:48.629419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:48.647639 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bad0b940-d34d-49f0-9155-0aa63897114e tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1315 microversion: 2.1 time: 1.143399 Oct 17 15:23:48.648264 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 240/498] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:47 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1315 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:48.656078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:48.664225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:48.681673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:48.684743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:48.686393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:48.688028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:48.688829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:48.689522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:48.823921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:48.851804 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64b9fb95-71fc-43b4-9870-9a845db79c27 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1323 microversion: 2.1 time: 1.030668 Oct 17 15:23:48.853013 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 259/499] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:47 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1323 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:48.871646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:48.872318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:48.887228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:48.887838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:48.888218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:48.888939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:48.891542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:48.892055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:49.168831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:49.187141 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b1c70cd3-a8ab-45d3-9569-6beccdf31e17 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1322 microversion: 2.1 time: 0.535687 Oct 17 15:23:49.190450 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 241/500] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:48 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:49.224151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:49.224927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:49.252591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:49.253105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:49.258006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:49.263819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:49.265427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:49.266766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:49.454037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:49.466972 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ba5fe8d-fa23-4416-88c2-6cf12a23357b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1469 microversion: 2.1 time: 0.611701 Oct 17 15:23:49.479408 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 260/501] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:48 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1469 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:49.492622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-00c54dd0-df13-426e-af85-d4b1887fc432 req-1693a4b8-0e9d-4b83-9c44-b11ddba662c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1eb4e3f-2a07-451d-8093-1390b98f0454", "name": "network-vif-plugged", "status": "completed", "tag": "9230af05-af45-49db-91ef-84165b1b5de5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:49.539830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-00c54dd0-df13-426e-af85-d4b1887fc432 req-1693a4b8-0e9d-4b83-9c44-b11ddba662c5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:49.541058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-00c54dd0-df13-426e-af85-d4b1887fc432 req-1693a4b8-0e9d-4b83-9c44-b11ddba662c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:49.541836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-00c54dd0-df13-426e-af85-d4b1887fc432 req-1693a4b8-0e9d-4b83-9c44-b11ddba662c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:49.587961 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-00c54dd0-df13-426e-af85-d4b1887fc432 req-1693a4b8-0e9d-4b83-9c44-b11ddba662c5 service nova] Creating event network-vif-plugged:9230af05-af45-49db-91ef-84165b1b5de5 for instance b1eb4e3f-2a07-451d-8093-1390b98f0454 on n-h1-854441-12 Oct 17 15:23:49.603173 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-00c54dd0-df13-426e-af85-d4b1887fc432 req-1693a4b8-0e9d-4b83-9c44-b11ddba662c5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120958 Oct 17 15:23:49.606627 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 261/502] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:49.664184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:49.675153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:49.675813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:49.685601 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fcb216a8-2ecb-4e98-96f7-932d477800b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.493091 Oct 17 15:23:49.688203 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 242/503] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:49 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:49.712144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:49.715376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:49.719164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:49.720048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:49.725100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:49.725609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:49.881865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:49.883331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:49.909575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:49.914074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:49.933423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:49.936231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:49.940551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:49.941484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:50.741607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:50.759104 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87afc91f-6074-458e-87ab-64a2fb54f2d2 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1315 microversion: 2.1 time: 1.086691 Oct 17 15:23:50.759736 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 262/504] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:49 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1315 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:50.840912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:50.873539 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-48258ca5-fede-4257-9590-00310dfed425 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1323 microversion: 2.1 time: 0.998694 Oct 17 15:23:50.875421 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 243/505] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:49 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1323 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:50.903911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:50.905118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:50.923596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:50.925206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:50.926603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:50.928355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:50.929172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:50.930396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.112050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Calling method '.version_select at 0x7f28bf3a0700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:51.114044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.114643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.115094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.152860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.154168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.155274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.177928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.183302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.183914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.201851 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f31d872c-0718-4aa3-a12c-a7e9b9c25c30 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.438560 Oct 17 15:23:51.208516 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 263/506] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:51.215295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:51.215848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:51.232773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.233237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.234405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.236339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.237024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.239413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.450926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:51.468763 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-08a65321-cf0d-4191-9748-affd703e0aee tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1322 microversion: 2.1 time: 0.591041 Oct 17 15:23:51.469385 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 244/507] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:50 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1322 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:51.476191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:51.476971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:51.486954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.487817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.489583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.491156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.492257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.492880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.501631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=39 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:51.887219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:51.889042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:51.932214 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5df82b72-d6fc-48b4-8695-d8276368d6d5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.458061 Oct 17 15:23:51.933545 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71ab1aae-e86f-4428-afa5-d20924624122 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1469 microversion: 2.1 time: 0.723680 Oct 17 15:23:51.935255 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 264/508] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:51 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1469 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:51.936037 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 245/509] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:51 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:51.961290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:51.965081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:51.966339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Calling method '.version_select at 0x7f28bf2333a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:51.973410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.975496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.979031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.986525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.987715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.988093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:51.991638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:51.994195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:51.995663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.012174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.012674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.013096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.045230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.045958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.046561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.054783 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8831f450-113d-42cb-b8f4-745bd25594f7 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/n-h1-854441-12/servers" status: 200 len: 276 microversion: 2.1 time: 0.097826 Oct 17 15:23:52.055528 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 265/510] 10.222.0.87 () {58 vars in 1215 bytes} [Mon Oct 17 15:23:51 2022] GET /compute/v2.1/os-hypervisors/n-h1-854441-12/servers => generated 276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:52.068745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.069650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:52.079010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.079792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.080394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.081987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.082717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.083344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.208274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:52.219200 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e1b1ace4-f44c-4d8c-963a-f282719bb774 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1315 microversion: 2.1 time: 0.279056 Oct 17 15:23:52.220577 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 246/511] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:51 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:52.238691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-3d1cd71e-c2b0-4394-836d-f4f9efeecf4f req-d4286d13-f83e-4290-b733-e339c7c7fbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd0517d-2f4c-45ab-bf34-038e5f1cdab3", "tag": "6ab0c236-83b6-4a4f-9f31-6a81cb2e9403"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:52.250464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3d1cd71e-c2b0-4394-836d-f4f9efeecf4f req-d4286d13-f83e-4290-b733-e339c7c7fbe2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.251459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3d1cd71e-c2b0-4394-836d-f4f9efeecf4f req-d4286d13-f83e-4290-b733-e339c7c7fbe2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.252109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3d1cd71e-c2b0-4394-836d-f4f9efeecf4f req-d4286d13-f83e-4290-b733-e339c7c7fbe2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.266897 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-3d1cd71e-c2b0-4394-836d-f4f9efeecf4f req-d4286d13-f83e-4290-b733-e339c7c7fbe2 service nova] Creating event network-changed:6ab0c236-83b6-4a4f-9f31-6a81cb2e9403 for instance 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 on n-h1-854441-12 Oct 17 15:23:52.274306 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-3d1cd71e-c2b0-4394-836d-f4f9efeecf4f req-d4286d13-f83e-4290-b733-e339c7c7fbe2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051885 Oct 17 15:23:52.276917 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 247/512] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:52.283870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c67c94dd-7ec3-4f8e-9db5-9ce2ed266245 req-ea4dbc75-63b1-4007-a539-4483979dd958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b183b4-a45b-41de-8816-0081abe33337", "name": "network-vif-plugged", "status": "completed", "tag": "30109548-6b0a-419e-b2a6-52a8b6d8c480"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:52.298562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c67c94dd-7ec3-4f8e-9db5-9ce2ed266245 req-ea4dbc75-63b1-4007-a539-4483979dd958 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.299660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c67c94dd-7ec3-4f8e-9db5-9ce2ed266245 req-ea4dbc75-63b1-4007-a539-4483979dd958 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.300347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c67c94dd-7ec3-4f8e-9db5-9ce2ed266245 req-ea4dbc75-63b1-4007-a539-4483979dd958 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.316514 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c67c94dd-7ec3-4f8e-9db5-9ce2ed266245 req-ea4dbc75-63b1-4007-a539-4483979dd958 service nova] Creating event network-vif-plugged:30109548-6b0a-419e-b2a6-52a8b6d8c480 for instance 63b183b4-a45b-41de-8816-0081abe33337 on n-h2-854441-12 Oct 17 15:23:52.322477 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c67c94dd-7ec3-4f8e-9db5-9ce2ed266245 req-ea4dbc75-63b1-4007-a539-4483979dd958 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043829 Oct 17 15:23:52.324037 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 248/513] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:52.408873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=41 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:52.574142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Calling method '.version_select at 0x7f28bf57fdc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.576415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.577639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.578305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.611619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.612644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.613403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.631673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.632348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.632989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.633503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:52.642814 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-615f0057-ea99-4e9c-a4e6-21e76d5d4849 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.317268 Oct 17 15:23:52.644196 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 249/514] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:52.652933 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8438dc82-c611-4b4d-82a4-ab640c7939f1 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1323 microversion: 2.1 time: 0.595970 Oct 17 15:23:52.654359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Calling method '.version_select at 0x7f28bf57f9d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.657851 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 266/515] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1323 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:52.670856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.670856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.670856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.680175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.683377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:52.690368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.690989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.691822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.694258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.695012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.695630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.701074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.701827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.702877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.721509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.722261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.723904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.730611 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-66748dda-d08c-46b0-87f8-804ad1d544b9 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.084738 Oct 17 15:23:52.731221 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 250/516] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:52.735895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Calling method '.version_select at 0x7f28bf317ca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.738536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.739266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.739706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.754263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.754706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.755142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.766840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.767327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.767843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.775385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-19c0aa9a-2720-449c-8591-c85a876fd226 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.042827 Oct 17 15:23:52.782708 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 251/517] 10.222.0.87 () {58 vars in 1167 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:52.782708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e123fe5a-751c-4bb8-98d7-eeb5a87a1553 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Calling method '.version_select at 0x7f28bf4d6dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.782708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e123fe5a-751c-4bb8-98d7-eeb5a87a1553 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.783030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e123fe5a-751c-4bb8-98d7-eeb5a87a1553 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.783425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e123fe5a-751c-4bb8-98d7-eeb5a87a1553 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.801605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e123fe5a-751c-4bb8-98d7-eeb5a87a1553 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.802088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e123fe5a-751c-4bb8-98d7-eeb5a87a1553 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.802699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e123fe5a-751c-4bb8-98d7-eeb5a87a1553 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.808908 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e123fe5a-751c-4bb8-98d7-eeb5a87a1553 tempest-HypervisorAdminUnderV252Test-427340614 tempest-HypervisorAdminUnderV252Test-427340614-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/n-h1-854441-12/search" status: 200 len: 105 microversion: 2.1 time: 0.031821 Oct 17 15:23:52.813174 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 252/518] 10.222.0.87 () {58 vars in 1212 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/os-hypervisors/n-h1-854441-12/search => generated 105 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:52.813874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Calling method '.version_select at 0x7f28bf40b8b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.818778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.819531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.820159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.838141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.838821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.839531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.852256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.856406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.856999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.867738 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f790439b-f547-4d50-8434-28fb24e548d2 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.056888 Oct 17 15:23:52.873612 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 253/519] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:52.883015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b44ae842-59a8-491d-938e-f0e8a82a614b tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Calling method '.version_select at 0x7f28bf4d61f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.885305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44ae842-59a8-491d-938e-f0e8a82a614b tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.885795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44ae842-59a8-491d-938e-f0e8a82a614b tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.886231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44ae842-59a8-491d-938e-f0e8a82a614b tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.902898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44ae842-59a8-491d-938e-f0e8a82a614b tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.903553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44ae842-59a8-491d-938e-f0e8a82a614b tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.903812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44ae842-59a8-491d-938e-f0e8a82a614b tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.911260 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b44ae842-59a8-491d-938e-f0e8a82a614b tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.034870 Oct 17 15:23:52.922321 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 254/520] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:52.929275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-efd14143-fc45-422f-8561-4b6eebab0043 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Calling method '.version_select at 0x7f28bf485ca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.931773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efd14143-fc45-422f-8561-4b6eebab0043 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.931773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efd14143-fc45-422f-8561-4b6eebab0043 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.932242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efd14143-fc45-422f-8561-4b6eebab0043 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.949618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:52.951840 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-efd14143-fc45-422f-8561-4b6eebab0043 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.027916 Oct 17 15:23:52.954065 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 255/521] 10.222.0.87 () {58 vars in 1179 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:52.965335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:52.966426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:52.974196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.975019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.975458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:52.976167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:52.976790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:52.977207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.153627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:53.165031 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f09e1c58-580f-45f5-ac03-6b17b1ecebf3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1469 microversion: 2.1 time: 0.209556 Oct 17 15:23:53.166171 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 256/522] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:53.171484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:53.172641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:53.179217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.180035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.180756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.181698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.182253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.182950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.361299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:53.370863 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f81a57cc-9e2e-4c89-b893-b31e18a58c51 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.203272 Oct 17 15:23:53.384734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:53.386822 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 257/523] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:53 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:53.396893 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e0b4bb20-9ef3-4146-b5a5-4984dc511e1e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1472 microversion: 2.1 time: 0.722527 Oct 17 15:23:53.399710 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 267/524] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:52 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1472 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:53.401152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Calling method '.version_select at 0x7f28bf3c6f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:53.404272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.405778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.407823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.411060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:53.411940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:53.426368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.426963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.427632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.428652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.431033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.431812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.439022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.451433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.452186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.472732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.473236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.473674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.489518 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3acf0b08-37f5-4322-a159-106e9bcd94a0 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.101065 Oct 17 15:23:53.496435 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 258/525] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:23:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:53.774037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6c15edf0-e454-4e10-8fa3-f4d8198d1000 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:53.775005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6c15edf0-e454-4e10-8fa3-f4d8198d1000 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] [instance: 0a6d234b-7760-49b7-8ecb-9762964b0f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:53.781850 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-6c15edf0-e454-4e10-8fa3-f4d8198d1000 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] HTTP exception thrown: Instance 0a6d234b-7760-49b7-8ecb-9762964b0f21 could not be found. Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6c15edf0-e454-4e10-8fa3-f4d8198d1000 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Request method failure captured: Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/0a6d234b-7760-49b7-8ecb-9762964b0f21/action HTTP/1.1 Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 15 Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNybmU8rX2iPoGAJlrz0yX5S9G8zS8uf52BN7mPT0VIa_ArSGBJ49packCHClcGyfX3PT_fK5SDQsfvcJ_2ttRTdkloIxvugRiNBtR55SAPvu0HEE97Z8So9fYB68n6gVW6ywEMNK5xD9WjWDmUycGFIkCq59OS-73otoh-90bNrFs Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:23:53.784774 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: fe2e700c2be845d0b9092094da9d1de2 Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: {"migrate": {}} Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:23:53.786128 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 0a6d234b-7760-49b7-8ecb-9762964b0f21 could not be found. Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '0a6d234b-7760-49b7-8ecb-9762964b0f21', 'body': {'migrate': {}}} Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a6d234b-7760-49b7-8ecb-9762964b0f21 could not be found. Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:23:53.787372 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a6d234b-7760-49b7-8ecb-9762964b0f21 could not be found. Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a6d234b-7760-49b7-8ecb-9762964b0f21 could not be found. Oct 17 15:23:53.788723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:23:53.789767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6c15edf0-e454-4e10-8fa3-f4d8198d1000 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Returning 404 to user: Instance 0a6d234b-7760-49b7-8ecb-9762964b0f21 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:23:53.789767 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6c15edf0-e454-4e10-8fa3-f4d8198d1000 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/0a6d234b-7760-49b7-8ecb-9762964b0f21/action" status: 404 len: 111 microversion: 2.1 time: 0.288033 Oct 17 15:23:53.798415 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 259/526] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:23:53 2022] POST /compute/v2.1/servers/0a6d234b-7760-49b7-8ecb-9762964b0f21/action => generated 111 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:23:53.804150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b188d92-5d9e-401d-84a0-c9020cbf7bc6 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Calling method '.version_select at 0x7f28bf317550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:53.806139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:53.806286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b188d92-5d9e-401d-84a0-c9020cbf7bc6 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.806746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b188d92-5d9e-401d-84a0-c9020cbf7bc6 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.807250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b188d92-5d9e-401d-84a0-c9020cbf7bc6 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.817708 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71404f8a-4ea0-476f-af5e-af817289af69 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1315 microversion: 2.1 time: 0.415761 Oct 17 15:23:53.819396 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 268/527] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:53 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:53.825160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:53.826188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:53.833707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.834491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.835368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.837524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.838426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.839500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.840456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b188d92-5d9e-401d-84a0-c9020cbf7bc6 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.841242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b188d92-5d9e-401d-84a0-c9020cbf7bc6 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.841696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b188d92-5d9e-401d-84a0-c9020cbf7bc6 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.875053 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b188d92-5d9e-401d-84a0-c9020cbf7bc6 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.075389 Oct 17 15:23:53.890268 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 260/528] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:23:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:53.895034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-85e1c0f3-0ba6-4ac6-a4e7-df9083949420 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Calling method '.version_select at 0x7f28bf4d6dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:53.896955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e1c0f3-0ba6-4ac6-a4e7-df9083949420 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.897446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e1c0f3-0ba6-4ac6-a4e7-df9083949420 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.897882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e1c0f3-0ba6-4ac6-a4e7-df9083949420 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.914142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e1c0f3-0ba6-4ac6-a4e7-df9083949420 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.914672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e1c0f3-0ba6-4ac6-a4e7-df9083949420 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.914766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e1c0f3-0ba6-4ac6-a4e7-df9083949420 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.934594 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-85e1c0f3-0ba6-4ac6-a4e7-df9083949420 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.043098 Oct 17 15:23:53.951592 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 261/529] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:23:53 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:53.963929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Calling method '.version_select at 0x7f28bf3c6940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:53.966209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.966986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.968235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:53.987991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:53.988737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:53.989375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:54.001825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:54.002603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:54.003187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:54.067896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:54.077879 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3ebb364-a4cd-4800-812f-e5949fa41fe2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1323 microversion: 2.1 time: 0.257111 Oct 17 15:23:54.096860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 269/530] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:53 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:54.103461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2044251866", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:54.193102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:23:54.294319 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-af579c47-4ad0-4ab2-a16e-cda9f081dc26 tempest-HypervisorAdminTestJSON-940541703 tempest-HypervisorAdminTestJSON-940541703-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.341817 Oct 17 15:23:54.302325 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 262/531] 10.222.0.87 () {58 vars in 1173 bytes} [Mon Oct 17 15:23:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:54.310718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:54.311449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:54.365329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:54.366005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:54.371681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:54.372868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:54.374245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:54.377435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:54.378842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=7 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:54.681743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=11 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:54.738653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:54.755310 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a5114e6-12ad-41ec-85c5-5cfec1ddb24d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1469 microversion: 2.1 time: 0.450882 Oct 17 15:23:54.757206 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 263/532] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:54 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1469 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:54.776696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:54.778329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:54.788911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:54.790651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:54.791334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:54.792604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:54.793133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:54.794289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.024603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:55.047460 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-df02baf0-f971-4d40-b559-3c1f79c38699 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.285666 Oct 17 15:23:55.048049 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 264/533] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:54 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:55.067960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:55.068922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:55.075574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.076422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.077101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.077924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.078624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.080005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.089948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:23:55.090741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:23:55.091447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:23:55.091938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:23:55.092353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:23:55.112505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.112998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.113629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.115368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.116403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.116999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.142818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Getting quotas for project 70295fa3676c40c88cee677a1dd84ac6. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:23:55.148944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Getting quotas for user 4610d60e4c154bd6ab5b66e238d4541e and project 70295fa3676c40c88cee677a1dd84ac6. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:23:55.162768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:23:55.165380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:23:55.236052 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb98f2b4-0c5a-4811-a32a-fe59aefdf815 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137974 Oct 17 15:23:55.245983 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 270/534] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:23:55.257015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:55.259531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:55.275073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.278583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.280363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.281806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.284501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.285113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.704198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:55.711108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:55.716175 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d24bbbd8-2cf7-4cae-8162-346417fafd67 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1323 microversion: 2.1 time: 0.467555 Oct 17 15:23:55.716761 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 271/535] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:55 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:55.737935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:55.743447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a6c145e8-f6fa-4e1e-86f2-126259a42278 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:55.744070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a6c145e8-f6fa-4e1e-86f2-126259a42278 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:55.755264 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6a6920c6-8662-4235-ae0d-c163dd8a0485 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1503 microversion: 2.1 time: 0.690858 Oct 17 15:23:55.758155 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 265/536] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:55 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1503 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:55.786717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:55.787650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:55.796754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.797665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.798981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.799941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.800899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.801650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.924839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6c145e8-f6fa-4e1e-86f2-126259a42278 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:55.933881 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a6c145e8-f6fa-4e1e-86f2-126259a42278 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1222 microversion: 2.1 time: 0.216074 Oct 17 15:23:55.934471 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 272/537] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:55 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1222 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:55.963047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:55.970311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:55.986146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.990021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.990740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:55.991744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:55.992588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:55.996540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:56.076121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:56.076598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:23:56.094716 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-efed95cb-16e4-4b52-9e90-485eb01cb31a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.315724 Oct 17 15:23:56.108802 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 266/538] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:55 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:56.122948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:56.126231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:56.140964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:56.142681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:56.145127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:56.147386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:56.148709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:56.149765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:56.219962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:56.233667 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1f37aed-86ad-4a9a-b615-d9fc8afe4754 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "DELETE /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 204 len: 0 microversion: 2.1 time: 0.280389 Oct 17 15:23:56.234956 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 273/539] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:23:55 2022] DELETE /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:23:56.245178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-94fd5807-a5e2-490f-9bb0-2604fc317591 req-33b010af-98e2-41a9-a8cc-9edabd165df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c92757-4ed7-4d61-9156-4add9affe762", "name": "network-vif-plugged", "status": "completed", "tag": "4a53f88e-978b-458e-8666-a0b33c244e39"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:23:56.259663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-94fd5807-a5e2-490f-9bb0-2604fc317591 req-33b010af-98e2-41a9-a8cc-9edabd165df6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:56.261672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-94fd5807-a5e2-490f-9bb0-2604fc317591 req-33b010af-98e2-41a9-a8cc-9edabd165df6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:56.262315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-94fd5807-a5e2-490f-9bb0-2604fc317591 req-33b010af-98e2-41a9-a8cc-9edabd165df6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:56.295317 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-94fd5807-a5e2-490f-9bb0-2604fc317591 req-33b010af-98e2-41a9-a8cc-9edabd165df6 service nova] Creating event network-vif-plugged:4a53f88e-978b-458e-8666-a0b33c244e39 for instance 24c92757-4ed7-4d61-9156-4add9affe762 on n-h2-854441-12 Oct 17 15:23:56.310782 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-94fd5807-a5e2-490f-9bb0-2604fc317591 req-33b010af-98e2-41a9-a8cc-9edabd165df6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074090 Oct 17 15:23:56.312216 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 274/540] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:23:56.322235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:56.323231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:56.346939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:56.349856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:56.350932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:56.352448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:56.354672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:56.356438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:56.430691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:56.442282 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-33a18541-bb28-4845-9c5b-8e2847dad99b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.331260 Oct 17 15:23:56.445372 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 267/541] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:56 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:56.603628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:56.613384 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7e21cd0-5847-4e34-9b10-f55670230f80 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1509 microversion: 2.1 time: 0.297987 Oct 17 15:23:56.613978 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 275/542] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:56 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:56.743498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:56.744634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:56.752821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:56.753487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:56.755122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:56.756330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:56.757179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:56.757720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:56.960732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:56.961345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:56.976433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:56.978617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:56.979076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:56.979786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:56.980239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:56.980661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:57.098652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:57.109261 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b43ce19-2d64-4597-af3b-dfd7fc048baf tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1323 microversion: 2.1 time: 0.368483 Oct 17 15:23:57.110765 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 268/543] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:56 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:57.123113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:57.124209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:57.133461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:57.134339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:57.135276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:57.136103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:57.136782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:57.138492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:57.278477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:57.292108 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42c9ec79-1d15-48ba-884a-cad1672bc056 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1274 microversion: 2.1 time: 0.335180 Oct 17 15:23:57.292738 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 276/544] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:56 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1274 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:57.332836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:57.348227 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b89fb26c-4deb-44ac-81a9-01d37eba1cae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.230454 Oct 17 15:23:57.349395 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 269/545] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:57 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:23:57.470653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:57.471487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:57.483930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:57.491298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:57.492000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:57.492987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:57.500175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:57.500955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:57.648422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:57.649626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:57.666648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:57.677320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:57.677900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:57.678699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:57.679173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:57.679594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:57.916979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:57.952529 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b74762e6-0afa-4f22-883a-58d97702c613 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1509 microversion: 2.1 time: 0.319119 Oct 17 15:23:57.955410 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 270/546] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:57 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:58.179591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:58.208393 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81057366-bff1-43ab-a1b3-125f2b4f1b5f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.742884 Oct 17 15:23:58.209253 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 277/547] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:57 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:58.223544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:58.224152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:58.241474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.246546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.247208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.248088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.248695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.249299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.273689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Calling method '.version_select at 0x7f28bf2398b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:58.277045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.278125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.280824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.318311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.319046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.319641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.332602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.333312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.333901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.341152 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c89e1ba1-69a8-4363-b2d4-c8bfe7dbe5ca tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.367411 Oct 17 15:23:58.342143 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 271/548] 10.222.0.87 () {60 vars in 1187 bytes} [Mon Oct 17 15:23:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:23:58.347943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:58.349091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:58.362208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.368867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.369761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.370721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.371280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.371772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.502319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:58.511872 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1804771a-fd50-4233-8a47-3525d1f86745 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1280 microversion: 2.1 time: 0.168456 Oct 17 15:23:58.526591 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 272/549] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:58 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:58.526591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4d7334b3-225a-4fa3-95d0-6dd2220563f4 tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Calling method '.version_select at 0x7f28bf1c00d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:58.530486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d7334b3-225a-4fa3-95d0-6dd2220563f4 tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.531124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d7334b3-225a-4fa3-95d0-6dd2220563f4 tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.531571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d7334b3-225a-4fa3-95d0-6dd2220563f4 tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.547105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d7334b3-225a-4fa3-95d0-6dd2220563f4 tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.547666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d7334b3-225a-4fa3-95d0-6dd2220563f4 tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.548109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d7334b3-225a-4fa3-95d0-6dd2220563f4 tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.556024 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4d7334b3-225a-4fa3-95d0-6dd2220563f4 tempest-HypervisorAdminV228Test-1226424956 tempest-HypervisorAdminV228Test-1226424956-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.040808 Oct 17 15:23:58.557283 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 273/550] 10.222.0.87 () {60 vars in 1193 bytes} [Mon Oct 17 15:23:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:23:58.590698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:58.591332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:58.620174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.620671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.621110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.621832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.622295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:58.622774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:58.658532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:23:58.727758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:58.743368 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ba575db-0e02-42c7-b532-369e3493b2e5 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1323 microversion: 2.1 time: 0.532773 Oct 17 15:23:58.743937 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 278/551] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:58 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:58.981603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:58.982717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:58.998559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:58.999359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:59.000213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:59.002773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:59.005323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:59.006008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:59.021421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:23:59.041896 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9d05d800-ebac-4a74-96db-c43ae05d5bf1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.481507 Oct 17 15:23:59.043925 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 274/552] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:58 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:23:59.233360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:23:59.233972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:23:59.246793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:59.247326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:59.247762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:23:59.253344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:23:59.254537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:23:59.254537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:00.055206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:00.065880 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0be2d847-13ed-412c-a843-d92aebfa3c79 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1509 microversion: 2.1 time: 1.092158 Oct 17 15:24:00.070012 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 279/553] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:58 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1509 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:00.080749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:00.081379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:00.116592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:00.121412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:00.124482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:00.125471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:00.126229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:00.126981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:00.217135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:00.229254 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-26c33d34-add2-4144-b276-74cf6d1e832e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1391 microversion: 2.1 time: 0.999705 Oct 17 15:24:00.245177 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 275/554] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:23:59 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1391 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:00.257430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:00.258100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:00.274098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:00.275828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:00.276360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:00.276816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:00.277561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:00.282132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:00.284344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:00.543658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:00.552468 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8901a84e-87bc-4401-8fee-0881aeee2bce tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1323 microversion: 2.1 time: 0.306028 Oct 17 15:24:00.566331 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 276/555] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:00 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:00.577485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:00.587171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:00.595920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:00.596957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:00.597616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:00.598645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:00.599326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:00.600475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:00.707089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:00.745632 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e5942ab-66f6-4e05-b963-848aae0e4ee1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 0.665313 Oct 17 15:24:00.746665 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 280/556] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:00 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:00.781006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f2daee2a-7b80-449c-90a7-cc2409c77fb0 req-682116f4-c118-4f9c-b96c-5db5821c3c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd0517d-2f4c-45ab-bf34-038e5f1cdab3", "name": "network-vif-plugged", "status": "completed", "tag": "6ab0c236-83b6-4a4f-9f31-6a81cb2e9403"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:00.852069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f2daee2a-7b80-449c-90a7-cc2409c77fb0 req-682116f4-c118-4f9c-b96c-5db5821c3c6f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:00.859198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f2daee2a-7b80-449c-90a7-cc2409c77fb0 req-682116f4-c118-4f9c-b96c-5db5821c3c6f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:00.859980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f2daee2a-7b80-449c-90a7-cc2409c77fb0 req-682116f4-c118-4f9c-b96c-5db5821c3c6f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:00.897942 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f2daee2a-7b80-449c-90a7-cc2409c77fb0 req-682116f4-c118-4f9c-b96c-5db5821c3c6f service nova] Creating event network-vif-plugged:6ab0c236-83b6-4a4f-9f31-6a81cb2e9403 for instance 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 on n-h1-854441-12 Oct 17 15:24:00.916443 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f2daee2a-7b80-449c-90a7-cc2409c77fb0 req-682116f4-c118-4f9c-b96c-5db5821c3c6f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145787 Oct 17 15:24:00.917078 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 281/557] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:00.935260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6685c545-203b-4fd7-a96f-2302f0d4b68b req-22e6a055-2d0f-45f2-b525-afeadd4394da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b183b4-a45b-41de-8816-0081abe33337", "name": "network-vif-deleted", "tag": "30109548-6b0a-419e-b2a6-52a8b6d8c480"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:00.965296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6685c545-203b-4fd7-a96f-2302f0d4b68b req-22e6a055-2d0f-45f2-b525-afeadd4394da service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:00.969104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6685c545-203b-4fd7-a96f-2302f0d4b68b req-22e6a055-2d0f-45f2-b525-afeadd4394da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:00.969769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6685c545-203b-4fd7-a96f-2302f0d4b68b req-22e6a055-2d0f-45f2-b525-afeadd4394da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:01.008120 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6685c545-203b-4fd7-a96f-2302f0d4b68b req-22e6a055-2d0f-45f2-b525-afeadd4394da service nova] Creating event network-vif-deleted:30109548-6b0a-419e-b2a6-52a8b6d8c480 for instance 63b183b4-a45b-41de-8816-0081abe33337 on n-h2-854441-12 Oct 17 15:24:01.019203 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6685c545-203b-4fd7-a96f-2302f0d4b68b req-22e6a055-2d0f-45f2-b525-afeadd4394da service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095596 Oct 17 15:24:01.023436 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 282/558] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:01.101410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:01.115915 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-968abb3e-5fdf-4fbe-b4a2-bd3636a5b6d3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.548059 Oct 17 15:24:01.119438 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 277/559] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:00 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:01.151644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:01.153001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:01.168320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:01.171276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:01.174947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:01.176100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:01.178989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:01.179662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:01.275239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:01.275878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:01.276208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:01.276686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lazy-loading 'fault' on Instance uuid 63b183b4-a45b-41de-8816-0081abe33337 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:24:01.387763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f03f4f86-4a98-4d50-95f0-9d07274dbcbd tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Action: 'create', calling method: .version_select at 0x7f28bf3a0700>, body: {"keypair": {"name": "tempest-keypair-580459187", "type": "ssh", "user_id": "d8ea9b6bc6c44792ab7030b5229c2b39", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi6yf26I70WpAZSK2zxadV/RNwUOOadP9b1kGG6w4ogis3r6wHoTe1JLidv09S1+GL3bM7fcyN8Evpj6WGWKeOnd/K5TZShhKJuKlqYRoLOIV2NygV1wkbw3QXzyW0Svw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:01.446600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f03f4f86-4a98-4d50-95f0-9d07274dbcbd tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Getting quotas for project 88fef549fdb243c7b8a9d8c1c428d739. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:01.459840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f03f4f86-4a98-4d50-95f0-9d07274dbcbd tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Getting quotas for user 8c3206c6c78d4f8483007a247c577670 and project 88fef549fdb243c7b8a9d8c1c428d739. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:01.528263 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f03f4f86-4a98-4d50-95f0-9d07274dbcbd tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.437997 Oct 17 15:24:01.529361 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 283/560] 10.222.0.87 () {62 vars in 1200 bytes} [Mon Oct 17 15:24:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 441 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 17 15:24:01.538546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:01.545615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:01.554328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:01.555272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:01.555961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:01.557461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:01.558119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:01.558807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:01.586070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b27f5649414601a1b66c0a63b8f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7270241d5a1941dca114d49e3920ef9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:01.624345 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07a9fee4-e8fc-478a-964e-c5361c3515ad tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 200 len: 1305 microversion: 2.1 time: 0.466799 Oct 17 15:24:01.627895 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 278/561] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:01 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 1305 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:01.637456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0be1ea5f-f08a-4939-af3c-e5bd12e4814d tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Action: 'create', calling method: .version_select at 0x7f28bf32f310>, body: {"keypair": {"name": "tempest-keypair-798619170", "type": "ssh", "user_id": "d8ea9b6bc6c44792ab7030b5229c2b39", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/u2j9HR1CQW4/owmpGd4zEMnpRquRVgC0Jf9oyTAjHt2tOHOZg3B7O4vDLFsgH9nfS4tnzSDVWoFupTwwdUaSjnAb5EbHg4m5ni0bR0SH88tAkkzwnJ6huBvnVjh71yg=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:01.669557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-0be1ea5f-f08a-4939-af3c-e5bd12e4814d tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Getting quotas for project 88fef549fdb243c7b8a9d8c1c428d739. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:01.679776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-0be1ea5f-f08a-4939-af3c-e5bd12e4814d tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Getting quotas for user 8c3206c6c78d4f8483007a247c577670 and project 88fef549fdb243c7b8a9d8c1c428d739. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:01.709105 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0be1ea5f-f08a-4939-af3c-e5bd12e4814d tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.079744 Oct 17 15:24:01.710110 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 279/562] 10.222.0.87 () {62 vars in 1200 bytes} [Mon Oct 17 15:24:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 15:24:01.715685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:01.716971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:01.724436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:01.725017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:01.725584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:01.726303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:01.726862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:01.727399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:01.872127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:01.886470 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39af9692-d917-45cc-9ab7-7232f4d08897 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1589 microversion: 2.1 time: 0.355469 Oct 17 15:24:01.887371 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 284/563] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:01 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1589 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:01.898165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a9e11c9-840d-4bc7-8259-efd93bfb7e5b tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Calling method '.version_select at 0x7f28bf3a00d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:01.926690 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a9e11c9-840d-4bc7-8259-efd93bfb7e5b tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] 10.222.0.87 "GET /compute/v2.1/os-keypairs/tempest-keypair-580459187?user_id=d8ea9b6bc6c44792ab7030b5229c2b39" status: 200 len: 511 microversion: 2.10 time: 0.033702 Oct 17 15:24:01.927341 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 285/564] 10.222.0.87 () {60 vars in 1337 bytes} [Mon Oct 17 15:24:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-580459187?user_id=d8ea9b6bc6c44792ab7030b5229c2b39 => generated 511 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:24:01.954763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:01.955486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:01.967104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:01.967612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:01.968111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:01.970019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:01.970854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:01.971768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.161533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:02.173980 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a20561aa-68af-4252-99cc-7f0d16c17ecd tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1323 microversion: 2.1 time: 0.462083 Oct 17 15:24:02.177398 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 280/565] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:01 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:02.206374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93909686-32d8-40e3-acdc-6b0855bdcdbc tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:02.208590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93909686-32d8-40e3-acdc-6b0855bdcdbc tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:02.230343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93909686-32d8-40e3-acdc-6b0855bdcdbc tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:02.231203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93909686-32d8-40e3-acdc-6b0855bdcdbc tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:02.232297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93909686-32d8-40e3-acdc-6b0855bdcdbc tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.233441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93909686-32d8-40e3-acdc-6b0855bdcdbc tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:02.234904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:02.235640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93909686-32d8-40e3-acdc-6b0855bdcdbc tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:02.236309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93909686-32d8-40e3-acdc-6b0855bdcdbc tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.246907 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c6e5500-079f-4818-b42d-9d533c90067b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 0.304955 Oct 17 15:24:02.250006 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 286/566] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:01 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:02.269046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2dbb4186-f56c-4387-8dfe-008805aa62e7 tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Action: 'create', calling method: .version_select at 0x7f28bf233ee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-963154434", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8Ru5bJNb+/nxuIQgawWEnDhqg/oWDMtnKMBunsUWwLwkdHhrXCdjL2mKYebJusftHuh5y4zJJsEPwgTOVexePOHSg15ayRloPGmqy469kQo3+PT2QPzcE0uACqk2nAwQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:02.293749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2dbb4186-f56c-4387-8dfe-008805aa62e7 tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Getting quotas for project 88fef549fdb243c7b8a9d8c1c428d739. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:02.300153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2dbb4186-f56c-4387-8dfe-008805aa62e7 tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Getting quotas for user 8c3206c6c78d4f8483007a247c577670 and project 88fef549fdb243c7b8a9d8c1c428d739. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:02.339659 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2dbb4186-f56c-4387-8dfe-008805aa62e7 tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.088102 Oct 17 15:24:02.343515 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 287/567] 10.222.0.87 () {62 vars in 1200 bytes} [Mon Oct 17 15:24:02 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 15:24:02.357320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:02.358541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:02.373420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:02.374094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:02.375220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.376215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:02.377197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:02.377838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.621714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:02.635632 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62ba63c7-2c28-4e64-9ea3-3bacf1554347 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.288349 Oct 17 15:24:02.637412 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 288/568] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:02 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:02.655299 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-93909686-32d8-40e3-acdc-6b0855bdcdbc tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.474925 Oct 17 15:24:02.655835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0875f3ba-30c7-4d93-a8f6-394406958c06 req-0937407e-a259-4296-8a01-215a0a4b0c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83fb150-6289-480d-bed1-dd6363c26326", "tag": "bcc058ce-4e6f-4b7b-b2d8-203f083df3d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:02.666118 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 281/569] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:24:02 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762/os-interface => generated 284 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:02.671198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8e4e539c-324b-4d55-8b97-373a814fc45a tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Calling method '.version_select at 0x7f28bf57f700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:02.676840 n-d-854441-12 devstack@n-api.service[120407]: WARNING oslo_db.sqlalchemy.utils [None req-8e4e539c-324b-4d55-8b97-373a814fc45a tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 15:24:02.685827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0875f3ba-30c7-4d93-a8f6-394406958c06 req-0937407e-a259-4296-8a01-215a0a4b0c7f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:02.686074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0875f3ba-30c7-4d93-a8f6-394406958c06 req-0937407e-a259-4296-8a01-215a0a4b0c7f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:02.686776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0875f3ba-30c7-4d93-a8f6-394406958c06 req-0937407e-a259-4296-8a01-215a0a4b0c7f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.687245 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8e4e539c-324b-4d55-8b97-373a814fc45a tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] 10.222.0.87 "GET /compute/v2.1/os-keypairs?user_id=d8ea9b6bc6c44792ab7030b5229c2b39" status: 200 len: 724 microversion: 2.10 time: 0.019538 Oct 17 15:24:02.688010 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 282/570] 10.222.0.87 () {60 vars in 1259 bytes} [Mon Oct 17 15:24:02 2022] GET /compute/v2.1/os-keypairs?user_id=d8ea9b6bc6c44792ab7030b5229c2b39 => generated 724 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:24:02.693814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:02.694761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:02.712047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:02.714750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:02.715319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.716167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:02.717466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:02.719394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.757524 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] HTTP exception thrown: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Request method failure captured: Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 HTTP/1.1 Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXN1jrR1yYhADIupbu8JjZCPyYonbg6oJZqCBh6qiLi5dvVYD6w195Vm1kJZgrb8Tbr53p-8e8aeDWHySFpE4xWoZUQJMnQhiR5SaqbGPCzUUMsB758rUSBruytQR63Nk4WnXkPmEq0o_QtEQpbssxx0wWVzS5LkPwMsCWy3gH_gBio Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:24:02.764576 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 62b27f5649414601a1b66c0a63b8f3b2 Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.766884 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '63b183b4-a45b-41de-8816-0081abe33337'} Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:02.767831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.769250 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.771563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Returning 404 to user: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:02.775731 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-38f28026-91ce-4be4-ad2e-2cb695a4c892 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 404 len: 111 microversion: 2.1 time: 0.084116 Oct 17 15:24:02.776537 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 283/571] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:02 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:02.777995 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0875f3ba-30c7-4d93-a8f6-394406958c06 req-0937407e-a259-4296-8a01-215a0a4b0c7f service nova] Creating event network-changed:bcc058ce-4e6f-4b7b-b2d8-203f083df3d9 for instance f83fb150-6289-480d-bed1-dd6363c26326 on n-h1-854441-12 Oct 17 15:24:02.787433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-32cc7a9e-91d2-47ab-9c1b-cc978324e857 tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Calling method '.version_select at 0x7f28bf1c0160>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:02.800206 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0875f3ba-30c7-4d93-a8f6-394406958c06 req-0937407e-a259-4296-8a01-215a0a4b0c7f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154409 Oct 17 15:24:02.807242 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 289/572] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:02.822163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-567011336", "metadata": {"image_type": "test"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:02.829577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:02.843418 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-32cc7a9e-91d2-47ab-9c1b-cc978324e857 tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-963154434" status: 204 len: 0 microversion: 2.10 time: 0.065552 Oct 17 15:24:02.844159 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 284/573] 10.222.0.87 () {60 vars in 1322 bytes} [Mon Oct 17 15:24:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-963154434 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:24:02.852929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f0dd3b0c-de39-4b84-b62c-6a1e3313bc9f tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Calling method '.version_select at 0x7f28bf1e44c0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:02.863080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:02.863825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:02.864310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.866289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:02.866821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:02.867312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:02.903015 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] HTTP exception thrown: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Request method failure captured: Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337/action HTTP/1.1 Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 111 Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXN1jrR1yYhADIupbu8JjZCPyYonbg6oJZqCBh6qiLi5dvVYD6w195Vm1kJZgrb8Tbr53p-8e8aeDWHySFpE4xWoZUQJMnQhiR5SaqbGPCzUUMsB758rUSBruytQR63Nk4WnXkPmEq0o_QtEQpbssxx0wWVzS5LkPwMsCWy3gH_gBio Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:24:02.906151 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 62b27f5649414601a1b66c0a63b8f3b2 Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-567011336", "metadata": {"image_type": "test"}}} Oct 17 15:24:02.907898 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '63b183b4-a45b-41de-8816-0081abe33337', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-567011336', 'metadata': {'image_type': 'test'}}}} Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:02.908736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.910207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:02.911562 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:02.911562 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:02.911562 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:02.911562 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:02.911562 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.911562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Returning 404 to user: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:02.911562 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f50cd91-f6fa-42d6-92c4-17c34a7ac0cf tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "POST /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337/action" status: 404 len: 111 microversion: 2.1 time: 0.091716 Oct 17 15:24:02.911562 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 290/574] 10.222.0.87 () {60 vars in 1279 bytes} [Mon Oct 17 15:24:02 2022] POST /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337/action => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:02.922363 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f0dd3b0c-de39-4b84-b62c-6a1e3313bc9f tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-798619170?user_id=d8ea9b6bc6c44792ab7030b5229c2b39" status: 204 len: 0 microversion: 2.10 time: 0.072535 Oct 17 15:24:02.923873 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 285/575] 10.222.0.87 () {60 vars in 1340 bytes} [Mon Oct 17 15:24:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-798619170?user_id=d8ea9b6bc6c44792ab7030b5229c2b39 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 15:24:02.940478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bcbcb775-6aa2-40cd-9179-11e60081dbbe tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] Calling method '.version_select at 0x7f28bf1e1ee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:02.941217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c94a3dd-ac65-4afa-931f-a23a03042862 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1273565371", "metadata": {"image_type": "test"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:02.945336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c94a3dd-ac65-4afa-931f-a23a03042862 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Failed to fetch instance by id tempest-invalid-707986359 {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 15:24:02.949806 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1c94a3dd-ac65-4afa-931f-a23a03042862 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] HTTP exception thrown: Instance tempest-invalid-707986359 could not be found. Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c94a3dd-ac65-4afa-931f-a23a03042862 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Request method failure captured: Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/tempest-invalid-707986359/action HTTP/1.1 Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 112 Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXN1jrR1yYhADIupbu8JjZCPyYonbg6oJZqCBh6qiLi5dvVYD6w195Vm1kJZgrb8Tbr53p-8e8aeDWHySFpE4xWoZUQJMnQhiR5SaqbGPCzUUMsB758rUSBruytQR63Nk4WnXkPmEq0o_QtEQpbssxx0wWVzS5LkPwMsCWy3gH_gBio Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:24:02.953211 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 62b27f5649414601a1b66c0a63b8f3b2 Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1273565371", "metadata": {"image_type": "test"}}} Oct 17 15:24:02.954644 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance tempest-invalid-707986359 could not be found. Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'tempest-invalid-707986359', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1273565371', 'metadata': {'image_type': 'test'}}}} Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-707986359 could not be found. Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:02.955345 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-707986359 could not be found. Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-707986359 could not be found. Oct 17 15:24:02.956474 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.958438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c94a3dd-ac65-4afa-931f-a23a03042862 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Returning 404 to user: Instance tempest-invalid-707986359 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:02.958438 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c94a3dd-ac65-4afa-931f-a23a03042862 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "POST /compute/v2.1/servers/tempest-invalid-707986359/action" status: 404 len: 100 microversion: 2.1 time: 0.030116 Oct 17 15:24:02.959567 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 291/576] 10.222.0.87 () {60 vars in 1246 bytes} [Mon Oct 17 15:24:02 2022] POST /compute/v2.1/servers/tempest-invalid-707986359/action => generated 100 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:02.971483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b8a450b-cd94-40bb-aff9-e99b97375c4c tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2074999834"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:02.976844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b8a450b-cd94-40bb-aff9-e99b97375c4c tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 15:24:02.977733 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5b8a450b-cd94-40bb-aff9-e99b97375c4c tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b8a450b-cd94-40bb-aff9-e99b97375c4c tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Request method failure captured: Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 57 Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXN1jrR1yYhADIupbu8JjZCPyYonbg6oJZqCBh6qiLi5dvVYD6w195Vm1kJZgrb8Tbr53p-8e8aeDWHySFpE4xWoZUQJMnQhiR5SaqbGPCzUUMsB758rUSBruytQR63Nk4WnXkPmEq0o_QtEQpbssxx0wWVzS5LkPwMsCWy3gH_gBio Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:24:02.979581 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 62b27f5649414601a1b66c0a63b8f3b2 Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: {"createImage": {"name": "tempest-test-snap-2074999834"}} Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:24:02.981116 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2074999834'}}} Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:02.981934 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:02.983327 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:02.986312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b8a450b-cd94-40bb-aff9-e99b97375c4c tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:02.987425 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b8a450b-cd94-40bb-aff9-e99b97375c4c tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.023852 Oct 17 15:24:02.989035 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 292/577] 10.222.0.87 () {60 vars in 1275 bytes} [Mon Oct 17 15:24:02 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:02.995559 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bcbcb775-6aa2-40cd-9179-11e60081dbbe tempest-KeyPairsV210TestJSON-1549284804 tempest-KeyPairsV210TestJSON-1549284804-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-580459187?user_id=d8ea9b6bc6c44792ab7030b5229c2b39" status: 204 len: 0 microversion: 2.10 time: 0.064932 Oct 17 15:24:03.000496 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 286/578] 10.222.0.87 () {60 vars in 1340 bytes} [Mon Oct 17 15:24:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-580459187?user_id=d8ea9b6bc6c44792ab7030b5229c2b39 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:24:03.001098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1afff12d-4f1d-45ed-b961-1177bc0d0aee tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1911732751"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:03.004661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1afff12d-4f1d-45ed-b961-1177bc0d0aee tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 15:24:03.006174 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1afff12d-4f1d-45ed-b961-1177bc0d0aee tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1afff12d-4f1d-45ed-b961-1177bc0d0aee tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Request method failure captured: Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 57 Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXN1jrR1yYhADIupbu8JjZCPyYonbg6oJZqCBh6qiLi5dvVYD6w195Vm1kJZgrb8Tbr53p-8e8aeDWHySFpE4xWoZUQJMnQhiR5SaqbGPCzUUMsB758rUSBruytQR63Nk4WnXkPmEq0o_QtEQpbssxx0wWVzS5LkPwMsCWy3gH_gBio Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:24:03.008592 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 62b27f5649414601a1b66c0a63b8f3b2 Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: {"createImage": {"name": "tempest-test-snap-1911732751"}} Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:24:03.010194 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1911732751'}}} Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:03.011004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 15:24:03.012122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.013325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1afff12d-4f1d-45ed-b961-1177bc0d0aee tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:03.013325 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1afff12d-4f1d-45ed-b961-1177bc0d0aee tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.017946 Oct 17 15:24:03.020660 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 293/579] 10.222.0.87 () {60 vars in 1281 bytes} [Mon Oct 17 15:24:02 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:03.028018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:03.029336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:03.044745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.045874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.047041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.048447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.049930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.051429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.093631 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] HTTP exception thrown: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Request method failure captured: Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 HTTP/1.1 Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXN1jrR1yYhADIupbu8JjZCPyYonbg6oJZqCBh6qiLi5dvVYD6w195Vm1kJZgrb8Tbr53p-8e8aeDWHySFpE4xWoZUQJMnQhiR5SaqbGPCzUUMsB758rUSBruytQR63Nk4WnXkPmEq0o_QtEQpbssxx0wWVzS5LkPwMsCWy3gH_gBio Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:24:03.100125 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 62b27f5649414601a1b66c0a63b8f3b2 Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.101368 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '63b183b4-a45b-41de-8816-0081abe33337'} Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:03.102332 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.103493 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.120890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Returning 404 to user: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:03.121987 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20cb3fa2-5bf3-4d09-b938-52e647d573c1 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "DELETE /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 404 len: 111 microversion: 2.1 time: 0.100025 Oct 17 15:24:03.123354 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 287/580] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:24:03 2022] DELETE /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:03.132708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:03.133788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] [instance: 63b183b4-a45b-41de-8816-0081abe33337] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:03.150282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.152582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.153671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.158147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.158336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.160689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.188278 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] HTTP exception thrown: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Request method failure captured: Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 HTTP/1.1 Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXN1jrR1yYhADIupbu8JjZCPyYonbg6oJZqCBh6qiLi5dvVYD6w195Vm1kJZgrb8Tbr53p-8e8aeDWHySFpE4xWoZUQJMnQhiR5SaqbGPCzUUMsB758rUSBruytQR63Nk4WnXkPmEq0o_QtEQpbssxx0wWVzS5LkPwMsCWy3gH_gBio Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:24:03.199352 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7270241d5a1941dca114d49e3920ef9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 7270241d5a1941dca114d49e3920ef9e Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1471731268 Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 62b27f5649414601a1b66c0a63b8f3b2 Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesNegativeTestJSON-1471731268-project Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.200990 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '63b183b4-a45b-41de-8816-0081abe33337'} Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:03.201799 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. Oct 17 15:24:03.203418 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.206806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] Returning 404 to user: Instance 63b183b4-a45b-41de-8816-0081abe33337 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:03.209117 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eec5e6c4-dcb3-4efe-856d-0d4688e800a6 tempest-ImagesNegativeTestJSON-1471731268 tempest-ImagesNegativeTestJSON-1471731268-project] 10.222.0.87 "GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337" status: 404 len: 111 microversion: 2.1 time: 0.081787 Oct 17 15:24:03.209689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:03.210349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:03.218702 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 294/581] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:03 2022] GET /compute/v2.1/servers/63b183b4-a45b-41de-8816-0081abe33337 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:03.226339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.227065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.227568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.228838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.233389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.233747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.279038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:03.280069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:03.299927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.300865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.302103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.303120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.303802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.304435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.624647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:03.633852 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-119e8e22-e4a7-48c6-bb09-fa7bc9fe6b5c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1472 microversion: 2.1 time: 0.435929 Oct 17 15:24:03.634453 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 288/582] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:03 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1472 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:03.660075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:03.660814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:03.669801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.670129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.670803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.671768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.672385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.673026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.701992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Request method failure captured: Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3/diagnostics HTTP/1.1 Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXN6M6qsgaGKPwTIRp1FKB0z0NtpOWdp9842_HWZwP-5KooKVJ9aq4lBA2ziD_j1Z4yBYC7XSAwnuOD0VB5h0EJ3CjTClnTejZ3jKSyULVoUq7OMhd8xIQ_fvTMg3Yh-_5AGFqPYT3A2TrnYCX1_PEXMAGN_oyK8PR5fH78eaBTUfNo Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: cae57be8e41a4dea89fbefef358d0ed1 Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1048093212 Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:24:03.705289 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cae57be8e41a4dea89fbefef358d0ed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cae57be8e41a4dea89fbefef358d0ed1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cae57be8e41a4dea89fbefef358d0ed1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cae57be8e41a4dea89fbefef358d0ed1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1048093212 Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: cae57be8e41a4dea89fbefef358d0ed1 Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1048093212 Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerDiagnosticsNegativeTest-1048093212-project Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 91084e2fdf5d4a7c8c8b0fb7b4a6b001 Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1048093212-project Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:24:03.706636 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'server_id': '4fd0517d-2f4c-45ab-bf34-038e5f1cdab3'} Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:24:03.707513 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 15:24:03.708860 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:03.711797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:03.713160 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-73b63afd-7cae-4f00-ab04-f145bd4965a2 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.059169 Oct 17 15:24:03.717827 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 289/583] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:24:03 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3/diagnostics => generated 117 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:24:03.730123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:03.731313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:03.741358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.741876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.742386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:03.743243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:03.743705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:03.744315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:04.011848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:04.027319 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c28f8a07-9fcd-496e-9f27-b4f8eb9f517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.307039 Oct 17 15:24:04.043159 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 290/584] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:03 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:04.059214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:04.063323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:04.087082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:04.087634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:04.088081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:04.088820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:04.089283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:04.089715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:04.161572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:24:04.264330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:04.278179 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d7893e8-dab6-49a0-bf9f-b8e4d638485b tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 1.001709 Oct 17 15:24:04.279733 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 295/585] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:03 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:04.340106 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2ef1893-227e-4245-8590-fe7684b2e5eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 204 len: 0 microversion: 2.1 time: 0.293252 Oct 17 15:24:04.341891 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 291/586] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:24:04 2022] DELETE /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:24:04.352417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:04.353400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:04.363870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:04.364745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:04.365349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:04.367518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:04.368901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:04.369497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:04.923275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:04.933898 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8b29e40-795e-4aee-8fbb-9d4eade61d30 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1478 microversion: 2.1 time: 0.586513 Oct 17 15:24:04.934488 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 296/587] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:04 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1478 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:05.057503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.058087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:05.068202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.068918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.069298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.071754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.072114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.072622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.137307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:05.233478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b9740e0-4cc1-4e7d-b659-8c37f1ef0885 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Calling method '.version_select at 0x7f28bf2399d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.235756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2b9740e0-4cc1-4e7d-b659-8c37f1ef0885 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '8aeac6b1cc4d47f68ff300047e64c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8eb4278a384c5da6d20d6847f7def8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b9740e0-4cc1-4e7d-b659-8c37f1ef0885 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Request method failure captured: Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOTxPkOXC0M0qgpwULBenwsVbZQ_nlmVmyAHT5S6fEbpzMY65SeCORmwcGe5m1iyzurkkCQS21RSI5ktV25YCgw9kAanL_D9CZPtEinUOvRgZdPjYUb2mP72XunCjBGgQ9irKTCgo5DZWYndI11Zv_mJ2hPOWBqDGbGQAHRJAp9wyo Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:24:05.237559 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8aeac6b1cc4d47f68ff300047e64c89b Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: action_args: {} Oct 17 15:24:05.239059 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:24:05.240106 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 15:24:05.241417 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.242873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b9740e0-4cc1-4e7d-b659-8c37f1ef0885 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:05.242873 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2b9740e0-4cc1-4e7d-b659-8c37f1ef0885 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.297877 Oct 17 15:24:05.246695 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 292/588] 10.222.0.87 () {58 vars in 1167 bytes} [Mon Oct 17 15:24:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 305 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:05.251860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bcfaffd3-3c9b-42b8-9f1d-d4fe31f85dad tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Calling method '.version_select at 0x7f28bf1c0dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.254330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bcfaffd3-3c9b-42b8-9f1d-d4fe31f85dad tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '8aeac6b1cc4d47f68ff300047e64c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8eb4278a384c5da6d20d6847f7def8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bcfaffd3-3c9b-42b8-9f1d-d4fe31f85dad tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Request method failure captured: Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOTxPkOXC0M0qgpwULBenwsVbZQ_nlmVmyAHT5S6fEbpzMY65SeCORmwcGe5m1iyzurkkCQS21RSI5ktV25YCgw9kAanL_D9CZPtEinUOvRgZdPjYUb2mP72XunCjBGgQ9irKTCgo5DZWYndI11Zv_mJ2hPOWBqDGbGQAHRJAp9wyo Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:24:05.258845 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8aeac6b1cc4d47f68ff300047e64c89b Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: action_args: {} Oct 17 15:24:05.260773 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:24:05.261737 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 15:24:05.263194 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.264594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bcfaffd3-3c9b-42b8-9f1d-d4fe31f85dad tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:05.264594 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bcfaffd3-3c9b-42b8-9f1d-d4fe31f85dad tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.013761 Oct 17 15:24:05.264594 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 293/589] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:05.276089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9ae7e8d-f204-4dd9-9989-7d99309f4fc0 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Calling method '.version_select at 0x7f28bf1f8160>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.278132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9ae7e8d-f204-4dd9-9989-7d99309f4fc0 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '8aeac6b1cc4d47f68ff300047e64c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8eb4278a384c5da6d20d6847f7def8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9ae7e8d-f204-4dd9-9989-7d99309f4fc0 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Request method failure captured: Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOTxPkOXC0M0qgpwULBenwsVbZQ_nlmVmyAHT5S6fEbpzMY65SeCORmwcGe5m1iyzurkkCQS21RSI5ktV25YCgw9kAanL_D9CZPtEinUOvRgZdPjYUb2mP72XunCjBGgQ9irKTCgo5DZWYndI11Zv_mJ2hPOWBqDGbGQAHRJAp9wyo Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:24:05.287642 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8aeac6b1cc4d47f68ff300047e64c89b Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: action_args: {} Oct 17 15:24:05.289130 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:24:05.296105 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 15:24:05.297223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.298224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9ae7e8d-f204-4dd9-9989-7d99309f4fc0 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:05.298224 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9ae7e8d-f204-4dd9-9989-7d99309f4fc0 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.018826 Oct 17 15:24:05.298224 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 294/590] 10.222.0.87 () {58 vars in 1179 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:05.388362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Calling method '.version_select at 0x7f28bf365700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.390492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.391282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.391888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.415432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.416477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.417816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.433955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.434909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.435576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.443967 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f32e4cd9-aee6-4a73-a6fc-43ac8b686bf3 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.148046 Oct 17 15:24:05.445406 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 295/591] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:05.451022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.452131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:05.461059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.461997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.462799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.463882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.464556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.465414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.530974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:05.536709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:05.550323 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad055243-1d0c-4c91-9ea0-e66cdc0d8f7b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.496827 Oct 17 15:24:05.551576 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 297/592] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:05.556061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c80ffdb-364b-47a3-9699-e13970c27ae4 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Calling method '.version_select at 0x7f28bf4c24c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.557849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c80ffdb-364b-47a3-9699-e13970c27ae4 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '8aeac6b1cc4d47f68ff300047e64c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8eb4278a384c5da6d20d6847f7def8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c80ffdb-364b-47a3-9699-e13970c27ae4 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Request method failure captured: Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOTxPkOXC0M0qgpwULBenwsVbZQ_nlmVmyAHT5S6fEbpzMY65SeCORmwcGe5m1iyzurkkCQS21RSI5ktV25YCgw9kAanL_D9CZPtEinUOvRgZdPjYUb2mP72XunCjBGgQ9irKTCgo5DZWYndI11Zv_mJ2hPOWBqDGbGQAHRJAp9wyo Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:24:05.559458 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8aeac6b1cc4d47f68ff300047e64c89b Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1'} Oct 17 15:24:05.560696 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:24:05.561483 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 15:24:05.563750 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.564728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c80ffdb-364b-47a3-9699-e13970c27ae4 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:05.564728 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c80ffdb-364b-47a3-9699-e13970c27ae4 tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.008591 Oct 17 15:24:05.574870 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 298/593] 10.222.0.87 () {58 vars in 1173 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:05.584248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e541dcb0-362f-492a-a1a5-16fc7cd6a214 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Calling method '.version_select at 0x7f28bf20e3a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.585949 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e541dcb0-362f-492a-a1a5-16fc7cd6a214 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] HTTP exception thrown: Hypervisor with ID 'c1f6bd04-1549-443f-815e-a0cdd8fd2821' could not be found. Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e541dcb0-362f-492a-a1a5-16fc7cd6a214 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Request method failure captured: Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/c1f6bd04-1549-443f-815e-a0cdd8fd2821/uptime HTTP/1.1 Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOUfQ3QE_MO-93ZDPzM3SXjR0lDzizRcAI7DFo7jA86Zen61xSv-e7eYAOryE9YNveLpwmDdzCHf0bwKoaU7eJrD-tqxjhgqwY2MvUt5p5Oh-YA8xS38fBmOjxY-tgvCly2RdzEELmbZDquS5A2lHc2tQEnh20xNZuLsZkBkykDdRM Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 93af342849384015ba26a7b7c33f0071 Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-41881440 Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:24:05.601352 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93af342849384015ba26a7b7c33f0071"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/93af342849384015ba26a7b7c33f0071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_93af342849384015ba26a7b7c33f0071"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93af342849384015ba26a7b7c33f0071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-41881440 Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 93af342849384015ba26a7b7c33f0071 Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-41881440 Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: d58bf7d3bd95479da232e5a9016fdcb0 Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: exception: Hypervisor with ID 'c1f6bd04-1549-443f-815e-a0cdd8fd2821' could not be found. Oct 17 15:24:05.602926 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'c1f6bd04-1549-443f-815e-a0cdd8fd2821'} Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c1f6bd04-1549-443f-815e-a0cdd8fd2821' Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 17 15:24:05.603669 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c1f6bd04-1549-443f-815e-a0cdd8fd2821' could not be found. Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.604963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c1f6bd04-1549-443f-815e-a0cdd8fd2821' could not be found. Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e541dcb0-362f-492a-a1a5-16fc7cd6a214 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Returning 404 to user: Hypervisor with ID 'c1f6bd04-1549-443f-815e-a0cdd8fd2821' could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e541dcb0-362f-492a-a1a5-16fc7cd6a214 tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/c1f6bd04-1549-443f-815e-a0cdd8fd2821/uptime" status: 404 len: 123 microversion: 2.1 time: 0.027094 Oct 17 15:24:05.608146 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 299/594] 10.222.0.87 () {58 vars in 1278 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/os-hypervisors/c1f6bd04-1549-443f-815e-a0cdd8fd2821/uptime => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:05.613161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Calling method '.version_select at 0x7f28bf287ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.616126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.616621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.617053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.656316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.656828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.657273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.693229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:05.693229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:05.693229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:05.706321 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-41e80141-0308-445c-952f-63ece4ca231d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.097167 Oct 17 15:24:05.722938 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 300/595] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:05.733745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48427f3a-66fd-4c82-a92f-c52257d7b95e tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Calling method '.version_select at 0x7f28bf3a01f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.735829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-48427f3a-66fd-4c82-a92f-c52257d7b95e tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '8aeac6b1cc4d47f68ff300047e64c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8eb4278a384c5da6d20d6847f7def8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48427f3a-66fd-4c82-a92f-c52257d7b95e tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Request method failure captured: Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOTxPkOXC0M0qgpwULBenwsVbZQ_nlmVmyAHT5S6fEbpzMY65SeCORmwcGe5m1iyzurkkCQS21RSI5ktV25YCgw9kAanL_D9CZPtEinUOvRgZdPjYUb2mP72XunCjBGgQ9irKTCgo5DZWYndI11Zv_mJ2hPOWBqDGbGQAHRJAp9wyo Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:24:05.737472 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ee8eb4278a384c5da6d20d6847f7def8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ee8eb4278a384c5da6d20d6847f7def8 Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788 Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8aeac6b1cc4d47f68ff300047e64c89b Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1287575788-project Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1'} Oct 17 15:24:05.739219 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:24:05.739964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 15:24:05.741376 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.742577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48427f3a-66fd-4c82-a92f-c52257d7b95e tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:05.744066 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48427f3a-66fd-4c82-a92f-c52257d7b95e tempest-HypervisorAdminNegativeTestJSON-1287575788 tempest-HypervisorAdminNegativeTestJSON-1287575788-project] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.014871 Oct 17 15:24:05.749659 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 301/596] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:05.764026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a59ec477-057e-478a-a248-07ef5aacf51d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Calling method '.version_select at 0x7f28bf326310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.765627 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a59ec477-057e-478a-a248-07ef5aacf51d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] HTTP exception thrown: Hypervisor with ID 'f09c332b-ed95-4083-88c6-fdbfa06db28c' could not be found. Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a59ec477-057e-478a-a248-07ef5aacf51d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Request method failure captured: Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-hypervisors/f09c332b-ed95-4083-88c6-fdbfa06db28c HTTP/1.1 Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOUfQ3QE_MO-93ZDPzM3SXjR0lDzizRcAI7DFo7jA86Zen61xSv-e7eYAOryE9YNveLpwmDdzCHf0bwKoaU7eJrD-tqxjhgqwY2MvUt5p5Oh-YA8xS38fBmOjxY-tgvCly2RdzEELmbZDquS5A2lHc2tQEnh20xNZuLsZkBkykDdRM Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 93af342849384015ba26a7b7c33f0071 Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-41881440 Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:24:05.767350 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93af342849384015ba26a7b7c33f0071"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/93af342849384015ba26a7b7c33f0071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_93af342849384015ba26a7b7c33f0071"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93af342849384015ba26a7b7c33f0071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-41881440 Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 93af342849384015ba26a7b7c33f0071 Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-41881440 Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: d58bf7d3bd95479da232e5a9016fdcb0 Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: exception: Hypervisor with ID 'f09c332b-ed95-4083-88c6-fdbfa06db28c' could not be found. Oct 17 15:24:05.768602 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'f09c332b-ed95-4083-88c6-fdbfa06db28c'} Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f09c332b-ed95-4083-88c6-fdbfa06db28c' Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 17 15:24:05.769316 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:24:05.771292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f09c332b-ed95-4083-88c6-fdbfa06db28c' could not be found. Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f09c332b-ed95-4083-88c6-fdbfa06db28c' could not be found. Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a59ec477-057e-478a-a248-07ef5aacf51d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] Returning 404 to user: Hypervisor with ID 'f09c332b-ed95-4083-88c6-fdbfa06db28c' could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:05.774355 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a59ec477-057e-478a-a248-07ef5aacf51d tempest-HypervisorAdminNegativeTestJSON-41881440 tempest-HypervisorAdminNegativeTestJSON-41881440-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors/f09c332b-ed95-4083-88c6-fdbfa06db28c" status: 404 len: 123 microversion: 2.1 time: 0.012702 Oct 17 15:24:05.802682 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 302/597] 10.222.0.87 () {58 vars in 1257 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/os-hypervisors/f09c332b-ed95-4083-88c6-fdbfa06db28c => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:05.985532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:05.988683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:06.045342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:06.048000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:06.051996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:06.054440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:06.057438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:06.057893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:06.440547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:06.450420 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8930421a-4e09-407a-81c0-58d61833349d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 1.003692 Oct 17 15:24:06.453888 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 296/598] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:06.578295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:06.579236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:06.604809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:06.612450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:06.617475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:06.621435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:06.622242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:06.625428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:06.939979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:06.949673 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd5bddd6-6114-4a8f-9976-0afaf0dc0d2c tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1478 microversion: 2.1 time: 0.991665 Oct 17 15:24:06.954766 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 303/599] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:05 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1478 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:07.231820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:07.241287 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2763a239-30c0-4378-aa63-b8295276183c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.667596 Oct 17 15:24:07.247721 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 297/600] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:06 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:07.315940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:07.316929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:07.340526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:07.340979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-81d34b29-3f13-4174-8d4f-15db2b6a26dc req-bb128165-ca1b-4fed-9206-e61237468650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c92757-4ed7-4d61-9156-4add9affe762", "tag": "4a53f88e-978b-458e-8666-a0b33c244e39"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:07.344469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:07.345903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:07.348461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:07.355458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:07.355943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:07.361960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-81d34b29-3f13-4174-8d4f-15db2b6a26dc req-bb128165-ca1b-4fed-9206-e61237468650 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:07.362980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-81d34b29-3f13-4174-8d4f-15db2b6a26dc req-bb128165-ca1b-4fed-9206-e61237468650 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:07.363625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-81d34b29-3f13-4174-8d4f-15db2b6a26dc req-bb128165-ca1b-4fed-9206-e61237468650 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:07.382713 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-81d34b29-3f13-4174-8d4f-15db2b6a26dc req-bb128165-ca1b-4fed-9206-e61237468650 service nova] Creating event network-changed:4a53f88e-978b-458e-8666-a0b33c244e39 for instance 24c92757-4ed7-4d61-9156-4add9affe762 on n-h2-854441-12 Oct 17 15:24:07.408817 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-81d34b29-3f13-4174-8d4f-15db2b6a26dc req-bb128165-ca1b-4fed-9206-e61237468650 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072734 Oct 17 15:24:07.410792 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 298/601] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:07.481274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:07.483267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:07.517757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:07.518776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:07.519444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:07.521028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:07.522401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:07.524870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:07.824969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:07.839444 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c85e1ebf-c6a4-4eb6-b5bc-e43734ddc126 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 200 len: 1589 microversion: 2.1 time: 0.527629 Oct 17 15:24:07.840173 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 304/602] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:07 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 1589 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:07.973521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:07.974922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:07.987168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:07.987884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:07.990064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:07.990923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:07.991407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:07.995839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:08.404184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:08.416010 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d051539-3386-440d-881f-b767d6c8d4d8 tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1478 microversion: 2.1 time: 0.446640 Oct 17 15:24:08.416621 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 305/603] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:07 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1478 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:08.427435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:08.431811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:08.446966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:08.451281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:08.452724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:08.456216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:08.459118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:08.466107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:08.471742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:08.474119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:08.495041 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ccff5cc4-2aff-4aa5-bc67-6134efe84e49 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 1.014117 Oct 17 15:24:08.496216 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 299/604] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:07 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:08.537400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-af9d6fe1-eaea-47bf-ae6e-416dc82e7b2b req-d46e861f-c18b-4ac0-bdf2-c5de7bd249f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd0517d-2f4c-45ab-bf34-038e5f1cdab3", "name": "network-vif-deleted", "tag": "6ab0c236-83b6-4a4f-9f31-6a81cb2e9403"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:08.560205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-af9d6fe1-eaea-47bf-ae6e-416dc82e7b2b req-d46e861f-c18b-4ac0-bdf2-c5de7bd249f1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:08.560884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-af9d6fe1-eaea-47bf-ae6e-416dc82e7b2b req-d46e861f-c18b-4ac0-bdf2-c5de7bd249f1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:08.562970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-af9d6fe1-eaea-47bf-ae6e-416dc82e7b2b req-d46e861f-c18b-4ac0-bdf2-c5de7bd249f1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:08.595330 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-af9d6fe1-eaea-47bf-ae6e-416dc82e7b2b req-d46e861f-c18b-4ac0-bdf2-c5de7bd249f1 service nova] Creating event network-vif-deleted:6ab0c236-83b6-4a4f-9f31-6a81cb2e9403 for instance 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 on n-h1-854441-12 Oct 17 15:24:08.604477 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-af9d6fe1-eaea-47bf-ae6e-416dc82e7b2b req-d46e861f-c18b-4ac0-bdf2-c5de7bd249f1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073220 Oct 17 15:24:08.605935 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 300/605] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:08.929495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:08.955064 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac26fc87-c02f-4585-80ca-949e2eda2a82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.534258 Oct 17 15:24:08.957568 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 306/606] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:08 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:09.443978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:09.444974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:09.463110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:09.463943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:09.465459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:09.466452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:09.467100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:09.467710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:09.535052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:09.535703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:09.542361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:09.547675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:09.551901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:09.556695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:09.557312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:09.557787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:09.570576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:09.571432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:09.571593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:09.572039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lazy-loading 'fault' on Instance uuid 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:24:09.733159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91084e2fdf5d4a7c8c8b0fb7b4a6b001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae57be8e41a4dea89fbefef358d0ed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:09.747199 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c13ad20-b24b-4d18-8ded-75be8ec0997b tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 200 len: 1313 microversion: 2.1 time: 0.309987 Oct 17 15:24:09.750425 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 301/607] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:09 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:10.029891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1403932628", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "7d66882a-376e-4e59-a30c-8056586fb6d2"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:10.169348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] validate_networks() for [('7d66882a-376e-4e59-a30c-8056586fb6d2', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:24:10.334640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:10.349647 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3834ad46-31b3-4ddc-af9a-f3a0dc6abb37 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 0.834096 Oct 17 15:24:10.372122 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 307/608] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:09 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:10.407414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:10.408170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:10.434380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:10.435049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:10.435506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:10.441550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:10.447464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:10.449396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:10.867628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:10.880794 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e0162ee-f65a-40a9-aa8d-df8748b541a7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.507031 Oct 17 15:24:10.885869 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 308/609] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:10 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:10.898165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:10.899711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] [instance: 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:10.915091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:10.918884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:10.919649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:10.921046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:10.921717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:10.923120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:10.929269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:24:10.929804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:24:10.930195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:24:10.930637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:24:10.931170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:24:10.941881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:10.943156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:10.943722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:10.944943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:10.945867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:10.946439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:10.951020 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] HTTP exception thrown: Instance 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 could not be found. Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Request method failure captured: Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 HTTP/1.1 Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXN6M6qsgaGKPwTIRp1FKB0z0NtpOWdp9842_HWZwP-5KooKVJ9aq4lBA2ziD_j1Z4yBYC7XSAwnuOD0VB5h0EJ3CjTClnTejZ3jKSyULVoUq7OMhd8xIQ_fvTMg3Yh-_5AGFqPYT3A2TrnYCX1_PEXMAGN_oyK8PR5fH78eaBTUfNo Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: cae57be8e41a4dea89fbefef358d0ed1 Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1048093212 Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:24:10.963331 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cae57be8e41a4dea89fbefef358d0ed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cae57be8e41a4dea89fbefef358d0ed1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cae57be8e41a4dea89fbefef358d0ed1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cae57be8e41a4dea89fbefef358d0ed1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1048093212 Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: cae57be8e41a4dea89fbefef358d0ed1 Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1048093212 Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerDiagnosticsNegativeTest-1048093212-project Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 91084e2fdf5d4a7c8c8b0fb7b4a6b001 Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1048093212-project Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 could not be found. Oct 17 15:24:10.964759 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '4fd0517d-2f4c-45ab-bf34-038e5f1cdab3'} Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 could not be found. Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:10.965463 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 could not be found. Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 could not be found. Oct 17 15:24:10.966682 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:10.969215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] Returning 404 to user: Instance 4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:10.969338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:10.970397 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01b34a99-d152-4b4f-9109-c5d42f02c0eb tempest-ServerDiagnosticsNegativeTest-1048093212 tempest-ServerDiagnosticsNegativeTest-1048093212-project] 10.222.0.87 "GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3" status: 404 len: 111 microversion: 2.1 time: 0.083269 Oct 17 15:24:10.971518 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 309/610] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:10 2022] GET /compute/v2.1/servers/4fd0517d-2f4c-45ab-bf34-038e5f1cdab3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:10.978488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for user 13c8d45b2e4d459d92b024476b2f4fbd and project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:10.995351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:24:10.999145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:24:11.061747 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3b0d7f4d-cc1d-4f66-b0a2-5703b40220bc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.307229 Oct 17 15:24:11.062664 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 302/611] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:24:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:24:11.076707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c30760f-2e38-4fd6-8ded-581fd55768e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:11.077494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c30760f-2e38-4fd6-8ded-581fd55768e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:11.276760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c30760f-2e38-4fd6-8ded-581fd55768e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:11.285142 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c30760f-2e38-4fd6-8ded-581fd55768e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1211 microversion: 2.1 time: 0.214797 Oct 17 15:24:11.288196 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 310/612] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:11 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1211 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:11.388829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:11.391729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:11.413188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:11.413715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:11.423763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:11.429945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:11.430724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:11.431327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:11.904198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:11.911383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:11.912066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:11.929746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:11.932081 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a2e2b0cd-15a9-4957-873b-bbc54ae3699f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 0.551964 Oct 17 15:24:11.941036 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 303/613] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:11 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:11.941188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:11.942026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:11.942976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:11.947740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:11.948781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:12.312357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:12.313000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:12.320807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:12.329246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:12.329962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:12.330791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:12.334485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:12.336268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:12.540490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:12.549532 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-363ef294-61d0-418c-b4e4-bfa8f0dae7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1215 microversion: 2.1 time: 0.241327 Oct 17 15:24:12.555708 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 304/614] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:12 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:12.819469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:12.870308 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df249cc2-6c8a-4180-ac4f-202d213f1d39 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.962829 Oct 17 15:24:12.874059 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 311/615] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:11 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:12.987760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:12.988602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:13.008483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:13.009201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:13.010128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:13.010921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:13.012289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:13.012791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:13.336177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-811d2bfc-24fd-4f0a-8d9d-578d97acd0ef tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf1e1dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:13.365754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:13.377744 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2d97292-8418-4acb-8fb2-8760db0c2409 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 0.398962 Oct 17 15:24:13.386581 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 312/616] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:12 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:13.590824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:13.591669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:13.601412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:13.602169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:13.602794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:13.603680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:13.604331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:13.604916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:13.738649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:13.754519 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08f3e63e-dc9f-42d8-b62e-7278f6b0c937 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1281 microversion: 2.1 time: 0.178289 Oct 17 15:24:13.755946 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 313/617] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:13 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1281 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:13.903705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:13.904527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:13.939148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:13.939719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:13.940168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:13.940917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:13.945658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:13.946162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:14.269920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811d2bfc-24fd-4f0a-8d9d-578d97acd0ef tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:14.272211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811d2bfc-24fd-4f0a-8d9d-578d97acd0ef tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:14.273026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811d2bfc-24fd-4f0a-8d9d-578d97acd0ef tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:14.274452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811d2bfc-24fd-4f0a-8d9d-578d97acd0ef tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:14.275198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811d2bfc-24fd-4f0a-8d9d-578d97acd0ef tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:14.275783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811d2bfc-24fd-4f0a-8d9d-578d97acd0ef tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:14.339668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:14.353297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:14.359176 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2f65c9d-3d01-4462-8364-6dce107ec349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.461908 Oct 17 15:24:14.360079 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 314/618] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:13 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:14.369292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-aca85371-cd0b-4df0-a9b9-5409a11188a3 req-d92da4a9-3dab-4683-8ec1-bd514558ccab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83fb150-6289-480d-bed1-dd6363c26326", "name": "network-vif-plugged", "status": "completed", "tag": "bcc058ce-4e6f-4b7b-b2d8-203f083df3d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:14.398240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-aca85371-cd0b-4df0-a9b9-5409a11188a3 req-d92da4a9-3dab-4683-8ec1-bd514558ccab service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:14.399054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-aca85371-cd0b-4df0-a9b9-5409a11188a3 req-d92da4a9-3dab-4683-8ec1-bd514558ccab service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:14.399628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-aca85371-cd0b-4df0-a9b9-5409a11188a3 req-d92da4a9-3dab-4683-8ec1-bd514558ccab service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:14.440328 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-aca85371-cd0b-4df0-a9b9-5409a11188a3 req-d92da4a9-3dab-4683-8ec1-bd514558ccab service nova] Creating event network-vif-plugged:bcc058ce-4e6f-4b7b-b2d8-203f083df3d9 for instance f83fb150-6289-480d-bed1-dd6363c26326 on n-h1-854441-12 Oct 17 15:24:14.465641 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-aca85371-cd0b-4df0-a9b9-5409a11188a3 req-d92da4a9-3dab-4683-8ec1-bd514558ccab service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088801 Oct 17 15:24:14.466591 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 315/619] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:14.481975 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-811d2bfc-24fd-4f0a-8d9d-578d97acd0ef tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/d73d0c9d00ba41749038543a38ed6c8d" status: 200 len: 240 microversion: 2.36 time: 1.705781 Oct 17 15:24:14.486259 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 305/620] 10.222.0.87 () {62 vars in 1303 bytes} [Mon Oct 17 15:24:12 2022] PUT /compute/v2.1/os-quota-sets/d73d0c9d00ba41749038543a38ed6c8d => generated 240 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:24:14.494760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:14.501554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8713d8a-82f8-4c53-b8ed-c4635b5ebccf tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Calling method '.version_select at 0x7f28bf1e1b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:14.505121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:14.534008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:14.534864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:14.535555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:14.536451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:14.539423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:14.540033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:15.075595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:15.084498 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b536779-40c4-407e-b086-429d913ab5f4 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 0.616403 Oct 17 15:24:15.085091 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 316/621] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:14 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:15.116634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:15.125956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:15.164335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:15.165162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:15.165898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:15.173519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:15.176498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:15.180128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:15.215369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8713d8a-82f8-4c53-b8ed-c4635b5ebccf tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:15.216159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8713d8a-82f8-4c53-b8ed-c4635b5ebccf tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:15.216749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8713d8a-82f8-4c53-b8ed-c4635b5ebccf tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:15.217669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8713d8a-82f8-4c53-b8ed-c4635b5ebccf tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:15.219681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8713d8a-82f8-4c53-b8ed-c4635b5ebccf tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:15.220274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8713d8a-82f8-4c53-b8ed-c4635b5ebccf tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:15.251649 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a8713d8a-82f8-4c53-b8ed-c4635b5ebccf tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/d73d0c9d00ba41749038543a38ed6c8d/detail" status: 200 len: 672 microversion: 2.36 time: 0.758913 Oct 17 15:24:15.252851 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 306/622] 10.222.0.87 () {60 vars in 1304 bytes} [Mon Oct 17 15:24:14 2022] GET /compute/v2.1/os-quota-sets/d73d0c9d00ba41749038543a38ed6c8d/detail => generated 672 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:24:15.354755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:15.365111 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0773de5f-943f-4af3-a739-1f568ee01879 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1269 microversion: 2.1 time: 0.268935 Oct 17 15:24:15.379778 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 317/623] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:15 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1269 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:15.388076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:15.389365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:15.400091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:15.403286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:15.406851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:15.407964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:15.408600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:15.409219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:15.840180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:15.855568 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7eef4a76-a7b2-435f-a8f3-b16fee022dbe tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.468185 Oct 17 15:24:15.871544 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 307/624] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:15 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:15.943058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf3a4940>, body: {"quota_set": {"ram": "2048"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:16.111711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:16.113451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:16.120721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.121218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.121651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.122357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.122951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.123521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.303190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:16.317945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.320547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.321251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.323009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.323494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.326037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.385396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.386032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.386711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.387451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.387942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.388368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.456489 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f8195b1-17cd-47be-b30d-eebe21b2b75a tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-sets/d73d0c9d00ba41749038543a38ed6c8d?user_id=7e27df1c38464dd99cd82296ae753e6b" status: 200 len: 240 microversion: 2.36 time: 0.518053 Oct 17 15:24:16.463858 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 318/625] 10.222.0.87 () {62 vars in 1384 bytes} [Mon Oct 17 15:24:15 2022] PUT /compute/v2.1/os-quota-sets/d73d0c9d00ba41749038543a38ed6c8d?user_id=7e27df1c38464dd99cd82296ae753e6b => generated 240 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:24:16.469001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:16.469858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:16.480084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.480762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.481312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.482159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.482474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.482942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.541243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:16.556275 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad4d209b-30fb-4405-b3b0-1ddf5b51356d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1322 microversion: 2.1 time: 0.448506 Oct 17 15:24:16.557682 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 308/626] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:16 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:16.563515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2e98c289-997f-4a9b-8759-9999e8b0c408 tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] Calling method '.version_select at 0x7f28bf317790>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:16.683024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:16.696924 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2b27032-cf06-4d0d-b322-dd71848198b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1311 microversion: 2.1 time: 0.231689 Oct 17 15:24:16.697517 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 319/627] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:16 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1311 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:16.877870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:16.878843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:16.892158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.894654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.895201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.896800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:16.899013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:16.901424 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2e98c289-997f-4a9b-8759-9999e8b0c408 tempest-QuotasAdminTestV236-1670617647 tempest-QuotasAdminTestV236-1670617647-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/d73d0c9d00ba41749038543a38ed6c8d?user_id=7e27df1c38464dd99cd82296ae753e6b" status: 200 len: 282 microversion: 2.36 time: 0.340513 Oct 17 15:24:16.902135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:16.905493 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 309/628] 10.222.0.87 () {60 vars in 1364 bytes} [Mon Oct 17 15:24:16 2022] GET /compute/v2.1/os-quota-sets/d73d0c9d00ba41749038543a38ed6c8d?user_id=7e27df1c38464dd99cd82296ae753e6b => generated 282 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:24:17.073941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:17.084868 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9144bb6a-6e31-4c44-b911-9ba47e5b73f4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.210469 Oct 17 15:24:17.086929 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 320/629] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:16 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:17.153664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0ad9f4d1-f65b-4a86-8b52-29110e4e08f0 req-5123d614-b8b5-4d81-ae34-2d535d8cef62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33832aef-61a6-417f-9061-676bd10b92ac", "tag": "b2d5c653-09bc-422e-8ea4-94b4d18f9d5b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:17.167714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ad9f4d1-f65b-4a86-8b52-29110e4e08f0 req-5123d614-b8b5-4d81-ae34-2d535d8cef62 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:17.168927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ad9f4d1-f65b-4a86-8b52-29110e4e08f0 req-5123d614-b8b5-4d81-ae34-2d535d8cef62 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:17.170148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ad9f4d1-f65b-4a86-8b52-29110e4e08f0 req-5123d614-b8b5-4d81-ae34-2d535d8cef62 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:17.187635 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0ad9f4d1-f65b-4a86-8b52-29110e4e08f0 req-5123d614-b8b5-4d81-ae34-2d535d8cef62 service nova] Creating event network-changed:b2d5c653-09bc-422e-8ea4-94b4d18f9d5b for instance 33832aef-61a6-417f-9061-676bd10b92ac on n-h1-854441-12 Oct 17 15:24:17.197676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0ad9f4d1-f65b-4a86-8b52-29110e4e08f0 req-5123d614-b8b5-4d81-ae34-2d535d8cef62 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049613 Oct 17 15:24:17.198938 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 310/630] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:17.583536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:17.585146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:17.593762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:17.594368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:17.594904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:17.595915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:17.596440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:17.596941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:17.603438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:17.723000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:17.723884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:17.731398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:17.732754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:17.733748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:17.734608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:17.735033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:17.735551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:17.790690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:17.801167 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6583836b-5987-4b2d-9c99-eddb136181a6 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1472 microversion: 2.1 time: 0.222475 Oct 17 15:24:17.802140 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 321/631] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:17 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:17.826798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:17.827336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:17.838115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:17.838634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:17.839080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:17.839781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:17.840356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:17.840802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:17.871644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lazy-loading 'flavor' on Instance uuid f83fb150-6289-480d-bed1-dd6363c26326 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:24:17.941397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:17.951696 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07cd3357-3132-4119-94c8-049b419e0cef tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1311 microversion: 2.1 time: 0.233556 Oct 17 15:24:17.952901 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 311/632] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:17 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:18.013081 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-edec9679-7cbd-4cff-b4be-6b834a88cdb3 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326/action" status: 202 len: 0 microversion: 2.1 time: 0.188835 Oct 17 15:24:18.014234 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 322/633] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:24:17 2022] POST /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:24:18.024556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-adfbd9f9-3998-4302-ae3f-cddbe7f034f2 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:18.025282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-adfbd9f9-3998-4302-ae3f-cddbe7f034f2 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:18.032960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adfbd9f9-3998-4302-ae3f-cddbe7f034f2 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:18.033461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adfbd9f9-3998-4302-ae3f-cddbe7f034f2 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:18.034062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adfbd9f9-3998-4302-ae3f-cddbe7f034f2 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:18.034640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adfbd9f9-3998-4302-ae3f-cddbe7f034f2 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:18.035102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adfbd9f9-3998-4302-ae3f-cddbe7f034f2 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:18.035533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adfbd9f9-3998-4302-ae3f-cddbe7f034f2 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:18.272124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-08fc3455-1273-4b65-9b4b-04087ae1968a tempest-QuotaClassesAdminTestJSON-2087551917 tempest-QuotaClassesAdminTestJSON-2087551917-project-admin] Calling method '.version_select at 0x7f28bf181280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:18.293385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-08fc3455-1273-4b65-9b4b-04087ae1968a tempest-QuotaClassesAdminTestJSON-2087551917 tempest-QuotaClassesAdminTestJSON-2087551917-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.338970 Oct 17 15:24:18.293981 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 312/634] 10.222.0.87 () {58 vars in 1185 bytes} [Mon Oct 17 15:24:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:18.299331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:18.300243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:18.308848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:18.309526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:18.310139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:18.310981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:18.311305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:18.311871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:18.328066 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-adfbd9f9-3998-4302-ae3f-cddbe7f034f2 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1633 microversion: 2.1 time: 0.309129 Oct 17 15:24:18.338887 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 323/635] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:18 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1633 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:18.338887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fcf5963f-9dbd-4720-a2b0-1c517f0f1552 tempest-QuotaClassesAdminTestJSON-2087551917 tempest-QuotaClassesAdminTestJSON-2087551917-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf233790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:18.506337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:18.523010 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-25d144dd-0cc3-44c6-96eb-51ec845157df tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.227284 Oct 17 15:24:18.524124 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 313/636] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:18 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:18.683271 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fcf5963f-9dbd-4720-a2b0-1c517f0f1552 tempest-QuotaClassesAdminTestJSON-2087551917 tempest-QuotaClassesAdminTestJSON-2087551917-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.351815 Oct 17 15:24:18.690804 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 324/637] 10.222.0.87 () {60 vars in 1206 bytes} [Mon Oct 17 15:24:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:18.698598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e04302e-06f4-4abd-945a-1622411c6f46 tempest-QuotaClassesAdminTestJSON-2087551917 tempest-QuotaClassesAdminTestJSON-2087551917-project-admin] Calling method '.version_select at 0x7f28bf2870d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:18.714191 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e04302e-06f4-4abd-945a-1622411c6f46 tempest-QuotaClassesAdminTestJSON-2087551917 tempest-QuotaClassesAdminTestJSON-2087551917-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.021309 Oct 17 15:24:18.715369 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 325/638] 10.222.0.87 () {58 vars in 1185 bytes} [Mon Oct 17 15:24:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:18.729587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21f6d13a-4131-4908-86f5-0ebb680e960f tempest-QuotaClassesAdminTestJSON-2087551917 tempest-QuotaClassesAdminTestJSON-2087551917-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf326f70>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:18.852904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=8,nova_api:UPDATE=22 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:18.909200 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21f6d13a-4131-4908-86f5-0ebb680e960f tempest-QuotaClassesAdminTestJSON-2087551917 tempest-QuotaClassesAdminTestJSON-2087551917-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.185250 Oct 17 15:24:18.910869 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 326/639] 10.222.0.87 () {60 vars in 1206 bytes} [Mon Oct 17 15:24:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:18.951425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-418710252", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": "none"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:19.014120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-564ce6a5-3c8b-405b-a1fe-7d93d4ba8cfe tempest-AbsoluteLimitsTestJSON-440863149 tempest-AbsoluteLimitsTestJSON-440863149-project] Calling method '.version_select at 0x7f28bf3a4c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:19.031774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:24:19.032778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:24:19.033244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:24:19.033842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:24:19.034488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564ce6a5-3c8b-405b-a1fe-7d93d4ba8cfe tempest-AbsoluteLimitsTestJSON-440863149 tempest-AbsoluteLimitsTestJSON-440863149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.035016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564ce6a5-3c8b-405b-a1fe-7d93d4ba8cfe tempest-AbsoluteLimitsTestJSON-440863149 tempest-AbsoluteLimitsTestJSON-440863149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.035164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:24:19.035909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564ce6a5-3c8b-405b-a1fe-7d93d4ba8cfe tempest-AbsoluteLimitsTestJSON-440863149 tempest-AbsoluteLimitsTestJSON-440863149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.036662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564ce6a5-3c8b-405b-a1fe-7d93d4ba8cfe tempest-AbsoluteLimitsTestJSON-440863149 tempest-AbsoluteLimitsTestJSON-440863149-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.037439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564ce6a5-3c8b-405b-a1fe-7d93d4ba8cfe tempest-AbsoluteLimitsTestJSON-440863149 tempest-AbsoluteLimitsTestJSON-440863149-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.037880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564ce6a5-3c8b-405b-a1fe-7d93d4ba8cfe tempest-AbsoluteLimitsTestJSON-440863149 tempest-AbsoluteLimitsTestJSON-440863149-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.048099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.048821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.049403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.050449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.053790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.054846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.062077 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-564ce6a5-3c8b-405b-a1fe-7d93d4ba8cfe tempest-AbsoluteLimitsTestJSON-440863149 tempest-AbsoluteLimitsTestJSON-440863149-project] 10.222.0.87 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.149566 Oct 17 15:24:19.062904 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 327/640] 10.222.0.87 () {58 vars in 1122 bytes} [Mon Oct 17 15:24:18 2022] GET /compute/v2.1/limits => generated 511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:19.085589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:19.086359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:19.096737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.096737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.096737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.097118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.097289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.097723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.107772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Getting quotas for project ff56c4114ed54db3ad1dea0866ea96a0. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:19.124691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Getting quotas for user 1325e6aaa6a944cb9e228919f32b3c06 and project ff56c4114ed54db3ad1dea0866ea96a0. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:19.157357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:24:19.161624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:24:19.254942 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-75dc22e9-10c5-4fa9-b712-ef7dde26d20d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.728768 Oct 17 15:24:19.256155 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 314/641] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:24:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:24:19.277013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8b57ceaa-2c1c-4a00-a0b9-6c236d31626c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:19.277903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8b57ceaa-2c1c-4a00-a0b9-6c236d31626c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:19.401081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:19.412694 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8216e69d-1709-42ca-8d23-1dd4ad290b90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1311 microversion: 2.1 time: 0.348497 Oct 17 15:24:19.414244 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 328/642] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:19 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1311 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:19.419660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-200bde91-d03e-48ff-a6a5-d38af1b25909 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:19.420575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-200bde91-d03e-48ff-a6a5-d38af1b25909 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:19.427516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-200bde91-d03e-48ff-a6a5-d38af1b25909 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.428183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-200bde91-d03e-48ff-a6a5-d38af1b25909 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.428702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-200bde91-d03e-48ff-a6a5-d38af1b25909 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.429742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-200bde91-d03e-48ff-a6a5-d38af1b25909 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.430333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-200bde91-d03e-48ff-a6a5-d38af1b25909 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.431437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-200bde91-d03e-48ff-a6a5-d38af1b25909 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.553723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8b57ceaa-2c1c-4a00-a0b9-6c236d31626c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:19.571340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8b57ceaa-2c1c-4a00-a0b9-6c236d31626c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:19.572964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8b57ceaa-2c1c-4a00-a0b9-6c236d31626c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:19.589701 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8b57ceaa-2c1c-4a00-a0b9-6c236d31626c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1452 microversion: 2.91 time: 0.324422 Oct 17 15:24:19.592437 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 315/643] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:19 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1452 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:19.605906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:19.606884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:19.620466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.620962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.621396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.622103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.622573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.622999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.653355 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-200bde91-d03e-48ff-a6a5-d38af1b25909 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1616 microversion: 2.1 time: 0.237642 Oct 17 15:24:19.654284 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 329/644] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:19 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1616 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:19.678642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:19.679801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:19.689869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.691473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.692364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.693620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:19.694269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:19.695156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:19.895182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:19.908899 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c3c3f49-fa02-4e04-8f71-14a79c14cc64 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.313121 Oct 17 15:24:19.909967 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 316/645] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:19 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:19.920502 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] HTTP exception thrown: Cannot 'migrate' instance f83fb150-6289-480d-bed1-dd6363c26326 while it is in vm_state suspended Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Request method failure captured: Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326/action HTTP/1.1 Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 15 Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNybmU8rX2iPoGAJlrz0yX5S9G8zS8uf52BN7mPT0VIa_ArSGBJ49packCHClcGyfX3PT_fK5SDQsfvcJ_2ttRTdkloIxvugRiNBtR55SAPvu0HEE97Z8So9fYB68n6gVW6ywEMNK5xD9WjWDmUycGFIkCq59OS-73otoh-90bNrFs Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:24:19.922756 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: fe2e700c2be845d0b9092094da9d1de2 Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: {"migrate": {}} Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:24:19.924390 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'migrate' instance f83fb150-6289-480d-bed1-dd6363c26326 while it is in vm_state suspended Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'f83fb150-6289-480d-bed1-dd6363c26326', 'body': {'migrate': {}}} Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f83fb150-6289-480d-bed1-dd6363c26326 in vm_state suspended. Cannot resize while the instance is in this state. Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.925221 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance f83fb150-6289-480d-bed1-dd6363c26326 while it is in vm_state suspended Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:19.926425 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:19.927536 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:19.927536 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:19.927536 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance f83fb150-6289-480d-bed1-dd6363c26326 while it is in vm_state suspended Oct 17 15:24:19.927536 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.927536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Returning 409 to user: Cannot 'migrate' instance f83fb150-6289-480d-bed1-dd6363c26326 while it is in vm_state suspended {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:19.927536 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1964df06-7a99-4653-b29b-9e5bcf180980 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326/action" status: 409 len: 148 microversion: 2.1 time: 0.250432 Oct 17 15:24:19.927536 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 330/646] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:24:19 2022] POST /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326/action => generated 148 bytes in 252 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 15:24:19.947898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e94cfa5b-d242-493a-a0aa-6d1381774688 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e94cfa5b-d242-493a-a0aa-6d1381774688 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Request method failure captured: Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454/action HTTP/1.1 Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 39 Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNybmU8rX2iPoGAJlrz0yX5S9G8zS8uf52BN7mPT0VIa_ArSGBJ49packCHClcGyfX3PT_fK5SDQsfvcJ_2ttRTdkloIxvugRiNBtR55SAPvu0HEE97Z8So9fYB68n6gVW6ywEMNK5xD9WjWDmUycGFIkCq59OS-73otoh-90bNrFs Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:24:19.959407 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: fe2e700c2be845d0b9092094da9d1de2 Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: {"os-resetState": {"state": "invalid"}} Oct 17 15:24:19.962236 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'b1eb4e3f-2a07-451d-8093-1390b98f0454', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:19.963131 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:24:19.964972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 15:24:19.967780 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.967780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e94cfa5b-d242-493a-a0aa-6d1381774688 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:19.967780 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e94cfa5b-d242-493a-a0aa-6d1381774688 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454/action" status: 400 len: 144 microversion: 2.1 time: 0.028250 Oct 17 15:24:19.967780 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 317/647] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:24:19 2022] POST /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454/action => generated 144 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:24:19.975896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb483ea6-0021-42f1-86b9-23e6bdee1395 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb483ea6-0021-42f1-86b9-23e6bdee1395 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Request method failure captured: Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454/action HTTP/1.1 Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 31 Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNybmU8rX2iPoGAJlrz0yX5S9G8zS8uf52BN7mPT0VIa_ArSGBJ49packCHClcGyfX3PT_fK5SDQsfvcJ_2ttRTdkloIxvugRiNBtR55SAPvu0HEE97Z8So9fYB68n6gVW6ywEMNK5xD9WjWDmUycGFIkCq59OS-73otoh-90bNrFs Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:24:19.980756 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: fe2e700c2be845d0b9092094da9d1de2 Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: {"os-resetState": {"state": 1}} Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:24:19.982406 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'b1eb4e3f-2a07-451d-8093-1390b98f0454', 'body': {'os-resetState': {'state': 1}}} Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 1 Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:19.983527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 15:24:19.985157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:19.986270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb483ea6-0021-42f1-86b9-23e6bdee1395 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:19.986270 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb483ea6-0021-42f1-86b9-23e6bdee1395 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454/action" status: 400 len: 120 microversion: 2.1 time: 0.011039 Oct 17 15:24:19.986270 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 331/648] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:24:19 2022] POST /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:24:19.999360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8bfffcf9-0018-432f-addd-cd97fdcc5cf5 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:20.005512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8bfffcf9-0018-432f-addd-cd97fdcc5cf5 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Failed to fetch instance by id 999 {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 15:24:20.006997 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8bfffcf9-0018-432f-addd-cd97fdcc5cf5 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8bfffcf9-0018-432f-addd-cd97fdcc5cf5 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Request method failure captured: Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 37 Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNybmU8rX2iPoGAJlrz0yX5S9G8zS8uf52BN7mPT0VIa_ArSGBJ49packCHClcGyfX3PT_fK5SDQsfvcJ_2ttRTdkloIxvugRiNBtR55SAPvu0HEE97Z8So9fYB68n6gVW6ywEMNK5xD9WjWDmUycGFIkCq59OS-73otoh-90bNrFs Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:24:20.010268 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3139e15fde23468c8d001ac77d1c9828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3139e15fde23468c8d001ac77d1c9828 Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1695671551 Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: fe2e700c2be845d0b9092094da9d1de2 Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1695671551-project-admin Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: {"os-resetState": {"state": "error"}} Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:24:20.011787 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 999 could not be found. Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:20.012512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 17 15:24:20.013816 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:20.018656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8bfffcf9-0018-432f-addd-cd97fdcc5cf5 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:20.021952 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8bfffcf9-0018-432f-addd-cd97fdcc5cf5 tempest-ServersAdminNegativeTestJSON-1695671551 tempest-ServersAdminNegativeTestJSON-1695671551-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.033290 Oct 17 15:24:20.026158 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 318/649] 10.222.0.87 () {60 vars in 1179 bytes} [Mon Oct 17 15:24:19 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:24:20.035869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:20.036633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:20.048493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.049253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.049896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:20.050856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.051513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.052875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:20.109607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:24:20.282034 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af96309c-d7dc-4c27-87a3-4f38cbe0b62e tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 204 len: 0 microversion: 2.1 time: 0.250309 Oct 17 15:24:20.294021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:20.294646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:20.300774 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 332/650] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:24:20 2022] DELETE /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:24:20.306652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.308424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.314131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:20.315755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.315755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.315937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:20.439123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:20.441214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:20.455644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.457052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.457607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:20.458396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.458991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.459873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:20.652235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:20.661150 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a4f3337-ca3f-4e0b-adba-5844f5ac1992 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1469 microversion: 2.1 time: 0.371806 Oct 17 15:24:20.665840 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 319/651] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:20 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:20.675387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:20.678945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:20.708560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.709184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.711452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:20.712239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.712853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.715765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:20.823846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:20.835007 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62b6aa5b-51e7-4085-a33d-81e08172b4f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1311 microversion: 2.1 time: 0.400968 Oct 17 15:24:20.841178 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 333/652] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:20 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1311 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:20.938420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:20.939510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:20.949820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.950532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.951143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:20.953046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:20.953958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:20.955008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:21.028788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:21.040365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:21.042467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:21.050413 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8fe2ef6-2e26-478c-a761-fbc45c216777 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1504 microversion: 2.91 time: 0.383179 Oct 17 15:24:21.052223 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 320/653] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:20 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:21.125940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:21.151498 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e45be533-e3cc-40b3-8a70-ff44f60b1418 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.220166 Oct 17 15:24:21.154552 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 334/654] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:20 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:21.688559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:21.689220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:21.696549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:21.697006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:21.697533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:21.698582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:21.699068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:21.699518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:21.866326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:21.874702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:21.894076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:21.895374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:21.896436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:21.897205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:21.898941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:21.902898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:21.913841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:21.926147 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1ada2c8e-85bd-4723-b794-f5840659d7c1 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1469 microversion: 2.1 time: 0.238236 Oct 17 15:24:21.928085 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 321/655] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:21 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:22.060821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-29a58f79-851c-42dc-a43c-8f62361adbe2 req-f10e9a09-2945-4922-8ea8-b50ff6dcd4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33832aef-61a6-417f-9061-676bd10b92ac", "name": "network-vif-plugged", "status": "completed", "tag": "b2d5c653-09bc-422e-8ea4-94b4d18f9d5b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:22.074423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-29a58f79-851c-42dc-a43c-8f62361adbe2 req-f10e9a09-2945-4922-8ea8-b50ff6dcd4ea service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:22.075374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-29a58f79-851c-42dc-a43c-8f62361adbe2 req-f10e9a09-2945-4922-8ea8-b50ff6dcd4ea service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:22.078309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-29a58f79-851c-42dc-a43c-8f62361adbe2 req-f10e9a09-2945-4922-8ea8-b50ff6dcd4ea service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:22.106039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-29a58f79-851c-42dc-a43c-8f62361adbe2 req-f10e9a09-2945-4922-8ea8-b50ff6dcd4ea service nova] Creating event network-vif-plugged:b2d5c653-09bc-422e-8ea4-94b4d18f9d5b for instance 33832aef-61a6-417f-9061-676bd10b92ac on n-h1-854441-12 Oct 17 15:24:22.118088 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-29a58f79-851c-42dc-a43c-8f62361adbe2 req-f10e9a09-2945-4922-8ea8-b50ff6dcd4ea service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061869 Oct 17 15:24:22.122724 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 322/656] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:22.131868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:22.134059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:22.150524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:22.152117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:22.152725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:22.153716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:22.156483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:22.158456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:22.210439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:22.230469 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-311afb1c-19bf-4b54-adf0-1fcac857d1a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1311 microversion: 2.1 time: 0.369451 Oct 17 15:24:22.231504 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 335/657] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:21 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:22.248587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:22.249553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:22.272077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:22.275460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:22.276298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:22.277279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:22.277993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:22.278661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:22.335477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:22.344938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:22.346430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:22.352205 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4b22286e-c526-47c4-aeb9-32cfd2a0663e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1510 microversion: 2.91 time: 0.227823 Oct 17 15:24:22.367527 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 323/658] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:22 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:22.487512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:22.498009 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a7de62b-35aa-4000-94e8-fddb51a4cc21 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.265052 Oct 17 15:24:22.516526 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 336/659] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:22 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:22.685436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e0b0d1c2-b69f-4f4d-a005-5446038cd0f0 req-65715c9f-8f33-4469-a643-35e342935fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83fb150-6289-480d-bed1-dd6363c26326", "name": "network-vif-deleted", "tag": "bcc058ce-4e6f-4b7b-b2d8-203f083df3d9"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:22.702288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e0b0d1c2-b69f-4f4d-a005-5446038cd0f0 req-65715c9f-8f33-4469-a643-35e342935fd9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:22.703192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e0b0d1c2-b69f-4f4d-a005-5446038cd0f0 req-65715c9f-8f33-4469-a643-35e342935fd9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:22.703783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e0b0d1c2-b69f-4f4d-a005-5446038cd0f0 req-65715c9f-8f33-4469-a643-35e342935fd9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:22.719516 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e0b0d1c2-b69f-4f4d-a005-5446038cd0f0 req-65715c9f-8f33-4469-a643-35e342935fd9 service nova] Creating event network-vif-deleted:bcc058ce-4e6f-4b7b-b2d8-203f083df3d9 for instance f83fb150-6289-480d-bed1-dd6363c26326 on n-h1-854441-12 Oct 17 15:24:22.726259 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e0b0d1c2-b69f-4f4d-a005-5446038cd0f0 req-65715c9f-8f33-4469-a643-35e342935fd9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046365 Oct 17 15:24:22.731776 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 324/660] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:22.957694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:22.959767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:22.970911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:22.971928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:22.973963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:22.978787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:22.980383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:22.983061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:23.040908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:23.042044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:23.042766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:23.043228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lazy-loading 'fault' on Instance uuid f83fb150-6289-480d-bed1-dd6363c26326 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:24:23.127979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:23.149688 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f9ac0c3-2ef0-4d22-8a02-29c2e1ff4840 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 200 len: 1312 microversion: 2.1 time: 0.197331 Oct 17 15:24:23.152525 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 337/661] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:22 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:23.264821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:23.266229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:23.278219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:23.279520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:23.280456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:23.281814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:23.283050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:23.283921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:23.382617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:23.383086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:23.403539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:23.404046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:23.404485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:23.405203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:23.409449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:23.409936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:23.630099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:23.641179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:23.649019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:23.649903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:23.662084 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-496e39a2-363f-4727-b42b-2093871da710 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1311 microversion: 2.1 time: 0.407617 Oct 17 15:24:23.663780 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 325/662] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:23 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1311 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:23.664348 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7253fb93-5196-47b3-a418-be95725d5706 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1510 microversion: 2.91 time: 0.285633 Oct 17 15:24:23.665646 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 338/663] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:23 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:23.684805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:23.685837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:23.712724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:23.713716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:23.714481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:23.715788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:23.716527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:23.717151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:23.739741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:23.971893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:23.998332 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee42f95f-8baa-469f-b837-60f96218def5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.332170 Oct 17 15:24:24.003055 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 326/664] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:23 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:24.179666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:24.181261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: f83fb150-6289-480d-bed1-dd6363c26326] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:24.194778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.196176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.197565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.199116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.200172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.201521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.247071 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] HTTP exception thrown: Instance f83fb150-6289-480d-bed1-dd6363c26326 could not be found. Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Request method failure captured: Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 HTTP/1.1 Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNvR_67nx-lc_MQkDqdDhMtW7_rFkMYJQh_ehLVpnF9QiXeNET9qCsiQuomeRoHBlaeCJk-fxvd4TZvf9magQ0HdLmP4__tD3O0ingYvgzsoWCKI6ngQ_Y2mFM-ks94nyRDgdIq5CYsxp1eGOIXFdFvAt2GzaAYaNOf2bB0RQv5Zj4 Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 70295fa3676c40c88cee677a1dd84ac6 Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-687972980 Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:24:24.252356 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/70295fa3676c40c88cee677a1dd84ac6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/70295fa3676c40c88cee677a1dd84ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_70295fa3676c40c88cee677a1dd84ac6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/70295fa3676c40c88cee677a1dd84ac6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-687972980 Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 70295fa3676c40c88cee677a1dd84ac6 Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-687972980 Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersAdminNegativeTestJSON-687972980-project Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 4610d60e4c154bd6ab5b66e238d4541e Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-687972980-project Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f83fb150-6289-480d-bed1-dd6363c26326 could not be found. Oct 17 15:24:24.255086 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f83fb150-6289-480d-bed1-dd6363c26326'} Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83fb150-6289-480d-bed1-dd6363c26326 could not be found. Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:24.257014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83fb150-6289-480d-bed1-dd6363c26326 could not be found. Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83fb150-6289-480d-bed1-dd6363c26326 could not be found. Oct 17 15:24:24.259836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:24.270849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Returning 404 to user: Instance f83fb150-6289-480d-bed1-dd6363c26326 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:24.270849 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e851059f-86ac-4a5c-a971-1c9379e6f16a tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326" status: 404 len: 111 microversion: 2.1 time: 0.093690 Oct 17 15:24:24.273864 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 327/665] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:24 2022] GET /compute/v2.1/servers/f83fb150-6289-480d-bed1-dd6363c26326 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:24.278086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10ac3e3c-0879-4168-8f1f-af69e01ec614 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:24.289357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:24.290816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:24.297337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ac3e3c-0879-4168-8f1f-af69e01ec614 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.298694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ac3e3c-0879-4168-8f1f-af69e01ec614 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.299352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ac3e3c-0879-4168-8f1f-af69e01ec614 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.303238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ac3e3c-0879-4168-8f1f-af69e01ec614 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.304272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ac3e3c-0879-4168-8f1f-af69e01ec614 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.305242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.306117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10ac3e3c-0879-4168-8f1f-af69e01ec614 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.306540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.307668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.310352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.311511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.312233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.346771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:24.398805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:24:24.430475 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10ac3e3c-0879-4168-8f1f-af69e01ec614 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.761055 Oct 17 15:24:24.434967 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 339/666] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:23 2022] GET /compute/v2.1/os-services => generated 949 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:24.450638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5221291-320e-494a-ade2-2c595a9b787b tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:24.469283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5221291-320e-494a-ade2-2c595a9b787b tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.470352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5221291-320e-494a-ade2-2c595a9b787b tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.471347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5221291-320e-494a-ade2-2c595a9b787b tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.472971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5221291-320e-494a-ade2-2c595a9b787b tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.473917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5221291-320e-494a-ade2-2c595a9b787b tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.474934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5221291-320e-494a-ade2-2c595a9b787b tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.505939 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5221291-320e-494a-ade2-2c595a9b787b tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?host=n-d-854441-12" status: 200 len: 581 microversion: 2.1 time: 0.064564 Oct 17 15:24:24.507258 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 340/667] 10.222.0.87 () {58 vars in 1174 bytes} [Mon Oct 17 15:24:24 2022] GET /compute/v2.1/os-services?host=n-d-854441-12 => generated 581 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:24.521794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07af9504-ea09-4782-a6e3-24c65399a413 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:24.528564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af9504-ea09-4782-a6e3-24c65399a413 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.529202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af9504-ea09-4782-a6e3-24c65399a413 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.529645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af9504-ea09-4782-a6e3-24c65399a413 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.530401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af9504-ea09-4782-a6e3-24c65399a413 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.530905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af9504-ea09-4782-a6e3-24c65399a413 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.531317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af9504-ea09-4782-a6e3-24c65399a413 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.559197 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07af9504-ea09-4782-a6e3-24c65399a413 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.042369 Oct 17 15:24:24.568567 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 341/668] 10.222.0.87 () {58 vars in 1176 bytes} [Mon Oct 17 15:24:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:24.574650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ea28157-462d-47b2-8f92-4a0cb211db02 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:24.579593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea28157-462d-47b2-8f92-4a0cb211db02 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.580326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea28157-462d-47b2-8f92-4a0cb211db02 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.581052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea28157-462d-47b2-8f92-4a0cb211db02 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.582196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea28157-462d-47b2-8f92-4a0cb211db02 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.582935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea28157-462d-47b2-8f92-4a0cb211db02 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.583569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ea28157-462d-47b2-8f92-4a0cb211db02 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.607672 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dfedf2ae-ffe7-4354-bb79-1c93d57cc217 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 204 len: 0 microversion: 2.1 time: 0.326292 Oct 17 15:24:24.609120 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 328/669] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:24:24 2022] DELETE /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:24:24.620594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:24.621790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:24.630312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.631229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.632673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.633614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.634258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.635273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.655468 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ea28157-462d-47b2-8f92-4a0cb211db02 tempest-ServicesAdminTestJSON-1592414677 tempest-ServicesAdminTestJSON-1592414677-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.084823 Oct 17 15:24:24.656211 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 342/670] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:24 2022] GET /compute/v2.1/os-services => generated 949 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:24.691783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:24.692433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:24.715497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.716276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.717179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:24.718368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:24.719308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:24.725461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:25.032947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:25.045940 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9046ea7d-8ac2-4abb-adac-ecf73e9ffe9e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1494 microversion: 2.1 time: 0.357094 Oct 17 15:24:25.046926 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 343/671] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:24 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1494 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:25.058086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:25.064281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:25.079323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:25.081473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:25.083783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:25.084707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:25.086011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:25.087585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:25.185753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:25.198804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:25.201597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:25.214699 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cd67af9-9906-46a9-850a-4819eec25124 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1531 microversion: 2.91 time: 0.166259 Oct 17 15:24:25.216056 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 344/672] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:25 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1531 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:25.231460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:25.232074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:25.243039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:25.243542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:25.243974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:25.244682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:25.249599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:25.250149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:25.281430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:25.295094 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9722721b-182c-4fea-8a07-07d2b65f3182 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1478 microversion: 2.1 time: 0.681064 Oct 17 15:24:25.308370 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 329/673] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:24 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1478 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:25.486955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:25.495742 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a026f155-e6d0-4a32-95dc-43eef4ea5f7d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.276015 Oct 17 15:24:25.516866 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 345/674] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:25 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:25.678805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-66c3698f-ffc1-4b58-a389-af432d437381 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:25.679747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-66c3698f-ffc1-4b58-a389-af432d437381 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:25.687787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c3698f-ffc1-4b58-a389-af432d437381 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:25.695957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c3698f-ffc1-4b58-a389-af432d437381 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:25.696711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c3698f-ffc1-4b58-a389-af432d437381 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:25.697651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c3698f-ffc1-4b58-a389-af432d437381 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:25.698102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c3698f-ffc1-4b58-a389-af432d437381 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:25.698724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c3698f-ffc1-4b58-a389-af432d437381 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:25.807610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:25.811034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:25.824734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:25.825255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:25.825694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:25.826421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:25.829696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:25.830143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.050229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lazy-loading 'services' on Instance uuid 98141701-d49a-42aa-a983-c59e9d2c3ba1 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:24:26.140843 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2fc1a2b-cad5-4474-b762-b5c7e777b958 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1938 microversion: 2.91 time: 0.622353 Oct 17 15:24:26.141980 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 346/675] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:25 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1938 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:26.170826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:26.171415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:26.179143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.180020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.180653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.181729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.182356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.186758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.196636 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-66c3698f-ffc1-4b58-a389-af432d437381 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1647 microversion: 2.1 time: 0.899314 Oct 17 15:24:26.197266 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 330/676] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:25 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1647 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:26.227840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2086c212-db19-414e-bf40-847fc8724a48 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:26.228691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2086c212-db19-414e-bf40-847fc8724a48 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:26.243020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2086c212-db19-414e-bf40-847fc8724a48 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.245626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2086c212-db19-414e-bf40-847fc8724a48 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.247619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2086c212-db19-414e-bf40-847fc8724a48 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.248527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2086c212-db19-414e-bf40-847fc8724a48 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.250648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2086c212-db19-414e-bf40-847fc8724a48 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.251207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2086c212-db19-414e-bf40-847fc8724a48 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.296248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lazy-loading 'services' on Instance uuid 98141701-d49a-42aa-a983-c59e9d2c3ba1 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:24:26.318896 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e39d7d3d-5fed-41c3-a666-946fa5bfa495 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1938 microversion: 2.91 time: 0.152718 Oct 17 15:24:26.332442 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 347/677] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:26 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1938 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:24:26.346896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:26.347761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:26.356414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.357519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.357975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.358798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.359261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.359742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.674668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:26.683570 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e26877d2-9bb6-479a-bbd7-1605692ef89d tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1478 microversion: 2.1 time: 0.349401 Oct 17 15:24:26.684160 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 348/678] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:26 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1478 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:26.688725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ffb90404-1ef3-4286-bd28-37afb64f869a tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:26.695178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffb90404-1ef3-4286-bd28-37afb64f869a tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.695921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffb90404-1ef3-4286-bd28-37afb64f869a tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.696581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffb90404-1ef3-4286-bd28-37afb64f869a tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.697508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffb90404-1ef3-4286-bd28-37afb64f869a tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.698090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffb90404-1ef3-4286-bd28-37afb64f869a tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.698728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffb90404-1ef3-4286-bd28-37afb64f869a tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.725858 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ffb90404-1ef3-4286-bd28-37afb64f869a tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.040458 Oct 17 15:24:26.727156 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 349/679] 10.222.0.87 () {60 vars in 1217 bytes} [Mon Oct 17 15:24:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:24:26.731994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:26.739124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:26.748257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.756565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.757377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.758397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.759193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.760365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.806669 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2086c212-db19-414e-bf40-847fc8724a48 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1647 microversion: 2.1 time: 0.583640 Oct 17 15:24:26.808143 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 331/680] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:26 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1647 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:26.814611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:26.815389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:26.827027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.827864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.828504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.829644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:26.830257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:26.831089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:26.861776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lazy-loading 'flavor' on Instance uuid 98141701-d49a-42aa-a983-c59e9d2c3ba1 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:24:27.156956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:27.172055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9180bc69-236c-45cb-b72d-f82a62230e82 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1474 microversion: 2.1 time: 0.442357 Oct 17 15:24:27.173350 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 350/681] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:26 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1474 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:27.179560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4171e212-d290-42bd-b476-449039db48d8 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:27.185307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4171e212-d290-42bd-b476-449039db48d8 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:27.186023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4171e212-d290-42bd-b476-449039db48d8 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:27.186681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4171e212-d290-42bd-b476-449039db48d8 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:27.188303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4171e212-d290-42bd-b476-449039db48d8 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:27.189245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4171e212-d290-42bd-b476-449039db48d8 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:27.197743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4171e212-d290-42bd-b476-449039db48d8 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:27.272407 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4171e212-d290-42bd-b476-449039db48d8 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.097716 Oct 17 15:24:27.274056 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 351/682] 10.222.0.87 () {58 vars in 1176 bytes} [Mon Oct 17 15:24:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:27.280392 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b05845f1-439d-4c85-9faf-59676efee55f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "POST /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1/action" status: 202 len: 0 microversion: 2.91 time: 0.470685 Oct 17 15:24:27.281020 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 332/683] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:24:26 2022] POST /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:24:27.291953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:27.292648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:27.292789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854441-12", "block_migration": true, "disk_over_commit": false}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:27.295726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:27.310433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:27.310974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:27.311532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:27.312254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:27.312705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:27.313122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:27.332040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:27.335403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:27.342127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:27.345262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:27.348188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:27.350190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:27.490808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lazy-loading 'flavor' on Instance uuid 33832aef-61a6-417f-9061-676bd10b92ac {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:24:27.491695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:27.501183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:27.502925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:27.506743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Going to try to live migrate instance to n-h2-854441-12 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 15:24:27.512507 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-327e9d7e-e27e-4a82-80de-ac925bf0d605 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.226165 Oct 17 15:24:27.521489 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 333/684] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:27 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:27.710005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:27.710679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:27.722067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:27.722599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:27.723039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:27.723796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:27.724249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:27.724666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:27.862907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4610d60e4c154bd6ab5b66e238d4541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70295fa3676c40c88cee677a1dd84ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:27.873466 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1b5ae496-0baf-4441-816f-35814721680f tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 200 len: 1436 microversion: 2.1 time: 0.165444 Oct 17 15:24:27.889538 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 334/685] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:27 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 1436 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:28.202382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:28.204477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:28.224850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:28.233252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:28.243445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:28.244564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:28.246086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:28.249260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:28.255297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:28.893423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:28.902255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc07d950-9a78-4efe-8fca-d8d27d071778 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1473 microversion: 2.1 time: 0.706775 Oct 17 15:24:28.902477 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 335/686] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:28 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1473 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:28.917862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f3c91b6a-5748-4734-acec-962bbeb95847 req-e574df33-79bf-4704-9340-f3d79d961cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1eb4e3f-2a07-451d-8093-1390b98f0454", "name": "network-vif-deleted", "tag": "9230af05-af45-49db-91ef-84165b1b5de5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:28.949767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f3c91b6a-5748-4734-acec-962bbeb95847 req-e574df33-79bf-4704-9340-f3d79d961cfe service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:28.950519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f3c91b6a-5748-4734-acec-962bbeb95847 req-e574df33-79bf-4704-9340-f3d79d961cfe service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:28.951098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f3c91b6a-5748-4734-acec-962bbeb95847 req-e574df33-79bf-4704-9340-f3d79d961cfe service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:28.963636 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f3c91b6a-5748-4734-acec-962bbeb95847 req-e574df33-79bf-4704-9340-f3d79d961cfe service nova] Creating event network-vif-deleted:9230af05-af45-49db-91ef-84165b1b5de5 for instance b1eb4e3f-2a07-451d-8093-1390b98f0454 on n-h1-854441-12 Oct 17 15:24:28.973030 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f3c91b6a-5748-4734-acec-962bbeb95847 req-e574df33-79bf-4704-9340-f3d79d961cfe service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059279 Oct 17 15:24:28.973972 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 336/687] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:28.981326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:28.982490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:28.991714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:28.992956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:28.993624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:28.995866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:28.996596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:28.997189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:29.031945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=59,nova_cell0:UPDATE=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:29.423217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:29.522695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:29.536399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:29.537825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:29.564975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=34 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:29.571495 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-966ce3f2-a9b5-4638-9244-015aa8bc4db8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.595831 Oct 17 15:24:29.572121 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 337/688] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:28 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:29.588801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:29.592201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] [instance: b1eb4e3f-2a07-451d-8093-1390b98f0454] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:29.610808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:29.615703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:29.621172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:29.622641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:29.623363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:29.624123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:29.660205 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] HTTP exception thrown: Instance b1eb4e3f-2a07-451d-8093-1390b98f0454 could not be found. Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Request method failure captured: Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 HTTP/1.1 Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNvR_67nx-lc_MQkDqdDhMtW7_rFkMYJQh_ehLVpnF9QiXeNET9qCsiQuomeRoHBlaeCJk-fxvd4TZvf9magQ0HdLmP4__tD3O0ingYvgzsoWCKI6ngQ_Y2mFM-ks94nyRDgdIq5CYsxp1eGOIXFdFvAt2GzaAYaNOf2bB0RQv5Zj4 Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 70295fa3676c40c88cee677a1dd84ac6 Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-687972980 Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:24:29.668818 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/70295fa3676c40c88cee677a1dd84ac6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/70295fa3676c40c88cee677a1dd84ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_70295fa3676c40c88cee677a1dd84ac6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/70295fa3676c40c88cee677a1dd84ac6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-687972980 Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 70295fa3676c40c88cee677a1dd84ac6 Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-687972980 Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersAdminNegativeTestJSON-687972980-project Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 4610d60e4c154bd6ab5b66e238d4541e Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-687972980-project Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance b1eb4e3f-2a07-451d-8093-1390b98f0454 could not be found. Oct 17 15:24:29.670420 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'b1eb4e3f-2a07-451d-8093-1390b98f0454'} Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1eb4e3f-2a07-451d-8093-1390b98f0454 could not be found. Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:29.671300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1eb4e3f-2a07-451d-8093-1390b98f0454 could not be found. Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1eb4e3f-2a07-451d-8093-1390b98f0454 could not be found. Oct 17 15:24:29.672668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:29.674575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] Returning 404 to user: Instance b1eb4e3f-2a07-451d-8093-1390b98f0454 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:29.678362 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d737043e-4fed-4e87-b1a5-51a950451741 tempest-ServersAdminNegativeTestJSON-687972980 tempest-ServersAdminNegativeTestJSON-687972980-project] 10.222.0.87 "GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454" status: 404 len: 111 microversion: 2.1 time: 0.102848 Oct 17 15:24:29.679212 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 338/689] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:29 2022] GET /compute/v2.1/servers/b1eb4e3f-2a07-451d-8093-1390b98f0454 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:24:30.328984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2b9d1a7-f945-4dce-b40d-caf5b88a0f06 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:30.344210 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2b9d1a7-f945-4dce-b40d-caf5b88a0f06 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.663522 Oct 17 15:24:30.356606 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 339/690] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:30.371711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-95ea1569-c5e7-4ea0-952e-c59e7d6adfb0 req-ca6d1bc4-63e9-42b8-9f0d-65741ba3ea3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88c7d5d-8596-4064-b313-10976ecf63fa", "name": "network-vif-unplugged", "status": "completed", "tag": "d40489a8-5c88-4b32-a52a-751ce1cb2d44"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:30.396953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-95ea1569-c5e7-4ea0-952e-c59e7d6adfb0 req-ca6d1bc4-63e9-42b8-9f0d-65741ba3ea3e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:30.398040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-95ea1569-c5e7-4ea0-952e-c59e7d6adfb0 req-ca6d1bc4-63e9-42b8-9f0d-65741ba3ea3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:30.398703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-95ea1569-c5e7-4ea0-952e-c59e7d6adfb0 req-ca6d1bc4-63e9-42b8-9f0d-65741ba3ea3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:30.404050 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-893cc5f5-76ab-4d85-b4ae-7223648c6d68 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac/action" status: 202 len: 0 microversion: 2.1 time: 3.117591 Oct 17 15:24:30.405510 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 352/691] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:24:27 2022] POST /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac/action => generated 0 bytes in 3120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:24:30.411774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:30.412958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:30.425912 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-95ea1569-c5e7-4ea0-952e-c59e7d6adfb0 req-ca6d1bc4-63e9-42b8-9f0d-65741ba3ea3e service nova] Creating event network-vif-unplugged:d40489a8-5c88-4b32-a52a-751ce1cb2d44 for instance b88c7d5d-8596-4064-b313-10976ecf63fa on n-h1-854441-12 Oct 17 15:24:30.434284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:30.435457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:30.437503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:30.438489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:30.440003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:30.443244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:30.454690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-95ea1569-c5e7-4ea0-952e-c59e7d6adfb0 req-ca6d1bc4-63e9-42b8-9f0d-65741ba3ea3e service nova] Instance b88c7d5d-8596-4064-b313-10976ecf63fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:24:30.483349 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-95ea1569-c5e7-4ea0-952e-c59e7d6adfb0 req-ca6d1bc4-63e9-42b8-9f0d-65741ba3ea3e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125207 Oct 17 15:24:30.486430 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 340/692] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:30.498407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-feaa325b-29f7-40cf-a0fb-e2846a839894 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:30.589482 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-feaa325b-29f7-40cf-a0fb-e2846a839894 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors" status: 200 len: 3080 microversion: 2.1 time: 0.100785 Oct 17 15:24:30.600611 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 341/693] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:24:30 2022] GET /compute/v2.1/flavors => generated 3080 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:30.608162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:30.610899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:30.630480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:30.631344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:30.636310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:30.637342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:30.639030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:30.639704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:30.931380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:30.948091 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6116d99c-860b-4fbc-8644-fa6f84692fe4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1473 microversion: 2.1 time: 0.536445 Oct 17 15:24:30.949007 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 353/694] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:30 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1473 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:30.964854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:30.965793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:30.978349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:30.979200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:30.980443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:30.981503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:30.982219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:30.984609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:31.177318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:31.195935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:31.201258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:31.220101 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08f627ff-6c3c-496e-b34f-636351dc0d6d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.269785 Oct 17 15:24:31.220710 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 354/695] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:30 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:31.259988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a819e1f-bb32-4126-9c3c-63caa2a46ed7 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.270421 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a819e1f-bb32-4126-9c3c-63caa2a46ed7 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020937 Oct 17 15:24:31.281134 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 355/696] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:31.290644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-544d9f37-3d94-479e-98c9-6b53d120bf96 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.295974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:31.302107 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-544d9f37-3d94-479e-98c9-6b53d120bf96 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018783 Oct 17 15:24:31.309830 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 356/697] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:31.320554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b429e9f5-5680-48ea-85e6-9512c91ee072 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.343283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:31.360142 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe025b86-6cfe-4281-be8a-46897afa8a90 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1504 microversion: 2.1 time: 0.759651 Oct 17 15:24:31.367245 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 342/698] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:30 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1504 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:31.400096 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b429e9f5-5680-48ea-85e6-9512c91ee072 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.087630 Oct 17 15:24:31.407636 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 357/699] 10.222.0.87 () {58 vars in 1165 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:31.422925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-35d6ac4d-465c-447c-996a-a73e6b5745aa tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.438072 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-35d6ac4d-465c-447c-996a-a73e6b5745aa tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019150 Oct 17 15:24:31.442838 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 343/700] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:31.453075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5557d28c-3290-4d23-8bfa-c158002784d2 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.522338 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5557d28c-3290-4d23-8bfa-c158002784d2 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.074167 Oct 17 15:24:31.530605 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 358/701] 10.222.0.87 () {58 vars in 1169 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:31.569025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc821730-027c-4581-839d-440bbbd359a2 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.623025 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc821730-027c-4581-839d-440bbbd359a2 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.055734 Oct 17 15:24:31.623710 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 344/702] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:31.639679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7c04f36-c10b-4d53-a8a6-82ea8e8679fc tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.655341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7c04f36-c10b-4d53-a8a6-82ea8e8679fc tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019402 Oct 17 15:24:31.656405 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 359/703] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:31.669512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff377490-4c16-40b5-ac91-4d3e6416ff13 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.725517 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff377490-4c16-40b5-ac91-4d3e6416ff13 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.060625 Oct 17 15:24:31.730115 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 345/704] 10.222.0.87 () {58 vars in 1167 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:31.748524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2593e94-3a69-4df6-8b0d-e6b395138923 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.761724 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2593e94-3a69-4df6-8b0d-e6b395138923 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020009 Oct 17 15:24:31.769922 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 360/705] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:31.780125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7ca0a8d-486f-49a0-96b9-9cb5c25aa094 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.813143 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b7ca0a8d-486f-49a0-96b9-9cb5c25aa094 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.041398 Oct 17 15:24:31.832021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4de3397-7e4d-4a20-bb05-619dc0a2c909 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.835809 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 346/706] 10.222.0.87 () {58 vars in 1144 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:31.841799 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4de3397-7e4d-4a20-bb05-619dc0a2c909 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014736 Oct 17 15:24:31.850763 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 361/707] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:31.855700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5294573f-2c22-4bca-a590-f7c0398372db tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.909327 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5294573f-2c22-4bca-a590-f7c0398372db tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.057428 Oct 17 15:24:31.920857 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 347/708] 10.222.0.87 () {58 vars in 1148 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:31.929265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b86615a-cb7d-41d1-b50a-da337eb5475c tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.978940 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b86615a-cb7d-41d1-b50a-da337eb5475c tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.054263 Oct 17 15:24:31.982136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:31.990683 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 362/709] 10.222.0.87 () {58 vars in 1140 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:31.992392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:32.003969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:32.004184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ae27dce-7d27-4842-a7e3-55b394486c77 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:32.004608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:32.007604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:32.008664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:32.011230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:32.011788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:32.027269 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ae27dce-7d27-4842-a7e3-55b394486c77 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030258 Oct 17 15:24:32.027932 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 363/710] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:32.051023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdb7dfb9-6f73-4d79-b528-d1db29ebd46f tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:32.102143 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdb7dfb9-6f73-4d79-b528-d1db29ebd46f tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.062218 Oct 17 15:24:32.105661 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 364/711] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:24:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:32.123838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11830f66-ecaf-4cf6-b12d-a418b45af4af tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:32.174090 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11830f66-ecaf-4cf6-b12d-a418b45af4af tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.055111 Oct 17 15:24:32.190554 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 365/712] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:24:32 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:32.206235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d9ee5e6-5d18-4c13-ba03-ebc64d3676d2 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:32.223488 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d9ee5e6-5d18-4c13-ba03-ebc64d3676d2 tempest-FlavorsV2TestJSON-1511325144 tempest-FlavorsV2TestJSON-1511325144-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022834 Oct 17 15:24:32.228703 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 366/713] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:32.256596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:32.257494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:32.271705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:32.276416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:32.277080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:32.278197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:32.282255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:32.283093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:32.352229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:32.354894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:32.364804 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9f93f33a-a144-4e68-ba1a-36852ebed130 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1473 microversion: 2.1 time: 0.392249 Oct 17 15:24:32.387228 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 348/714] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:31 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1473 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:32.393610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:32.407897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:32.420367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:32.423903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:32.424474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:32.425298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:32.427392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:32.427925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:32.476293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:32.488278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:32.498564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:32.504752 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a26c3913-ee69-47d1-924e-3e0faf23d044 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.255265 Oct 17 15:24:32.519465 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 367/715] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:32 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:24:32.555936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-70c8ac59-d964-40cd-b97f-11688e8fa15b req-1db47107-8052-4feb-8ec9-5e33f52e0814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88c7d5d-8596-4064-b313-10976ecf63fa", "tag": "d40489a8-5c88-4b32-a52a-751ce1cb2d44"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:32.590932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-70c8ac59-d964-40cd-b97f-11688e8fa15b req-1db47107-8052-4feb-8ec9-5e33f52e0814 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:32.593387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-70c8ac59-d964-40cd-b97f-11688e8fa15b req-1db47107-8052-4feb-8ec9-5e33f52e0814 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:32.594087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-70c8ac59-d964-40cd-b97f-11688e8fa15b req-1db47107-8052-4feb-8ec9-5e33f52e0814 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:32.620345 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-70c8ac59-d964-40cd-b97f-11688e8fa15b req-1db47107-8052-4feb-8ec9-5e33f52e0814 service nova] Creating event network-changed:d40489a8-5c88-4b32-a52a-751ce1cb2d44 for instance b88c7d5d-8596-4064-b313-10976ecf63fa on n-h1-854441-12 Oct 17 15:24:32.639726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-70c8ac59-d964-40cd-b97f-11688e8fa15b req-1db47107-8052-4feb-8ec9-5e33f52e0814 service nova] Instance b88c7d5d-8596-4064-b313-10976ecf63fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:24:32.663740 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-70c8ac59-d964-40cd-b97f-11688e8fa15b req-1db47107-8052-4feb-8ec9-5e33f52e0814 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111389 Oct 17 15:24:32.665079 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 368/716] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:33.005855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:33.015297 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6adbf933-1bc1-4569-b0f6-87e36b2dcfa7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1504 microversion: 2.1 time: 0.625445 Oct 17 15:24:33.023501 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 349/717] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:32 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1504 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:33.157139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf11a820>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:33.163291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.164810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.165411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.176315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.176756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.177302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.187339 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] HTTP exception thrown: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Request method failure captured: Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-services/d9c05d6f-1813-4f75-afee-1e5733fe6e65 HTTP/1.1 Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 56 Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOwYbivKav3xd1QTskFpFFXejkAvhZn2Y5hlPh8Ged7S3Aa_C0e2aPzM1MSkk2nbZa1BEO8ajqrocpol9XVSvocshwEMWmzVQn3cp2is3gve28jYVs7IoPaYXF4vRDefNNG9gpslSqX4YpQAbUDZYRwKMAMLXhrdzGb5Tf7GHBP_1o Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4ce2b2963f004ad78f4526fea802c3dc Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1381698762 Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:24:33.190696 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1381698762 Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4ce2b2963f004ad78f4526fea802c3dc Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1381698762 Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ba2b9a8e2d464821b0357c4ebd6d487b Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:24:33.192269 n-d-854441-12 devstack@n-api.service[120406]: exception: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'd9c05d6f-1813-4f75-afee-1e5733fe6e65', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.193502 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:33.195512 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:33.198628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:33.198628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.198628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.198628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Returning 404 to user: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:33.198628 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd1f52a0-c9a7-40df-aed2-39651a0ec78e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-services/d9c05d6f-1813-4f75-afee-1e5733fe6e65" status: 404 len: 110 microversion: 2.53 time: 0.528755 Oct 17 15:24:33.198628 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 369/718] 10.222.0.87 () {62 vars in 1309 bytes} [Mon Oct 17 15:24:32 2022] PUT /compute/v2.1/os-services/d9c05d6f-1813-4f75-afee-1e5733fe6e65 => generated 110 bytes in 533 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:24:33.212534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Action: 'update', calling method: .version_select at 0x7f28bf3c65e0>, body: {"status": "disabled"} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:33.224515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.225007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.225449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.240628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.241479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.242350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.255661 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] HTTP exception thrown: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Request method failure captured: Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: request: PUT /compute/v2.1/os-services/d9c05d6f-1813-4f75-afee-1e5733fe6e65 HTTP/1.1 Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 22 Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOwYbivKav3xd1QTskFpFFXejkAvhZn2Y5hlPh8Ged7S3Aa_C0e2aPzM1MSkk2nbZa1BEO8ajqrocpol9XVSvocshwEMWmzVQn3cp2is3gve28jYVs7IoPaYXF4vRDefNNG9gpslSqX4YpQAbUDZYRwKMAMLXhrdzGb5Tf7GHBP_1o Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4ce2b2963f004ad78f4526fea802c3dc Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1381698762 Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:24:33.262632 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1381698762 Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4ce2b2963f004ad78f4526fea802c3dc Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1381698762 Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ba2b9a8e2d464821b0357c4ebd6d487b Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: {"status": "disabled"} Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: exception: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.264112 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd9c05d6f-1813-4f75-afee-1e5733fe6e65', 'body': {'status': 'disabled'}} Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.264918 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:33.266301 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:33.267608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.267608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.272425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Returning 404 to user: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:33.274748 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e530d0b0-7a0a-4422-b97f-56ce34cea36d tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-services/d9c05d6f-1813-4f75-afee-1e5733fe6e65" status: 404 len: 110 microversion: 2.53 time: 0.065856 Oct 17 15:24:33.276443 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 350/719] 10.222.0.87 () {62 vars in 1309 bytes} [Mon Oct 17 15:24:33 2022] PUT /compute/v2.1/os-services/d9c05d6f-1813-4f75-afee-1e5733fe6e65 => generated 110 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:24:33.287874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Action: 'update', calling method: .version_select at 0x7f28bef3aee0>, body: {"status": "enabled"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:33.291639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.292208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.292711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.298805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.299394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.299900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.303144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:33.306460 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] HTTP exception thrown: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Request method failure captured: Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-services/d9c05d6f-1813-4f75-afee-1e5733fe6e65 HTTP/1.1 Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 21 Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOwYbivKav3xd1QTskFpFFXejkAvhZn2Y5hlPh8Ged7S3Aa_C0e2aPzM1MSkk2nbZa1BEO8ajqrocpol9XVSvocshwEMWmzVQn3cp2is3gve28jYVs7IoPaYXF4vRDefNNG9gpslSqX4YpQAbUDZYRwKMAMLXhrdzGb5Tf7GHBP_1o Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4ce2b2963f004ad78f4526fea802c3dc Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1381698762 Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:24:33.308171 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4ce2b2963f004ad78f4526fea802c3dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1381698762 Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4ce2b2963f004ad78f4526fea802c3dc Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1381698762 Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ba2b9a8e2d464821b0357c4ebd6d487b Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: {"status": "enabled"} Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: exception: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.309551 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'd9c05d6f-1813-4f75-afee-1e5733fe6e65', 'body': {'status': 'enabled'}} Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.310346 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:24:33.311924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:24:33.316128 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. Oct 17 15:24:33.316128 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:33.316128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Returning 404 to user: Service d9c05d6f-1813-4f75-afee-1e5733fe6e65 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:33.316128 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40e831a9-35a8-47d0-b242-f853ef3ef2df tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-services/d9c05d6f-1813-4f75-afee-1e5733fe6e65" status: 404 len: 110 microversion: 2.53 time: 0.025667 Oct 17 15:24:33.316128 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 370/720] 10.222.0.87 () {62 vars in 1309 bytes} [Mon Oct 17 15:24:33 2022] PUT /compute/v2.1/os-services/d9c05d6f-1813-4f75-afee-1e5733fe6e65 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:24:33.334172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b69e5124-0039-4147-af0d-e9e6a429155a tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:33.342247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69e5124-0039-4147-af0d-e9e6a429155a tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.342768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69e5124-0039-4147-af0d-e9e6a429155a tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.344914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69e5124-0039-4147-af0d-e9e6a429155a tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.345751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69e5124-0039-4147-af0d-e9e6a429155a tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.346234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69e5124-0039-4147-af0d-e9e6a429155a tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.347386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69e5124-0039-4147-af0d-e9e6a429155a tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.393699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:33.394808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:33.402389 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b69e5124-0039-4147-af0d-e9e6a429155a tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.085933 Oct 17 15:24:33.413349 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 351/721] 10.222.0.87 () {60 vars in 1178 bytes} [Mon Oct 17 15:24:33 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:33.419025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.420611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.425892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.426747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.427323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.427916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.429465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5e5d974d-4432-4a6f-831b-d1e9944f038e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:33.440630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e5d974d-4432-4a6f-831b-d1e9944f038e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.442511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e5d974d-4432-4a6f-831b-d1e9944f038e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.443237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e5d974d-4432-4a6f-831b-d1e9944f038e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.445375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e5d974d-4432-4a6f-831b-d1e9944f038e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.446940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e5d974d-4432-4a6f-831b-d1e9944f038e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.449129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e5d974d-4432-4a6f-831b-d1e9944f038e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.560729 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5e5d974d-4432-4a6f-831b-d1e9944f038e tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.134548 Oct 17 15:24:33.562929 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 352/722] 10.222.0.87 () {60 vars in 1211 bytes} [Mon Oct 17 15:24:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:33.573200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-10ed4c53-2427-4140-94ca-080af3c5d370 req-af5b14a9-a297-4fd3-b2c2-19c19222c1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33832aef-61a6-417f-9061-676bd10b92ac", "name": "network-vif-unplugged", "status": "completed", "tag": "b2d5c653-09bc-422e-8ea4-94b4d18f9d5b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:33.593416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-10ed4c53-2427-4140-94ca-080af3c5d370 req-af5b14a9-a297-4fd3-b2c2-19c19222c1d2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.601353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-10ed4c53-2427-4140-94ca-080af3c5d370 req-af5b14a9-a297-4fd3-b2c2-19c19222c1d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.602294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-10ed4c53-2427-4140-94ca-080af3c5d370 req-af5b14a9-a297-4fd3-b2c2-19c19222c1d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.619274 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-10ed4c53-2427-4140-94ca-080af3c5d370 req-af5b14a9-a297-4fd3-b2c2-19c19222c1d2 service nova] Creating event network-vif-unplugged:b2d5c653-09bc-422e-8ea4-94b4d18f9d5b for instance 33832aef-61a6-417f-9061-676bd10b92ac on n-h1-854441-12 Oct 17 15:24:33.644001 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-10ed4c53-2427-4140-94ca-080af3c5d370 req-af5b14a9-a297-4fd3-b2c2-19c19222c1d2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079226 Oct 17 15:24:33.644627 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 353/723] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:33.650157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:33.654020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:33.670776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.671601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.675028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.676003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.680220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.680674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.903842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:33.927979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:33.930764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:33.939033 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-14e1626e-53ba-44b0-9bf1-9dddff222dd5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.292550 Oct 17 15:24:33.939903 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 354/724] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:33 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:33.961046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-906ddfe3-b5c8-4809-8cee-41c873afcebd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:33.965096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906ddfe3-b5c8-4809-8cee-41c873afcebd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.965859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906ddfe3-b5c8-4809-8cee-41c873afcebd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.966570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906ddfe3-b5c8-4809-8cee-41c873afcebd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:33.967505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906ddfe3-b5c8-4809-8cee-41c873afcebd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:33.973077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906ddfe3-b5c8-4809-8cee-41c873afcebd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:33.973810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906ddfe3-b5c8-4809-8cee-41c873afcebd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.016111 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-906ddfe3-b5c8-4809-8cee-41c873afcebd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.071364 Oct 17 15:24:34.017077 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 355/725] 10.222.0.87 () {60 vars in 1178 bytes} [Mon Oct 17 15:24:33 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:34.029983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-82832f87-4194-4382-8885-74989307a9dd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:34.036129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82832f87-4194-4382-8885-74989307a9dd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:34.036948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82832f87-4194-4382-8885-74989307a9dd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:34.037690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82832f87-4194-4382-8885-74989307a9dd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.039269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82832f87-4194-4382-8885-74989307a9dd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:34.040332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82832f87-4194-4382-8885-74989307a9dd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:34.041636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82832f87-4194-4382-8885-74989307a9dd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.086193 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-82832f87-4194-4382-8885-74989307a9dd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?host=n-d-854441-12&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.056787 Oct 17 15:24:34.090518 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 356/726] 10.222.0.87 () {60 vars in 1237 bytes} [Mon Oct 17 15:24:34 2022] GET /compute/v2.1/os-services?host=n-d-854441-12&binary=xxx => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:34.100398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:34.105417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:34.117617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:34.126113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:34.129049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:34.129391 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d732a5cb-aab7-4736-a2c2-9a944a3fd5c4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1473 microversion: 2.1 time: 0.740838 Oct 17 15:24:34.129700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.130676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:34.132681 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 371/727] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:33 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1473 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:34.133494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:34.133932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.142307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7374981-016f-449d-b930-eb6380427ddd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:34.146016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7374981-016f-449d-b930-eb6380427ddd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:34.151162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7374981-016f-449d-b930-eb6380427ddd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:34.159224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7374981-016f-449d-b930-eb6380427ddd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.160067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7374981-016f-449d-b930-eb6380427ddd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:34.160566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7374981-016f-449d-b930-eb6380427ddd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:34.160994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7374981-016f-449d-b930-eb6380427ddd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.213272 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7374981-016f-449d-b930-eb6380427ddd tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.079460 Oct 17 15:24:34.213897 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 372/728] 10.222.0.87 () {60 vars in 1178 bytes} [Mon Oct 17 15:24:34 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:34.227765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f03c9d95-d24d-4a5e-9966-beddacd75b10 tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:34.239912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f03c9d95-d24d-4a5e-9966-beddacd75b10 tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:34.240736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f03c9d95-d24d-4a5e-9966-beddacd75b10 tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:34.241391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f03c9d95-d24d-4a5e-9966-beddacd75b10 tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.245250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f03c9d95-d24d-4a5e-9966-beddacd75b10 tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:34.246124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f03c9d95-d24d-4a5e-9966-beddacd75b10 tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:34.246827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f03c9d95-d24d-4a5e-9966-beddacd75b10 tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.274169 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f03c9d95-d24d-4a5e-9966-beddacd75b10 tempest-ServicesAdminNegativeV253TestJSON-1381698762 tempest-ServicesAdminNegativeV253TestJSON-1381698762-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.049818 Oct 17 15:24:34.275434 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 373/729] 10.222.0.87 () {60 vars in 1239 bytes} [Mon Oct 17 15:24:34 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:34.409749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:34.423799 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fb9b6a30-cb1e-4abb-90fb-9f137940dff9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1504 microversion: 2.1 time: 0.329231 Oct 17 15:24:34.424348 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 357/730] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:34 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:34.692852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c63059c8-d1b7-44ed-9c86-14bf66383310 tempest-ServicesAdminNegativeV253TestJSON-932046255 tempest-ServicesAdminNegativeV253TestJSON-932046255-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:34.697798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c63059c8-d1b7-44ed-9c86-14bf66383310 tempest-ServicesAdminNegativeV253TestJSON-932046255 tempest-ServicesAdminNegativeV253TestJSON-932046255-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e908d3ef1fc449629bdbb66691e06c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b442037ab84506b947900c5f8d1228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c63059c8-d1b7-44ed-9c86-14bf66383310 tempest-ServicesAdminNegativeV253TestJSON-932046255 tempest-ServicesAdminNegativeV253TestJSON-932046255-project] Request method failure captured: Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOuLABup2e9fBWossYKTeHEwX-TtbUEtEeDj6KeoRI9MX_zxhdqvWX3K-ow7RbI1lvJyNlFERLpL7Zwzr_D52EPxepFsk0mdA_niSTo4W9jYlNDBAC8S7UPHe0GxoRryUhoiqGlFYzGdlNz772KDcWVGPHppkEDoPj5X886uRdGQZE Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8b442037ab84506b947900c5f8d1228 Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-932046255 Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:24:34.702718 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8b442037ab84506b947900c5f8d1228"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8b442037ab84506b947900c5f8d1228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8b442037ab84506b947900c5f8d1228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8b442037ab84506b947900c5f8d1228"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-932046255 Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8b442037ab84506b947900c5f8d1228 Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-932046255 Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServicesAdminNegativeV253TestJSON-932046255-project Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: e908d3ef1fc449629bdbb66691e06c6b Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-932046255-project Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 15:24:34.704325 n-d-854441-12 devstack@n-api.service[120406]: action_args: {} Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:24:34.705383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 15:24:34.706986 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:24:34.708413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c63059c8-d1b7-44ed-9c86-14bf66383310 tempest-ServicesAdminNegativeV253TestJSON-932046255 tempest-ServicesAdminNegativeV253TestJSON-932046255-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:24:34.710076 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c63059c8-d1b7-44ed-9c86-14bf66383310 tempest-ServicesAdminNegativeV253TestJSON-932046255 tempest-ServicesAdminNegativeV253TestJSON-932046255-project] 10.222.0.87 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.412972 Oct 17 15:24:34.717814 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 374/731] 10.222.0.87 () {60 vars in 1178 bytes} [Mon Oct 17 15:24:34 2022] GET /compute/v2.1/os-services => generated 112 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:24:34.971185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:34.971910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:34.993034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:34.996746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:34.997871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:34.999361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:35.001608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:35.002689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:35.107038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:35.116929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:35.119157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:35.125491 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92038e2a-c186-48e8-a847-4a873cc4458c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.158528 Oct 17 15:24:35.138390 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 358/732] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:34 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:24:35.160929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:35.162522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:35.173513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:35.174006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:35.174812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:35.176324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:35.178918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:35.179872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:35.450272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:35.451384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:35.466570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:35.467267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:35.467494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:35.468738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:35.469351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:35.470953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:35.561357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:35.579411 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c03f9445-61a7-4778-9048-cfb500d13bfa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1471 microversion: 2.1 time: 0.425189 Oct 17 15:24:35.579894 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 375/733] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:35 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1471 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:35.676455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-87e11a7d-8877-44d0-940e-bc8570d0a65c req-0bd95699-236b-4880-b6b7-aea606b1c129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33832aef-61a6-417f-9061-676bd10b92ac", "tag": "b2d5c653-09bc-422e-8ea4-94b4d18f9d5b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:35.705955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-87e11a7d-8877-44d0-940e-bc8570d0a65c req-0bd95699-236b-4880-b6b7-aea606b1c129 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:35.706438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-87e11a7d-8877-44d0-940e-bc8570d0a65c req-0bd95699-236b-4880-b6b7-aea606b1c129 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:35.706909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-87e11a7d-8877-44d0-940e-bc8570d0a65c req-0bd95699-236b-4880-b6b7-aea606b1c129 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:35.730332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-87e11a7d-8877-44d0-940e-bc8570d0a65c req-0bd95699-236b-4880-b6b7-aea606b1c129 service nova] Creating event network-changed:b2d5c653-09bc-422e-8ea4-94b4d18f9d5b for instance 33832aef-61a6-417f-9061-676bd10b92ac on n-h1-854441-12 Oct 17 15:24:35.748682 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-87e11a7d-8877-44d0-940e-bc8570d0a65c req-0bd95699-236b-4880-b6b7-aea606b1c129 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077017 Oct 17 15:24:35.757470 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 376/734] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:35.784267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:35.797259 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2dc79f7a-516f-4d81-911e-b42b0a094c31 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1504 microversion: 2.1 time: 0.353249 Oct 17 15:24:35.800236 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 359/735] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:35 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:36.158970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:36.159612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:36.172690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:36.173206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:36.175434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:36.178824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:36.179465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:36.179915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:36.478853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:36.492001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:36.500239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:36.517283 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dd65fb9e-9fa1-4389-91ae-3647e439c9e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.362339 Oct 17 15:24:36.520552 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 360/736] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:36 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:24:36.726948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95592e24-f5bb-4165-a10b-6e825c7b04bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: .version_select at 0x7f28bef40a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1517575104", "description": "tempest-description-650738572"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:36.851607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2072729062", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:36.986399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:24:36.987982 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95592e24-f5bb-4165-a10b-6e825c7b04bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.941282 Oct 17 15:24:36.997812 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 377/737] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:24:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:37.003724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:37.004964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:37.014007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:37.015044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:37.015649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:37.017168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:37.018976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:37.021653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:37.299367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:37.313548 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fcec03a8-b7b4-4b6a-9f77-4b589cfcad0e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1468 microversion: 2.1 time: 0.317404 Oct 17 15:24:37.314128 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 378/738] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:36 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1468 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:37.319142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:37.320224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:37.326586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:37.327388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:37.328032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:37.328963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:37.329634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:37.330264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:37.376389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:24:37.377109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:24:37.377782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:24:37.378348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:24:37.379093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:24:37.389482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:37.390251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:37.390940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:37.391912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:37.392599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:37.393254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:37.414086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:37.421562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:37.435128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:24:37.437579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:24:37.513242 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f7f5a832-c75e-425c-bbc0-5ee61e38eb8a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946884 Oct 17 15:24:37.522065 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 361/739] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:24:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:24:37.526802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2fd0cac9-67ef-47b0-ac07-c550ffa424b4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: .version_select at 0x7f28bf0f0820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1122205114", "description": "tempest-description-382697656"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:37.710627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:37.727103 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-184d0d43-ae34-43dd-9f51-d41981b43350 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1504 microversion: 2.1 time: 0.409778 Oct 17 15:24:37.731453 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 379/740] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:37 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:37.738448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17d756f7-b4f9-4c5a-bddb-dc33c8b2b9c7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:37.739189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17d756f7-b4f9-4c5a-bddb-dc33c8b2b9c7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:37.776695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d756f7-b4f9-4c5a-bddb-dc33c8b2b9c7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:37.777115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d756f7-b4f9-4c5a-bddb-dc33c8b2b9c7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:37.777549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d756f7-b4f9-4c5a-bddb-dc33c8b2b9c7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:37.778290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d756f7-b4f9-4c5a-bddb-dc33c8b2b9c7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:37.778767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d756f7-b4f9-4c5a-bddb-dc33c8b2b9c7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:37.779207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17d756f7-b4f9-4c5a-bddb-dc33c8b2b9c7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:37.818396 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2fd0cac9-67ef-47b0-ac07-c550ffa424b4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.302346 Oct 17 15:24:37.823393 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 362/741] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:24:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:37.828605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-935f3386-868f-4542-a465-f9bec3cedbd6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:37.829232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-935f3386-868f-4542-a465-f9bec3cedbd6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:37.979443 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17d756f7-b4f9-4c5a-bddb-dc33c8b2b9c7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa/action" status: 204 len: 0 microversion: 2.1 time: 0.239499 Oct 17 15:24:37.980211 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 380/742] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:24:37 2022] POST /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa/action => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:24:38.004984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:38.011386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:38.055569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:38.059678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:38.060665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:38.062688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:38.066586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:38.068839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:38.100585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-935f3386-868f-4542-a465-f9bec3cedbd6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:38.112435 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-935f3386-868f-4542-a465-f9bec3cedbd6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1217 microversion: 2.1 time: 0.284194 Oct 17 15:24:38.118082 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 363/743] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:37 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1217 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:38.131593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1049466724", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "38c66c38-c5a7-484b-a607-a2664b041212"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:38.239981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] validate_networks() for [('38c66c38-c5a7-484b-a607-a2664b041212', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:24:38.342251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:38.360548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:38.363750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:38.390175 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0fa85d4c-412d-4001-8a4a-6c0cff20f6e5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.399259 Oct 17 15:24:38.395169 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 381/744] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:37 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:38.403819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:38.404769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:38.412815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:38.413633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:38.414258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:38.415201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:38.415819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:38.416449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:38.958869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:38.972847 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0af3d69a-1f68-4f6f-a755-763c88299493 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1468 microversion: 2.1 time: 0.574718 Oct 17 15:24:38.977301 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 382/745] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:38 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1468 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:38.985030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c2506c67-0224-46b3-afed-88c869797cfa req-3e1f78ea-77a6-447c-8cf4-0bc9224694bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88c7d5d-8596-4064-b313-10976ecf63fa", "name": "network-vif-plugged", "status": "completed", "tag": "d40489a8-5c88-4b32-a52a-751ce1cb2d44"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:39.009900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c2506c67-0224-46b3-afed-88c869797cfa req-3e1f78ea-77a6-447c-8cf4-0bc9224694bd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:39.010851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c2506c67-0224-46b3-afed-88c869797cfa req-3e1f78ea-77a6-447c-8cf4-0bc9224694bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:39.015890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c2506c67-0224-46b3-afed-88c869797cfa req-3e1f78ea-77a6-447c-8cf4-0bc9224694bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:39.038909 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c2506c67-0224-46b3-afed-88c869797cfa req-3e1f78ea-77a6-447c-8cf4-0bc9224694bd service nova] Creating event network-vif-plugged:d40489a8-5c88-4b32-a52a-751ce1cb2d44 for instance b88c7d5d-8596-4064-b313-10976ecf63fa on n-h1-854441-12 Oct 17 15:24:39.060779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-c2506c67-0224-46b3-afed-88c869797cfa req-3e1f78ea-77a6-447c-8cf4-0bc9224694bd service nova] Instance b88c7d5d-8596-4064-b313-10976ecf63fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:24:39.087959 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c2506c67-0224-46b3-afed-88c869797cfa req-3e1f78ea-77a6-447c-8cf4-0bc9224694bd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108215 Oct 17 15:24:39.089311 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 383/746] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:39.111182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:39.118088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:39.135592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:39.137431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:39.138775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:39.140955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:39.142973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:39.143689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:39.410518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:39.426755 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a03d9048-500f-4e49-9456-dd86efbfe25e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1504 microversion: 2.1 time: 0.335154 Oct 17 15:24:39.427285 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 384/747] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:39 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:39.457124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:39.459061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:39.466555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:39.467738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:39.468383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:39.469393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:39.469957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:39.470445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:39.546277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:24:39.547462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:24:39.548163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:24:39.548772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:24:39.549382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:24:39.579389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:39.580730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:39.581371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:39.582326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:39.583087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:39.583728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:39.611783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Getting quotas for project 44f6e3a7889145b2be55c1a543f6e9cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:39.620471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Getting quotas for user 8e0cca33970f49f1b9b6fa9830451dc0 and project 44f6e3a7889145b2be55c1a543f6e9cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:39.639767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:24:39.642785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:24:39.680898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:39.694812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:39.708467 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c353749-dca3-4baf-9dc0-161a6722d903 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1269 microversion: 2.1 time: 0.262992 Oct 17 15:24:39.716071 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 385/748] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:39 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1269 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:39.736431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:39.740122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:39.764318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5d897aa6-2488-4a69-a591-bd941cb05cba tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.645033 Oct 17 15:24:39.764997 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 364/749] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:24:39.767398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:39.767958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:39.768407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:39.769150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:39.769592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:39.770009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:39.787738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-497c2ad4-612c-4f23-b83d-3d72047269ad tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:39.788392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-497c2ad4-612c-4f23-b83d-3d72047269ad tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:39.897576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-497c2ad4-612c-4f23-b83d-3d72047269ad tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:39.909181 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-497c2ad4-612c-4f23-b83d-3d72047269ad tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1216 microversion: 2.1 time: 0.135159 Oct 17 15:24:39.913076 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 365/750] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:39 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:40.006816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:40.008187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:40.022642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:40.023240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:40.023718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:40.024451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:40.044557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:40.045205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:40.059506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:40.071513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:40.076609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:40.091623 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7cc6a8cf-b97c-4bdd-96c1-062d7ec38548 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.371591 Oct 17 15:24:40.094286 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 386/751] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:39 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:40.453048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:40.453886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:40.465641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:40.466147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:40.466607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:40.470829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:40.471784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:40.472315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:40.783598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:40.797329 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4245fc3e-77f9-4ca4-934e-6806af2d842a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1504 microversion: 2.1 time: 0.349485 Oct 17 15:24:40.799327 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 387/752] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:40 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:40.807181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:40.807809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:40.817073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:40.818660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:40.819293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:40.820134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:40.820597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:40.821194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:40.855332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:40.893871 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24da4625-b522-4588-94bb-6be759ac316c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1468 microversion: 2.1 time: 0.892666 Oct 17 15:24:40.911805 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 366/753] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:39 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1468 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:40.937681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:40.938293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:40.959476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:40.961338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:40.966051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:40.970161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:40.971649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:40.972893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:40.983289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:41.001052 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90d878b6-c425-44d1-a9ee-1d36f27e1a15 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1275 microversion: 2.1 time: 0.199791 Oct 17 15:24:41.018298 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 388/754] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:40 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1275 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:41.124361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:41.126800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:41.129438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:41.145315 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8ae8185b-f66b-49ef-9b64-98eec03ca4fd tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1220 microversion: 2.1 time: 0.213357 Oct 17 15:24:41.155014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:41.155994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:41.156648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:41.157604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:41.159086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:41.159737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:41.177684 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 367/755] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:40 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1220 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:41.296061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:41.313046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:41.319977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:41.331704 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3839a86-a9fa-414b-9233-17a8276aafca tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.214082 Oct 17 15:24:41.339470 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 389/756] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:41 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:24:41.831267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:41.832387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:41.856501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:41.862326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:41.868031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:41.869818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:41.871309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:41.872133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:41.930089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:41.934033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:41.981017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:41.988166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:41.989259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:41.995092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:41.996062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:41.996840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:42.102541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:43.217288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:43.235631 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3b68fa4-e8b0-43fe-87b2-66e6c681c9bb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1504 microversion: 2.1 time: 1.413389 Oct 17 15:24:43.238643 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 368/757] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:41 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1504 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:43.246977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:43.247588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:43.263027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:43.263536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:43.264164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:43.264690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:43.265156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:43.265579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:43.327333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:43.335878 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-410c0ff7-5af6-411b-8ea3-76147b37b384 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1460 microversion: 2.1 time: 1.413077 Oct 17 15:24:43.337162 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 390/758] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:41 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1460 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:43.342555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:43.343411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:43.350394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:43.351276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:43.351855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:43.352707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:43.353312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:43.353736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:43.442810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:43.483642 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76bd37ad-6b76-481c-9e7b-eb82d5342421 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1274 microversion: 2.1 time: 0.144876 Oct 17 15:24:43.484253 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 391/759] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:43 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:43.499938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:43.500468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:43.511628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:43.512549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:43.513371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:43.514912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:43.515603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:43.516352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:43.649268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:43.660253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:43.662488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:43.672456 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7306657c-430c-4c4c-8e7b-a22036c7ed69 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.176438 Oct 17 15:24:43.673697 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 392/760] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:43 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:43.683814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:43.685084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:43.737855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:43.742789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:43.746643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:43.747853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:43.749856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:43.753244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:43.884885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:43.918380 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c2ddc44a-5f99-42bc-a8fe-5a6e5c62e129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.671232 Oct 17 15:24:43.921147 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 369/761] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:43 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:44.253841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=27 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:44.277115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:44.279566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:44.295262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:44.298138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:44.301526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:44.301935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:44.303070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:44.304589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:44.319616 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-332d2f4f-957d-48e2-8fb3-7d8814e92081 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1460 microversion: 2.1 time: 0.644108 Oct 17 15:24:44.320528 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 393/762] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:43 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1460 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:44.330144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:44.349533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-925baa66-aa9d-400c-b772-d24805d06483 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'create', calling method: .version_select at 0x7f28beedddc0>, body: {"keypair": {"name": "tempest-keypair-523355754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj7EPzcDm9kfqYf6huYNTz4pahUr5pV936+7nBC4GWNCUTXayiR0gUP/9gfDLRfZjpDnqXO7UsEsY2C/9FuSJu7CeCGoppF984K00wAuL3IJmbhJFfiZWuVGqri1Zbgfg=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:44.377979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-925baa66-aa9d-400c-b772-d24805d06483 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:44.385850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-925baa66-aa9d-400c-b772-d24805d06483 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for user 5ec3b5fbeafd47558718a7a9638d0c9e and project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:44.421380 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-925baa66-aa9d-400c-b772-d24805d06483 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075664 Oct 17 15:24:44.423036 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 394/763] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:24:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:24:44.510103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:44.510960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:44.524619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:44.525447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:44.526220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:44.527333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:44.528161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:44.529025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:44.718127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:44.729201 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ccfb0aa2-a341-4490-93d5-88348732e0a7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1274 microversion: 2.1 time: 0.223650 Oct 17 15:24:44.729804 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 395/764] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:44 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1274 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:24:44.752482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:44.754118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:44.762271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:44.764171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:44.764813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:44.767290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:44.769590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:44.770470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:44.885423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:44.898000 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f872e7cc-2cdc-45d1-b438-732ab42caec4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1504 microversion: 2.1 time: 0.626847 Oct 17 15:24:44.899299 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 370/765] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:44 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1504 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:44.949097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:44.949617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:44.952839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:44.957472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:44.958369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:44.959653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:44.961079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:44.961710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:44.962285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:44.966083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:44.969692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:44.977421 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe04d6b2-2dba-4ab9-94f4-dd73ef4f2184 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.246469 Oct 17 15:24:44.991887 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 396/766] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:44 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:45.707699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:45.721330 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c296c52c-78a8-4b6d-ba43-a63399da3a29 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.783028 Oct 17 15:24:45.727057 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 371/767] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:44 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:45.753532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:45.754410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:45.766763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:45.769590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:45.771240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:45.772627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:45.774963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:45.777742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:45.778354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:45.924639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:45.925255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:45.940234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:45.942558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:45.943174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:45.944142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:45.944797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:45.945363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:46.475337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:46.492790 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f842832d-4d4b-4780-a03b-1f2d4bdec046 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1316 microversion: 2.1 time: 0.743943 Oct 17 15:24:46.494326 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 397/768] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:45 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1316 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:46.511825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:46.512502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:46.530475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:46.531032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:46.531522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:46.532285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:46.532744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:46.533171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:46.701661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:46.726834 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab20b89c-79f8-4b87-8591-97328b144d20 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1494 microversion: 2.1 time: 0.805944 Oct 17 15:24:46.728218 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 372/769] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:45 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1494 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:46.740990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f69878e7-3974-4fe0-b776-3b0788c003ae req-81f468fb-5b28-4cb4-93d9-67d3f9a7bfbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21af96d-b24a-454b-bc29-715bd73d273b", "tag": "3a8d5665-e578-4098-aee4-cfbc0995db0c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:46.755424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f69878e7-3974-4fe0-b776-3b0788c003ae req-81f468fb-5b28-4cb4-93d9-67d3f9a7bfbe service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:46.756163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f69878e7-3974-4fe0-b776-3b0788c003ae req-81f468fb-5b28-4cb4-93d9-67d3f9a7bfbe service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:46.756797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f69878e7-3974-4fe0-b776-3b0788c003ae req-81f468fb-5b28-4cb4-93d9-67d3f9a7bfbe service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:46.776689 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f69878e7-3974-4fe0-b776-3b0788c003ae req-81f468fb-5b28-4cb4-93d9-67d3f9a7bfbe service nova] Creating event network-changed:3a8d5665-e578-4098-aee4-cfbc0995db0c for instance e21af96d-b24a-454b-bc29-715bd73d273b on n-h1-854441-12 Oct 17 15:24:46.783536 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f69878e7-3974-4fe0-b776-3b0788c003ae req-81f468fb-5b28-4cb4-93d9-67d3f9a7bfbe service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050567 Oct 17 15:24:46.785128 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 373/770] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:46.794416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:46.796878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:46.808802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:46.809319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:46.809776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:46.810544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:46.811024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:46.811460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:46.839668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:46.997390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:47.012343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:47.014122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:47.040927 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb62d907-3576-4c9f-9078-a21cda53cfb3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.543799 Oct 17 15:24:47.043813 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 398/771] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:46 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:47.055678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0476e54-7c3b-4258-9bf6-48d3d865c8da tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '.version_select at 0x7f28bf233dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:47.065602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0476e54-7c3b-4258-9bf6-48d3d865c8da tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:47.066486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0476e54-7c3b-4258-9bf6-48d3d865c8da tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:47.067111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0476e54-7c3b-4258-9bf6-48d3d865c8da tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:47.080074 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0476e54-7c3b-4258-9bf6-48d3d865c8da tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 1196 microversion: 2.1 time: 0.034514 Oct 17 15:24:47.103996 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 399/772] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:24:47 2022] GET /compute/v2.1/os-migrations => generated 1196 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:47.117100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47837e03-a0b2-4bc3-93f4-08783a2f48a9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:47.117741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47837e03-a0b2-4bc3-93f4-08783a2f48a9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:47.134778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47837e03-a0b2-4bc3-93f4-08783a2f48a9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:47.135271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47837e03-a0b2-4bc3-93f4-08783a2f48a9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:47.137835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47837e03-a0b2-4bc3-93f4-08783a2f48a9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:47.138640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47837e03-a0b2-4bc3-93f4-08783a2f48a9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:47.139277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47837e03-a0b2-4bc3-93f4-08783a2f48a9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:47.139916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47837e03-a0b2-4bc3-93f4-08783a2f48a9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:47.365126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:47.380037 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6fa21750-ac11-4b83-920a-b7e5d8b59b6d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.591794 Oct 17 15:24:47.382123 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 374/773] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:46 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:47.522263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:47.523480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:47.541045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:47.541549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:47.541994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:47.542762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:47.543221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:47.543649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:47.649144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47837e03-a0b2-4bc3-93f4-08783a2f48a9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1647 microversion: 2.1 time: 0.543931 Oct 17 15:24:47.654744 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 400/774] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:47 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1647 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:47.979739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1520254851", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "7d66882a-376e-4e59-a30c-8056586fb6d2"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:48.039249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:48.058753 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8912a58-a2ac-4a9f-b216-a5bc2510f79e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1316 microversion: 2.1 time: 0.541456 Oct 17 15:24:48.088175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] validate_networks() for [('7d66882a-376e-4e59-a30c-8056586fb6d2', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:24:48.088935 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 375/775] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:47 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:48.108705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:48.109464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:48.120083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:48.128800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:48.129769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:48.131087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:48.132404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:48.133164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:48.481141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:48.494723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:48.499862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:48.516500 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4f2137fe-3f8f-446c-91c0-6b4e1c526828 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.426322 Oct 17 15:24:48.517784 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 376/776] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:48 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:48.524899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:48.536218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:48.546529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:48.547312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:48.548078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:48.549159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:48.551799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:48.552349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.311850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:49.324634 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-10353466-ec85-48fc-aba9-5905a700651c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.803396 Oct 17 15:24:49.325570 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 377/777] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:48 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:49.337386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:49.338273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:49.353493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:49.353997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:49.354450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.355290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:49.355742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:49.356176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.602023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=14 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:49.608499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:49.619389 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-06c2fe5c-0eae-4a92-a7c3-da0e291b09f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1316 microversion: 2.1 time: 0.292108 Oct 17 15:24:49.639196 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 378/778] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:49 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:49.648039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:24:49.648831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:24:49.648946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:24:49.649316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:24:49.649967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:24:49.654666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9092e49e-dd11-4455-95f0-e7b830d01bdd req-6b91f846-1ddb-43d8-83af-7d70af4113cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d", "tag": "be4c4639-9aeb-438a-ab03-55e2f2e5de57"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:49.666780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:49.667504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:49.668101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.669004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:49.670277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9092e49e-dd11-4455-95f0-e7b830d01bdd req-6b91f846-1ddb-43d8-83af-7d70af4113cf service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:49.670426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:49.670883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.671263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9092e49e-dd11-4455-95f0-e7b830d01bdd req-6b91f846-1ddb-43d8-83af-7d70af4113cf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:49.672334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9092e49e-dd11-4455-95f0-e7b830d01bdd req-6b91f846-1ddb-43d8-83af-7d70af4113cf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.685961 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9092e49e-dd11-4455-95f0-e7b830d01bdd req-6b91f846-1ddb-43d8-83af-7d70af4113cf service nova] Creating event network-changed:be4c4639-9aeb-438a-ab03-55e2f2e5de57 for instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d on n-h1-854441-12 Oct 17 15:24:49.692781 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9092e49e-dd11-4455-95f0-e7b830d01bdd req-6b91f846-1ddb-43d8-83af-7d70af4113cf service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051924 Oct 17 15:24:49.693626 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 379/779] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:49.702548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:49.703464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:49.710788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:49.711521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:49.711877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:49.712292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.713167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:49.713775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:49.714358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.729579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for user 13c8d45b2e4d459d92b024476b2f4fbd and project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:49.754808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:24:49.757808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:24:49.844121 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5aa4c6a3-4c9e-4994-aa47-c1504d9ea112 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.870138 Oct 17 15:24:49.845130 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 401/780] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:24:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:24:49.857447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:49.858302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:49.866358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:49.867247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:49.867876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.868823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:49.869585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:49.870177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:49.875192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:49.885975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:49.887647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:49.901944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d57e26e9-1aa0-4066-b93f-a9025e386853 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.206676 Oct 17 15:24:49.902734 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 380/781] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:49 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:49.914677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bfde5303-2237-4cb4-b6ab-b90585a9a1f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:49.915334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bfde5303-2237-4cb4-b6ab-b90585a9a1f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:49.936320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:24:49.952236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=16 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:50.193779 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-456ed581-879a-46e0-8c05-044dd7a20507 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "DELETE /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 204 len: 0 microversion: 2.1 time: 0.340206 Oct 17 15:24:50.195043 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 402/782] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:24:49 2022] DELETE /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:24:50.309547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bfde5303-2237-4cb4-b6ab-b90585a9a1f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:50.318088 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bfde5303-2237-4cb4-b6ab-b90585a9a1f8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1211 microversion: 2.1 time: 0.414169 Oct 17 15:24:50.323903 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 381/783] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:49 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1211 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:50.356249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:50.359321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:50.373893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:50.393379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:50.403244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:50.407101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:50.407887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:50.409161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:50.448782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-469666732", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "1007262630", "adminPass": "***", "networks": [{"uuid": "95fad76e-f3b2-47f0-aea3-f34beb499496"}], "security_groups": [{"name": "tempest-securitygroup--1266887381"}], "key_name": "tempest-keypair-1193477078", "user_data": "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:50.911881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] validate_networks() for [('95fad76e-f3b2-47f0-aea3-f34beb499496', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:24:50.985709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:51.002598 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a953e0b4-9d4a-4752-a112-fe5b93961782 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.657709 Oct 17 15:24:51.003806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 403/784] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:50 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:51.012294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:51.018650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:51.033503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:51.034012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:51.042987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:51.044045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:51.044720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:51.045315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:51.460111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:51.471500 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8d173f8-9b23-4dcf-8499-75bdd9f18ca9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1316 microversion: 2.1 time: 0.463638 Oct 17 15:24:51.494093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 404/785] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:51 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:51.499939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:51.502674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:51.511731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:51.512468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:51.513058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:51.513948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:51.515288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:51.516131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:51.642250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:51.652920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:51.655413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:51.662376 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de4f7a55-aea2-4d8e-a3f6-c17197735d06 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.166976 Oct 17 15:24:51.663646 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 405/786] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:51 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:51.669237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:51.670255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:51.677225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:51.678207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:51.679254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:51.680137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:51.680880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:51.681392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:51.845398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:51.854312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ada905b1-6265-474f-808c-b08ce8af702f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1215 microversion: 2.1 time: 0.189151 Oct 17 15:24:51.863411 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 406/787] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:51 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:51.869677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-617f81bb-3f49-4ae3-a47a-a2f0c243a926 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '.version_select at 0x7f28bef61820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:51.873331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-617f81bb-3f49-4ae3-a47a-a2f0c243a926 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:51.888463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:24:51.889254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:24:51.891246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:24:51.891673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-617f81bb-3f49-4ae3-a47a-a2f0c243a926 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:51.891789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:24:51.892133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-617f81bb-3f49-4ae3-a47a-a2f0c243a926 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:51.892649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:24:51.911265 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-617f81bb-3f49-4ae3-a47a-a2f0c243a926 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 1198 microversion: 2.1 time: 0.046436 Oct 17 15:24:51.928828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:51.932283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:51.937334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:51.941249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:51.956611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:51.957358 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 407/788] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:24:51 2022] GET /compute/v2.1/os-migrations => generated 1198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:51.961183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:52.055518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Getting quotas for project 526aebb581ba4845835d901c0475af9f. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:52.076046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Getting quotas for user a31b571ec20642bc8c31ce18fefb962c and project 526aebb581ba4845835d901c0475af9f. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:52.123266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:24:52.132820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:24:52.232675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1704383811", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "5f2e49b0-0bea-48ef-beb8-a039a0b44e77"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:52.333425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] validate_networks() for [('5f2e49b0-0bea-48ef-beb8-a039a0b44e77', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:24:52.371724 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-21d619dd-1c26-40a6-9e25-8782450d1d3e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.941572 Oct 17 15:24:52.373241 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 382/789] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:24:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:24:52.389604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccff47ff-87e5-419d-938e-8222860fddc5 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:52.411642 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ccff47ff-87e5-419d-938e-8222860fddc5 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036475 Oct 17 15:24:52.419716 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 383/790] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:24:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:52.425193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:52.426376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:52.433970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:52.434752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:52.435335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:52.436261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:52.436867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:52.437438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:52.789952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:52.800514 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e4b93ae4-26eb-4da9-8182-44249881126a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.379351 Oct 17 15:24:52.822996 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 384/791] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:52 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:52.831431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61ce2cbf-6e0a-4492-8dc4-c2633e653461 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:52.832064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61ce2cbf-6e0a-4492-8dc4-c2633e653461 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:52.976469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61ce2cbf-6e0a-4492-8dc4-c2633e653461 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:52.986206 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61ce2cbf-6e0a-4492-8dc4-c2633e653461 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1264 microversion: 2.1 time: 0.162036 Oct 17 15:24:53.005043 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 385/792] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:52 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:53.019789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-710beb79-acac-4e34-8621-aae11b3becea tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-208018254", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:53.075087 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-710beb79-acac-4e34-8621-aae11b3becea tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.065780 Oct 17 15:24:53.076052 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 386/793] 10.222.0.87 () {60 vars in 1146 bytes} [Mon Oct 17 15:24:53 2022] POST /compute/v2.1/flavors => generated 498 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:53.091210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:53.097017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:53.110886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:53.114065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:53.116484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:53.120584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:53.121478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:53.122129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:53.546084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:53.566558 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1c13bd7c-9554-4735-90c8-5253e73e28c2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1316 microversion: 2.1 time: 0.476591 Oct 17 15:24:53.567364 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 387/794] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:53 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:53.603638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:53.609448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:53.630074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:53.632153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:53.634322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:53.636621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:53.641733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:53.642214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:53.812685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:53.825967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:53.832241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:53.845544 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6972d94-2506-450b-a602-115cef13963f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1558 microversion: 2.91 time: 0.256984 Oct 17 15:24:53.846359 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 388/795] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:53 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1558 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:53.852723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:53.853344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:53.860490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:53.860985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:53.861421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:53.862136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:53.867124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:53.868868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:53.984016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:53.994784 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-776b2f5e-4a70-4901-8307-497a4450da46 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1269 microversion: 2.1 time: 0.147206 Oct 17 15:24:53.996153 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 389/796] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:53 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1269 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:54.001269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fa623913-b0ca-4249-9c6e-c22ef1f447c6 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:54.015947 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fa623913-b0ca-4249-9c6e-c22ef1f447c6 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017838 Oct 17 15:24:54.017162 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 390/797] 10.222.0.87 () {58 vars in 1182 bytes} [Mon Oct 17 15:24:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:24:54.022782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:54.023832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:54.033248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:54.034817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:54.035654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:54.042309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:54.043425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:54.044153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:54.460990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:24:54.462281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:24:54.464372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:24:54.465105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:24:54.468491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:24:54.497011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:54.497956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:54.499351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:54.500847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:54.501586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:54.502395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:54.531598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Getting quotas for project 80c6d074cf6a4c65b2656ec8e0451cde. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:54.604708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Getting quotas for user 2900a57571cf417aac13c765cc1e9eff and project 80c6d074cf6a4c65b2656ec8e0451cde. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:54.638304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:24:54.641695 n-d-854441-12 devstack@n-api.service[120406]: WARNING nova.utils [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1704383811 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-170438381 Oct 17 15:24:54.644354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:24:54.662226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:54.678127 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c92b4426-7268-47c8-893a-b16885bac6f0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.656121 Oct 17 15:24:54.681218 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 391/798] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:54 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:54.686975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:54.687603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:54.694671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:54.694908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:54.695294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:54.696016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:54.696482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:54.696908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:54.757679 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06d86f28-06e6-4fa8-9f64-37a467c49907 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.798894 Oct 17 15:24:54.760508 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 408/799] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:24:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:24:54.769234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1219800041", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "a90fc8d4-00c0-4281-9162-d741e55ece04"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:55.014403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:24:55.359817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:55.377138 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c0cc7489-d490-4ebc-86de-96f924a6cfd4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1316 microversion: 2.1 time: 0.688315 Oct 17 15:24:55.379860 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 392/800] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:54 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1316 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:55.391027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:55.395982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:55.412925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:55.413425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:55.418452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:55.419637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:55.420268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:55.420862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:55.949121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:55.971121 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4f75a8e1-a395-422b-9b30-b01a15be1908 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1316 microversion: 2.1 time: 0.581336 Oct 17 15:24:55.972327 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 393/801] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:55 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:55.990720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:55.993198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:56.007419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.008291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.009275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:56.010257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.011057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.014781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:56.078278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:24:56.079371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:24:56.080023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:24:56.080587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:24:56.081155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:24:56.100532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.101542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.104178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:56.105815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.119094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.119596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:56.155058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:56.202425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:56.220691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for user 5ec3b5fbeafd47558718a7a9638d0c9e and project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:56.240235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:56.268100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:24:56.278872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:24:56.279119 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-42b7370b-f8d9-40e7-9eb6-cab83a5531b0 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1236 microversion: 2.1 time: 0.305298 Oct 17 15:24:56.280831 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 394/802] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:55 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1236 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:56.288041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:56.288837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:56.296454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.297371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.298129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:56.299066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.299697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.300282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:56.480356 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5028b635-781d-45e6-a6b0-2cc66a0d705a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.717775 Oct 17 15:24:56.486689 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 409/803] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:24:56.509697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:56.513726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:56.571302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.577313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.577982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:56.578852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.586256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.586900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:56.715613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:56.727100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:56.733706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:56.757358 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-18d70293-ffb6-4f67-b6a2-7a3dd84c5ec1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.469243 Oct 17 15:24:56.763915 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 395/804] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:56 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:24:56.777219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:56.777892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:56.831894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.832412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.832846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:56.833584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:56.834043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:56.834520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:57.863554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:57.881490 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b6fd860-bb36-45f7-9ac6-57ae9f6ac2eb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1311 microversion: 2.1 time: 1.389007 Oct 17 15:24:57.882753 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 410/805] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:56 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1311 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:57.898027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:57.900481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:57.910052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:57.910957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:57.911676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:57.914788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:57.918658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:57.919633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:58.031861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:58.047449 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ec119844-f04a-4290-a69c-b4eadc75686e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 1.279386 Oct 17 15:24:58.048647 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 396/806] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:56 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:58.060903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-bfa0cece-34c5-4b49-a1c5-a4861c5eee84 req-764016c4-37d9-476c-95f6-5eaeafcd0624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c92757-4ed7-4d61-9156-4add9affe762", "name": "network-vif-deleted", "tag": "4a53f88e-978b-458e-8666-a0b33c244e39"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:58.078459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:58.094254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bfa0cece-34c5-4b49-a1c5-a4861c5eee84 req-764016c4-37d9-476c-95f6-5eaeafcd0624 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:58.096900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bfa0cece-34c5-4b49-a1c5-a4861c5eee84 req-764016c4-37d9-476c-95f6-5eaeafcd0624 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:58.098823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bfa0cece-34c5-4b49-a1c5-a4861c5eee84 req-764016c4-37d9-476c-95f6-5eaeafcd0624 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:58.108471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:58.131622 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bfa0cece-34c5-4b49-a1c5-a4861c5eee84 req-764016c4-37d9-476c-95f6-5eaeafcd0624 service nova] Creating event network-vif-deleted:4a53f88e-978b-458e-8666-a0b33c244e39 for instance 24c92757-4ed7-4d61-9156-4add9affe762 on n-h2-854441-12 Oct 17 15:24:58.137602 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6ec4361-2620-4464-b5eb-b4e519b1f9c1 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1322 microversion: 2.1 time: 0.245930 Oct 17 15:24:58.141766 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-bfa0cece-34c5-4b49-a1c5-a4861c5eee84 req-764016c4-37d9-476c-95f6-5eaeafcd0624 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091465 Oct 17 15:24:58.147358 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 397/807] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:24:58.151907 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 411/808] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:57 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:58.154775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:58.155889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:58.165534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:58.167358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:58.167973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:58.169006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:58.169810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:58.188102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:58.208074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:24:58.303478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1471442227", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "2243e6e3-9d81-48b1-bb5b-6d70da2406ed"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:24:58.419219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] validate_networks() for [('2243e6e3-9d81-48b1-bb5b-6d70da2406ed', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:24:58.558368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:58.567300 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf5b8bb3-5ae2-4bff-89e5-a0f810452a71 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1275 microversion: 2.1 time: 0.418414 Oct 17 15:24:58.576572 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 398/809] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:58 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1275 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:58.582661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:58.587159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:58.609454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:58.610589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:58.611276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:58.612253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:58.612951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:58.613640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:59.510491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:24:59.512080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:24:59.512816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:24:59.513434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:24:59.514104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:24:59.537671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:59.538635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:59.539324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:59.540795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:59.542440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:59.543124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:59.597641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Getting quotas for project d43225ce4f724468800718eed544b111. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:24:59.608559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Getting quotas for user de65615d61c54443b8b58ea1c5fd108e and project d43225ce4f724468800718eed544b111. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:24:59.630116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:24:59.633471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:24:59.719979 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5cbe6738-23ae-415f-ab8f-f4af22f4d2c2 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560478 Oct 17 15:24:59.721071 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 412/810] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:24:59.727026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:59.727650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:59.739620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:59.740130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:59.740887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:59.741738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:59.742323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:59.745420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:59.847297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:24:59.869975 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-082970be-03f8-40ad-aba9-4f12ccb3d045 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1316 microversion: 2.1 time: 1.291099 Oct 17 15:24:59.882613 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 399/811] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:58 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1316 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:24:59.883519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:24:59.886074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:24:59.898955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:59.903242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:59.904376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:24:59.909126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:24:59.910956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:24:59.911934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:00.147256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:00.163859 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a4180d6-0077-4055-a195-6decd74e9c4a tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1290 microversion: 2.1 time: 0.441536 Oct 17 15:25:00.177182 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 413/812] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:24:59 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1290 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:00.205838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-13a31286-77f3-453f-8c64-d612a3d5e767 req-05bb8cb6-9654-427c-90ce-75f62aefced0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d", "name": "network-vif-plugged", "status": "completed", "tag": "be4c4639-9aeb-438a-ab03-55e2f2e5de57"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:00.261127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-13a31286-77f3-453f-8c64-d612a3d5e767 req-05bb8cb6-9654-427c-90ce-75f62aefced0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:00.261617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-13a31286-77f3-453f-8c64-d612a3d5e767 req-05bb8cb6-9654-427c-90ce-75f62aefced0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:00.262047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-13a31286-77f3-453f-8c64-d612a3d5e767 req-05bb8cb6-9654-427c-90ce-75f62aefced0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:00.320333 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-13a31286-77f3-453f-8c64-d612a3d5e767 req-05bb8cb6-9654-427c-90ce-75f62aefced0 service nova] Creating event network-vif-plugged:be4c4639-9aeb-438a-ab03-55e2f2e5de57 for instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d on n-h1-854441-12 Oct 17 15:25:00.333172 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-13a31286-77f3-453f-8c64-d612a3d5e767 req-05bb8cb6-9654-427c-90ce-75f62aefced0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153252 Oct 17 15:25:00.335104 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 414/813] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:00.369980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:00.372575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:00.389893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:00.390859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:00.396219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:00.397890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:00.423832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:00.428009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:00.592862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:00.632885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:00.646626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:00.681815 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b0527c4e-1bd6-4047-9e13-ace6c8a3feb2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.802200 Oct 17 15:25:00.683961 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 400/814] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:24:59 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:00.694318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:00.697124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:00.713932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:00.718153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:00.719063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:00.722676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:00.724422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:00.725203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.206632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:01.227544 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87545b3f-1dd5-42cb-ad7a-f11f832f9689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1311 microversion: 2.1 time: 0.888199 Oct 17 15:25:01.231201 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 415/815] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:00 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1311 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:01.250154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:01.253507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:01.288209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:01.292794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.301871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.304778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.308068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.309654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.310654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.582807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:01.596340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:01.599142 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe6d35d2-ca42-42b6-be22-ee180b0556d7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.913802 Oct 17 15:25:01.599820 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 401/816] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:00 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:01.620742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:01.621362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:01.621545 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d644c99d-69eb-4e1c-9806-fda3a4102a1e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1390 microversion: 2.1 time: 0.388471 Oct 17 15:25:01.622193 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 416/817] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:01 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1390 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:01.632805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:01.638362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:01.654250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.654792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.655235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.656167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.656781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.657363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.657801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.658421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.661431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.662327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.662993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.668187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.804500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:01.826344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:01.831261 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3cce6284-110c-4b80-9a04-408799c2f93c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1276 microversion: 2.1 time: 0.206687 Oct 17 15:25:01.848732 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 417/818] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:01 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:01.849441 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dfb9f0ba-f598-4867-95a5-a1b1c52f1c6e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1337 microversion: 2.1 time: 0.248481 Oct 17 15:25:01.850137 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 402/819] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:01 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1337 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:01.857921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:01.860182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:01.860327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:01.861240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:01.868426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.869268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.869939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.871945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.872773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.873443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.886090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.886945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.887558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:01.891214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:01.893800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:01.895061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:02.033462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:02.470127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:02.481146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ba9ff81-d560-435d-acea-564c5d903f23 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1316 microversion: 2.1 time: 0.631186 Oct 17 15:25:02.486657 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 418/820] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:01 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:02.493784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:02.494736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:02.502132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:02.503044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:02.503898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:02.505173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:02.506276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:02.507065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:02.818147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:02.828972 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-db5a10b6-2426-41af-8af6-70b270fc82f9 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1290 microversion: 2.1 time: 0.974733 Oct 17 15:25:02.829882 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 403/821] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:01 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1290 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:02.864212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:02.865267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:02.874135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:02.875066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:02.875677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:02.876551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:02.877159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:02.877725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:02.920880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:02.939913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:02.941384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:02.949814 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d26a1ae3-808e-4a90-a81c-9a1ef6b55630 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.461414 Oct 17 15:25:02.966686 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 419/822] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:02 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:02.975308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ca01508b-bf7e-47f2-ab04-2c992277e62a req-04c6f910-25ae-4f91-89c1-8ace62dc8c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21af96d-b24a-454b-bc29-715bd73d273b", "name": "network-vif-plugged", "status": "completed", "tag": "3a8d5665-e578-4098-aee4-cfbc0995db0c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:02.982424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:02.994704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ca01508b-bf7e-47f2-ab04-2c992277e62a req-04c6f910-25ae-4f91-89c1-8ace62dc8c21 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:02.997892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ca01508b-bf7e-47f2-ab04-2c992277e62a req-04c6f910-25ae-4f91-89c1-8ace62dc8c21 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:02.999090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ca01508b-bf7e-47f2-ab04-2c992277e62a req-04c6f910-25ae-4f91-89c1-8ace62dc8c21 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:03.019047 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ca01508b-bf7e-47f2-ab04-2c992277e62a req-04c6f910-25ae-4f91-89c1-8ace62dc8c21 service nova] Creating event network-vif-plugged:3a8d5665-e578-4098-aee4-cfbc0995db0c for instance e21af96d-b24a-454b-bc29-715bd73d273b on n-h1-854441-12 Oct 17 15:25:03.031883 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ca01508b-bf7e-47f2-ab04-2c992277e62a req-04c6f910-25ae-4f91-89c1-8ace62dc8c21 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061584 Oct 17 15:25:03.034491 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 420/823] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:03.086730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:03.088248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:03.122650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:03.125323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:03.128335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:03.129532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:03.131712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:03.132451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:03.382770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:03.391918 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b417515d-c974-4291-a9e0-3a636af7a509 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1311 microversion: 2.1 time: 0.544564 Oct 17 15:25:03.400736 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 404/824] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:02 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1311 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:03.411579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:03.420373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:03.443236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:03.443853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:03.444314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:03.449152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:03.449658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:03.450105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:03.467861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:03.478844 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-557195ba-7194-4854-98ef-4a2be90df43a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.438574 Oct 17 15:25:03.485882 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 421/825] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:03 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:03.503853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:03.508539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:03.529788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:03.530296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:03.530774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:03.531493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:03.531948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:03.532371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:03.778004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:03.796373 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e050beaa-fd79-4433-b923-2206d3ac33c4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1282 microversion: 2.1 time: 0.307266 Oct 17 15:25:03.799652 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 422/826] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:03 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1282 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:03.818371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:03.821894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:03.844022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:03.847521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:03.848397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:03.850330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:03.854621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:03.855394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.030821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:04.056441 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c0e617fb-b95d-4b81-a3f9-630250ba2602 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1390 microversion: 2.1 time: 0.646758 Oct 17 15:25:04.058415 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 405/827] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:03 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1390 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:04.074055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2b5ac2b4-a3b8-4840-9f4e-2493ace2fc27 req-3205d374-23c0-4f19-b640-61b561673716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "189db5a7-8cc1-43e9-8edd-162434dd4ecf", "tag": "a616fde1-6d69-41c3-9362-6f07d6ec877d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:04.125143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2b5ac2b4-a3b8-4840-9f4e-2493ace2fc27 req-3205d374-23c0-4f19-b640-61b561673716 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.125923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2b5ac2b4-a3b8-4840-9f4e-2493ace2fc27 req-3205d374-23c0-4f19-b640-61b561673716 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:04.126565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2b5ac2b4-a3b8-4840-9f4e-2493ace2fc27 req-3205d374-23c0-4f19-b640-61b561673716 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.151746 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2b5ac2b4-a3b8-4840-9f4e-2493ace2fc27 req-3205d374-23c0-4f19-b640-61b561673716 service nova] Creating event network-changed:a616fde1-6d69-41c3-9362-6f07d6ec877d for instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf on n-h2-854441-12 Oct 17 15:25:04.159309 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2b5ac2b4-a3b8-4840-9f4e-2493ace2fc27 req-3205d374-23c0-4f19-b640-61b561673716 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095384 Oct 17 15:25:04.160215 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 406/828] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:04.171775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:04.172834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:04.179852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.180721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:04.181382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.182454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.185068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:04.186252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.329196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:04.341935 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76389601-3b09-418e-b750-1b24cb3bec0d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1379 microversion: 2.1 time: 0.540072 Oct 17 15:25:04.345863 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 423/829] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:03 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1379 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:04.357188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:04.360235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:04.376227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.376732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:04.377956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.378909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.380665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:04.381675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.711990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:04.728292 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed46d85a-20d6-4eee-96d9-7128f75a3e61 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1503 microversion: 2.1 time: 0.564060 Oct 17 15:25:04.730243 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 407/830] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:04 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1503 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:04.738276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:04.751693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:04.752547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:04.752958 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a7f6cd5-b789-4006-a1d3-4561c1022400 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1332 microversion: 2.1 time: 0.406111 Oct 17 15:25:04.758573 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 424/831] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:04 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1332 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:04.767886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:04.776813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.777738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:04.778402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.779454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:04.779755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.780447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:04.781093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.785958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.786453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:04.787587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.788328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.788829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:04.789220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:04.915416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:04.943049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:04.948857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:04.969559 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e413b21e-7aba-42be-911f-f0f2fa0194b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.235315 Oct 17 15:25:04.971677 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 408/832] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:04 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:04.984180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:04.985718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:04.997726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:04.999262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:05.004736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:05.005944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:05.007612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:05.008481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:05.262666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:05.273422 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57f8823f-d08c-40f2-8949-2a73dbc272bf tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1311 microversion: 2.1 time: 0.517701 Oct 17 15:25:05.291085 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 425/833] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:04 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1311 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:05.297260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1517575104"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:05.298160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:05.312395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:05.313216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:05.313964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:05.314922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:05.315586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:05.316225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:05.417017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:05.428620 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24d435c6-8715-48d2-bb0a-1895ebb70019 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1317 microversion: 2.1 time: 0.454192 Oct 17 15:25:05.440232 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 409/834] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:04 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:05.454808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:05.461157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:05.480484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:05.480988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:05.481426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:05.482139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:05.493525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:05.493993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:05.926366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:05.935574 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-066449aa-8345-4aa0-b250-dd78f20a2596 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1324 microversion: 2.1 time: 0.494125 Oct 17 15:25:05.951784 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 410/835] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:05 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1324 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:05.957084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e6d69770-14c2-43f4-8bc9-5f41f7c4d3ec req-6ebb6f04-be01-44a8-9c25-0f444fec48d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f2d90a-2839-4199-87db-d5739abf33a8", "tag": "f4f8835c-e978-4278-9cc8-bcb8389538d7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:05.967587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e6d69770-14c2-43f4-8bc9-5f41f7c4d3ec req-6ebb6f04-be01-44a8-9c25-0f444fec48d6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:05.968354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e6d69770-14c2-43f4-8bc9-5f41f7c4d3ec req-6ebb6f04-be01-44a8-9c25-0f444fec48d6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:05.968947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e6d69770-14c2-43f4-8bc9-5f41f7c4d3ec req-6ebb6f04-be01-44a8-9c25-0f444fec48d6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:06.000839 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e6d69770-14c2-43f4-8bc9-5f41f7c4d3ec req-6ebb6f04-be01-44a8-9c25-0f444fec48d6 service nova] Creating event network-changed:f4f8835c-e978-4278-9cc8-bcb8389538d7 for instance b4f2d90a-2839-4199-87db-d5739abf33a8 on n-h2-854441-12 Oct 17 15:25:06.009897 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e6d69770-14c2-43f4-8bc9-5f41f7c4d3ec req-6ebb6f04-be01-44a8-9c25-0f444fec48d6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053900 Oct 17 15:25:06.011839 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 411/836] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:06.030988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:06.032101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:06.041276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:06.042371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:06.043567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:06.044484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:06.045110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:06.045690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:06.104581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.network.security_group_api [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Adding security group 5c022cea-5e62-4f49-8e07-de46833fdde0 to port be4c4639-9aeb-438a-ab03-55e2f2e5de57 Oct 17 15:25:07.116152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:07.126084 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb658184-d31a-4515-8fd3-bcac15f2309c tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1390 microversion: 2.1 time: 1.112751 Oct 17 15:25:07.126708 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 412/837] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:06 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1390 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:07.140496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:07.141314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:07.165101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:07.170195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:07.171783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:07.172766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:07.173448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:07.174112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:07.724140 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b94278e3-ff6e-4325-b607-8eae7cbf56a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d/action" status: 202 len: 0 microversion: 2.1 time: 2.431348 Oct 17 15:25:07.725504 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 426/838] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:05 2022] POST /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d/action => generated 0 bytes in 2434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:07.730596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:07.731497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:07.749936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:07.751829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:07.751829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:07.754907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:07.755962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:07.763249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:07.854081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:07.864564 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ecd955b7-73b3-4294-a72b-eaa2a763883c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1379 microversion: 2.1 time: 0.728129 Oct 17 15:25:07.871049 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 413/839] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:07 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1379 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:07.903342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:07.903968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:07.911501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:07.912070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:07.912590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:07.919675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:07.920364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:07.920889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.071626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:08.082183 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2810f71d-5a2c-43e4-a587-d0bbbf936b1f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1332 microversion: 2.1 time: 0.355397 Oct 17 15:25:08.089555 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 427/840] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:07 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1332 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:08.098808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-11f17aab-2ee4-4b70-b9db-ebe7a8b365cd req-a3ee57df-1d46-483d-9415-6aa7f6049ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbaccdf-2e7a-4036-aad1-0458d0071d3c", "tag": "c4adad94-d883-47dc-a4f2-13b83f40f971"}, {"name": "network-changed", "server_uuid": "f04dead0-b7ae-4861-aeb9-c9e8626abfa1", "tag": "0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:08.130380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:08.131043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-11f17aab-2ee4-4b70-b9db-ebe7a8b365cd req-a3ee57df-1d46-483d-9415-6aa7f6049ed6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.143367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-11f17aab-2ee4-4b70-b9db-ebe7a8b365cd req-a3ee57df-1d46-483d-9415-6aa7f6049ed6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.143654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:08.144811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-11f17aab-2ee4-4b70-b9db-ebe7a8b365cd req-a3ee57df-1d46-483d-9415-6aa7f6049ed6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.148779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:08.161936 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-11f17aab-2ee4-4b70-b9db-ebe7a8b365cd req-a3ee57df-1d46-483d-9415-6aa7f6049ed6 service nova] Creating event network-changed:c4adad94-d883-47dc-a4f2-13b83f40f971 for instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c on n-h2-854441-12 Oct 17 15:25:08.162194 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a69e3a4-ffda-485e-b8f3-3af8080d26ed tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.289597 Oct 17 15:25:08.163018 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 414/841] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:07 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:08.170793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:08.176318 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-11f17aab-2ee4-4b70-b9db-ebe7a8b365cd req-a3ee57df-1d46-483d-9415-6aa7f6049ed6 service nova] Creating event network-changed:0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 for instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 on n-h1-854441-12 Oct 17 15:25:08.182735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:08.189817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.193310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.194038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.194589 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-11f17aab-2ee4-4b70-b9db-ebe7a8b365cd req-a3ee57df-1d46-483d-9415-6aa7f6049ed6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.102135 Oct 17 15:25:08.196609 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 428/842] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:08.196982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.197643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.199398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.217050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:08.220706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:08.228284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.230046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.231520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.232510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.233179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.233807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.265613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:08.442378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:08.452187 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6be90d60-f3b0-4468-ac0f-ede463284ef2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1467 microversion: 2.1 time: 0.254185 Oct 17 15:25:08.453294 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 429/843] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:08 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1467 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:08.458469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:08.459552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:08.485881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.486460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.491770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.492643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.493183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.493674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.616369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:08.624588 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2870db84-0448-42e2-a9b8-0d1cb0e9929d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1311 microversion: 2.1 time: 0.460262 Oct 17 15:25:08.625180 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 415/844] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:08 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1311 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:08.639746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1122205114"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:08.640903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:08.652922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.653677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.656833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.657790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.658247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.658705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.678731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:08.741911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:08.756019 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bfad155e-41d0-40a8-9870-ef3f0607ede4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1324 microversion: 2.1 time: 0.301347 Oct 17 15:25:08.760346 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 430/845] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:08 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:08.765943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6a71dcf6-0f1d-4310-880e-0380ea8e8821 req-a72038b8-a31d-4f78-8ae7-833984407f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11396321-8b48-4627-858e-90aabfbe0432", "tag": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe"}, {"name": "network-changed", "server_uuid": "2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d", "tag": "be4c4639-9aeb-438a-ab03-55e2f2e5de57"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:08.780698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a71dcf6-0f1d-4310-880e-0380ea8e8821 req-a72038b8-a31d-4f78-8ae7-833984407f79 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.782165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a71dcf6-0f1d-4310-880e-0380ea8e8821 req-a72038b8-a31d-4f78-8ae7-833984407f79 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.783552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a71dcf6-0f1d-4310-880e-0380ea8e8821 req-a72038b8-a31d-4f78-8ae7-833984407f79 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.804707 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6a71dcf6-0f1d-4310-880e-0380ea8e8821 req-a72038b8-a31d-4f78-8ae7-833984407f79 service nova] Creating event network-changed:ad6d955f-b8f4-4902-bca5-a5ef16b95dbe for instance 11396321-8b48-4627-858e-90aabfbe0432 on n-h1-854441-12 Oct 17 15:25:08.805541 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6a71dcf6-0f1d-4310-880e-0380ea8e8821 req-a72038b8-a31d-4f78-8ae7-833984407f79 service nova] Creating event network-changed:be4c4639-9aeb-438a-ab03-55e2f2e5de57 for instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d on n-h1-854441-12 Oct 17 15:25:08.817549 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6a71dcf6-0f1d-4310-880e-0380ea8e8821 req-a72038b8-a31d-4f78-8ae7-833984407f79 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055375 Oct 17 15:25:08.820164 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.network.security_group_api [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Adding security group 84465c56-38cc-454c-aadb-3c764f8d8a5b to port be4c4639-9aeb-438a-ab03-55e2f2e5de57 Oct 17 15:25:08.822477 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 431/846] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:08.828652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:08.829534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:08.840025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.841255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.841923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:08.843062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:08.843887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:08.845007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.019439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:09.028577 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f51cae5b-482e-40b7-a4a3-1083264e5eec tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1390 microversion: 2.1 time: 0.204410 Oct 17 15:25:09.030185 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 432/847] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:08 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1390 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:09.232080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-461c6f53-8f10-481e-8071-474786dd68b7 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:09.233492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-461c6f53-8f10-481e-8071-474786dd68b7 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:09.241759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461c6f53-8f10-481e-8071-474786dd68b7 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.242336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461c6f53-8f10-481e-8071-474786dd68b7 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.242881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461c6f53-8f10-481e-8071-474786dd68b7 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.243652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461c6f53-8f10-481e-8071-474786dd68b7 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.244204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461c6f53-8f10-481e-8071-474786dd68b7 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.244734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-461c6f53-8f10-481e-8071-474786dd68b7 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.456314 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9e2afeb4-5322-43a9-89ae-1d6c5ecae858 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d/action" status: 202 len: 0 microversion: 2.1 time: 0.819874 Oct 17 15:25:09.457714 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 416/848] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:08 2022] POST /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:09.474020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:09.476668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:09.504180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.509626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.510077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.510875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.511329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.518761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.571815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:09.592047 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-461c6f53-8f10-481e-8071-474786dd68b7 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1620 microversion: 2.1 time: 0.557724 Oct 17 15:25:09.593203 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 433/849] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:09 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1620 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:09.598624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:09.599234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:09.605939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.609264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.609264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.609264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.609638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.609638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.625822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=28 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:09.738784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:09.749885 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a88ff5d-060b-4f05-95cb-d91b0152e3ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1379 microversion: 2.1 time: 0.290838 Oct 17 15:25:09.762527 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 417/850] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:09 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1379 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:09.762527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:09.762527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:09.763900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.764398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.764826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.765532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.765974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.766390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.779537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:09.791333 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a439c46e-d860-4e50-a591-d3ed374a12b1 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1332 microversion: 2.1 time: 0.196188 Oct 17 15:25:09.791592 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 434/851] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:09 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1332 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:09.798475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f696b803-0ba3-4e94-8453-c4dd6a796fd7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:09.799378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f696b803-0ba3-4e94-8453-c4dd6a796fd7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:09.807626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f696b803-0ba3-4e94-8453-c4dd6a796fd7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.808261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f696b803-0ba3-4e94-8453-c4dd6a796fd7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.809099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f696b803-0ba3-4e94-8453-c4dd6a796fd7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.809903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f696b803-0ba3-4e94-8453-c4dd6a796fd7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:09.810438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f696b803-0ba3-4e94-8453-c4dd6a796fd7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:09.810951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f696b803-0ba3-4e94-8453-c4dd6a796fd7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:09.879516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:09.901330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:09.905535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:09.912902 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d5f83d8d-9cbf-4b50-937e-3bc7bc1d79b2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.160733 Oct 17 15:25:09.927099 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 418/852] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:09 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:09.927099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46e2f65f-9b9a-4453-a2bf-230ffbb09819 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Action: 'create', calling method: .version_select at 0x7f28bf11e040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-694503667", "policies": ["affinity"]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:09.942962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-46e2f65f-9b9a-4453-a2bf-230ffbb09819 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:09.949448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-46e2f65f-9b9a-4453-a2bf-230ffbb09819 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:10.008196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-46e2f65f-9b9a-4453-a2bf-230ffbb09819 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:10.014898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-46e2f65f-9b9a-4453-a2bf-230ffbb09819 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:10.029974 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-46e2f65f-9b9a-4453-a2bf-230ffbb09819 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.114240 Oct 17 15:25:10.039317 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 419/853] 10.222.0.87 () {60 vars in 1174 bytes} [Mon Oct 17 15:25:09 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:10.040755 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f696b803-0ba3-4e94-8453-c4dd6a796fd7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.247862 Oct 17 15:25:10.050910 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 435/854] 10.222.0.87 () {58 vars in 1293 bytes} [Mon Oct 17 15:25:09 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d/os-security-groups => generated 1157 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:10.050910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:10.050910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:10.059123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:10.060089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:10.069538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:10.069924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:10.070492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:10.071154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:10.085914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:10.086380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:10.086878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:10.087455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:10.090463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:10.091791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:10.093373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:10.093831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:10.343990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:10.359608 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9705b5d-140e-4ce4-b0a0-bc994e9ec4f3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1324 microversion: 2.1 time: 0.315927 Oct 17 15:25:10.360217 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 436/855] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:10 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:10.364801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:10.374945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:10.384511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:10.385325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:10.386173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:10.387421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:10.388023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:10.388464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:10.592178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:10.604826 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81468f3f-4738-40b2-b43e-b2949c272f15 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1311 microversion: 2.1 time: 0.563975 Oct 17 15:25:10.605764 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 420/856] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:10 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1311 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:10.621542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e0ed11a3-e1bc-48fd-88f0-9f808cf4adc6 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: .version_select at 0x7f28bf45c550>, body: {"security_group": {"name": " tempest-securitygroup -1497997542 ", "description": "tempest-description-1817221088"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:10.710318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:10.721794 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae5132a4-b4de-46c4-a467-dfb8e1baf92e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1390 microversion: 2.1 time: 0.360501 Oct 17 15:25:10.726378 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 437/857] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:10 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1390 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:10.740381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-835870803", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f37a43ff-eefa-4838-b0a5-1068b6e615b1"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:10.861083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:25:11.044965 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e0ed11a3-e1bc-48fd-88f0-9f808cf4adc6 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.430326 Oct 17 15:25:11.046302 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 421/858] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:25:10 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:11.051541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-eda155bb-3597-4ab3-b66f-addc8528121d req-a3225924-3008-4263-bacc-3f6ad6e7a590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d", "tag": "be4c4639-9aeb-438a-ab03-55e2f2e5de57"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:11.075169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-eda155bb-3597-4ab3-b66f-addc8528121d req-a3225924-3008-4263-bacc-3f6ad6e7a590 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:11.075809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-eda155bb-3597-4ab3-b66f-addc8528121d req-a3225924-3008-4263-bacc-3f6ad6e7a590 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:11.076342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-eda155bb-3597-4ab3-b66f-addc8528121d req-a3225924-3008-4263-bacc-3f6ad6e7a590 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:11.112132 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-eda155bb-3597-4ab3-b66f-addc8528121d req-a3225924-3008-4263-bacc-3f6ad6e7a590 service nova] Creating event network-changed:be4c4639-9aeb-438a-ab03-55e2f2e5de57 for instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d on n-h1-854441-12 Oct 17 15:25:11.124871 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-eda155bb-3597-4ab3-b66f-addc8528121d req-a3225924-3008-4263-bacc-3f6ad6e7a590 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076419 Oct 17 15:25:11.125276 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 422/859] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:11.141151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9b214796-14c8-45e4-9f20-ec58f4b35e25 req-69edbfe3-8508-4a99-a3fb-d75e76cd859a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189db5a7-8cc1-43e9-8edd-162434dd4ecf", "name": "network-vif-plugged", "status": "completed", "tag": "a616fde1-6d69-41c3-9362-6f07d6ec877d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:11.164356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9b214796-14c8-45e4-9f20-ec58f4b35e25 req-69edbfe3-8508-4a99-a3fb-d75e76cd859a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:11.164865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9b214796-14c8-45e4-9f20-ec58f4b35e25 req-69edbfe3-8508-4a99-a3fb-d75e76cd859a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:11.165298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9b214796-14c8-45e4-9f20-ec58f4b35e25 req-69edbfe3-8508-4a99-a3fb-d75e76cd859a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:11.195466 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9b214796-14c8-45e4-9f20-ec58f4b35e25 req-69edbfe3-8508-4a99-a3fb-d75e76cd859a service nova] Creating event network-vif-plugged:a616fde1-6d69-41c3-9362-6f07d6ec877d for instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf on n-h2-854441-12 Oct 17 15:25:11.203602 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9b214796-14c8-45e4-9f20-ec58f4b35e25 req-69edbfe3-8508-4a99-a3fb-d75e76cd859a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076546 Oct 17 15:25:11.204878 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 423/860] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:11.212350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:11.213389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:11.220323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:11.221102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:11.221278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:11.221958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:11.222417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:11.223349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:11.433657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:25:11.434089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:25:11.434593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:25:11.435007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:25:11.435421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:25:11.476124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:11.476508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:11.476957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:11.477701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:11.478948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:11.479401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:11.504936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:11.511696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:11.512880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:11.525246 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ec98d06e-a0d5-4745-824c-68205b167790 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1379 microversion: 2.1 time: 0.318979 Oct 17 15:25:11.528804 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 424/861] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:11 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1379 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:11.535645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Going to run 2 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:25:11.550529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:11.552572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:11.576389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:11.577501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:11.579666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:25:11.580661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:11.582055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:11.590718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:11.590718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:11.639169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120406) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 17 15:25:11.663945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:11.670184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:11.721208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:11.727803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:11.744785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=8bd095af-cfc4-415b-bd1f-7cf9234fcc2f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:25:11.817612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:11.824439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:11.826519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:11.896767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:11.903923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:11.973691 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f26e5388-881c-466a-98af-388136d0d281 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.242238 Oct 17 15:25:11.976670 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 438/862] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:25:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 1248 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 17 15:25:11.989619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:11.990934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:12.007914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.011075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.011902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:12.013199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.015025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.016224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:12.144731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:12.159576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:12.161473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:12.168854 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-752c32b4-5510-43cd-95b0-b872a0d797fb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.189628 Oct 17 15:25:12.187868 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 439/863] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:11 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:12.187868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96ca4a29-cb8a-463d-9713-e83a6195fdf1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bf259b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:12.233170 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96ca4a29-cb8a-463d-9713-e83a6195fdf1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64" status: 200 len: 224 microversion: 2.1 time: 0.061812 Oct 17 15:25:12.241162 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 440/864] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:25:12 2022] GET /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64 => generated 224 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:12.241162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:12.241162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:12.249190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.249763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.250103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:12.251093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.251540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.251953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:12.411369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:12.429103 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-11d6de03-5a16-418e-a626-328263f982f2 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1332 microversion: 2.1 time: 0.898378 Oct 17 15:25:12.430040 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 425/865] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:11 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1332 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:12.435078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:12.438922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:12.457390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.458099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.458752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:12.459693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.460352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.460957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:12.516447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:12.525168 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b88f66c-cb33-4a16-a547-51ceedcda483 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1324 microversion: 2.1 time: 0.290039 Oct 17 15:25:12.527255 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 441/866] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:12 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:12.532366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:12.533054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:12.539819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.540418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.540915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:12.541685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.542196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.542699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:12.796198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:12.811842 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2df854a9-cf02-480f-9761-705c12688900 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1311 microversion: 2.1 time: 0.380614 Oct 17 15:25:12.815485 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 426/867] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:12 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1311 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:12.827117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:12.827709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:12.838045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:12.841261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Searching by: {'deleted': False, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:25:12.854566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-efe256b8-f5b8-4e29-805d-722532f2b712 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1390 microversion: 2.1 time: 0.324836 Oct 17 15:25:12.866296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 442/868] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:12 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1390 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:12.881166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84acc4ed-0cb9-4db0-80b1-9e55e48068f2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28beee5160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:12.903173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.904764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.909090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:12.910120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:12.911833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:12.915877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:13.181752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:25:13.307661 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84acc4ed-0cb9-4db0-80b1-9e55e48068f2 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64" status: 202 len: 0 microversion: 2.1 time: 0.439750 Oct 17 15:25:13.308555 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 443/869] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:25:12 2022] DELETE /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:13.321074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:13.321739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:13.341037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:13.341539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:13.341997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:13.352946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:13.353709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:13.354169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:13.480677 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-30cd7b83-5858-492d-a02c-886c182d951d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.662789 Oct 17 15:25:13.489140 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 427/870] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:25:12 2022] GET /compute/v2.1/servers => generated 1002 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:13.498517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:13.501406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:13.530787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:13.531821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:13.532451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:13.533374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:13.537002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:13.537817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:13.707400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:13.719927 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-714f3440-e57e-423e-89ab-90d28a560314 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1379 microversion: 2.1 time: 0.407369 Oct 17 15:25:13.720528 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 444/871] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:13 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1379 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:13.748969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60741c37-a9a8-4fcb-9eef-5017251c0bf1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28c0f95b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:13.780103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-60741c37-a9a8-4fcb-9eef-5017251c0bf1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:25:13.781174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-60741c37-a9a8-4fcb-9eef-5017251c0bf1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group 06a05263-b634-46cf-bab6-b421ad32cc64 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:25:13.782103 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-60741c37-a9a8-4fcb-9eef-5017251c0bf1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:25:13.782103 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-897ae1d7-7f29-4a5e-b097-d1f98c46abb8'] Oct 17 15:25:13.795583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60741c37-a9a8-4fcb-9eef-5017251c0bf1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64 HTTP/1.1 Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:25:13.802147 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-897ae1d7-7f29-4a5e-b097-d1f98c46abb8'] Oct 17 15:25:13.803958 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '06a05263-b634-46cf-bab6-b421ad32cc64'} Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:13.804883 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-897ae1d7-7f29-4a5e-b097-d1f98c46abb8'] Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:25:13.806208 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-897ae1d7-7f29-4a5e-b097-d1f98c46abb8'] Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-897ae1d7-7f29-4a5e-b097-d1f98c46abb8'] Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:13.808271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:13.809777 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:13.809777 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:13.809777 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:25:13.809777 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:25:13.809777 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:25:13.809777 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-897ae1d7-7f29-4a5e-b097-d1f98c46abb8'] Oct 17 15:25:13.809777 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:13.810293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:13.811553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:13.812686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60741c37-a9a8-4fcb-9eef-5017251c0bf1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:25:13.812686 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-897ae1d7-7f29-4a5e-b097-d1f98c46abb8'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:25:13.816301 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60741c37-a9a8-4fcb-9eef-5017251c0bf1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64" status: 404 len: 194 microversion: 2.1 time: 0.076650 Oct 17 15:25:13.817421 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 445/872] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:25:13 2022] GET /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:25:13.826941 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-38321e58-cc25-45f3-aed9-368e70dfeaf8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.336273 Oct 17 15:25:13.827587 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 428/873] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:13 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:13.829516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:13.832345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:13.847794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:13.848721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:13.849316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:13.850370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:13.851548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:13.852955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:13.860193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-6cde47af-4ff5-43cd-92fc-25ddfebb455d req-8f19fd84-ed93-4105-9a9a-1186bc401205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04dead0-b7ae-4861-aeb9-c9e8626abfa1", "name": "network-vif-plugged", "status": "completed", "tag": "0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:13.879512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6cde47af-4ff5-43cd-92fc-25ddfebb455d req-8f19fd84-ed93-4105-9a9a-1186bc401205 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:13.879991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6cde47af-4ff5-43cd-92fc-25ddfebb455d req-8f19fd84-ed93-4105-9a9a-1186bc401205 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:13.884733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6cde47af-4ff5-43cd-92fc-25ddfebb455d req-8f19fd84-ed93-4105-9a9a-1186bc401205 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:13.897355 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-6cde47af-4ff5-43cd-92fc-25ddfebb455d req-8f19fd84-ed93-4105-9a9a-1186bc401205 service nova] Creating event network-vif-plugged:0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 for instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 on n-h1-854441-12 Oct 17 15:25:13.924587 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-6cde47af-4ff5-43cd-92fc-25ddfebb455d req-8f19fd84-ed93-4105-9a9a-1186bc401205 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067909 Oct 17 15:25:13.925840 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 429/874] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:13.934964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:13.947597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:13.953461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:13.955390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:13.956510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:13.959619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:13.960585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:13.961211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:13.964204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:14.097585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:14.111147 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a3e9fcf-0f41-40e1-bf6c-1c048b37b5e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1214 microversion: 2.1 time: 0.181758 Oct 17 15:25:14.112448 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 430/875] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:13 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:14.121273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:14.121876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:14.136042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:14.136650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:14.137051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:14.139080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:14.139826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:14.140498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:14.225603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:14.235408 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e39dcd3-3e45-4183-ba15-dea9122ac111 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1332 microversion: 2.1 time: 0.416442 Oct 17 15:25:14.243566 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 446/876] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:13 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1332 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:14.253856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0bd5ceb-7121-48cd-a38a-354b8c041f63 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: .version_select at 0x7f28bee14b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-120845143", "description": "tempest-description-1534434961"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:14.475173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:14.486424 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-375206f8-0ef0-4598-acab-d2381a34a84f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1324 microversion: 2.1 time: 0.372651 Oct 17 15:25:14.509304 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 431/877] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:14 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:14.516313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:14.517301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:14.525386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:14.526205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:14.527726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:14.529420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:14.530570 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0bd5ceb-7121-48cd-a38a-354b8c041f63 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.284839 Oct 17 15:25:14.531422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:14.532363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:14.534939 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 447/878] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:25:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:14.540986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:14.541873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:14.559272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:14.560378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:14.563388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:14.564364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:14.564987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:14.568849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:14.766126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:14.775404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9133c503-6212-4f94-bf74-2cfa87a4c515 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1495 microversion: 2.1 time: 0.264518 Oct 17 15:25:14.776004 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 432/879] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:14 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1495 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:14.792249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22a70c56-00bc-4b13-8e77-315c69b1d812 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: .version_select at 0x7f28bf259310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-614617213", "description": "tempest-description-42417672"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:14.793642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:14.811004 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9e412b3-3fb6-4edb-ab58-95115a0370e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1390 microversion: 2.1 time: 0.274446 Oct 17 15:25:14.812365 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 448/880] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:14 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1390 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:14.818390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:14.820151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:14.831907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:14.832439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:14.832847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:14.836653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:14.839002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:14.839696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.037821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:15.046710 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22a70c56-00bc-4b13-8e77-315c69b1d812 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.264542 Oct 17 15:25:15.047519 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 433/881] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:25:14 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:15.053413 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9dd8d48-07d5-48e6-8ad3-4680b7cf73c6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1379 microversion: 2.1 time: 0.239606 Oct 17 15:25:15.054032 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 449/882] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:14 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1379 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:15.060396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:15.061213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:15.062993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81b03f04-5f0a-4b43-b0b9-e2ce3a5aec20 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:15.064629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-81b03f04-5f0a-4b43-b0b9-e2ce3a5aec20 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:15.071066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.071856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.072481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.073357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.074045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.074662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.080311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b03f04-5f0a-4b43-b0b9-e2ce3a5aec20 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.082341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b03f04-5f0a-4b43-b0b9-e2ce3a5aec20 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.084688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b03f04-5f0a-4b43-b0b9-e2ce3a5aec20 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.086195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b03f04-5f0a-4b43-b0b9-e2ce3a5aec20 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.087548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b03f04-5f0a-4b43-b0b9-e2ce3a5aec20 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.088126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b03f04-5f0a-4b43-b0b9-e2ce3a5aec20 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.217520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:15.240405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:15.242725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:15.256702 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99777f50-76da-482f-be0a-f8158445e01c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.201540 Oct 17 15:25:15.259861 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 450/883] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:15 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:15.274724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ffd49158-b349-469e-a18a-1b853f2598a3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: .version_select at 0x7f28beee53a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1332597971", "description": "tempest-description-891180429"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:15.290873 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81b03f04-5f0a-4b43-b0b9-e2ce3a5aec20 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1648 microversion: 2.1 time: 0.241796 Oct 17 15:25:15.302541 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 434/884] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:15 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1648 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:15.310773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:15.311967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:15.331644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.332227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.332860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.334917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.335665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.336284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.410131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:15.420625 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba3d0101-b939-45c0-8cb8-1ef3272751e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1270 microversion: 2.1 time: 0.116583 Oct 17 15:25:15.442098 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 435/885] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:15 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:15.447503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:15.452949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:15.463816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.470450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.471364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.472323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.472779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.473437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.515821 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ffd49158-b349-469e-a18a-1b853f2598a3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.251080 Oct 17 15:25:15.516887 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 451/886] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:25:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:15.522111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-689d444e-f8b9-49ee-9b95-a27e66b73514 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:15.523108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-689d444e-f8b9-49ee-9b95-a27e66b73514 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:15.557283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-689d444e-f8b9-49ee-9b95-a27e66b73514 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.563389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-689d444e-f8b9-49ee-9b95-a27e66b73514 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.564087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-689d444e-f8b9-49ee-9b95-a27e66b73514 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.565017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-689d444e-f8b9-49ee-9b95-a27e66b73514 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.565634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-689d444e-f8b9-49ee-9b95-a27e66b73514 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.569333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-689d444e-f8b9-49ee-9b95-a27e66b73514 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.875305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:15.887174 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-710d3961-7f9a-4118-b1e8-aaf50c036a2b tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1332 microversion: 2.1 time: 0.443546 Oct 17 15:25:15.898419 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 436/887] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:15 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1332 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:15.907822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:15.908730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:15.915907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.916653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.917337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.918286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:15.918993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:15.919640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:15.950291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:15.968027 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-689d444e-f8b9-49ee-9b95-a27e66b73514 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1648 microversion: 2.1 time: 0.449581 Oct 17 15:25:15.969190 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 452/888] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:15 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1648 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:15.974193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80f6b5aa-2f7c-49b6-8021-12aa0f278911 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bf233310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:16.178554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:16.181173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:16.191437 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4e2aa86-d889-448f-a3f4-6a5860c2cecc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1324 microversion: 2.1 time: 0.290569 Oct 17 15:25:16.193595 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 437/889] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:15 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:16.206070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:16.209067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:16.229108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:16.229991 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80f6b5aa-2f7c-49b6-8021-12aa0f278911 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.259481 Oct 17 15:25:16.230172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:16.231280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:16.232438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:16.235370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:16.236029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:16.240359 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 453/890] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:25:15 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:16.245615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-117e3b4f-6a53-45ff-8423-46b4ddbcf78c req-977738e6-9774-44f6-8f01-ff7bcbe8c130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbaccdf-2e7a-4036-aad1-0458d0071d3c", "name": "network-vif-plugged", "status": "completed", "tag": "c4adad94-d883-47dc-a4f2-13b83f40f971"}, {"server_uuid": "11396321-8b48-4627-858e-90aabfbe0432", "name": "network-vif-plugged", "status": "completed", "tag": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:16.259271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-117e3b4f-6a53-45ff-8423-46b4ddbcf78c req-977738e6-9774-44f6-8f01-ff7bcbe8c130 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:16.260167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-117e3b4f-6a53-45ff-8423-46b4ddbcf78c req-977738e6-9774-44f6-8f01-ff7bcbe8c130 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:16.260867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-117e3b4f-6a53-45ff-8423-46b4ddbcf78c req-977738e6-9774-44f6-8f01-ff7bcbe8c130 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:16.274951 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-117e3b4f-6a53-45ff-8423-46b4ddbcf78c req-977738e6-9774-44f6-8f01-ff7bcbe8c130 service nova] Creating event network-vif-plugged:c4adad94-d883-47dc-a4f2-13b83f40f971 for instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c on n-h2-854441-12 Oct 17 15:25:16.276377 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-117e3b4f-6a53-45ff-8423-46b4ddbcf78c req-977738e6-9774-44f6-8f01-ff7bcbe8c130 service nova] Creating event network-vif-plugged:ad6d955f-b8f4-4902-bca5-a5ef16b95dbe for instance 11396321-8b48-4627-858e-90aabfbe0432 on n-h1-854441-12 Oct 17 15:25:16.288722 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-117e3b4f-6a53-45ff-8423-46b4ddbcf78c req-977738e6-9774-44f6-8f01-ff7bcbe8c130 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045073 Oct 17 15:25:16.290828 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 454/891] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:16.298238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eff56c2b-e866-4f6a-b41d-a3e1318e3baf tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:16.305896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff56c2b-e866-4f6a-b41d-a3e1318e3baf tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:16.306679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff56c2b-e866-4f6a-b41d-a3e1318e3baf tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:16.307277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff56c2b-e866-4f6a-b41d-a3e1318e3baf tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:16.308285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff56c2b-e866-4f6a-b41d-a3e1318e3baf tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:16.308909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff56c2b-e866-4f6a-b41d-a3e1318e3baf tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:16.309603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eff56c2b-e866-4f6a-b41d-a3e1318e3baf tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:16.339280 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eff56c2b-e866-4f6a-b41d-a3e1318e3baf tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.046145 Oct 17 15:25:16.340526 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 455/892] 10.222.0.87 () {58 vars in 1176 bytes} [Mon Oct 17 15:25:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:16.350266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:16.353489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:16.369773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:16.370590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:16.374085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:16.375064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:16.375683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:16.376268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:16.714771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:16.731104 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c4d43b8-4d56-4d55-941c-4ff8cbdc4409 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1379 microversion: 2.1 time: 0.388509 Oct 17 15:25:16.748333 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 456/893] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:16 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1379 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:16.756343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-216df779-6e14-4628-9de0-302f2794f1f8 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bedb9160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:17.101334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:17.114114 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff7db265-326e-4515-9263-c7687e2a92e6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1390 microversion: 2.1 time: 0.919070 Oct 17 15:25:17.117619 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 438/894] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:16 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1390 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:17.125898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:17.132905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:17.143099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.146673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.147120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.154303 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-216df779-6e14-4628-9de0-302f2794f1f8 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/e4725a6c-223e-48ab-bd5b-56f6552bfa70" status: 202 len: 0 microversion: 2.1 time: 0.404355 Oct 17 15:25:17.154931 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 457/895] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:25:16 2022] DELETE /compute/v2.1/os-security-groups/e4725a6c-223e-48ab-bd5b-56f6552bfa70 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:17.160771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-716c1310-560c-4c3c-8552-d18d5b9b98e9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:17.161328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-716c1310-560c-4c3c-8552-d18d5b9b98e9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:17.164751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.165068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.165497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.179325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716c1310-560c-4c3c-8552-d18d5b9b98e9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.185096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716c1310-560c-4c3c-8552-d18d5b9b98e9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.185553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716c1310-560c-4c3c-8552-d18d5b9b98e9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.186307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716c1310-560c-4c3c-8552-d18d5b9b98e9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.191912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716c1310-560c-4c3c-8552-d18d5b9b98e9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.194798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-716c1310-560c-4c3c-8552-d18d5b9b98e9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.383167 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-716c1310-560c-4c3c-8552-d18d5b9b98e9 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf/action" status: 202 len: 0 microversion: 2.1 time: 0.226922 Oct 17 15:25:17.384880 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 458/896] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:17 2022] POST /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:17.392446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:17.393903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:17.402296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.403317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.404077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.405322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.406139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.407047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.487080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:17.498558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:17.509249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:17.529705 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-661ec699-eec9-41ce-b66c-40d1d12f8d55 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.410665 Oct 17 15:25:17.530301 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 439/897] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:17 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:17.546371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:17.570166 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0ebee4b-21ce-4909-9311-e160bab18bdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1276 microversion: 2.1 time: 0.183676 Oct 17 15:25:17.570799 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 459/898] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:17 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:17.593518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c13bf24-3801-475c-be6e-2c726e516bb4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bedb9550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:17.600775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:17.601668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:17.620541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.620854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.621364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.622165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.622767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.623256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.643611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-9c13bf24-3801-475c-be6e-2c726e516bb4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:25:17.644523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-9c13bf24-3801-475c-be6e-2c726e516bb4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:25:17.645156 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9c13bf24-3801-475c-be6e-2c726e516bb4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:25:17.645156 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-ad6d80fa-016e-4f88-a1d2-ded4c8011d55'] Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c13bf24-3801-475c-be6e-2c726e516bb4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-security-groups/e4725a6c-223e-48ab-bd5b-56f6552bfa70 HTTP/1.1 Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:25:17.664399 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-ad6d80fa-016e-4f88-a1d2-ded4c8011d55'] Oct 17 15:25:17.674395 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e4725a6c-223e-48ab-bd5b-56f6552bfa70'} Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:17.675220 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad6d80fa-016e-4f88-a1d2-ded4c8011d55'] Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:25:17.677997 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad6d80fa-016e-4f88-a1d2-ded4c8011d55'] Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad6d80fa-016e-4f88-a1d2-ded4c8011d55'] Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:17.679283 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad6d80fa-016e-4f88-a1d2-ded4c8011d55'] Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c13bf24-3801-475c-be6e-2c726e516bb4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-ad6d80fa-016e-4f88-a1d2-ded4c8011d55'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c13bf24-3801-475c-be6e-2c726e516bb4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups/e4725a6c-223e-48ab-bd5b-56f6552bfa70" status: 404 len: 194 microversion: 2.1 time: 0.067192 Oct 17 15:25:17.735499 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 460/899] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:25:17 2022] GET /compute/v2.1/os-security-groups/e4725a6c-223e-48ab-bd5b-56f6552bfa70 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:25:17.737865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:17.737865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:17.737865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.737865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.739059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.739059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.739059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.739059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.936511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:17.952170 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92b6bdb8-cf5c-4d88-aa2f-bc90342a4d7d tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1324 microversion: 2.1 time: 0.288616 Oct 17 15:25:17.952829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 461/900] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:17 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:17.957641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ac23756-b933-427f-8405-dba555cc57cb tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:17.958335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ac23756-b933-427f-8405-dba555cc57cb tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:17.964781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ac23756-b933-427f-8405-dba555cc57cb tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.965281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ac23756-b933-427f-8405-dba555cc57cb tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.965797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ac23756-b933-427f-8405-dba555cc57cb tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:17.966523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ac23756-b933-427f-8405-dba555cc57cb tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:17.967830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ac23756-b933-427f-8405-dba555cc57cb tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:17.968266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ac23756-b933-427f-8405-dba555cc57cb tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:18.183132 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ac23756-b933-427f-8405-dba555cc57cb tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1633 microversion: 2.1 time: 0.229167 Oct 17 15:25:18.184193 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 462/901] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:17 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1633 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:18.189220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f844fce7-2953-42e7-94df-0d59e663df82 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bf3e7ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:18.431723 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f844fce7-2953-42e7-94df-0d59e663df82 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/b53e8071-7ab6-4723-9375-d3b112effe01" status: 202 len: 0 microversion: 2.1 time: 0.246351 Oct 17 15:25:18.432692 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 463/902] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:25:18 2022] DELETE /compute/v2.1/os-security-groups/b53e8071-7ab6-4723-9375-d3b112effe01 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:18.439263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:18.440129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:18.452847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:18.457700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:18.458164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:18.458979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:18.459433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:18.459854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:18.472129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:18.490009 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-176e642e-1c04-42c0-aec3-fb393c11dfed tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1536 microversion: 2.1 time: 0.928006 Oct 17 15:25:18.501163 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 440/903] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:17 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1536 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:18.514456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:18.515469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:18.528609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:18.530357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:18.531900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:18.533607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:18.534378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:18.537160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:18.764988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:18.776438 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b6f2909-13f8-4efe-bb9e-88511b7e010d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1379 microversion: 2.1 time: 0.341998 Oct 17 15:25:18.789729 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 464/904] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:18 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1379 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:18.797202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854441-12", "block_migration": true, "disk_over_commit": false}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:18.799950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:18.804205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:18.807149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:18.807772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:18.808332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:18.809335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:18.810002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:18.810631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:18.817813 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-edbe0137-0ab7-4ae2-a07e-4fe28595d518 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1390 microversion: 2.1 time: 0.315173 Oct 17 15:25:18.821743 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 441/905] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:18 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1390 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:18.827428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8201534f-2bf8-43c3-b3f9-8be0b2fd75fc req-4c222d48-1aac-437f-89a4-5c202d561c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f2d90a-2839-4199-87db-d5739abf33a8", "name": "network-vif-plugged", "status": "completed", "tag": "f4f8835c-e978-4278-9cc8-bcb8389538d7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:18.838593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8201534f-2bf8-43c3-b3f9-8be0b2fd75fc req-4c222d48-1aac-437f-89a4-5c202d561c6c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:18.839353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8201534f-2bf8-43c3-b3f9-8be0b2fd75fc req-4c222d48-1aac-437f-89a4-5c202d561c6c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:18.840033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8201534f-2bf8-43c3-b3f9-8be0b2fd75fc req-4c222d48-1aac-437f-89a4-5c202d561c6c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:18.860820 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8201534f-2bf8-43c3-b3f9-8be0b2fd75fc req-4c222d48-1aac-437f-89a4-5c202d561c6c service nova] Creating event network-vif-plugged:f4f8835c-e978-4278-9cc8-bcb8389538d7 for instance b4f2d90a-2839-4199-87db-d5739abf33a8 on n-h2-854441-12 Oct 17 15:25:18.864520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lazy-loading 'flavor' on Instance uuid 189db5a7-8cc1-43e9-8edd-162434dd4ecf {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:25:18.867281 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8201534f-2bf8-43c3-b3f9-8be0b2fd75fc req-4c222d48-1aac-437f-89a4-5c202d561c6c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044195 Oct 17 15:25:18.868489 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 442/906] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:18.874584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd9e3c54-ad5f-4ad5-b346-875d4189cc34 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bf05c550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:18.878839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Going to try to live migrate instance to n-h1-854441-12 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 15:25:18.961036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-cd9e3c54-ad5f-4ad5-b346-875d4189cc34 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:25:18.963653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.security_group_api [None req-cd9e3c54-ad5f-4ad5-b346-875d4189cc34 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group b53e8071-7ab6-4723-9375-d3b112effe01 not found {{(pid=120407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:25:18.966264 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-cd9e3c54-ad5f-4ad5-b346-875d4189cc34 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:25:18.966264 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-22d4dabb-69d1-4e36-a3d9-4732a660e44c'] Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd9e3c54-ad5f-4ad5-b346-875d4189cc34 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-security-groups/b53e8071-7ab6-4723-9375-d3b112effe01 HTTP/1.1 Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:25:18.983994 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: exception: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-22d4dabb-69d1-4e36-a3d9-4732a660e44c'] Oct 17 15:25:18.985620 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'b53e8071-7ab6-4723-9375-d3b112effe01'} Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:18.987685 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22d4dabb-69d1-4e36-a3d9-4732a660e44c'] Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:25:18.989310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22d4dabb-69d1-4e36-a3d9-4732a660e44c'] Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22d4dabb-69d1-4e36-a3d9-4732a660e44c'] Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:18.990758 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22d4dabb-69d1-4e36-a3d9-4732a660e44c'] Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd9e3c54-ad5f-4ad5-b346-875d4189cc34 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-22d4dabb-69d1-4e36-a3d9-4732a660e44c'] {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:25:18.992050 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd9e3c54-ad5f-4ad5-b346-875d4189cc34 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups/b53e8071-7ab6-4723-9375-d3b112effe01" status: 404 len: 194 microversion: 2.1 time: 0.118272 Oct 17 15:25:18.994716 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 443/907] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:25:18 2022] GET /compute/v2.1/os-security-groups/b53e8071-7ab6-4723-9375-d3b112effe01 => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:25:19.014288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-778db67b-487b-49cd-bf64-e2d3bf5a0293 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Action: 'create', calling method: .version_select at 0x7f28bee8ce50>, body: {"pool": "f639fbac-39b1-4034-aba2-9393df7f148c"} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:20.023288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:21.579972 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4226545-8fa9-4aad-9651-1c38fae9995b tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf/action" status: 202 len: 0 microversion: 2.1 time: 2.786850 Oct 17 15:25:21.581335 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 465/908] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:18 2022] POST /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf/action => generated 0 bytes in 2791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:21.586863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:21.589198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:21.601282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:21.601871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:21.602393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:21.603292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:21.603840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:21.604350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:21.674424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:21.684052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:21.685801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:21.692228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa5e6ac2-476b-4931-8cc7-3b182c95c626 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1535 microversion: 2.91 time: 0.109490 Oct 17 15:25:21.692849 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 466/909] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:21 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1535 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:21.703961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:21.704945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:21.712015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:21.712586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:21.713200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:21.714154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:21.714711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:21.715204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:21.862107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:21.871500 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a5de6d3-cccf-47ef-a97f-4e40c638cc83 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1318 microversion: 2.1 time: 0.177478 Oct 17 15:25:21.872095 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 467/910] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:21 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:21.877085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:21.877977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:21.884841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:21.885336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:21.885774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:21.886822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:21.887281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:21.887705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:21.914283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=22 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:22.305520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:22.314155 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb8cd41d-8156-4d92-a49e-75ae90ce4716 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1520 microversion: 2.1 time: 0.440902 Oct 17 15:25:22.314758 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 468/911] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:21 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:22.320013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5751a58-f110-4f90-b81d-a7907b7d6e3f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bf233310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:22.497548 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-778db67b-487b-49cd-bf64-e2d3bf5a0293 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.500326 Oct 17 15:25:22.498748 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 444/912] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:25:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:22.503881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:22.505593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:22.513339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:22.513829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:22.514256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:22.514986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:22.515625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:22.516237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:22.553048 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5751a58-f110-4f90-b81d-a7907b7d6e3f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/83d2792e-5c35-4dbf-9507-2efc5596de00" status: 202 len: 0 microversion: 2.1 time: 0.237072 Oct 17 15:25:22.554440 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 469/913] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:25:22 2022] DELETE /compute/v2.1/os-security-groups/83d2792e-5c35-4dbf-9507-2efc5596de00 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:22.569989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:22.570545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:22.576980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:22.577887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:22.578929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:22.579846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:22.580299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:22.580831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:22.690364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:22.701335 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-48e0ba6e-0c34-4c67-847d-99dc50e20d8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1528 microversion: 2.1 time: 0.201251 Oct 17 15:25:22.702033 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 445/914] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:22 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1528 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:22.706923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f48a06d8-ff5b-44c5-9e5b-6c4b8013fc28 req-96d9c322-9324-4255-a374-9c115c556479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd095af-cfc4-415b-bd1f-7cf9234fcc2f", "tag": "fc8831de-bd51-450c-a522-db20043ea8fb"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:22.723206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f48a06d8-ff5b-44c5-9e5b-6c4b8013fc28 req-96d9c322-9324-4255-a374-9c115c556479 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:22.723989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f48a06d8-ff5b-44c5-9e5b-6c4b8013fc28 req-96d9c322-9324-4255-a374-9c115c556479 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:22.724465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f48a06d8-ff5b-44c5-9e5b-6c4b8013fc28 req-96d9c322-9324-4255-a374-9c115c556479 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:22.737418 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f48a06d8-ff5b-44c5-9e5b-6c4b8013fc28 req-96d9c322-9324-4255-a374-9c115c556479 service nova] Creating event network-changed:fc8831de-bd51-450c-a522-db20043ea8fb for instance 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f on n-h1-854441-12 Oct 17 15:25:22.743707 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f48a06d8-ff5b-44c5-9e5b-6c4b8013fc28 req-96d9c322-9324-4255-a374-9c115c556479 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040184 Oct 17 15:25:22.744941 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 446/915] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:22.750905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:22.751871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:22.759009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:22.759502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:22.760115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:22.761004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:22.761455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:22.762061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:22.763897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:22.772863 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9596ee2f-52ee-4f29-9d3a-8b51d273c25b tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1589 microversion: 2.1 time: 0.217000 Oct 17 15:25:22.773682 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 470/916] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:22 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1589 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:22.778672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3a01dfd-220e-4929-ab82-0ee58942b7e7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Action: 'create', calling method: .version_select at 0x7f28bee25ee0>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:22.917424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:22.927693 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23d9b5bd-d229-4a86-a4a1-d277e28d644a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.181124 Oct 17 15:25:22.928334 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 447/917] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:22 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:22.933502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Action: 'action', calling method: .version_select at 0x7f28c1337b80>, body: {"addFloatingIp": {"address": "172.25.2.95"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:22.935962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:22.943314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:22.943570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:22.944018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:22.944721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:22.945166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:22.945583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:23.014153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:25:23.014662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquired lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:25:23.064692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:24.650902 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3a01dfd-220e-4929-ab82-0ee58942b7e7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.875897 Oct 17 15:25:24.652861 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 471/918] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:25:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:24.660971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59660863-16c1-4aa0-ad92-537276eee9f4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bedde820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:24.705323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-59660863-16c1-4aa0-ad92-537276eee9f4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:25:24.705989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-59660863-16c1-4aa0-ad92-537276eee9f4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group 83d2792e-5c35-4dbf-9507-2efc5596de00 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:25:24.706740 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-59660863-16c1-4aa0-ad92-537276eee9f4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:25:24.706740 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-d9c2b736-c800-45b7-b106-84b3c4454d8c'] Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59660863-16c1-4aa0-ad92-537276eee9f4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-security-groups/83d2792e-5c35-4dbf-9507-2efc5596de00 HTTP/1.1 Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:25:24.709543 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-d9c2b736-c800-45b7-b106-84b3c4454d8c'] Oct 17 15:25:24.711134 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '83d2792e-5c35-4dbf-9507-2efc5596de00'} Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:24.712089 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9c2b736-c800-45b7-b106-84b3c4454d8c'] Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:25:24.713656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9c2b736-c800-45b7-b106-84b3c4454d8c'] Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9c2b736-c800-45b7-b106-84b3c4454d8c'] Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:24.714963 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9c2b736-c800-45b7-b106-84b3c4454d8c'] Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59660863-16c1-4aa0-ad92-537276eee9f4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-d9c2b736-c800-45b7-b106-84b3c4454d8c'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59660863-16c1-4aa0-ad92-537276eee9f4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups/83d2792e-5c35-4dbf-9507-2efc5596de00" status: 404 len: 194 microversion: 2.1 time: 0.057454 Oct 17 15:25:24.716439 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 472/919] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:25:24 2022] GET /compute/v2.1/os-security-groups/83d2792e-5c35-4dbf-9507-2efc5596de00 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:25:24.720401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:24.721039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:24.730359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:24.731601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:24.732047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:24.732771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:24.734384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:24.735047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:24.829287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:24.838856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:24.840319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:24.846099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a58a878c-4545-4b70-85d1-b3f784437494 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1478 microversion: 2.91 time: 0.131112 Oct 17 15:25:24.848353 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 473/920] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:24 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1478 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:24.853915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:24.854796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:24.866530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:24.868018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:24.868864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:24.869910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:24.870861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:24.872774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:25.080267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:25.085419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:25.093479 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13c3db71-4f50-4114-b46a-806615011d1b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1528 microversion: 2.1 time: 0.243584 Oct 17 15:25:25.111874 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 474/921] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:24 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1528 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:25.119659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06f96398-6c9c-4de2-8490-4683cf567f46 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:25.120627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06f96398-6c9c-4de2-8490-4683cf567f46 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:25.128743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06f96398-6c9c-4de2-8490-4683cf567f46 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:25.129669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06f96398-6c9c-4de2-8490-4683cf567f46 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:25.130320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06f96398-6c9c-4de2-8490-4683cf567f46 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:25.131890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06f96398-6c9c-4de2-8490-4683cf567f46 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:25.133354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06f96398-6c9c-4de2-8490-4683cf567f46 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:25.134632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06f96398-6c9c-4de2-8490-4683cf567f46 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:25.247504 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06f96398-6c9c-4de2-8490-4683cf567f46 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132206 Oct 17 15:25:25.248324 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 475/922] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:25:25 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:25.252909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:25.253517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:25.260663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:25.261149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:25.261580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:25.262363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:25.262887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:25.263302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:25.453576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Building network info cache for instance {{(pid=120407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:25:25.852465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:25.868322 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a192c4f-62fb-482d-ac17-93b1ae251407 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1318 microversion: 2.1 time: 0.618921 Oct 17 15:25:25.869076 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 476/923] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:25 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:25.874339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:25.875107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:25.881496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:25.882121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:25.882676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:25.883976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:25.884619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:25.885222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:26.136797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:26.149842 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04d2eeee-5712-48c0-ac7a-1c24fa3ee78e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.279446 Oct 17 15:25:26.150943 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 477/924] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:25 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:26.154660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Updating instance_info_cache with network_info: [{"id": "0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7", "address": "fa:16:3e:8a:d2:6d", "network": {"id": "5f2e49b0-0bea-48ef-beb8-a039a0b44e77", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1171277760-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "80c6d074cf6a4c65b2656ec8e0451cde", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0f80ad4a-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:25:26.155919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9fb3431c-7141-4f83-aa2b-65d82e86c6f4 req-ef61711b-dcf4-4920-98fe-d64e1cb06c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189db5a7-8cc1-43e9-8edd-162434dd4ecf", "name": "network-vif-unplugged", "status": "completed", "tag": "a616fde1-6d69-41c3-9362-6f07d6ec877d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:26.166293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fb3431c-7141-4f83-aa2b-65d82e86c6f4 req-ef61711b-dcf4-4920-98fe-d64e1cb06c2f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:26.166806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fb3431c-7141-4f83-aa2b-65d82e86c6f4 req-ef61711b-dcf4-4920-98fe-d64e1cb06c2f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:26.167237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fb3431c-7141-4f83-aa2b-65d82e86c6f4 req-ef61711b-dcf4-4920-98fe-d64e1cb06c2f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:26.179954 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9fb3431c-7141-4f83-aa2b-65d82e86c6f4 req-ef61711b-dcf4-4920-98fe-d64e1cb06c2f service nova] Creating event network-vif-unplugged:a616fde1-6d69-41c3-9362-6f07d6ec877d for instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf on n-h2-854441-12 Oct 17 15:25:26.185806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Releasing lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:25:26.186034 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9fb3431c-7141-4f83-aa2b-65d82e86c6f4 req-ef61711b-dcf4-4920-98fe-d64e1cb06c2f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033675 Oct 17 15:25:26.186751 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 478/925] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:26.186895 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b39fa152-eff5-4a92-9f65-5b914f5d1423 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action" status: 202 len: 0 microversion: 2.1 time: 3.257021 Oct 17 15:25:26.187812 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 448/926] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:22 2022] POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action => generated 0 bytes in 3259 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 15:25:26.192288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1564982113", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "2243e6e3-9d81-48b1-bb5b-6d70da2406ed"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:26.193914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2fa97233-7c0f-457a-a756-d2df8aea0635 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bee8cee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:26.255827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] validate_networks() for [('2243e6e3-9d81-48b1-bb5b-6d70da2406ed', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:25:26.316348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:26.396090 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2fa97233-7c0f-457a-a756-d2df8aea0635 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.206515 Oct 17 15:25:26.396980 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 449/927] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:25:26 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:26.413704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2c9b2617-bc27-4eff-b193-1d8b4334783a req-b515cee0-3eda-4b23-acc4-b6bc09db0c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be739b8d-d20e-46e8-b17e-e98f66c72ea5", "tag": "41fbc30e-61ff-4f5b-a5e1-dec150c6c6d1"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:26.425708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2c9b2617-bc27-4eff-b193-1d8b4334783a req-b515cee0-3eda-4b23-acc4-b6bc09db0c87 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:26.426581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2c9b2617-bc27-4eff-b193-1d8b4334783a req-b515cee0-3eda-4b23-acc4-b6bc09db0c87 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:26.427017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2c9b2617-bc27-4eff-b193-1d8b4334783a req-b515cee0-3eda-4b23-acc4-b6bc09db0c87 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:26.439235 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2c9b2617-bc27-4eff-b193-1d8b4334783a req-b515cee0-3eda-4b23-acc4-b6bc09db0c87 service nova] Creating event network-changed:41fbc30e-61ff-4f5b-a5e1-dec150c6c6d1 for instance be739b8d-d20e-46e8-b17e-e98f66c72ea5 on n-h1-854441-12 Oct 17 15:25:26.445095 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2c9b2617-bc27-4eff-b193-1d8b4334783a req-b515cee0-3eda-4b23-acc4-b6bc09db0c87 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035024 Oct 17 15:25:26.447566 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 450/928] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:26.454564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:26.457813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:26.465007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:26.465743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:26.466343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:26.467236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:26.468151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:26.468742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:26.555173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-854441-12". {{(pid=120407) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 15:25:26.702902 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3c5872fc-dc3e-4e92-aad1-17eb66cc3023 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1/action" status: 202 len: 0 microversion: 2.91 time: 0.253311 Oct 17 15:25:26.707606 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 451/929] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:25:26 2022] POST /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:25:26.724352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2425e88f-08b5-4092-a47a-c8aa5b43768c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:26.755500 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2425e88f-08b5-4092-a47a-c8aa5b43768c tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/a90fc8d4-00c0-4281-9162-d741e55ece04" status: 202 len: 0 microversion: 2.1 time: 0.044775 Oct 17 15:25:26.760233 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 452/930] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:25:26 2022] DELETE /compute/v2.1/flavors/a90fc8d4-00c0-4281-9162-d741e55ece04 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:26.766604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-edb30583-6049-4484-b785-31e2a2d87c48 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Action: 'create', calling method: .version_select at 0x7f28bee36160>, body: {"pool": "f639fbac-39b1-4034-aba2-9393df7f148c"} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:26.954147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:25:26.954782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:25:26.955219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:25:26.955640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:25:26.956068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:25:26.970947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:26.975235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:26.975945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:26.976927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:26.979143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:26.979832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:27.006605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Getting quotas for project d43225ce4f724468800718eed544b111. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:27.013178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Getting quotas for user de65615d61c54443b8b58ea1c5fd108e and project d43225ce4f724468800718eed544b111. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:27.029792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:25:27.032790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:25:27.069566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:27.121357 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96f8618f-6034-401c-ba68-5055c0b3cee5 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933474 Oct 17 15:25:27.122632 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 479/931] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:25:27.134301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d6454cb-3bbe-494a-a22e-fd5003b4375d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: .version_select at 0x7f28beee5e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1597330256", "description": "tempest-description-19759372"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:27.532233 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d6454cb-3bbe-494a-a22e-fd5003b4375d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.408351 Oct 17 15:25:27.532854 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 480/932] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:25:27 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:27.537812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:27.538428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:27.552198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:27.552703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:27.553108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:27.560535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:27.561136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:27.561584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:27.658155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:27.669287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:27.671219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:27.677165 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9e3d5e7-5c01-4c77-848c-bd29f58d729e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1486 microversion: 2.91 time: 0.143144 Oct 17 15:25:27.677689 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 481/933] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:27 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1486 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:27.683543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71f85aca-c47b-46c9-9340-1f1dc49cfbc5 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:27.707355 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71f85aca-c47b-46c9-9340-1f1dc49cfbc5 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.028371 Oct 17 15:25:27.708692 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 482/934] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:25:27 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:27.727159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2dcc92a3-8bbe-4eb4-bac8-a5b666f91b0b req-b0b36497-003a-47c2-8cca-f23d60a9e6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd095af-cfc4-415b-bd1f-7cf9234fcc2f", "name": "network-vif-plugged", "status": "completed", "tag": "fc8831de-bd51-450c-a522-db20043ea8fb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:27.740104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2dcc92a3-8bbe-4eb4-bac8-a5b666f91b0b req-b0b36497-003a-47c2-8cca-f23d60a9e6c2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:27.743489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2dcc92a3-8bbe-4eb4-bac8-a5b666f91b0b req-b0b36497-003a-47c2-8cca-f23d60a9e6c2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:27.745397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2dcc92a3-8bbe-4eb4-bac8-a5b666f91b0b req-b0b36497-003a-47c2-8cca-f23d60a9e6c2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:27.774751 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2dcc92a3-8bbe-4eb4-bac8-a5b666f91b0b req-b0b36497-003a-47c2-8cca-f23d60a9e6c2 service nova] Creating event network-vif-plugged:fc8831de-bd51-450c-a522-db20043ea8fb for instance 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f on n-h1-854441-12 Oct 17 15:25:27.782623 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2dcc92a3-8bbe-4eb4-bac8-a5b666f91b0b req-b0b36497-003a-47c2-8cca-f23d60a9e6c2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071976 Oct 17 15:25:27.786780 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 483/935] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:27.792150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:27.792862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:27.812251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:27.818103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:27.818985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:27.819783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:27.820326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:27.831338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.005113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:28.018698 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-082ceee1-d5ec-4148-a4b5-7e3b95dda1fd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1318 microversion: 2.1 time: 0.230654 Oct 17 15:25:28.038136 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 484/936] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:27 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:28.045170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:28.045989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:28.053009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.054771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.055441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.056405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.057052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.058193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.164688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:28.176111 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c37919a0-cd31-47b2-ab12-459dc77a333a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1228 microversion: 2.1 time: 0.136010 Oct 17 15:25:28.191195 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 485/937] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:28 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1228 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:28.201035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:28.204798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:28.219027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.220537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.221670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.222941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.223628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.224480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.375260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:28.383936 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-917017bc-4593-4bb1-bf9b-e34bc59aaa98 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.191386 Oct 17 15:25:28.386640 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 486/938] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:28 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:28.391721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:28.392655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:28.399386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.400189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.400859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.401793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.402471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.403176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.560174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:28.574974 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f1d03fc-70fd-49cf-8ac3-3e7db7559981 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1589 microversion: 2.1 time: 0.185005 Oct 17 15:25:28.576827 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 487/939] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:28 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1589 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:28.584486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8915fe8f-23c4-4ce8-880b-fb729cdbddf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: .version_select at 0x7f28beddadc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-605456786", "description": "tempest-description-645542589"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:28.763905 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8915fe8f-23c4-4ce8-880b-fb729cdbddf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.185561 Oct 17 15:25:28.770763 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 488/940] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:25:28 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:28.782153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:28.784640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:28.798289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.799113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.801792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.803734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.804225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.804667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.851782 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-edb30583-6049-4484-b785-31e2a2d87c48 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.090237 Oct 17 15:25:28.852391 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 453/941] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:25:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:28.864920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-48f8e027-3603-4738-bbec-e092e0aa50ce req-31580afe-3388-4be9-9e81-ffe05010a72a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "189db5a7-8cc1-43e9-8edd-162434dd4ecf", "tag": "a616fde1-6d69-41c3-9362-6f07d6ec877d"}, {"name": "network-changed", "server_uuid": "ddbaccdf-2e7a-4036-aad1-0458d0071d3c", "tag": "c4adad94-d883-47dc-a4f2-13b83f40f971"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:28.877305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-48f8e027-3603-4738-bbec-e092e0aa50ce req-31580afe-3388-4be9-9e81-ffe05010a72a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.878074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-48f8e027-3603-4738-bbec-e092e0aa50ce req-31580afe-3388-4be9-9e81-ffe05010a72a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.878613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-48f8e027-3603-4738-bbec-e092e0aa50ce req-31580afe-3388-4be9-9e81-ffe05010a72a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.896087 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-48f8e027-3603-4738-bbec-e092e0aa50ce req-31580afe-3388-4be9-9e81-ffe05010a72a service nova] Creating event network-changed:a616fde1-6d69-41c3-9362-6f07d6ec877d for instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf on n-h2-854441-12 Oct 17 15:25:28.896599 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-48f8e027-3603-4738-bbec-e092e0aa50ce req-31580afe-3388-4be9-9e81-ffe05010a72a service nova] Creating event network-changed:c4adad94-d883-47dc-a4f2-13b83f40f971 for instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c on n-h2-854441-12 Oct 17 15:25:28.905781 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-48f8e027-3603-4738-bbec-e092e0aa50ce req-31580afe-3388-4be9-9e81-ffe05010a72a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044452 Oct 17 15:25:28.906401 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 454/942] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:28.912377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e05d0e80-d7c1-4f55-a842-e635bd23c70a req-a9aa3d2e-61db-460f-8852-a90ba23e7001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04dead0-b7ae-4861-aeb9-c9e8626abfa1", "tag": "0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:28.921614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:28.922489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e05d0e80-d7c1-4f55-a842-e635bd23c70a req-a9aa3d2e-61db-460f-8852-a90ba23e7001 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.923009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e05d0e80-d7c1-4f55-a842-e635bd23c70a req-a9aa3d2e-61db-460f-8852-a90ba23e7001 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.923436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e05d0e80-d7c1-4f55-a842-e635bd23c70a req-a9aa3d2e-61db-460f-8852-a90ba23e7001 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.930304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Old instance type tempest-test_resize_flavor_-208018254, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 15:25:28.936616 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e05d0e80-d7c1-4f55-a842-e635bd23c70a req-a9aa3d2e-61db-460f-8852-a90ba23e7001 service nova] Creating event network-changed:0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 for instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 on n-h1-854441-12 Oct 17 15:25:28.937757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:25:28.938170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:25:28.938677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:25:28.939258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:25:28.939822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:25:28.942487 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e05d0e80-d7c1-4f55-a842-e635bd23c70a req-a9aa3d2e-61db-460f-8852-a90ba23e7001 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034395 Oct 17 15:25:28.943655 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 455/943] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:28.949345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:28.950078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:28.957009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.957419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.957848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:28.958619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:28.959067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:28.959484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:29.030898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:29.059550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:29.061267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:29.069149 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f11fba9-46ef-4a70-bfa2-cc502911f9bc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.123953 Oct 17 15:25:29.070148 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 456/944] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:28 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:29.076220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.164"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:29.078841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:29.086797 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82c757ce-a2aa-478b-abcd-e472c14130f1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8/action" status: 202 len: 0 microversion: 2.1 time: 0.313912 Oct 17 15:25:29.088780 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 489/945] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:28 2022] POST /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:29.094811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:29.095750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:29.096420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:29.097404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:29.098324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:29.099185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:29.101668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2093022661", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "38c66c38-c5a7-484b-a607-a2664b041212"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:29.145639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:25:29.146405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquired lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:25:29.177884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] validate_networks() for [('38c66c38-c5a7-484b-a607-a2664b041212', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:25:29.674401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:25:29.675121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:25:29.675799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:25:29.676270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:25:29.676664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:25:29.688273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:29.689087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:29.689704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:29.690898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:29.691548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:29.692361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:29.711714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Getting quotas for project 44f6e3a7889145b2be55c1a543f6e9cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:29.718032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Getting quotas for user 8e0cca33970f49f1b9b6fa9830451dc0 and project 44f6e3a7889145b2be55c1a543f6e9cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:29.733666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:25:29.736688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:25:29.796222 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ae375ba-5e98-4757-9942-244b45da1889 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706074 Oct 17 15:25:29.797321 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 490/946] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:25:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:25:29.809353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:29.810967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:29.819107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:29.819994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:29.820527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:29.821333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:29.821920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:29.822403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:29.993882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:30.004287 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-489829f8-d4b8-496f-8977-30f50899e464 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1318 microversion: 2.1 time: 0.199481 Oct 17 15:25:30.005053 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 491/947] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:29 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:30.022697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:30.023703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:30.031532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.032042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.032480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.033272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.033903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.034488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.262264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:30.273571 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2907fa54-a732-4452-a526-79c89869e982 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.267136 Oct 17 15:25:30.292216 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 492/948] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:30 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:30.300663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:30.302983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:30.315850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.316719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.317837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.320247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.321093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.322094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.380107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.164 (0e453d04-dad9-4472-9d0d-e4e62a95694c) with port 0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network f639fbac-39b1-4034-aba2-9393df7f148c.", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:25:30.380738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Releasing lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:25:30.381677 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.164 (0e453d04-dad9-4472-9d0d-e4e62a95694c) with port 0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network f639fbac-39b1-4034-aba2-9393df7f148c. Oct 17 15:25:30.381677 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-d70b4e21-76b6-4fe3-bc0c-39002447a926'] Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Request method failure captured: Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action HTTP/1.1 Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 46 Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXPDHJ67Rl5dOqOicvHci20bMH4S4y0VHuZi7Yda3lYVcvdhhaVGrmsp4PkBOKU3aQJHMzgeqrVJkTiNTG_HQfXmACrTlnwcDwcFh7-lHR4R30dmg_E2hgSQ0063K3JGG4WyM0iZB6R3eIlxtz6SgrjRxjb0wvjiZt19kf6ypB-3Ydc Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:25:30.384436 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 2900a57571cf417aac13c765cc1e9eff Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: {"addFloatingIp": {"address": "172.25.2.164"}} Oct 17 15:25:30.385880 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: exception: Cannot associate floating IP 172.25.2.164 (0e453d04-dad9-4472-9d0d-e4e62a95694c) with port 0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network f639fbac-39b1-4034-aba2-9393df7f148c. Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-d70b4e21-76b6-4fe3-bc0c-39002447a926'] Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f04dead0-b7ae-4861-aeb9-c9e8626abfa1', 'body': {'addFloatingIp': {'address': '172.25.2.164'}}} Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:30.387702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:25:30.389011 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.164 (0e453d04-dad9-4472-9d0d-e4e62a95694c) with port 0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network f639fbac-39b1-4034-aba2-9393df7f148c. Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d70b4e21-76b6-4fe3-bc0c-39002447a926'] Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.164 (0e453d04-dad9-4472-9d0d-e4e62a95694c) with port 0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network f639fbac-39b1-4034-aba2-9393df7f148c. Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d70b4e21-76b6-4fe3-bc0c-39002447a926'] Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:30.391715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.164 (0e453d04-dad9-4472-9d0d-e4e62a95694c) with port 0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network f639fbac-39b1-4034-aba2-9393df7f148c. Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d70b4e21-76b6-4fe3-bc0c-39002447a926'] Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:30.393762 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.164 (0e453d04-dad9-4472-9d0d-e4e62a95694c) with port 0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network f639fbac-39b1-4034-aba2-9393df7f148c. Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d70b4e21-76b6-4fe3-bc0c-39002447a926'] Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Returning 400 to user: Cannot associate floating IP 172.25.2.164 (0e453d04-dad9-4472-9d0d-e4e62a95694c) with port 0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network f639fbac-39b1-4034-aba2-9393df7f148c. Oct 17 15:25:30.397467 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-d70b4e21-76b6-4fe3-bc0c-39002447a926'] {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:25:30.398925 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-41c70572-9609-4e1a-abf8-914d3ff7c330 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action" status: 400 len: 381 microversion: 2.1 time: 1.314515 Oct 17 15:25:30.398925 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 457/949] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:29 2022] POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action => generated 381 bytes in 1316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:25:30.398925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:30.398925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:30.424878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.431184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.437897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.438860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.439561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.440588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.534356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:30.547176 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b7a12e40-f7a4-4e84-9d41-07d71e1958b1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1284 microversion: 2.1 time: 0.249458 Oct 17 15:25:30.548125 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 493/950] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:30 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:30.556721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:30.557359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:30.564372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.565422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.566725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.567984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.569641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.570086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.707429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:30.720659 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61b5d917-edbd-428f-8b5b-d1969d8f703a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1220 microversion: 2.1 time: 0.169700 Oct 17 15:25:30.722247 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 494/951] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:30 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:30.730930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9d75be2d-195e-48f5-81d0-cab0cdc1a3d2 req-9fdc80fd-6c12-4b87-b31f-9250bdb8dfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be739b8d-d20e-46e8-b17e-e98f66c72ea5", "name": "network-vif-plugged", "status": "completed", "tag": "41fbc30e-61ff-4f5b-a5e1-dec150c6c6d1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:30.744935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9d75be2d-195e-48f5-81d0-cab0cdc1a3d2 req-9fdc80fd-6c12-4b87-b31f-9250bdb8dfb2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.745406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9d75be2d-195e-48f5-81d0-cab0cdc1a3d2 req-9fdc80fd-6c12-4b87-b31f-9250bdb8dfb2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.746014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9d75be2d-195e-48f5-81d0-cab0cdc1a3d2 req-9fdc80fd-6c12-4b87-b31f-9250bdb8dfb2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.769723 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9d75be2d-195e-48f5-81d0-cab0cdc1a3d2 req-9fdc80fd-6c12-4b87-b31f-9250bdb8dfb2 service nova] Creating event network-vif-plugged:41fbc30e-61ff-4f5b-a5e1-dec150c6c6d1 for instance be739b8d-d20e-46e8-b17e-e98f66c72ea5 on n-h1-854441-12 Oct 17 15:25:30.777654 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9d75be2d-195e-48f5-81d0-cab0cdc1a3d2 req-9fdc80fd-6c12-4b87-b31f-9250bdb8dfb2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053583 Oct 17 15:25:30.779678 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 495/952] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:30.788049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:30.789053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:30.797759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.805167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.805769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.806690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:30.807586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:30.810718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:30.932519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:30.944017 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1adf1eb7-e387-4ae0-96a6-853fd868358e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.553293 Oct 17 15:25:30.947984 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 458/953] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:30 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:30.969895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bd5f1ef7-de1f-48ea-8a1a-6b9f8bc5e373 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '.version_select at 0x7f28bedce0d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:31.105443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:31.109901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:31.134396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:31.155689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:31.162120 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d57c200c-787c-4fdf-865c-dfdef5bd4bf5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.380605 Oct 17 15:25:31.163384 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 496/954] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:30 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:31.168890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:31.169715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:31.176493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:31.177313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:31.177910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:31.178913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:31.179600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:31.189340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:31.941695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:31.959317 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8e22ef2-4974-446e-9432-f6e7c1c295ac tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1318 microversion: 2.1 time: 0.794604 Oct 17 15:25:31.960204 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 497/955] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:31 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1318 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:31.964997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:31.965828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:31.979833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:31.980620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:31.981287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:31.982155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:31.982795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:31.987230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.378397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:32.388000 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bd5f1ef7-de1f-48ea-8a1a-6b9f8bc5e373 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/0e453d04-dad9-4472-9d0d-e4e62a95694c" status: 202 len: 0 microversion: 2.1 time: 1.435309 Oct 17 15:25:32.392394 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 459/956] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:25:30 2022] DELETE /compute/v2.1/os-floating-ips/0e453d04-dad9-4472-9d0d-e4e62a95694c => generated 0 bytes in 1441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:25:32.398165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:32.400875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:32.408443 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0d9878cc-9cc1-4cca-b534-9ebd834f88c1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.447007 Oct 17 15:25:32.409981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.410488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.411151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.412114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.412725 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 498/957] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:31 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:32.420917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.422703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.424013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:32.424990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:32.441821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.442740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.443415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.444351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.444963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.445613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.591149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:32.601299 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79274433-74ef-4a6c-8676-edc220d5ed8e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.187197 Oct 17 15:25:32.603332 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 499/958] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:32 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:32.610673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:32.612155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:32.619886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.620660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.621340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.622481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.623184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.623825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.671291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:32.680509 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2acd6f1c-6062-4355-aa42-4adfa47d8827 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.286725 Oct 17 15:25:32.698699 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 460/959] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:32 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:32.714871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:32.719601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:32.731161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.731973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.732570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.733471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.737008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.737823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.876573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:32.883850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:32.899989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:32.901345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:32.920589 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8b2826d3-9a45-477b-8832-cd962240a733 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.220262 Oct 17 15:25:32.928917 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 461/960] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:32 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:32.935218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Action: 'action', calling method: .version_select at 0x7f28c13488b0>, body: {"removeFloatingIp": {"address": "172.25.2.95"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:32.942999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:32.953680 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ddd4ee9-b8fc-4895-a8c6-47cc97c6be7d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.348609 Oct 17 15:25:32.954709 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 500/961] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:32 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:32.989233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:32.989943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:32.996694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.997461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.998056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:32.998969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:32.999424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:32.999843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:33.138087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:33.145036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:33.145682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:33.146359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:33.147318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:33.147999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:33.148512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:33.167995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:33.191363 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51037b06-a27e-4afb-883c-bdf4510013ed tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1468 microversion: 2.1 time: 0.206364 Oct 17 15:25:33.192222 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 501/962] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:32 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1468 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:33.213677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:33.214388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:33.220652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:33.221212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:33.222317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:33.223118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:33.223749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:33.224240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:33.372831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:33.381853 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45bb8cf2-e0ad-4ae5-b707-2b157d5741a1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f" status: 200 len: 1467 microversion: 2.1 time: 0.172095 Oct 17 15:25:33.382455 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 502/963] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:33 2022] GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f => generated 1467 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:33.404526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:33.410877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:33.411293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:25:33.412039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquired lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:25:33.413055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Searching by: {'reservation_id': 'r-8sk6dqk7', 'deleted': False, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:25:33.421023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:33.421503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:33.421925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:33.422663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:33.423112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:33.423603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:33.578543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:25:33.711845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:33.721492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:33.722448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:33.723190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:33.859367 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ebe0724-8fc3-4114-bdcd-f3615cadd447 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/detail?reservation_id=r-8sk6dqk7" status: 200 len: 2928 microversion: 2.1 time: 0.458576 Oct 17 15:25:33.860579 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 503/964] 10.222.0.87 () {58 vars in 1197 bytes} [Mon Oct 17 15:25:33 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8sk6dqk7 => generated 2928 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:33.876077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:33.876850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:33.884508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:33.885152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:33.885589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:33.886319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:33.886986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:33.887410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.039397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:34.048528 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-faf9bb55-5018-40fb-99d9-6519067e083c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.176468 Oct 17 15:25:34.049313 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 504/965] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:33 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:34.054251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:34.055142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:34.069699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.070760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.071566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.072761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.073545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.074358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.158665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:34.172457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ddbde601-f7a6-4e62-bb61-a14b00ceb7c3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.122226 Oct 17 15:25:34.173485 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 505/966] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:34 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:34.180656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:34.181512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:34.188091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.189061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.189495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.190178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.190678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.191100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.244318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Building network info cache for instance {{(pid=120407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:25:34.375132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:34.383155 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e4d69c4-ff28-41dd-abe5-dce9e8dbdfd9 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.207050 Oct 17 15:25:34.394749 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 506/967] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:34 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:34.402727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66e221c3-c5e1-4004-9da7-f722bad1f05b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:34.426878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_groups [None req-66e221c3-c5e1-4004-9da7-f722bad1f05b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Querying cell 4ec06080-01b5-4793-9448-66de7d08c56d(cell1) for 2 instances {{(pid=120406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 15:25:34.427913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66e221c3-c5e1-4004-9da7-f722bad1f05b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.428494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66e221c3-c5e1-4004-9da7-f722bad1f05b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.429018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66e221c3-c5e1-4004-9da7-f722bad1f05b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.470439 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66e221c3-c5e1-4004-9da7-f722bad1f05b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups/f37a43ff-eefa-4838-b0a5-1068b6e615b1" status: 200 len: 265 microversion: 2.1 time: 0.073694 Oct 17 15:25:34.471898 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 507/968] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:25:34 2022] GET /compute/v2.1/os-server-groups/f37a43ff-eefa-4838-b0a5-1068b6e615b1 => generated 265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:34.477229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:34.477855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:34.488492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.488997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.489492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.490206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.490690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.491145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.595351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:34.604622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:34.606228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:34.612234 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04b50df9-613f-44ca-ae91-512ca55cc819 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.139183 Oct 17 15:25:34.623722 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 508/969] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:34 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:34.639694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:34.640681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:34.648372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.649443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.650171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.650927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.651379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.651793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.804232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:34.813228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0eee734-10e5-452f-b688-563cb19d9c39 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.187980 Oct 17 15:25:34.830417 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 509/970] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:34 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:34.839366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d9b68286-a8a5-4f4f-874d-09dd5239c7b0 req-969fb715-cb08-4972-9343-9e1f3a9d22c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04dead0-b7ae-4861-aeb9-c9e8626abfa1", "tag": "0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:34.859557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d9b68286-a8a5-4f4f-874d-09dd5239c7b0 req-969fb715-cb08-4972-9343-9e1f3a9d22c3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.860354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d9b68286-a8a5-4f4f-874d-09dd5239c7b0 req-969fb715-cb08-4972-9343-9e1f3a9d22c3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.860935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d9b68286-a8a5-4f4f-874d-09dd5239c7b0 req-969fb715-cb08-4972-9343-9e1f3a9d22c3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.876887 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d9b68286-a8a5-4f4f-874d-09dd5239c7b0 req-969fb715-cb08-4972-9343-9e1f3a9d22c3 service nova] Creating event network-changed:0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 for instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 on n-h1-854441-12 Oct 17 15:25:34.882965 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d9b68286-a8a5-4f4f-874d-09dd5239c7b0 req-969fb715-cb08-4972-9343-9e1f3a9d22c3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051168 Oct 17 15:25:34.888856 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 510/971] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:34.894822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f7457eb-6f87-4506-b4f1-babcb467b7f1 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:34.895573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f7457eb-6f87-4506-b4f1-babcb467b7f1 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:34.903890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f7457eb-6f87-4506-b4f1-babcb467b7f1 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.904382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f7457eb-6f87-4506-b4f1-babcb467b7f1 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.904815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f7457eb-6f87-4506-b4f1-babcb467b7f1 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.905585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f7457eb-6f87-4506-b4f1-babcb467b7f1 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:34.906036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f7457eb-6f87-4506-b4f1-babcb467b7f1 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:34.915929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f7457eb-6f87-4506-b4f1-babcb467b7f1 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:34.971452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Updating instance_info_cache with network_info: [{"id": "0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7", "address": "fa:16:3e:8a:d2:6d", "network": {"id": "5f2e49b0-0bea-48ef-beb8-a039a0b44e77", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1171277760-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "80c6d074cf6a4c65b2656ec8e0451cde", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0f80ad4a-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:25:34.989770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Releasing lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:25:34.990760 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-14836a31-e0e8-4972-9eb1-94340e51060f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action" status: 202 len: 0 microversion: 2.1 time: 2.060634 Oct 17 15:25:34.991710 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 462/972] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:32 2022] POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action => generated 0 bytes in 2062 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 15:25:34.999707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4a43b520-d8dd-4395-95f1-3323ac91501f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '.version_select at 0x7f28bedcb940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:35.098605 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f7457eb-6f87-4506-b4f1-babcb467b7f1 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f" status: 200 len: 1620 microversion: 2.1 time: 0.212790 Oct 17 15:25:35.119654 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 511/973] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:34 2022] GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f => generated 1620 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:35.131782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:35.132403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:35.142049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:35.142587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:35.143030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:35.143736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:35.144211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:35.145182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:35.325204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:35.336791 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d639d6a-cd86-4f14-9194-fbad1b37436f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.215858 Oct 17 15:25:35.345103 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 512/974] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:35 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:35.345103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae7e5f89-a3cb-4ecb-8c0e-8901b1d6c58a tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:35.345103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae7e5f89-a3cb-4ecb-8c0e-8901b1d6c58a tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:35.352570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae7e5f89-a3cb-4ecb-8c0e-8901b1d6c58a tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:35.353096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae7e5f89-a3cb-4ecb-8c0e-8901b1d6c58a tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:35.353524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae7e5f89-a3cb-4ecb-8c0e-8901b1d6c58a tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:35.354256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae7e5f89-a3cb-4ecb-8c0e-8901b1d6c58a tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:35.354833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae7e5f89-a3cb-4ecb-8c0e-8901b1d6c58a tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:35.355293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae7e5f89-a3cb-4ecb-8c0e-8901b1d6c58a tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:35.557053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:35.568570 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae7e5f89-a3cb-4ecb-8c0e-8901b1d6c58a tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 200 len: 1621 microversion: 2.1 time: 0.229702 Oct 17 15:25:35.570904 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 513/975] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:35 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 1621 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:35.595846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:35.596788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:35.605674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:35.606173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:35.606709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:35.607387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:35.607843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:35.608267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:35.731962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:35.743875 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-834cb109-90bb-480e-951f-b758b6b7ee6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.168123 Oct 17 15:25:35.744491 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 514/976] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:35 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:35.759863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:35.760526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:35.773154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:35.773663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:35.774106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:35.774850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:35.775305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:35.781131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:35.998852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:36.021314 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-afe7adb1-8e99-4e2e-93ff-5872ac23a95b tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.274502 Oct 17 15:25:36.022561 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 515/977] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:35 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:36.037945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0886929a-6766-4731-9ae8-619811bcf444 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Action: 'create', calling method: .version_select at 0x7f28becdcee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1383412898", "policies": ["anti-affinity"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:36.052500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:36.063343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0886929a-6766-4731-9ae8-619811bcf444 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:36.071555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0886929a-6766-4731-9ae8-619811bcf444 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:36.139031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0886929a-6766-4731-9ae8-619811bcf444 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:36.151301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0886929a-6766-4731-9ae8-619811bcf444 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:36.198086 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0886929a-6766-4731-9ae8-619811bcf444 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.174210 Oct 17 15:25:36.199689 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 516/978] 10.222.0.87 () {60 vars in 1174 bytes} [Mon Oct 17 15:25:36 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:36.215151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:36.215934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:36.234037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.234705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.235239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.236069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.236588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.237084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.323016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:36.331268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:36.332706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:36.338979 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5004328e-13be-41ae-9e9a-de0db4c863f4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.137509 Oct 17 15:25:36.345001 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 517/979] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:36 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:36.360870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:36.363324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:36.380716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.381127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.381567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.382286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.382764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.383544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.546214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:36.555072 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e48c43d4-9d95-48de-80a9-bef1db445ca4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.213630 Oct 17 15:25:36.555072 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 518/980] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:36 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:36.566813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-347024419", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "720fd1e6-01a7-4eda-bb49-505213e1e3d1"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:36.618770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:25:36.756054 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4a43b520-d8dd-4395-95f1-3323ac91501f tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/83de5fe1-9c23-4971-9449-1351c81ed22d" status: 202 len: 0 microversion: 2.1 time: 1.760153 Oct 17 15:25:36.756678 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 463/981] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:25:34 2022] DELETE /compute/v2.1/os-floating-ips/83de5fe1-9c23-4971-9449-1351c81ed22d => generated 0 bytes in 1761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:25:36.767392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:36.769507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:36.776100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.776982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.777562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.778416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.779056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.779619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.863416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:25:36.863864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:25:36.864603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:25:36.865016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:25:36.865428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:25:36.886579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.887073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.887518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.888244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.888703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.889130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.907335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:36.913199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:36.926244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Going to run 2 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:25:36.928776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 99ca326f-588c-4823-97b0-0bde70fc9435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:25:36.930678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:36.954179 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-536193f0-f710-46b7-ade8-6732b13440d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.196131 Oct 17 15:25:36.955044 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 464/982] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:36 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:36.961004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce90d646-b723-43db-8820-315c5b768968 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce90d646-b723-43db-8820-315c5b768968 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Request method failure captured: Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action HTTP/1.1 Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 34 Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXPDHJ67Rl5dOqOicvHci20bMH4S4y0VHuZi7Yda3lYVcvdhhaVGrmsp4PkBOKU3aQJHMzgeqrVJkTiNTG_HQfXmACrTlnwcDwcFh7-lHR4R30dmg_E2hgSQ0063K3JGG4WyM0iZB6R3eIlxtz6SgrjRxjb0wvjiZt19kf6ypB-3Ydc Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:25:36.965712 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 2900a57571cf417aac13c765cc1e9eff Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: {"addFloatingIp": {"address": ""}} Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:25:36.967419 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f04dead0-b7ae-4861-aeb9-c9e8626abfa1', 'body': {'addFloatingIp': {'address': ''}}} Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '' Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:25:36.968197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:25:36.969629 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:25:36.973048 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 15:25:36.973048 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:36.973048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce90d646-b723-43db-8820-315c5b768968 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:25:36.973048 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ce90d646-b723-43db-8820-315c5b768968 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action" status: 400 len: 142 microversion: 2.1 time: 0.011127 Oct 17 15:25:36.973048 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 465/983] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:36 2022] POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action => generated 142 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:25:36.973048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:36.974157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:36.981781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.982309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.982951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.983825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:36.984282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:36.984705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:36.987570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:36.993304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:37.033211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:37.039448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:37.055241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=99ca326f-588c-4823-97b0-0bde70fc9435,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:25:37.073732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:37.082100 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a4109cd-46ec-4bbc-b0c8-e72eeb5f92c4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.112773 Oct 17 15:25:37.082700 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 466/984] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:36 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:37.090419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:37.090419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:37.101161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.101633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.102063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.102787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.103234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.103648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.116739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:37.123163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:37.137918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:25:37.139152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquired lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:25:37.174246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:37.182546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:37.191790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:37.222106 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8de865f6-13bf-41c6-9a4b-83b473eb38eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.665607 Oct 17 15:25:37.223176 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 519/985] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:25:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 17 15:25:37.228469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:37.229087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:37.236758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.237322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.237827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.238564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.239022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.239488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.249951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Releasing lock "refresh_cache-f04dead0-b7ae-4861-aeb9-c9e8626abfa1" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:25:37.250846 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] HTTP exception thrown: floating IP not found Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Request method failure captured: Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action HTTP/1.1 Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 41 Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXPDHJ67Rl5dOqOicvHci20bMH4S4y0VHuZi7Yda3lYVcvdhhaVGrmsp4PkBOKU3aQJHMzgeqrVJkTiNTG_HQfXmACrTlnwcDwcFh7-lHR4R30dmg_E2hgSQ0063K3JGG4WyM0iZB6R3eIlxtz6SgrjRxjb0wvjiZt19kf6ypB-3Ydc Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:25:37.253037 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 2900a57571cf417aac13c765cc1e9eff Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:25:37.254590 n-d-854441-12 devstack@n-api.service[120407]: exception: floating IP not found Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f04dead0-b7ae-4861-aeb9-c9e8626abfa1', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:37.255630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 17 15:25:37.257342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.265253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Returning 404 to user: floating IP not found {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:25:37.265253 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fd0d3315-a7a8-46a1-915a-59f5bae86f45 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action" status: 404 len: 67 microversion: 2.1 time: 0.172799 Oct 17 15:25:37.265253 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 467/986] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:37 2022] POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action => generated 67 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:25:37.266644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:37.273139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:37.274436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Searching by: {'deleted': False, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:25:37.319588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.320283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.320809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.321597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.322131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.322656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.362169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:25:37.400713 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c6555891-ac49-4492-8cc6-a4af534a1f30 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.142443 Oct 17 15:25:37.409918 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 468/987] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:25:37 2022] GET /compute/v2.1/servers => generated 1662 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:37.409918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9dae4548-88c3-485c-a910-20d1f5041942 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:37.433127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:37.444142 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9db0581-3b70-4a75-a2c4-fe9744fc05d7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.218295 Oct 17 15:25:37.445149 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 520/988] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:37 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:37.450016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:37.450736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:37.458857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.459353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.459796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.460496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.460950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.461436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.510654 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-9dae4548-88c3-485c-a910-20d1f5041942 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9dae4548-88c3-485c-a910-20d1f5041942 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Request method failure captured: Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action HTTP/1.1 Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 44 Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXPDHJ67Rl5dOqOicvHci20bMH4S4y0VHuZi7Yda3lYVcvdhhaVGrmsp4PkBOKU3aQJHMzgeqrVJkTiNTG_HQfXmACrTlnwcDwcFh7-lHR4R30dmg_E2hgSQ0063K3JGG4WyM0iZB6R3eIlxtz6SgrjRxjb0wvjiZt19kf6ypB-3Ydc Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:25:37.512638 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 2900a57571cf417aac13c765cc1e9eff Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:25:37.514083 n-d-854441-12 devstack@n-api.service[120407]: exception: Floating IP not found for address 0.0.0.0. Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f04dead0-b7ae-4861-aeb9-c9e8626abfa1', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:25:37.514916 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 17 15:25:37.519475 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:37.522014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9dae4548-88c3-485c-a910-20d1f5041942 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:25:37.522014 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9dae4548-88c3-485c-a910-20d1f5041942 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action" status: 404 len: 88 microversion: 2.1 time: 0.111301 Oct 17 15:25:37.522014 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 469/989] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:25:37 2022] POST /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1/action => generated 88 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:25:37.527873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-12621cee-099b-4796-9fe0-f6b8b290ce9a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:37.528571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-12621cee-099b-4796-9fe0-f6b8b290ce9a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:37.540479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:37.550176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:37.551739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:37.558163 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-19d1114e-85f6-4293-88f1-9d6217a7a1b4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.111893 Oct 17 15:25:37.558822 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 521/990] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:37 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:37.579115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:37.579627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:37.592289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.592968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.593365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.594075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.594522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.594942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.620297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-12621cee-099b-4796-9fe0-f6b8b290ce9a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:37.628175 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-12621cee-099b-4796-9fe0-f6b8b290ce9a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1218 microversion: 2.1 time: 0.104930 Oct 17 15:25:37.629368 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 470/991] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:37 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:37.635987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:37.637151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:37.646232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.647492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.647710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.648242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:25:37.648474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.648943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.649379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.796306 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aca35500-ae00-4ea0-b4a2-f7e967dbe908 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 204 len: 0 microversion: 2.1 time: 0.236106 Oct 17 15:25:37.800643 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 522/992] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:25:37 2022] DELETE /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:25:37.807599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:37.809044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:37.815832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.816585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.817217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.818224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:37.818859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:37.819436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:37.872497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:37.881469 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e0d4f32b-4a94-45bc-a025-fdc88251b374 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.250519 Oct 17 15:25:37.882046 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 471/993] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:37 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:37.988617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:37.992031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:37.994722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:37.999119 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d861d4f5-7cdd-4a0f-af69-29ff2518c004 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1542 microversion: 2.1 time: 0.196274 Oct 17 15:25:38.000054 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 523/994] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:37 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1542 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:38.001924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.002568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.003001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.003727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.004209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.004750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.105930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:38.116533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:38.137135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.137980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.138449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.139193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.139629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.140363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.169121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:38.178219 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c314495-de5a-40af-9c05-1f598ebe2123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.197187 Oct 17 15:25:38.179477 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 472/995] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:37 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:38.217738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:38.225982 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c854ea10-1bc9-499d-a966-c506689bf59a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.124687 Oct 17 15:25:38.226613 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 524/996] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:38 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:38.467857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:38.468476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:38.475335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.475838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.476276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.476977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.477433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.477857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.597398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:38.598183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:38.605492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.606289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.606942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.607835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.608455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.609045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.625782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:38.634996 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3c196cdd-f832-47a1-948a-cf8c98f116be tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.171046 Oct 17 15:25:38.635587 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 473/997] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:38 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:38.657937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:38.658876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:38.666003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.667239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.667838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.668759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.669217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.669647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.684864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:38.694467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:38.701383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:38.704371 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-331b0bbe-a860-4edf-b637-61c4707e69d8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.111787 Oct 17 15:25:38.705351 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 525/998] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:38 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:38.739660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:38.748322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a253517a-0e97-4784-a2d7-8f2d3c6c5428 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1222 microversion: 2.1 time: 0.094959 Oct 17 15:25:38.748929 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 474/999] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:38 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:38.908001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:38.908611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:38.915621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.916111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.916544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:38.917243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:38.917693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:38.918119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.023999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:39.024712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:39.032104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.032704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.033213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.034020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.034557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.034997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.065332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:39.075462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6959ec6-6e11-424d-b36f-dfbb2e68438e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.171371 Oct 17 15:25:39.076743 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 526/1000] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:38 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:39.202880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:39.206782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:39.207480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:39.214366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.215059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.215478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.216182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.216634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.217056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.232004 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-da524344-b426-4c81-83c0-18130511a711 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1542 microversion: 2.1 time: 0.212395 Oct 17 15:25:39.232737 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 475/1001] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:39 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1542 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:39.249367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:39.250287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:39.257722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.259008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.259842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.260825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.261490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.262234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.356259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:39.365062 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc10f86a-e56c-4131-817d-a4e40d4de5a5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.119852 Oct 17 15:25:39.365668 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 476/1002] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:39 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:39.416042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:39.424268 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b6eaedc-ee27-4d61-abc7-56cf497bb168 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.223222 Oct 17 15:25:39.424857 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 527/1003] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:39 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:39.660684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:39.661443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:39.671702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.672285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.672723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.673417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.673914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.674332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.733455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:39.734441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:39.742717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.743638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.744373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.745337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.746005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.746705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.828139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:39.840502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:39.842079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:39.848832 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4677d773-58dd-4bd0-9429-07cd57821528 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.120131 Oct 17 15:25:39.850263 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 528/1004] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:39 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:39.861568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:39.865209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:39.891391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.892815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.893511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:39.897569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:39.898378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:39.901011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.052113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:40.057743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:40.062407 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14de5532-d91b-4202-8316-45692bc9e818 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1222 microversion: 2.1 time: 0.210185 Oct 17 15:25:40.063038 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 529/1005] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:39 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:40.074891 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f99c892f-b54c-4d7e-a69f-59e0bc7eb563 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.412176 Oct 17 15:25:40.074891 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 477/1006] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:39 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:40.101422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:40.102061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:40.112308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.112781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.115041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.116441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.116441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.116607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.145935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:40.259051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:40.259683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:40.287298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.288151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.288778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.289687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.290317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.290933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.394123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:40.433489 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6d526ba-26c4-4888-adf3-3e84c775e945 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.325390 Oct 17 15:25:40.456068 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 530/1007] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:40 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:40.479937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:40.480583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:40.512615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.513132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.519634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.520947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.521463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.521890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.541346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:40.568442 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-06ec16f0-c642-4a56-9210-7dfda19f7394 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1500 microversion: 2.1 time: 0.305670 Oct 17 15:25:40.587398 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 478/1008] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:40 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1500 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:40.592206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-82c7215d-79d6-4cd9-85dd-fb4d76a0a95a req-f4d7815e-fb23-4acf-bb41-b739dce2e838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04dead0-b7ae-4861-aeb9-c9e8626abfa1", "name": "network-vif-deleted", "tag": "0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:40.613660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82c7215d-79d6-4cd9-85dd-fb4d76a0a95a req-f4d7815e-fb23-4acf-bb41-b739dce2e838 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.614590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82c7215d-79d6-4cd9-85dd-fb4d76a0a95a req-f4d7815e-fb23-4acf-bb41-b739dce2e838 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.615215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82c7215d-79d6-4cd9-85dd-fb4d76a0a95a req-f4d7815e-fb23-4acf-bb41-b739dce2e838 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.667742 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-82c7215d-79d6-4cd9-85dd-fb4d76a0a95a req-f4d7815e-fb23-4acf-bb41-b739dce2e838 service nova] Creating event network-vif-deleted:0f80ad4a-7f2d-4fdf-a355-aaecf6349ab7 for instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 on n-h1-854441-12 Oct 17 15:25:40.694218 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-82c7215d-79d6-4cd9-85dd-fb4d76a0a95a req-f4d7815e-fb23-4acf-bb41-b739dce2e838 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103091 Oct 17 15:25:40.696116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:40.696752 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 479/1009] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:40.709258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:40.709258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:40.714471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:40.717395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.718390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.719231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.719581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b975ca0e-d3db-4fae-a481-1096703f6233 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.260009 Oct 17 15:25:40.720456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.721230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.721969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.737678 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 531/1010] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:40 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:40.884699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:40.885214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:40.904181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.905089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.907037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:40.912173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:40.912672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:40.914192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.020957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:41.051117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:41.053140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:41.059763 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba2d597e-70c1-4901-a141-83bdac0d94ba tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.179495 Oct 17 15:25:41.060457 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 532/1011] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:40 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:25:41.098760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:41.099424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:41.107014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.107793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.108642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.109779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.110396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.110992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.213126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:41.236610 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d46d042-d37a-49b0-9876-89e79d354736 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1222 microversion: 2.1 time: 0.140174 Oct 17 15:25:41.237240 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 533/1012] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:41 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:41.248262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:41.248990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:41.250544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:41.261608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.262134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.263181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.263888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.264335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.264864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.267492 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f5df5ebd-278b-4909-ac78-6283b5727e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.568472 Oct 17 15:25:41.268961 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 480/1013] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:40 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:41.468533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:41.469274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:41.475947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.476800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.477298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.478081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.478622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.479305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.486030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:41.496168 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae1fa74f-f271-4500-b0e3-d804e1ce038f tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.257631 Oct 17 15:25:41.497048 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 534/1014] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:41 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:41.597371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:41.597992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:41.605488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.605991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.606425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.607732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.607732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.608081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.650397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.650920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.651377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.652315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lazy-loading 'fault' on Instance uuid f04dead0-b7ae-4861-aeb9-c9e8626abfa1 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:25:41.700889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:41.715243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a57571cf417aac13c765cc1e9eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6d074cf6a4c65b2656ec8e0451cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:41.729744 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-89f24a6a-69aa-4847-9f67-4b671c26dc5e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.265388 Oct 17 15:25:41.730917 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 481/1015] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:41 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:41.736904 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1118ac61-36fb-429f-ab65-20ad2846f09e tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 200 len: 1322 microversion: 2.1 time: 0.143279 Oct 17 15:25:41.746850 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 535/1016] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:41 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:41.757944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:41.764584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:41.768966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.770203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.774560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.774560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:41.774560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:41.785134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:41.823313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:41.893834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:41.909363 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-abe22d59-cc7d-4d19-bcdf-44a3922838ac tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.155192 Oct 17 15:25:41.910469 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 482/1017] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:41 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:42.093794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:42.094409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:42.113473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.118772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.120072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.121763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.123618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.124321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.263567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:42.264922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:42.274078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.274953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.275554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.276437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.277902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.281890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.329264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:42.347899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:42.351659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:42.362114 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cfbf42a2-75b5-40ba-a04c-9cdf8a4a3eea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.272590 Oct 17 15:25:42.374524 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 536/1018] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:42 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:42.374524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:42.374871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:42.390723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.391805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.391805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.392378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.392838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.393265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.432785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:42.442139 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4efd423-f0ca-4fdf-9c3a-524cd0c49645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1222 microversion: 2.1 time: 0.182470 Oct 17 15:25:42.443334 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 483/1019] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:42 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:42.528583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:42.530605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:42.552589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.553302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.554272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.555501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.558465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.559215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.601270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:42.610117 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15cba6b7-c0d6-44ae-be88-2ad64e276d37 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.244897 Oct 17 15:25:42.611194 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 537/1020] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:42 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:42.755708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:42.756706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:42.764390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.764981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.765539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.766304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.767113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.767537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.797669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:42.808909 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe27d5a3-f9e5-4682-af75-023070e0cc3a tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.291583 Oct 17 15:25:42.809486 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 484/1021] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:42 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:42.815446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:42.816492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] [instance: f04dead0-b7ae-4861-aeb9-c9e8626abfa1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:42.823927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.824711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.825311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.827239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.827689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.828295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.845745 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] HTTP exception thrown: Instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 could not be found. Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Request method failure captured: Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 HTTP/1.1 Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXPDHJ67Rl5dOqOicvHci20bMH4S4y0VHuZi7Yda3lYVcvdhhaVGrmsp4PkBOKU3aQJHMzgeqrVJkTiNTG_HQfXmACrTlnwcDwcFh7-lHR4R30dmg_E2hgSQ0063K3JGG4WyM0iZB6R3eIlxtz6SgrjRxjb0wvjiZt19kf6ypB-3Ydc Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:25:42.848286 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/80c6d074cf6a4c65b2656ec8e0451cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 80c6d074cf6a4c65b2656ec8e0451cde Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476 Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 2900a57571cf417aac13c765cc1e9eff Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:25:42.850231 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 could not be found. Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f04dead0-b7ae-4861-aeb9-c9e8626abfa1'} Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 could not be found. Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:25:42.850987 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 could not be found. Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 could not be found. Oct 17 15:25:42.852237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:25:42.853768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] Returning 404 to user: Instance f04dead0-b7ae-4861-aeb9-c9e8626abfa1 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:25:42.853768 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1cce026f-6d91-4fed-8415-2cbe6cfcbd83 tempest-FloatingIPsAssociationNegativeTestJSON-196047476 tempest-FloatingIPsAssociationNegativeTestJSON-196047476-project] 10.222.0.87 "GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1" status: 404 len: 111 microversion: 2.1 time: 0.039347 Oct 17 15:25:42.853768 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 485/1022] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:42 2022] GET /compute/v2.1/servers/f04dead0-b7ae-4861-aeb9-c9e8626abfa1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:25:42.935740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:42.936031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:42.943607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.944399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.945008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:42.945938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:42.946667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:42.947040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.037972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:43.039206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:43.049468 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a5751723-66de-42ee-90ac-f2191b2ae37a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.117923 Oct 17 15:25:43.050300 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 486/1023] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:42 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:43.051030 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b8de461-2561-41c3-b85b-22505f9f6deb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.299578 Oct 17 15:25:43.068167 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 538/1024] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:42 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:43.319282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d91e692c-f2a0-4143-beb1-41954c5c0c4b req-5a5738a7-7afe-4c36-a0ea-c0fd4a9a4747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ca326f-588c-4823-97b0-0bde70fc9435", "tag": "1b032b50-ae0d-460a-b76a-a8dfd2038eed"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:43.342060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d91e692c-f2a0-4143-beb1-41954c5c0c4b req-5a5738a7-7afe-4c36-a0ea-c0fd4a9a4747 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:43.343779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d91e692c-f2a0-4143-beb1-41954c5c0c4b req-5a5738a7-7afe-4c36-a0ea-c0fd4a9a4747 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:43.347706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d91e692c-f2a0-4143-beb1-41954c5c0c4b req-5a5738a7-7afe-4c36-a0ea-c0fd4a9a4747 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.367106 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d91e692c-f2a0-4143-beb1-41954c5c0c4b req-5a5738a7-7afe-4c36-a0ea-c0fd4a9a4747 service nova] Creating event network-changed:1b032b50-ae0d-460a-b76a-a8dfd2038eed for instance 99ca326f-588c-4823-97b0-0bde70fc9435 on n-h1-854441-12 Oct 17 15:25:43.386061 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d91e692c-f2a0-4143-beb1-41954c5c0c4b req-5a5738a7-7afe-4c36-a0ea-c0fd4a9a4747 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068993 Oct 17 15:25:43.395422 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 487/1025] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:43.402823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:43.403820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:43.417460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:43.418979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:43.419430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.420492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:43.420616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:43.421050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.466672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:43.467825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:43.475190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:43.476145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:43.476806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.477813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:43.478824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:43.479666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.569741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:43.588411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:43.601543 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-29a45a31-9f88-4626-826c-1605d9f62911 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1214 microversion: 2.1 time: 0.138856 Oct 17 15:25:43.604372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:43.606997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:43.613061 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be2c7f24-2883-4d96-b9eb-4ddf1ea172a2 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.216918 Oct 17 15:25:43.614161 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 539/1026] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:43 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:43.615254 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 488/1027] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:43 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:43.640379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:43.641017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:43.649047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:43.649562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:43.650072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.650835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:43.651298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:43.652854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.834144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:43.835192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:43.851620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:43.852183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:43.852716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.853487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:43.854148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:43.854663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:43.973215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:43.982940 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f90534d-dd58-4b98-b5f1-b57847d4f598 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.346802 Oct 17 15:25:43.983881 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 540/1028] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:43 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:44.001692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:44.011071 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36661c9d-30d6-4501-89b4-1fa9fafe336c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.181009 Oct 17 15:25:44.011672 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 489/1029] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:43 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:44.076813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:44.077039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:44.077704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:44.077851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:44.084689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:44.085178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:44.085332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:44.085639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:44.085999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:44.086414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:44.086698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:44.087254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:44.087514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:44.088095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:44.088397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:44.088996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:44.197510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:44.207296 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b95bf1f-36ba-4029-9efd-fc454fbc048e tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.134937 Oct 17 15:25:44.208614 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 541/1030] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:44 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:44.246149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:44.254596 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ac23d141-65e5-4b49-95ed-b18c91b6e4a9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.181723 Oct 17 15:25:44.255586 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 490/1031] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:44 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:44.614218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a03bf1d6-0a2c-410a-b96c-6aa10391a727 req-b1900303-b8e5-43dc-b51f-87db97e5cb18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e37b74a-df57-4e6a-ba1c-cd631111d114", "tag": "73104619-ab2a-4f83-8519-6b2bb6caad29"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:44.630561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:44.631276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:44.635912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a03bf1d6-0a2c-410a-b96c-6aa10391a727 req-b1900303-b8e5-43dc-b51f-87db97e5cb18 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:44.637205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a03bf1d6-0a2c-410a-b96c-6aa10391a727 req-b1900303-b8e5-43dc-b51f-87db97e5cb18 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:44.637650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a03bf1d6-0a2c-410a-b96c-6aa10391a727 req-b1900303-b8e5-43dc-b51f-87db97e5cb18 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:44.646307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:44.651349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:44.651875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:44.652685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:44.653268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:44.653765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:44.656645 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a03bf1d6-0a2c-410a-b96c-6aa10391a727 req-b1900303-b8e5-43dc-b51f-87db97e5cb18 service nova] Creating event network-changed:73104619-ab2a-4f83-8519-6b2bb6caad29 for instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 on n-h2-854441-12 Oct 17 15:25:44.663732 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a03bf1d6-0a2c-410a-b96c-6aa10391a727 req-b1900303-b8e5-43dc-b51f-87db97e5cb18 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053959 Oct 17 15:25:44.664831 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 542/1032] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:44.671495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:44.672369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:44.679168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:44.679455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:44.679856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:44.681096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:44.681096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:44.681436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:44.745082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:44.754430 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-17b94a85-0577-4417-9018-0a66bdb2f5db tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1214 microversion: 2.1 time: 0.128818 Oct 17 15:25:44.755923 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 491/1033] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:44 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:44.776245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:44.789130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:44.791925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:44.798278 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27c1e68f-81a7-4d6b-ac21-90cbe6b3d872 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.132004 Oct 17 15:25:44.799379 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 543/1034] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:44 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:45.008896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:45.009921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:45.016394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.017288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.017951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.019027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.019725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.022803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.034873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:45.035945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:45.043207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.044244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.045060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.046153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.047165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.047811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.291289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:45.303241 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f584697f-b795-4779-8f1e-e256b3081099 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.296789 Oct 17 15:25:45.304220 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 492/1035] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:45 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:45.309298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:45.310025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:45.317343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.317840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.318282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.319079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.319461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.319884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.357176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:45.368193 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c6b3251-bf79-4f07-96d6-7e296b1965e0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.338324 Oct 17 15:25:45.369028 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 544/1036] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:45 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:45.373287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:45.373881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:45.395772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.396271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.396709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.397431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.397886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.398309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.431632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:45.441216 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca28f716-b667-4a9f-8c2e-15dce93e55aa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1268 microversion: 2.1 time: 0.135629 Oct 17 15:25:45.442268 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 493/1037] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:45 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1268 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:45.625768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:45.636130 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-187972ea-4013-47f3-875b-a90caa7e5d77 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.266284 Oct 17 15:25:45.637090 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 545/1038] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:45 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:45.786619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:45.787786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:45.807461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.810357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.810974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.813433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.814306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.815768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.830208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:45.831033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:45.845271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.847245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.848838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:45.853676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:45.855253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:45.856903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:46.041449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:46.095965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:46.108093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:46.126248 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e6c9105-1545-49a7-9375-12204f20059c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.301968 Oct 17 15:25:46.127408 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 546/1039] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:45 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:25:46.278447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:46.290750 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3bae943e-2277-4ba2-abb4-775082e9a5a2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1214 microversion: 2.1 time: 0.511734 Oct 17 15:25:46.305255 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 494/1040] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:45 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1214 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:46.333533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:46.334232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:46.342403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:46.342939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:46.343378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:46.344187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:46.344645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:46.345064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:46.378401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:46.392455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:46.393061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:46.402658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:46.403380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:46.403910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:46.406621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:46.411270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:46.411908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:46.897512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:46.899131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:46.905741 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-634bbcef-70dc-4048-b8f7-091453ebbac3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.517039 Oct 17 15:25:46.908781 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 495/1041] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:46 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:46.935380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:46.936605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:46.946397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:46.947308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:46.948103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:46.950402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:46.950998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:46.951667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:47.055302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:47.055439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:47.067676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1d627f08-f9df-4647-b3c0-0fdc347421eb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1274 microversion: 2.1 time: 0.150788 Oct 17 15:25:47.074556 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 496/1042] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:46 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:47.080680 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-814532de-0112-47da-8b4b-222ab65dfc4f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.753901 Oct 17 15:25:47.081284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:47.081634 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 547/1043] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:46 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:47.088459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:47.098056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:47.098852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:47.099526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:47.100817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:47.101632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:47.102403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:47.160941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:47.161930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:47.170472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:47.171807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:47.173050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:47.175158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:47.177336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:47.178347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:47.220626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=44 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:47.337209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:47.338709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:47.350284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:47.355472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:47.372013 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c5f6a52-d1de-4e91-9312-f011b16b6813 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.215826 Oct 17 15:25:47.372858 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 548/1044] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:47 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:47.384501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:47.393984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:47.400789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:47.404914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:47.409811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:47.410727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:47.411276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:47.411822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:47.460267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:47.472584 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a004f949-9c80-4f0f-bb6a-288dd5c9ebbb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.398676 Oct 17 15:25:47.473359 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 497/1045] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:47 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:47.650767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:47.663493 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-404ba7f7-aee9-4762-a198-7634342fe3eb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1214 microversion: 2.1 time: 0.287601 Oct 17 15:25:47.664920 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 549/1046] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:47 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1214 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:47.930238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:47.930876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:47.933008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:47.938577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:47.939086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:47.939512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:47.940203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:47.940645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:47.941057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.092406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:48.093190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:48.100047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.100729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.101371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.102178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.102874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.103469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.272235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:48.286969 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b47e80fc-840e-467b-b041-2a13d4781602 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.360551 Oct 17 15:25:48.290526 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 498/1047] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:47 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:48.307492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:48.308367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:48.316218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.316924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.330634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.332338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.333307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.333883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.643230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:48.670530 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-87f7c380-9461-471c-ab36-ceb136cd55ec tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.378543 Oct 17 15:25:48.675674 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 499/1048] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:48 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:48.680916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:48.683868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:48.701966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.702949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.706780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.707998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.708621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.709063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.722530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:48.741050 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8667d9d9-e520-4f45-80b5-3bfea5862b03 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1274 microversion: 2.1 time: 0.649958 Oct 17 15:25:48.742690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:48.759971 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 550/1049] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:48 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1274 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:48.767641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:48.768739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:48.777818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.779110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.780835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.781672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.782234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.782923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.830212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:48.840001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:48.842416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:48.849734 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-38e26b33-085f-4e9b-a04e-b042b91e462c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1531 microversion: 2.91 time: 0.172268 Oct 17 15:25:48.864665 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 500/1050] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:48 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1531 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:48.869881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:48.870820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:48.877254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.877981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.878671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:48.879414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:48.879858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:48.880271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.008672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:49.022242 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f2a29e88-14eb-437f-81b4-0390f5067e94 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1270 microversion: 2.1 time: 0.156067 Oct 17 15:25:49.022881 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 501/1051] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:48 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:49.027685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:49.028503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:49.045683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.046437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.047219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.049263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.049930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.050603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.092413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:49.101923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f182a78-dd69-480b-94db-76b6308ccb29 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1505 microversion: 2.1 time: 0.340247 Oct 17 15:25:49.102953 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 551/1052] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:48 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:49.247179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lazy-loading 'services' on Instance uuid 98141701-d49a-42aa-a983-c59e9d2c3ba1 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:25:49.313426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:49.314708 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-771dde8a-29a8-4d1a-9784-de5649a0212d tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1938 microversion: 2.91 time: 0.290556 Oct 17 15:25:49.316094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 502/1053] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:49 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1938 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:49.336585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:49.349049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.349863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.350558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.354629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.355952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.357033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.361893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:49.362562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:49.386100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.386621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.387058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.402955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.403559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.404005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.429331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lazy-loading 'flavor' on Instance uuid 98141701-d49a-42aa-a983-c59e9d2c3ba1 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:25:49.615215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:49.630196 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5902f841-5a10-4181-bf98-11d22f582d69 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.321722 Oct 17 15:25:49.634260 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 552/1054] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:49 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:49.694957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f0a07600-e89d-471e-a008-1a6f05ad0b56 req-61080395-2227-45c8-b99a-b3d6bf7baac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ca326f-588c-4823-97b0-0bde70fc9435", "name": "network-vif-plugged", "status": "completed", "tag": "1b032b50-ae0d-460a-b76a-a8dfd2038eed"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:49.715437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f0a07600-e89d-471e-a008-1a6f05ad0b56 req-61080395-2227-45c8-b99a-b3d6bf7baac8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.717722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f0a07600-e89d-471e-a008-1a6f05ad0b56 req-61080395-2227-45c8-b99a-b3d6bf7baac8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.719357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f0a07600-e89d-471e-a008-1a6f05ad0b56 req-61080395-2227-45c8-b99a-b3d6bf7baac8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.787196 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80eeeacc-f1e6-4098-98be-235ada97ac11 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "POST /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1/action" status: 202 len: 0 microversion: 2.91 time: 0.439364 Oct 17 15:25:49.788499 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 503/1055] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:25:49 2022] POST /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:25:49.792659 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f0a07600-e89d-471e-a008-1a6f05ad0b56 req-61080395-2227-45c8-b99a-b3d6bf7baac8 service nova] Creating event network-vif-plugged:1b032b50-ae0d-460a-b76a-a8dfd2038eed for instance 99ca326f-588c-4823-97b0-0bde70fc9435 on n-h1-854441-12 Oct 17 15:25:49.811849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:49.812115 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f0a07600-e89d-471e-a008-1a6f05ad0b56 req-61080395-2227-45c8-b99a-b3d6bf7baac8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125028 Oct 17 15:25:49.813021 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 553/1056] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:25:49.816507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:49.825805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:49.826589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:49.837762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.844524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.845288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.846259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.854051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.855225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.859267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.859771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.863518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:49.865603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:49.866093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:49.866540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.482077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:50.493724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:50.505906 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-742328e9-fa7f-4494-9ac5-169854c08e8f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.716135 Oct 17 15:25:50.507149 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f957dfd-a221-4ca8-af3d-833d93b38991 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.691156 Oct 17 15:25:50.508861 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 554/1057] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:49 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:50.514236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:50.515082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:50.525664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.526674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.527429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.528305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.528467 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 504/1058] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:49 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:50.529372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.529979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.549540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:50.551134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:50.564213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.567509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.568336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.569685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.570312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.571082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.632206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:50.645402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:50.646952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:50.650950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:50.654825 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a6ed83ed-0f98-4d52-9021-a944a31b92d3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.144778 Oct 17 15:25:50.655660 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 555/1059] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:50 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:50.662562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:50.663331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:50.671771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.672575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.673158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.673955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.674414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.674874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.683372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:50.692147 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b1d4309-a37a-4a0a-bc05-f931d87d3855 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1276 microversion: 2.1 time: 0.161619 Oct 17 15:25:50.692747 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 505/1060] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:50 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:50.698013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:50.698650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:50.704718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.705225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.705658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.706352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.706834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.707256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.885060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:50.894078 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c82e143-729c-42b6-8034-0372c9aae6e5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1480 microversion: 2.1 time: 0.237179 Oct 17 15:25:50.894457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:50.894712 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 556/1061] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:50 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1480 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:50.899331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b97f8b41-199b-4cdc-871e-47419ad0b2c0 req-a9e90cba-ae5f-4f0c-a5df-680cd15424f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3", "tag": "c0728835-c3dd-487d-9ae3-e25a2f9c594a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:50.902336 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5cae9f47-ae6c-4152-8c83-39f39ee641e8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.208420 Oct 17 15:25:50.903133 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 506/1062] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:50 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:50.917139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-68469259-c546-4046-bd7b-9d0386a83b02 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '.version_select at 0x7f28bee40a60>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:50.920516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b97f8b41-199b-4cdc-871e-47419ad0b2c0 req-a9e90cba-ae5f-4f0c-a5df-680cd15424f9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.921006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b97f8b41-199b-4cdc-871e-47419ad0b2c0 req-a9e90cba-ae5f-4f0c-a5df-680cd15424f9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.921433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b97f8b41-199b-4cdc-871e-47419ad0b2c0 req-a9e90cba-ae5f-4f0c-a5df-680cd15424f9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.921724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68469259-c546-4046-bd7b-9d0386a83b02 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.922302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68469259-c546-4046-bd7b-9d0386a83b02 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.922821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68469259-c546-4046-bd7b-9d0386a83b02 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.933136 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b97f8b41-199b-4cdc-871e-47419ad0b2c0 req-a9e90cba-ae5f-4f0c-a5df-680cd15424f9 service nova] Creating event network-changed:c0728835-c3dd-487d-9ae3-e25a2f9c594a for instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 on n-h2-854441-12 Oct 17 15:25:50.937088 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-68469259-c546-4046-bd7b-9d0386a83b02 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 1985 microversion: 2.1 time: 0.023925 Oct 17 15:25:50.938094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 507/1063] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:25:50 2022] GET /compute/v2.1/os-migrations => generated 1985 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:50.938240 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b97f8b41-199b-4cdc-871e-47419ad0b2c0 req-a9e90cba-ae5f-4f0c-a5df-680cd15424f9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042281 Oct 17 15:25:50.938875 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 557/1064] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:50.952327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-622ab637-6916-4eac-affc-aeabbbd8b4a5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:50.953000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-622ab637-6916-4eac-affc-aeabbbd8b4a5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:50.959681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-622ab637-6916-4eac-affc-aeabbbd8b4a5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.960143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-622ab637-6916-4eac-affc-aeabbbd8b4a5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.960578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-622ab637-6916-4eac-affc-aeabbbd8b4a5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:50.961268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-622ab637-6916-4eac-affc-aeabbbd8b4a5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:50.961716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-622ab637-6916-4eac-affc-aeabbbd8b4a5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:50.962133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-622ab637-6916-4eac-affc-aeabbbd8b4a5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.100117 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-622ab637-6916-4eac-affc-aeabbbd8b4a5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1633 microversion: 2.1 time: 0.151369 Oct 17 15:25:51.100710 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 508/1065] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:50 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1633 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:51.145741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9282466b-f2cb-4fe9-82ab-1303bd6e884c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Action: 'create', calling method: .version_select at 0x7f28bead0f70>, body: {"keypair": {"name": "tempest-keypair-1048118819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9fp0CPJ1hdzpmIPQ4weJkD7HHWaOmaF/Cf+xG0bhPdZ1agmM2suDXoC72a6m8MiY/lc+wZQQ+hfEIB2n/uyETRfMO0A1iTM30K4169+rSGYITtfGnXjLewd7WApAkvQQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:51.164091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9282466b-f2cb-4fe9-82ab-1303bd6e884c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:51.170789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9282466b-f2cb-4fe9-82ab-1303bd6e884c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for user 13c8d45b2e4d459d92b024476b2f4fbd and project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:51.199566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9282466b-f2cb-4fe9-82ab-1303bd6e884c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058299 Oct 17 15:25:51.200345 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 558/1066] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:25:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:51.551311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:51.552342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:51.552825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:51.556653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:51.565770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.565770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.565770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.566100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.568178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.568822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.570911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.571402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.571830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.577223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.577694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.578398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.750826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:51.762371 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d59c57a7-7de5-4430-be9e-06d8b04d49dc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.216879 Oct 17 15:25:51.775689 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 509/1067] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:51 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:51.786537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:51.787493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:51.794727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.795937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.796587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.797834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.798774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.799414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.824606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:51.833606 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d84838b-03f5-48db-a6f6-98ddb153fd1d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.285873 Oct 17 15:25:51.835023 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 559/1068] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:51 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:51.840093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:51.840910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:51.848089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.848836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.849614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.850693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.851363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.851877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.899532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:51.911067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:51.913272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:51.922093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5bea3607-33a7-4ff1-bcd4-86595e5d0833 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.144754 Oct 17 15:25:51.923024 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 510/1069] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:51 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:51.924311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:51.927984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:51.928784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:51.935345 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d7f4283-59b6-4d12-9f76-316d63d76f18 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1276 microversion: 2.1 time: 0.099063 Oct 17 15:25:51.935571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.935995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.936632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:51.936825 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 560/1070] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:51 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:51.937781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:51.938238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:51.938855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:52.624376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:52.638572 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c77d68be-1c75-4f0f-9bb0-82deb57d2221 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.713917 Oct 17 15:25:52.648510 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 511/1071] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:51 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:52.789393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:52.790321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:52.799252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:52.800026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:52.801058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:52.801634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:52.802180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:52.802871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:52.859167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:52.860455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:52.872772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:52.873822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:52.874480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:52.875506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:52.876060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:52.876574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:53.104605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:53.119748 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f9a03e2d-7a31-4cef-8fcb-aae63bed0fc0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.265878 Oct 17 15:25:53.122338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 512/1072] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:52 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:53.131931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:53.133563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:53.184441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:53.194880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:53.196244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:53.197442 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35b2bcd3-80a4-4a2c-b096-cfd09a5e6ec3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1537 microversion: 2.1 time: 0.412357 Oct 17 15:25:53.197741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:53.198850 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 561/1073] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:52 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1537 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:53.199142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:53.199737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:53.200288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:53.207861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:53.208782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:53.223544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:53.224677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:53.254627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:53.254627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:53.254627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:53.254627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:53.339210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:53.342382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:53.354989 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70f744aa-3597-4581-8784-36d319c8cd03 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1276 microversion: 2.1 time: 0.152447 Oct 17 15:25:53.355610 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 562/1074] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:53 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:53.357121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:53.359178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:53.366034 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-16453000-8616-44b5-b695-35c110df48b5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.239029 Oct 17 15:25:53.367056 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 513/1075] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:53 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:53.427455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1775703348", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "7d66882a-376e-4e59-a30c-8056586fb6d2"}], "security_groups": [{"name": "tempest-securitygroup--1766301396"}], "key_name": "tempest-keypair-1048118819", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:53.657584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] validate_networks() for [('7d66882a-376e-4e59-a30c-8056586fb6d2', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:25:53.661677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:53.662292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:53.671170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:53.672060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:53.672663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:53.674575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:53.675217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:53.675797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:54.215317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:54.224783 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f0d45ae2-5b36-43ca-8b29-bc8593d04c55 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.566358 Oct 17 15:25:54.224783 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 514/1076] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:53 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:54.229794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:54.230404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:54.237395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:54.238212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:54.238983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:54.239915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:54.240577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:54.241169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:54.258975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:54.396238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:54.407204 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-14eea8d6-c405-49cf-be52-d95b0c16e638 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.181216 Oct 17 15:25:54.408635 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 515/1077] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:54 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:54.414251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:54.415156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:54.422108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:54.422716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:54.423568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:54.424283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:54.424739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:54.425163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:54.830839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:54.845578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-775a50ac-815e-462c-8f5b-5ab410e6b415 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1542 microversion: 2.1 time: 0.435343 Oct 17 15:25:54.847215 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 516/1078] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:54 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1542 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:54.855088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:54.856342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:54.865084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:54.866407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:54.867145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:54.868543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:54.869348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:54.870354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:54.932844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:25:54.934462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:25:54.935464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:25:54.936672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:25:54.937364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:25:54.953704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:54.955468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:54.957146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:54.960180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:54.961202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:54.961881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:54.994378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:25:55.007088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for user 13c8d45b2e4d459d92b024476b2f4fbd and project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:25:55.041354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:25:55.044454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:25:55.160375 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2263674-be3c-423c-b2e7-de7900c8e672 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.736491 Oct 17 15:25:55.166683 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 563/1079] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:25:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:25:55.175364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:55.176746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:55.185546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:55.186795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:55.187662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:55.190670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:55.191543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:55.192269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:55.407929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:55.417791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:55.426098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:55.437896 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb7b158b-b8af-4a6d-8865-248f3cd35ffd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.274914 Oct 17 15:25:55.438713 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 564/1080] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:55 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:55.451558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c7eb823-7e64-44b6-a188-449cd9bc78a3 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:55.452245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c7eb823-7e64-44b6-a188-449cd9bc78a3 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:55.538337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c7eb823-7e64-44b6-a188-449cd9bc78a3 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:55.551959 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c7eb823-7e64-44b6-a188-449cd9bc78a3 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1235 microversion: 2.1 time: 0.112337 Oct 17 15:25:55.552750 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 565/1081] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:55 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:55.557263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:55.557839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:55.582998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:55.583510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:55.593315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:55.596281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:55.596774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:55.597214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:55.641427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:55.654666 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1e9f3efb-727e-490b-8723-40ccedb64a8f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.805937 Oct 17 15:25:55.657893 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 517/1082] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:54 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:55.667729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:55.670367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:55.691410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:55.697216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:55.697716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:55.698479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:55.700840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:55.701269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:55.946333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:55.957923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76dcbeae-b178-4afb-a2fd-a9263fb64a99 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.404088 Oct 17 15:25:55.963171 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 566/1083] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:55 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:55.976994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:55.977818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:55.995434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:55.997839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:55.999027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.001390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:56.003110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:56.005194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.119137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:56.129541 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b9ccffd-08cc-427f-a61e-717f287f5413 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.469856 Oct 17 15:25:56.130810 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 518/1084] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:55 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:56.337384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:56.351247 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b24fc095-6da0-4051-95a4-c4cf852b9143 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1542 microversion: 2.1 time: 0.384390 Oct 17 15:25:56.354203 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 567/1085] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:55 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1542 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:56.437367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8a3cd86b-7acd-42f5-af15-97aa6103a437 req-f4c3849b-9ce9-43de-990f-816a90c9b18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943a464e-b11b-46e2-9cb0-4b734b5e7402", "tag": "ef30b980-4440-407e-95c4-25cbaff490fe"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:56.453117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8a3cd86b-7acd-42f5-af15-97aa6103a437 req-f4c3849b-9ce9-43de-990f-816a90c9b18b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:56.453608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8a3cd86b-7acd-42f5-af15-97aa6103a437 req-f4c3849b-9ce9-43de-990f-816a90c9b18b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:56.454029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8a3cd86b-7acd-42f5-af15-97aa6103a437 req-f4c3849b-9ce9-43de-990f-816a90c9b18b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.469376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:56.471190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:56.480815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:56.481860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:56.482907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.485248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:56.486821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:56.487409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.492169 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8a3cd86b-7acd-42f5-af15-97aa6103a437 req-f4c3849b-9ce9-43de-990f-816a90c9b18b service nova] Creating event network-changed:ef30b980-4440-407e-95c4-25cbaff490fe for instance 943a464e-b11b-46e2-9cb0-4b734b5e7402 on n-h2-854441-12 Oct 17 15:25:56.506987 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8a3cd86b-7acd-42f5-af15-97aa6103a437 req-f4c3849b-9ce9-43de-990f-816a90c9b18b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073103 Oct 17 15:25:56.508418 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 519/1086] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:25:56.524656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:25:56.583027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:56.586832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:56.587997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:56.596211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:56.597210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:56.598167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:56.598814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:56.598991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.599627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:56.600294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:56.600724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.609265 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-696c4ded-906d-42a5-977d-a0567d464b9c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.143750 Oct 17 15:25:56.613054 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 568/1087] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:56 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:56.682255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:56.682962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:56.687354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:56.692855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:56.694816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:56.695460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.699513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:56.699683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:56.700039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.701765 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c00df62e-0802-43d5-ab71-5129076f9cbe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1287 microversion: 2.1 time: 0.126599 Oct 17 15:25:56.711170 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 520/1088] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:56 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:56.921929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:56.932700 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0431a3f-5147-4640-a170-17867f6cced2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.254776 Oct 17 15:25:56.933316 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 569/1089] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:56 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:56.981311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:56.981934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:56.992602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:56.993139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:56.998916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:56.999764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.000249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.000873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.100446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-386474b7-7def-45d8-8442-778925e07a03 req-5628edb0-06f9-4a1e-a137-9d9b89f36fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e37b74a-df57-4e6a-ba1c-cd631111d114", "name": "network-vif-plugged", "status": "completed", "tag": "73104619-ab2a-4f83-8519-6b2bb6caad29"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:25:57.121458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-386474b7-7def-45d8-8442-778925e07a03 req-5628edb0-06f9-4a1e-a137-9d9b89f36fff service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.121951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-386474b7-7def-45d8-8442-778925e07a03 req-5628edb0-06f9-4a1e-a137-9d9b89f36fff service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.122380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-386474b7-7def-45d8-8442-778925e07a03 req-5628edb0-06f9-4a1e-a137-9d9b89f36fff service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.154226 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-386474b7-7def-45d8-8442-778925e07a03 req-5628edb0-06f9-4a1e-a137-9d9b89f36fff service nova] Creating event network-vif-plugged:73104619-ab2a-4f83-8519-6b2bb6caad29 for instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 on n-h2-854441-12 Oct 17 15:25:57.169280 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-386474b7-7def-45d8-8442-778925e07a03 req-5628edb0-06f9-4a1e-a137-9d9b89f36fff service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075149 Oct 17 15:25:57.177159 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 570/1090] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:25:57.184152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:57.187383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:57.223484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.224283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.224947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.225947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.226958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.228252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.406258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:57.416006 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-359c9362-5756-43b8-a87a-c30b26067297 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.438651 Oct 17 15:25:57.421020 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 521/1091] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:56 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:57.431261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:57.435222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:57.451384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.452277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.452987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.453894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.454577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.455178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.532384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:57.543829 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d9d22f0a-1852-4032-882f-9d437ae3fe78 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.364882 Oct 17 15:25:57.545274 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 571/1092] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:57 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:57.646299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:57.647232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:57.655365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.655876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.656909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.657752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.658304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.658785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.769626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:57.785213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:57.787066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:57.796565 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8dfec48-9c5e-47be-a306-493c926347dd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.159263 Oct 17 15:25:57.797621 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 572/1093] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:57 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:57.803241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:57.804184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:57.812580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.814952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.815834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.816860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.818040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.818549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.917435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:57.945706 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d4f441e-9111-473e-87ea-cb6b8134b7c1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1293 microversion: 2.1 time: 0.146736 Oct 17 15:25:57.947710 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 573/1094] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:57 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1293 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:57.957941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:57.959470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:57.971945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.972451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.972949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:57.973858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:57.974302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:57.975094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:58.157680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:58.166322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c08ac6ce-bef2-46a8-892e-36b278012b62 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1542 microversion: 2.1 time: 0.743891 Oct 17 15:25:58.174045 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 522/1095] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:57 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1542 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:58.218695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:58.232501 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-724ae46d-148f-44a5-964a-2f81c39dbb9b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.279363 Oct 17 15:25:58.246533 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 574/1096] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:57 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:58.445773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:58.447183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:58.453699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:58.454564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:58.455247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:58.456214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:58.456731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:58.457393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:58.576116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:58.576904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:58.587717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:58.588311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:58.589037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:58.590033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:58.590818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:58.591344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:58.779651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:58.791926 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3af4bd96-fddf-4bf7-8617-e62f382f580c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.350168 Oct 17 15:25:58.792656 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 523/1097] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:58 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:58.828371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:58.828646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:58.836384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:58.836779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:58.837528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:58.841701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:58.843216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:58.845389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:58.945832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:58.954246 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e02b4834-2faf-4473-b253-ec84a1bd1767 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.384090 Oct 17 15:25:58.955033 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 575/1098] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:58 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:58.987596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:58.988279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:58.992083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:59.005957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:59.006460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:59.006938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:59.007658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:59.008478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:59.008901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:59.011585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:59.013312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:59.027155 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f363918b-4611-46a3-a223-a5da1033f650 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.203769 Oct 17 15:25:59.027766 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 524/1099] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:25:58 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:25:59.128412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:59.138658 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99421e85-2286-4f0a-88b8-ca9ef63430c2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1293 microversion: 2.1 time: 0.158602 Oct 17 15:25:59.151779 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 576/1100] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:58 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1293 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:25:59.201776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:59.203013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:59.211208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:59.212134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:59.212938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:59.214675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:59.215362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:59.216003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:59.260875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:59.261483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:59.268672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:59.269367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:59.271025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:59.272154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:59.272901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:59.273549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:59.530974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:59.540000 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69b524d5-63f1-4b72-ae0d-06dd5ad0af8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.283209 Oct 17 15:25:59.547340 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 577/1101] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:59 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:59.568785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:25:59.586889 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1daa30b6-e3c9-4b33-922b-2783db538bc2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1542 microversion: 2.1 time: 0.382774 Oct 17 15:25:59.588152 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 525/1102] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:59 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1542 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:25:59.821456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:25:59.822284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:25:59.838814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:59.839329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:59.842914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:59.844026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:25:59.844712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:25:59.845502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:25:59.993544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:00.002386 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3f2e456-6629-4178-8d15-551d484d06f7 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1324 microversion: 2.1 time: 0.185964 Oct 17 15:26:00.018387 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 578/1103] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:25:59 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1324 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:00.059555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:00.060235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:00.067780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.068334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.068767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.069766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.069974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.070442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.150703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1119304751", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "4a4d489b-6847-437c-bb6f-226f2268a1b9"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:00.151956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:00.161653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:00.163606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:00.170643 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02a77cbe-e9ce-4abb-ae60-5081cd8f59db tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.118017 Oct 17 15:26:00.172478 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 579/1104] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:00 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:00.179657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:00.179657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:00.185900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.186396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.186958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.187591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.188046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.188694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.195765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:00.261584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] validate_networks() for [('4a4d489b-6847-437c-bb6f-226f2268a1b9', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:26:00.400182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:00.408051 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aad8fb12-0c83-4ce1-b3ec-c3049394c7f3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.234506 Oct 17 15:26:00.408649 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 580/1105] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:00 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:00.427434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:00.428158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:00.435240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.435744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.436186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.436900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.437362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.437805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.602160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:00.612533 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85b87f65-be02-47ff-8754-870437a91882 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1361 microversion: 2.1 time: 0.201236 Oct 17 15:26:00.613381 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 581/1106] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:00 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:00.618130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:00.618783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:00.626363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.626940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.627512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.628240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.628776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.629303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.845530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:00.853954 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4c974c7-0059-4db4-94f8-c55863453638 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.239650 Oct 17 15:26:00.855817 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 582/1107] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:00 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:00.864090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:00.864797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:00.873745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.874242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.874713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.875780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.875906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.876287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.950927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:26:00.951476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:26:00.951806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:26:00.952583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:26:00.953127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:26:00.965690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.966921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.967671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.968748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:00.969209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:00.970210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:00.995886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:26:01.002739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for user 59a1c6dac66a43d9b5e91b78215359ce and project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:26:01.018280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:26:01.021685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:26:01.034713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:01.045917 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f6476c2-1dc8-4c6b-8c45-0add6614318e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1542 microversion: 2.1 time: 0.189878 Oct 17 15:26:01.060462 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 583/1108] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:00 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1542 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:01.073218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3febc60b-5e8f-4957-8ca0-56c69c2560b7 req-0f7a7571-45df-4d49-b706-12c849da2b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c128f7c3-d3e6-4664-979e-e424581346e1", "tag": "0ae18c17-0b0d-49c1-8d85-94306923e42f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:01.085926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3febc60b-5e8f-4957-8ca0-56c69c2560b7 req-0f7a7571-45df-4d49-b706-12c849da2b3f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.086422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3febc60b-5e8f-4957-8ca0-56c69c2560b7 req-0f7a7571-45df-4d49-b706-12c849da2b3f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.087320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3febc60b-5e8f-4957-8ca0-56c69c2560b7 req-0f7a7571-45df-4d49-b706-12c849da2b3f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.107191 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3febc60b-5e8f-4957-8ca0-56c69c2560b7 req-0f7a7571-45df-4d49-b706-12c849da2b3f service nova] Creating event network-changed:0ae18c17-0b0d-49c1-8d85-94306923e42f for instance c128f7c3-d3e6-4664-979e-e424581346e1 on n-h1-854441-12 Oct 17 15:26:01.108746 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-519c7a85-4ae8-4b5d-b8fb-09a54f746d67 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145852 Oct 17 15:26:01.111942 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 526/1109] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:25:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:26:01.112811 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3febc60b-5e8f-4957-8ca0-56c69c2560b7 req-0f7a7571-45df-4d49-b706-12c849da2b3f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046534 Oct 17 15:26:01.113736 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 584/1110] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:01.124536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2f6ed8e-ea62-4eda-a4d5-227beb8452ef tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:01.125614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2f6ed8e-ea62-4eda-a4d5-227beb8452ef tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:01.138879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:01.139595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:01.147932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.148997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.149451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.150222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.150721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.151151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.188836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2f6ed8e-ea62-4eda-a4d5-227beb8452ef tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:01.199767 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2f6ed8e-ea62-4eda-a4d5-227beb8452ef tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1208 microversion: 2.1 time: 0.081009 Oct 17 15:26:01.201107 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 585/1111] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:01 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:01.205996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:01.206633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:01.222273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:01.228403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.229060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.229557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.230365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.231150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.231367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.331734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:01.355513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:01.357075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:01.364852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3fba8439-f058-4c4a-8ea5-ae397327c0cf tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.162340 Oct 17 15:26:01.365923 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 586/1112] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:01 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:01.390413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:01.399305 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-11710c27-fb60-41e8-b8d0-47b65ee134e6 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1520 microversion: 2.1 time: 0.285786 Oct 17 15:26:01.399884 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 527/1113] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:01 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:01.422256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Action: 'action', calling method: .version_select at 0x7f28c09104c0>, body: {"addFloatingIp": {"address": "172.25.2.130"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:01.425035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:01.434537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:01.435259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:01.443116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.443688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.444220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.445129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.445754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.446178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.449379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.451618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.451618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.451961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.452633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.453063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.483669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:01.542309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "refresh_cache-11396321-8b48-4627-858e-90aabfbe0432" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:26:01.543048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquired lock "refresh_cache-11396321-8b48-4627-858e-90aabfbe0432" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:26:01.613902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:01.622295 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5cd9793d-b919-45d1-85cf-9d3cbbc4cf97 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.191648 Oct 17 15:26:01.623497 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 528/1114] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:01 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:01.644097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:01.645084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:01.653169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.653980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.654640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.655697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.656878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.657673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.817611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:01.828660 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-08e110e6-15a1-4110-817a-e63b1a77bb53 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1361 microversion: 2.1 time: 0.192507 Oct 17 15:26:01.831439 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 529/1115] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:01 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:01.880150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:01.881203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:01.892148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.893522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.895211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:01.896249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:01.897547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:01.898194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:02.058017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:02.066488 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a06b19c-86ca-4557-a6f3-b3a4590aaa75 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.191057 Oct 17 15:26:02.078521 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 530/1116] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:01 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:02.080048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:02.080664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:02.086939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:02.087430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:02.087863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:02.088790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:02.089409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:02.089833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:02.258830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:02.267195 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d023029f-35d4-456a-ba3b-5229182c852b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1542 microversion: 2.1 time: 0.191346 Oct 17 15:26:02.267927 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 531/1117] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:02 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1542 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:02.272879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:02.273778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:02.283262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:02.283884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:02.284445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:02.285292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:02.285837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:02.286525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:02.351585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:02.363848 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-418c128b-dd2d-4ab0-adab-51c7667a52cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1212 microversion: 2.1 time: 0.094479 Oct 17 15:26:02.364560 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 532/1118] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:02 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:02.399170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:02.399775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:02.405911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:02.406403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:02.406881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:02.407787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:02.408883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:02.409318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:02.426678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:02.488040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:02.497186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:02.499040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:02.504423 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7d09064a-c3c9-423a-bcf8-b34db767c4ea tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.109665 Oct 17 15:26:02.510532 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 533/1119] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:02 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:26:02.647612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:02.648540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:02.657333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:02.657880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:02.658481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:02.663874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:02.664405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:02.664846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:02.831079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Building network info cache for instance {{(pid=120406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:26:02.993299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:03.010068 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bfabfbaf-0fbc-4735-a167-330f90bb6f4d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.366167 Oct 17 15:26:03.026267 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 534/1120] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:02 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:03.036599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-4eed3ff5-0dd6-405a-9668-b94245817faa req-4f65f074-91c4-4b42-9cf2-9269207ca47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11396321-8b48-4627-858e-90aabfbe0432", "tag": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:03.053622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4eed3ff5-0dd6-405a-9668-b94245817faa req-4f65f074-91c4-4b42-9cf2-9269207ca47b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.055000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4eed3ff5-0dd6-405a-9668-b94245817faa req-4f65f074-91c4-4b42-9cf2-9269207ca47b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.055694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4eed3ff5-0dd6-405a-9668-b94245817faa req-4f65f074-91c4-4b42-9cf2-9269207ca47b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:03.069532 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-4eed3ff5-0dd6-405a-9668-b94245817faa req-4f65f074-91c4-4b42-9cf2-9269207ca47b service nova] Creating event network-changed:ad6d955f-b8f4-4902-bca5-a5ef16b95dbe for instance 11396321-8b48-4627-858e-90aabfbe0432 on n-h1-854441-12 Oct 17 15:26:03.077211 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-4eed3ff5-0dd6-405a-9668-b94245817faa req-4f65f074-91c4-4b42-9cf2-9269207ca47b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045847 Oct 17 15:26:03.078262 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 535/1121] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:03.086471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:03.088190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:03.097749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.099755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.100627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:03.103469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.105934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.106840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:03.578489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:03.593061 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-82039249-a145-4e4e-a33f-1ae22975a761 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1361 microversion: 2.1 time: 0.507075 Oct 17 15:26:03.593758 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 536/1122] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:03 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1361 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:03.603049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:03.603937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:03.616893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.617416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.618491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:03.619446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.620476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.620922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:03.763953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Updating instance_info_cache with network_info: [{"id": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe", "address": "fa:16:3e:fe:10:0b", "network": {"id": "2243e6e3-9d81-48b1-bb5b-6d70da2406ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1589788987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d43225ce4f724468800718eed544b111", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad6d955f-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:26:03.790474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:03.801864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Releasing lock "refresh_cache-11396321-8b48-4627-858e-90aabfbe0432" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:26:03.802861 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-812df8e7-80db-4149-9fba-a2ed84efd805 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "POST /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432/action" status: 202 len: 0 microversion: 2.1 time: 2.385051 Oct 17 15:26:03.803507 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 587/1123] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:01 2022] POST /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432/action => generated 0 bytes in 2386 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 15:26:03.825264 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-af94448e-a508-407c-bf0e-83dc04fe9c7a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.230379 Oct 17 15:26:03.826492 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 537/1124] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:03 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:03.828298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-06931772-b331-4cee-aba3-f4763157d8e4 req-c36a53a3-6936-45d0-a18f-f3bbc8d3f621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3", "name": "network-vif-plugged", "status": "completed", "tag": "c0728835-c3dd-487d-9ae3-e25a2f9c594a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:03.837273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:03.838238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:03.850542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-06931772-b331-4cee-aba3-f4763157d8e4 req-c36a53a3-6936-45d0-a18f-f3bbc8d3f621 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.853197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.853910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-06931772-b331-4cee-aba3-f4763157d8e4 req-c36a53a3-6936-45d0-a18f-f3bbc8d3f621 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.855559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.856176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:03.857071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.857681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.858390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:03.859430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-06931772-b331-4cee-aba3-f4763157d8e4 req-c36a53a3-6936-45d0-a18f-f3bbc8d3f621 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:03.882302 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-06931772-b331-4cee-aba3-f4763157d8e4 req-c36a53a3-6936-45d0-a18f-f3bbc8d3f621 service nova] Creating event network-vif-plugged:c0728835-c3dd-487d-9ae3-e25a2f9c594a for instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 on n-h2-854441-12 Oct 17 15:26:03.888983 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-06931772-b331-4cee-aba3-f4763157d8e4 req-c36a53a3-6936-45d0-a18f-f3bbc8d3f621 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073349 Oct 17 15:26:03.889917 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 588/1125] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:03.897104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:03.898101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:03.904782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.905671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.906419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:03.907383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:03.908055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:03.908695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:04.167377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:04.180110 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a0d38a2-fb0b-4e36-9176-7c036bcf34c5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1260 microversion: 2.1 time: 0.288653 Oct 17 15:26:04.185826 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 589/1126] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:03 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1260 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:04.206383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:04.209645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:04.237309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:04.237849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:04.238368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:04.239756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:04.240228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:04.240662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:04.370138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:04.396463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:04.400021 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92559a1d-13ab-42b3-a699-42d75472b235 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1542 microversion: 2.1 time: 0.570510 Oct 17 15:26:04.400889 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 538/1127] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:03 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1542 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:04.413347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.130"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:04.417830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:04.418606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:04.420175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:04.428993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:04.429788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:04.430234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:04.430980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:04.433581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c15318c-5d12-4bc5-95c2-1c5395bf664c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.245914 Oct 17 15:26:04.434736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:04.435341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:04.437532 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 590/1128] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:04 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:04.451177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:04.452076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:04.464211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:04.466858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:04.468644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:04.469568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:04.470024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:04.470454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:04.510126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "refresh_cache-3e37b74a-df57-4e6a-ba1c-cd631111d114" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:26:04.510554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquired lock "refresh_cache-3e37b74a-df57-4e6a-ba1c-cd631111d114" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:26:04.981718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:05.038584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:05.046812 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d91e5b5-84f1-442d-8bb3-e7ee73709f1a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.608174 Oct 17 15:26:05.047608 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 591/1129] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:04 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:05.053030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:05.053893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:05.062024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.062909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.063581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.064556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.065057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.065552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.211220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:05.224493 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-acec7c9f-2d75-45be-9cdd-e7cee8d16a5c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1361 microversion: 2.1 time: 0.175628 Oct 17 15:26:05.241135 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 592/1130] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:05 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:05.241135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:05.241135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:05.247236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.247918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.249211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.250315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.251017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.251622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.432323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:05.447920 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54df1772-f7dc-4622-8dfe-2bc83ddbaaae tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.218764 Oct 17 15:26:05.463165 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 593/1131] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:05 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:05.463165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:05.463165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:05.468226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.468727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.469346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.470061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.470533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.470979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.535739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:05.545207 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a95621e3-4034-43c1-bc18-3cea18c92108 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1266 microversion: 2.1 time: 0.094961 Oct 17 15:26:05.554973 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 594/1132] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:05 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:05.560906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:05.562764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:05.570533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.571976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.572832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.574251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.574953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.575499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.721364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:05.730467 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89504cd9-9768-4c16-a37e-d01ffd661827 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1542 microversion: 2.1 time: 0.173885 Oct 17 15:26:05.731087 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 595/1133] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:05 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1542 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:05.736435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:05.737036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:05.744492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.744976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.745406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.746250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:05.746729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:05.747238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:05.818115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:05.827571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:05.829106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:05.834657 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa7da5f6-2065-4cca-a335-00455461e1f1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.102524 Oct 17 15:26:05.846525 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 596/1134] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:05 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:06.071824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:06.073586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:06.081395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.082299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.083293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.084303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.084998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.085785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.236498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:06.247243 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96a50591-3552-40c2-aa0b-d9435331c8e5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.179275 Oct 17 15:26:06.248793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 597/1135] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:06 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:06.254956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:06.255797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:06.267776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.269016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.269875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.271250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.271713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.272140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.428418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:06.436618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5161346-10b5-4d7e-8e66-aee1a6c29863 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1361 microversion: 2.1 time: 0.186210 Oct 17 15:26:06.437211 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 598/1136] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:06 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:06.471634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:06.471634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:06.479576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.480287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.480488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.481195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.481806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.482054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.627560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:06.639541 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbc092b1-08e5-4466-a954-8e86fb765792 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.171297 Oct 17 15:26:06.646461 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 599/1137] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:06 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:06.653570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:06.654467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:06.661819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.662511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.662971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.663693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.664142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.664565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.811449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:06.819674 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-880e608b-555c-470b-acbc-5e5dd6f247f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1308 microversion: 2.1 time: 0.171734 Oct 17 15:26:06.820180 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 600/1138] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:06 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:06.824833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1fe2599e-9e53-454a-90b7-38bbcf3fd2b2 req-e856bc9b-2052-4a70-8969-66588e344396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c128f7c3-d3e6-4664-979e-e424581346e1", "name": "network-vif-plugged", "status": "completed", "tag": "0ae18c17-0b0d-49c1-8d85-94306923e42f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:06.834530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1fe2599e-9e53-454a-90b7-38bbcf3fd2b2 req-e856bc9b-2052-4a70-8969-66588e344396 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.836405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1fe2599e-9e53-454a-90b7-38bbcf3fd2b2 req-e856bc9b-2052-4a70-8969-66588e344396 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.836405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1fe2599e-9e53-454a-90b7-38bbcf3fd2b2 req-e856bc9b-2052-4a70-8969-66588e344396 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.848042 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1fe2599e-9e53-454a-90b7-38bbcf3fd2b2 req-e856bc9b-2052-4a70-8969-66588e344396 service nova] Creating event network-vif-plugged:0ae18c17-0b0d-49c1-8d85-94306923e42f for instance c128f7c3-d3e6-4664-979e-e424581346e1 on n-h1-854441-12 Oct 17 15:26:06.853085 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1fe2599e-9e53-454a-90b7-38bbcf3fd2b2 req-e856bc9b-2052-4a70-8969-66588e344396 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031778 Oct 17 15:26:06.853692 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 601/1139] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:06.860385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:06.861087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:06.867640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.868133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.868573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:06.869282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:06.869737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:06.870163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.067967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:07.076063 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1391e380-a2d9-45ad-84c8-99308cf5130b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1541 microversion: 2.1 time: 0.221208 Oct 17 15:26:07.076678 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 602/1140] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:06 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1541 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:07.081257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:07.082163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:07.088938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.089431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.089871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.090636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.091092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.091508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.158744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:07.169276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:07.170729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:07.175854 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f818113-2503-4f59-83cb-2092ddd2b483 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.098140 Oct 17 15:26:07.176614 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 603/1141] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:07 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:07.273269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:07.274188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:07.280827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.281396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.282061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.283317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.284071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.284655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.304095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:07.439333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:07.447885 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af17949c-3802-4a9b-ab42-01151d252709 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1316 microversion: 2.1 time: 0.179922 Oct 17 15:26:07.448473 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 604/1142] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:07 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:07.461362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:07.461999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:07.470136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.470962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.471366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.472316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.473041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.473436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.624993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:07.633809 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f7d0a3b-37f3-45be-bb60-8f1d4e98a42c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1361 microversion: 2.1 time: 0.176692 Oct 17 15:26:07.634445 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 605/1143] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:07 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:07.639412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6f799a9d-aa0c-4452-bec9-2cc530f54210 req-173c0511-b3b6-4c18-b66d-57a17d064df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef56e60-7257-4eb3-82e1-bef0667ed073", "tag": "a37c0ce3-a016-4e5d-963c-bb23a0c4f78b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:07.649501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6f799a9d-aa0c-4452-bec9-2cc530f54210 req-173c0511-b3b6-4c18-b66d-57a17d064df7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.649973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6f799a9d-aa0c-4452-bec9-2cc530f54210 req-173c0511-b3b6-4c18-b66d-57a17d064df7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.650396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6f799a9d-aa0c-4452-bec9-2cc530f54210 req-173c0511-b3b6-4c18-b66d-57a17d064df7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.662124 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6f799a9d-aa0c-4452-bec9-2cc530f54210 req-173c0511-b3b6-4c18-b66d-57a17d064df7 service nova] Creating event network-changed:a37c0ce3-a016-4e5d-963c-bb23a0c4f78b for instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 on n-h1-854441-12 Oct 17 15:26:07.667231 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6f799a9d-aa0c-4452-bec9-2cc530f54210 req-173c0511-b3b6-4c18-b66d-57a17d064df7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031523 Oct 17 15:26:07.667871 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 606/1144] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:07.673116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:07.673792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:07.680619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.681106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.681529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.682233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.682719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.683128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.835065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:07.844522 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83e1e19b-4b5e-4e88-930a-9d440a724322 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.175337 Oct 17 15:26:07.845030 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 607/1145] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:07 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:07.849883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:07.850752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:07.857713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.858366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.858696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.859328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:07.859803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:07.860217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:07.996845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:08.005186 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c88faa3a-44ee-4f84-b82c-e962828b03b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1308 microversion: 2.1 time: 0.159154 Oct 17 15:26:08.005772 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 608/1146] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:07 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:08.099823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:08.100886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:08.108153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.108650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.109087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:08.109791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.110248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.110794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:08.249652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:08.257460 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34458ba5-e0ac-448b-876b-d0b7a51246bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1541 microversion: 2.1 time: 0.162010 Oct 17 15:26:08.258454 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 609/1147] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:08 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1541 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:08.263108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:08.263738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:08.271047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.271518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.271985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:08.272655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.273144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.273575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:08.338241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:08.346768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:08.348308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:08.353572 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a00269bb-41cf-409d-b476-b2f5c67c07b3 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.094079 Oct 17 15:26:08.354087 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 610/1148] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:08 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:08.473570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:08.474286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:08.489712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.491112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.492245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:08.493178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.493869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.494545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:08.706379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:08.718435 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3a22066-67ed-4921-aa40-72026dc2aae7 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1504 microversion: 2.1 time: 0.248747 Oct 17 15:26:08.719700 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 611/1149] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:08 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:08.726256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:08.727170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:08.737321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.737883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.738457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:08.739254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.739786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.740343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:08.887160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:08.895335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9df8eeb5-1cd2-4e2a-97ef-92c2ba0ac2ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1544 microversion: 2.1 time: 0.174177 Oct 17 15:26:08.897281 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 612/1150] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:08 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1544 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:08.902196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1597330256"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:08.902948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:08.909396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.910082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.910697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:08.911512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:08.912421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:08.912561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:09.054595 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.network.security_group_api [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Adding security group 863c57d8-4262-4459-a35b-4018f89514c7 to port c0728835-c3dd-487d-9ae3-e25a2f9c594a Oct 17 15:26:09.119578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.network.neutron [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] re-assign floating IP 172.25.2.130 from instance 11396321-8b48-4627-858e-90aabfbe0432 Oct 17 15:26:09.167224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Building network info cache for instance {{(pid=120407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:26:09.400596 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35aa0d00-7225-4268-b1a7-bce38db20abb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3/action" status: 202 len: 0 microversion: 2.1 time: 0.500823 Oct 17 15:26:09.404375 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 613/1151] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:08 2022] POST /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:09.415638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:09.416341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:09.437826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:09.438627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:09.439244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:09.440107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:09.440716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:09.441499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:09.599831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:09.609633 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0dc9006b-9187-4b0d-a0f9-f7d2009b8d67 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.203943 Oct 17 15:26:09.610653 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 614/1152] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:09 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:09.615425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d343a867-2249-403e-9903-c92adba5f842 req-c3f62b43-213a-4a2d-8fc4-860ffa517e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943a464e-b11b-46e2-9cb0-4b734b5e7402", "name": "network-vif-plugged", "status": "completed", "tag": "ef30b980-4440-407e-95c4-25cbaff490fe"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:09.625148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d343a867-2249-403e-9903-c92adba5f842 req-c3f62b43-213a-4a2d-8fc4-860ffa517e99 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:09.625632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d343a867-2249-403e-9903-c92adba5f842 req-c3f62b43-213a-4a2d-8fc4-860ffa517e99 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:09.626060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d343a867-2249-403e-9903-c92adba5f842 req-c3f62b43-213a-4a2d-8fc4-860ffa517e99 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:09.638862 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d343a867-2249-403e-9903-c92adba5f842 req-c3f62b43-213a-4a2d-8fc4-860ffa517e99 service nova] Creating event network-vif-plugged:ef30b980-4440-407e-95c4-25cbaff490fe for instance 943a464e-b11b-46e2-9cb0-4b734b5e7402 on n-h2-854441-12 Oct 17 15:26:09.644642 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d343a867-2249-403e-9903-c92adba5f842 req-c3f62b43-213a-4a2d-8fc4-860ffa517e99 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032650 Oct 17 15:26:09.645423 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 615/1153] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:09.651440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d11c0be3-c412-4d18-bdfb-a89eea8cc94a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:09.652035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d11c0be3-c412-4d18-bdfb-a89eea8cc94a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:09.658429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11c0be3-c412-4d18-bdfb-a89eea8cc94a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:09.658953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11c0be3-c412-4d18-bdfb-a89eea8cc94a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:09.659385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11c0be3-c412-4d18-bdfb-a89eea8cc94a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:09.660369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11c0be3-c412-4d18-bdfb-a89eea8cc94a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:09.660793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11c0be3-c412-4d18-bdfb-a89eea8cc94a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:09.661214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11c0be3-c412-4d18-bdfb-a89eea8cc94a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:09.742874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Updating instance_info_cache with network_info: [{"id": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe", "address": "fa:16:3e:fe:10:0b", "network": {"id": "2243e6e3-9d81-48b1-bb5b-6d70da2406ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1589788987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d43225ce4f724468800718eed544b111", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad6d955f-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:26:09.753881 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d11c0be3-c412-4d18-bdfb-a89eea8cc94a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107093 Oct 17 15:26:09.754603 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 616/1154] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:26:09 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:09.760088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:09.760844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:09.768360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:09.768852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:09.769339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:09.770679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:09.771072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:09.771500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:09.775351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Building network info cache for instance {{(pid=120407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:26:10.044373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:10.059700 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd307621-a426-4016-93c7-ff3d4be7ca25 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1308 microversion: 2.1 time: 0.304008 Oct 17 15:26:10.070531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 617/1155] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:09 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:10.070531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:10.070531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:10.072593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:10.072593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:10.078001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:10.078001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:10.078001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:10.078001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:10.432304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:10.445675 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-620407cf-949c-49a5-be0b-b48e9acf0bd0 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1473 microversion: 2.1 time: 0.383788 Oct 17 15:26:10.447158 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 618/1156] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:10 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:10.472127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:10.475499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:10.483621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:10.484349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:10.484958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:10.485896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:10.487169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:10.487808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:10.585274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:10.596530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:10.600642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:10.606627 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55a7f74c-ad3c-48d8-8f7d-5a5ccbe0be88 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.158063 Oct 17 15:26:10.607468 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 619/1157] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:10 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:10.612266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-36c9eddb-cb49-4f5c-ae78-51565fc3cdf8 req-121a8fda-af3a-4982-a478-005a8331c978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3", "tag": "c0728835-c3dd-487d-9ae3-e25a2f9c594a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:10.624117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-36c9eddb-cb49-4f5c-ae78-51565fc3cdf8 req-121a8fda-af3a-4982-a478-005a8331c978 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:10.624819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-36c9eddb-cb49-4f5c-ae78-51565fc3cdf8 req-121a8fda-af3a-4982-a478-005a8331c978 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:10.625408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-36c9eddb-cb49-4f5c-ae78-51565fc3cdf8 req-121a8fda-af3a-4982-a478-005a8331c978 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:10.638257 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-36c9eddb-cb49-4f5c-ae78-51565fc3cdf8 req-121a8fda-af3a-4982-a478-005a8331c978 service nova] Creating event network-changed:c0728835-c3dd-487d-9ae3-e25a2f9c594a for instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 on n-h2-854441-12 Oct 17 15:26:10.643803 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-36c9eddb-cb49-4f5c-ae78-51565fc3cdf8 req-121a8fda-af3a-4982-a478-005a8331c978 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034843 Oct 17 15:26:10.645008 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 620/1158] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:10.650583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d68fb7fe-4114-49bd-864e-bdd35233cae5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bea1bdc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:10.687442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Updating instance_info_cache with network_info: [{"id": "73104619-ab2a-4f83-8519-6b2bb6caad29", "address": "fa:16:3e:bf:f2:68", "network": {"id": "2243e6e3-9d81-48b1-bb5b-6d70da2406ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1589788987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d43225ce4f724468800718eed544b111", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap73104619-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:26:10.702301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Releasing lock "refresh_cache-3e37b74a-df57-4e6a-ba1c-cd631111d114" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:26:10.704685 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b0db6703-de08-4f64-8f8b-44c38c6ac1df tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "POST /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114/action" status: 202 len: 0 microversion: 2.1 time: 6.301296 Oct 17 15:26:10.705964 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 539/1159] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:04 2022] POST /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114/action => generated 0 bytes in 6303 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 15:26:10.713802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0b410424-26fb-4881-9071-3665d4535e7a req-e0a314ff-3583-4cc7-9d89-8bf4a8737086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11396321-8b48-4627-858e-90aabfbe0432", "tag": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe"}, {"name": "network-changed", "server_uuid": "3e37b74a-df57-4e6a-ba1c-cd631111d114", "tag": "73104619-ab2a-4f83-8519-6b2bb6caad29"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:10.732123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0b410424-26fb-4881-9071-3665d4535e7a req-e0a314ff-3583-4cc7-9d89-8bf4a8737086 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:10.733152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0b410424-26fb-4881-9071-3665d4535e7a req-e0a314ff-3583-4cc7-9d89-8bf4a8737086 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:10.733797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0b410424-26fb-4881-9071-3665d4535e7a req-e0a314ff-3583-4cc7-9d89-8bf4a8737086 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:10.749632 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0b410424-26fb-4881-9071-3665d4535e7a req-e0a314ff-3583-4cc7-9d89-8bf4a8737086 service nova] Creating event network-changed:ad6d955f-b8f4-4902-bca5-a5ef16b95dbe for instance 11396321-8b48-4627-858e-90aabfbe0432 on n-h1-854441-12 Oct 17 15:26:10.750569 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0b410424-26fb-4881-9071-3665d4535e7a req-e0a314ff-3583-4cc7-9d89-8bf4a8737086 service nova] Creating event network-changed:73104619-ab2a-4f83-8519-6b2bb6caad29 for instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 on n-h2-854441-12 Oct 17 15:26:10.762704 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0b410424-26fb-4881-9071-3665d4535e7a req-e0a314ff-3583-4cc7-9d89-8bf4a8737086 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054926 Oct 17 15:26:10.764204 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 540/1160] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:10.771078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:10.773209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:10.781584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:10.783184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:10.784029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:10.785154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:10.786041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:10.786742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:10.900160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-d68fb7fe-4114-49bd-864e-bdd35233cae5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 863c57d8-4262-4459-a35b-4018f89514c7 in use.", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:26:10.900865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d68fb7fe-4114-49bd-864e-bdd35233cae5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security Group 863c57d8-4262-4459-a35b-4018f89514c7 in use. Oct 17 15:26:10.900865 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-163eeeaa-0690-427b-ae1b-0a1b4b06a6a3'] Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d68fb7fe-4114-49bd-864e-bdd35233cae5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/863c57d8-4262-4459-a35b-4018f89514c7 HTTP/1.1 Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:10.902872 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: exception: Security Group 863c57d8-4262-4459-a35b-4018f89514c7 in use. Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-163eeeaa-0690-427b-ae1b-0a1b4b06a6a3'] Oct 17 15:26:10.904511 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '863c57d8-4262-4459-a35b-4018f89514c7'} Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:10.905375 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 863c57d8-4262-4459-a35b-4018f89514c7 in use. Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-163eeeaa-0690-427b-ae1b-0a1b4b06a6a3'] Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 863c57d8-4262-4459-a35b-4018f89514c7 in use. Oct 17 15:26:10.906751 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-163eeeaa-0690-427b-ae1b-0a1b4b06a6a3'] Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 863c57d8-4262-4459-a35b-4018f89514c7 in use. Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-163eeeaa-0690-427b-ae1b-0a1b4b06a6a3'] Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:10.907965 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 863c57d8-4262-4459-a35b-4018f89514c7 in use. Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-163eeeaa-0690-427b-ae1b-0a1b4b06a6a3'] Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d68fb7fe-4114-49bd-864e-bdd35233cae5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 400 to user: Security Group 863c57d8-4262-4459-a35b-4018f89514c7 in use. Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-163eeeaa-0690-427b-ae1b-0a1b4b06a6a3'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d68fb7fe-4114-49bd-864e-bdd35233cae5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/863c57d8-4262-4459-a35b-4018f89514c7" status: 400 len: 185 microversion: 2.1 time: 0.258030 Oct 17 15:26:10.909313 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 621/1161] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:10 2022] DELETE /compute/v2.1/os-security-groups/863c57d8-4262-4459-a35b-4018f89514c7 => generated 185 bytes in 259 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:26:10.910129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Action: 'action', calling method: .version_select at 0x7f28c0910430>, body: {"removeFloatingIp": {"address": "172.25.2.130"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:10.984511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:11.011259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:11.038833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:11.048386 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-70efcf38-82b2-44a8-84ef-afe3c342e65a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.282598 Oct 17 15:26:11.049153 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 541/1162] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:10 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:11.054979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-68f2f3f1-7aa8-481a-9e82-0cd72039bd3c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:11.057566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-68f2f3f1-7aa8-481a-9e82-0cd72039bd3c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:11.064872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68f2f3f1-7aa8-481a-9e82-0cd72039bd3c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.065739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68f2f3f1-7aa8-481a-9e82-0cd72039bd3c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.066468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68f2f3f1-7aa8-481a-9e82-0cd72039bd3c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:11.067448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68f2f3f1-7aa8-481a-9e82-0cd72039bd3c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.068236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68f2f3f1-7aa8-481a-9e82-0cd72039bd3c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.068722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68f2f3f1-7aa8-481a-9e82-0cd72039bd3c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:11.179956 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-68f2f3f1-7aa8-481a-9e82-0cd72039bd3c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3/action" status: 202 len: 0 microversion: 2.1 time: 0.128951 Oct 17 15:26:11.184376 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 542/1163] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:11 2022] POST /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:11.192174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:11.193083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:11.193218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:11.203796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.204616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.204982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:11.206388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.207182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.207717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:11.250807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:11.258156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.258697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.259142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:11.259864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.260318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.260748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:11.555976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:11.573687 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f0b19819-131f-4487-aab7-2f89c00ede40 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1308 microversion: 2.1 time: 0.381878 Oct 17 15:26:11.573687 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 543/1164] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:11 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:11.583652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:11.583867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:11.612735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.612955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.613362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:11.614305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.618972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.620273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:11.856644 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] HTTP exception thrown: Floating IP 172.25.2.130 is not associated with instance 11396321-8b48-4627-858e-90aabfbe0432. Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Request method failure captured: Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432/action HTTP/1.1 Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 49 Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXPI7aMOlk5IVrzumgmmK562EE37g5AAshLBukF4hFqG7aoZKfMwOZvicKVsvvcUKCxSgEWOun13AZ4S1Vv3KnYkR7eNX6w01IEYSF9j1sAFbvh5OnDakV9fZ-n806TdMP-8NPKCbt7COJ2g4issfkCOnBpjQq07BppnVzMDY1jqqQo Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: d43225ce4f724468800718eed544b111 Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1653041916 Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:11.859014 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d43225ce4f724468800718eed544b111"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/d43225ce4f724468800718eed544b111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_d43225ce4f724468800718eed544b111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d43225ce4f724468800718eed544b111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1653041916 Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: d43225ce4f724468800718eed544b111 Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1653041916 Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsAssociationTestJSON-1653041916-project Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: de65615d61c54443b8b58ea1c5fd108e Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1653041916-project Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: {"removeFloatingIp": {"address": "172.25.2.130"}} Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:26:11.860473 n-d-854441-12 devstack@n-api.service[120406]: exception: Floating IP 172.25.2.130 is not associated with instance 11396321-8b48-4627-858e-90aabfbe0432. Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '11396321-8b48-4627-858e-90aabfbe0432', 'body': {'removeFloatingIp': {'address': '172.25.2.130'}}} Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.130 is not associated with instance 11396321-8b48-4627-858e-90aabfbe0432. Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:11.861706 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:11.864091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:11.864091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:11.864091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:11.864091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:11.864091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.130 is not associated with instance 11396321-8b48-4627-858e-90aabfbe0432. Oct 17 15:26:11.864091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:11.866299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Returning 409 to user: Floating IP 172.25.2.130 is not associated with instance 11396321-8b48-4627-858e-90aabfbe0432. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:11.867938 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c6665aa-b064-4a61-aa8f-16f3621f288e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "POST /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432/action" status: 409 len: 146 microversion: 2.1 time: 0.962115 Oct 17 15:26:11.869016 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 622/1165] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:10 2022] POST /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432/action => generated 146 bytes in 963 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:26:11.889392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:11.891063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:11.907190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.907690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.908126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:11.908837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:11.909289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:11.909735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.395432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:12.404771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59d95c4c-82b0-49c7-8f7a-155fae740302 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1470 microversion: 2.1 time: 0.534107 Oct 17 15:26:12.405366 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 623/1166] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:11 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1470 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:12.411327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:12.412082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:12.418338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.418752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.419902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.420809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.421414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.422181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.426706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:12.436382 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-224de1a1-27e7-43e3-bd8a-8a23fc0c64c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1575 microversion: 2.1 time: 0.862343 Oct 17 15:26:12.437997 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 544/1167] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:11 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1575 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:12.444191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1ccd4be4-27d2-410e-88ac-89d66553e650 req-4d5e3a03-11eb-4163-ae87-cfdeed11a61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f2d90a-2839-4199-87db-d5739abf33a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f4f8835c-e978-4278-9cc8-bcb8389538d7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:12.455729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1ccd4be4-27d2-410e-88ac-89d66553e650 req-4d5e3a03-11eb-4163-ae87-cfdeed11a61b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.456632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1ccd4be4-27d2-410e-88ac-89d66553e650 req-4d5e3a03-11eb-4163-ae87-cfdeed11a61b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.457270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1ccd4be4-27d2-410e-88ac-89d66553e650 req-4d5e3a03-11eb-4163-ae87-cfdeed11a61b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.470570 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1ccd4be4-27d2-410e-88ac-89d66553e650 req-4d5e3a03-11eb-4163-ae87-cfdeed11a61b service nova] Creating event network-vif-unplugged:f4f8835c-e978-4278-9cc8-bcb8389538d7 for instance b4f2d90a-2839-4199-87db-d5739abf33a8 on n-h2-854441-12 Oct 17 15:26:12.477034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-1ccd4be4-27d2-410e-88ac-89d66553e650 req-4d5e3a03-11eb-4163-ae87-cfdeed11a61b service nova] Instance b4f2d90a-2839-4199-87db-d5739abf33a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:26:12.483923 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1ccd4be4-27d2-410e-88ac-89d66553e650 req-4d5e3a03-11eb-4163-ae87-cfdeed11a61b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044393 Oct 17 15:26:12.485182 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 545/1168] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:12.491447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.130"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:12.509307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:12.517715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:12.519230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:12.524781 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c151191e-e856-4168-aea2-07f403a1bda8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.118238 Oct 17 15:26:12.525894 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 624/1169] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:12 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:12.530930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:12.531845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:12.539466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.540204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.540784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.541643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.542242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.542833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.547691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:12.698933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:12.709065 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e60e7adf-74d9-47c6-be7e-beb3ce0d565d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.181893 Oct 17 15:26:12.710035 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 625/1170] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:12 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:12.732816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:12.733446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:12.741416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.742028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.742619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.743418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.743955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.744612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.789503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.790119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.790763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.791687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.792238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.792758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.817722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:26:12.823342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for user 5ec3b5fbeafd47558718a7a9638d0c9e and project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:26:12.825742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:12.837320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:12.844135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.844900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.845424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.855966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.856948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.857491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.941844 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a28bf8bd-dce3-4752-a910-88b6de1885fa tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8/action" status: 202 len: 0 microversion: 2.1 time: 0.215794 Oct 17 15:26:12.943062 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 626/1171] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:12 2022] POST /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:12.953721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:12.954897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:12.962977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.963492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.963952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:12.964741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:12.965239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:12.965625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:13.152863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:13.177529 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d103cbbf-1871-4c3e-8ca6-44e8188cb155 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1308 microversion: 2.1 time: 0.233085 Oct 17 15:26:13.178662 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 627/1172] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:12 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:13.185929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-341365d6-df1d-4e87-be97-4eae6039eb2b req-0922574b-33c6-4d5d-97d4-9b13d591e973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c128f7c3-d3e6-4664-979e-e424581346e1", "tag": "0ae18c17-0b0d-49c1-8d85-94306923e42f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:13.199386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-341365d6-df1d-4e87-be97-4eae6039eb2b req-0922574b-33c6-4d5d-97d4-9b13d591e973 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:13.199864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-341365d6-df1d-4e87-be97-4eae6039eb2b req-0922574b-33c6-4d5d-97d4-9b13d591e973 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:13.200288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-341365d6-df1d-4e87-be97-4eae6039eb2b req-0922574b-33c6-4d5d-97d4-9b13d591e973 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:13.213666 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-341365d6-df1d-4e87-be97-4eae6039eb2b req-0922574b-33c6-4d5d-97d4-9b13d591e973 service nova] Creating event network-changed:0ae18c17-0b0d-49c1-8d85-94306923e42f for instance c128f7c3-d3e6-4664-979e-e424581346e1 on n-h1-854441-12 Oct 17 15:26:13.219728 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-341365d6-df1d-4e87-be97-4eae6039eb2b req-0922574b-33c6-4d5d-97d4-9b13d591e973 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039526 Oct 17 15:26:13.220212 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 628/1173] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:13.226887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:13.227593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:13.235232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:13.235937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:13.236562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:13.237442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:13.238009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:13.238446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:13.381056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "refresh_cache-3e37b74a-df57-4e6a-ba1c-cd631111d114" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:26:13.381745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquired lock "refresh_cache-3e37b74a-df57-4e6a-ba1c-cd631111d114" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:26:13.576066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:13.589418 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c43b8b4-1842-498b-92dd-7a9ad63b07be tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.367165 Oct 17 15:26:13.590096 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 629/1174] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:13 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:13.599548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:13.600339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:13.611073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:13.611645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:13.612148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:13.612981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:13.614432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:13.614984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:13.642089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:26:13.736318 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c3df8e1-dae8-476f-af03-5da7709a1665 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 204 len: 0 microversion: 2.1 time: 0.143621 Oct 17 15:26:13.737791 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 630/1175] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:13 2022] DELETE /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:26:13.745094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:13.746241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:13.753437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:13.753930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:13.754376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:13.755297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:13.755917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:13.756352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:13.979135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:13.987017 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-796286c4-8b5b-426c-a105-1d4e8c0a3f86 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1575 microversion: 2.1 time: 0.247477 Oct 17 15:26:13.987599 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 631/1176] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:13 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:13.992504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:13.993316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:13.999432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.000158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.000774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.001653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.002257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.002934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.067075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:14.075380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:14.076818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:14.081709 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ea0f852-dac6-41de-a573-86b741158860 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.093020 Oct 17 15:26:14.082288 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 632/1177] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:13 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:14.086878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:14.087467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:14.093853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.094358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.096212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.096957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.097565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.097924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.132316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Building network info cache for instance {{(pid=120407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:26:14.261741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:14.270413 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83e1e5b6-f589-4a16-8109-22b133e5264d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.187026 Oct 17 15:26:14.275066 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 633/1178] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:14 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:14.280337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:14.281265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:14.288832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.289448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.289957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.291198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.291893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.292445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.432854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:14.443610 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3446096a-57c0-4bb3-bfad-306e1986787a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1714 microversion: 2.1 time: 0.167197 Oct 17 15:26:14.444863 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 634/1179] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:14 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1714 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:14.454017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9fcb387c-392d-4f9b-9f8b-403ae10293d2 req-b9526aa3-21d7-475d-b64b-0368b3e9b822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e37b74a-df57-4e6a-ba1c-cd631111d114", "tag": "73104619-ab2a-4f83-8519-6b2bb6caad29"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:14.467766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fcb387c-392d-4f9b-9f8b-403ae10293d2 req-b9526aa3-21d7-475d-b64b-0368b3e9b822 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.468745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fcb387c-392d-4f9b-9f8b-403ae10293d2 req-b9526aa3-21d7-475d-b64b-0368b3e9b822 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.469259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fcb387c-392d-4f9b-9f8b-403ae10293d2 req-b9526aa3-21d7-475d-b64b-0368b3e9b822 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.483473 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9fcb387c-392d-4f9b-9f8b-403ae10293d2 req-b9526aa3-21d7-475d-b64b-0368b3e9b822 service nova] Creating event network-changed:73104619-ab2a-4f83-8519-6b2bb6caad29 for instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 on n-h2-854441-12 Oct 17 15:26:14.489956 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9fcb387c-392d-4f9b-9f8b-403ae10293d2 req-b9526aa3-21d7-475d-b64b-0368b3e9b822 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044097 Oct 17 15:26:14.490749 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 635/1180] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:14.496113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:14.497137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:14.503867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.504596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.505118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.505996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.506607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.507112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.665377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:14.676054 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1ed158f-6349-468d-b197-4cfbd66c1177 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1308 microversion: 2.1 time: 0.184028 Oct 17 15:26:14.676968 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 636/1181] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:14 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:14.681524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:14.682131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:14.688172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.688655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.689070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.689755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.690207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.690768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.835174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:14.843688 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cfdef30-3297-4e71-bf7f-5b7523b935bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.165777 Oct 17 15:26:14.844386 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 637/1182] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:14 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:14.897013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Updating instance_info_cache with network_info: [{"id": "73104619-ab2a-4f83-8519-6b2bb6caad29", "address": "fa:16:3e:bf:f2:68", "network": {"id": "2243e6e3-9d81-48b1-bb5b-6d70da2406ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1589788987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d43225ce4f724468800718eed544b111", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap73104619-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:26:14.909791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Releasing lock "refresh_cache-3e37b74a-df57-4e6a-ba1c-cd631111d114" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:26:14.910864 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b7db16a2-5cdf-43cb-bc0a-470ba40d94eb tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "POST /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114/action" status: 202 len: 0 microversion: 2.1 time: 2.424238 Oct 17 15:26:14.911322 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 546/1183] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:12 2022] POST /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114/action => generated 0 bytes in 2425 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 15:26:14.919714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:14.920312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:14.926624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.927205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.927704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.928460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.928981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.929474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:14.946256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:14.959889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:26:14.986091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d70d5724-3f3a-4074-9ce6-2f8ddc155389 req-9abe7701-b17c-4e8c-a2b2-0d402034237e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef56e60-7257-4eb3-82e1-bef0667ed073", "name": "network-vif-plugged", "status": "completed", "tag": "a37c0ce3-a016-4e5d-963c-bb23a0c4f78b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:14.996358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d70d5724-3f3a-4074-9ce6-2f8ddc155389 req-9abe7701-b17c-4e8c-a2b2-0d402034237e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:14.997091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d70d5724-3f3a-4074-9ce6-2f8ddc155389 req-9abe7701-b17c-4e8c-a2b2-0d402034237e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:14.997511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d70d5724-3f3a-4074-9ce6-2f8ddc155389 req-9abe7701-b17c-4e8c-a2b2-0d402034237e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.011367 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d70d5724-3f3a-4074-9ce6-2f8ddc155389 req-9abe7701-b17c-4e8c-a2b2-0d402034237e service nova] Creating event network-vif-plugged:a37c0ce3-a016-4e5d-963c-bb23a0c4f78b for instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 on n-h1-854441-12 Oct 17 15:26:15.016527 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d70d5724-3f3a-4074-9ce6-2f8ddc155389 req-9abe7701-b17c-4e8c-a2b2-0d402034237e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034281 Oct 17 15:26:15.017616 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 547/1184] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:26:15.023901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:15.024732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:15.031681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.032166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.032925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.033594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.034225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.034663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.039305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:15.058587 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ca71456-8f1f-4918-94f5-6ed7155c32b0 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 204 len: 0 microversion: 2.1 time: 0.142318 Oct 17 15:26:15.059376 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 638/1185] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:14 2022] DELETE /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:26:15.074903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.130"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:15.077678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:15.085796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.086554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.087263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.088252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.088812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.089343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.121999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "refresh_cache-11396321-8b48-4627-858e-90aabfbe0432" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:26:15.122834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquired lock "refresh_cache-11396321-8b48-4627-858e-90aabfbe0432" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:26:15.199368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:15.215007 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba9306a1-3ffd-45e8-873c-484c363f62a1 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1575 microversion: 2.1 time: 0.195842 Oct 17 15:26:15.230522 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 548/1186] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:15 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:15.237093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:15.237940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:15.245310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.246319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.246886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.248279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.248405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.248932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.320210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:15.329700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:15.331549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:15.338096 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8381980f-65a2-4bc2-9453-e1415064fd44 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.106214 Oct 17 15:26:15.350185 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 549/1187] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:15 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:15.350185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:15.350185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:15.356113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.356701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.357343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.358104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.358746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.359192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.498319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:15.506809 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f45250c4-ae30-46e9-b766-9c2b27294fea tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.165437 Oct 17 15:26:15.507412 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 550/1188] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:15 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:15.513360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:15.514234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:15.522195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.523111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.523758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.524475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.524925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.525523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.670770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:15.682061 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-124593d8-e2f2-4e90-b9f2-bccff0320bf2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1714 microversion: 2.1 time: 0.172379 Oct 17 15:26:15.684517 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 551/1189] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:15 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1714 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:15.701818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:15.702534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:15.709316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.709804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.710789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.710973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.711803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.711803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.849285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:15.857466 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9bd80645-f456-4b76-b85a-b98170833c58 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1308 microversion: 2.1 time: 0.159652 Oct 17 15:26:15.858067 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 552/1190] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:15 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:15.866875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:15.867584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:15.875248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.875826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.876324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:15.877121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:15.877656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:15.878149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.015496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:16.023588 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-975e7f58-71d7-4509-adc6-3b706b4d3a47 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.160707 Oct 17 15:26:16.024139 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 553/1191] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:15 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:16.240285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:16.240958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:16.247517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.248009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.248485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.249192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.249638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.250070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.393271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:16.402186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bb886e19-0a79-40cf-ad1b-f4ea0b4a98da tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1575 microversion: 2.1 time: 0.165955 Oct 17 15:26:16.402901 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 554/1192] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:16 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:16.407438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:16.408061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:16.414170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.414737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.415170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.415860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.416286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.416714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.480905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:16.489720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:16.491251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:16.496239 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5e126327-145c-4079-a7a1-7f0d1ea2d250 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.092383 Oct 17 15:26:16.496802 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 555/1193] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:16 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:16.530426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:16.531064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:16.537389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.537884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.538311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.539152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.539686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.540089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.684924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:16.693517 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1ed69963-0493-4464-8bb2-bbd8237ad648 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1318 microversion: 2.1 time: 0.166896 Oct 17 15:26:16.694537 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 556/1194] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:16 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:16.710366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:16.711410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:16.719820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.720412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.720984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.721734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.722330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.722923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.856904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:16.866144 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-58f0ab51-3c11-49e4-9872-c67e6acf0ba4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1714 microversion: 2.1 time: 0.162445 Oct 17 15:26:16.867163 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 557/1195] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:16 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:16.885943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:16.888762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:16.895899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.896395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.896847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:16.897542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:16.897984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:16.898431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.028228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:17.037089 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-54dcd3b6-0958-438c-b15b-e4309205715f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1489 microversion: 2.1 time: 0.157736 Oct 17 15:26:17.037712 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 558/1196] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:16 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1489 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:17.042267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-35f61be9-b0c1-457c-9b8b-a458b162de35 req-b4c4e2f2-89d5-4821-a4ec-b5b38d5815c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f2d90a-2839-4199-87db-d5739abf33a8", "name": "network-vif-plugged", "status": "completed", "tag": "f4f8835c-e978-4278-9cc8-bcb8389538d7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:17.052511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-35f61be9-b0c1-457c-9b8b-a458b162de35 req-b4c4e2f2-89d5-4821-a4ec-b5b38d5815c6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.053083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-35f61be9-b0c1-457c-9b8b-a458b162de35 req-b4c4e2f2-89d5-4821-a4ec-b5b38d5815c6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.053734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-35f61be9-b0c1-457c-9b8b-a458b162de35 req-b4c4e2f2-89d5-4821-a4ec-b5b38d5815c6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.067988 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-35f61be9-b0c1-457c-9b8b-a458b162de35 req-b4c4e2f2-89d5-4821-a4ec-b5b38d5815c6 service nova] Creating event network-vif-plugged:f4f8835c-e978-4278-9cc8-bcb8389538d7 for instance b4f2d90a-2839-4199-87db-d5739abf33a8 on n-h2-854441-12 Oct 17 15:26:17.074115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-35f61be9-b0c1-457c-9b8b-a458b162de35 req-b4c4e2f2-89d5-4821-a4ec-b5b38d5815c6 service nova] Instance b4f2d90a-2839-4199-87db-d5739abf33a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:26:17.080721 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-35f61be9-b0c1-457c-9b8b-a458b162de35 req-b4c4e2f2-89d5-4821-a4ec-b5b38d5815c6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041767 Oct 17 15:26:17.081543 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 559/1197] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:17.087015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:17.087437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:17.094142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.094696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.095290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.096110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.096474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.096900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.273733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Building network info cache for instance {{(pid=120406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:26:17.633021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:17.641912 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9e021233-4e8f-4f4e-a192-64ee709981ea tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.559406 Oct 17 15:26:17.642823 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 560/1198] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:17 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:17.663288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b76eb5d6-3395-4138-a3db-79706583aff0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:17.663825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b76eb5d6-3395-4138-a3db-79706583aff0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:17.669895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b76eb5d6-3395-4138-a3db-79706583aff0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.670471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b76eb5d6-3395-4138-a3db-79706583aff0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.671111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b76eb5d6-3395-4138-a3db-79706583aff0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.671811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b76eb5d6-3395-4138-a3db-79706583aff0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.672440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b76eb5d6-3395-4138-a3db-79706583aff0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.673020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b76eb5d6-3395-4138-a3db-79706583aff0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.746044 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b76eb5d6-3395-4138-a3db-79706583aff0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073/action" status: 202 len: 0 microversion: 2.1 time: 0.089959 Oct 17 15:26:17.749838 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 561/1199] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:17 2022] POST /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:17.754533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a9b0b25b-8556-4015-9e49-fac1315e43d8 req-da0bba3e-0915-4965-99ba-38a4afbe173b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11396321-8b48-4627-858e-90aabfbe0432", "tag": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:17.765810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a9b0b25b-8556-4015-9e49-fac1315e43d8 req-da0bba3e-0915-4965-99ba-38a4afbe173b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.766292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a9b0b25b-8556-4015-9e49-fac1315e43d8 req-da0bba3e-0915-4965-99ba-38a4afbe173b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.766915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a9b0b25b-8556-4015-9e49-fac1315e43d8 req-da0bba3e-0915-4965-99ba-38a4afbe173b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.783630 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a9b0b25b-8556-4015-9e49-fac1315e43d8 req-da0bba3e-0915-4965-99ba-38a4afbe173b service nova] Creating event network-changed:ad6d955f-b8f4-4902-bca5-a5ef16b95dbe for instance 11396321-8b48-4627-858e-90aabfbe0432 on n-h1-854441-12 Oct 17 15:26:17.789537 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a9b0b25b-8556-4015-9e49-fac1315e43d8 req-da0bba3e-0915-4965-99ba-38a4afbe173b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040858 Oct 17 15:26:17.791059 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 562/1200] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:17.796327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:17.797025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:17.805925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.806433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.806900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.807611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.808064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.808477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.850326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Updating instance_info_cache with network_info: [{"id": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe", "address": "fa:16:3e:fe:10:0b", "network": {"id": "2243e6e3-9d81-48b1-bb5b-6d70da2406ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1589788987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d43225ce4f724468800718eed544b111", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad6d955f-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:26:17.868521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Releasing lock "refresh_cache-11396321-8b48-4627-858e-90aabfbe0432" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:26:17.870473 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60d94810-d36a-4af4-a38f-99f22bbbc3e3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "POST /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432/action" status: 202 len: 0 microversion: 2.1 time: 2.800354 Oct 17 15:26:17.872518 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 639/1201] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:15 2022] POST /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432/action => generated 0 bytes in 2803 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 15:26:17.883306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:17.884160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:17.895202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.895986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.896416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.897109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.897551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.897967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.974917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:17.977744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:17.983896 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0771d1ac-bd59-49c2-9a19-75427afd2798 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1575 microversion: 2.1 time: 0.191542 Oct 17 15:26:17.984495 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 563/1202] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:17 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:17.987863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:17.989761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:17.989889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:17.990371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:17.998179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:17.998713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:17.999147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:17.999856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.000308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.000729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.008153 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18b58d3e-5110-40db-b442-b9e8c559a0f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.133443 Oct 17 15:26:18.009440 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 640/1203] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:17 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:18.014913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:18.015694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:18.022554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.023648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.024187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.025120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.025597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.026169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.198852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:18.202769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:18.208595 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1e503121-1b7b-4772-bf26-95ba09fed478 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1468 microversion: 2.1 time: 0.223058 Oct 17 15:26:18.209474 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 564/1204] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:17 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1468 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:18.214202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c8ea6372-3b1a-4534-82a9-4813609adc80 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '.version_select at 0x7f28bed5a550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:18.258824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:18.272814 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31119eac-53e2-4454-a9ba-6aa7036e04b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1494 microversion: 2.1 time: 0.262021 Oct 17 15:26:18.273554 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 641/1205] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:18 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1494 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:18.278726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:18.280128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:18.289230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.291951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.291951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.292339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.292654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.293142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.433205 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c8ea6372-3b1a-4534-82a9-4813609adc80 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/os-floating-ips/4a85c55f-c599-4a9b-92de-0322580fdd9a" status: 200 len: 184 microversion: 2.1 time: 0.222644 Oct 17 15:26:18.434554 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 565/1206] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:26:18 2022] GET /compute/v2.1/os-floating-ips/4a85c55f-c599-4a9b-92de-0322580fdd9a => generated 184 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:18.439371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:18.439985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 99ca326f-588c-4823-97b0-0bde70fc9435] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:18.455538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.456030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.456773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.457666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.458274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.459502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.523082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:18.532774 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-deddd326-95d4-4d74-9189-eb51ca83eb6e tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1714 microversion: 2.1 time: 0.257939 Oct 17 15:26:18.533668 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 642/1207] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:18 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1714 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:18.554358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.130"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:18.626090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:18.635372 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-54ef533c-8f22-4d47-bc2c-a03019b4bb49 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435" status: 200 len: 1467 microversion: 2.1 time: 0.199669 Oct 17 15:26:18.635976 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 566/1208] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:18 2022] GET /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435 => generated 1467 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:18.658466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:18.663818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:18.664703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Searching by: {'reservation_id': 'r-r2i8adp3', 'deleted': False, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:26:18.667752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:18.671425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.671885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.672310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.673017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.673469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.673879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.773515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:26:18.847303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:18.855128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.855610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.856030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.977801 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b212107e-d08b-418d-80e2-59e89244e694 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/detail?reservation_id=r-r2i8adp3" status: 200 len: 2928 microversion: 2.1 time: 0.323354 Oct 17 15:26:18.978708 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 567/1209] 10.222.0.87 () {58 vars in 1197 bytes} [Mon Oct 17 15:26:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-r2i8adp3 => generated 2928 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:18.984485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:18.985209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:18.991573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.992066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.992501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:18.993197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:18.993646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:18.994063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.001592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:19.008346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.008847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.009274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.009978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.010432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.011327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.133197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:19.141165 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6b44153-dc15-4ce2-a94f-cb64eabdf14f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.160538 Oct 17 15:26:19.141956 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 568/1210] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:18 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:19.146324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fd2c89a-1b8c-42f4-a4cd-0d8c19596129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:19.170888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.compute.server_groups [None req-1fd2c89a-1b8c-42f4-a4cd-0d8c19596129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Querying cell 4ec06080-01b5-4793-9448-66de7d08c56d(cell1) for 2 instances {{(pid=120407) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 15:26:19.171505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd2c89a-1b8c-42f4-a4cd-0d8c19596129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.171981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd2c89a-1b8c-42f4-a4cd-0d8c19596129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.172411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd2c89a-1b8c-42f4-a4cd-0d8c19596129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.202433 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1fd2c89a-1b8c-42f4-a4cd-0d8c19596129 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups/720fd1e6-01a7-4eda-bb49-505213e1e3d1" status: 200 len: 271 microversion: 2.1 time: 0.059610 Oct 17 15:26:19.203057 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 569/1211] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:26:19 2022] GET /compute/v2.1/os-server-groups/720fd1e6-01a7-4eda-bb49-505213e1e3d1 => generated 271 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:19.209374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:19.209374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:19.214143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.214659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.215092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.215786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.216229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.216627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.218699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "refresh_cache-11396321-8b48-4627-858e-90aabfbe0432" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:26:19.219441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquired lock "refresh_cache-11396321-8b48-4627-858e-90aabfbe0432" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:26:19.369295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:19.377461 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1d170970-765e-4284-a700-1d6993b549f5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1575 microversion: 2.1 time: 0.173437 Oct 17 15:26:19.378045 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 570/1212] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:19 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:19.383306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:19.383916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:19.389857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.390322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.390789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.391491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.391948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.392376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.460012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:19.467253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:19.468646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:19.473811 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c08c49b5-82e3-4e7f-a30b-ded047939480 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.094650 Oct 17 15:26:19.474375 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 571/1213] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:19 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:19.478600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6af7e25f-8f34-449b-81c3-4e342e836c2d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:19.479190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6af7e25f-8f34-449b-81c3-4e342e836c2d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:19.485591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af7e25f-8f34-449b-81c3-4e342e836c2d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.486065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af7e25f-8f34-449b-81c3-4e342e836c2d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.486534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af7e25f-8f34-449b-81c3-4e342e836c2d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.487228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af7e25f-8f34-449b-81c3-4e342e836c2d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.487747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af7e25f-8f34-449b-81c3-4e342e836c2d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.488168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af7e25f-8f34-449b-81c3-4e342e836c2d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.620976 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6af7e25f-8f34-449b-81c3-4e342e836c2d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1621 microversion: 2.1 time: 0.145489 Oct 17 15:26:19.621566 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 572/1214] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:19 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1621 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:19.625986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:19.626697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:19.633190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.633667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.634099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.634818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.635279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.635733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.766667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:19.775383 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b0733a9a-5a75-463e-8b63-8573067b61d9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 200 len: 1474 microversion: 2.1 time: 0.152746 Oct 17 15:26:19.775999 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 573/1215] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:19 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 1474 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:19.780724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:19.781325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:19.787381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.787882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.788307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.788987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.789451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.789863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.867260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Building network info cache for instance {{(pid=120406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:26:19.939201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:19.955961 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-735ab047-00ab-472b-a1d4-e27afc0ce29a tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1714 microversion: 2.1 time: 0.178745 Oct 17 15:26:19.972862 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 574/1216] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:19 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1714 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:19.977792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5e0a9e51-9a40-4381-bec3-ed7a85ed3f7b tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:19.978519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5e0a9e51-9a40-4381-bec3-ed7a85ed3f7b tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] [instance: 99ca326f-588c-4823-97b0-0bde70fc9435] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:19.984715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e0a9e51-9a40-4381-bec3-ed7a85ed3f7b tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.985341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e0a9e51-9a40-4381-bec3-ed7a85ed3f7b tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.985898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e0a9e51-9a40-4381-bec3-ed7a85ed3f7b tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:19.987122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e0a9e51-9a40-4381-bec3-ed7a85ed3f7b tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:19.987248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e0a9e51-9a40-4381-bec3-ed7a85ed3f7b tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:19.988093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e0a9e51-9a40-4381-bec3-ed7a85ed3f7b tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:20.233624 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5e0a9e51-9a40-4381-bec3-ed7a85ed3f7b tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435" status: 200 len: 1620 microversion: 2.1 time: 0.259438 Oct 17 15:26:20.247092 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 575/1217] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:19 2022] GET /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435 => generated 1620 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:20.265075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a5f9f99b-d105-43c3-ad55-b0c3218d6d31 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1019930798"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:20.267549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a5f9f99b-d105-43c3-ad55-b0c3218d6d31 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:20.275292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5f9f99b-d105-43c3-ad55-b0c3218d6d31 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:20.275788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5f9f99b-d105-43c3-ad55-b0c3218d6d31 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:20.276224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5f9f99b-d105-43c3-ad55-b0c3218d6d31 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:20.276934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5f9f99b-d105-43c3-ad55-b0c3218d6d31 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:20.277385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5f9f99b-d105-43c3-ad55-b0c3218d6d31 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:20.277814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5f9f99b-d105-43c3-ad55-b0c3218d6d31 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:20.545926 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a5f9f99b-d105-43c3-ad55-b0c3218d6d31 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073/action" status: 202 len: 0 microversion: 2.1 time: 0.297390 Oct 17 15:26:20.547941 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 576/1218] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:20 2022] POST /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:26:20.556085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-6460fb4e-e05c-45d2-8e38-903c8b960aba req-e1d35b76-e458-4581-a864-ea62feb57b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11396321-8b48-4627-858e-90aabfbe0432", "tag": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:20.569219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6460fb4e-e05c-45d2-8e38-903c8b960aba req-e1d35b76-e458-4581-a864-ea62feb57b3d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:20.570208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6460fb4e-e05c-45d2-8e38-903c8b960aba req-e1d35b76-e458-4581-a864-ea62feb57b3d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:20.571274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6460fb4e-e05c-45d2-8e38-903c8b960aba req-e1d35b76-e458-4581-a864-ea62feb57b3d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:20.604923 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-6460fb4e-e05c-45d2-8e38-903c8b960aba req-e1d35b76-e458-4581-a864-ea62feb57b3d service nova] Creating event network-changed:ad6d955f-b8f4-4902-bca5-a5ef16b95dbe for instance 11396321-8b48-4627-858e-90aabfbe0432 on n-h1-854441-12 Oct 17 15:26:20.616964 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-6460fb4e-e05c-45d2-8e38-903c8b960aba req-e1d35b76-e458-4581-a864-ea62feb57b3d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064455 Oct 17 15:26:20.617839 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 577/1219] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:20.623240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:20.623944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:20.635803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:20.636486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:20.636730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:20.637446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:20.637894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:20.638471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:20.909895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Updating instance_info_cache with network_info: [{"id": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe", "address": "fa:16:3e:fe:10:0b", "network": {"id": "2243e6e3-9d81-48b1-bb5b-6d70da2406ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1589788987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d43225ce4f724468800718eed544b111", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad6d955f-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:26:20.931480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Releasing lock "refresh_cache-11396321-8b48-4627-858e-90aabfbe0432" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:26:20.932374 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da55aeed-0f55-49d0-a540-4b659e081095 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "POST /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432/action" status: 202 len: 0 microversion: 2.1 time: 2.386033 Oct 17 15:26:20.934137 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 643/1220] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:18 2022] POST /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432/action => generated 0 bytes in 2388 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 15:26:20.943294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:20.943935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:20.954149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:20.954804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:20.955255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:20.956315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:20.956962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:20.957827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:21.058349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:21.070974 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-433b55a7-0a0f-4f56-b4b9-a640d05d3aa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.452015 Oct 17 15:26:21.072372 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 578/1221] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:20 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:21.077718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-660236674", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "e21af96d-b24a-454b-bc29-715bd73d273b"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:21.150536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:26:21.452331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:21.471444 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed647946-7b98-469c-80b3-8d8db26f5139 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1575 microversion: 2.1 time: 0.533157 Oct 17 15:26:21.488032 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 644/1222] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:20 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1575 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:21.498121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:21.499205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:21.507935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:21.508984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:21.509993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:21.511740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:21.512479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:21.517020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:21.603058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:26:21.603483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:26:21.603935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:26:21.604328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:26:21.605002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:26:21.619399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:21.619935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:21.620851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:21.621730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:21.622278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:21.622728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:21.643488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:26:21.649114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:26:21.662101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:26:21.664521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:26:21.679011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:21.689316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:21.691118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:21.698654 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-999d7d48-20e0-44b3-a82f-f8f56caf8cc0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.206040 Oct 17 15:26:21.699833 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 645/1223] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:21 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:21.723301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b47783c5-ed18-46e3-a164-b37e33654533 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be993ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:21.755545 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fddfd18e-6332-43de-b717-b356a0477aa7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681466 Oct 17 15:26:21.756743 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 579/1224] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:26:21.765503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:21.766102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:21.774895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:21.776176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:21.777185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:21.787813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:21.788513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:21.794620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:21.799469 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b47783c5-ed18-46e3-a164-b37e33654533 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1414 microversion: 2.1 time: 0.098245 Oct 17 15:26:21.800949 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 646/1225] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:21 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:21.807624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:21.809070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:21.815525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:21.816533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:21.817251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:21.818110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:21.818736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:21.819306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:21.842918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:26:21.902548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:21.908940 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.api [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Instance is already in deleting state, ignoring this request Oct 17 15:26:21.910226 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f677d57e-21b0-43e3-a84d-15b0f05df5fd tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 204 len: 0 microversion: 2.1 time: 0.151196 Oct 17 15:26:21.914780 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 580/1226] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:21 2022] DELETE /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:26:21.918372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-528b702c-da08-423f-ad63-0d1697e92a85 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:21.919257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-528b702c-da08-423f-ad63-0d1697e92a85 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:21.984703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-528b702c-da08-423f-ad63-0d1697e92a85 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:21.994813 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-528b702c-da08-423f-ad63-0d1697e92a85 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1216 microversion: 2.1 time: 0.081931 Oct 17 15:26:21.996241 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 581/1227] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:21 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:22.003419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:22.004496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:22.012314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:22.012949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:22.013564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:22.014487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:22.015064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:22.015583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:22.162264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:22.173366 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ccfb3341-f6e6-4ab5-87ff-a17b926f9c1e tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1645 microversion: 2.1 time: 0.175774 Oct 17 15:26:22.174192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 582/1228] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:21 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1645 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:22.179463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:22.180164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:22.189846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:22.190359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:22.190902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:22.191621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:22.192116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:22.192529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:22.264668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:22.279649 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73be975a-8686-4d9d-beed-6b4b3aae1ca5 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1646 microversion: 2.1 time: 0.477407 Oct 17 15:26:22.283015 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 647/1229] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:21 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1646 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:22.373108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:22.381804 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-51e7a71f-a557-4b1a-ac31-e4ea208e46ad tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.206236 Oct 17 15:26:22.383039 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 583/1230] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:22 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:22.501886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:22.503236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:22.510278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:22.510802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:22.511402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:22.512302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:22.512752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:22.513337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:22.672162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-6460e78b-8977-41cc-a681-2614c9899005 req-859e4d72-7c1e-4680-9064-1ceae70e4701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e37b74a-df57-4e6a-ba1c-cd631111d114", "name": "network-vif-deleted", "tag": "73104619-ab2a-4f83-8519-6b2bb6caad29"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:22.684006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6460e78b-8977-41cc-a681-2614c9899005 req-859e4d72-7c1e-4680-9064-1ceae70e4701 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:22.684485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6460e78b-8977-41cc-a681-2614c9899005 req-859e4d72-7c1e-4680-9064-1ceae70e4701 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:22.685235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6460e78b-8977-41cc-a681-2614c9899005 req-859e4d72-7c1e-4680-9064-1ceae70e4701 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:22.698919 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-6460e78b-8977-41cc-a681-2614c9899005 req-859e4d72-7c1e-4680-9064-1ceae70e4701 service nova] Creating event network-vif-deleted:73104619-ab2a-4f83-8519-6b2bb6caad29 for instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 on n-h2-854441-12 Oct 17 15:26:22.707951 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-6460e78b-8977-41cc-a681-2614c9899005 req-859e4d72-7c1e-4680-9064-1ceae70e4701 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039850 Oct 17 15:26:22.708913 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 584/1231] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:26:22.730306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:22.731329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:22.738107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:22.738782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:22.739615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:22.740610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:22.741314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:22.741829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:22.760158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:22.769387 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcad39f2-852a-4ab6-9040-9ff505c6340c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1575 microversion: 2.1 time: 0.271414 Oct 17 15:26:22.772241 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 648/1232] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:22 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1575 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:22.815814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cac99cdf-8e58-4151-850e-f5636329ea64 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be9f9ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:22.821799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:22.825168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:22.835884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:22.837332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:22.842346 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5f20944e-26f4-45ba-bf14-1a10cfb4ff3f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.116795 Oct 17 15:26:22.843234 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 585/1233] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:22 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:26:22.870396 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cac99cdf-8e58-4151-850e-f5636329ea64 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1414 microversion: 2.1 time: 0.058571 Oct 17 15:26:22.871053 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 649/1234] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:22 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:23.019561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:23.020171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:23.027012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.027504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.027939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.028747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.029096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.029519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.090582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:23.098977 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c54c58bb-fce3-4848-b0fe-fd43bbafd663 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1220 microversion: 2.1 time: 0.083405 Oct 17 15:26:23.099739 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 586/1235] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:23 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:23.198000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:23.198832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:23.205254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.205827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.206338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.207136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.207674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.208116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.273222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:23.281517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1aa2760f-7f1d-4528-935f-8d7a3c3c6fd3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1603 microversion: 2.1 time: 0.088136 Oct 17 15:26:23.282138 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 650/1236] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:23 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1603 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:23.305859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:23.306473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:23.313549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.314111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.314672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.315436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.316025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.316514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.380045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:23.389099 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-df56e38c-accc-4c28-b69d-d3fe8d9aacde tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1646 microversion: 2.1 time: 0.087324 Oct 17 15:26:23.390023 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 587/1237] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:23 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1646 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:23.407683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:23.408309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:23.415436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.416331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.416933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.417822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.418806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.419446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.567908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:23.576028 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31ac3844-f3fc-4a21-b207-64d115160dcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.172846 Oct 17 15:26:23.576535 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 651/1238] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:23 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:23.796880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:23.798478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:23.805932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.806513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.807237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.808244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.808702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.809128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.876000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:23.877634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:23.888799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.889810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.890357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.891194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:23.891803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:23.892412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:23.961358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:23.969348 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-607a2d5d-7451-43dc-ada0-f6c0e3d3ee51 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1580 microversion: 2.1 time: 0.177743 Oct 17 15:26:23.970617 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 588/1239] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:23 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1580 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:23.974741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:23.975117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-adf739e8-ee22-4fc6-9a04-708663066e72 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bec1caf0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:23.984163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:23.985107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:23.990449 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da3f01a1-8bba-4a9f-b821-0294526388f8 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.122598 Oct 17 15:26:23.991236 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 652/1240] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:23 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:24.023869 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-adf739e8-ee22-4fc6-9a04-708663066e72 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1414 microversion: 2.1 time: 0.052239 Oct 17 15:26:24.024476 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 589/1241] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:23 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1414 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:24.121311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:24.121931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:24.128402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.128891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.129357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.130026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.130482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.130991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.198126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:24.200922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:24.209575 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74e69d41-2883-4e7f-a923-6a07e5c56ce7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1268 microversion: 2.1 time: 0.092040 Oct 17 15:26:24.210313 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 653/1242] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:24 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1268 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:24.307011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:24.307782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:24.315620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.316334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.316937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.318213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.319044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.319494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.352774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.353261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.353689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.354130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lazy-loading 'fault' on Instance uuid 3e37b74a-df57-4e6a-ba1c-cd631111d114 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:24.400513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:24.408550 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d63eca50-dd44-4486-a38a-b3a04de00181 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1314 microversion: 2.1 time: 0.106086 Oct 17 15:26:24.410065 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 590/1243] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:24 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1314 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:24.417627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:24.418400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:24.426917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.427638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.428215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.429061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.429600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.430026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.464471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.464943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.465498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.465948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lazy-loading 'fault' on Instance uuid ddbaccdf-2e7a-4036-aad1-0458d0071d3c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:24.507389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:24.516035 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1643965d-b853-4b43-afeb-804e35d16b65 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1354 microversion: 2.1 time: 0.104708 Oct 17 15:26:24.516629 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 654/1244] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:24 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:24.600182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:24.600811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:24.607297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.607752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.608116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.608784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.609375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.609798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.727228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9d412fd3-fa4c-4e99-afb6-6f79af0246b8 req-4961741a-f6a4-4ab0-84c3-23c384610d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbaccdf-2e7a-4036-aad1-0458d0071d3c", "name": "network-vif-deleted", "tag": "c4adad94-d883-47dc-a4f2-13b83f40f971"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:24.738486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9d412fd3-fa4c-4e99-afb6-6f79af0246b8 req-4961741a-f6a4-4ab0-84c3-23c384610d25 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:24.739008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9d412fd3-fa4c-4e99-afb6-6f79af0246b8 req-4961741a-f6a4-4ab0-84c3-23c384610d25 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:24.739419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9d412fd3-fa4c-4e99-afb6-6f79af0246b8 req-4961741a-f6a4-4ab0-84c3-23c384610d25 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:24.751441 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9d412fd3-fa4c-4e99-afb6-6f79af0246b8 req-4961741a-f6a4-4ab0-84c3-23c384610d25 service nova] Creating event network-vif-deleted:c4adad94-d883-47dc-a4f2-13b83f40f971 for instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c on n-h2-854441-12 Oct 17 15:26:24.757054 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9d412fd3-fa4c-4e99-afb6-6f79af0246b8 req-4961741a-f6a4-4ab0-84c3-23c384610d25 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Oct 17 15:26:24.758196 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 655/1245] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:24.767457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:24.777588 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-507a493e-cff9-4634-beb9-30a5b7a6250e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.182194 Oct 17 15:26:24.778530 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 591/1246] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:24 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:24.997926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:25.001792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:25.013559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.013559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.013559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.019047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:25.019652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:25.023260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.026837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.027639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.028079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.030561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.035942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.037321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.038445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.039178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.179237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:25.193027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:25.194605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:25.229395 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f3fd3f19-0437-4b43-9374-3cb51d358565 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.214138 Oct 17 15:26:25.234222 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 592/1247] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:25 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:25.241247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ffeec967-2590-411e-ac0a-f865ba446109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea89b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:25.319497 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ffeec967-2590-411e-ac0a-f865ba446109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1414 microversion: 2.1 time: 0.081994 Oct 17 15:26:25.320410 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 593/1248] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:25 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:25.338192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:25.338861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:25.359351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.359849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.360292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.361012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.361470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.372410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.419843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:25.436298 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ae94443-1781-42e7-b0e0-cd0fe5cbb5bb tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1573 microversion: 2.1 time: 0.438242 Oct 17 15:26:25.440696 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 656/1249] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:24 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1573 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:25.457019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:25.458067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:25.472045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.473856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.474613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.475561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.476269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.476929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.524651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.525334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.525760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.526630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lazy-loading 'fault' on Instance uuid 3e37b74a-df57-4e6a-ba1c-cd631111d114 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:25.546940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:25.563860 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6287ec96-6b02-48b6-9cba-6fd9f2baf492 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1286 microversion: 2.1 time: 0.241873 Oct 17 15:26:25.566420 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 594/1250] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:25 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1286 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:25.571868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-605456786"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:25.572637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:25.579397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.580202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.580850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.581977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.582547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.583250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.588568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:25.597963 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ad9da31-c0e9-4ab6-9062-a030edf428cc tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1314 microversion: 2.1 time: 0.153421 Oct 17 15:26:25.599221 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 657/1251] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:25 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:25.604271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:25.605209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:25.622403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.623117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.623569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.624290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.624745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.625168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.686977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.687842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.688487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.689141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lazy-loading 'fault' on Instance uuid ddbaccdf-2e7a-4036-aad1-0458d0071d3c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:25.734806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31b571ec20642bc8c31ce18fefb962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526aebb581ba4845835d901c0475af9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:25.751063 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95b99d43-2c02-42a2-bb62-23c8d5fa19d2 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 200 len: 1354 microversion: 2.1 time: 0.150314 Oct 17 15:26:25.764013 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 658/1252] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:25 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 1354 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:25.801408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:25.802020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:25.814561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.815350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.815987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.816863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:25.817464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:25.818033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:25.902369 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.network.security_group_api [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Adding security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 to port c0728835-c3dd-487d-9ae3-e25a2f9c594a Oct 17 15:26:26.034868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:26.044101 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f451cbae-3f95-4b3c-92ed-bd3cc67bc707 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 0.246616 Oct 17 15:26:26.058800 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 659/1253] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:25 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:26.269694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:26.270806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:26.280183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.281040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.281649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.282384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.282924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.283342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.355908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:26.366081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:26.367871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:26.373897 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c1ed61c-be1f-4f2c-800b-e771f5367029 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.108469 Oct 17 15:26:26.374754 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 660/1254] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:26 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:26.399591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bbd3b6cd-38ca-4005-9958-365ad2b7da41 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be9f94c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:26.450974 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bbd3b6cd-38ca-4005-9958-365ad2b7da41 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1414 microversion: 2.1 time: 0.062765 Oct 17 15:26:26.451936 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 661/1255] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:26 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:26.595906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:26.597026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:26.602635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:26.605327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.605843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.606448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.607485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.608403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.609362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.726732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:26.753536 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6010b948-80f5-4c79-8620-1cdaabdb25e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1274 microversion: 2.1 time: 0.163197 Oct 17 15:26:26.754892 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 662/1256] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:26 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:26.761141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:26.762325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:26.769197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.769965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.771470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.773108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.781075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.789489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.851117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.853130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.853612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.854074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lazy-loading 'fault' on Instance uuid 3e37b74a-df57-4e6a-ba1c-cd631111d114 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:26.907386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:26.922596 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84d93451-6cc5-4032-8995-4952a0f60e7c tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1314 microversion: 2.1 time: 0.165810 Oct 17 15:26:26.923437 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 663/1257] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:26 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:26.930162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:26.930803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:26.937651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.938082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.938536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.939231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.939674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.940087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.956630 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] HTTP exception thrown: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Request method failure captured: Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c HTTP/1.1 Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNYlHUkr1zoR-UflmSDAYFIDP4yCqluRj7_rdReXNj0oQFuMhrzK5yeTHlEnR3XYsk9x9CuHbkcX3hOgxJBfPv9p0DgS_qw72U82W5vTQoD7iC7oAB1cJGnQ1ux7FoIcTPh4-5PGRdgHPW2PgPtTH5zS3GRI8uc4zToEj-lfKddGP0 Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:26.958306 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/526aebb581ba4845835d901c0475af9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_526aebb581ba4845835d901c0475af9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a31b571ec20642bc8c31ce18fefb962c Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:26.959986 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'ddbaccdf-2e7a-4036-aad1-0458d0071d3c'} Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:26.960941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:26.962544 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:26.963927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Returning 404 to user: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:26.963927 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51e009b1-61b9-499e-99f6-6d0495130aeb tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 404 len: 111 microversion: 2.1 time: 0.035429 Oct 17 15:26:26.963927 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 664/1258] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:26 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:26.968826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:26.969320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:26.975855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.976395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.976825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.977520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:26.977965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:26.978385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:26.993067 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] HTTP exception thrown: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Request method failure captured: Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 HTTP/1.1 Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNYlHUkr1zoR-UflmSDAYFIDP4yCqluRj7_rdReXNj0oQFuMhrzK5yeTHlEnR3XYsk9x9CuHbkcX3hOgxJBfPv9p0DgS_qw72U82W5vTQoD7iC7oAB1cJGnQ1ux7FoIcTPh4-5PGRdgHPW2PgPtTH5zS3GRI8uc4zToEj-lfKddGP0 Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:26.994845 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/526aebb581ba4845835d901c0475af9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_526aebb581ba4845835d901c0475af9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a31b571ec20642bc8c31ce18fefb962c Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:26.996246 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '24c92757-4ed7-4d61-9156-4add9affe762'} Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:26.996984 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:26.999093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.001523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Returning 404 to user: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:27.001523 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15195d23-b6a1-46e9-9bc6-9ed370cfe111 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "DELETE /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 404 len: 111 microversion: 2.1 time: 0.031328 Oct 17 15:26:27.001523 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 665/1259] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:26 2022] DELETE /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:27.004878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:27.005495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:27.012082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:27.012896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:27.013023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:27.013842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:27.014584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:27.015159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:27.032456 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] HTTP exception thrown: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Request method failure captured: Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 HTTP/1.1 Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNYlHUkr1zoR-UflmSDAYFIDP4yCqluRj7_rdReXNj0oQFuMhrzK5yeTHlEnR3XYsk9x9CuHbkcX3hOgxJBfPv9p0DgS_qw72U82W5vTQoD7iC7oAB1cJGnQ1ux7FoIcTPh4-5PGRdgHPW2PgPtTH5zS3GRI8uc4zToEj-lfKddGP0 Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:27.034175 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/526aebb581ba4845835d901c0475af9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_526aebb581ba4845835d901c0475af9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a31b571ec20642bc8c31ce18fefb962c Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:27.035804 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '24c92757-4ed7-4d61-9156-4add9affe762'} Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:27.036581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:27.037901 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.040816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Returning 404 to user: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:27.040816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa53dcf3-fdeb-4db8-9e69-c1b006d1f89f tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 404 len: 111 microversion: 2.1 time: 0.034758 Oct 17 15:26:27.040816 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 666/1260] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:27 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:27.045128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-162089cc-6d2a-4c1c-bdad-dd8f9215c0b7 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '.version_select at 0x7f28be9790d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:27.075929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4cb5c662-68d4-4ed1-b2bb-4e0be7617989 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3/action" status: 202 len: 0 microversion: 2.1 time: 1.503214 Oct 17 15:26:27.075929 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 595/1261] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:26:25 2022] POST /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3/action => generated 0 bytes in 1505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:27.076580 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-162089cc-6d2a-4c1c-bdad-dd8f9215c0b7 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193477078" status: 202 len: 0 microversion: 2.1 time: 0.031900 Oct 17 15:26:27.077249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:27.077455 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 667/1262] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 15:26:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193477078 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:27.078423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:27.083046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7de30f14-12c7-4323-8fe4-c78784f56cf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28be9f9c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:27.089993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:27.094477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:27.097142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:27.100784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:27.102366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:27.102866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:27.427609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-7de30f14-12c7-4323-8fe4-c78784f56cf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 in use.", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:26:27.428314 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7de30f14-12c7-4323-8fe4-c78784f56cf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security Group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 in use. Oct 17 15:26:27.428314 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-7febc9aa-4316-4276-b74c-6cf09b8f5e50'] Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7de30f14-12c7-4323-8fe4-c78784f56cf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/0dadb4c7-7a6e-4e53-905f-4d095ec071a8 HTTP/1.1 Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:27.430348 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: exception: Security Group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 in use. Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-7febc9aa-4316-4276-b74c-6cf09b8f5e50'] Oct 17 15:26:27.432154 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '0dadb4c7-7a6e-4e53-905f-4d095ec071a8'} Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:27.433232 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 in use. Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7febc9aa-4316-4276-b74c-6cf09b8f5e50'] Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 in use. Oct 17 15:26:27.434717 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7febc9aa-4316-4276-b74c-6cf09b8f5e50'] Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 in use. Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7febc9aa-4316-4276-b74c-6cf09b8f5e50'] Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:27.436476 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 in use. Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7febc9aa-4316-4276-b74c-6cf09b8f5e50'] Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7de30f14-12c7-4323-8fe4-c78784f56cf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 400 to user: Security Group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 in use. Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-7febc9aa-4316-4276-b74c-6cf09b8f5e50'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7de30f14-12c7-4323-8fe4-c78784f56cf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/0dadb4c7-7a6e-4e53-905f-4d095ec071a8" status: 400 len: 185 microversion: 2.1 time: 0.353333 Oct 17 15:26:27.439273 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 668/1263] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:27 2022] DELETE /compute/v2.1/os-security-groups/0dadb4c7-7a6e-4e53-905f-4d095ec071a8 => generated 185 bytes in 358 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:26:27.452140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d49a9b9b-0514-46bf-a8bd-a9998ddd75b6 req-72b4cfbc-0717-4a35-9216-4434596a7a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3", "tag": "c0728835-c3dd-487d-9ae3-e25a2f9c594a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:27.483652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d49a9b9b-0514-46bf-a8bd-a9998ddd75b6 req-72b4cfbc-0717-4a35-9216-4434596a7a4c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:27.484191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d49a9b9b-0514-46bf-a8bd-a9998ddd75b6 req-72b4cfbc-0717-4a35-9216-4434596a7a4c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:27.486136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d49a9b9b-0514-46bf-a8bd-a9998ddd75b6 req-72b4cfbc-0717-4a35-9216-4434596a7a4c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:27.516093 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d49a9b9b-0514-46bf-a8bd-a9998ddd75b6 req-72b4cfbc-0717-4a35-9216-4434596a7a4c service nova] Creating event network-changed:c0728835-c3dd-487d-9ae3-e25a2f9c594a for instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 on n-h2-854441-12 Oct 17 15:26:27.531015 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d49a9b9b-0514-46bf-a8bd-a9998ddd75b6 req-72b4cfbc-0717-4a35-9216-4434596a7a4c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092730 Oct 17 15:26:27.533734 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 669/1264] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:27.570772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-826de011-1b50-47a5-909d-09b70500fac4 req-f8a218b0-e47a-4149-853c-266f02360de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef56e60-7257-4eb3-82e1-bef0667ed073", "name": "network-vif-plugged", "status": "completed", "tag": "a37c0ce3-a016-4e5d-963c-bb23a0c4f78b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:27.601914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-826de011-1b50-47a5-909d-09b70500fac4 req-f8a218b0-e47a-4149-853c-266f02360de6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:27.604421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-826de011-1b50-47a5-909d-09b70500fac4 req-f8a218b0-e47a-4149-853c-266f02360de6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:27.605233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-826de011-1b50-47a5-909d-09b70500fac4 req-f8a218b0-e47a-4149-853c-266f02360de6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:27.643528 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-826de011-1b50-47a5-909d-09b70500fac4 req-f8a218b0-e47a-4149-853c-266f02360de6 service nova] Creating event network-vif-plugged:a37c0ce3-a016-4e5d-963c-bb23a0c4f78b for instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 on n-h1-854441-12 Oct 17 15:26:27.683165 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-826de011-1b50-47a5-909d-09b70500fac4 req-f8a218b0-e47a-4149-853c-266f02360de6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135611 Oct 17 15:26:27.687793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 670/1265] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:27.708549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:27.710791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:27.718654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:27.719491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:27.720165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:27.721812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:27.722876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:27.723621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:27.956128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:27.965204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:27.973905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:27.987997 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f325b973-5649-47fd-b35b-c07ec50f50a7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1558 microversion: 2.91 time: 0.292833 Oct 17 15:26:27.989209 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 671/1266] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:27 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1558 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:27.994333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:27.999739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:28.017335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:28.021544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:28.026922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:28.029142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:28.030993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:28.036889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:28.092989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:26:28.211449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:28.224464 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5158f298-b025-41c0-bd93-51585103ae49 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1469 microversion: 2.1 time: 1.151403 Oct 17 15:26:28.242875 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 596/1267] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:27 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1469 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:28.249562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bb350e65-5f28-43f5-b922-b4faa1f3e7fd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28beb1a0d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:28.289852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-febfc549-f8c8-4202-817f-b2259c2ad84f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 204 len: 0 microversion: 2.1 time: 0.298821 Oct 17 15:26:28.295635 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 672/1268] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:27 2022] DELETE /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:26:28.304071 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bb350e65-5f28-43f5-b922-b4faa1f3e7fd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1414 microversion: 2.1 time: 0.059475 Oct 17 15:26:28.305331 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 597/1269] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:28 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:28.310284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:28.311266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:28.313037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:28.313897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:28.320168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:28.321013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:28.321681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:28.322645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:28.323679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:28.324338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:28.328832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:28.332827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:28.333454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:28.334687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:28.336426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:28.341076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:28.383104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:28.384282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:28.385325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:28.386003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lazy-loading 'fault' on Instance uuid 3e37b74a-df57-4e6a-ba1c-cd631111d114 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:28.519258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:28.531455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97aa52c3-4ce2-4931-a76e-f9cd58dcf0ea tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1314 microversion: 2.1 time: 0.224711 Oct 17 15:26:28.536390 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 598/1270] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:28 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:28.549122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:28.550628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:28.572555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:28.575998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:28.576845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:28.577806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:28.589259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:28.590655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:28.659201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:28.671004 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd36ab18-4e2d-4402-a6fc-a5c9027ea027 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1316 microversion: 2.1 time: 0.375247 Oct 17 15:26:28.673899 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 673/1271] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:28 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:28.902191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83574940-0c91-4ca6-aa6a-f281f26bc938 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:28.945330 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83574940-0c91-4ca6-aa6a-f281f26bc938 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1833926121" status: 202 len: 0 microversion: 2.1 time: 0.047439 Oct 17 15:26:28.946082 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 674/1272] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:26:28 2022] DELETE /compute/v2.1/flavors/1833926121 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:26:28.954461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-256d8a6f-6b90-4596-909b-f6482502b0b2 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.004311 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-256d8a6f-6b90-4596-909b-f6482502b0b2 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.053345 Oct 17 15:26:29.023234 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 675/1273] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:26:28 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:29.024271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.025051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:29.047786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.048411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.048959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.049920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.050566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.051072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.086117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:29.092888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:29.121865 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9f274dde-20b2-42c3-bdad-c7ba8c8fd7fa tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1647 microversion: 2.1 time: 0.568764 Oct 17 15:26:29.123238 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 599/1274] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:28 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1647 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:29.152790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-28f2d5f4-f0f7-4c12-ab4e-4b1cb7480753 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.189450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:29.193149 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-28f2d5f4-f0f7-4c12-ab4e-4b1cb7480753 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1007262630" status: 202 len: 0 microversion: 2.1 time: 0.064408 Oct 17 15:26:29.194003 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 600/1275] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:26:29 2022] DELETE /compute/v2.1/flavors/1007262630 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:29.202577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-138d4b39-9212-4caf-a3a9-1dac1af58590 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.205786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:29.208714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:29.214544 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b0f66b2-adf8-427e-be14-5348a41ca6cd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1558 microversion: 2.91 time: 0.194572 Oct 17 15:26:29.241851 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 676/1276] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:29 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:29.250846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.252017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:29.259795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.260332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.260857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.261701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.262678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.263326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.265320 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-138d4b39-9212-4caf-a3a9-1dac1af58590 tempest-ServersWithSpecificFlavorTestJSON-1301820963 tempest-ServersWithSpecificFlavorTestJSON-1301820963-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066314 Oct 17 15:26:29.265929 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 601/1277] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:26:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:29.296536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.297416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:29.312024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.312630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.314827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.315697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.316244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.316746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.359802 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] HTTP exception thrown: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Request method failure captured: Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c HTTP/1.1 Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNYlHUkr1zoR-UflmSDAYFIDP4yCqluRj7_rdReXNj0oQFuMhrzK5yeTHlEnR3XYsk9x9CuHbkcX3hOgxJBfPv9p0DgS_qw72U82W5vTQoD7iC7oAB1cJGnQ1ux7FoIcTPh4-5PGRdgHPW2PgPtTH5zS3GRI8uc4zToEj-lfKddGP0 Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:26:29.362972 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/526aebb581ba4845835d901c0475af9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_526aebb581ba4845835d901c0475af9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a31b571ec20642bc8c31ce18fefb962c Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.364754 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ddbaccdf-2e7a-4036-aad1-0458d0071d3c'} Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:29.365675 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.367377 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.370929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Returning 404 to user: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:29.372663 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-180b29a8-626a-46da-8237-495ef1a1d0a4 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 404 len: 111 microversion: 2.1 time: 0.081479 Oct 17 15:26:29.373753 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 602/1278] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:29 2022] DELETE /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:29.378701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aff9c2fc-e18e-4965-b6ad-d933e0ad3e6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28beae1af0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.478574 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aff9c2fc-e18e-4965-b6ad-d933e0ad3e6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1414 microversion: 2.1 time: 0.101838 Oct 17 15:26:29.479572 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 603/1279] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:29 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:29.485244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.485991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: ddbaccdf-2e7a-4036-aad1-0458d0071d3c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:29.497640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:29.502821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.506767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.507234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.508355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.508849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:29.510476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.515136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.520824 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f517cd41-e171-4bfb-a63a-abca9971edcf tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1535 microversion: 2.1 time: 0.275298 Oct 17 15:26:29.521633 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 677/1280] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:29 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1535 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:29.548495 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] HTTP exception thrown: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Request method failure captured: Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c HTTP/1.1 Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXNYlHUkr1zoR-UflmSDAYFIDP4yCqluRj7_rdReXNj0oQFuMhrzK5yeTHlEnR3XYsk9x9CuHbkcX3hOgxJBfPv9p0DgS_qw72U82W5vTQoD7iC7oAB1cJGnQ1ux7FoIcTPh4-5PGRdgHPW2PgPtTH5zS3GRI8uc4zToEj-lfKddGP0 Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:26:29.550662 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/526aebb581ba4845835d901c0475af9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_526aebb581ba4845835d901c0475af9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a31b571ec20642bc8c31ce18fefb962c Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.551984 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ddbaccdf-2e7a-4036-aad1-0458d0071d3c'} Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:29.552761 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. Oct 17 15:26:29.553952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.555069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Returning 404 to user: Instance ddbaccdf-2e7a-4036-aad1-0458d0071d3c could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:29.555069 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d28f091d-7b70-4141-84df-46ffed29d8b6 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c" status: 404 len: 111 microversion: 2.1 time: 0.071542 Oct 17 15:26:29.555069 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 604/1281] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:29 2022] GET /compute/v2.1/servers/ddbaccdf-2e7a-4036-aad1-0458d0071d3c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:29.561505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.562819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:29.572361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.576271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.577237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.578399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.579356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:29.580067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.582471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.583213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.594748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.604387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.605296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.606231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.606884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.607470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.613692 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] HTTP exception thrown: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Request method failure captured: Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 HTTP/1.1 Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNYlHUkr1zoR-UflmSDAYFIDP4yCqluRj7_rdReXNj0oQFuMhrzK5yeTHlEnR3XYsk9x9CuHbkcX3hOgxJBfPv9p0DgS_qw72U82W5vTQoD7iC7oAB1cJGnQ1ux7FoIcTPh4-5PGRdgHPW2PgPtTH5zS3GRI8uc4zToEj-lfKddGP0 Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:29.615686 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/526aebb581ba4845835d901c0475af9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_526aebb581ba4845835d901c0475af9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a31b571ec20642bc8c31ce18fefb962c Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.617365 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '24c92757-4ed7-4d61-9156-4add9affe762'} Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:29.618265 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.619793 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.621886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Returning 404 to user: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:29.622936 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e44b728-e072-43f8-8051-b02be02e4d96 tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "DELETE /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 404 len: 111 microversion: 2.1 time: 0.065822 Oct 17 15:26:29.623671 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 678/1282] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:29 2022] DELETE /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:29.642097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.643253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] [instance: 24c92757-4ed7-4d61-9156-4add9affe762] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:29.649034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.649528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.649960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.650314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.650484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lazy-loading 'fault' on Instance uuid 3e37b74a-df57-4e6a-ba1c-cd631111d114 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:29.650837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.651272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.652074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.652409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.652825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.672657 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] HTTP exception thrown: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Request method failure captured: Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 HTTP/1.1 Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXNYlHUkr1zoR-UflmSDAYFIDP4yCqluRj7_rdReXNj0oQFuMhrzK5yeTHlEnR3XYsk9x9CuHbkcX3hOgxJBfPv9p0DgS_qw72U82W5vTQoD7iC7oAB1cJGnQ1ux7FoIcTPh4-5PGRdgHPW2PgPtTH5zS3GRI8uc4zToEj-lfKddGP0 Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:29.675705 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/526aebb581ba4845835d901c0475af9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_526aebb581ba4845835d901c0475af9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/526aebb581ba4845835d901c0475af9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 526aebb581ba4845835d901c0475af9f Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589 Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a31b571ec20642bc8c31ce18fefb962c Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33470589-project Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.677065 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '24c92757-4ed7-4d61-9156-4add9affe762'} Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:29.677792 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. Oct 17 15:26:29.679091 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:29.681652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] Returning 404 to user: Instance 24c92757-4ed7-4d61-9156-4add9affe762 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:29.682780 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f46ed5f3-6b92-4d89-8c83-ff400442072d tempest-ServersWithSpecificFlavorTestJSON-33470589 tempest-ServersWithSpecificFlavorTestJSON-33470589-project] 10.222.0.87 "GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762" status: 404 len: 111 microversion: 2.1 time: 0.045696 Oct 17 15:26:29.683582 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 679/1283] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:29 2022] GET /compute/v2.1/servers/24c92757-4ed7-4d61-9156-4add9affe762 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:29.688943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-95027282-83ad-4099-a350-96fa8e70a29f req-104fe101-4cfe-4c04-b78b-e345c1b5b0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889fed9e-4835-4a06-ae15-bb3f4e7540dc", "tag": "b9d81cf4-99dd-44b8-ac1a-ee8c845874d7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:29.706757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-95027282-83ad-4099-a350-96fa8e70a29f req-104fe101-4cfe-4c04-b78b-e345c1b5b0e1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.707925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-95027282-83ad-4099-a350-96fa8e70a29f req-104fe101-4cfe-4c04-b78b-e345c1b5b0e1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.710372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:29.710819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-95027282-83ad-4099-a350-96fa8e70a29f req-104fe101-4cfe-4c04-b78b-e345c1b5b0e1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.719195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:29.723495 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a7294d6f-f677-4aa5-a088-3accf7edd3a4 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 200 len: 1314 microversion: 2.1 time: 0.155861 Oct 17 15:26:29.724107 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 605/1284] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:29 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:29.725566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-95027282-83ad-4099-a350-96fa8e70a29f req-104fe101-4cfe-4c04-b78b-e345c1b5b0e1 service nova] Creating event network-changed:b9d81cf4-99dd-44b8-ac1a-ee8c845874d7 for instance 889fed9e-4835-4a06-ae15-bb3f4e7540dc on n-h2-854441-12 Oct 17 15:26:29.734321 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-95027282-83ad-4099-a350-96fa8e70a29f req-104fe101-4cfe-4c04-b78b-e345c1b5b0e1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049008 Oct 17 15:26:29.739848 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 680/1285] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:29.746942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:29.747562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:29.752082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ac03aaa9-e5e9-43d7-9a05-ef2e300a153a req-59235239-a0a4-40f0-b243-e352366c0875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f2d90a-2839-4199-87db-d5739abf33a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f4f8835c-e978-4278-9cc8-bcb8389538d7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:29.763217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac03aaa9-e5e9-43d7-9a05-ef2e300a153a req-59235239-a0a4-40f0-b243-e352366c0875 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.763610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac03aaa9-e5e9-43d7-9a05-ef2e300a153a req-59235239-a0a4-40f0-b243-e352366c0875 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.764043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac03aaa9-e5e9-43d7-9a05-ef2e300a153a req-59235239-a0a4-40f0-b243-e352366c0875 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.764986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.765781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.766387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.767281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:29.767888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:29.768681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:29.776342 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ac03aaa9-e5e9-43d7-9a05-ef2e300a153a req-59235239-a0a4-40f0-b243-e352366c0875 service nova] Creating event network-vif-unplugged:f4f8835c-e978-4278-9cc8-bcb8389538d7 for instance b4f2d90a-2839-4199-87db-d5739abf33a8 on n-h2-854441-12 Oct 17 15:26:29.793643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-ac03aaa9-e5e9-43d7-9a05-ef2e300a153a req-59235239-a0a4-40f0-b243-e352366c0875 service nova] Instance b4f2d90a-2839-4199-87db-d5739abf33a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:26:29.809930 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ac03aaa9-e5e9-43d7-9a05-ef2e300a153a req-59235239-a0a4-40f0-b243-e352366c0875 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068230 Oct 17 15:26:29.817225 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 681/1286] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:29.951093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:29.966341 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5273708-50ba-4306-a995-898aecafd4e4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1316 microversion: 2.1 time: 0.234215 Oct 17 15:26:29.983498 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 606/1287] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:29 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:30.152137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:30.153029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:30.190345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:30.191683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:30.192288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:30.192994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:30.193903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:30.193903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:30.252613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:30.253773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:30.267969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:30.270915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:30.271724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:30.272620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:30.274231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:30.276203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:30.385739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:30.396101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:30.397978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:30.404229 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4ee54d51-ed19-4c81-8810-a2742f7827df tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1558 microversion: 2.91 time: 0.157772 Oct 17 15:26:30.405707 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 607/1288] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:30 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:30.496100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6c6ddf98-c78e-421f-b422-f1334e93f872 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bec1c700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:30.580966 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6c6ddf98-c78e-421f-b422-f1334e93f872 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1414 microversion: 2.1 time: 0.090352 Oct 17 15:26:30.582515 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 608/1289] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:30 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:30.594828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:30.595747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:30.606523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:30.607353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:30.608187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:30.609050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:30.609667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:30.610276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:30.887375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:30.898731 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9eab48e8-96aa-4062-9539-94da681e4fcc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1647 microversion: 2.1 time: 0.749695 Oct 17 15:26:30.919575 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 682/1290] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:30 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1647 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:30.924798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:30.929481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 3e37b74a-df57-4e6a-ba1c-cd631111d114] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:30.948477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:30.949299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:30.949565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:30.950475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:30.951110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:30.951690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:30.979418 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] HTTP exception thrown: Instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 could not be found. Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Request method failure captured: Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 HTTP/1.1 Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXPI7aMOlk5IVrzumgmmK562EE37g5AAshLBukF4hFqG7aoZKfMwOZvicKVsvvcUKCxSgEWOun13AZ4S1Vv3KnYkR7eNX6w01IEYSF9j1sAFbvh5OnDakV9fZ-n806TdMP-8NPKCbt7COJ2g4issfkCOnBpjQq07BppnVzMDY1jqqQo Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: d43225ce4f724468800718eed544b111 Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1653041916 Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:30.988734 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d43225ce4f724468800718eed544b111"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/d43225ce4f724468800718eed544b111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_d43225ce4f724468800718eed544b111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d43225ce4f724468800718eed544b111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1653041916 Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: d43225ce4f724468800718eed544b111 Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1653041916 Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsAssociationTestJSON-1653041916-project Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: de65615d61c54443b8b58ea1c5fd108e Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1653041916-project Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 could not be found. Oct 17 15:26:30.990581 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '3e37b74a-df57-4e6a-ba1c-cd631111d114'} Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 could not be found. Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:30.991532 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 could not be found. Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 could not be found. Oct 17 15:26:30.993666 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:30.996579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Returning 404 to user: Instance 3e37b74a-df57-4e6a-ba1c-cd631111d114 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:30.997645 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea639f72-aff6-4f59-96be-d8769a55bba8 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114" status: 404 len: 111 microversion: 2.1 time: 0.076988 Oct 17 15:26:30.998746 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 683/1291] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:30 2022] GET /compute/v2.1/servers/3e37b74a-df57-4e6a-ba1c-cd631111d114 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:31.012188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:31.013298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:31.031302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:31.035272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:31.036112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:31.037087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:31.037758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:31.040689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:31.211900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:31.230891 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a101cb7-9e42-45da-80c5-a65bbdf92e7e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1535 microversion: 2.1 time: 0.643603 Oct 17 15:26:31.234657 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 609/1292] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:30 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1535 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:31.239868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fb9c8e63-cbe7-4545-85cd-c24fea7e05b3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '.version_select at 0x7f28bee36280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:31.633277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:31.994150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:32.643620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:32.658491 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72d41d35-ef18-4b38-9f4e-de75ac504933 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1316 microversion: 2.1 time: 1.658375 Oct 17 15:26:32.659443 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 684/1293] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:30 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1316 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:32.665066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:32.675531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:32.694326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:32.702863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:32.704143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:32.708573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:32.709464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:32.710201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:32.986168 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fb9c8e63-cbe7-4545-85cd-c24fea7e05b3 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/4a85c55f-c599-4a9b-92de-0322580fdd9a" status: 202 len: 0 microversion: 2.1 time: 1.750219 Oct 17 15:26:32.987674 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 610/1294] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:26:31 2022] DELETE /compute/v2.1/os-floating-ips/4a85c55f-c599-4a9b-92de-0322580fdd9a => generated 0 bytes in 1752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:32.994095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a3c19904-555b-4adf-90e2-2c1cb161f4cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28beae11f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:33.219795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:33.239191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:33.246785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:33.264787 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbd44cb0-76f6-4003-8fc2-4e3ecc0e4dbc tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.603348 Oct 17 15:26:33.269001 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 685/1295] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:32 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:33.282454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:33.283640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:33.297310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:33.302568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:33.303467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:33.304596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:33.305293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:33.306456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:33.709615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:33.726069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47935b7e-3ce2-4b24-b707-1e0a3c0da4d0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1647 microversion: 2.1 time: 0.454497 Oct 17 15:26:33.744509 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 686/1296] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:33 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1647 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:33.744509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:33.744509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:33.761998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:33.764060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:33.765646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:33.768323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:33.768907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:33.769908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:34.086907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:34.099521 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-22eaed55-49a4-45c2-9c81-1d608ff90e48 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1535 microversion: 2.1 time: 0.368596 Oct 17 15:26:34.116878 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 687/1297] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:33 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1535 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:34.140825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:34.141524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:34.147733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:34.148208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:34.148661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:34.149341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:34.149784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:34.150200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:34.250479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:26:34.481337 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d3b74fa-e8ae-4fe9-b791-8105068563d1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "DELETE /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 204 len: 0 microversion: 2.1 time: 0.359233 Oct 17 15:26:34.486448 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 688/1298] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:34 2022] DELETE /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:26:34.494369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:34.506875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:34.516494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:34.526721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:34.526721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:34.527560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:34.528212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:34.528724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:35.019648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:35.035882 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d06374c-5f92-44a8-8dfa-a3200094d3f9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1316 microversion: 2.1 time: 0.547876 Oct 17 15:26:35.055860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 689/1299] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:34 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1316 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:35.073625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:35.074263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:35.141239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:35.141659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:35.142108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:35.142903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:35.158573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:35.159137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:35.330973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:35.345366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:35.348888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:35.363069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c1624b8-5a62-4787-b003-d6d123c3db8f tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.305657 Oct 17 15:26:35.377581 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 690/1300] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:35 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:35.379409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:35.393546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:35.434928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:35.435689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:35.436180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:35.436959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:35.437433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:35.438036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:36.412730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:36.432521 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a9e2cf3-5f8a-4e50-ada6-8d21ba310cd1 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1526 microversion: 2.1 time: 1.064724 Oct 17 15:26:36.437843 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 691/1301] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:35 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1526 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:36.463266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f91f4867-27ad-47ec-bccb-6f93587ef8ba req-a2ba9c62-19bd-4bc3-b4f1-b898724b57f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3", "name": "network-vif-deleted", "tag": "c0728835-c3dd-487d-9ae3-e25a2f9c594a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:36.506013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f91f4867-27ad-47ec-bccb-6f93587ef8ba req-a2ba9c62-19bd-4bc3-b4f1-b898724b57f1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:36.514918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f91f4867-27ad-47ec-bccb-6f93587ef8ba req-a2ba9c62-19bd-4bc3-b4f1-b898724b57f1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:36.517939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f91f4867-27ad-47ec-bccb-6f93587ef8ba req-a2ba9c62-19bd-4bc3-b4f1-b898724b57f1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:36.557719 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f91f4867-27ad-47ec-bccb-6f93587ef8ba req-a2ba9c62-19bd-4bc3-b4f1-b898724b57f1 service nova] Creating event network-vif-deleted:c0728835-c3dd-487d-9ae3-e25a2f9c594a for instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 on n-h2-854441-12 Oct 17 15:26:36.568978 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f91f4867-27ad-47ec-bccb-6f93587ef8ba req-a2ba9c62-19bd-4bc3-b4f1-b898724b57f1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129226 Oct 17 15:26:36.570240 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 692/1302] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:36.578237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:36.581309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:36.594208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:36.600304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:36.603615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:36.607662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:36.608322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:36.608946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:36.689813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:36.706840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:36.707605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:36.708091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lazy-loading 'fault' on Instance uuid 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:37.250111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:37.262556 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ff4acab-2f47-4049-b2b1-de7d93645b3b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 200 len: 1306 microversion: 2.1 time: 0.690597 Oct 17 15:26:37.265683 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 693/1303] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:36 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 1306 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:37.278843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:37.281241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:37.308293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:37.309198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:37.309328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:37.309962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:37.310421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:37.322427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:37.690272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:37.693368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:37.711296 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10688306-e30f-4f9f-883e-f2004e7d43ae tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1528 microversion: 2.1 time: 0.444267 Oct 17 15:26:37.731932 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 694/1304] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:37 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1528 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:37.763747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:37.766810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:37.787037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:37.801645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:37.805898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:37.806923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:37.807567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:37.808142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:38.141620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:38.155146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69bf8617-7f36-46ac-9f2a-44f27563baf1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1316 microversion: 2.1 time: 0.417480 Oct 17 15:26:38.155934 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 695/1305] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:37 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:38.166756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:38.167630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:38.188447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:38.188957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:38.189399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:38.190186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:38.190674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:38.191102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:38.444800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:38.462265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:38.465051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:38.478103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:38.488644 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9221616a-b4ba-4c3e-9c3f-3ddb7261ccb7 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.331321 Oct 17 15:26:38.492410 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 696/1306] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:38 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:38.500468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:38.501115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:38.528261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:38.529397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:38.530053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:38.531085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:38.531742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:38.532390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:38.597708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:38.598400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:38.600005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:38.600762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lazy-loading 'fault' on Instance uuid 11396321-8b48-4627-858e-90aabfbe0432 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:38.716952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de65615d61c54443b8b58ea1c5fd108e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43225ce4f724468800718eed544b111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:38.732310 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3b93404-ddd0-4db5-bff2-b34d9b844b01 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 200 len: 1314 microversion: 2.1 time: 0.238374 Oct 17 15:26:38.735208 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 697/1307] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:38 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:38.744607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:38.745532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:38.753493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:38.754292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:38.754946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:38.755829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:38.756710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:38.757657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:39.105681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:39.123977 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-edd57c47-fcbd-4a40-9977-1d8fb6c91c15 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1528 microversion: 2.1 time: 0.387484 Oct 17 15:26:39.162877 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 698/1308] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:38 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1528 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:39.168306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:39.176139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:39.204749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:39.205673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:39.206386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:39.207407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:39.208155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:39.208847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:39.238688 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 HTTP/1.1 Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:39.240770 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:39.242174 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3'} Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:39.243196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:39.244496 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.254909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:39.260064 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63b42959-0de2-48e8-ae90-ac444c2c406f tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 404 len: 111 microversion: 2.1 time: 0.091555 Oct 17 15:26:39.261340 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 699/1309] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:39 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:39.281260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-43acff7d-7d7f-42e8-a0a7-a54fd4d035af req-6f84adca-f635-4a3a-82c6-ad11fa1a35da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11396321-8b48-4627-858e-90aabfbe0432", "name": "network-vif-deleted", "tag": "ad6d955f-b8f4-4902-bca5-a5ef16b95dbe"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:39.298373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-43acff7d-7d7f-42e8-a0a7-a54fd4d035af req-6f84adca-f635-4a3a-82c6-ad11fa1a35da service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:39.298913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-43acff7d-7d7f-42e8-a0a7-a54fd4d035af req-6f84adca-f635-4a3a-82c6-ad11fa1a35da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:39.299713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-43acff7d-7d7f-42e8-a0a7-a54fd4d035af req-6f84adca-f635-4a3a-82c6-ad11fa1a35da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:39.312498 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-43acff7d-7d7f-42e8-a0a7-a54fd4d035af req-6f84adca-f635-4a3a-82c6-ad11fa1a35da service nova] Creating event network-vif-deleted:ad6d955f-b8f4-4902-bca5-a5ef16b95dbe for instance 11396321-8b48-4627-858e-90aabfbe0432 on n-h1-854441-12 Oct 17 15:26:39.318316 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-43acff7d-7d7f-42e8-a0a7-a54fd4d035af req-6f84adca-f635-4a3a-82c6-ad11fa1a35da service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056092 Oct 17 15:26:39.320069 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 700/1310] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:39.331886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8659a397-d61c-480a-9f8e-4e4370cb1b45 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:39.338690 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8659a397-d61c-480a-9f8e-4e4370cb1b45 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] HTTP exception thrown: Flavor a90fc8d4-00c0-4281-9162-d741e55ece04 could not be found. Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8659a397-d61c-480a-9f8e-4e4370cb1b45 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Request method failure captured: Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/flavors/a90fc8d4-00c0-4281-9162-d741e55ece04 HTTP/1.1 Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMbyQiI-LnNyWxauK5jGTlbXhwY7np2VDuD0acoMDjUeQQyuZwfZGLYssB3ug3tdU0dJqyHnkoMGzRVxWUmpu77a942tEZjPfaErKFCX3hXBkvyMPJ1b7rRKJepa6AVEpQRqkpLHpTrFHl2PXuPa4Y2QgzDiZ4y8YCVb4r7r2as5Us Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: e8ac94e595be49668e583193e0d5d4aa Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-MigrationsAdminTest-485010690 Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:26:39.340633 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e8ac94e595be49668e583193e0d5d4aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e8ac94e595be49668e583193e0d5d4aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e8ac94e595be49668e583193e0d5d4aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e8ac94e595be49668e583193e0d5d4aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-MigrationsAdminTest-485010690 Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: e8ac94e595be49668e583193e0d5d4aa Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MigrationsAdminTest-485010690 Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-MigrationsAdminTest-485010690-project-admin Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a72c1cb213b049e195ccf33d522a70a6 Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-MigrationsAdminTest-485010690-project-admin Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: exception: Flavor a90fc8d4-00c0-4281-9162-d741e55ece04 could not be found. Oct 17 15:26:39.342079 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'a90fc8d4-00c0-4281-9162-d741e55ece04'} Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor a90fc8d4-00c0-4281-9162-d741e55ece04 could not be found. Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:39.342938 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor a90fc8d4-00c0-4281-9162-d741e55ece04 could not be found. Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor a90fc8d4-00c0-4281-9162-d741e55ece04 could not be found. Oct 17 15:26:39.344177 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:39.345484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8659a397-d61c-480a-9f8e-4e4370cb1b45 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Returning 404 to user: Flavor a90fc8d4-00c0-4281-9162-d741e55ece04 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:39.345484 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8659a397-d61c-480a-9f8e-4e4370cb1b45 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/a90fc8d4-00c0-4281-9162-d741e55ece04" status: 404 len: 109 microversion: 2.1 time: 0.020013 Oct 17 15:26:39.345484 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 701/1311] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:39 2022] DELETE /compute/v2.1/flavors/a90fc8d4-00c0-4281-9162-d741e55ece04 => generated 109 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:39.376142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:39.376873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:39.390716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:39.391219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:39.396163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:39.397008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:39.405187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:39.405710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:39.876169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:39.908577 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6119a14b-8902-41de-b794-c2950fb58f91 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1316 microversion: 2.1 time: 0.564377 Oct 17 15:26:39.914181 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 702/1312] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:39 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:39.931625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf32a41c-ff07-4a8c-bbd2-1d16013eb4d3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bea69af0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:40.409343 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf32a41c-ff07-4a8c-bbd2-1d16013eb4d3 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/863c57d8-4262-4459-a35b-4018f89514c7" status: 202 len: 0 microversion: 2.1 time: 0.493879 Oct 17 15:26:40.410032 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 703/1313] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:39 2022] DELETE /compute/v2.1/os-security-groups/863c57d8-4262-4459-a35b-4018f89514c7 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:40.416614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:40.417266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:40.439251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:40.439748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:40.440337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:40.441056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:40.441507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:40.441936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:40.556943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:40.570126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:40.572975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:40.583994 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ca58608-c5b2-46a2-a375-0df9169ae7aa tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.172813 Oct 17 15:26:40.602887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=13 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:40.610001 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 704/1314] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:40 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:40.616875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1495093396", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:41.289421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=18 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:42.974029 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a3c19904-555b-4adf-90e2-2c1cb161f4cd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1423 microversion: 2.1 time: 9.984053 Oct 17 15:26:42.977680 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 611/1315] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:32 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1423 bytes in 9989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:42.990538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:26:42.997383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:42.999402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] [instance: 11396321-8b48-4627-858e-90aabfbe0432] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:43.020295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:43.020995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:43.021522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:43.022361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:43.022946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:43.023470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:43.038270 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] HTTP exception thrown: Instance 11396321-8b48-4627-858e-90aabfbe0432 could not be found. Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Request method failure captured: Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 HTTP/1.1 Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXPI7aMOlk5IVrzumgmmK562EE37g5AAshLBukF4hFqG7aoZKfMwOZvicKVsvvcUKCxSgEWOun13AZ4S1Vv3KnYkR7eNX6w01IEYSF9j1sAFbvh5OnDakV9fZ-n806TdMP-8NPKCbt7COJ2g4issfkCOnBpjQq07BppnVzMDY1jqqQo Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: d43225ce4f724468800718eed544b111 Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1653041916 Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:26:43.040026 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d43225ce4f724468800718eed544b111"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/d43225ce4f724468800718eed544b111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_d43225ce4f724468800718eed544b111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d43225ce4f724468800718eed544b111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1653041916 Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: d43225ce4f724468800718eed544b111 Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1653041916 Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPsAssociationTestJSON-1653041916-project Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: de65615d61c54443b8b58ea1c5fd108e Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1653041916-project Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 11396321-8b48-4627-858e-90aabfbe0432 could not be found. Oct 17 15:26:43.041774 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '11396321-8b48-4627-858e-90aabfbe0432'} Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11396321-8b48-4627-858e-90aabfbe0432 could not be found. Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:43.042949 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11396321-8b48-4627-858e-90aabfbe0432 could not be found. Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11396321-8b48-4627-858e-90aabfbe0432 could not be found. Oct 17 15:26:43.044712 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:43.046207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] Returning 404 to user: Instance 11396321-8b48-4627-858e-90aabfbe0432 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:43.046766 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f7adba7-6809-4754-90cf-fdf46f296d65 tempest-FloatingIPsAssociationTestJSON-1653041916 tempest-FloatingIPsAssociationTestJSON-1653041916-project] 10.222.0.87 "GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432" status: 404 len: 111 microversion: 2.1 time: 0.067273 Oct 17 15:26:43.051326 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 612/1316] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:42 2022] GET /compute/v2.1/servers/11396321-8b48-4627-858e-90aabfbe0432 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:43.057047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e298cebe-647d-4e54-84e5-7c290ba9cada tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28beae1670>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:43.584198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:26:43.584944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:26:43.585575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:26:43.586161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:26:43.586814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:26:43.600331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:43.601148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:43.601765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:43.602720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:43.603473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:43.604204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:43.635740 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e298cebe-647d-4e54-84e5-7c290ba9cada tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/0dadb4c7-7a6e-4e53-905f-4d095ec071a8" status: 202 len: 0 microversion: 2.1 time: 0.582380 Oct 17 15:26:43.636727 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 613/1317] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:43 2022] DELETE /compute/v2.1/os-security-groups/0dadb4c7-7a6e-4e53-905f-4d095ec071a8 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:43.641747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:43.642934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:43.657423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:43.657929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:43.658359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:43.669926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:26:43.675835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:43.676398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:43.679091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:43.682838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Getting quotas for user 5ec3b5fbeafd47558718a7a9638d0c9e and project 72c637634ac84f7299ee3ac1a67f2750. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:26:43.697165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:26:43.701910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:26:43.781557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4af01295-8208-4b14-ba64-44b0d2c97a00 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.170228 Oct 17 15:26:43.788712 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 705/1318] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:26:43.804806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:43.813491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:43.834303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:43.838543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:43.839444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:43.840907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:43.844211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:43.846163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:44.114171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:44.131414 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c49321df-2d55-41a2-96c9-ee4370b9a641 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1316 microversion: 2.1 time: 0.493321 Oct 17 15:26:44.132971 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 614/1319] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:43 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:44.140233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-716d27c0-677c-4535-8212-4dd31f63223d req-e34199a8-72cb-43a4-94d9-580df72dae6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889fed9e-4835-4a06-ae15-bb3f4e7540dc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d81cf4-99dd-44b8-ac1a-ee8c845874d7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:44.168315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-716d27c0-677c-4535-8212-4dd31f63223d req-e34199a8-72cb-43a4-94d9-580df72dae6b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:44.169120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-716d27c0-677c-4535-8212-4dd31f63223d req-e34199a8-72cb-43a4-94d9-580df72dae6b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:44.173346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-716d27c0-677c-4535-8212-4dd31f63223d req-e34199a8-72cb-43a4-94d9-580df72dae6b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:44.212681 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-716d27c0-677c-4535-8212-4dd31f63223d req-e34199a8-72cb-43a4-94d9-580df72dae6b service nova] Creating event network-vif-plugged:b9d81cf4-99dd-44b8-ac1a-ee8c845874d7 for instance 889fed9e-4835-4a06-ae15-bb3f4e7540dc on n-h2-854441-12 Oct 17 15:26:44.220475 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-716d27c0-677c-4535-8212-4dd31f63223d req-e34199a8-72cb-43a4-94d9-580df72dae6b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086204 Oct 17 15:26:44.225348 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 615/1320] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:44.238662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4cfd8684-2279-4715-b3ba-24d839a2f42f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea91310>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:44.325552 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4cfd8684-2279-4715-b3ba-24d839a2f42f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 200 len: 1423 microversion: 2.1 time: 0.098432 Oct 17 15:26:44.326822 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 616/1321] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:26:44 2022] GET /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:44.331928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef8d416f-12d5-4b0c-98b6-d6e7df290571 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'create', calling method: .version_select at 0x7f28beb011f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-616058967", "description": "tempest-description-2035888003"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:44.539532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:44.550590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:44.564466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:44.590824 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d61b0e0-87af-4d28-b4e0-63e8f80f31ce tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.798374 Oct 17 15:26:44.607274 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 706/1322] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:43 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:44.616265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5ca35a5-d036-42e9-aeba-87bc3bf4bee6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:44.624626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5ca35a5-d036-42e9-aeba-87bc3bf4bee6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:44.727628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5ca35a5-d036-42e9-aeba-87bc3bf4bee6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:44.736667 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5ca35a5-d036-42e9-aeba-87bc3bf4bee6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1213 microversion: 2.1 time: 0.134957 Oct 17 15:26:44.749220 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 707/1323] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:44 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:44.772644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9f3db2a-cadc-4c8d-b28f-3ab5a402c375 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be99c280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:45.216808 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef8d416f-12d5-4b0c-98b6-d6e7df290571 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.888637 Oct 17 15:26:45.217912 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 617/1324] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:26:44 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:45.223267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:45.224225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:45.243905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:45.244403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:45.244836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:45.245605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:45.245976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:45.246396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:45.591876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:45.616617 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-74fe01f2-4552-4cb8-aa86-c38022830341 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1316 microversion: 2.1 time: 0.397298 Oct 17 15:26:45.618929 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 618/1325] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:45 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:45.627243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-003ac506-d1ce-478a-b05f-5a5250687d4a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Action: 'update', calling method: .version_select at 0x7f28bec668b0>, body: {"security_group": {"name": "tempest-sg-hth-1878785740", "description": "tempest-description-hth-135372770"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:45.754511 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9f3db2a-cadc-4c8d-b28f-3ab5a402c375 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 204 len: 0 microversion: 2.1 time: 1.002252 Oct 17 15:26:45.755289 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 708/1326] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:44 2022] DELETE /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:26:45.760947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:45.761900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:45.776189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:45.781049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:45.800829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:45.802130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:45.802836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:45.803303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:46.028585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:46.038230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:46.050084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:46.068645 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5d4b6e0-fc50-407c-aa65-d181f848e8fe tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.312026 Oct 17 15:26:46.069529 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 709/1327] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:45 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:46.074422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:46.075255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:46.083317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:46.091348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:46.091812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:46.092560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:46.093010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:46.093424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:46.144158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:26:46.458572 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f97d00b2-bfad-400b-9a6a-ca43fda83558 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 204 len: 0 microversion: 2.1 time: 0.387517 Oct 17 15:26:46.470103 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 710/1328] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:46 2022] DELETE /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:26:46.476027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:46.477028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:46.488387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:46.489891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:46.490678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:46.491674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:46.493325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:46.495807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:46.653403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:46.662882 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e9a14d5-f54a-4555-8490-96c70d46ffb2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1265 microversion: 2.1 time: 0.190867 Oct 17 15:26:46.667634 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 711/1329] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:46 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:46.672719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-37fdfecb-24e9-499c-9576-1789901cfe00 req-e20d7cf1-aaed-4a89-8524-209a9f041829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f2d90a-2839-4199-87db-d5739abf33a8", "name": "network-vif-plugged", "status": "completed", "tag": "f4f8835c-e978-4278-9cc8-bcb8389538d7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:46.734708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37fdfecb-24e9-499c-9576-1789901cfe00 req-e20d7cf1-aaed-4a89-8524-209a9f041829 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:46.737518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37fdfecb-24e9-499c-9576-1789901cfe00 req-e20d7cf1-aaed-4a89-8524-209a9f041829 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:46.739395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-37fdfecb-24e9-499c-9576-1789901cfe00 req-e20d7cf1-aaed-4a89-8524-209a9f041829 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:46.775176 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-37fdfecb-24e9-499c-9576-1789901cfe00 req-e20d7cf1-aaed-4a89-8524-209a9f041829 service nova] Creating event network-vif-plugged:f4f8835c-e978-4278-9cc8-bcb8389538d7 for instance b4f2d90a-2839-4199-87db-d5739abf33a8 on n-h2-854441-12 Oct 17 15:26:46.790977 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-37fdfecb-24e9-499c-9576-1789901cfe00 req-e20d7cf1-aaed-4a89-8524-209a9f041829 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121680 Oct 17 15:26:46.794257 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 712/1330] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:46.798615 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-003ac506-d1ce-478a-b05f-5a5250687d4a tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "PUT /compute/v2.1/os-security-groups/bd1d4cf1-0fa9-4641-9464-72870a8cc218" status: 200 len: 217 microversion: 2.1 time: 1.177350 Oct 17 15:26:46.800424 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 619/1331] 10.222.0.87 () {60 vars in 1290 bytes} [Mon Oct 17 15:26:45 2022] PUT /compute/v2.1/os-security-groups/bd1d4cf1-0fa9-4641-9464-72870a8cc218 => generated 217 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:46.806793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:46.807704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:46.820205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1431553099", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "4a4d489b-6847-437c-bb6f-226f2268a1b9"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:46.829920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:46.830996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:46.833623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:46.837017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:46.837889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:46.838604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:46.937241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] validate_networks() for [('4a4d489b-6847-437c-bb6f-226f2268a1b9', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:26:47.376475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:47.387227 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0bdffbb5-3e95-4e00-8120-19cba4b1330c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1466 microversion: 2.1 time: 0.585249 Oct 17 15:26:47.389817 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 620/1332] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:46 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1466 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:47.395552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5997c77-783c-4cb2-a9d5-9f7ca47ad3f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28beb01280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:47.652764 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5997c77-783c-4cb2-a9d5-9f7ca47ad3f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups/bd1d4cf1-0fa9-4641-9464-72870a8cc218" status: 200 len: 217 microversion: 2.1 time: 0.261452 Oct 17 15:26:47.653965 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 621/1333] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:26:47 2022] GET /compute/v2.1/os-security-groups/bd1d4cf1-0fa9-4641-9464-72870a8cc218 => generated 217 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:47.659415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:47.660387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:47.675684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:47.677086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:47.678767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:47.679920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:47.683129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:47.685251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:47.868495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:47.903660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:47.908868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:47.921770 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c3e3ad9f-f9b7-4b52-98db-7de3ec50fcc5 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.265188 Oct 17 15:26:47.923900 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 622/1334] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:47 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:47.932033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02517681-cd66-458e-b576-a9fa4607ecf9 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:47.932944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-02517681-cd66-458e-b576-a9fa4607ecf9 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:47.943339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02517681-cd66-458e-b576-a9fa4607ecf9 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:47.944198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02517681-cd66-458e-b576-a9fa4607ecf9 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:47.944822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02517681-cd66-458e-b576-a9fa4607ecf9 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:47.945733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02517681-cd66-458e-b576-a9fa4607ecf9 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:47.946754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02517681-cd66-458e-b576-a9fa4607ecf9 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:47.947738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02517681-cd66-458e-b576-a9fa4607ecf9 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:48.397271 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02517681-cd66-458e-b576-a9fa4607ecf9 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1619 microversion: 2.1 time: 0.471403 Oct 17 15:26:48.398110 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 623/1335] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:47 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1619 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:48.444285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:26:48.444285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:26:48.444285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:26:48.444285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:26:48.444285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:26:48.452101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9266699e-9a52-465e-8df3-a65bbdcad2f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28beb01280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:48.494639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:48.495124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:48.495568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:48.496327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:48.496806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:48.497232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:48.557694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:26:48.575222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for user 59a1c6dac66a43d9b5e91b78215359ce and project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:26:48.592892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:26:48.597788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:26:48.722740 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b24bd102-2899-4b2c-8528-243a509e8e59 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.922626 Oct 17 15:26:48.735936 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 713/1336] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:26:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:26:48.750132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:48.751229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:48.768073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:48.771487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:48.778034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:48.779129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:48.779848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:48.783168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:48.978531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:48.991470 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a3b53b8-77a6-455c-9e42-c99b1b538c59 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1271 microversion: 2.1 time: 0.253980 Oct 17 15:26:48.992107 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 714/1337] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:48 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:49.017016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-225694dd-88fc-4cd5-8868-f4fc67b014c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:49.017784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-225694dd-88fc-4cd5-8868-f4fc67b014c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:49.390296 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9266699e-9a52-465e-8df3-a65bbdcad2f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/bd1d4cf1-0fa9-4641-9464-72870a8cc218" status: 202 len: 0 microversion: 2.1 time: 0.977924 Oct 17 15:26:49.394362 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 624/1338] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:48 2022] DELETE /compute/v2.1/os-security-groups/bd1d4cf1-0fa9-4641-9464-72870a8cc218 => generated 0 bytes in 993 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:49.398026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1895692987", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["e21af96d-b24a-454b-bc29-715bd73d273b"]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:49.482856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-225694dd-88fc-4cd5-8868-f4fc67b014c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:49.505057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:26:49.521358 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-225694dd-88fc-4cd5-8868-f4fc67b014c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1208 microversion: 2.1 time: 0.527802 Oct 17 15:26:49.527421 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 715/1339] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:48 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1208 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:49.565835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-85335220-767f-44b9-8f7e-d077b1f6b8dd req-a4ccaedf-9266-4dd5-b9bb-de27aedcaf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef56e60-7257-4eb3-82e1-bef0667ed073", "name": "network-vif-unplugged", "status": "completed", "tag": "a37c0ce3-a016-4e5d-963c-bb23a0c4f78b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:49.617045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85335220-767f-44b9-8f7e-d077b1f6b8dd req-a4ccaedf-9266-4dd5-b9bb-de27aedcaf9a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:49.618346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85335220-767f-44b9-8f7e-d077b1f6b8dd req-a4ccaedf-9266-4dd5-b9bb-de27aedcaf9a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:49.619474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85335220-767f-44b9-8f7e-d077b1f6b8dd req-a4ccaedf-9266-4dd5-b9bb-de27aedcaf9a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:49.640555 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-85335220-767f-44b9-8f7e-d077b1f6b8dd req-a4ccaedf-9266-4dd5-b9bb-de27aedcaf9a service nova] Creating event network-vif-unplugged:a37c0ce3-a016-4e5d-963c-bb23a0c4f78b for instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 on n-h1-854441-12 Oct 17 15:26:49.680412 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-85335220-767f-44b9-8f7e-d077b1f6b8dd req-a4ccaedf-9266-4dd5-b9bb-de27aedcaf9a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147528 Oct 17 15:26:49.681926 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 716/1340] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:49.688963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:49.690060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:49.705562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:49.706757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:49.707475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:49.708475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:49.709367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:49.710033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:49.912684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:49.929659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:49.936308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:49.947991 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fae80de-3029-4fe3-9b8b-c1c20e45b4eb tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1553 microversion: 2.91 time: 0.263202 Oct 17 15:26:49.949094 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 717/1341] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:49 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:49.988933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:49.989978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:50.000264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.001305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.002443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.003562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.004293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.004944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.038932 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 HTTP/1.1 Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:50.044308 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.046763 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3'} Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:50.047602 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.048926 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.055477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:50.059653 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6c06575-0329-4c5d-8149-f68514dd5a19 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 404 len: 111 microversion: 2.1 time: 0.107772 Oct 17 15:26:50.060650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:26:50.061324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:26:50.062542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:26:50.063141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:26:50.063291 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 718/1342] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:49 2022] DELETE /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:50.064116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:26:50.075148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d34e8269-f69d-4349-84f1-c87f806d96db req-93637c04-719f-4f67-85c1-50bdf293d525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef56e60-7257-4eb3-82e1-bef0667ed073", "name": "network-vif-deleted", "tag": "a37c0ce3-a016-4e5d-963c-bb23a0c4f78b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:50.092078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.093890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.096188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.098774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.099715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d34e8269-f69d-4349-84f1-c87f806d96db req-93637c04-719f-4f67-85c1-50bdf293d525 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.100236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d34e8269-f69d-4349-84f1-c87f806d96db req-93637c04-719f-4f67-85c1-50bdf293d525 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.100674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d34e8269-f69d-4349-84f1-c87f806d96db req-93637c04-719f-4f67-85c1-50bdf293d525 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.103629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.104326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.146263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:50.153523 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d34e8269-f69d-4349-84f1-c87f806d96db req-93637c04-719f-4f67-85c1-50bdf293d525 service nova] Creating event network-vif-deleted:a37c0ce3-a016-4e5d-963c-bb23a0c4f78b for instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 on n-h1-854441-12 Oct 17 15:26:50.166942 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d34e8269-f69d-4349-84f1-c87f806d96db req-93637c04-719f-4f67-85c1-50bdf293d525 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101534 Oct 17 15:26:50.167988 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 719/1343] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:50.182721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:50.191471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:50.207962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:26:50.211992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.212521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.213149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.218879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.219575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.220176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.243911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:26:50.302262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:26:50.308073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:26:50.547527 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-62f5b602-a713-45f3-a553-83f437e6f50c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.155280 Oct 17 15:26:50.548167 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 625/1344] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:26:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:26:50.571332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:50.572014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:50.611252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.611823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.612270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.622362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.623011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.623401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.658823 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 HTTP/1.1 Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:26:50.663987 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.665528 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3'} Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:50.666358 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. Oct 17 15:26:50.667603 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:50.670995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Instance 5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:50.675471 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-313849e7-1769-495b-97dc-519a10b2951c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3" status: 404 len: 111 microversion: 2.1 time: 0.124183 Oct 17 15:26:50.676643 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 626/1345] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:50 2022] GET /compute/v2.1/servers/5eba6c18-9f5c-4ce2-b9ce-4beef5c72de3 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:50.688211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:50.689059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:50.705056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.706925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.708384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.709288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:50.711481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:50.712060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:50.788270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:50.802988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5156bf97-a171-429a-a9bf-e8b86f618c95 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.627669 Oct 17 15:26:50.804063 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 720/1346] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:50 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:50.821200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5b41166-85de-4a90-9565-441c6ba4b031 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:50.825348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5b41166-85de-4a90-9565-441c6ba4b031 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:50.952940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5b41166-85de-4a90-9565-441c6ba4b031 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:50.961946 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5b41166-85de-4a90-9565-441c6ba4b031 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1217 microversion: 2.1 time: 0.152674 Oct 17 15:26:50.985121 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 721/1347] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:50 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:51.017130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d133b9-cda2-473f-ad9d-9a76ded0747d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28be99a670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:51.529787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:51.539227 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b4a6d857-2a6e-412f-8c13-020d4e37ee76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1204 microversion: 2.1 time: 0.861261 Oct 17 15:26:51.545253 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 627/1348] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:50 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1204 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:51.554401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:51.556111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:51.568855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:51.571474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:51.572842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:51.573803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:51.574301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:51.575809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:51.578979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-80d133b9-cda2-473f-ad9d-9a76ded0747d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:26:51.580853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-80d133b9-cda2-473f-ad9d-9a76ded0747d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:26:51.581829 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-80d133b9-cda2-473f-ad9d-9a76ded0747d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 does not exist Oct 17 15:26:51.581829 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-92ac662f-2bb0-4770-bccb-08751c549b4c'] Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d133b9-cda2-473f-ad9d-9a76ded0747d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/0dadb4c7-7a6e-4e53-905f-4d095ec071a8 HTTP/1.1 Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:51.587625 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 does not exist Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-92ac662f-2bb0-4770-bccb-08751c549b4c'] Oct 17 15:26:51.589049 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '0dadb4c7-7a6e-4e53-905f-4d095ec071a8'} Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.589857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 does not exist Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92ac662f-2bb0-4770-bccb-08751c549b4c'] Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:26:51.591071 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 does not exist Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92ac662f-2bb0-4770-bccb-08751c549b4c'] Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 does not exist Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92ac662f-2bb0-4770-bccb-08751c549b4c'] Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.593325 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 does not exist Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92ac662f-2bb0-4770-bccb-08751c549b4c'] Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d133b9-cda2-473f-ad9d-9a76ded0747d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group 0dadb4c7-7a6e-4e53-905f-4d095ec071a8 does not exist Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-92ac662f-2bb0-4770-bccb-08751c549b4c'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80d133b9-cda2-473f-ad9d-9a76ded0747d tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/0dadb4c7-7a6e-4e53-905f-4d095ec071a8" status: 404 len: 194 microversion: 2.1 time: 0.603026 Oct 17 15:26:51.595228 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 722/1349] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:50 2022] DELETE /compute/v2.1/os-security-groups/0dadb4c7-7a6e-4e53-905f-4d095ec071a8 => generated 194 bytes in 604 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:51.600411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31aebcf1-1d00-4fac-90a1-825aa2500a4b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28be99a0d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:51.633499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-31aebcf1-1d00-4fac-90a1-825aa2500a4b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 863c57d8-4262-4459-a35b-4018f89514c7 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:26:51.634103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-31aebcf1-1d00-4fac-90a1-825aa2500a4b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group 863c57d8-4262-4459-a35b-4018f89514c7 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:26:51.634653 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-31aebcf1-1d00-4fac-90a1-825aa2500a4b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group 863c57d8-4262-4459-a35b-4018f89514c7 does not exist Oct 17 15:26:51.634653 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-28056c1d-153e-4030-ad26-9f9e5c523ecb'] Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31aebcf1-1d00-4fac-90a1-825aa2500a4b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/863c57d8-4262-4459-a35b-4018f89514c7 HTTP/1.1 Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:51.637399 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group 863c57d8-4262-4459-a35b-4018f89514c7 does not exist Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-28056c1d-153e-4030-ad26-9f9e5c523ecb'] Oct 17 15:26:51.638805 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '863c57d8-4262-4459-a35b-4018f89514c7'} Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.639647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 863c57d8-4262-4459-a35b-4018f89514c7 does not exist Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28056c1d-153e-4030-ad26-9f9e5c523ecb'] Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:26:51.640783 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 863c57d8-4262-4459-a35b-4018f89514c7 does not exist Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28056c1d-153e-4030-ad26-9f9e5c523ecb'] Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 863c57d8-4262-4459-a35b-4018f89514c7 does not exist Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28056c1d-153e-4030-ad26-9f9e5c523ecb'] Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.641879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 863c57d8-4262-4459-a35b-4018f89514c7 does not exist Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28056c1d-153e-4030-ad26-9f9e5c523ecb'] Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31aebcf1-1d00-4fac-90a1-825aa2500a4b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group 863c57d8-4262-4459-a35b-4018f89514c7 does not exist Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-28056c1d-153e-4030-ad26-9f9e5c523ecb'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31aebcf1-1d00-4fac-90a1-825aa2500a4b tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/863c57d8-4262-4459-a35b-4018f89514c7" status: 404 len: 194 microversion: 2.1 time: 0.043360 Oct 17 15:26:51.643150 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 723/1350] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:51 2022] DELETE /compute/v2.1/os-security-groups/863c57d8-4262-4459-a35b-4018f89514c7 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:51.654217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72555a85-8716-4c24-ad3a-7fff03340b6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bea69160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:51.681821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:51.691600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:51.693946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:51.699648 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5838f4b-801b-4605-bc92-35f189ae9a00 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1535 microversion: 2.91 time: 0.152294 Oct 17 15:26:51.700778 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 628/1351] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:51 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1535 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:51.702978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-72555a85-8716-4c24-ad3a-7fff03340b6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:26:51.703780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-72555a85-8716-4c24-ad3a-7fff03340b6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group 83d2792e-5c35-4dbf-9507-2efc5596de00 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:26:51.704457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-72555a85-8716-4c24-ad3a-7fff03340b6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:26:51.704457 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-3f4ee1d9-1978-499d-922e-7d7ae0b0b3ae'] Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72555a85-8716-4c24-ad3a-7fff03340b6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/83d2792e-5c35-4dbf-9507-2efc5596de00 HTTP/1.1 Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:51.706791 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-3f4ee1d9-1978-499d-922e-7d7ae0b0b3ae'] Oct 17 15:26:51.708332 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '83d2792e-5c35-4dbf-9507-2efc5596de00'} Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.709319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f4ee1d9-1978-499d-922e-7d7ae0b0b3ae'] Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:26:51.710730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f4ee1d9-1978-499d-922e-7d7ae0b0b3ae'] Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f4ee1d9-1978-499d-922e-7d7ae0b0b3ae'] Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.711828 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.713289 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.713289 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.713289 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:51.713289 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:51.713289 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:26:51.713289 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f4ee1d9-1978-499d-922e-7d7ae0b0b3ae'] Oct 17 15:26:51.713289 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.714671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72555a85-8716-4c24-ad3a-7fff03340b6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group 83d2792e-5c35-4dbf-9507-2efc5596de00 does not exist Oct 17 15:26:51.714671 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-3f4ee1d9-1978-499d-922e-7d7ae0b0b3ae'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:51.715555 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72555a85-8716-4c24-ad3a-7fff03340b6c tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/83d2792e-5c35-4dbf-9507-2efc5596de00" status: 404 len: 194 microversion: 2.1 time: 0.066054 Oct 17 15:26:51.716491 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 724/1352] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:51 2022] DELETE /compute/v2.1/os-security-groups/83d2792e-5c35-4dbf-9507-2efc5596de00 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:51.726601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-331aecc2-dbb4-4faa-b91e-ece22ca77830 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28beca11f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:51.761734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-331aecc2-dbb4-4faa-b91e-ece22ca77830 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:26:51.762646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.security_group_api [None req-331aecc2-dbb4-4faa-b91e-ece22ca77830 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group b53e8071-7ab6-4723-9375-d3b112effe01 not found {{(pid=120407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:26:51.763254 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-331aecc2-dbb4-4faa-b91e-ece22ca77830 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:26:51.763254 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-4cfa059f-d7ec-49d5-b807-56910e9413a1'] Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-331aecc2-dbb4-4faa-b91e-ece22ca77830 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-security-groups/b53e8071-7ab6-4723-9375-d3b112effe01 HTTP/1.1 Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:26:51.765569 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: exception: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-4cfa059f-d7ec-49d5-b807-56910e9413a1'] Oct 17 15:26:51.767601 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'b53e8071-7ab6-4723-9375-d3b112effe01'} Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.768662 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cfa059f-d7ec-49d5-b807-56910e9413a1'] Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:26:51.770138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cfa059f-d7ec-49d5-b807-56910e9413a1'] Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cfa059f-d7ec-49d5-b807-56910e9413a1'] Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.771436 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.772854 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.772854 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.772854 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:51.772854 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:51.772854 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:26:51.772854 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cfa059f-d7ec-49d5-b807-56910e9413a1'] Oct 17 15:26:51.772854 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.774689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-331aecc2-dbb4-4faa-b91e-ece22ca77830 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group b53e8071-7ab6-4723-9375-d3b112effe01 does not exist Oct 17 15:26:51.774689 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-4cfa059f-d7ec-49d5-b807-56910e9413a1'] {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:51.775592 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-331aecc2-dbb4-4faa-b91e-ece22ca77830 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/b53e8071-7ab6-4723-9375-d3b112effe01" status: 404 len: 194 microversion: 2.1 time: 0.055137 Oct 17 15:26:51.779313 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 629/1353] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:51 2022] DELETE /compute/v2.1/os-security-groups/b53e8071-7ab6-4723-9375-d3b112effe01 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:51.785486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06b1c890-0995-4f39-a36a-c19df8b88747 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bea99d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:51.828623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:51.829681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:51.840119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:51.840616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:51.841068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:51.845236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:51.845653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:51.846134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:51.870219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-06b1c890-0995-4f39-a36a-c19df8b88747 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:26:51.872208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-06b1c890-0995-4f39-a36a-c19df8b88747 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:26:51.879280 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-06b1c890-0995-4f39-a36a-c19df8b88747 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:26:51.879280 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-589919b2-f50f-4b85-a352-abf5fed0eaac'] Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06b1c890-0995-4f39-a36a-c19df8b88747 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/e4725a6c-223e-48ab-bd5b-56f6552bfa70 HTTP/1.1 Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:51.887034 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-589919b2-f50f-4b85-a352-abf5fed0eaac'] Oct 17 15:26:51.888609 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e4725a6c-223e-48ab-bd5b-56f6552bfa70'} Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.889556 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-589919b2-f50f-4b85-a352-abf5fed0eaac'] Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:26:51.894206 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-589919b2-f50f-4b85-a352-abf5fed0eaac'] Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-589919b2-f50f-4b85-a352-abf5fed0eaac'] Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.896681 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.902301 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.902301 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.902301 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:51.902301 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:51.902301 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:26:51.902301 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-589919b2-f50f-4b85-a352-abf5fed0eaac'] Oct 17 15:26:51.902301 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.905911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06b1c890-0995-4f39-a36a-c19df8b88747 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group e4725a6c-223e-48ab-bd5b-56f6552bfa70 does not exist Oct 17 15:26:51.905911 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-589919b2-f50f-4b85-a352-abf5fed0eaac'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:51.907315 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06b1c890-0995-4f39-a36a-c19df8b88747 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/e4725a6c-223e-48ab-bd5b-56f6552bfa70" status: 404 len: 194 microversion: 2.1 time: 0.127019 Oct 17 15:26:51.908943 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 725/1354] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:51 2022] DELETE /compute/v2.1/os-security-groups/e4725a6c-223e-48ab-bd5b-56f6552bfa70 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:26:51.920926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5061c3c-a018-4461-ac59-5e9cec02b6b5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28be99a8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:51.963003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-b5061c3c-a018-4461-ac59-5e9cec02b6b5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:26:51.963601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-b5061c3c-a018-4461-ac59-5e9cec02b6b5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Neutron security group 06a05263-b634-46cf-bab6-b421ad32cc64 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:26:51.964130 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b5061c3c-a018-4461-ac59-5e9cec02b6b5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:26:51.964130 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-ab555a27-47da-4175-b540-66f53170389e'] Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5061c3c-a018-4461-ac59-5e9cec02b6b5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64 HTTP/1.1 Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:51.967125 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-ab555a27-47da-4175-b540-66f53170389e'] Oct 17 15:26:51.968487 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '06a05263-b634-46cf-bab6-b421ad32cc64'} Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.969651 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab555a27-47da-4175-b540-66f53170389e'] Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:26:51.971224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab555a27-47da-4175-b540-66f53170389e'] Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab555a27-47da-4175-b540-66f53170389e'] Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.972358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab555a27-47da-4175-b540-66f53170389e'] Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5061c3c-a018-4461-ac59-5e9cec02b6b5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Security group 06a05263-b634-46cf-bab6-b421ad32cc64 does not exist Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-ab555a27-47da-4175-b540-66f53170389e'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5061c3c-a018-4461-ac59-5e9cec02b6b5 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64" status: 404 len: 194 microversion: 2.1 time: 0.055482 Oct 17 15:26:51.973661 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 726/1355] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:51 2022] DELETE /compute/v2.1/os-security-groups/06a05263-b634-46cf-bab6-b421ad32cc64 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:26:51.980887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:51.981405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:51.999480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:51.999992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.000448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.001174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:52.003175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.003175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.077857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:52.087242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:26:52.088270 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe447f70-13b3-4247-932a-c03365896e33 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.263480 Oct 17 15:26:52.092978 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 630/1356] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:51 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:52.098640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:52.100780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:52.107582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:52.108291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.108910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.109815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:52.110738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.111385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.264569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:52.276692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:52.300578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aeeb2f65-0a0b-46bc-a9a5-8d6c21df1a21 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1221 microversion: 2.1 time: 0.205966 Oct 17 15:26:52.301193 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 631/1357] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:52 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1221 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:52.348082 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-efd8c961-22e8-48f1-b4eb-35f38d882cdc tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 204 len: 0 microversion: 2.1 time: 0.374131 Oct 17 15:26:52.349365 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 727/1358] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:26:51 2022] DELETE /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:26:52.364967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:52.372839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:52.388421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:52.398798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.399565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.400493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:52.402648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.403789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.573941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:52.574872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:52.585539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:52.588983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.589989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.591550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:52.592137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.592752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.698648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:52.708573 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a692aaaa-07d0-4572-8741-44326cf23f73 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1647 microversion: 2.1 time: 0.354536 Oct 17 15:26:52.713552 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 632/1359] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:52 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1647 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:52.737990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:52.738792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:52.747958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:52.748524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.749040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.749818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:52.750488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:52.750801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:52.847965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:52.857523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:52.859109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:52.866084 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-465ba80d-1acd-4698-8055-ba2976239f09 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1535 microversion: 2.91 time: 0.136539 Oct 17 15:26:52.867074 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 633/1360] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:52 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1535 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:52.935972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:52.947186 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87670d66-736a-4aeb-8dbc-2af2712ea109 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1278 microversion: 2.1 time: 0.380630 Oct 17 15:26:52.959681 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 728/1361] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:52 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1278 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:53.126882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:53.127660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:53.135571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:53.136479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:53.137197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:53.138089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:53.138729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:53.139461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:53.325651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:53.326593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:53.333676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:53.334162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:53.335252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:53.336167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:53.336792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:53.337365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:53.358729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:53.371510 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-476f292c-6ffe-44b9-a69a-58fa35dba63f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.249506 Oct 17 15:26:53.372102 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 634/1362] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:53 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:53.522936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:53.535742 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66ec8896-6898-4844-b511-25098ab1f7f4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1269 microversion: 2.1 time: 0.213748 Oct 17 15:26:53.536756 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 729/1363] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:53 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1269 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:53.555906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-6146fbee-f9b9-40f2-8111-6b6436efb834 req-a8e74194-8feb-4948-968f-781abeb38ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a05ba5-2063-49b7-92bb-7122faf92713", "tag": "18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:53.566645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6146fbee-f9b9-40f2-8111-6b6436efb834 req-a8e74194-8feb-4948-968f-781abeb38ec7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:53.567504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6146fbee-f9b9-40f2-8111-6b6436efb834 req-a8e74194-8feb-4948-968f-781abeb38ec7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:53.568107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6146fbee-f9b9-40f2-8111-6b6436efb834 req-a8e74194-8feb-4948-968f-781abeb38ec7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:53.581783 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-6146fbee-f9b9-40f2-8111-6b6436efb834 req-a8e74194-8feb-4948-968f-781abeb38ec7 service nova] Creating event network-changed:18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f for instance 91a05ba5-2063-49b7-92bb-7122faf92713 on n-h2-854441-12 Oct 17 15:26:53.587313 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-6146fbee-f9b9-40f2-8111-6b6436efb834 req-a8e74194-8feb-4948-968f-781abeb38ec7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035166 Oct 17 15:26:53.589167 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 635/1364] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:53.739046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:53.739724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:53.751699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:53.752578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:53.754418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:53.756496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:53.758663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:53.759501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:53.904485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:53.906163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:53.917719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:53.918213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:53.918673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:53.919556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:53.920163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:53.921066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:54.105673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:54.127396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:54.140403 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0d3b8efe-d95a-4e0b-bc8a-51b68444ad07 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1647 microversion: 2.1 time: 0.406202 Oct 17 15:26:54.144006 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 730/1365] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:53 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1647 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:54.165101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:54.167115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:54.172489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:54.173123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:54.177639 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c99cd62b-5b33-41ab-8f85-5d91412d20fd tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1535 microversion: 2.91 time: 0.278473 Oct 17 15:26:54.191567 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 636/1366] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:53 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1535 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:54.200196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:54.200716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:54.201159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:54.202296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:54.203412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:54.204209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:54.290097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:54.300172 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0005796-0b3d-44f0-b12f-934950ea180b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1266 microversion: 2.1 time: 0.139632 Oct 17 15:26:54.301218 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 731/1367] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:54 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:54.403891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:54.404507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:54.413938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:54.414429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:54.414904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:54.415629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:54.416079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:54.416504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:54.504663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7ba06a1-ced2-4973-b781-8b38165d0ef8 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1208970382", "ram": 512, "vcpus": 1, "disk": 10, "id": 1641443392, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:54.550740 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7ba06a1-ced2-4973-b781-8b38165d0ef8 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.261082 Oct 17 15:26:54.562018 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 637/1368] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:26:54 2022] POST /compute/v2.1/flavors => generated 416 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:54.577934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:54.578955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:54.596369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:54.596971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:54.597633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:54.598557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:54.599176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:54.599874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:54.703339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:54.712639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:54.721557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-290c406c-17d8-4912-a044-58507a76258a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.321695 Oct 17 15:26:54.722038 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cffb7b56-8f67-41de-9fdf-026fea5f6104 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1269 microversion: 2.1 time: 0.156010 Oct 17 15:26:54.723198 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 638/1369] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:54 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:54.726176 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 732/1370] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:54 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:26:54.729693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-69d33e22-7c05-41f6-b29e-ae97ae22d0df tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:54.741457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-785ea401-235b-4a2a-8237-c378635af4d9 req-ed0cf31d-675a-407c-aa27-ff6f7384c4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d", "name": "network-vif-deleted", "tag": "be4c4639-9aeb-438a-ab03-55e2f2e5de57"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:54.757818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-785ea401-235b-4a2a-8237-c378635af4d9 req-ed0cf31d-675a-407c-aa27-ff6f7384c4bd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:54.758776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-785ea401-235b-4a2a-8237-c378635af4d9 req-ed0cf31d-675a-407c-aa27-ff6f7384c4bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:54.759450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-785ea401-235b-4a2a-8237-c378635af4d9 req-ed0cf31d-675a-407c-aa27-ff6f7384c4bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:54.778582 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-69d33e22-7c05-41f6-b29e-ae97ae22d0df tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/1641443392/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053909 Oct 17 15:26:54.780182 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 639/1371] 10.222.0.87 () {60 vars in 1224 bytes} [Mon Oct 17 15:26:54 2022] POST /compute/v2.1/flavors/1641443392/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:26:54.785217 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-785ea401-235b-4a2a-8237-c378635af4d9 req-ed0cf31d-675a-407c-aa27-ff6f7384c4bd service nova] Creating event network-vif-deleted:be4c4639-9aeb-438a-ab03-55e2f2e5de57 for instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d on n-h1-854441-12 Oct 17 15:26:54.801318 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-785ea401-235b-4a2a-8237-c378635af4d9 req-ed0cf31d-675a-407c-aa27-ff6f7384c4bd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073630 Oct 17 15:26:54.801932 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 733/1372] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:55.076430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c791c6c-f646-492d-8588-b31322e0fa4d tempest-FlavorsExtraSpecsTestJSON-1770516730 tempest-FlavorsExtraSpecsTestJSON-1770516730-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.090440 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0c791c6c-f646-492d-8588-b31322e0fa4d tempest-FlavorsExtraSpecsTestJSON-1770516730 tempest-FlavorsExtraSpecsTestJSON-1770516730-project] 10.222.0.87 "GET /compute/v2.1/flavors/1641443392/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.303123 Oct 17 15:26:55.098320 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 640/1373] 10.222.0.87 () {58 vars in 1203 bytes} [Mon Oct 17 15:26:54 2022] GET /compute/v2.1/flavors/1641443392/os-extra_specs => generated 66 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:26:55.103259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-617a984c-6c53-4f6b-a9ab-e2927728655e tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:55.136171 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-617a984c-6c53-4f6b-a9ab-e2927728655e tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/1641443392/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037175 Oct 17 15:26:55.137793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 734/1374] 10.222.0.87 () {60 vars in 1224 bytes} [Mon Oct 17 15:26:55 2022] POST /compute/v2.1/flavors/1641443392/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:26:55.148616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b084231f-caf4-4576-b4b0-5f8d39160fc7 tempest-FlavorsExtraSpecsTestJSON-1770516730 tempest-FlavorsExtraSpecsTestJSON-1770516730-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.161029 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b084231f-caf4-4576-b4b0-5f8d39160fc7 tempest-FlavorsExtraSpecsTestJSON-1770516730 tempest-FlavorsExtraSpecsTestJSON-1770516730-project] 10.222.0.87 "GET /compute/v2.1/flavors/1641443392/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.017075 Oct 17 15:26:55.161739 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 641/1375] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/flavors/1641443392/os-extra_specs/hw:numa_nodes => generated 22 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:26:55.173306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.174300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:55.186465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.188317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-632370f6-7e14-4c4c-9a7c-f5755eff64c3 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:55.189034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.190234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.192062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.195026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.196224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.222816 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-632370f6-7e14-4c4c-9a7c-f5755eff64c3 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors/1641443392/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053402 Oct 17 15:26:55.224147 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 642/1376] 10.222.0.87 () {60 vars in 1224 bytes} [Mon Oct 17 15:26:55 2022] POST /compute/v2.1/flavors/1641443392/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:26:55.229561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.230680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:55.239530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.240424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.241448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.242370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.243090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.243705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.286286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.286835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.287292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.287759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lazy-loading 'fault' on Instance uuid 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:26:55.356614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:55.360435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:55.368869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:55.371365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:55.379506 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9aa15be9-ba5d-43db-919d-fd669b546eee tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1535 microversion: 2.91 time: 0.153913 Oct 17 15:26:55.380398 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 643/1377] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1535 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:55.387043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e123678b-8de4-46d0-b397-74fce284ff96 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.399342 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e123678b-8de4-46d0-b397-74fce284ff96 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/1641443392/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017696 Oct 17 15:26:55.400266 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 644/1378] 10.222.0.87 () {58 vars in 1203 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/flavors/1641443392/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:26:55.404524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0cca33970f49f1b9b6fa9830451dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f6e3a7889145b2be55c1a543f6e9cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:55.407428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.408774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:55.425951 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-159ffbe8-d20e-446f-b6cb-c764a2aa96c9 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 200 len: 1306 microversion: 2.1 time: 0.258263 Oct 17 15:26:55.426910 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 735/1379] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 1306 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:55.432126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-05a7ee62-7ec0-49e3-a7f0-5997e063f365 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:55.435472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.435966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.436469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.444341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.446049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.446722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.484697 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-05a7ee62-7ec0-49e3-a7f0-5997e063f365 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "PUT /compute/v2.1/flavors/1641443392/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.056680 Oct 17 15:26:55.485293 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 736/1380] 10.222.0.87 () {60 vars in 1265 bytes} [Mon Oct 17 15:26:55 2022] PUT /compute/v2.1/flavors/1641443392/os-extra_specs/hw:numa_nodes => generated 22 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:26:55.497403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b6a738f-d2de-497a-aca5-ac55599c8530 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.522604 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b6a738f-d2de-497a-aca5-ac55599c8530 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/1641443392/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028940 Oct 17 15:26:55.523697 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 737/1381] 10.222.0.87 () {58 vars in 1203 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/flavors/1641443392/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:26:55.534046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24b525bf-ed2f-4efa-a8b1-bfa65f085ae0 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.594548 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24b525bf-ed2f-4efa-a8b1-bfa65f085ae0 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1641443392/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.065190 Oct 17 15:26:55.595207 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 738/1382] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:26:55 2022] DELETE /compute/v2.1/flavors/1641443392/os-extra_specs/hw:numa_nodes => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 17 15:26:55.603503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ec69a8a-bbed-4003-b70c-0c0f365ab73b tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.649799 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ec69a8a-bbed-4003-b70c-0c0f365ab73b tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1641443392/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.049903 Oct 17 15:26:55.651189 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 739/1383] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:26:55 2022] DELETE /compute/v2.1/flavors/1641443392/os-extra_specs/hw:cpu_policy => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 15:26:55.665133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25136dc3-eecd-4d04-897c-f5dbfb96593a tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.675324 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25136dc3-eecd-4d04-897c-f5dbfb96593a tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/1641443392/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018596 Oct 17 15:26:55.678145 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 740/1384] 10.222.0.87 () {58 vars in 1203 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/flavors/1641443392/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 15:26:55.692451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e197dd9-e8d7-4232-93d3-d1b56f037314 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.734808 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e197dd9-e8d7-4232-93d3-d1b56f037314 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1641443392" status: 202 len: 0 microversion: 2.1 time: 0.047815 Oct 17 15:26:55.735551 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 741/1385] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:26:55 2022] DELETE /compute/v2.1/flavors/1641443392 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:26:55.756462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:55.767445 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0d789d86-1b33-40ee-9641-b4d35bd5c957 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 0.364249 Oct 17 15:26:55.767720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9954d321-a302-4bb4-afc5-8629a14b4a02 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.768759 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 645/1386] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:55.785786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.788844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:55.801099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:26:55.803271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.804129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.804831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.805802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.806528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.807381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.856647 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9954d321-a302-4bb4-afc5-8629a14b4a02 tempest-FlavorsExtraSpecsTestJSON-524823718 tempest-FlavorsExtraSpecsTestJSON-524823718-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.102753 Oct 17 15:26:55.857292 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 742/1387] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:55.872251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:55.873001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:55.888136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.890594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.893524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:55.905143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:55.910052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:55.914131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.055194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:56.067571 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9474163-762a-4e30-bc35-11576b93c098 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1269 microversion: 2.1 time: 0.206965 Oct 17 15:26:56.084637 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 743/1388] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:56.091775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:56.101104 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e44444cb-e705-4a8e-90c3-c2418dd7e190 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.330893 Oct 17 15:26:56.105599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21f3777a-0b41-4e25-9216-2104285fe46d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:56.106766 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 646/1389] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:55 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:56.107885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21f3777a-0b41-4e25-9216-2104285fe46d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:56.114839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f3777a-0b41-4e25-9216-2104285fe46d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.115621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f3777a-0b41-4e25-9216-2104285fe46d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.116268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f3777a-0b41-4e25-9216-2104285fe46d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.117203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f3777a-0b41-4e25-9216-2104285fe46d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.117861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f3777a-0b41-4e25-9216-2104285fe46d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.118487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21f3777a-0b41-4e25-9216-2104285fe46d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.410479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:56.411121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:56.424906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.425617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.429020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.429937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.431386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.431518 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21f3777a-0b41-4e25-9216-2104285fe46d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1815 microversion: 2.1 time: 0.345331 Oct 17 15:26:56.431953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.432064 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 744/1390] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:56 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1815 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:56.460530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:56.461147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] [instance: 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:56.478478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.478994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.479426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.480133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.480630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.480990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.512715 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] HTTP exception thrown: Instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d could not be found. Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Request method failure captured: Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d HTTP/1.1 Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOz1a8h7pYjcLLGCoanaRdKUCyFhoux7OYM4CNpxarL9RN9SScEWm9dtR864YMYsuxqK2c1BqpZhDLarJtcjl7NT2DKSOcwbXyJMJhHJDsII7l0dU9z3UHVNFTruNnFIBGpY5Vj8YrQNsVIwOZJLCTy4lW4eu-YXCi-1iGbM1YyqOQ Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:26:56.515829 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44f6e3a7889145b2be55c1a543f6e9cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 44f6e3a7889145b2be55c1a543f6e9cb Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-820586396 Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8e0cca33970f49f1b9b6fa9830451dc0 Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsTestJSON-820586396-project Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d could not be found. Oct 17 15:26:56.517197 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d'} Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d could not be found. Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:26:56.518061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d could not be found. Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d could not be found. Oct 17 15:26:56.519334 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:26:56.526127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Returning 404 to user: Instance 2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:26:56.527365 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c2d4511-64bf-495e-93f5-10cac82829f0 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d" status: 404 len: 111 microversion: 2.1 time: 0.070896 Oct 17 15:26:56.528201 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 745/1391] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:56 2022] GET /compute/v2.1/servers/2efd65d2-a75d-462a-a1e7-dfc2d7ad6d3d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:26:56.538956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f7f4bcd-b8c0-451b-ab97-aee20d8310df tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:56.549881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7f4bcd-b8c0-451b-ab97-aee20d8310df tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.550381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7f4bcd-b8c0-451b-ab97-aee20d8310df tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.553091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7f4bcd-b8c0-451b-ab97-aee20d8310df tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.555372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7f4bcd-b8c0-451b-ab97-aee20d8310df tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.555911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7f4bcd-b8c0-451b-ab97-aee20d8310df tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.557058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7f4bcd-b8c0-451b-ab97-aee20d8310df tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.615797 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f7f4bcd-b8c0-451b-ab97-aee20d8310df tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.075734 Oct 17 15:26:56.617282 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 746/1392] 10.222.0.87 () {58 vars in 1176 bytes} [Mon Oct 17 15:26:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:56.625803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7813378-ed0f-4c40-9858-19fe474aebf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28be99af70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:56.656500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:56.676292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:56.680063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:56.687112 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e7eccc69-2670-4794-901e-194b2ab4ef4b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1538 microversion: 2.91 time: 0.281630 Oct 17 15:26:56.688093 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 647/1393] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:56 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1538 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:26:56.710075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8c7a7fdf-3ecc-4191-a3d2-f6bb990f8e4e req-c3ef9d88-74a6-444a-9c78-a18753edb189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e39bc6c0-63e8-43f1-8b4a-15706f69c7d3", "tag": "6247badd-4d3d-447a-9d04-eb66dbfdaf3f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:56.783879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8c7a7fdf-3ecc-4191-a3d2-f6bb990f8e4e req-c3ef9d88-74a6-444a-9c78-a18753edb189 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.784376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8c7a7fdf-3ecc-4191-a3d2-f6bb990f8e4e req-c3ef9d88-74a6-444a-9c78-a18753edb189 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.788714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8c7a7fdf-3ecc-4191-a3d2-f6bb990f8e4e req-c3ef9d88-74a6-444a-9c78-a18753edb189 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.816974 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8c7a7fdf-3ecc-4191-a3d2-f6bb990f8e4e req-c3ef9d88-74a6-444a-9c78-a18753edb189 service nova] Creating event network-changed:6247badd-4d3d-447a-9d04-eb66dbfdaf3f for instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 on n-h1-854441-12 Oct 17 15:26:56.832050 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8c7a7fdf-3ecc-4191-a3d2-f6bb990f8e4e req-c3ef9d88-74a6-444a-9c78-a18753edb189 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142095 Oct 17 15:26:56.833890 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 648/1394] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:26:56.840416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-854441-12"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:26:56.843427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:56.878345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.883702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.888056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.889247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:56.889338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:56.889739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:56.982370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-854441-12". {{(pid=120407) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 15:26:57.093186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-226942ca-e722-48e1-9968-7a5dd6e54cc4 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1/action" status: 202 len: 0 microversion: 2.91 time: 0.257335 Oct 17 15:26:57.093862 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 649/1395] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:26:56 2022] POST /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:26:57.101540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:57.102226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:57.109514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:57.109514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:57.109985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:57.110678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:57.111306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:57.111828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:57.913163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:57.925760 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f870c545-90ff-4078-ae7f-144699ad35a2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 0.830488 Oct 17 15:26:57.928924 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 650/1396] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:57 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:57.939028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:57.939707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:57.953171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:57.954815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:57.955382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:57.956211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:57.957073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:57.957554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:58.176428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:58.185783 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc08363f-ad16-49f1-af94-84cfdf799ead tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1275 microversion: 2.1 time: 0.250963 Oct 17 15:26:58.186377 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 651/1397] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:57 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:58.224112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:58.224996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:58.239725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:58.241365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:58.255221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:58.256739 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7813378-ed0f-4c40-9858-19fe474aebf4 tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/84465c56-38cc-454c-aadb-3c764f8d8a5b" status: 202 len: 0 microversion: 2.1 time: 1.637889 Oct 17 15:26:58.260782 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 747/1398] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:56 2022] DELETE /compute/v2.1/os-security-groups/84465c56-38cc-454c-aadb-3c764f8d8a5b => generated 0 bytes in 1640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:58.262576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:58.264496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:58.266019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:58.267435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:58.268085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:58.284464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:58.285088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:58.285626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:58.289730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:58.290339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:58.290910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:58.428585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:58.457752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:58.459874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:58.488572 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2763f3c8-8b3a-4464-ba2b-730683e93fd4 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1486 microversion: 2.91 time: 0.268595 Oct 17 15:26:58.489771 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 652/1399] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:58 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1486 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:26:58.499400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-756c01e7-a4b1-4924-a6d0-9d2b3b2443ff tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] Calling method '.version_select at 0x7f28bec6c9d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:58.592042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:58.622998 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-614411fc-7183-494a-b276-1bee5f5c29d2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.362042 Oct 17 15:26:58.626026 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 748/1400] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:58 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:58.953423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:58.954038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:58.971306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:58.971997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:58.972599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:58.973475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:58.974075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:58.974682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:59.015542 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-756c01e7-a4b1-4924-a6d0-9d2b3b2443ff tempest-SecurityGroupsTestJSON-820586396 tempest-SecurityGroupsTestJSON-820586396-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/5c022cea-5e62-4f49-8e07-de46833fdde0" status: 202 len: 0 microversion: 2.1 time: 0.521475 Oct 17 15:26:59.019242 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 653/1401] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:26:58 2022] DELETE /compute/v2.1/os-security-groups/5c022cea-5e62-4f49-8e07-de46833fdde0 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:26:59.221718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:59.222530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:59.236918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:59.237675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:59.238271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:59.239206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:59.239816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:59.243455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:59.431037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:59.442999 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bccd5958-b8c2-4107-9938-1227b8599d8b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 0.493412 Oct 17 15:26:59.445265 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 749/1402] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:58 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:59.526475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:59.527196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:59.541364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:59.544640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:59.546033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:59.548322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:59.550046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:59.551314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:59.655586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:59.671665 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-becdac21-48c2-4399-abd6-4edccc356ee4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 0.462231 Oct 17 15:26:59.674358 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 654/1403] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:59 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:26:59.687019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:26:59.689993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:26:59.705142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:59.706280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:59.707764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:59.711098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:26:59.712089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:26:59.712747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:26:59.826779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:59.843649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:59.845442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:26:59.853983 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7cacb77-1465-44bb-bb46-f0848899409e tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1488 microversion: 2.91 time: 0.332125 Oct 17 15:26:59.868607 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 750/1404] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:26:59 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1488 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:00.026393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:00.035637 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-554f6c88-8349-4452-be22-a960b65ff1a9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.357895 Oct 17 15:27:00.037932 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 655/1405] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:26:59 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:00.474018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:00.475473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:00.493031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:00.494911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:00.496911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:00.501573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:00.503488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:00.504899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:00.540204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:00.699880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:00.700501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:00.702977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:00.704845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:00.721981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:00.722713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:00.723307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:00.724182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:00.731762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:00.732385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:00.958249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=18 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:01.181306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:01.192612 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0419a906-2d2d-4dc2-8016-6bc80ac681f5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 0.726375 Oct 17 15:27:01.211009 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 751/1406] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:00 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:01.219189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:01.220209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:01.243588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:01.244486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:01.245099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:01.246684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:01.247516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:01.248328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:01.352386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:01.371188 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07dec06a-a822-4f51-83b0-3b5a410d5b0d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 0.672131 Oct 17 15:27:01.376173 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 656/1407] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:00 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:01.389290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-425905ed-7c92-4cf7-bf23-540e38cf29f6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "089479ce-f5b9-4be7-bbb9-6852816fdd76", "device": "/dev/xvdb"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:01.392636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-425905ed-7c92-4cf7-bf23-540e38cf29f6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:01.400859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-425905ed-7c92-4cf7-bf23-540e38cf29f6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:01.401637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-425905ed-7c92-4cf7-bf23-540e38cf29f6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:01.402075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-425905ed-7c92-4cf7-bf23-540e38cf29f6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:01.405522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-425905ed-7c92-4cf7-bf23-540e38cf29f6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:01.407164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-425905ed-7c92-4cf7-bf23-540e38cf29f6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:01.407612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-425905ed-7c92-4cf7-bf23-540e38cf29f6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:01.411436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:01.420985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:01.422437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:01.428798 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5fc372cc-68a1-407a-b503-1fdacef4a695 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.216206 Oct 17 15:27:01.445408 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 752/1408] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:01 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:01.457512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:01.467685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:01.487682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:01.488290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:01.488290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:01.491001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:01.491475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:01.494136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:01.918018 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-425905ed-7c92-4cf7-bf23-540e38cf29f6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "POST /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538024 Oct 17 15:27:01.920953 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 657/1409] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:27:01 2022] POST /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments => generated 194 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:02.220072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:02.221023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:02.245962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:02.250129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:02.252420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:02.255022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:02.259540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:02.260207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:02.533507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:02.567050 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3c8852c-5c47-4c8b-880e-a9e6c98b7708 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 1.119147 Oct 17 15:27:02.573515 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 753/1410] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:01 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:02.600059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2f3bfd36-44c2-47ba-a0f5-5aaacc7e2f37 req-c9a46238-2699-4b01-8183-c40dce9b14da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852fe346-2528-459b-a160-3db1a514aef8", "tag": "790b7695-63c4-4c60-9541-d80765d15e14"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:02.632816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2f3bfd36-44c2-47ba-a0f5-5aaacc7e2f37 req-c9a46238-2699-4b01-8183-c40dce9b14da service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:02.633733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2f3bfd36-44c2-47ba-a0f5-5aaacc7e2f37 req-c9a46238-2699-4b01-8183-c40dce9b14da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:02.634422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2f3bfd36-44c2-47ba-a0f5-5aaacc7e2f37 req-c9a46238-2699-4b01-8183-c40dce9b14da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:02.663469 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2f3bfd36-44c2-47ba-a0f5-5aaacc7e2f37 req-c9a46238-2699-4b01-8183-c40dce9b14da service nova] Creating event network-changed:790b7695-63c4-4c60-9541-d80765d15e14 for instance 852fe346-2528-459b-a160-3db1a514aef8 on n-h2-854441-12 Oct 17 15:27:02.682354 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2f3bfd36-44c2-47ba-a0f5-5aaacc7e2f37 req-c9a46238-2699-4b01-8183-c40dce9b14da service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105657 Oct 17 15:27:02.689983 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 754/1411] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:02.707989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:02.715630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:02.730683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:DELETE=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:02.734984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:02.736714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:02.737483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:02.740816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:02.743865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:02.744573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:02.895412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:02.911671 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf315713-e392-4ab7-9f45-483d3762daab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 0.697227 Oct 17 15:27:02.913731 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 658/1412] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:02 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:02.930210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:02.931727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:02.948595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:02.950808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:02.952081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:02.955684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:02.956790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:02.957866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:03.130252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:03.152050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:03.160276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:03.163650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:03.174297 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-be5fc632-a2bd-42ab-9f99-68bcf25a2b50 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.255102 Oct 17 15:27:03.178008 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 659/1413] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:02 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:03.193127 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ee0abcb-95c9-4fb2-aca3-112f49896156 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 0.500161 Oct 17 15:27:03.193726 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 755/1414] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:02 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:03.597466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:03.598230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:03.649844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8597d462-32d7-4e6f-bc61-3f1d079b8d5d tempest-FlavorsV261TestJSON-1817215086 tempest-FlavorsV261TestJSON-1817215086-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-793892131", "id": 558727860, "os-flavor-access:is_public": "True"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:03.651856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:03.653987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:03.657526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:03.659749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:03.665811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:03.667632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:03.734022 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8597d462-32d7-4e6f-bc61-3f1d079b8d5d tempest-FlavorsV261TestJSON-1817215086 tempest-FlavorsV261TestJSON-1817215086-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.550404 Oct 17 15:27:03.749593 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 660/1415] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:27:03 2022] POST /compute/v2.1/flavors => generated 464 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:27:04.013424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3357ece1-8f0f-4b83-976d-e3a396e0f599 tempest-FlavorsV261TestJSON-1291616603 tempest-FlavorsV261TestJSON-1291616603-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:04.033438 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3357ece1-8f0f-4b83-976d-e3a396e0f599 tempest-FlavorsV261TestJSON-1291616603 tempest-FlavorsV261TestJSON-1291616603-project] 10.222.0.87 "GET /compute/v2.1/flavors/558727860" status: 200 len: 464 microversion: 2.61 time: 0.278977 Oct 17 15:27:04.038107 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 661/1416] 10.222.0.87 () {60 vars in 1196 bytes} [Mon Oct 17 15:27:03 2022] GET /compute/v2.1/flavors/558727860 => generated 464 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:27:04.078742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:04.081694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:04.104284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:04.107608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:04.109198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:04.128346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:04.130871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:04.132608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:04.203122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:04.462570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:04.473229 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63421490-8f71-4ab5-afef-3b25d15b9254 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.882679 Oct 17 15:27:04.475073 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 756/1417] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:03 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:04.491345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e98b3e89-4e17-46d6-abe4-daf7051cae17 tempest-FlavorsV261TestJSON-1817215086 tempest-FlavorsV261TestJSON-1817215086-project-admin] Action: 'update', calling method: .version_select at 0x7f28c0aba550>, body: {"flavor": {"description": "new"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:04.566057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e98b3e89-4e17-46d6-abe4-daf7051cae17 tempest-FlavorsV261TestJSON-1817215086 tempest-FlavorsV261TestJSON-1817215086-project-admin] 10.222.0.87 "PUT /compute/v2.1/flavors/558727860" status: 200 len: 465 microversion: 2.61 time: 0.089659 Oct 17 15:27:04.575134 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 757/1418] 10.222.0.87 () {62 vars in 1216 bytes} [Mon Oct 17 15:27:04 2022] PUT /compute/v2.1/flavors/558727860 => generated 465 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:27:04.585607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:04.586477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:04.598614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:04.603253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:04.603932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:04.604838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:04.605451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:04.607032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:04.965955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:04.997521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:04.999344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:05.017318 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-646c54a7-acdb-4579-9dea-2f4e026cdd6b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.440604 Oct 17 15:27:05.017851 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 758/1419] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:04 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:05.022465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:05.043503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:05.051797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:05.053528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:05.054421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:05.055511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:05.056527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:05.057209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:05.311551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:05.339775 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9c8b8a00-6331-48f1-9537-49bdd466ffd4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 1.290240 Oct 17 15:27:05.340625 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 662/1420] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:04 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:05.345818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b780844a-7588-4010-ae3b-17b8fba1d8e0 tempest-FlavorsV261TestJSON-1291616603 tempest-FlavorsV261TestJSON-1291616603-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:05.436933 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b780844a-7588-4010-ae3b-17b8fba1d8e0 tempest-FlavorsV261TestJSON-1291616603 tempest-FlavorsV261TestJSON-1291616603-project] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.094685 Oct 17 15:27:05.437580 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 663/1421] 10.222.0.87 () {60 vars in 1187 bytes} [Mon Oct 17 15:27:05 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:05.461969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bac72cc9-3d4f-4ba4-9351-a09c9902b8d2 tempest-FlavorsV261TestJSON-1291616603 tempest-FlavorsV261TestJSON-1291616603-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:05.490469 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bac72cc9-3d4f-4ba4-9351-a09c9902b8d2 tempest-FlavorsV261TestJSON-1291616603 tempest-FlavorsV261TestJSON-1291616603-project] 10.222.0.87 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.032358 Oct 17 15:27:05.504267 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 664/1422] 10.222.0.87 () {60 vars in 1166 bytes} [Mon Oct 17 15:27:05 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:05.837116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:05.842047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:05.855851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:05.857044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:05.857771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:05.860087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:05.882126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:05.884360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:06.464116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:06.482304 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c73eb5a5-6284-4f4b-b7cf-d208e6b5536b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.975833 Oct 17 15:27:06.483853 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 665/1423] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:05 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:06.492591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-979cc92b-8919-40fb-be50-bc7628f2d135 tempest-FlavorsV261TestJSON-1817215086 tempest-FlavorsV261TestJSON-1817215086-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:06.563504 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-979cc92b-8919-40fb-be50-bc7628f2d135 tempest-FlavorsV261TestJSON-1817215086 tempest-FlavorsV261TestJSON-1817215086-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/558727860" status: 202 len: 0 microversion: 2.61 time: 0.074771 Oct 17 15:27:06.573751 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 666/1424] 10.222.0.87 () {60 vars in 1199 bytes} [Mon Oct 17 15:27:06 2022] DELETE /compute/v2.1/flavors/558727860 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:27:06.577666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:06.582773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:06.594778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:06.612175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:06.612626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:06.613070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:06.613786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:06.641640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:06.642260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:07.011019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:07.031984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:07.044135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:07.045616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:07.050777 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d362b18-2fd0-4b12-9726-c08141305ccf tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 2.031696 Oct 17 15:27:07.064879 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 759/1425] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:05 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:07.091646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:07.100737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:07.110724 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f7eb7980-a149-483e-9d5d-902a5bd0d88a tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.535002 Oct 17 15:27:07.130541 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 667/1426] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:06 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:07.149607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-01e187b5-53c7-47d6-bf9b-60ecdcc80bbd tempest-FlavorsV261TestJSON-1817215086 tempest-FlavorsV261TestJSON-1817215086-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:07.164197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:07.170390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:07.172509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:07.174680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:07.178203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:07.181056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:07.229573 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-01e187b5-53c7-47d6-bf9b-60ecdcc80bbd tempest-FlavorsV261TestJSON-1817215086 tempest-FlavorsV261TestJSON-1817215086-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.095223 Oct 17 15:27:07.246552 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 668/1427] 10.222.0.87 () {60 vars in 1187 bytes} [Mon Oct 17 15:27:07 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:07.515183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:07.515183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:07.534126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:07.538086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:07.541189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:07.550238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:07.557245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:07.560876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:08.069172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:08.086603 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b12a210f-c80b-4899-aea0-2e5437d8798d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 1.020157 Oct 17 15:27:08.091655 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 760/1428] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:07 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:08.134547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:08.138702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:08.157778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:08.167093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:08.167651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:08.168488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:08.177636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:08.178230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:08.885005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:08.897809 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b62f62d7-887b-4a17-bc5d-72d2bc748ed2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 1.389092 Oct 17 15:27:08.919373 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 669/1429] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:07 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:08.931797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:08.934736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:08.951539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:08.952439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:08.955730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:08.958661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:08.960138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:08.961337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:09.118330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:09.136815 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d321785-656a-447d-ac7a-2b21c5314517 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 1.038135 Oct 17 15:27:09.148537 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 761/1430] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:08 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:09.164192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:09.165367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:09.179269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:09.180158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:09.183884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:09.185190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:09.190938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:09.195449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:09.216174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:09.247654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:09.267667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:09.307053 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fa49e7f2-965b-4948-8552-dca9870eeaf6 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.383026 Oct 17 15:27:09.311916 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 670/1431] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:08 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:09.852671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:09.862314 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-836fb5a4-cd6d-454b-8f97-e16a9e6a2c6b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 0.712118 Oct 17 15:27:09.868860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 762/1432] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:09 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:09.941694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:09.942453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:09.958971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:09.964404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:09.971170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:09.975117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:09.975901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:09.976570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:10.049245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f34d6f1-d703-4add-9444-e8b1f6115953 tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] Calling method '.version_select at 0x7f28bec1cca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:10.623987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:10.640748 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a50b686-872a-46e5-96ef-2a1fb12ba595 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.695697 Oct 17 15:27:10.641501 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 763/1433] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:09 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:10.686173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:10.688266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:10.719702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:10.721709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:10.723170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:10.726299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:10.727129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:10.729505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:10.950729 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f34d6f1-d703-4add-9444-e8b1f6115953 tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] 10.222.0.87 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.332035 Oct 17 15:27:10.959852 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 671/1434] 10.222.0.87 () {58 vars in 1149 bytes} [Mon Oct 17 15:27:09 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 15:27:10.965449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:10.966222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:11.010890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:11.011835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:11.012525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:11.015896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:11.016775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:11.020318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:11.334493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:11.348244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:11.350040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:11.356562 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b78a784a-931c-4aab-8f9b-db4dee6e295c tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.395245 Oct 17 15:27:11.357726 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 672/1435] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:10 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:11.378909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:11.379545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:11.392996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:11.393496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:11.393944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:11.400742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:11.401248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:11.401709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:11.509026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:11.533538 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e62eeaf-a221-4e80-ad67-8152c6073ff7 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 0.890705 Oct 17 15:27:11.550235 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 764/1436] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:10 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:11.582428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16a786cd-fc0c-44c9-898d-1f2fe99ad0af tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] Action: 'create', calling method: .version_select at 0x7f28be99c3a0>, body: {"pool": "non_exist_pool"} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:11.753221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:11.774541 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-93cdcc73-bf5f-4fa6-b1b4-28a0f5ac090d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 0.412449 Oct 17 15:27:11.798799 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 673/1437] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:11 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:11.802231 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-16a786cd-fc0c-44c9-898d-1f2fe99ad0af tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] HTTP exception thrown: Floating IP pool not found. Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16a786cd-fc0c-44c9-898d-1f2fe99ad0af tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] Request method failure captured: Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 26 Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXRNmPGNnX9mP8-UagzZkXxFE614MgTvcGcDZfHNbWfriHd0NykAWzGGOMa7kf6NV8mNvFl-k-JnadYJtxlhRRYLZZA-TuCjgPfpliFF2zL-qsW-Ec6YzyZTbXGsZqcWiuy-KJdwr0gdONHAQWnHW0dDSfhWkVL4yc9VdBEwCcArolw Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: a80542689ca440abace916076bf90955 Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2020191090 Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:27:11.803945 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a80542689ca440abace916076bf90955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a80542689ca440abace916076bf90955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a80542689ca440abace916076bf90955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a80542689ca440abace916076bf90955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2020191090 Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: a80542689ca440abace916076bf90955 Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2020191090 Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FloatingIPsNegativeTestJSON-2020191090-project Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 4f9474ca367a4b5dbafbda4d1ad6949a Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2020191090-project Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: {"pool": "non_exist_pool"} Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: exception: Floating IP pool not found. Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 17 15:27:11.805439 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:27:11.806492 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16a786cd-fc0c-44c9-898d-1f2fe99ad0af tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] Returning 404 to user: Floating IP pool not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:27:11.807858 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16a786cd-fc0c-44c9-898d-1f2fe99ad0af tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.246861 Oct 17 15:27:11.812768 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 765/1438] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:27:11 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:27:11.815860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:11.816506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:11.816639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-3f35f3c1-a797-4db9-8ea3-9f76c19f45bf req-da5bc621-b838-4108-a5c3-d2e505c2d01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39bc6c0-63e8-43f1-8b4a-15706f69c7d3", "name": "network-vif-plugged", "status": "completed", "tag": "6247badd-4d3d-447a-9d04-eb66dbfdaf3f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:11.836775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3f35f3c1-a797-4db9-8ea3-9f76c19f45bf req-da5bc621-b838-4108-a5c3-d2e505c2d01d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:11.837406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3f35f3c1-a797-4db9-8ea3-9f76c19f45bf req-da5bc621-b838-4108-a5c3-d2e505c2d01d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:11.838151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3f35f3c1-a797-4db9-8ea3-9f76c19f45bf req-da5bc621-b838-4108-a5c3-d2e505c2d01d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:11.857305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:11.857949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:11.858369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:11.862328 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-3f35f3c1-a797-4db9-8ea3-9f76c19f45bf req-da5bc621-b838-4108-a5c3-d2e505c2d01d service nova] Creating event network-vif-plugged:6247badd-4d3d-447a-9d04-eb66dbfdaf3f for instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 on n-h1-854441-12 Oct 17 15:27:11.864351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:11.864873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:11.865317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:11.872578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-3f35f3c1-a797-4db9-8ea3-9f76c19f45bf req-da5bc621-b838-4108-a5c3-d2e505c2d01d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071997 Oct 17 15:27:11.873995 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 674/1439] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:11.885366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11ebce00-9e0e-4bed-81b5-2583673a517d tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] Calling method '.version_select at 0x7f28bf1e1160>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:12.015848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-11ebce00-9e0e-4bed-81b5-2583673a517d tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ba3965b6-c848-43a0-a9b7-f09152ae4def could not be found", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:27:12.016571 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-11ebce00-9e0e-4bed-81b5-2583673a517d tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] HTTP exception thrown: Floating IP not found for ID ba3965b6-c848-43a0-a9b7-f09152ae4def Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11ebce00-9e0e-4bed-81b5-2583673a517d tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] Request method failure captured: Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-floating-ips/ba3965b6-c848-43a0-a9b7-f09152ae4def HTTP/1.1 Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRNmPGNnX9mP8-UagzZkXxFE614MgTvcGcDZfHNbWfriHd0NykAWzGGOMa7kf6NV8mNvFl-k-JnadYJtxlhRRYLZZA-TuCjgPfpliFF2zL-qsW-Ec6YzyZTbXGsZqcWiuy-KJdwr0gdONHAQWnHW0dDSfhWkVL4yc9VdBEwCcArolw Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: a80542689ca440abace916076bf90955 Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2020191090 Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:27:12.018730 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a80542689ca440abace916076bf90955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a80542689ca440abace916076bf90955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a80542689ca440abace916076bf90955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a80542689ca440abace916076bf90955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2020191090 Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: a80542689ca440abace916076bf90955 Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2020191090 Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPsNegativeTestJSON-2020191090-project Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 4f9474ca367a4b5dbafbda4d1ad6949a Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2020191090-project Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: exception: Floating IP not found for ID ba3965b6-c848-43a0-a9b7-f09152ae4def Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ba3965b6-c848-43a0-a9b7-f09152ae4def'} Oct 17 15:27:12.020108 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:27:12.020934 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ba3965b6-c848-43a0-a9b7-f09152ae4def could not be found Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7e080a1-a803-4da3-b560-1ca9c678f997'] Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ba3965b6-c848-43a0-a9b7-f09152ae4def. Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:12.022145 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ba3965b6-c848-43a0-a9b7-f09152ae4def Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:27:12.025043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:27:12.028398 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ba3965b6-c848-43a0-a9b7-f09152ae4def Oct 17 15:27:12.028398 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:12.028398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11ebce00-9e0e-4bed-81b5-2583673a517d tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] Returning 404 to user: Floating IP not found for ID ba3965b6-c848-43a0-a9b7-f09152ae4def {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:27:12.028398 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-11ebce00-9e0e-4bed-81b5-2583673a517d tempest-FloatingIPsNegativeTestJSON-2020191090 tempest-FloatingIPsNegativeTestJSON-2020191090-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/ba3965b6-c848-43a0-a9b7-f09152ae4def" status: 404 len: 111 microversion: 2.1 time: 0.144559 Oct 17 15:27:12.028398 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 675/1440] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:27:11 2022] DELETE /compute/v2.1/os-floating-ips/ba3965b6-c848-43a0-a9b7-f09152ae4def => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:27:12.392850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:12.393619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:12.423024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:12.424962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:12.425541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:12.432672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:12.433181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:12.436220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:12.676525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:12.691271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:12.694403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:12.717866 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3b402f13-b57d-4b48-a2f6-fb972c6537a1 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.328262 Oct 17 15:27:12.746533 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 676/1441] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:12 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:12.777215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:12.778360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:12.816892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:12.818172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:12.818744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:12.819585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:12.820137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:12.821613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:13.205254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:13.218516 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0d00adf1-2803-4e6c-bf86-e678ce07194f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 1.411508 Oct 17 15:27:13.219130 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 766/1442] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:11 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:13.272543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:13.276539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:13.310156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:13.312325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:13.312801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:13.313552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:13.314202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:13.322930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:14.508214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:14.521963 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7a570482-ae39-4003-af9e-49404d46f4a0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 1.773417 Oct 17 15:27:14.524270 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 677/1443] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:12 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:14.534880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:14.538405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:14.551132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:14.551905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:14.552589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:14.553636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:14.554470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:14.555147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:14.765413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:14.783417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:14.790644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:14.798341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:14.808789 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-77c04952-ae9a-4355-beaa-591b356e3d75 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.283059 Oct 17 15:27:14.835480 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 678/1444] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:14 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:14.847364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-bf073c8d-0a1b-4516-8039-8772294c045a req-d2619985-2625-4b01-8af9-a581fbb55f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a05ba5-2063-49b7-92bb-7122faf92713", "name": "network-vif-plugged", "status": "completed", "tag": "18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:14.853340 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a90e50a5-726f-4d78-bc7f-8b97f9883687 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1308 microversion: 2.1 time: 1.597709 Oct 17 15:27:14.853949 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 767/1445] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:13 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1308 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:14.911871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf073c8d-0a1b-4516-8039-8772294c045a req-d2619985-2625-4b01-8af9-a581fbb55f14 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:14.918315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf073c8d-0a1b-4516-8039-8772294c045a req-d2619985-2625-4b01-8af9-a581fbb55f14 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:14.920221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf073c8d-0a1b-4516-8039-8772294c045a req-d2619985-2625-4b01-8af9-a581fbb55f14 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:14.929265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:14.936034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:14.972325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:14.980988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:14.982879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:14.983821 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bf073c8d-0a1b-4516-8039-8772294c045a req-d2619985-2625-4b01-8af9-a581fbb55f14 service nova] Creating event network-vif-plugged:18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f for instance 91a05ba5-2063-49b7-92bb-7122faf92713 on n-h2-854441-12 Oct 17 15:27:14.984763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:14.987245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:14.988144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:14.991387 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-bf073c8d-0a1b-4516-8039-8772294c045a req-d2619985-2625-4b01-8af9-a581fbb55f14 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153559 Oct 17 15:27:14.993009 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 679/1446] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:15.447677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:15.472103 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce992757-6a62-4a49-860d-0584dd52319e tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.572272 Oct 17 15:27:15.478671 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 768/1447] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:14 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:15.552764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:15.554585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:15.586584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:15.608826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:15.612255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:15.613655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:15.619754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:15.631926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:15.842384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:15.847993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:15.868937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:15.869562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:15.872045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:15.873041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:15.874295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:15.877011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:16.159534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:16.191726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:16.193509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:16.201790 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3708cb9f-3597-4538-8fae-75397336353b tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.363930 Oct 17 15:27:16.203243 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 769/1448] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:15 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:27:16.208436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:16.209050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:16.231950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:16.232614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:16.233081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:16.234451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:16.237462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:16.237965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:16.292382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:16.311661 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b42ad9b-e544-4066-96fc-5b79cad9cbf6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 0.765505 Oct 17 15:27:16.330539 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 680/1449] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:15 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:16.505677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:16.506453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:16.531603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:16.534784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:16.535408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:16.536260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:16.536714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:16.540129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:16.672122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:16.675443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:16.683576 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fcf347e9-301a-48b6-bf46-3349280c9590 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1489 microversion: 2.1 time: 0.479162 Oct 17 15:27:16.695530 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 770/1450] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:16 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1489 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:16.711273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6db37682-3922-482e-a31d-28713e37c015 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:16.733747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6db37682-3922-482e-a31d-28713e37c015 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:16.734324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6db37682-3922-482e-a31d-28713e37c015 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:16.734813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6db37682-3922-482e-a31d-28713e37c015 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:16.891260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6db37682-3922-482e-a31d-28713e37c015 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Going to try to stop instance {{(pid=120406) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 15:27:16.993074 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6db37682-3922-482e-a31d-28713e37c015 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3/action" status: 202 len: 0 microversion: 2.1 time: 0.285900 Oct 17 15:27:16.993699 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 771/1451] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:27:16 2022] POST /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:27:17.014828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:17.015634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:17.063228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:17.069793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:17.070360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:17.070871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:17.071662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:17.072150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:17.072605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:17.076843 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6a944a61-8f49-4876-96bf-5a517b1bbd13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1313 microversion: 2.1 time: 0.577793 Oct 17 15:27:17.111178 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 681/1452] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:16 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1313 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:17.128674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e51c0c9d-cfa9-487d-9096-8837c325d117 req-f229c8a6-f76d-40a2-8be9-883d8d5361ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852fe346-2528-459b-a160-3db1a514aef8", "name": "network-vif-plugged", "status": "completed", "tag": "790b7695-63c4-4c60-9541-d80765d15e14"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:17.158365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e51c0c9d-cfa9-487d-9096-8837c325d117 req-f229c8a6-f76d-40a2-8be9-883d8d5361ec service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:17.161321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e51c0c9d-cfa9-487d-9096-8837c325d117 req-f229c8a6-f76d-40a2-8be9-883d8d5361ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:17.161854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e51c0c9d-cfa9-487d-9096-8837c325d117 req-f229c8a6-f76d-40a2-8be9-883d8d5361ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:17.194150 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e51c0c9d-cfa9-487d-9096-8837c325d117 req-f229c8a6-f76d-40a2-8be9-883d8d5361ec service nova] Creating event network-vif-plugged:790b7695-63c4-4c60-9541-d80765d15e14 for instance 852fe346-2528-459b-a160-3db1a514aef8 on n-h2-854441-12 Oct 17 15:27:17.205700 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e51c0c9d-cfa9-487d-9096-8837c325d117 req-f229c8a6-f76d-40a2-8be9-883d8d5361ec service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092891 Oct 17 15:27:17.225721 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 682/1453] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:17.270582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:17.272060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:17.312578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:17.313218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:17.319367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:17.320275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:17.320755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:17.321313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:17.633232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:17.652531 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53900d86-05b2-467d-8703-c3cf94ef2d95 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.641008 Oct 17 15:27:17.654829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 772/1454] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:17 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:17.666435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:17.667101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:17.685319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:17.692207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:17.692805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:17.694038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:17.694707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:17.697292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:17.700676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:17.700676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:17.712801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:17.739282 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-655d41e2-f8aa-46ff-a74f-232f360ab94d tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.505825 Oct 17 15:27:17.742025 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 683/1455] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:17 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:17.993108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:18.001453 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a070755-7af9-4de5-add1-d662cf29582a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 0.345574 Oct 17 15:27:18.003404 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 773/1456] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:17 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:18.113814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:18.115152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:18.121766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.122612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.123258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.124173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.124832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.125460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.393414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb4f2e4b-5423-4b0a-8203-1c75829edefc tempest-AZV2TestJSON-1407576458 tempest-AZV2TestJSON-1407576458-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:18.395082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb4f2e4b-5423-4b0a-8203-1c75829edefc tempest-AZV2TestJSON-1407576458 tempest-AZV2TestJSON-1407576458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.395568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb4f2e4b-5423-4b0a-8203-1c75829edefc tempest-AZV2TestJSON-1407576458 tempest-AZV2TestJSON-1407576458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.396001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb4f2e4b-5423-4b0a-8203-1c75829edefc tempest-AZV2TestJSON-1407576458 tempest-AZV2TestJSON-1407576458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.396778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb4f2e4b-5423-4b0a-8203-1c75829edefc tempest-AZV2TestJSON-1407576458 tempest-AZV2TestJSON-1407576458-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.397178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb4f2e4b-5423-4b0a-8203-1c75829edefc tempest-AZV2TestJSON-1407576458 tempest-AZV2TestJSON-1407576458-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.397595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb4f2e4b-5423-4b0a-8203-1c75829edefc tempest-AZV2TestJSON-1407576458 tempest-AZV2TestJSON-1407576458-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.467744 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb4f2e4b-5423-4b0a-8203-1c75829edefc tempest-AZV2TestJSON-1407576458 tempest-AZV2TestJSON-1407576458-project] 10.222.0.87 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.239359 Oct 17 15:27:18.468343 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 774/1457] 10.222.0.87 () {58 vars in 1164 bytes} [Mon Oct 17 15:27:18 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:27:18.482232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:18.502462 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-adf072eb-d1d2-4291-8e3f-5e9b7d2c398f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1462 microversion: 2.1 time: 0.394596 Oct 17 15:27:18.503744 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 684/1458] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:18 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1462 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:18.530002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e73f306e-5f22-4e65-8876-30cbbdce8495 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:18.530859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e73f306e-5f22-4e65-8876-30cbbdce8495 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:18.542405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e73f306e-5f22-4e65-8876-30cbbdce8495 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.543028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e73f306e-5f22-4e65-8876-30cbbdce8495 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.543524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e73f306e-5f22-4e65-8876-30cbbdce8495 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.547444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e73f306e-5f22-4e65-8876-30cbbdce8495 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.548268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e73f306e-5f22-4e65-8876-30cbbdce8495 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.548918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e73f306e-5f22-4e65-8876-30cbbdce8495 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.678473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:18.679102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:18.681598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:18.691655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.692179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.692619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.701470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.702097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.703106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.914879 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e73f306e-5f22-4e65-8876-30cbbdce8495 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1615 microversion: 2.1 time: 0.388627 Oct 17 15:27:18.916125 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 775/1459] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:18 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1615 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:18.921771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:18.922735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:18.929242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.930028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.930773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.931714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.932380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.933022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.939064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:18.949873 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-50a72bb5-0a11-48c4-b527-79b82aa8651a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.273969 Oct 17 15:27:18.951371 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 685/1460] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:18 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:18.956197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:18.956774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:18.973431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.973926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.974560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:18.975482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:18.976128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:18.976702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:19.028995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a72c1cb213b049e195ccf33d522a70a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ac94e595be49668e583193e0d5d4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:19.030105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] flavor_id is None. Assuming migration. {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 15:27:19.032147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 15:27:19.065438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:19.077425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:19.085278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:19.090452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:19.094724 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2be9bcbd-3eb6-4d70-b475-4cd33987d7d0 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.177002 Oct 17 15:27:19.095932 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 776/1461] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:18 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:19.101402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:19.102357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:19.119220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:19.119934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:19.122000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:19.123064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:19.125040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:19.125726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:19.260403 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-76adc1ae-6c8d-4414-aac8-3e5633f503e7 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713/action" status: 202 len: 0 microversion: 2.1 time: 0.307027 Oct 17 15:27:19.261938 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 686/1462] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:27:18 2022] POST /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:27:19.273224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:19.274132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:19.283435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:19.284781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:19.285846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:19.287456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:19.288195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:19.288848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:19.626096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:19.637802 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c6ea409-644a-4742-aa04-3eb16f3f4fe6 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1317 microversion: 2.1 time: 0.540355 Oct 17 15:27:19.638457 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 777/1463] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:19 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:19.673414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:19.682970 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-efe11ab6-38bd-4c23-9340-f1bb4ebdd1eb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1471 microversion: 2.1 time: 0.414537 Oct 17 15:27:19.686690 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 687/1464] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:19 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1471 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:19.976700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:19.978837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:20.001098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:20.005776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:20.006946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:20.017739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:20.019063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:20.020979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:20.128552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:20.129610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:20.144477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:20.147637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:20.149073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:20.151202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:20.155964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:20.157820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:20.345981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:20.365747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:20.367410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:20.380847 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-670b45f0-c65e-412a-9cb4-b0f9c39a5783 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.257290 Oct 17 15:27:20.382328 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 688/1465] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:20 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:27:20.571183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:20.582565 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-115464f3-8620-4bce-bcfd-f1950e4cd22a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.612794 Oct 17 15:27:20.588383 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 778/1466] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:19 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:20.663683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:20.664438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:20.673981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:20.674940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:20.676733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:20.680373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:20.680666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:20.681561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:20.710642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:20.712032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:20.723603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:20.724103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:20.724544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:20.725258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:20.725713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:20.726138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:20.953477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:20.970948 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1298a292-b4e8-45c3-bc82-29d62aaa90ee tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1471 microversion: 2.1 time: 0.262051 Oct 17 15:27:20.973374 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 779/1467] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:20 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:21.395676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:21.413965 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6bcaa771-064e-408b-a144-a5ffcfd7133e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1466 microversion: 2.1 time: 0.754127 Oct 17 15:27:21.416730 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 689/1468] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:20 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1466 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:21.424115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:21.424810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:21.432919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:21.433802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:21.434493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:21.435696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:21.437311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:21.438166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:21.444503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f196ae5-caee-423a-b42b-72c883aaaf49 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:21.445253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7f196ae5-caee-423a-b42b-72c883aaaf49 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:21.453648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f196ae5-caee-423a-b42b-72c883aaaf49 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:21.457866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f196ae5-caee-423a-b42b-72c883aaaf49 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:21.460463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f196ae5-caee-423a-b42b-72c883aaaf49 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:21.461589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f196ae5-caee-423a-b42b-72c883aaaf49 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:21.463789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f196ae5-caee-423a-b42b-72c883aaaf49 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:21.466729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f196ae5-caee-423a-b42b-72c883aaaf49 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:21.578240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:21.596754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:21.601553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:21.609826 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da7fec16-eae6-41c8-ad3f-7724c772e413 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1544 microversion: 2.91 time: 0.193230 Oct 17 15:27:21.620532 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 780/1469] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:21 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1544 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:21.620532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:21.620532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:21.638164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:21.638696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:21.639141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:21.639853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:21.640300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:21.643810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:21.992296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:22.018335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1cf198c6-017f-4514-957e-f503a3f89104 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.405589 Oct 17 15:27:22.019601 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 781/1470] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:21 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:22.026434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:22.028058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:22.036457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:22.037248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:22.037828 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7f196ae5-caee-423a-b42b-72c883aaaf49 tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1619 microversion: 2.1 time: 0.597479 Oct 17 15:27:22.038163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:22.038840 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 690/1471] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:21 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1619 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:22.039623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:22.040380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:22.041020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:22.216252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1688866018", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e21af96d-b24a-454b-bc29-715bd73d273b"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:22.324998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:22.339831 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8c5784e-5655-40af-af4d-99d0f3b52260 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1471 microversion: 2.1 time: 0.314712 Oct 17 15:27:22.342825 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 782/1472] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:22 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:22.374323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:27:22.642137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:22.643755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:22.657913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:22.662846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:22.672397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:22.673410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:22.673987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:22.674596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:22.787081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:22.798936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:22.802430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:22.811190 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-741328ac-48ed-4392-afcc-958c412c9814 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1531 microversion: 2.91 time: 0.173628 Oct 17 15:27:22.812887 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 783/1473] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:22 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1531 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:22.841555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:22.842928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:22.851515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:22.852284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:22.853276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:22.854408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:22.855546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:22.859967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.005497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] Lazy-loading 'services' on Instance uuid 98141701-d49a-42aa-a983-c59e9d2c3ba1 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:27:23.053219 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98f20464-0b5b-4bc8-a39e-813c83292383 tempest-UnshelveToHostMultiNodesTest-2107183575 tempest-UnshelveToHostMultiNodesTest-2107183575-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1938 microversion: 2.91 time: 0.216939 Oct 17 15:27:23.056474 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 784/1474] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:22 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1938 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:23.067646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:23.070310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:23.077664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.078739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.079960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.081113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.082347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.083329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.227878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:27:23.228983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:27:23.229461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:27:23.229974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:27:23.230587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:27:23.250215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.250802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.251242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.251992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.252817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.253309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.272630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:27:23.278464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Getting quotas for user a6d13409eb044988911b34d37730b714 and project fc5aac724de34054a6a6b0a8ab32a0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:27:23.294932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:27:23.300010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:27:23.309805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:23.319614 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a44c8cab-acfd-46c6-b5d1-5db6a5100fc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.263930 Oct 17 15:27:23.320632 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 785/1475] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:23 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:23.328977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:23.329847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:23.338749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.339255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.339980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.340731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.341193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.341873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.362368 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-59d6e06a-60af-46a7-971b-e7a1fc77d942 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151050 Oct 17 15:27:23.369734 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 691/1476] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:27:23.375470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:23.377320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:23.380131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:27:23.385126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.385976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.386683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.387618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.388181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:23.388529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.389510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.513338 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa346915-1fda-458d-9e8e-74554d6b3e90 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "DELETE /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 204 len: 0 microversion: 2.91 time: 0.190558 Oct 17 15:27:23.514191 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 786/1477] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:27:23 2022] DELETE /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:27:23.521572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-503ed25d-cf18-48b7-8a52-bafa2d71ff20 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:23.522918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-503ed25d-cf18-48b7-8a52-bafa2d71ff20 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:23.653041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-503ed25d-cf18-48b7-8a52-bafa2d71ff20 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:23.666789 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-503ed25d-cf18-48b7-8a52-bafa2d71ff20 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1217 microversion: 2.1 time: 0.149213 Oct 17 15:27:23.681124 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 787/1478] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:23 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:23.695457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:23.696310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:23.708533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.709126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.709409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.710111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:23.735156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:23.736926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:23.806798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:23.827046 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3136fe4d-2870-4124-b3be-72e0e1e5fad4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1471 microversion: 2.1 time: 0.455503 Oct 17 15:27:23.829945 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 692/1479] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:23 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1471 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:23.913642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:23.929419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:23.934689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:23.951610 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e47c772-2f63-433a-bfe3-599170f87a85 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.266959 Oct 17 15:27:23.955093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 788/1480] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:23 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:24.349596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:24.352042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:24.364146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:24.365292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:24.365940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:24.367117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:24.369947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:24.371529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:24.693614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:24.694256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:24.700901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:24.701623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:24.702223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:24.702947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:24.703549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:24.704159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:24.741120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:24.750356 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c072798e-5f5b-4653-af26-f03f40a5d3f4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.409320 Oct 17 15:27:24.751388 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 693/1481] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:24 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:24.782738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:24.792892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0c03cae-f360-49c8-8e50-682509f242c9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1221 microversion: 2.1 time: 0.103048 Oct 17 15:27:24.805497 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 789/1482] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:24 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:24.855808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:24.858145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:24.871154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:24.874817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:24.876064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:24.879175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:24.882027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:24.883813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:25.040882 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4f53d272-0809-48a6-ab98-4e58fdfe6a27 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] 10.222.0.87 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.287679 Oct 17 15:27:25.048681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 694/1483] 10.222.0.87 () {58 vars in 1128 bytes} [Mon Oct 17 15:27:24 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 15:27:25.054478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:25.056066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:25.062531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:25.063043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:25.063726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:25.065217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:25.065847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:25.066431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:25.098057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:25.108198 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c1dad3c-843d-4383-b2ad-6abca92fb72b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1471 microversion: 2.1 time: 0.257046 Oct 17 15:27:25.111308 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 790/1484] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:24 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:25.118708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06f38edb-122c-4093-a715-d4b47ed1b7fb tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Calling method '.version_select at 0x7f28bebdde50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:25.195813 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-06f38edb-122c-4093-a715-d4b47ed1b7fb tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] HTTP exception thrown: Image not found. Oct 17 15:27:25.196510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06f38edb-122c-4093-a715-d4b47ed1b7fb tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Request method failure captured: Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXRc6eLJGKcXvWAS7qcB0I9UI2vipKch22AtYjV4czUMZzFzl3OJBRhtPpTsfrXiy7TVqVue4yF51_lYlkS9ly7rhN5utqNCrCVY5XjUxQJd6j25qq1h3BpZ8jMyeLtYGlx7mrt3tYGTQmiio53cM7_VbASDZyvMbvjdUL6MZkcroiI Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:27:25.200173 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: aa722c1e2f614904b8b3939e3adad76b Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: exception: Image not found. Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '-1'} Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:27:25.201923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.203148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:27:25.204720 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:27:25.206455 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.209124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06f38edb-122c-4093-a715-d4b47ed1b7fb tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:27:25.210249 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06f38edb-122c-4093-a715-d4b47ed1b7fb tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] 10.222.0.87 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.097662 Oct 17 15:27:25.217284 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 791/1485] 10.222.0.87 () {58 vars in 1134 bytes} [Mon Oct 17 15:27:25 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:27:25.218200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:25.220145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:25.238940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb9da8ce-2dc7-49a7-900d-25ee02e0586e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:25.239857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb9da8ce-2dc7-49a7-900d-25ee02e0586e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:25.250157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9da8ce-2dc7-49a7-900d-25ee02e0586e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:25.251034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9da8ce-2dc7-49a7-900d-25ee02e0586e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:25.255620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9da8ce-2dc7-49a7-900d-25ee02e0586e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:25.256854 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-908064d0-fd8a-4e15-b6b4-ba80ef1d8144 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1537 microversion: 2.91 time: 0.200507 Oct 17 15:27:25.258127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9da8ce-2dc7-49a7-900d-25ee02e0586e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:25.259186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9da8ce-2dc7-49a7-900d-25ee02e0586e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:25.259798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb9da8ce-2dc7-49a7-900d-25ee02e0586e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:25.261487 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 695/1486] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:25 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:25.272829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3f6478f2-0762-460d-afa6-39ce1d3d41e3 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Calling method '.version_select at 0x7f28bee368b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:25.328148 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-3f6478f2-0762-460d-afa6-39ce1d3d41e3 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] HTTP exception thrown: Image not found. Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3f6478f2-0762-460d-afa6-39ce1d3d41e3 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Request method failure captured: Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/7f6f092c-70d7-44f8-81d1-df0318fce51j HTTP/1.1 Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRc6eLJGKcXvWAS7qcB0I9UI2vipKch22AtYjV4czUMZzFzl3OJBRhtPpTsfrXiy7TVqVue4yF51_lYlkS9ly7rhN5utqNCrCVY5XjUxQJd6j25qq1h3BpZ8jMyeLtYGlx7mrt3tYGTQmiio53cM7_VbASDZyvMbvjdUL6MZkcroiI Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:27:25.331416 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: aa722c1e2f614904b8b3939e3adad76b Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7f6f092c-70d7-44f8-81d1-df0318fce51j'} Oct 17 15:27:25.333040 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7f6f092c-70d7-44f8-81d1-df0318fce51j to delete Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.334018 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f6f092c-70d7-44f8-81d1-df0318fce51j could not be found. Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:27:25.335635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.337093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3f6478f2-0762-460d-afa6-39ce1d3d41e3 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:27:25.338102 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3f6478f2-0762-460d-afa6-39ce1d3d41e3 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] 10.222.0.87 "DELETE /compute/v2.1/images/7f6f092c-70d7-44f8-81d1-df0318fce51j" status: 404 len: 62 microversion: 2.1 time: 0.072675 Oct 17 15:27:25.344509 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 696/1487] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:25 2022] DELETE /compute/v2.1/images/7f6f092c-70d7-44f8-81d1-df0318fce51j => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:27:25.351785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-39ed11c3-e9c3-4954-a86e-b6f10b4fda4f tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Calling method '.version_select at 0x7f28bf0f0550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:25.390071 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-39ed11c3-e9c3-4954-a86e-b6f10b4fda4f tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] HTTP exception thrown: Image not found. Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-39ed11c3-e9c3-4954-a86e-b6f10b4fda4f tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Request method failure captured: Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/1b7b0b04-83e9-4cb2-87a3-fc3e8444fff11 HTTP/1.1 Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRc6eLJGKcXvWAS7qcB0I9UI2vipKch22AtYjV4czUMZzFzl3OJBRhtPpTsfrXiy7TVqVue4yF51_lYlkS9ly7rhN5utqNCrCVY5XjUxQJd6j25qq1h3BpZ8jMyeLtYGlx7mrt3tYGTQmiio53cM7_VbASDZyvMbvjdUL6MZkcroiI Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:27:25.392991 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: aa722c1e2f614904b8b3939e3adad76b Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '1b7b0b04-83e9-4cb2-87a3-fc3e8444fff11'} Oct 17 15:27:25.395782 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1b7b0b04-83e9-4cb2-87a3-fc3e8444fff11 to delete Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.396765 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b7b0b04-83e9-4cb2-87a3-fc3e8444fff11 could not be found. Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:27:25.398139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-39ed11c3-e9c3-4954-a86e-b6f10b4fda4f tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:27:25.405465 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-39ed11c3-e9c3-4954-a86e-b6f10b4fda4f tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] 10.222.0.87 "DELETE /compute/v2.1/images/1b7b0b04-83e9-4cb2-87a3-fc3e8444fff11" status: 404 len: 62 microversion: 2.1 time: 0.049560 Oct 17 15:27:25.407342 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 697/1488] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:27:25 2022] DELETE /compute/v2.1/images/1b7b0b04-83e9-4cb2-87a3-fc3e8444fff11 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:27:25.414262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-52f63e8a-f5b4-49ec-86fb-39c513170b56 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Calling method '.version_select at 0x7f28bebfdee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:25.444286 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-52f63e8a-f5b4-49ec-86fb-39c513170b56 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] HTTP exception thrown: Image not found. Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-52f63e8a-f5b4-49ec-86fb-39c513170b56 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Request method failure captured: Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/tempest-invalid-1259989521 HTTP/1.1 Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRc6eLJGKcXvWAS7qcB0I9UI2vipKch22AtYjV4czUMZzFzl3OJBRhtPpTsfrXiy7TVqVue4yF51_lYlkS9ly7rhN5utqNCrCVY5XjUxQJd6j25qq1h3BpZ8jMyeLtYGlx7mrt3tYGTQmiio53cM7_VbASDZyvMbvjdUL6MZkcroiI Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:27:25.452248 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: aa722c1e2f614904b8b3939e3adad76b Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'tempest-invalid-1259989521'} Oct 17 15:27:25.453752 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1259989521 to delete Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.455912 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1259989521 could not be found. Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:27:25.458978 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-52f63e8a-f5b4-49ec-86fb-39c513170b56 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:27:25.462056 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-52f63e8a-f5b4-49ec-86fb-39c513170b56 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] 10.222.0.87 "DELETE /compute/v2.1/images/tempest-invalid-1259989521" status: 404 len: 62 microversion: 2.1 time: 0.049561 Oct 17 15:27:25.465095 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 698/1489] 10.222.0.87 () {58 vars in 1206 bytes} [Mon Oct 17 15:27:25 2022] DELETE /compute/v2.1/images/tempest-invalid-1259989521 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:27:25.468507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46ac7b7a-d8ac-404b-8f47-fb6870b52b35 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Calling method '.version_select at 0x7f28bebfd550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:25.493544 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-46ac7b7a-d8ac-404b-8f47-fb6870b52b35 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] HTTP exception thrown: Image not found. Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46ac7b7a-d8ac-404b-8f47-fb6870b52b35 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Request method failure captured: Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/9f26fe97-33ea-4b84-91fe-4fd3f299b305 HTTP/1.1 Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRc6eLJGKcXvWAS7qcB0I9UI2vipKch22AtYjV4czUMZzFzl3OJBRhtPpTsfrXiy7TVqVue4yF51_lYlkS9ly7rhN5utqNCrCVY5XjUxQJd6j25qq1h3BpZ8jMyeLtYGlx7mrt3tYGTQmiio53cM7_VbASDZyvMbvjdUL6MZkcroiI Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:27:25.496253 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7b12a54c0a384c178bf4cca637478a3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7b12a54c0a384c178bf4cca637478a3a Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193 Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: aa722c1e2f614904b8b3939e3adad76b Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2031610193-project Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '9f26fe97-33ea-4b84-91fe-4fd3f299b305'} Oct 17 15:27:25.497881 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9f26fe97-33ea-4b84-91fe-4fd3f299b305 to delete Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.498914 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f26fe97-33ea-4b84-91fe-4fd3f299b305 could not be found. Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:27:25.500317 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:27:25.501976 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:25.504531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46ac7b7a-d8ac-404b-8f47-fb6870b52b35 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:27:25.505624 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-46ac7b7a-d8ac-404b-8f47-fb6870b52b35 tempest-ImagesDeleteNegativeTestJSON-2031610193 tempest-ImagesDeleteNegativeTestJSON-2031610193-project] 10.222.0.87 "DELETE /compute/v2.1/images/9f26fe97-33ea-4b84-91fe-4fd3f299b305" status: 404 len: 62 microversion: 2.1 time: 0.042596 Oct 17 15:27:25.515330 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 699/1490] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:25 2022] DELETE /compute/v2.1/images/9f26fe97-33ea-4b84-91fe-4fd3f299b305 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:27:25.617590 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb9da8ce-2dc7-49a7-900d-25ee02e0586e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1861 microversion: 2.1 time: 0.398591 Oct 17 15:27:25.636093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 792/1491] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:25 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1861 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:25.666654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854441-12", "block_migration": true, "disk_over_commit": false}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:25.674027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:25.696339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:25.698230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:25.700352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:25.701362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:25.707518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:25.708520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:25.777461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:25.778364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:25.782637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:25.804083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:25.804589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:25.805032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:25.805769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:25.806238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:25.816376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:25.851639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lazy-loading 'flavor' on Instance uuid c128f7c3-d3e6-4664-979e-e424581346e1 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:27:25.920175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Going to try to live migrate instance to n-h2-854441-12 {{(pid=120407) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 15:27:26.102166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:26.116302 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5082fa00-0ab7-4831-9b71-749f0a8f24ea tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.342695 Oct 17 15:27:26.116918 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 793/1492] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:25 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:26.139477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:26.142686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:26.159953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:26.169156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:26.171041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:26.172833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:26.173824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:26.175926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:26.311155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:26.320229 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4b1674e-3586-467f-9ac9-a56bcf25174a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1269 microversion: 2.1 time: 0.184884 Oct 17 15:27:26.322934 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 794/1493] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:26 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:26.338995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:26.345274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:26.360567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:26.361080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:26.361533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:26.372028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:26.372861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:26.373500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:26.662670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:26.675134 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9bf3bc9-20b3-4420-9fbe-9f5c9e363760 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1471 microversion: 2.1 time: 0.350865 Oct 17 15:27:26.676791 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 795/1494] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:26 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1471 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:26.683819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:26.684720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:26.710635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:26.726277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:26.726991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:26.729030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:26.730087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:26.735216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:26.849448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:26.850017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:26.850381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:26.850977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lazy-loading 'fault' on Instance uuid 98141701-d49a-42aa-a983-c59e9d2c3ba1 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:27:26.999336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:27.017961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:27.019702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1325e6aaa6a944cb9e228919f32b3c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56c4114ed54db3ad1dea0866ea96a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:27.048022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-75b7ff5a-f23c-46f9-ab47-ef677cdd8361 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 200 len: 1542 microversion: 2.91 time: 0.369789 Oct 17 15:27:27.049024 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 796/1495] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:26 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 1542 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:27.143734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:27.144382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:27.163015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:27.163505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:27.165476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:27.168216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:27.170487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:27.172588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:27.963547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:27.978042 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e49814de-7585-462e-b4a1-c5c64114513b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.840408 Oct 17 15:27:27.981430 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 797/1496] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:27 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:27.997959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:27.998792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:28.011807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:28.012615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:28.013755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:28.015078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:28.016056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:28.016795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:28.128949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:28.144880 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eedf2e7e-f933-409c-8e2c-139e8bbd25ca tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1275 microversion: 2.1 time: 0.153078 Oct 17 15:27:28.145784 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 798/1497] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:27 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:28.158694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:28.159574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:28.178211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:28.179008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:28.179639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:28.180527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:28.181138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:28.181721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:28.409384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:28.434060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:28.444594 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8bc18dc6-3579-45b0-813a-8ebe6cf3390b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.297496 Oct 17 15:27:28.445602 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 799/1498] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:28 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:28.452884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:28.453552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] [instance: 98141701-d49a-42aa-a983-c59e9d2c3ba1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:28.477270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:28.477783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:28.478357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:28.479951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:28.480875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:28.481538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:28.529069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] HTTP exception thrown: Instance 98141701-d49a-42aa-a983-c59e9d2c3ba1 could not be found. Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Request method failure captured: Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 HTTP/1.1 Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOgWDicZRCPh6WkGNw9TDLhMUOaU2GJdptgNCAMPuV8UYGc0eEB-TXG9ypq2TR4E4I5tqldbg63azPXdbQtt8qYgAyRkBR78W_lTCZqPRTZHTAVK37Ct1g-VdSTA911E-81xtsZeZFqu3dyriHg3b3ht-d7xdRKvMms_ZuTG2A4pUs Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.91 Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ff56c4114ed54db3ad1dea0866ea96a0 Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1417965867 Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:27:28.533691 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ff56c4114ed54db3ad1dea0866ea96a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ff56c4114ed54db3ad1dea0866ea96a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ff56c4114ed54db3ad1dea0866ea96a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ff56c4114ed54db3ad1dea0866ea96a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1417965867 Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ff56c4114ed54db3ad1dea0866ea96a0 Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1417965867 Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-UnshelveToHostMultiNodesTest-1417965867-project Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1325e6aaa6a944cb9e228919f32b3c06 Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1417965867-project Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 98141701-d49a-42aa-a983-c59e9d2c3ba1 could not be found. Oct 17 15:27:28.535284 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '98141701-d49a-42aa-a983-c59e9d2c3ba1'} Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98141701-d49a-42aa-a983-c59e9d2c3ba1 could not be found. Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:27:28.536189 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98141701-d49a-42aa-a983-c59e9d2c3ba1 could not be found. Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98141701-d49a-42aa-a983-c59e9d2c3ba1 could not be found. Oct 17 15:27:28.537619 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:27:28.540948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] Returning 404 to user: Instance 98141701-d49a-42aa-a983-c59e9d2c3ba1 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:27:28.542385 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f883ff6-097d-4fd3-aae9-c6593fa94090 tempest-UnshelveToHostMultiNodesTest-1417965867 tempest-UnshelveToHostMultiNodesTest-1417965867-project] 10.222.0.87 "GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1" status: 404 len: 111 microversion: 2.91 time: 0.095645 Oct 17 15:27:28.549706 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 800/1499] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:28 2022] GET /compute/v2.1/servers/98141701-d49a-42aa-a983-c59e9d2c3ba1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:27:29.012563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:29.013596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:29.030640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:29.032315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:29.033346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:29.036438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:29.039107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:29.039881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:29.663016 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e450c3ef-3995-41a7-afaa-073a2188e84e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/action" status: 202 len: 0 microversion: 2.1 time: 4.003550 Oct 17 15:27:29.663639 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 700/1500] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:27:25 2022] POST /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/action => generated 0 bytes in 4005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:27:29.669544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:29.670437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:29.696663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:29.697164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:29.697606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:29.698335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:29.709666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:29.710466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:29.894404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:29.905139 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1aa6084-8a4f-4cfa-aa40-6bd5e469213c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.903225 Oct 17 15:27:29.905736 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 801/1501] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:29 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:29.923175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:29.925181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:29.941991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:29.942486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:29.942944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:29.943658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:29.944108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:29.944531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:30.058220 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:27:30.058686 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 15:27:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 (ip 10.222.0.87) !!! Oct 17 15:27:30.089667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:30.108200 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ae01075d-0318-424b-89c8-8ab606d397b5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.443290 Oct 17 15:27:30.128849 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 701/1502] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:29 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:30.138700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:30.141727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:30.170163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:30.170703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:30.171155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:30.171871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:30.172499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:30.173126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:30.517753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:30.531956 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d013de40-902b-47cd-9b56-b1166ff38aff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.399401 Oct 17 15:27:30.549103 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 702/1503] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:30 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:30.712198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:30.725940 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5fd3389a-ff60-4e6a-8868-4d7d17ad3fa9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.816875 Oct 17 15:27:30.727214 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 802/1504] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:29 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:30.931639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:30.932244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:30.948450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:30.949238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:30.949838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:30.950753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:30.951359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:30.955356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:31.133630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:31.134673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:31.144827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:31.145640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:31.146330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:31.147304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:31.147981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:31.148622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:31.449512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:31.478354 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e248f1b-fa3f-49b4-86c8-eff8703528c4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.551155 Oct 17 15:27:31.484129 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 703/1505] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:30 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:31.513008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:31.535933 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a90dfe54-5abb-407b-ac7d-748527e77645 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.406418 Oct 17 15:27:31.537141 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 803/1506] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:31 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:31.560929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:31.561951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:31.583703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:31.587164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:31.587880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:31.595520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:31.596812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:31.597483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:31.756930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:31.757563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:31.782441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:31.783795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:31.813889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:31.814720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:31.841287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:31.842185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:31.856590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:32.111303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:32.126699 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99789964-7af6-433e-b281-82796e2d0ea4 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.571071 Oct 17 15:27:32.129695 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 704/1507] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:31 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:32.391188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:32.407529 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-517d2de4-f9c7-4d06-aaef-e06099e6517d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.661539 Oct 17 15:27:32.409757 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 804/1508] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:31 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:32.508898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:32.509525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:32.517953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:32.518576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:32.518987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:32.519718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:32.520295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:32.520744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:32.794345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ae191f8e-f9b8-4233-97cd-25c9b9d6a374 req-5b05fdce-b638-4460-99fa-5941ebb9028e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be11174e-4f4c-4199-972c-0a92c5f3ef77", "tag": "f09fb33e-5463-4c71-9c57-a4ba031471b2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:32.826763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ae191f8e-f9b8-4233-97cd-25c9b9d6a374 req-5b05fdce-b638-4460-99fa-5941ebb9028e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:32.827632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ae191f8e-f9b8-4233-97cd-25c9b9d6a374 req-5b05fdce-b638-4460-99fa-5941ebb9028e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:32.827802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ae191f8e-f9b8-4233-97cd-25c9b9d6a374 req-5b05fdce-b638-4460-99fa-5941ebb9028e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:32.849796 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ae191f8e-f9b8-4233-97cd-25c9b9d6a374 req-5b05fdce-b638-4460-99fa-5941ebb9028e service nova] Creating event network-changed:f09fb33e-5463-4c71-9c57-a4ba031471b2 for instance be11174e-4f4c-4199-972c-0a92c5f3ef77 on n-h1-854441-12 Oct 17 15:27:32.870673 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ae191f8e-f9b8-4233-97cd-25c9b9d6a374 req-5b05fdce-b638-4460-99fa-5941ebb9028e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.739244 Oct 17 15:27:32.873622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 705/1509] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:32.887396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:32.889842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:32.913562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:32.916688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:32.917626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:32.922418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:32.925137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:32.926035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:32.998062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:33.263277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:33.286979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:33.409269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:33.440283 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9d842cda-c349-4017-b5d6-fdfd9471a19f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.561656 Oct 17 15:27:33.444867 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 706/1510] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:32 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:33.463861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:33.464586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:33.493781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:33.494292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:33.494757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:33.495478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:33.495930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:33.497893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:33.661708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:34.010824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:34.026348 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-266adff2-87a5-404c-aa3b-a9c30c025de6 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.574801 Oct 17 15:27:34.027756 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 707/1511] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:33 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:34.044567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:34.045492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:34.052932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:34.053811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:34.054465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:34.055528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:34.056210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:34.056929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:34.379856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:34.405553 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-254b199c-7b07-49a3-bef2-2b5366f1d429 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.376358 Oct 17 15:27:34.410237 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 708/1512] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:34 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:34.472967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:34.473932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:34.487470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:34.488813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:34.495464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:34.498128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:34.500001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:34.501346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:34.799654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:34.819482 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c05ea33f-5c87-485a-afb9-0a94cba7325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 2.313925 Oct 17 15:27:34.822085 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 805/1513] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:32 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:35.027469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:35.040974 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1380df60-bdbd-48c6-9d24-53a435ecb18d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.575011 Oct 17 15:27:35.041622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 709/1514] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:34 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:35.056679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:35.057433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:35.086815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:35.087917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:35.088709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:35.091201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:35.096926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:35.097841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:35.438286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:35.440562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:35.461081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:35.462038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:35.462670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:35.464224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:35.467155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:35.467801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:35.874948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:35.875341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:35.923889 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94d95aed-8ec5-4722-af12-52b432962689 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.872735 Oct 17 15:27:35.924373 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b001bf51-8f9f-46f0-aead-485257de8684 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.496106 Oct 17 15:27:35.925387 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 710/1515] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:35 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:35.928104 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 806/1516] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:35 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:35.934310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:35.935600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:35.945028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:35.954551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:35.955227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:35.956223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:35.956888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:35.957467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:36.066821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:36.073887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:36.089260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:36.089791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:36.096409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:36.097572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:36.099558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:36.101121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:36.573899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:36.594326 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc39bc58-3e02-445a-8264-eab3dd27f2f2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.665366 Oct 17 15:27:36.595502 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 711/1517] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:35 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:36.814628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:36.827923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ba3c2e1-6b96-4bf5-a287-577ae5d5281f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.766874 Oct 17 15:27:36.829274 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 807/1518] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:36 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:36.949422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:36.949688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:36.950153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:36.950424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:36.959457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:36.961497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:36.961708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:36.962390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:36.963005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:36.963146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:36.963739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:36.964204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:36.965953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:36.966468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:36.968367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:36.969065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:37.731929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:37.752407 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b9465087-4120-498e-8f68-cbc7a57ce272 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.801772 Oct 17 15:27:37.753455 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 712/1519] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:36 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:37.778738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:37.782846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:37.806388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:37.807918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:37.808364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:37.809087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:37.812766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:37.814675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:38.339900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:38.349191 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a0e918eb-bee8-4d56-93d3-7ab6d4fcafb4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.588281 Oct 17 15:27:38.349799 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 713/1520] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:37 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:38.354405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:38.363261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:38.374275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:38.377400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:38.378018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:38.381127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:38.383321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:38.383984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:38.402211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:38.415871 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c91d3137-7cb3-46e1-99e6-59e9c0285edd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 1.467920 Oct 17 15:27:38.431563 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 808/1521] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:36 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:38.782994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:38.784638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:38.791566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:38.799534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:38.800752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:38.801527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:38.803258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:38.803695 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc50c890-6092-430c-8f9f-9537c29a0f37 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.452832 Oct 17 15:27:38.804129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:38.804301 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 714/1522] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:38 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:38.821360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:39.378094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:39.379324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:39.388725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:39.389529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:39.390327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:39.391325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:39.391945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:39.392558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:39.704069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:39.721991 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51a2dbf9-c447-405e-a99c-3b3fa402cfa9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.940062 Oct 17 15:27:39.723120 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 809/1523] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:38 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:39.740873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:39.741535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:39.764656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:39.765566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:39.766366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:39.767544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:39.768512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:39.769267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:40.146262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:40.154393 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7227144d-0406-445b-8e30-d11ecc938500 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.783795 Oct 17 15:27:40.155018 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 715/1524] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:39 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:40.176833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:40.177770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:40.200455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:40.201261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:40.201877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:40.202876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:40.203536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:40.204131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:40.313960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:40.324695 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a62d315-b717-4c71-a9df-2fcd661e56cb tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.599710 Oct 17 15:27:40.334596 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 810/1525] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:39 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:40.604274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-492931802", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "e1442722-4c96-4091-8992-f20bac8a7206"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:40.661206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:40.670224 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d029ae3f-51ab-4f1a-8b98-cf119e9e3f06 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.504909 Oct 17 15:27:40.676889 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 716/1526] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:40 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:40.697930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] validate_networks() for [('e1442722-4c96-4091-8992-f20bac8a7206', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:27:40.748330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:40.748955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:40.766465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:40.766998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:40.767439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:40.768164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:40.768617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:40.769350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:41.096925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:41.113836 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aca93527-44a2-493b-bf55-f0df740dc5ae tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.369755 Oct 17 15:27:41.114463 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 717/1527] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:40 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:41.179799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:41.180592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:41.194180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:41.194705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:41.195339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:41.207636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:41.208386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:41.209017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:41.824011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:41.832248 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f55e621-c5b7-48a4-9813-8ad0a2541cfa tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.657261 Oct 17 15:27:41.835228 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 718/1528] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:41 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:41.840030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:41.840642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:41.871863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:41.872814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:41.873289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:41.876997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:41.884114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:41.886987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:42.712525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:42.728929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97b9c3ed-5af1-469b-9dde-64e5b8fb0067 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.892533 Oct 17 15:27:42.731427 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 719/1529] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:41 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:42.751514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:42.752570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:42.775760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:42.778615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:42.779557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:42.784961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:42.786185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:42.787302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:42.818973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:27:42.819580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:27:42.820319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:27:42.821109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:27:42.821655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:27:42.844646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:42.848316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:42.853304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:42.854872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:42.855638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:42.856350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:42.910242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Getting quotas for project 947ae7af631447ca8963b47e913fb618. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:27:42.928398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Getting quotas for user 62f7ab17b8454d049b81bdd07e41e62f and project 947ae7af631447ca8963b47e913fb618. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:27:42.962477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:27:42.981091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:27:43.091270 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dea391e4-92e3-4166-b922-72c87a6e8bfa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.760937 Oct 17 15:27:43.094595 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 811/1530] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:27:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:27:43.105024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:43.108974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:43.141989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:43.142709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:43.143815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:43.148122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:43.149529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:43.152476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:43.328463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:43.342801 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-45203714-c4ba-4f1f-90c8-b1b61a8183c1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.607432 Oct 17 15:27:43.353306 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 720/1531] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:42 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:43.387022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:43.387652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:43.406052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:43.406647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:43.407092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:43.407818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:43.408282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:43.408709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:43.659016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:43.670581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9de3dd36-4daa-48ae-af15-a73d806b6535 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.573856 Oct 17 15:27:43.702537 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 812/1532] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:43 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:43.702537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-471ec941-7462-42f1-8d96-be43d52b1e0b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:43.702537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-471ec941-7462-42f1-8d96-be43d52b1e0b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:43.866297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-471ec941-7462-42f1-8d96-be43d52b1e0b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:43.878532 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-471ec941-7462-42f1-8d96-be43d52b1e0b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1217 microversion: 2.1 time: 0.188798 Oct 17 15:27:43.880631 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 813/1533] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:43 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:43.893207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:43.895435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:43.914694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:43.915356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:43.919014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:43.921613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:43.923289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:43.924392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:44.327361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:44.351232 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e0ecbc21-53cd-4717-8462-a049683e268f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.980154 Oct 17 15:27:44.352310 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 721/1534] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:43 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:44.384788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:44.385816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:44.405345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:44.407141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:44.408021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:44.413218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:44.414159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:44.415328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:44.814301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:44.830598 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b52dd60-ff84-4b40-b089-24d5e357d005 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.946903 Oct 17 15:27:44.833489 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 814/1535] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:43 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:44.860179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:44.861147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:44.872853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:44.889309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:44.890298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:44.892594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:44.894896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:44.895542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:45.043258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:45.052276 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-19a40df4-a61f-43a1-af20-f77a40f9e112 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.673398 Oct 17 15:27:45.059686 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 722/1536] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:44 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:45.065035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:45.071095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:45.090204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:45.095157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:45.095987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:45.096965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:45.097678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:45.098330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:45.153116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:45.237302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:45.245708 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-46be41d0-d23f-4148-b57d-8e52b6e6347b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1269 microversion: 2.1 time: 0.184447 Oct 17 15:27:45.262674 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 723/1537] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:45 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:45.378524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:45.380101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:45.392083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:45.408220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:45.410602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:45.413182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:45.414351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:45.416198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:46.040190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:46.048999 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36c94215-d36e-43f7-9efc-c919c43784ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.674592 Oct 17 15:27:46.066985 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 724/1538] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:45 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:46.072347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:46.076757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:46.077601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:46.085651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:46.086378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:46.087115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:46.088197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:46.088821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:46.089406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:46.091495 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a2b7e73-f0a0-47b9-b236-163dcef8f3e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 1.254137 Oct 17 15:27:46.092599 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 815/1539] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:44 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:46.115982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:46.116823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:46.136516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:46.137352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:46.147564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:46.148435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:46.148913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:46.149344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:46.578086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:46.598346 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16cd0a67-9199-47ea-922a-9a187412a92b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.504591 Oct 17 15:27:46.599305 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 816/1540] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:46 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:46.618596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:46.620165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:46.631815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:46.634408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:46.643045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:46.644384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:46.645362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:46.645986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:46.772719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:46.785851 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d27bcb9-4fcb-464a-b882-99c951485f6c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1275 microversion: 2.1 time: 0.185181 Oct 17 15:27:46.786829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 817/1541] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:46 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:46.888845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2e5991ff-f72d-43ad-a825-12014971c125 req-099d747a-1e1a-4337-bcc3-d5568d65be59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be11174e-4f4c-4199-972c-0a92c5f3ef77", "name": "network-vif-plugged", "status": "completed", "tag": "f09fb33e-5463-4c71-9c57-a4ba031471b2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:46.909354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2e5991ff-f72d-43ad-a825-12014971c125 req-099d747a-1e1a-4337-bcc3-d5568d65be59 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:46.911247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2e5991ff-f72d-43ad-a825-12014971c125 req-099d747a-1e1a-4337-bcc3-d5568d65be59 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:46.912140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2e5991ff-f72d-43ad-a825-12014971c125 req-099d747a-1e1a-4337-bcc3-d5568d65be59 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:46.950231 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2e5991ff-f72d-43ad-a825-12014971c125 req-099d747a-1e1a-4337-bcc3-d5568d65be59 service nova] Creating event network-vif-plugged:f09fb33e-5463-4c71-9c57-a4ba031471b2 for instance be11174e-4f4c-4199-972c-0a92c5f3ef77 on n-h1-854441-12 Oct 17 15:27:46.966860 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2e5991ff-f72d-43ad-a825-12014971c125 req-099d747a-1e1a-4337-bcc3-d5568d65be59 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173852 Oct 17 15:27:46.968246 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 818/1542] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:47.084046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:47.084732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:47.099654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:47.100153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:47.100586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:47.101298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:47.101786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:47.102179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:47.440211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:47.455434 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a683d27-18d7-4b82-8ee9-9939f5447c1d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1499 microversion: 2.1 time: 0.376567 Oct 17 15:27:47.470933 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 819/1543] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:47 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1499 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:47.488718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:47.489348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:47.496026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:47.496526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:47.496965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:47.497678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:47.498141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:47.498626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:47.623699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:47.634784 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e8d53a9c-12a8-4621-9b82-7d1f74eb072f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 1.566436 Oct 17 15:27:47.635706 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 725/1544] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:46 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:47.653623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:47.655162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:47.664163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:47.664828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:47.665370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:47.666276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:47.667623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:47.668817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:48.094901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:48.109629 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8f57488-6994-42e9-8bce-e05e16c912e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.635863 Oct 17 15:27:48.113304 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 820/1545] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:47 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:48.118424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:48.125419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:48.140902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:48.141400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:48.141986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:48.142734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:48.143181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:48.143597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:48.353386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:48.372921 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bbe9ed30-e4ea-4a7c-8ae2-2258dc5c8f6c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1317 microversion: 2.1 time: 0.732825 Oct 17 15:27:48.376461 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 726/1546] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:47 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1317 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:48.383183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:48.397335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ce5d8de-45cc-4e36-b380-e19e76412bbe tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1275 microversion: 2.1 time: 0.282764 Oct 17 15:27:48.410004 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 821/1547] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:48 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1275 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:48.486151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:48.507115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:48.531782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:48.532476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:48.532934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:48.537135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:48.537571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:48.538434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:48.620803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aca2d91e-61d2-4c94-b629-b033815cf050 tempest-FloatingIPDetailsNegativeTestJSON-2120472609 tempest-FloatingIPDetailsNegativeTestJSON-2120472609-project] Calling method '.version_select at 0x7f28bea4a430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:48.940914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:48.965575 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e02d462-8724-43e2-87e2-20d7faf747ed tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 200 len: 1476 microversion: 2.1 time: 0.486128 Oct 17 15:27:48.967422 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 822/1548] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:48 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 1476 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:48.980876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:48.981496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:48.990517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:48.991513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:48.992220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:48.993123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:48.993737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:48.994317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:48.999328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:49.252244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-aca2d91e-61d2-4c94-b629-b033815cf050 tempest-FloatingIPDetailsNegativeTestJSON-2120472609 tempest-FloatingIPDetailsNegativeTestJSON-2120472609-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 78247664-3b6b-4c54-9ab2-88ecde681759 could not be found", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:27:49.253001 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-aca2d91e-61d2-4c94-b629-b033815cf050 tempest-FloatingIPDetailsNegativeTestJSON-2120472609 tempest-FloatingIPDetailsNegativeTestJSON-2120472609-project] HTTP exception thrown: Floating IP not found for ID 78247664-3b6b-4c54-9ab2-88ecde681759 Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aca2d91e-61d2-4c94-b629-b033815cf050 tempest-FloatingIPDetailsNegativeTestJSON-2120472609 tempest-FloatingIPDetailsNegativeTestJSON-2120472609-project] Request method failure captured: Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-floating-ips/78247664-3b6b-4c54-9ab2-88ecde681759 HTTP/1.1 Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR0VJr8NXwf7bUiCofkufGIOP2ylsFFdnEoe3sbHPgEwEc1AzQrW_I2kLlCXJVzm-fzLCmqqwihmJwThWBs08z0E2AS-kxYqeG-oYZyh_DtIf4-EewSU1RrX8xQ53o3D5ue2DRgse-6Z0t-R1a-uVQkc1gaGiB3RVuwyGOD9guf0z8 Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: a1b0da34ed38410989155401e2a6155a Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2120472609 Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:27:49.267963 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a1b0da34ed38410989155401e2a6155a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a1b0da34ed38410989155401e2a6155a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a1b0da34ed38410989155401e2a6155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a1b0da34ed38410989155401e2a6155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2120472609 Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: a1b0da34ed38410989155401e2a6155a Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2120472609 Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2120472609-project Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 5cc4b9d5ebf847fa87695987b3a94a1d Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2120472609-project Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: exception: Floating IP not found for ID 78247664-3b6b-4c54-9ab2-88ecde681759 Oct 17 15:27:49.269795 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '78247664-3b6b-4c54-9ab2-88ecde681759'} Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:49.270830 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 78247664-3b6b-4c54-9ab2-88ecde681759 could not be found Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a56463f-7b4c-4f71-8924-5bf37cc3e3a5'] Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 78247664-3b6b-4c54-9ab2-88ecde681759. Oct 17 15:27:49.272272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 78247664-3b6b-4c54-9ab2-88ecde681759 Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:27:49.275119 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:27:49.277158 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:27:49.277158 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 78247664-3b6b-4c54-9ab2-88ecde681759 Oct 17 15:27:49.277158 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:27:49.277158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aca2d91e-61d2-4c94-b629-b033815cf050 tempest-FloatingIPDetailsNegativeTestJSON-2120472609 tempest-FloatingIPDetailsNegativeTestJSON-2120472609-project] Returning 404 to user: Floating IP not found for ID 78247664-3b6b-4c54-9ab2-88ecde681759 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:27:49.277158 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aca2d91e-61d2-4c94-b629-b033815cf050 tempest-FloatingIPDetailsNegativeTestJSON-2120472609 tempest-FloatingIPDetailsNegativeTestJSON-2120472609-project] 10.222.0.87 "GET /compute/v2.1/os-floating-ips/78247664-3b6b-4c54-9ab2-88ecde681759" status: 404 len: 111 microversion: 2.1 time: 0.822640 Oct 17 15:27:49.277158 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 727/1549] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:27:48 2022] GET /compute/v2.1/os-floating-ips/78247664-3b6b-4c54-9ab2-88ecde681759 => generated 111 bytes in 825 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:27:49.290115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-869a7eec-af22-4fed-be40-75d1e97170c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-950213294"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:49.304969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-869a7eec-af22-4fed-be40-75d1e97170c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:49.325736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:49.327924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-869a7eec-af22-4fed-be40-75d1e97170c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:49.328753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-869a7eec-af22-4fed-be40-75d1e97170c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:49.330570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-869a7eec-af22-4fed-be40-75d1e97170c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:49.333789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-869a7eec-af22-4fed-be40-75d1e97170c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:49.334466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-869a7eec-af22-4fed-be40-75d1e97170c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:49.335089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-869a7eec-af22-4fed-be40-75d1e97170c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:49.589289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:49.620563 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7706a54b-e4dd-4605-b916-94df477f67e1 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.651801 Oct 17 15:27:49.621823 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 823/1550] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:48 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:49.647446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:49.648498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:49.657023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:49.663199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:49.665158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:49.667571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:49.672226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:49.680538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:49.983172 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-869a7eec-af22-4fed-be40-75d1e97170c2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3/action" status: 202 len: 0 microversion: 2.1 time: 0.708993 Oct 17 15:27:49.987200 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 728/1551] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:27:49 2022] POST /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:27:50.005316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:50.008188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:50.017185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:50.018026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:50.018650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:50.019531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:50.020151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:50.020733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:50.139744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:50.148975 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb2165b1-a8b8-4d29-9b36-6490586fd32a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.525274 Oct 17 15:27:50.155995 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 824/1552] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:49 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:50.163520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:50.169807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:50.205635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:50.208110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:50.215341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:50.218628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:50.219951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:50.222835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:50.714481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:50.740916 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-886d6923-204e-40b7-8b61-f96f73468089 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1467 microversion: 2.1 time: 0.751801 Oct 17 15:27:50.741836 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 729/1553] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:49 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1467 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:50.899998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1892825188", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "367a2d39-b572-49e0-b719-9b2cdd9cfe38"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:50.995434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] validate_networks() for [('367a2d39-b572-49e0-b719-9b2cdd9cfe38', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:27:51.106737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:51.117464 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf80726b-bab5-4bf5-9ebe-3f15141bf998 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 0.960118 Oct 17 15:27:51.127168 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 825/1554] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:50 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:51.142315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b6dc76e-5f1e-499b-8f3c-97c8f9003ea6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28beb84f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:51.201941 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b6dc76e-5f1e-499b-8f3c-97c8f9003ea6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.073505 Oct 17 15:27:51.211118 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 826/1555] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:27:51 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:51.221085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:51.224160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:51.237589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:51.238364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:51.240282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:51.241193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:51.243568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:51.244242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:51.944891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:51.953557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-182bac4d-904d-4f14-8a37-3b33ce166117 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.740904 Oct 17 15:27:51.958531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 827/1556] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:51 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:51.975066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbf860f9-4bd4-43a5-9cb5-51892270194d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:51.985703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbf860f9-4bd4-43a5-9cb5-51892270194d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:51.993250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf860f9-4bd4-43a5-9cb5-51892270194d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:51.994024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf860f9-4bd4-43a5-9cb5-51892270194d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:51.994986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf860f9-4bd4-43a5-9cb5-51892270194d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:51.996477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf860f9-4bd4-43a5-9cb5-51892270194d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:52.000213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf860f9-4bd4-43a5-9cb5-51892270194d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:52.000975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf860f9-4bd4-43a5-9cb5-51892270194d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:52.215983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:27:52.216527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:27:52.223311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:27:52.223822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:27:52.224248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:27:52.254341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:52.254883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:52.263339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:52.264281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:52.264692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:52.265173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:52.351166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:27:52.367717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for user 54134ad155cf45d19f6a551710c84a9e and project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:27:52.400387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:27:52.409743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:27:52.426104 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbf860f9-4bd4-43a5-9cb5-51892270194d tempest-ServersOnMultiNodesTest-988119134 tempest-ServersOnMultiNodesTest-988119134-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1620 microversion: 2.1 time: 0.466125 Oct 17 15:27:52.426746 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 828/1557] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:51 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1620 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:52.435790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:52.436415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:52.456647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:52.457157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:52.457582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:52.458266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:52.458749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:52.459171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:52.525947 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f13b46f0-9d69-4af9-8560-c34a3af93411 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.770067 Oct 17 15:27:52.527971 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 730/1558] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:27:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:27:52.699794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-896258723", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "d03e9e4b-e4e4-4807-a6fd-a00d165be1a3"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:52.846365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] validate_networks() for [('d03e9e4b-e4e4-4807-a6fd-a00d165be1a3', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:27:52.878215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:53.413752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:53.436778 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62762cd4-2d3b-4c37-8f1d-deafb7795a8a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 1.008910 Oct 17 15:27:53.441128 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 829/1559] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:52 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:53.457285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:53.463483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:53.502558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:53.517692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:53.519337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:53.520458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:53.521381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:53.522048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:53.875380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:54.285250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:54.300062 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2cec5c2-0c23-4037-ae07-8e128b77acc7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 0.851592 Oct 17 15:27:54.304007 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 830/1560] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:53 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:54.316585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36739c21-ba2b-4861-a1e7-ac3e750a264e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bedbe0d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:54.452672 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36739c21-ba2b-4861-a1e7-ac3e750a264e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.144020 Oct 17 15:27:54.456296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 831/1561] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:27:54 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:54.641589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2eb9a77d-d61e-4c68-97ee-b1ee1bcdfae9 req-def41252-1d25-4b2c-ae77-ffc1e3f474ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a6c5fc-30ba-49b2-ab11-747aae6d7f21", "tag": "1d89e5eb-f096-4fd6-ad9f-76b4586513f1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:54.661466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2eb9a77d-d61e-4c68-97ee-b1ee1bcdfae9 req-def41252-1d25-4b2c-ae77-ffc1e3f474ec service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:54.661949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2eb9a77d-d61e-4c68-97ee-b1ee1bcdfae9 req-def41252-1d25-4b2c-ae77-ffc1e3f474ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:54.662432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2eb9a77d-d61e-4c68-97ee-b1ee1bcdfae9 req-def41252-1d25-4b2c-ae77-ffc1e3f474ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:54.691930 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2eb9a77d-d61e-4c68-97ee-b1ee1bcdfae9 req-def41252-1d25-4b2c-ae77-ffc1e3f474ec service nova] Creating event network-changed:1d89e5eb-f096-4fd6-ad9f-76b4586513f1 for instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 on n-h2-854441-12 Oct 17 15:27:54.710388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2eb9a77d-d61e-4c68-97ee-b1ee1bcdfae9 req-def41252-1d25-4b2c-ae77-ffc1e3f474ec service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236311 Oct 17 15:27:54.712136 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 832/1562] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:54.718706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:54.719764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:54.733002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:54.737808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:54.738962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:54.739868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:54.740480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:54.741057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:54.806828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:27:54.957318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:54.962920 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29411004-e5a3-4906-93cf-aa447436967a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 204 len: 0 microversion: 2.1 time: 0.249251 Oct 17 15:27:54.963502 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 833/1563] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:27:54 2022] DELETE /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:27:54.977381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:54.978354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:54.985562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:54.986293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:54.987012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:54.987992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:54.988726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:54.989376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:55.125845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:27:55.127324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:27:55.127963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:27:55.128533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:27:55.129807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:27:55.143523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:55.145014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:55.145720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:55.146718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:55.147390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:55.148024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:55.201124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Getting quotas for project 4e0a35484bd44be0938aaabdee3cf4c2. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:27:55.218863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Getting quotas for user e5d69af6a3c14dbab949c56fde26ff95 and project 4e0a35484bd44be0938aaabdee3cf4c2. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:27:55.247124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:27:55.251951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:27:55.336724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:55.346335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:55.354331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:55.363224 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c8f973f-14fb-429e-a7e0-de38afe60828 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1314 microversion: 2.25 time: 0.398330 Oct 17 15:27:55.368071 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 834/1564] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:54 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:55.385959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-33b65bbf-c39f-4f87-a3ac-4c35c3c0d230 req-be2ca51b-a46b-4ea6-a1cb-f5aac8149824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c128f7c3-d3e6-4664-979e-e424581346e1", "name": "network-vif-unplugged", "status": "completed", "tag": "0ae18c17-0b0d-49c1-8d85-94306923e42f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:55.399011 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-00db82a0-f896-4da4-a5b8-665418a6db33 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.869452 Oct 17 15:27:55.400005 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 731/1565] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:27:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:27:55.406175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:55.413485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:55.430266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:55.431181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:55.431812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:55.433040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:55.435768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:55.436924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:55.450031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-33b65bbf-c39f-4f87-a3ac-4c35c3c0d230 req-be2ca51b-a46b-4ea6-a1cb-f5aac8149824 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:55.450590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-33b65bbf-c39f-4f87-a3ac-4c35c3c0d230 req-be2ca51b-a46b-4ea6-a1cb-f5aac8149824 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:55.475201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-33b65bbf-c39f-4f87-a3ac-4c35c3c0d230 req-be2ca51b-a46b-4ea6-a1cb-f5aac8149824 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:55.516479 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-33b65bbf-c39f-4f87-a3ac-4c35c3c0d230 req-be2ca51b-a46b-4ea6-a1cb-f5aac8149824 service nova] Creating event network-vif-unplugged:0ae18c17-0b0d-49c1-8d85-94306923e42f for instance c128f7c3-d3e6-4664-979e-e424581346e1 on n-h1-854441-12 Oct 17 15:27:55.532471 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-33b65bbf-c39f-4f87-a3ac-4c35c3c0d230 req-be2ca51b-a46b-4ea6-a1cb-f5aac8149824 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162696 Oct 17 15:27:55.538730 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 835/1566] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:55.570046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:55.572714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:55.606274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:55.606917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:55.607510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:55.608251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:55.608710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:55.609207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:55.919601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:55.928757 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-82cf0593-1862-47fe-883c-8a4f4cd0bb56 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.527433 Oct 17 15:27:55.930157 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 732/1567] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:55 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:55.938567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:55.939522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:55.948357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:55.949342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:55.950083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:55.951139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:55.951823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:55.952666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:56.198138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:56.214361 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b0454622-11b6-4462-abba-a4ef22741002 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1473 microversion: 2.1 time: 0.282150 Oct 17 15:27:56.217859 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 733/1568] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:55 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:56.225254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:56.228554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:56.242518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:56.246667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:56.247234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:56.248204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:56.248960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:56.249669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:56.270919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:56.281505 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04bd5aa3-32cd-4be9-be31-937046c8d81f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.739823 Oct 17 15:27:56.291959 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 836/1569] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:55 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:56.306366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe959b1c-ac8a-47a4-afbf-ee06918221df tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:56.308683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe959b1c-ac8a-47a4-afbf-ee06918221df tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:56.507060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:56.510522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe959b1c-ac8a-47a4-afbf-ee06918221df tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:56.551364 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-039b38b4-c580-4053-a4a8-90c0560f110f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 0.331908 Oct 17 15:27:56.551977 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 734/1570] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:56 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:56.575953 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe959b1c-ac8a-47a4-afbf-ee06918221df tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1224 microversion: 2.1 time: 0.251156 Oct 17 15:27:56.576826 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 837/1571] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:56 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1224 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:56.590649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:56.596327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:56.620039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:56.625089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-71282c3f-ca72-43eb-9411-ca5b46d41be7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c30089d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:56.625457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:56.625976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:56.626804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:56.645566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:56.647965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:56.729032 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-71282c3f-ca72-43eb-9411-ca5b46d41be7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.109225 Oct 17 15:27:56.730706 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 735/1572] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:27:56 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:56.857470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:56.878186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:56.889150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:56.891191 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8f6600f-17fb-4290-851e-e6b3a86ed98f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1314 microversion: 2.25 time: 0.312957 Oct 17 15:27:56.897795 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 838/1573] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:56 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:56.954207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:56.955892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:56.975053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:56.977000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:56.997490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:57.000321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:57.001000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:57.001625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:57.245540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:57.246534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:57.268186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:57.277348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:57.278479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:57.282231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:57.282780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:57.283223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:57.434437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:57.449024 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-14027b08-f8c2-4fd5-a9c1-d2fa3da1e9cc tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 0.499363 Oct 17 15:27:57.463670 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 736/1574] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:56 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:57.477573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:57.478619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:57.492633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:57.507659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:57.510242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:57.511828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:57.513519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:57.515191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.017512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:58.040149 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1fb228f3-88c2-4804-b9d9-3d99b0798ea2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.574799 Oct 17 15:27:58.041469 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 737/1575] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:57 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:58.046665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:58.053710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:58.095761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.098914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.099530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.100771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.101378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.104351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.326545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:58.339302 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97538888-1a7b-4d0d-81fd-b52bac97dd2c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1473 microversion: 2.1 time: 1.100919 Oct 17 15:27:58.353089 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 839/1576] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:57 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1473 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:58.358234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:58.358234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:58.376340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.376975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.377324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.378063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.378558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.379349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.528197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:58.542087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:58.543326 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-864b66b4-24c0-403c-82dc-2e3ebeded494 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1276 microversion: 2.1 time: 0.189274 Oct 17 15:27:58.559253 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c53f35b2-f8ec-4991-9145-bc4926e41ba5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 0.514357 Oct 17 15:27:58.559253 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 738/1577] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:58 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:58.560803 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 840/1578] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:58 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:58.580034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:58.588684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7caaa3b1-29cc-41f8-a522-043accc0b4cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea63a60>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:58.593954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:58.606048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.607301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.608090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.610715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.611479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.612172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.666697 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7caaa3b1-29cc-41f8-a522-043accc0b4cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.106277 Oct 17 15:27:58.668037 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 739/1579] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:27:58 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:58.678914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8eb6a03c-800d-457c-9f7a-2ac8ddce641c req-51eb7547-977c-4687-94ae-44262efbacab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c128f7c3-d3e6-4664-979e-e424581346e1", "tag": "0ae18c17-0b0d-49c1-8d85-94306923e42f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:58.718115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8eb6a03c-800d-457c-9f7a-2ac8ddce641c req-51eb7547-977c-4687-94ae-44262efbacab service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.724633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8eb6a03c-800d-457c-9f7a-2ac8ddce641c req-51eb7547-977c-4687-94ae-44262efbacab service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.725091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8eb6a03c-800d-457c-9f7a-2ac8ddce641c req-51eb7547-977c-4687-94ae-44262efbacab service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.750732 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8eb6a03c-800d-457c-9f7a-2ac8ddce641c req-51eb7547-977c-4687-94ae-44262efbacab service nova] Creating event network-changed:0ae18c17-0b0d-49c1-8d85-94306923e42f for instance c128f7c3-d3e6-4664-979e-e424581346e1 on n-h1-854441-12 Oct 17 15:27:58.752892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:58.767236 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8eb6a03c-800d-457c-9f7a-2ac8ddce641c req-51eb7547-977c-4687-94ae-44262efbacab service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097717 Oct 17 15:27:58.771103 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 740/1580] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:58.773118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:58.778566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:58.790475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-90202207-59a3-4ecf-9b17-0a5e466c76cc req-023e64d6-d59e-4c84-ba59-72e5d8894dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39bc6c0-63e8-43f1-8b4a-15706f69c7d3", "name": "network-vif-plugged", "status": "completed", "tag": "6247badd-4d3d-447a-9d04-eb66dbfdaf3f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:58.803655 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73bf7158-ff19-44aa-94c5-527d9fa56821 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1320 microversion: 2.25 time: 0.240089 Oct 17 15:27:58.818535 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 841/1581] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:27:58 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:27:58.818990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-90202207-59a3-4ecf-9b17-0a5e466c76cc req-023e64d6-d59e-4c84-ba59-72e5d8894dd0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.818990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-90202207-59a3-4ecf-9b17-0a5e466c76cc req-023e64d6-d59e-4c84-ba59-72e5d8894dd0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.818990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-90202207-59a3-4ecf-9b17-0a5e466c76cc req-023e64d6-d59e-4c84-ba59-72e5d8894dd0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.828092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:58.828721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:58.857740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.860760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.861213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.864151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.864707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.865146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.868681 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-90202207-59a3-4ecf-9b17-0a5e466c76cc req-023e64d6-d59e-4c84-ba59-72e5d8894dd0 service nova] Creating event network-vif-plugged:6247badd-4d3d-447a-9d04-eb66dbfdaf3f for instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 on n-h1-854441-12 Oct 17 15:27:58.885102 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-90202207-59a3-4ecf-9b17-0a5e466c76cc req-023e64d6-d59e-4c84-ba59-72e5d8894dd0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110144 Oct 17 15:27:58.888507 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 741/1582] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:58.898403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a4e441e1-3956-4f35-b3c9-06700cd60383 req-303ba3cd-63d6-4cd2-ab41-393f563c1c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be11174e-4f4c-4199-972c-0a92c5f3ef77", "name": "network-vif-deleted", "tag": "f09fb33e-5463-4c71-9c57-a4ba031471b2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:27:58.909285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:58.942887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a4e441e1-3956-4f35-b3c9-06700cd60383 req-303ba3cd-63d6-4cd2-ab41-393f563c1c9d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:58.943293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a4e441e1-3956-4f35-b3c9-06700cd60383 req-303ba3cd-63d6-4cd2-ab41-393f563c1c9d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:58.943741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a4e441e1-3956-4f35-b3c9-06700cd60383 req-303ba3cd-63d6-4cd2-ab41-393f563c1c9d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:58.991639 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a4e441e1-3956-4f35-b3c9-06700cd60383 req-303ba3cd-63d6-4cd2-ab41-393f563c1c9d service nova] Creating event network-vif-deleted:f09fb33e-5463-4c71-9c57-a4ba031471b2 for instance be11174e-4f4c-4199-972c-0a92c5f3ef77 on n-h1-854441-12 Oct 17 15:27:59.015867 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a4e441e1-3956-4f35-b3c9-06700cd60383 req-303ba3cd-63d6-4cd2-ab41-393f563c1c9d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118606 Oct 17 15:27:59.020082 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 742/1583] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:27:59.065770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:59.066702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:59.098491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:59.101934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:59.102833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:59.110013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:59.110834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:59.111475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:59.664894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:59.674137 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bb19e055-367e-4f2f-a2e8-d03b933506b1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.612655 Oct 17 15:27:59.691310 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 743/1584] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:59 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:27:59.708041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:59.709058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:59.724392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:59.726241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:59.726924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:59.727872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:59.728529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:59.729158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:59.778691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:59.779487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:59.780080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:59.780742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lazy-loading 'fault' on Instance uuid be11174e-4f4c-4199-972c-0a92c5f3ef77 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:27:59.784251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:27:59.842859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:27:59.854132 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b38c8844-f30a-4717-b0ce-baebf004a27a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 200 len: 1307 microversion: 2.1 time: 0.159069 Oct 17 15:27:59.855716 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 744/1585] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:59 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 1307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:27:59.861232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:27:59.862159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:27:59.869930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:59.870702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:59.871394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:59.872568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:27:59.873299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:27:59.874295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:27:59.988371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:00.001881 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd422428-d1ad-4ec7-83dc-e77d8b6a81bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1476 microversion: 2.1 time: 1.192120 Oct 17 15:28:00.003256 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 842/1586] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:58 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1476 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:00.011398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:00.016661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:00.017112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:00.037651 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9c7c3eba-1ecc-4dc4-8756-b166b81e989b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1276 microversion: 2.1 time: 0.180608 Oct 17 15:28:00.050307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:00.050842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:00.054069 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 745/1587] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:27:59 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:00.059135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce61dbd6-3498-4438-873c-d496227f3300 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea87280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:00.061148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:00.062279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:00.062806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:00.063253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:00.116091 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ce61dbd6-3498-4438-873c-d496227f3300 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.060678 Oct 17 15:28:00.129800 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 746/1588] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:00 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:00.138145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:00.139104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:00.148426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:00.149980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:00.150630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:00.151610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:00.152411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:00.153053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:00.360667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:00.386420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:00.388437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:00.389883 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a56ea77-b737-4b39-9d2e-b8f3341d0fa4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1320 microversion: 2.25 time: 0.257669 Oct 17 15:28:00.391063 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 747/1589] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:00 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:00.717952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:00.719598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:00.734016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:00.740460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:00.743036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:00.744493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:00.745154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:00.745773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:00.901178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:00.911435 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8facc451-cf43-4ae3-9e23-25987635019d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 0.906884 Oct 17 15:28:00.927148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 843/1590] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:00 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:00.941429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:00.943274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be11174e-4f4c-4199-972c-0a92c5f3ef77] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:00.953834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:00.954635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:00.955984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:00.958692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:00.959395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:00.959982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:00.998881 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] HTTP exception thrown: Instance be11174e-4f4c-4199-972c-0a92c5f3ef77 could not be found. Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Request method failure captured: Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 HTTP/1.1 Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOy4YIV9dGGOlYBRZ0F7igKcjNUQVY_QXu68sdCLtbczdytvezShVmrOiCrYJEIri6bWQZI5Dpv2ZOIKcHeQs-ZZch_pDZ5k4z2CobwVLs0ewF3OswO2gQru1sxNV7EGlzjGqf2fpmTnp4xGD9HMcB_jiM4d1ZfSoRXL_CCR4shTY4 Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:01.001754 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a6d13409eb044988911b34d37730b714 Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance be11174e-4f4c-4199-972c-0a92c5f3ef77 could not be found. Oct 17 15:28:01.004007 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'be11174e-4f4c-4199-972c-0a92c5f3ef77'} Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be11174e-4f4c-4199-972c-0a92c5f3ef77 could not be found. Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:01.005191 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be11174e-4f4c-4199-972c-0a92c5f3ef77 could not be found. Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be11174e-4f4c-4199-972c-0a92c5f3ef77 could not be found. Oct 17 15:28:01.007195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:01.009636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Returning 404 to user: Instance be11174e-4f4c-4199-972c-0a92c5f3ef77 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:01.010793 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bd99ac8-2f73-4f98-b697-5b0fc76eac8c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77" status: 404 len: 111 microversion: 2.1 time: 0.082255 Oct 17 15:28:01.011603 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 844/1591] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:00 2022] GET /compute/v2.1/servers/be11174e-4f4c-4199-972c-0a92c5f3ef77 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:01.028014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:01.028991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:01.075830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:01.078491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:01.079310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:01.081249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:01.081916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:01.083229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:01.180588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:01.425853 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9696d1b7-0fef-44e3-9a40-54ab9d6116c3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 204 len: 0 microversion: 2.1 time: 0.407576 Oct 17 15:28:01.426990 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 845/1592] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:01 2022] DELETE /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:01.450341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:01.452996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:01.471089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:01.473548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:01.474753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:01.477186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:01.479465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:01.481386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:01.887131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:01.905502 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2d6cf1a-22f5-4f62-a8f4-97b7d55723ab tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1475 microversion: 2.1 time: 0.469438 Oct 17 15:28:01.906182 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 846/1593] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:01 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1475 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:01.926420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:01.927084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:01.941539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:01.942031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:01.942722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:01.945486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:01.947602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:01.949601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:01.994019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:02.010230 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0d04d9c6-57b4-480a-9273-b890e757269e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 1.294115 Oct 17 15:28:02.013321 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 748/1594] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:00 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:02.023511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca8a65c4-50b1-49dc-b9e1-0c1cec32e781 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bf1e4d30>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:02.106165 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca8a65c4-50b1-49dc-b9e1-0c1cec32e781 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.086569 Oct 17 15:28:02.106165 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 749/1595] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:02 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:02.122510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:02.130659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:02.146457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:02.146998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:02.147431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:02.159642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:02.161126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:02.161748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:02.191006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:02.212164 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca2f60fe-2bed-44ef-b529-87cae765a015 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1294 microversion: 2.1 time: 0.302949 Oct 17 15:28:02.214945 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 847/1596] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:01 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1294 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:02.229630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:02.240056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:02.291183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:02.292250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:02.293023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:02.294057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:02.295554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:02.296306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:02.860948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:02.877862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:02.889482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:02.892796 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57eef7c1-6e99-43b8-b60c-fee3481bc5aa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1362 microversion: 2.25 time: 0.779440 Oct 17 15:28:02.893597 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 750/1597] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:02 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1362 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:02.902576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:02.906871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:02.930319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:02.931191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:02.932127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:02.938011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:02.939817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:02.942697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:03.527842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:03.540975 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-15d2127f-84bc-466b-a957-75eec1ecbf7d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 0.645087 Oct 17 15:28:03.542297 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 751/1598] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:02 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:03.568060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:03.580067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:03.608944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:03.611182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:03.611872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:03.614466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:03.615945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:03.617191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:03.870474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:03.881804 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ddfd6133-8d1c-4161-917e-2421c11c3dd4 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1472 microversion: 2.1 time: 1.662936 Oct 17 15:28:03.896643 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 848/1599] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:02 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1472 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:03.902011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:03.910479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:03.933858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:03.934563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:03.937020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:03.937939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:03.943343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:03.947894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:04.583486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:04.605879 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1ca1db2-6f46-43f8-b3e7-452cb7fe7d8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.707793 Oct 17 15:28:04.609047 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 849/1600] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:03 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:04.616859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2448060c-8903-45b4-8921-0d65be08b27e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28becdc160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:04.695159 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2448060c-8903-45b4-8921-0d65be08b27e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.084481 Oct 17 15:28:04.697504 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 850/1601] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:04 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:04.704533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:04.705699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:04.714399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:04.715449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:04.716137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:04.717592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:04.718319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:04.719086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:04.760427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:04.771102 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cdaaeb0e-4d96-4920-923a-f5f4cb7d2309 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1475 microversion: 2.1 time: 1.227042 Oct 17 15:28:04.771703 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 752/1602] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:03 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1475 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:04.781391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:04.787636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:04.800229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:04.802595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:04.803233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:04.807521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:04.808015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:04.808452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:05.025617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:05.038222 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0ce3b7d-eb34-4fdd-90f4-5e2baab48c3f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1282 microversion: 2.1 time: 0.339382 Oct 17 15:28:05.046970 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 851/1603] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:04 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1282 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:05.065328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1c20441d-ee60-4eef-ae4b-2e21ddd449f6 req-88f4d88f-be36-46c8-ac65-a5af96b90565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a05ba5-2063-49b7-92bb-7122faf92713", "name": "network-vif-unplugged", "status": "completed", "tag": "18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:05.097542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1c20441d-ee60-4eef-ae4b-2e21ddd449f6 req-88f4d88f-be36-46c8-ac65-a5af96b90565 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:05.098782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1c20441d-ee60-4eef-ae4b-2e21ddd449f6 req-88f4d88f-be36-46c8-ac65-a5af96b90565 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:05.099413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1c20441d-ee60-4eef-ae4b-2e21ddd449f6 req-88f4d88f-be36-46c8-ac65-a5af96b90565 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:05.128057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1c20441d-ee60-4eef-ae4b-2e21ddd449f6 req-88f4d88f-be36-46c8-ac65-a5af96b90565 service nova] Creating event network-vif-unplugged:18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f for instance 91a05ba5-2063-49b7-92bb-7122faf92713 on n-h1-854441-12 Oct 17 15:28:05.135805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-1c20441d-ee60-4eef-ae4b-2e21ddd449f6 req-88f4d88f-be36-46c8-ac65-a5af96b90565 service nova] Instance 91a05ba5-2063-49b7-92bb-7122faf92713 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:28:05.149209 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1c20441d-ee60-4eef-ae4b-2e21ddd449f6 req-88f4d88f-be36-46c8-ac65-a5af96b90565 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100340 Oct 17 15:28:05.150427 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 852/1604] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:05.156191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:05.157174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:05.165911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:05.166889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:05.167488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:05.168384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:05.168559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:05.169157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:05.169873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:05.230981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=12 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:05.684566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:05.698441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:05.700465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:05.703903 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-abe8a9e9-ea35-4e69-96c4-9f2fb5a9a5c8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1362 microversion: 2.25 time: 0.926329 Oct 17 15:28:05.715233 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 753/1605] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:04 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1362 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:05.725929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8573aa45-cdd0-4c76-ba7e-772dba9f1ab2 req-4fbc02e7-976b-4729-9f38-5c4fbbc86daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5acc0bfb-5006-48b8-a9dd-e292ff22ab29", "tag": "ee63535c-2ff3-4d96-89e6-4bd9db2a0f65"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:05.820625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8573aa45-cdd0-4c76-ba7e-772dba9f1ab2 req-4fbc02e7-976b-4729-9f38-5c4fbbc86daa service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:05.837289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8573aa45-cdd0-4c76-ba7e-772dba9f1ab2 req-4fbc02e7-976b-4729-9f38-5c4fbbc86daa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:05.838650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8573aa45-cdd0-4c76-ba7e-772dba9f1ab2 req-4fbc02e7-976b-4729-9f38-5c4fbbc86daa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:05.858222 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8573aa45-cdd0-4c76-ba7e-772dba9f1ab2 req-4fbc02e7-976b-4729-9f38-5c4fbbc86daa service nova] Creating event network-changed:ee63535c-2ff3-4d96-89e6-4bd9db2a0f65 for instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 on n-h1-854441-12 Oct 17 15:28:05.869795 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8573aa45-cdd0-4c76-ba7e-772dba9f1ab2 req-4fbc02e7-976b-4729-9f38-5c4fbbc86daa service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148896 Oct 17 15:28:05.878090 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 754/1606] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:05.897900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:05.903230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:05.926044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:05.928709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:05.931204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:05.933216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:05.934992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:05.936691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:06.055757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:06.060949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:06.065297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:06.066532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lazy-loading 'fault' on Instance uuid 852fe346-2528-459b-a160-3db1a514aef8 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:06.344513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:06.371147 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-592f3b95-cbec-4198-a4ad-49ce588cec3d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 200 len: 1307 microversion: 2.1 time: 0.489528 Oct 17 15:28:06.375123 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 755/1607] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:05 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 1307 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:06.401298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:06.407887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:06.429877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:06.430382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:06.430852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:06.431574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:06.432032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:06.432463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:06.520494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:06.630628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:06.645088 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c9fd749-f912-4fa3-9f80-4bc1685cb312 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 1.492050 Oct 17 15:28:06.664147 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 853/1608] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:05 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:06.675821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27308b61-5b96-47b9-a96c-a39c77fe4269 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28beb84dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:06.754328 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27308b61-5b96-47b9-a96c-a39c77fe4269 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.088914 Oct 17 15:28:06.765441 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 854/1609] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:06 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:06.779538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:06.790572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:06.819659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:06.821755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:06.822408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:06.828212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:06.828967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:06.831823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:06.884961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:06.901689 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6a4b8674-dce4-4a99-aedb-5e83454ee97a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.517739 Oct 17 15:28:06.907240 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 756/1610] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:06 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:06.916706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:06.925762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:06.941146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:06.943696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:06.944381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:06.949186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:06.949961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:06.950740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:07.482224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:07.492058 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1c1c8f27-8000-4162-b89b-d34ffc1ccec4 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.583389 Oct 17 15:28:07.510258 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 757/1611] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:06 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:07.515554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:07.516161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:07.552077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:07.552587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:07.558692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:07.568257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:07.569025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:07.569503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:07.569922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:07.574355 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-707e09f3-17e4-4b90-9e77-649cc64b11e4 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1475 microversion: 2.1 time: 0.806319 Oct 17 15:28:07.578046 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 855/1612] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:06 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1475 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:07.591560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-86da2756-8693-4003-b34b-1edb2b481145 req-13adf48c-8991-4649-ae7c-4a7c7b5d9ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a6c5fc-30ba-49b2-ab11-747aae6d7f21", "name": "network-vif-plugged", "status": "completed", "tag": "1d89e5eb-f096-4fd6-ad9f-76b4586513f1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:07.620186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-86da2756-8693-4003-b34b-1edb2b481145 req-13adf48c-8991-4649-ae7c-4a7c7b5d9ff7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:07.621850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-86da2756-8693-4003-b34b-1edb2b481145 req-13adf48c-8991-4649-ae7c-4a7c7b5d9ff7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:07.622584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-86da2756-8693-4003-b34b-1edb2b481145 req-13adf48c-8991-4649-ae7c-4a7c7b5d9ff7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:07.657693 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-86da2756-8693-4003-b34b-1edb2b481145 req-13adf48c-8991-4649-ae7c-4a7c7b5d9ff7 service nova] Creating event network-vif-plugged:1d89e5eb-f096-4fd6-ad9f-76b4586513f1 for instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 on n-h2-854441-12 Oct 17 15:28:07.673782 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-86da2756-8693-4003-b34b-1edb2b481145 req-13adf48c-8991-4649-ae7c-4a7c7b5d9ff7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092390 Oct 17 15:28:07.680894 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 856/1613] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:07.729299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:07.730682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 852fe346-2528-459b-a160-3db1a514aef8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:07.753296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:07.754926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:07.770478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:07.771854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:07.775094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:07.776568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:07.824087 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] HTTP exception thrown: Instance 852fe346-2528-459b-a160-3db1a514aef8 could not be found. Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Request method failure captured: Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 HTTP/1.1 Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOy4YIV9dGGOlYBRZ0F7igKcjNUQVY_QXu68sdCLtbczdytvezShVmrOiCrYJEIri6bWQZI5Dpv2ZOIKcHeQs-ZZch_pDZ5k4z2CobwVLs0ewF3OswO2gQru1sxNV7EGlzjGqf2fpmTnp4xGD9HMcB_jiM4d1ZfSoRXL_CCR4shTY4 Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:07.827794 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a6d13409eb044988911b34d37730b714 Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 852fe346-2528-459b-a160-3db1a514aef8 could not be found. Oct 17 15:28:07.829529 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '852fe346-2528-459b-a160-3db1a514aef8'} Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852fe346-2528-459b-a160-3db1a514aef8 could not be found. Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:07.830411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852fe346-2528-459b-a160-3db1a514aef8 could not be found. Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852fe346-2528-459b-a160-3db1a514aef8 could not be found. Oct 17 15:28:07.832000 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:07.841352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Returning 404 to user: Instance 852fe346-2528-459b-a160-3db1a514aef8 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:07.849804 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9e24f15-bbe6-4e00-9179-3425eb0fe904 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8" status: 404 len: 111 microversion: 2.1 time: 0.159438 Oct 17 15:28:07.852297 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 857/1614] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:07 2022] GET /compute/v2.1/servers/852fe346-2528-459b-a160-3db1a514aef8 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:07.861895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e0625d5a-f03c-4e5a-8fc4-78b95d32e0e7 req-8c8a5cf2-5016-4f0c-bc44-9d4084b6a115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852fe346-2528-459b-a160-3db1a514aef8", "name": "network-vif-deleted", "tag": "790b7695-63c4-4c60-9541-d80765d15e14"}, {"name": "network-changed", "server_uuid": "91a05ba5-2063-49b7-92bb-7122faf92713", "tag": "18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:07.898148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e0625d5a-f03c-4e5a-8fc4-78b95d32e0e7 req-8c8a5cf2-5016-4f0c-bc44-9d4084b6a115 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:07.899255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e0625d5a-f03c-4e5a-8fc4-78b95d32e0e7 req-8c8a5cf2-5016-4f0c-bc44-9d4084b6a115 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:07.899935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e0625d5a-f03c-4e5a-8fc4-78b95d32e0e7 req-8c8a5cf2-5016-4f0c-bc44-9d4084b6a115 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:07.936898 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e0625d5a-f03c-4e5a-8fc4-78b95d32e0e7 req-8c8a5cf2-5016-4f0c-bc44-9d4084b6a115 service nova] Creating event network-vif-deleted:790b7695-63c4-4c60-9541-d80765d15e14 for instance 852fe346-2528-459b-a160-3db1a514aef8 on n-h2-854441-12 Oct 17 15:28:07.940577 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e0625d5a-f03c-4e5a-8fc4-78b95d32e0e7 req-8c8a5cf2-5016-4f0c-bc44-9d4084b6a115 service nova] Creating event network-changed:18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f for instance 91a05ba5-2063-49b7-92bb-7122faf92713 on n-h1-854441-12 Oct 17 15:28:07.956494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-e0625d5a-f03c-4e5a-8fc4-78b95d32e0e7 req-8c8a5cf2-5016-4f0c-bc44-9d4084b6a115 service nova] Instance 91a05ba5-2063-49b7-92bb-7122faf92713 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:28:08.000450 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e0625d5a-f03c-4e5a-8fc4-78b95d32e0e7 req-8c8a5cf2-5016-4f0c-bc44-9d4084b6a115 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.146371 Oct 17 15:28:08.002551 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 858/1615] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:08.014453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:08.016505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:08.036508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:08.038177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:08.039015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:08.041572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:08.046014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:08.049460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.014337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:09.032678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:09.034195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:09.035390 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-68feaf97-cc08-4795-8dbe-a850a1054dc7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1362 microversion: 2.25 time: 1.523920 Oct 17 15:28:09.055341 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 758/1616] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:07 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1362 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:09.060493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4d4be19-d4c8-4595-a475-f6d39a9e55ff tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea63430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:09.164843 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b4d4be19-d4c8-4595-a475-f6d39a9e55ff tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.107884 Oct 17 15:28:09.177900 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 759/1617] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:09 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:09.193189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:09.194694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:09.204057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:09.217816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69546cfa-4000-4afd-b07b-5a687c245019 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 1.213741 Oct 17 15:28:09.224639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.225153 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 859/1618] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:08 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:09.227226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.227855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.228758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.229356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.229980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.239485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:09.240173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:09.253640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.254648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.256168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.261634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.263200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.265244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.308412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:09.462455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b935176a-a210-4bdf-b64a-cc6188cf8785 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 204 len: 0 microversion: 2.1 time: 0.280071 Oct 17 15:28:09.469499 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 760/1619] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:09 2022] DELETE /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:09.483406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:09.484808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:09.492297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.492777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.493239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.493991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.494773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.495186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.677808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:09.684467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:09.686327 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b092d9f9-ea4d-458b-835a-30341294177c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.459931 Oct 17 15:28:09.687033 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 860/1620] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:09 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:09.692931 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8be1a189-4d17-426d-a07b-b69044b5da1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.221429 Oct 17 15:28:09.694835 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 761/1621] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:09 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:09.699587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:09.700195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:09.707071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.707651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.708084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.708778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.709222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.709817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.877006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:09.886196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:09.889114 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4dbb7635-bae1-46e5-a3ec-1db5a302ee63 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1473 microversion: 2.1 time: 0.193280 Oct 17 15:28:09.906728 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 762/1622] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:09 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1473 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:09.916492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:09.917461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:09.926116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.926833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.927450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.928214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:09.928951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:09.929451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:09.946756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe58f206-bc0e-48ce-81cd-5195006f963a tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Action: 'create', calling method: .version_select at 0x7f28bf287af0>, body: {"keypair": {"name": "tempest-keypair-302246345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9M5QMDE1WFYFLP0OoKjQvHvjzA3ZdGDyep35URIjqQTlKrudHhigEyvgRz0Jz7WME7b9oZYB/ZbGCNlbjBEupquyRtwtPg+mPejzO78Q7SSwrS1gR/EQonNFTTGumOhA=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:09.969223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fe58f206-bc0e-48ce-81cd-5195006f963a tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:09.975823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fe58f206-bc0e-48ce-81cd-5195006f963a tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for user 1f6c8c9526134a409da661558214071c and project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:10.019127 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe58f206-bc0e-48ce-81cd-5195006f963a tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.322599 Oct 17 15:28:10.020967 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 861/1623] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:28:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:10.027593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ba0cd66b-40ce-4bd3-b64d-8d322a8550da req-97dd1923-5daa-4ee3-b83f-6de4b97f2b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d070bb7e-ed9f-40f4-826a-896eaaca1310", "tag": "511df248-5a16-482a-a7e7-9687df270ebf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:10.038557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ba0cd66b-40ce-4bd3-b64d-8d322a8550da req-97dd1923-5daa-4ee3-b83f-6de4b97f2b7b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:10.039464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ba0cd66b-40ce-4bd3-b64d-8d322a8550da req-97dd1923-5daa-4ee3-b83f-6de4b97f2b7b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:10.040085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ba0cd66b-40ce-4bd3-b64d-8d322a8550da req-97dd1923-5daa-4ee3-b83f-6de4b97f2b7b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:10.055331 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ba0cd66b-40ce-4bd3-b64d-8d322a8550da req-97dd1923-5daa-4ee3-b83f-6de4b97f2b7b service nova] Creating event network-changed:511df248-5a16-482a-a7e7-9687df270ebf for instance d070bb7e-ed9f-40f4-826a-896eaaca1310 on n-h2-854441-12 Oct 17 15:28:10.060808 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ba0cd66b-40ce-4bd3-b64d-8d322a8550da req-97dd1923-5daa-4ee3-b83f-6de4b97f2b7b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037788 Oct 17 15:28:10.062168 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 862/1624] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:10.070292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8548ee6-1f02-472c-bbd0-c28cafbb6381 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Calling method '.version_select at 0x7f28beb1f1f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:10.080143 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8548ee6-1f02-472c-bbd0-c28cafbb6381 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "GET /compute/v2.1/os-keypairs/tempest-keypair-302246345" status: 200 len: 496 microversion: 2.1 time: 0.016497 Oct 17 15:28:10.081395 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 863/1625] 10.222.0.87 () {58 vars in 1215 bytes} [Mon Oct 17 15:28:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-302246345 => generated 496 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:10.086346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:10.087805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:10.094990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:10.095799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:10.096442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:10.097391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:10.098091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:10.098749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:10.183375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:10.193127 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2e36879-7665-4fc8-8a6c-af4b5112b36c tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1472 microversion: 2.1 time: 0.300260 Oct 17 15:28:10.194416 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 763/1626] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:09 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:10.200528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-baf310d9-dfb4-47a5-a7a1-cb20a906c35a tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Calling method '.version_select at 0x7f28bea4a550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:10.235095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:10.259334 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-baf310d9-dfb4-47a5-a7a1-cb20a906c35a tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-302246345" status: 202 len: 0 microversion: 2.1 time: 0.063050 Oct 17 15:28:10.260763 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 764/1627] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-302246345 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:10.267089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c48e788b-4fc2-46cf-a247-6c2159f1cece tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea63ca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:10.308064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:10.314384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:10.325299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:10.329522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:10.343929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c48e788b-4fc2-46cf-a247-6c2159f1cece tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.081673 Oct 17 15:28:10.345563 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0707f269-72c7-4cc8-8cbe-65061c74ef91 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1362 microversion: 2.25 time: 0.262913 Oct 17 15:28:10.348397 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 765/1628] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:10 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:10.351404 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 864/1629] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:10 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:10.359313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58ac5c21-4225-458e-a22b-c4251f29cc7c tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Action: 'create', calling method: .version_select at 0x7f28becdcc10>, body: {"keypair": {"name": "tempest-keypair-1070640371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbpr4fA24fDlAjouYeXOGKxZQVmLrAcIECk4tGEwjY8ItC0B6yuosVZDvuK8GhqLqUpiBMOnq6xXQW5oR2trSCI+jcAzCO987D1OYLplxEUd5zvY8qXys4Qr1lXfJOH0Q=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:10.362305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:10.363085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:10.374862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:10.375309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:10.375754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:10.376496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:10.376969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:10.381841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:10.404591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-58ac5c21-4225-458e-a22b-c4251f29cc7c tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:10.415347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-58ac5c21-4225-458e-a22b-c4251f29cc7c tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for user 1f6c8c9526134a409da661558214071c and project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:10.473613 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58ac5c21-4225-458e-a22b-c4251f29cc7c tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120409 Oct 17 15:28:10.480173 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 865/1630] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:28:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:10.485758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61b818b5-a89b-4247-b749-8eac83ce4b7e tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Calling method '.version_select at 0x7f28bedb9040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:10.521859 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61b818b5-a89b-4247-b749-8eac83ce4b7e tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070640371" status: 202 len: 0 microversion: 2.1 time: 0.040418 Oct 17 15:28:10.527365 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 866/1631] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 15:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070640371 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:10.533406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18a7104d-e151-4a7e-b2d3-fb5c464de204 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Action: 'create', calling method: .version_select at 0x7f28c0f951f0>, body: {"keypair": {"name": "tempest-keypair-420969559", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:10.556193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-18a7104d-e151-4a7e-b2d3-fb5c464de204 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:10.561929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:10.563102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-18a7104d-e151-4a7e-b2d3-fb5c464de204 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for user 1f6c8c9526134a409da661558214071c and project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:10.606855 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18a7104d-e151-4a7e-b2d3-fb5c464de204 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.077422 Oct 17 15:28:10.614583 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 867/1632] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:28:10 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:10.620758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-adbb2ebe-e17b-42b8-9e19-869f8f394f08 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Calling method '.version_select at 0x7f28bf4caee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:10.659947 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-adbb2ebe-e17b-42b8-9e19-869f8f394f08 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420969559" status: 202 len: 0 microversion: 2.1 time: 0.043931 Oct 17 15:28:10.660452 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 868/1633] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420969559 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:10.665556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:10.672838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4a0dad4-4116-4fac-9c1f-d07cdfe7c271 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Action: 'create', calling method: .version_select at 0x7f28bf414af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-985207705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqr6kKirKH3B78iz3py970u+R7u+h7zL1ADRrbsgrHE5cv8QkAXYoLLHru54iD6l76bU504rn4j6ESbWoDCP3rZWDmwtH5qWViZ72NQHcFhWd+c+zJDCgzP5vb68ufD1A=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:10.679372 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7b706d02-f762-4fbf-8f7b-5bbaf243173f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 0.328949 Oct 17 15:28:10.691158 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 766/1634] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:10 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:10.727481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:10.729977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:10.739260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:10.740628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:10.741236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:10.742773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:10.743550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:10.744217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:10.746757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f4a0dad4-4116-4fac-9c1f-d07cdfe7c271 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:10.766567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f4a0dad4-4116-4fac-9c1f-d07cdfe7c271 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for user 1f6c8c9526134a409da661558214071c and project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:10.803562 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4a0dad4-4116-4fac-9c1f-d07cdfe7c271 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.134793 Oct 17 15:28:10.806805 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 869/1635] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:28:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:10.819433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:10.822259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:10.841282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:10.841282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:10.842331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:10.843404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:10.844090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:10.844627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:10.931286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:10.945588 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7d6e161c-4422-47e6-b019-01ea8d590207 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.237340 Oct 17 15:28:10.950831 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 767/1636] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:10 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:10.956632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57320da9-c3b9-46f0-8746-db3f6af75d26 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Action: 'create', calling method: .version_select at 0x7f28c300c0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-853016742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcj7H+vdmVzvZsqGJDHZN+URetjwLJ5O/1gQ3hSD19iIh4mggjw/6tV6vPtd+4eBi3ZZKAffH9bGdfA0s6siVXbxZraRyPeQkDzWJKe9brCzCMprMUpUv7GUjrb7PSzSg=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:10.996963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-57320da9-c3b9-46f0-8746-db3f6af75d26 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:11.011823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-57320da9-c3b9-46f0-8746-db3f6af75d26 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for user 1f6c8c9526134a409da661558214071c and project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:11.066216 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57320da9-c3b9-46f0-8746-db3f6af75d26 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.113682 Oct 17 15:28:11.075525 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 768/1637] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:28:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:11.081509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:11.082243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:11.084604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:11.088977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:11.089580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:11.090119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:11.091046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:11.092452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:11.093093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:11.101434 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20510cb3-8115-4317-a1b9-f9e670cd7efc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.291841 Oct 17 15:28:11.106029 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 870/1638] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:10 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:11.141720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33fcb65b-4b91-4022-80a3-78bf8feb2641 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Action: 'create', calling method: .version_select at 0x7f28c0f95550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-715760161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPrI+mb+B9wwXbOlWl5ZWaxjJpuszuHzHQ+UR4AlXX4luQoJlbeWPjyB4i5bhDNHZrgGP9Skj//kRA4Mo/rg3ozqol+mKQO3o3XGsyF4j2dwvHJP2cKNYN7gdyQzdwMgA=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:11.179290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-33fcb65b-4b91-4022-80a3-78bf8feb2641 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:11.186255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-33fcb65b-4b91-4022-80a3-78bf8feb2641 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Getting quotas for user 1f6c8c9526134a409da661558214071c and project 26ed665b671d484297f4053cef9b1aeb. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:11.283543 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33fcb65b-4b91-4022-80a3-78bf8feb2641 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.154031 Oct 17 15:28:11.284511 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 871/1639] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:28:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:11.291618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:11.292576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:11.314454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:11.316156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:11.317024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:11.321382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:11.322089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:11.323650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:11.397018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:11.416339 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a1d0a117-1a00-4e0f-ae8a-a5f3bad76964 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1473 microversion: 2.1 time: 0.339490 Oct 17 15:28:11.417053 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 769/1640] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:11 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1473 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:11.431298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-28c0842c-8315-4601-8ccb-4ff7b1310546 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Calling method '.version_select at 0x7f28bea63430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:11.438336 n-d-854441-12 devstack@n-api.service[120407]: WARNING oslo_db.sqlalchemy.utils [None req-28c0842c-8315-4601-8ccb-4ff7b1310546 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 15:28:11.457263 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-28c0842c-8315-4601-8ccb-4ff7b1310546 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.038961 Oct 17 15:28:11.458010 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 770/1641] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:28:11 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:11.468580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-446fb883-10c0-4931-bf4c-03474f3bee3f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c3008f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:11.543351 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-446fb883-10c0-4931-bf4c-03474f3bee3f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.083933 Oct 17 15:28:11.557271 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 771/1642] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:11 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:11.573224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:11.574442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:11.593940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:11.594937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:11.595645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:11.597115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:11.597814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:11.599898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:11.842359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:11.852648 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-042824c5-a235-45b7-8158-b2ed68c3fff1 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1472 microversion: 2.1 time: 0.565385 Oct 17 15:28:11.866533 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 872/1643] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:11 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1472 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:11.866533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9ab0ba0-fae0-4251-bda8-a2cd771bbf4c tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Calling method '.version_select at 0x7f28bf81b670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:11.882371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:11.891951 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9ab0ba0-fae0-4251-bda8-a2cd771bbf4c tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-715760161" status: 202 len: 0 microversion: 2.1 time: 0.034364 Oct 17 15:28:11.892779 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 873/1644] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-715760161 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:11.894349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:11.896156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:11.897337 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-127a220b-a9ba-48fe-9fe3-362ac2b9032a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1362 microversion: 2.25 time: 0.338324 Oct 17 15:28:11.910552 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 772/1645] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:11 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:11.910552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3f75963-f9d6-4e50-b9f5-ba305e48a590 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Calling method '.version_select at 0x7f28c3008160>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:11.912044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:11.915205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:11.922921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:11.923476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:11.923914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:11.924662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:11.925125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:11.925585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:11.930925 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3f75963-f9d6-4e50-b9f5-ba305e48a590 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-853016742" status: 202 len: 0 microversion: 2.1 time: 0.030734 Oct 17 15:28:11.932073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 773/1646] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-853016742 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:11.949836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-063d8415-3e9d-42ea-9948-e642015b7bb9 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] Calling method '.version_select at 0x7f28bea520d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:11.992552 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-063d8415-3e9d-42ea-9948-e642015b7bb9 tempest-KeyPairsV2TestJSON-2132469401 tempest-KeyPairsV2TestJSON-2132469401-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-985207705" status: 202 len: 0 microversion: 2.1 time: 0.052571 Oct 17 15:28:12.000476 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 774/1647] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-985207705 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:12.008376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:12.011319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:12.022858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:12.023661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:12.024261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:12.025623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:12.026264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:12.029903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:12.258128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:12.270074 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e20b21d6-c429-415c-80d1-b800c6773841 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.268370 Oct 17 15:28:12.274850 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 775/1648] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:12 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:12.285580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:12.288531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:12.302443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:12.303321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:12.305403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:12.306597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:12.308788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:12.309466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:12.894835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:12.903343 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-887af919-c428-4936-b593-2883aee42fb7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.626761 Oct 17 15:28:12.909765 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 776/1649] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:12 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:12.918150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:12.918804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:12.934725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:12.935228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:12.935664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:12.936427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:12.936886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:12.937310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.022033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:13.040639 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b236b7c-ab46-425f-a693-dff77d51f250 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1317 microversion: 2.1 time: 1.146549 Oct 17 15:28:13.041245 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 874/1650] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:11 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1317 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:13.059820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14aa8bf6-87c4-45ed-b60c-c2bb1a7f18cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bf3e7ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:13.141020 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14aa8bf6-87c4-45ed-b60c-c2bb1a7f18cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.098701 Oct 17 15:28:13.141603 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 875/1651] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:13 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:13.150902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:13.154601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:13.168722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:13.170847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:13.175816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.178686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:13.179350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:13.180354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.297121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:13.306039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fda7f6b1-2539-4ca1-b08e-f532c7bd51a6 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1470 microversion: 2.1 time: 0.394275 Oct 17 15:28:13.307355 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 777/1652] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:12 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1470 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:13.314117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:13.315601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:13.324065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:13.324907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:13.325577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.326558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:13.327235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:13.327890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.513910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:13.548809 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b5aaaaf-1e26-42d8-8ece-b2c5963a8a3e tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1472 microversion: 2.1 time: 0.405883 Oct 17 15:28:13.573788 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 876/1653] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:13 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:13.605759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e510035e-f24b-4816-b111-343847647557 req-f95b651b-d5fe-48f3-9f59-b0d36021f055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acc0bfb-5006-48b8-a9dd-e292ff22ab29", "name": "network-vif-plugged", "status": "completed", "tag": "ee63535c-2ff3-4d96-89e6-4bd9db2a0f65"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:13.629313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e510035e-f24b-4816-b111-343847647557 req-f95b651b-d5fe-48f3-9f59-b0d36021f055 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:13.629801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e510035e-f24b-4816-b111-343847647557 req-f95b651b-d5fe-48f3-9f59-b0d36021f055 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:13.630229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e510035e-f24b-4816-b111-343847647557 req-f95b651b-d5fe-48f3-9f59-b0d36021f055 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.658418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:13.661115 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e510035e-f24b-4816-b111-343847647557 req-f95b651b-d5fe-48f3-9f59-b0d36021f055 service nova] Creating event network-vif-plugged:ee63535c-2ff3-4d96-89e6-4bd9db2a0f65 for instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 on n-h1-854441-12 Oct 17 15:28:13.668100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:13.673779 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e510035e-f24b-4816-b111-343847647557 req-f95b651b-d5fe-48f3-9f59-b0d36021f055 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096965 Oct 17 15:28:13.675952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:13.677465 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5e7f41d8-8885-4f45-9af6-f9d814ff2c8e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1362 microversion: 2.25 time: 0.368457 Oct 17 15:28:13.677957 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 877/1654] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:13.680470 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 778/1655] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:13 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:13.700087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca92fec7-2521-47bb-9844-9d7dfee5f349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:13.700941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca92fec7-2521-47bb-9844-9d7dfee5f349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:13.724478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:13.725434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:13.727591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca92fec7-2521-47bb-9844-9d7dfee5f349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:13.729425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca92fec7-2521-47bb-9844-9d7dfee5f349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:13.730965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca92fec7-2521-47bb-9844-9d7dfee5f349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.734358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca92fec7-2521-47bb-9844-9d7dfee5f349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:13.735107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca92fec7-2521-47bb-9844-9d7dfee5f349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:13.735720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca92fec7-2521-47bb-9844-9d7dfee5f349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.750705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:13.750705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:13.751642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.752475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:13.753077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:13.753677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:13.987344 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca92fec7-2521-47bb-9844-9d7dfee5f349 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "POST /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713/action" status: 202 len: 0 microversion: 2.1 time: 0.305262 Oct 17 15:28:13.992102 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 779/1656] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:28:13 2022] POST /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:14.000780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:14.001872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:14.009516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.011140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.011950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:14.012919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.013602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.014689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:14.259451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:14.272839 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24221090-106e-44eb-8379-778b959f4dab tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.276450 Oct 17 15:28:14.275957 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 780/1657] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:13 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:14.283650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:14.289446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:14.290918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:14.301673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.302775 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2a2dd64-2e6d-4a14-8b66-9cd34c2512ff tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1718 microversion: 2.1 time: 0.622793 Oct 17 15:28:14.303538 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 878/1658] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:13 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1718 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:14.307952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.309999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:14.312373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.317610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.318168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:14.323451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:14.324299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:14.366763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.375644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.377714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:14.379395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.379888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.381444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:14.669675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:14.683195 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1404d317-a739-4c1a-91e2-b221d555ee6d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1469 microversion: 2.1 time: 0.405897 Oct 17 15:28:14.698473 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 781/1659] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:14 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1469 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:14.704246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e936f821-ec4b-49be-aa47-27ba8961652c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea4baf0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:14.799484 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e936f821-ec4b-49be-aa47-27ba8961652c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.113742 Oct 17 15:28:14.805948 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 782/1660] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:14 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:14.828355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:14.830276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:14.846830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.847384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.855053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:14.858280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.858914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.859404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:14.950682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:14.964658 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14d27fc6-0e7e-4915-b9e0-e71d34f0b369 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1506 microversion: 2.1 time: 0.656806 Oct 17 15:28:14.965720 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 879/1661] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:14 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:14.978801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:14.979112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:14.991545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.994460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.994641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:14.995540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:14.997630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:14.998091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.117510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:15.136024 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b9e9528e-8e1e-4bf3-98ea-4c1f1f0401e5 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1430 microversion: 2.1 time: 0.328685 Oct 17 15:28:15.137680 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 783/1662] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:14 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1430 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:15.149435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-6a71de06-d4b0-4a29-8314-bdfd9e382014 req-ec562631-00af-4eb6-ac96-a962d471cdbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889fed9e-4835-4a06-ae15-bb3f4e7540dc", "name": "network-vif-deleted", "tag": "b9d81cf4-99dd-44b8-ac1a-ee8c845874d7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:15.165594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6a71de06-d4b0-4a29-8314-bdfd9e382014 req-ec562631-00af-4eb6-ac96-a962d471cdbc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:15.168636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6a71de06-d4b0-4a29-8314-bdfd9e382014 req-ec562631-00af-4eb6-ac96-a962d471cdbc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:15.169414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6a71de06-d4b0-4a29-8314-bdfd9e382014 req-ec562631-00af-4eb6-ac96-a962d471cdbc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.186850 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-6a71de06-d4b0-4a29-8314-bdfd9e382014 req-ec562631-00af-4eb6-ac96-a962d471cdbc service nova] Creating event network-vif-deleted:b9d81cf4-99dd-44b8-ac1a-ee8c845874d7 for instance 889fed9e-4835-4a06-ae15-bb3f4e7540dc on n-h2-854441-12 Oct 17 15:28:15.216836 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-6a71de06-d4b0-4a29-8314-bdfd9e382014 req-ec562631-00af-4eb6-ac96-a962d471cdbc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073950 Oct 17 15:28:15.221395 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 784/1663] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:15.243949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:15.245096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:15.270031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:15.271163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:15.273642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.274404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:15.274933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:15.275342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.294989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:15.313459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:15.318109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:15.319751 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d4a0776-1ac9-405a-839f-513f627be8eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1362 microversion: 2.25 time: 0.353074 Oct 17 15:28:15.342355 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 880/1664] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:14 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:15.353151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:15.353772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:15.366592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:15.367533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:15.368136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.369149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:15.371158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:15.380467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.732891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:15.744476 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba52cbd2-8134-4205-a79b-f3699afdc722 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.399497 Oct 17 15:28:15.762681 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 881/1665] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:15 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:15.775868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:15.776774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:15.793053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:15.793759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:15.794364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.795295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:15.796161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:15.797078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.867203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:15.884017 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-10eef74c-7b58-4812-84de-d544e9c0c00d tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1506 microversion: 2.1 time: 0.658933 Oct 17 15:28:15.886626 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 785/1666] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:15 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1506 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:15.903297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:15.907403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:15.928226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:15.928737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:15.929185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.929907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:15.930365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:15.935786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:15.989965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:16.103910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:16.116672 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ec497f8-7f02-4c88-a92f-82118c165796 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1708 microversion: 2.1 time: 0.352541 Oct 17 15:28:16.119937 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 882/1667] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:15 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1708 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:16.132424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0bb08285-592b-4a31-8044-74ccb7cf69c4 req-04fa9b8d-84dc-4f0b-a0a0-be2dc744e6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a05ba5-2063-49b7-92bb-7122faf92713", "name": "network-vif-plugged", "status": "completed", "tag": "18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:16.157771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0bb08285-592b-4a31-8044-74ccb7cf69c4 req-04fa9b8d-84dc-4f0b-a0a0-be2dc744e6b7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.158317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0bb08285-592b-4a31-8044-74ccb7cf69c4 req-04fa9b8d-84dc-4f0b-a0a0-be2dc744e6b7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.158780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0bb08285-592b-4a31-8044-74ccb7cf69c4 req-04fa9b8d-84dc-4f0b-a0a0-be2dc744e6b7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.186226 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0bb08285-592b-4a31-8044-74ccb7cf69c4 req-04fa9b8d-84dc-4f0b-a0a0-be2dc744e6b7 service nova] Creating event network-vif-plugged:18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f for instance 91a05ba5-2063-49b7-92bb-7122faf92713 on n-h1-854441-12 Oct 17 15:28:16.195977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-0bb08285-592b-4a31-8044-74ccb7cf69c4 req-04fa9b8d-84dc-4f0b-a0a0-be2dc744e6b7 service nova] Instance 91a05ba5-2063-49b7-92bb-7122faf92713 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:28:16.231403 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0bb08285-592b-4a31-8044-74ccb7cf69c4 req-04fa9b8d-84dc-4f0b-a0a0-be2dc744e6b7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109576 Oct 17 15:28:16.232710 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 883/1668] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:16.238249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30ced44f-9746-45c6-8904-ff6a581e2dd8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bee25c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:16.264086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:16.276146 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f67176c9-c3c8-4ac2-be29-97397389b7bd tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1469 microversion: 2.1 time: 0.388283 Oct 17 15:28:16.277497 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 786/1669] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:15 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1469 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:16.283940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:16.289274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:16.297314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.298221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.299456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.300654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.301331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.302064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.330833 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30ced44f-9746-45c6-8904-ff6a581e2dd8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.096591 Oct 17 15:28:16.335408 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 884/1670] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:16 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:16.346356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-490a3555-7ea9-44bd-a576-aa770887f079 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '.version_select at 0x7f28bf4b4670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:16.351978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-490a3555-7ea9-44bd-a576-aa770887f079 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.354759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-490a3555-7ea9-44bd-a576-aa770887f079 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.358062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-490a3555-7ea9-44bd-a576-aa770887f079 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.391596 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-490a3555-7ea9-44bd-a576-aa770887f079 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 2765 microversion: 2.1 time: 0.054838 Oct 17 15:28:16.392236 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 885/1671] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:28:16 2022] GET /compute/v2.1/os-migrations => generated 2765 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:16.403396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:16.404416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:16.420968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.421702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.422303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.423210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.423826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.424413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.436659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:28:16.437218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:28:16.437790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:28:16.438340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:28:16.438875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:28:16.461675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.462435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.463057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.465371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lazy-loading 'fault' on Instance uuid 889fed9e-4835-4a06-ae15-bb3f4e7540dc {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:16.556019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:16.574015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.575101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.575579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.578611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.579309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.580948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.599289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:16.612157 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a87d2dd5-370e-4671-b690-1e5dfe63edfd tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 200 len: 1306 microversion: 2.1 time: 0.212747 Oct 17 15:28:16.614926 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 886/1672] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:16 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 1306 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:16.629606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:16.638309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:16.650008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.654533 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1d042881-6763-4875-9ab6-58bdf3cc3183 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "POST /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21/action" status: 202 len: 1108 microversion: 2.1 time: 0.372545 Oct 17 15:28:16.654972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.655825 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 787/1673] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:28:16 2022] POST /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21/action => generated 1108 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 15:28:16.656587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.659852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.660800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.664757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.682287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-60d2b12f-e166-427c-a1d1-882a9ea46e91 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:16.684941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-60d2b12f-e166-427c-a1d1-882a9ea46e91 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:16.701599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60d2b12f-e166-427c-a1d1-882a9ea46e91 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.702474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60d2b12f-e166-427c-a1d1-882a9ea46e91 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.707196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60d2b12f-e166-427c-a1d1-882a9ea46e91 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:16.709331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60d2b12f-e166-427c-a1d1-882a9ea46e91 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:16.710208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60d2b12f-e166-427c-a1d1-882a9ea46e91 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:16.713437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60d2b12f-e166-427c-a1d1-882a9ea46e91 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:17.014322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-60d2b12f-e166-427c-a1d1-882a9ea46e91 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1861 microversion: 2.1 time: 0.344615 Oct 17 15:28:17.044627 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 788/1674] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:16 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1861 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:17.049805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:17.050330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:17.080178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:17.081074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:17.083361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:17.084321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:17.086824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:17.087804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:17.091895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:17.133417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:17.142209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:17.151541 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3727f339-72a6-46ed-9174-791390ab77bf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1557 microversion: 2.25 time: 0.534422 Oct 17 15:28:17.162623 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 887/1675] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:16 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1557 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:17.189453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:17.190648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:17.204814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:17.206786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:17.207505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:17.208621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:17.209279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:17.210690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:17.380826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:17.389243 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b41b31fa-1d3c-45fe-bffd-031540b4fc04 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.359501 Oct 17 15:28:17.403402 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 789/1676] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:17 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:17.412105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-406ead87-4a4d-44c1-a4e0-210592210054 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:17.413379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-406ead87-4a4d-44c1-a4e0-210592210054 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:17.420307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406ead87-4a4d-44c1-a4e0-210592210054 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:17.421097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406ead87-4a4d-44c1-a4e0-210592210054 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:17.421746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406ead87-4a4d-44c1-a4e0-210592210054 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:17.422778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406ead87-4a4d-44c1-a4e0-210592210054 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:17.423701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406ead87-4a4d-44c1-a4e0-210592210054 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:17.424314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-406ead87-4a4d-44c1-a4e0-210592210054 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:17.551714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:17.567348 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ccc0c4e-a5bc-4afe-ab1c-12e927e3104a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.401408 Oct 17 15:28:17.586641 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 888/1677] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:17 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:17.618261 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-406ead87-4a4d-44c1-a4e0-210592210054 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1861 microversion: 2.1 time: 0.209909 Oct 17 15:28:17.627307 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 790/1678] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:17 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1861 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:17.627307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:17.627307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:17.633483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:17.633995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:17.634431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:17.635361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:17.636016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:17.636219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:17.944878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:17.956470 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b98ba788-c1c1-4a31-8909-7e1efdb48132 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1469 microversion: 2.1 time: 0.335285 Oct 17 15:28:17.957587 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 791/1679] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:17 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:17.965318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b9db208f-a6d1-4870-b876-36b342488c7e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2fe3310>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:18.049643 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b9db208f-a6d1-4870-b876-36b342488c7e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1413 microversion: 2.1 time: 0.090476 Oct 17 15:28:18.050903 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 792/1680] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:17 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:18.056174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:18.057463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 889fed9e-4835-4a06-ae15-bb3f4e7540dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:18.064899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.065647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.066298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.067686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.068315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.068903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.089912 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] HTTP exception thrown: Instance 889fed9e-4835-4a06-ae15-bb3f4e7540dc could not be found. Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Request method failure captured: Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc HTTP/1.1 Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOy4YIV9dGGOlYBRZ0F7igKcjNUQVY_QXu68sdCLtbczdytvezShVmrOiCrYJEIri6bWQZI5Dpv2ZOIKcHeQs-ZZch_pDZ5k4z2CobwVLs0ewF3OswO2gQru1sxNV7EGlzjGqf2fpmTnp4xGD9HMcB_jiM4d1ZfSoRXL_CCR4shTY4 Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:18.092163 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a6d13409eb044988911b34d37730b714 Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 889fed9e-4835-4a06-ae15-bb3f4e7540dc could not be found. Oct 17 15:28:18.093913 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '889fed9e-4835-4a06-ae15-bb3f4e7540dc'} Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 889fed9e-4835-4a06-ae15-bb3f4e7540dc could not be found. Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:18.095454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 889fed9e-4835-4a06-ae15-bb3f4e7540dc could not be found. Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 889fed9e-4835-4a06-ae15-bb3f4e7540dc could not be found. Oct 17 15:28:18.097004 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:18.099598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Returning 404 to user: Instance 889fed9e-4835-4a06-ae15-bb3f4e7540dc could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:18.101011 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-11539e83-0a4a-412b-98e8-54123c420b87 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc" status: 404 len: 111 microversion: 2.1 time: 0.048988 Oct 17 15:28:18.102665 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 793/1681] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:18 2022] GET /compute/v2.1/servers/889fed9e-4835-4a06-ae15-bb3f4e7540dc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:18.108144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:18.109206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:18.118091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.118810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.119601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.120494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.121459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.122044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.191368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:18.192755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:18.205433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.206298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.208621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.209547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.210304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.212900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.416685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lazy-loading 'services' on Instance uuid c128f7c3-d3e6-4664-979e-e424581346e1 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:18.580486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:18.624088 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3b9bf88-a1cb-47e8-b849-2d8d587c0235 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 2052 microversion: 2.25 time: 1.035247 Oct 17 15:28:18.627269 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 889/1682] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:17 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 2052 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:18.643983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:18.644747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 99ca326f-588c-4823-97b0-0bde70fc9435] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:18.661504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.662047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.662488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.663226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.670975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.671439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.688650 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-30fa24b8-2841-4a92-801a-117305b90bf2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments/089479ce-f5b9-4be7-bbb9-6852816fdd76" status: 202 len: 0 microversion: 2.1 time: 0.584404 Oct 17 15:28:18.692849 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 794/1683] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:28:18 2022] DELETE /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments/089479ce-f5b9-4be7-bbb9-6852816fdd76 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:18.720547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:18.721854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:18.742244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.742817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.743271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.747954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.750908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.751690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.800611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 99ca326f-588c-4823-97b0-0bde70fc9435] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:18.885567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:18.951532 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c997362e-e1c8-4ecc-b661-88a0497612c2 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435" status: 204 len: 0 microversion: 2.1 time: 0.322562 Oct 17 15:28:18.952381 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 890/1684] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:18 2022] DELETE /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:18.962122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:18.964961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:18.981172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.983796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.984468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:18.986010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:18.986478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:18.989915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.019992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:19.033701 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3b9e6c5a-0187-4f17-9fb4-39bba0f57c18 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.338729 Oct 17 15:28:19.034386 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 795/1685] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:18 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:19.042176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:19.043150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:19.049339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.057995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.076148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.078276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.079240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.079951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.296320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:19.314180 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c728644-8630-473d-aabd-2bdc586c6da0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 2052 microversion: 2.25 time: 0.277447 Oct 17 15:28:19.316118 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 796/1686] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:19 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 2052 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:19.318509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:19.323116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-15f88583-48a0-4b46-ab28-8caf54a67e27 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:19.325848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-15f88583-48a0-4b46-ab28-8caf54a67e27 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:19.328477 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4612dbe-940d-424a-959d-dfc92977c8c3 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.374884 Oct 17 15:28:19.329075 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 891/1687] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:18 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:19.343659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:19.345177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:19.347951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f88583-48a0-4b46-ab28-8caf54a67e27 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.348440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f88583-48a0-4b46-ab28-8caf54a67e27 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.348876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f88583-48a0-4b46-ab28-8caf54a67e27 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.349577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f88583-48a0-4b46-ab28-8caf54a67e27 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.350021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f88583-48a0-4b46-ab28-8caf54a67e27 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.350434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f88583-48a0-4b46-ab28-8caf54a67e27 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.354243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.354952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.355530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.356240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.356697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.357247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.385433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:19.393443 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-15f88583-48a0-4b46-ab28-8caf54a67e27 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075628 Oct 17 15:28:19.398649 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 797/1688] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:28:19 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:19.399446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:19.400907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:19.408543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.409673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.410349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.411275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.411895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.412746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.510741 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30f2e0da-0a9e-49ca-9f94-00f6e0daf713 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 204 len: 0 microversion: 2.1 time: 0.180093 Oct 17 15:28:19.515400 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 892/1689] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:19 2022] DELETE /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:19.519669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e0c84690-00fb-4672-bfcc-eecd0f576469 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bee251f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:19.578397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:19.595856 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-53f52660-9451-49b1-b9ea-ff055600513a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1469 microversion: 2.1 time: 0.200186 Oct 17 15:28:19.596874 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 798/1690] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:19 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:19.602542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8c51f58a-71d4-45f5-9898-b92eedbd1bff tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:19.606635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c51f58a-71d4-45f5-9898-b92eedbd1bff tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.607475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c51f58a-71d4-45f5-9898-b92eedbd1bff tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.608209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c51f58a-71d4-45f5-9898-b92eedbd1bff tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.609046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c51f58a-71d4-45f5-9898-b92eedbd1bff tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.609660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c51f58a-71d4-45f5-9898-b92eedbd1bff tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.610181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c51f58a-71d4-45f5-9898-b92eedbd1bff tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.632481 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e0c84690-00fb-4672-bfcc-eecd0f576469 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1422 microversion: 2.1 time: 0.118559 Oct 17 15:28:19.642064 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 893/1691] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:19 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:19.642064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:19.642064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 99ca326f-588c-4823-97b0-0bde70fc9435] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:19.646221 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8c51f58a-71d4-45f5-9898-b92eedbd1bff tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.047786 Oct 17 15:28:19.647138 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 799/1692] 10.222.0.87 () {60 vars in 1217 bytes} [Mon Oct 17 15:28:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:28:19.652186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.652954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3950585-ba13-4fc9-ab6a-b0a42dcbca1a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea52430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:19.664165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.664605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.665981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.666529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.667313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.714535 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3950585-ba13-4fc9-ab6a-b0a42dcbca1a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 200 len: 1422 microversion: 2.1 time: 0.066161 Oct 17 15:28:19.715535 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 800/1693] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:19 2022] GET /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 1422 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:19.720492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854441-12", "block_migration": "auto"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:19.723247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:19.730121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.730765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.731270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.732044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:19.732716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:19.733286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:19.763282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'flavor' on Instance uuid 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:19.776804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Going to try to live migrate instance to n-h2-854441-12 {{(pid=120407) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 15:28:19.830626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:20.270197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:20.278375 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea6fa4e5-088c-4f05-a2e6-7bb080ac509b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435" status: 200 len: 1473 microversion: 2.1 time: 0.643754 Oct 17 15:28:20.279044 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 894/1694] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:19 2022] GET /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435 => generated 1473 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:20.290831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8b5f90d-6e71-477e-922b-aeb8cb1d4f42 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28beb84dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:21.031718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:21.114590 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8b5f90d-6e71-477e-922b-aeb8cb1d4f42 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 204 len: 0 microversion: 2.1 time: 0.830366 Oct 17 15:28:21.116347 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 895/1695] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:20 2022] DELETE /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:21.124699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:21.132747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:21.161102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:21.163547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:21.164747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:21.166916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:21.168209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:21.169740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:21.216905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=20 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:21.563153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:21.590561 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64cff260-c4c8-48e3-8170-71233ba11a9c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.472663 Oct 17 15:28:21.626949 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 896/1696] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:21 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:21.652379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:21.665349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:21.696916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:21.697428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:21.708298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:21.709207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:21.709700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:21.718445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:22.267092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:22.279329 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3068698-fba6-4e57-8064-dc1950a46371 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.650959 Oct 17 15:28:22.291313 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 897/1697] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:21 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:22.305149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88e2bd79-7033-4151-b79a-8e8f16236b10 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:22.312040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88e2bd79-7033-4151-b79a-8e8f16236b10 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:22.328573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e2bd79-7033-4151-b79a-8e8f16236b10 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:22.330062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e2bd79-7033-4151-b79a-8e8f16236b10 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:22.330730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e2bd79-7033-4151-b79a-8e8f16236b10 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:22.331655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e2bd79-7033-4151-b79a-8e8f16236b10 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:22.332865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e2bd79-7033-4151-b79a-8e8f16236b10 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:22.335629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88e2bd79-7033-4151-b79a-8e8f16236b10 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:22.382996 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88e2bd79-7033-4151-b79a-8e8f16236b10 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090612 Oct 17 15:28:22.384222 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 898/1698] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:28:22 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:22.396106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:22.398957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:22.411858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:22.414839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:22.415441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:22.416848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:22.419792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:22.423641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:22.882850 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-16ac12dc-8a7d-46c9-b179-f241990d2a34 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29/action" status: 202 len: 0 microversion: 2.25 time: 3.165408 Oct 17 15:28:22.884184 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 801/1699] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:28:19 2022] POST /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29/action => generated 0 bytes in 3168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:22.890462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:22.891025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:22.904568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:22.905135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:22.905580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:22.906304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:22.906986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:22.907451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:22.991689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:23.014319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:23.033255 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d02ad0a-f896-41ea-bca7-baac0a7b2f38 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1469 microversion: 2.1 time: 0.647722 Oct 17 15:28:23.036988 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 899/1700] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:22 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1469 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:23.047697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-43e77b66-9907-4bd1-ab32-3cd2c058c6f5 req-7a09dfde-c50d-436f-90d8-5e8a1088c8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ca326f-588c-4823-97b0-0bde70fc9435", "name": "network-vif-deleted", "tag": "1b032b50-ae0d-460a-b76a-a8dfd2038eed"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:23.055895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:23.064457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-43e77b66-9907-4bd1-ab32-3cd2c058c6f5 req-7a09dfde-c50d-436f-90d8-5e8a1088c8dd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.065472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-43e77b66-9907-4bd1-ab32-3cd2c058c6f5 req-7a09dfde-c50d-436f-90d8-5e8a1088c8dd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.066145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-43e77b66-9907-4bd1-ab32-3cd2c058c6f5 req-7a09dfde-c50d-436f-90d8-5e8a1088c8dd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.135712 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-43e77b66-9907-4bd1-ab32-3cd2c058c6f5 req-7a09dfde-c50d-436f-90d8-5e8a1088c8dd service nova] Creating event network-vif-deleted:1b032b50-ae0d-460a-b76a-a8dfd2038eed for instance 99ca326f-588c-4823-97b0-0bde70fc9435 on n-h1-854441-12 Oct 17 15:28:23.157125 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-43e77b66-9907-4bd1-ab32-3cd2c058c6f5 req-7a09dfde-c50d-436f-90d8-5e8a1088c8dd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117897 Oct 17 15:28:23.162992 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 900/1701] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:23.195010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:23.197042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 99ca326f-588c-4823-97b0-0bde70fc9435] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:23.205528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:23.209835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.210720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.211343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.212467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.213228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.214007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.217516 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22f126d4-bc2b-4029-8bf6-5d0cde47ccc2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 204 len: 0 microversion: 2.1 time: 0.330231 Oct 17 15:28:23.223523 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 802/1702] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:22 2022] DELETE /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:23.230658 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] HTTP exception thrown: Instance 99ca326f-588c-4823-97b0-0bde70fc9435 could not be found. Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Request method failure captured: Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435 HTTP/1.1 Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOy4YIV9dGGOlYBRZ0F7igKcjNUQVY_QXu68sdCLtbczdytvezShVmrOiCrYJEIri6bWQZI5Dpv2ZOIKcHeQs-ZZch_pDZ5k4z2CobwVLs0ewF3OswO2gQru1sxNV7EGlzjGqf2fpmTnp4xGD9HMcB_jiM4d1ZfSoRXL_CCR4shTY4 Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:23.232624 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a6d13409eb044988911b34d37730b714 Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 99ca326f-588c-4823-97b0-0bde70fc9435 could not be found. Oct 17 15:28:23.234395 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '99ca326f-588c-4823-97b0-0bde70fc9435'} Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ca326f-588c-4823-97b0-0bde70fc9435 could not be found. Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:23.235362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ca326f-588c-4823-97b0-0bde70fc9435 could not be found. Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ca326f-588c-4823-97b0-0bde70fc9435 could not be found. Oct 17 15:28:23.236928 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:23.239129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Returning 404 to user: Instance 99ca326f-588c-4823-97b0-0bde70fc9435 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:23.240152 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e1b2f4e-56c2-49a0-9e75-aba59a41885f tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435" status: 404 len: 111 microversion: 2.1 time: 0.065696 Oct 17 15:28:23.244400 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 901/1703] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:23 2022] GET /compute/v2.1/servers/99ca326f-588c-4823-97b0-0bde70fc9435 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:23.245185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cee668ed-3f5a-4289-8164-dc99e5942fb3 req-39147d20-6bae-4116-b851-12ff3b973c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d070bb7e-ed9f-40f4-826a-896eaaca1310", "name": "network-vif-plugged", "status": "completed", "tag": "511df248-5a16-482a-a7e7-9687df270ebf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:23.252063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:23.252913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:23.260963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.261697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.262353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.263254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.263856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.264550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.278807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cee668ed-3f5a-4289-8164-dc99e5942fb3 req-39147d20-6bae-4116-b851-12ff3b973c93 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.280250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cee668ed-3f5a-4289-8164-dc99e5942fb3 req-39147d20-6bae-4116-b851-12ff3b973c93 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.280799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cee668ed-3f5a-4289-8164-dc99e5942fb3 req-39147d20-6bae-4116-b851-12ff3b973c93 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.316679 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cee668ed-3f5a-4289-8164-dc99e5942fb3 req-39147d20-6bae-4116-b851-12ff3b973c93 service nova] Creating event network-vif-plugged:511df248-5a16-482a-a7e7-9687df270ebf for instance d070bb7e-ed9f-40f4-826a-896eaaca1310 on n-h2-854441-12 Oct 17 15:28:23.331541 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cee668ed-3f5a-4289-8164-dc99e5942fb3 req-39147d20-6bae-4116-b851-12ff3b973c93 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103774 Oct 17 15:28:23.348544 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 803/1704] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:23.365336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:23.366034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:23.375806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.377762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.378601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.379501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.380116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.381143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.749708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:23.765810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:23.768238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:23.769743 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a8d776a-e0da-4b77-955b-1ca610fd87a5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.412782 Oct 17 15:28:23.797677 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 804/1705] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:23 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:23.807452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:23.808136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:23.820756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.821477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.824026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.826461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.827120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.834453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.907105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:23.916057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-672c940b-70b7-4a0e-8450-9ff7db4d46b4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.670305 Oct 17 15:28:23.935706 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 902/1706] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:23 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:23.938910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:23.950965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:23.953714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:23.966887 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc23d84c-803b-49dc-83c1-956697894ad0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1432 microversion: 2.1 time: 0.165292 Oct 17 15:28:23.982085 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 805/1707] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:23 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1432 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:23.982085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe5b8390-f9dc-4f1b-b59b-4b9b9ea1cd70 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:23.982085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe5b8390-f9dc-4f1b-b59b-4b9b9ea1cd70 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:23.984312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.985072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.985757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:23.986765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:23.987436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:23.988296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:24.009098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe5b8390-f9dc-4f1b-b59b-4b9b9ea1cd70 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:24.009674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe5b8390-f9dc-4f1b-b59b-4b9b9ea1cd70 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:24.010119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe5b8390-f9dc-4f1b-b59b-4b9b9ea1cd70 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:24.011830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe5b8390-f9dc-4f1b-b59b-4b9b9ea1cd70 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:24.012315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe5b8390-f9dc-4f1b-b59b-4b9b9ea1cd70 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:24.012869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe5b8390-f9dc-4f1b-b59b-4b9b9ea1cd70 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:24.093216 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe5b8390-f9dc-4f1b-b59b-4b9b9ea1cd70 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122100 Oct 17 15:28:24.099972 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 806/1708] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:28:23 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:24.110131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-484203811", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "4a4d489b-6847-437c-bb6f-226f2268a1b9"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:24.222087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] validate_networks() for [('4a4d489b-6847-437c-bb6f-226f2268a1b9', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:28:24.702777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:24.715236 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86a26bea-5960-4a15-b1b0-26e634ff53b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1324 microversion: 2.1 time: 0.776087 Oct 17 15:28:24.730534 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 903/1709] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:23 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1324 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:24.735811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-506c56e0-6f40-4de3-b630-81e937dc0d9e req-2e7a665a-302a-454a-8beb-51a4b8a0dbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943a464e-b11b-46e2-9cb0-4b734b5e7402", "name": "network-vif-deleted", "tag": "ef30b980-4440-407e-95c4-25cbaff490fe"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:24.759114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-506c56e0-6f40-4de3-b630-81e937dc0d9e req-2e7a665a-302a-454a-8beb-51a4b8a0dbed service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:24.759618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-506c56e0-6f40-4de3-b630-81e937dc0d9e req-2e7a665a-302a-454a-8beb-51a4b8a0dbed service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:24.760031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-506c56e0-6f40-4de3-b630-81e937dc0d9e req-2e7a665a-302a-454a-8beb-51a4b8a0dbed service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:24.793788 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-506c56e0-6f40-4de3-b630-81e937dc0d9e req-2e7a665a-302a-454a-8beb-51a4b8a0dbed service nova] Creating event network-vif-deleted:ef30b980-4440-407e-95c4-25cbaff490fe for instance 943a464e-b11b-46e2-9cb0-4b734b5e7402 on n-h2-854441-12 Oct 17 15:28:24.808388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-506c56e0-6f40-4de3-b630-81e937dc0d9e req-2e7a665a-302a-454a-8beb-51a4b8a0dbed service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076416 Oct 17 15:28:24.809489 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 904/1710] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:24.818685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:24.824018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:24.843179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:24.843990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:24.844588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:24.845462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:24.846089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:24.846701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:24.957040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:28:24.957499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:28:24.959240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:28:24.960622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:28:24.961886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:28:24.976304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:24.976801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:24.977515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:24.978259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:24.978851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:24.979283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:25.006303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:25.014493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for user 59a1c6dac66a43d9b5e91b78215359ce and project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:25.033855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:28:25.036982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:28:25.152126 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5d107be4-f6a3-4c16-b344-3fafb3957ba8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048594 Oct 17 15:28:25.168009 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 807/1711] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:28:25.173139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:25.178959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:25.206589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:25.209349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:25.213002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:25.213916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:25.215101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:25.218942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:25.470830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:25.504446 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80d7e33a-d773-4a6f-be57-238b67cfcb06 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1469 microversion: 2.1 time: 0.690981 Oct 17 15:28:25.520646 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 905/1712] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:24 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1469 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:25.550875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:25.553960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:25.576632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:25.577508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:25.578194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:25.579171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:25.579928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:25.580623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:25.972932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:25.992152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:25.993962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:25.995244 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07ee9b59-5343-42c9-b794-a9671d5e7b39 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.826199 Oct 17 15:28:25.995812 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 808/1713] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:25 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:26.035802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:26.046754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:26.062260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.073494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.073890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:26.074704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.077902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.078587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:26.150218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.153945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.155720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:26.162351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lazy-loading 'fault' on Instance uuid 943a464e-b11b-46e2-9cb0-4b734b5e7402 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:26.271880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:26.287114 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-96b31ffc-d06f-45c5-825c-235f0e5a0382 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 200 len: 1308 microversion: 2.1 time: 0.284114 Oct 17 15:28:26.288145 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 809/1714] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:26 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:26.298671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4aeb5d3-973b-46d4-91aa-81954f808d4d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:26.301333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a4aeb5d3-973b-46d4-91aa-81954f808d4d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:26.330447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4aeb5d3-973b-46d4-91aa-81954f808d4d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.330994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4aeb5d3-973b-46d4-91aa-81954f808d4d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.331432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4aeb5d3-973b-46d4-91aa-81954f808d4d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:26.332248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4aeb5d3-973b-46d4-91aa-81954f808d4d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.332706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4aeb5d3-973b-46d4-91aa-81954f808d4d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.333135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4aeb5d3-973b-46d4-91aa-81954f808d4d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:26.396195 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4aeb5d3-973b-46d4-91aa-81954f808d4d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106481 Oct 17 15:28:26.400802 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 810/1715] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:28:26 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:26.401920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:26.402542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:26.421355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.421922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.422375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:26.423116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.423776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.424202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:26.615496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:26.633464 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6eff25ba-de35-4fb1-b12f-ac4c0e4486ab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1203 microversion: 2.1 time: 0.235310 Oct 17 15:28:26.653518 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 811/1716] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:26 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1203 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:26.666794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-120dc80f-3ead-4d12-8e35-a910a0d7760d req-2c46155f-1a34-4425-b4b9-c4b8023b46a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a05ba5-2063-49b7-92bb-7122faf92713", "name": "network-vif-unplugged", "status": "completed", "tag": "18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f"}, {"server_uuid": "e39bc6c0-63e8-43f1-8b4a-15706f69c7d3", "name": "network-vif-unplugged", "status": "completed", "tag": "6247badd-4d3d-447a-9d04-eb66dbfdaf3f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:26.697902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-120dc80f-3ead-4d12-8e35-a910a0d7760d req-2c46155f-1a34-4425-b4b9-c4b8023b46a0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.698471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-120dc80f-3ead-4d12-8e35-a910a0d7760d req-2c46155f-1a34-4425-b4b9-c4b8023b46a0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.700914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-120dc80f-3ead-4d12-8e35-a910a0d7760d req-2c46155f-1a34-4425-b4b9-c4b8023b46a0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:26.719957 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-120dc80f-3ead-4d12-8e35-a910a0d7760d req-2c46155f-1a34-4425-b4b9-c4b8023b46a0 service nova] Creating event network-vif-unplugged:18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f for instance 91a05ba5-2063-49b7-92bb-7122faf92713 on n-h2-854441-12 Oct 17 15:28:26.720732 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-120dc80f-3ead-4d12-8e35-a910a0d7760d req-2c46155f-1a34-4425-b4b9-c4b8023b46a0 service nova] Creating event network-vif-unplugged:6247badd-4d3d-447a-9d04-eb66dbfdaf3f for instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 on n-h1-854441-12 Oct 17 15:28:26.729476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-120dc80f-3ead-4d12-8e35-a910a0d7760d req-2c46155f-1a34-4425-b4b9-c4b8023b46a0 service nova] Instance 91a05ba5-2063-49b7-92bb-7122faf92713 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:28:26.746579 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-120dc80f-3ead-4d12-8e35-a910a0d7760d req-2c46155f-1a34-4425-b4b9-c4b8023b46a0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.091567 Oct 17 15:28:26.747478 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 812/1717] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:26.756598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:26.757302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:26.765224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.765685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.766181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:26.767181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:26.767848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:26.768551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:27.148255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:27.163908 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c8a068ec-30ba-44b9-83fd-a6ec7fec5556 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1521 microversion: 2.1 time: 0.411693 Oct 17 15:28:27.184195 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 813/1718] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:26 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:27.190141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:27.191091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:27.198362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:27.199106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:27.199707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:27.200866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:27.201580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:27.202173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:27.257105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:27.277051 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4750bcf-0154-41fd-9e19-f60179ae7520 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 1.754908 Oct 17 15:28:27.278340 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 906/1719] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:25 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:27.283444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f25610a1-a296-443c-a3ff-2dd9d9a97067 req-0792e3ce-5fd3-42aa-8ab1-7946d838a2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39bc6c0-63e8-43f1-8b4a-15706f69c7d3", "name": "network-vif-deleted", "tag": "6247badd-4d3d-447a-9d04-eb66dbfdaf3f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:27.293882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f25610a1-a296-443c-a3ff-2dd9d9a97067 req-0792e3ce-5fd3-42aa-8ab1-7946d838a2a1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:27.294659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f25610a1-a296-443c-a3ff-2dd9d9a97067 req-0792e3ce-5fd3-42aa-8ab1-7946d838a2a1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:27.295333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f25610a1-a296-443c-a3ff-2dd9d9a97067 req-0792e3ce-5fd3-42aa-8ab1-7946d838a2a1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:27.311641 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f25610a1-a296-443c-a3ff-2dd9d9a97067 req-0792e3ce-5fd3-42aa-8ab1-7946d838a2a1 service nova] Creating event network-vif-deleted:6247badd-4d3d-447a-9d04-eb66dbfdaf3f for instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 on n-h1-854441-12 Oct 17 15:28:27.317956 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f25610a1-a296-443c-a3ff-2dd9d9a97067 req-0792e3ce-5fd3-42aa-8ab1-7946d838a2a1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038075 Oct 17 15:28:27.319629 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 907/1720] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:27.324703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5d76be71-2a3e-4c54-affb-200d05206a7b req-119bcfda-ae8a-4018-8ad7-f03c963782cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a05ba5-2063-49b7-92bb-7122faf92713", "tag": "18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:27.337253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d76be71-2a3e-4c54-affb-200d05206a7b req-119bcfda-ae8a-4018-8ad7-f03c963782cc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:27.338039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d76be71-2a3e-4c54-affb-200d05206a7b req-119bcfda-ae8a-4018-8ad7-f03c963782cc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:27.338665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d76be71-2a3e-4c54-affb-200d05206a7b req-119bcfda-ae8a-4018-8ad7-f03c963782cc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:27.351312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5d76be71-2a3e-4c54-affb-200d05206a7b req-119bcfda-ae8a-4018-8ad7-f03c963782cc service nova] Creating event network-changed:18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f for instance 91a05ba5-2063-49b7-92bb-7122faf92713 on n-h2-854441-12 Oct 17 15:28:27.357669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-5d76be71-2a3e-4c54-affb-200d05206a7b req-119bcfda-ae8a-4018-8ad7-f03c963782cc service nova] Instance 91a05ba5-2063-49b7-92bb-7122faf92713 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 15:28:27.371957 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5d76be71-2a3e-4c54-affb-200d05206a7b req-119bcfda-ae8a-4018-8ad7-f03c963782cc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051334 Oct 17 15:28:27.375255 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 908/1721] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:27.399520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:27.402138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:27.416995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:27.420824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:27.421592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:27.422617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:27.425738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:27.426408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:27.745528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:27.771846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:27.784281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:27.792906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:27.798010 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57908c4e-5f7d-4026-b0d7-acf7d32f8699 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.419442 Oct 17 15:28:27.814542 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 909/1722] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:27 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:27.819788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:27.820422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:27.829395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:27.830264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:27.830946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:27.831921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:27.832562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:27.833153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.036460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:28.051766 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad8f0358-93ea-4e05-acdd-912ad9497b2d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1521 microversion: 2.1 time: 0.249156 Oct 17 15:28:28.064161 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 910/1723] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:27 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:28.130041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43e3dfca-8e70-4636-8237-f1457ded1c2f tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28beee5280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-272024724", "description": "tempest-description-957819502"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:28.197155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:28.213726 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1fd4f2ff-ea89-4079-8848-71516c15874f tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1469 microversion: 2.1 time: 1.023851 Oct 17 15:28:28.214459 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 814/1724] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:27 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1469 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:28.221095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:28.222025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 943a464e-b11b-46e2-9cb0-4b734b5e7402] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:28.231014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.231935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.233375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.234351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.235057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.235694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.254805 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] HTTP exception thrown: Instance 943a464e-b11b-46e2-9cb0-4b734b5e7402 could not be found. Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Request method failure captured: Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 HTTP/1.1 Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOy4YIV9dGGOlYBRZ0F7igKcjNUQVY_QXu68sdCLtbczdytvezShVmrOiCrYJEIri6bWQZI5Dpv2ZOIKcHeQs-ZZch_pDZ5k4z2CobwVLs0ewF3OswO2gQru1sxNV7EGlzjGqf2fpmTnp4xGD9HMcB_jiM4d1ZfSoRXL_CCR4shTY4 Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:28.257976 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a6d13409eb044988911b34d37730b714 Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 943a464e-b11b-46e2-9cb0-4b734b5e7402 could not be found. Oct 17 15:28:28.259582 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '943a464e-b11b-46e2-9cb0-4b734b5e7402'} Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 943a464e-b11b-46e2-9cb0-4b734b5e7402 could not be found. Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:28.260525 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943a464e-b11b-46e2-9cb0-4b734b5e7402 could not be found. Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943a464e-b11b-46e2-9cb0-4b734b5e7402 could not be found. Oct 17 15:28:28.261861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.263091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Returning 404 to user: Instance 943a464e-b11b-46e2-9cb0-4b734b5e7402 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:28.266383 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1cef54d-56cd-40aa-9cc6-f08ff492c7e9 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402" status: 404 len: 111 microversion: 2.1 time: 0.049290 Oct 17 15:28:28.267579 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 815/1725] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:28 2022] GET /compute/v2.1/servers/943a464e-b11b-46e2-9cb0-4b734b5e7402 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:28.272591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-26efcb68-a8cc-40f0-a5d8-af9c95e41c8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:28.276059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-26efcb68-a8cc-40f0-a5d8-af9c95e41c8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:28.283341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26efcb68-a8cc-40f0-a5d8-af9c95e41c8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.284235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26efcb68-a8cc-40f0-a5d8-af9c95e41c8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.285050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26efcb68-a8cc-40f0-a5d8-af9c95e41c8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.286053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26efcb68-a8cc-40f0-a5d8-af9c95e41c8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.286956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26efcb68-a8cc-40f0-a5d8-af9c95e41c8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.287433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26efcb68-a8cc-40f0-a5d8-af9c95e41c8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.326351 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-26efcb68-a8cc-40f0-a5d8-af9c95e41c8c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057405 Oct 17 15:28:28.332640 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 816/1726] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:28:28 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:28.337968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:28.339176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:28.346215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.346865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.347389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.348214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.348899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.349529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.403804 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43e3dfca-8e70-4636-8237-f1457ded1c2f tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.337968 Oct 17 15:28:28.404474 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 911/1727] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:28:28 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:28.411928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a23acb93-a3ff-4f4a-9f6d-6e117e33b953 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-351819985", "metadata": {"": ""}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a23acb93-a3ff-4f4a-9f6d-6e117e33b953 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action HTTP/1.1 Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 106 Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:28.427739 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-351819985", "metadata": {"": ""}}} Oct 17 15:28:28.429903 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'd070bb7e-ed9f-40f4-826a-896eaaca1310', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-351819985', 'metadata': {'': ''}}}} Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'': ''} Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:28.431470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.437043 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:28.438688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:28.438688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:28.438688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:28:28.438688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:28:28.438688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:28:28.438688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:28.438688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a23acb93-a3ff-4f4a-9f6d-6e117e33b953 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:28.438688 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a23acb93-a3ff-4f4a-9f6d-6e117e33b953 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action" status: 400 len: 170 microversion: 2.1 time: 0.024871 Oct 17 15:28:28.438688 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 912/1728] 10.222.0.87 () {60 vars in 1279 bytes} [Mon Oct 17 15:28:28 2022] POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action => generated 170 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:28:28.444103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26b01d79-e463-4eeb-85fc-f77e7f7c4c34 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:28.494629 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26b01d79-e463-4eeb-85fc-f77e7f7c4c34 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/720fd1e6-01a7-4eda-bb49-505213e1e3d1" status: 204 len: 0 microversion: 2.1 time: 0.060716 Oct 17 15:28:28.499258 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 913/1729] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:28:28 2022] DELETE /compute/v2.1/os-server-groups/720fd1e6-01a7-4eda-bb49-505213e1e3d1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:28.505241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:28.506874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:28.517545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.518520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.519800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.520852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.522303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.523632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.546529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:28.554822 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-84a022c6-c431-4aeb-beb8-2e342cf32923 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1265 microversion: 2.1 time: 0.220694 Oct 17 15:28:28.555486 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 817/1730] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:28 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:28.560841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-49a4c4bc-97b9-4eff-9da8-913059fb51a4 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28bf710ee0>, body: {"security_group_rule": {"parent_group_id": "d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:28.693707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:28.701906 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e7b8a67-5d44-4a98-9886-88085325920f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.201331 Oct 17 15:28:28.702493 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 914/1731] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:28 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:28.707487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:28.708103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:28.714183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.715672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.716018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.716951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.717585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.718053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.861277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:28.869736 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85d3866b-af6d-4d47-9c47-5de46e3a1be5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1521 microversion: 2.1 time: 0.165900 Oct 17 15:28:28.870306 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 915/1732] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:28 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:28.876286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:28.877035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:28.884971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.885484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.885917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.886688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:28.887279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:28.888047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:28.915763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:29.013035 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b444a378-2ed4-4a71-8080-f328dcdab81d tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f" status: 204 len: 0 microversion: 2.1 time: 0.141081 Oct 17 15:28:29.015580 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 916/1733] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:28 2022] DELETE /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:29.021812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:29.022537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:29.038678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.039183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.039623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.040350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.040808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.041788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.209393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:29.218847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:29.220451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:29.221771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cec9580f-916c-49a0-b7ae-79ecc9483534 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.205567 Oct 17 15:28:29.238997 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 917/1734] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:29 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:29.245254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:29.246032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:29.252708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.253399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.254887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.256362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.257054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.257716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.282555 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-49a4c4bc-97b9-4eff-9da8-913059fb51a4 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.725797 Oct 17 15:28:29.283180 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 818/1735] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:28:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:29.295743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:29.296242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:29.303705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.304446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.305663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.306640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.307307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.308067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.328055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:29.343654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:29.433137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:29.444961 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4752115f-801b-4d97-bedb-cd370818a1cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1521 microversion: 2.1 time: 0.204669 Oct 17 15:28:29.462902 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 918/1736] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:29 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:29.467079 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-38581c2e-08e0-4579-adc3-4d0b8d30ea16 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 204 len: 0 microversion: 2.1 time: 0.175213 Oct 17 15:28:29.468193 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 819/1737] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:29 2022] DELETE /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:29.472953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:29.473808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:29.474679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ad0393f-9b67-4be9-9bca-389c1f10ebd3 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28bea4a430>, body: {"security_group_rule": {"parent_group_id": "d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:29.483809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.484560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.485152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.486293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.486960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.487885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.598832 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-3ad0393f-9b67-4be9-9bca-389c1f10ebd3 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] HTTP exception thrown: This rule already exists in group d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5 Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ad0393f-9b67-4be9-9bca-389c1f10ebd3 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Request method failure captured: Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 138 Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXSbYAiVm7TJDeWImThZy7yoXZVmFaOBMOTgNImb47gNmaBdFJrPddvYzYs24QWmKc2g_PfBplQuvJVsO3jidDHmKkHG2G--nTmXjqtbN81SVBX7JE1dacASMM62dQQUbgC54mgSQ6LwK0m6fEzNMU3IycRyvNxm_bv9bWa2Ui8YglQ Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:29.601961 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_936ac2a9a05248729865ee111acd8f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 9ce1a0c862c64fb5bca688d5fc37f442 Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: {"security_group_rule": {"parent_group_id": "d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 15:28:29.603468 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: exception: This rule already exists in group d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5 Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd4f28827-1d85-4075-ab7a-9dbbd1ba6ab5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5 Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:28:29.604309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5 Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5 Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.605839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ad0393f-9b67-4be9-9bca-389c1f10ebd3 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Returning 400 to user: This rule already exists in group d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:29.606908 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ad0393f-9b67-4be9-9bca-389c1f10ebd3 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.133671 Oct 17 15:28:29.608989 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 820/1738] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:28:29 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:28:29.615268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d2da5c60-2501-4996-87c9-5269332e592e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:29.618127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d2da5c60-2501-4996-87c9-5269332e592e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:29.628513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2da5c60-2501-4996-87c9-5269332e592e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.632220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2da5c60-2501-4996-87c9-5269332e592e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.632923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2da5c60-2501-4996-87c9-5269332e592e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.634534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2da5c60-2501-4996-87c9-5269332e592e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.635165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2da5c60-2501-4996-87c9-5269332e592e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.635779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2da5c60-2501-4996-87c9-5269332e592e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.658813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:29.668769 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-720c5cac-ef21-4124-8555-1ff39c490337 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1469 microversion: 2.1 time: 0.204200 Oct 17 15:28:29.669789 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 919/1739] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:29 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:29.674771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3afc09bf-75d9-42d2-a7db-98f7c47578d5 req-eb97d48c-02db-4011-868e-fce18b2d9057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acc0bfb-5006-48b8-a9dd-e292ff22ab29", "name": "network-vif-unplugged", "status": "completed", "tag": "ee63535c-2ff3-4d96-89e6-4bd9db2a0f65"}, {"name": "network-changed", "server_uuid": "5acc0bfb-5006-48b8-a9dd-e292ff22ab29", "tag": "ee63535c-2ff3-4d96-89e6-4bd9db2a0f65"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:29.686354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3afc09bf-75d9-42d2-a7db-98f7c47578d5 req-eb97d48c-02db-4011-868e-fce18b2d9057 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.687380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3afc09bf-75d9-42d2-a7db-98f7c47578d5 req-eb97d48c-02db-4011-868e-fce18b2d9057 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.688035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3afc09bf-75d9-42d2-a7db-98f7c47578d5 req-eb97d48c-02db-4011-868e-fce18b2d9057 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.696501 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d2da5c60-2501-4996-87c9-5269332e592e tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085396 Oct 17 15:28:29.701212 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 821/1740] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:28:29 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:29.702447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9c6a4f23-7ed6-46e9-ac57-ef85ea8db9c7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-163818908", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9c6a4f23-7ed6-46e9-ac57-ef85ea8db9c7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action HTTP/1.1 Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 618 Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:29.707651 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:29.709198 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:28:29.709903 n-d-854441-12 devstack@n-api.service[120407]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-163818908", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 17 15:28:29.709903 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:28:29.709903 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd070bb7e-ed9f-40f4-826a-896eaaca1310', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-163818908', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 17 15:28:29.710155 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:29.710947 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.712076 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:29.713094 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:29.713094 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:29.713094 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:28:29.713094 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:28:29.713094 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:28:29.713094 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:29.713525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9c6a4f23-7ed6-46e9-ac57-ef85ea8db9c7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:29.713525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9c6a4f23-7ed6-46e9-ac57-ef85ea8db9c7 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action" status: 400 len: 938 microversion: 2.1 time: 0.010529 Oct 17 15:28:29.713525 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 822/1741] 10.222.0.87 () {60 vars in 1279 bytes} [Mon Oct 17 15:28:29 2022] POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action => generated 938 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:28:29.716049 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3afc09bf-75d9-42d2-a7db-98f7c47578d5 req-eb97d48c-02db-4011-868e-fce18b2d9057 service nova] Creating event network-vif-unplugged:ee63535c-2ff3-4d96-89e6-4bd9db2a0f65 for instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 on n-h1-854441-12 Oct 17 15:28:29.717047 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3afc09bf-75d9-42d2-a7db-98f7c47578d5 req-eb97d48c-02db-4011-868e-fce18b2d9057 service nova] Creating event network-changed:ee63535c-2ff3-4d96-89e6-4bd9db2a0f65 for instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 on n-h1-854441-12 Oct 17 15:28:29.720512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:29.721131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:29.726184 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3afc09bf-75d9-42d2-a7db-98f7c47578d5 req-eb97d48c-02db-4011-868e-fce18b2d9057 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.054089 Oct 17 15:28:29.727742 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 920/1742] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:29.729811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.730190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.731121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.731978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.732657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.733303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.735101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:29.736200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:29.747826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.749255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.753119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.753867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:29.754346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:29.754805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:29.924930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:29.937729 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9bbfd27b-e10b-4622-abfa-a3bd1c5e772b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1307 microversion: 2.1 time: 0.208287 Oct 17 15:28:29.938734 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 921/1743] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:29 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:29.943256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:29.963010 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6ac6a1b6-7559-4506-bcb4-e5187c78fea0 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f" status: 200 len: 1473 microversion: 2.1 time: 0.246582 Oct 17 15:28:29.963478 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 823/1744] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:29 2022] GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f => generated 1473 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:29.966284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77994605-283b-430a-ad3b-cd1560373614 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Calling method '.version_select at 0x7f28becbb820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:29.979028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:29.980504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:30.003854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:30.006158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:30.006685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:30.007560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:30.007941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:30.009280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:30.239529 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77994605-283b-430a-ad3b-cd1560373614 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-group-rules/ebee6ae6-552e-4adf-9285-392429e23cc0" status: 202 len: 0 microversion: 2.1 time: 0.285619 Oct 17 15:28:30.246635 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 922/1745] 10.222.0.87 () {58 vars in 1287 bytes} [Mon Oct 17 15:28:29 2022] DELETE /compute/v2.1/os-security-group-rules/ebee6ae6-552e-4adf-9285-392429e23cc0 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:30.254430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:30.256492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:30.273158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:30.275879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:30.276481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:30.277218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:30.277677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:30.278133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:30.442397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:30.457801 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc7b9fd5-2d93-482e-b9c1-d47bb4e110b1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1521 microversion: 2.1 time: 0.490201 Oct 17 15:28:30.473034 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 824/1746] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:29 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:30.479177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97164bf5-526d-4b84-b8c7-f4d0367ae1bf tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28c2f630d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1745074879", "description": "tempest-description-424477049"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:30.484335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:30.492894 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e344d32-60dc-4fae-92e2-18934b181709 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.244887 Oct 17 15:28:30.493475 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 923/1747] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:30 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:30.499183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:30.499971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:30.506866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:30.507561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:30.508205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:30.509055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:30.510322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:30.510985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:30.703642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:30.715953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:30.719916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:30.721842 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67825059-5680-44b2-a289-63a9c808a1ba tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.227067 Oct 17 15:28:30.723129 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 924/1748] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:30 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:30.729162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:30.730039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:30.741387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:30.742330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:30.743186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:30.744347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:30.745586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:30.747153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:30.964169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:30.974703 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2225e508-f6c9-4531-818b-aed480e23683 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1521 microversion: 2.1 time: 0.250019 Oct 17 15:28:30.975991 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 925/1749] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:30 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:30.981567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:30.982176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:31.000637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.001544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.002239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.003703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.004986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.007636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.024482 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97164bf5-526d-4b84-b8c7-f4d0367ae1bf tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.553976 Oct 17 15:28:31.024482 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 825/1750] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:28:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:31.031529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cefe3ea7-cbc9-4a6e-bb0f-f5a1ca137c50 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:31.037541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cefe3ea7-cbc9-4a6e-bb0f-f5a1ca137c50 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:31.065748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cefe3ea7-cbc9-4a6e-bb0f-f5a1ca137c50 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.066242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cefe3ea7-cbc9-4a6e-bb0f-f5a1ca137c50 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.066716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cefe3ea7-cbc9-4a6e-bb0f-f5a1ca137c50 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.067764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cefe3ea7-cbc9-4a6e-bb0f-f5a1ca137c50 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.068563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cefe3ea7-cbc9-4a6e-bb0f-f5a1ca137c50 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.069152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cefe3ea7-cbc9-4a6e-bb0f-f5a1ca137c50 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.124517 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cefe3ea7-cbc9-4a6e-bb0f-f5a1ca137c50 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098331 Oct 17 15:28:31.126981 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 826/1751] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:28:31 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:28:31.135251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:31.136695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:31.144036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.145267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.145778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.146594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.147527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.147897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.210769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:31.225913 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2cd5416-8667-4b7d-a390-4ffe35714c55 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1462 microversion: 2.1 time: 0.248506 Oct 17 15:28:31.227214 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 926/1752] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:30 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1462 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:31.232068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:31.233532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:31.242487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.243080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.243741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.244586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.245104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.245594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.470755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:31.479904 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-803645a2-dc2a-4892-b155-059835454cdb tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f" status: 200 len: 1473 microversion: 2.1 time: 0.250828 Oct 17 15:28:31.480767 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 927/1753] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:31 2022] GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:31.488255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f387600-e561-4320-94d4-b0959ab738cc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f387600-e561-4320-94d4-b0959ab738cc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action HTTP/1.1 Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 285 Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:31.493923 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:28:31.495518 n-d-854441-12 devstack@n-api.service[120406]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'd070bb7e-ed9f-40f4-826a-896eaaca1310', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:28:31.496389 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:28:31.497192 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:28:31.498827 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:28:31.499676 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:28:31.499676 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.500667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f387600-e561-4320-94d4-b0959ab738cc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:31.501959 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f387600-e561-4320-94d4-b0959ab738cc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action" status: 400 len: 619 microversion: 2.1 time: 0.019802 Oct 17 15:28:31.503082 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 928/1754] 10.222.0.87 () {60 vars in 1279 bytes} [Mon Oct 17 15:28:31 2022] POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:28:31.520831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21be9dd8-7dda-47d5-9b4c-a4d36afb8ed9 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28beb1f790>, body: {"security_group_rule": {"parent_group_id": "79300f3e-3606-4910-8886-300894046c03", "ip_protocol": "tcp", "from_port": 549974115, "to_port": 22}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:31.635332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-21be9dd8-7dda-47d5-9b4c-a4d36afb8ed9 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] HTTP exception thrown: Invalid port range 549974115:22. Former value cannot be greater than the later Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21be9dd8-7dda-47d5-9b4c-a4d36afb8ed9 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Request method failure captured: Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 145 Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXSbYAiVm7TJDeWImThZy7yoXZVmFaOBMOTgNImb47gNmaBdFJrPddvYzYs24QWmKc2g_PfBplQuvJVsO3jidDHmKkHG2G--nTmXjqtbN81SVBX7JE1dacASMM62dQQUbgC54mgSQ6LwK0m6fEzNMU3IycRyvNxm_bv9bWa2Ui8YglQ Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:31.637160 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_936ac2a9a05248729865ee111acd8f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 9ce1a0c862c64fb5bca688d5fc37f442 Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: {"security_group_rule": {"parent_group_id": "79300f3e-3606-4910-8886-300894046c03", "ip_protocol": "tcp", "from_port": 549974115, "to_port": 22}} Oct 17 15:28:31.639012 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid port range 549974115:22. Former value cannot be greater than the later Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'security_group_rule': {'parent_group_id': '79300f3e-3606-4910-8886-300894046c03', 'ip_protocol': 'tcp', 'from_port': 549974115, 'to_port': 22}}} Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 549974115:22. Former value cannot be greater than the later Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:31.639991 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 549974115:22. Former value cannot be greater than the later Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 549974115:22. Former value cannot be greater than the later Oct 17 15:28:31.641498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:31.643090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21be9dd8-7dda-47d5-9b4c-a4d36afb8ed9 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Returning 400 to user: Invalid port range 549974115:22. Former value cannot be greater than the later {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:31.643090 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21be9dd8-7dda-47d5-9b4c-a4d36afb8ed9 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.121934 Oct 17 15:28:31.645033 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 929/1755] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:28:31 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:28:31.695451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:31.706929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-811e56ba-9bca-449b-b422-0714161a9066 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1307 microversion: 2.1 time: 0.578286 Oct 17 15:28:31.707549 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 827/1756] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:31 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1307 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:31.722692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:31.722692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:31.727479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.727988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.728655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.729275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.729730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.730148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.865817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f38d019-8706-4a47-8df4-708568dfdd96 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:31.866432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f38d019-8706-4a47-8df4-708568dfdd96 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:31.874036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f38d019-8706-4a47-8df4-708568dfdd96 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.874704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f38d019-8706-4a47-8df4-708568dfdd96 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.875148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f38d019-8706-4a47-8df4-708568dfdd96 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:31.875857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f38d019-8706-4a47-8df4-708568dfdd96 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:31.876303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f38d019-8706-4a47-8df4-708568dfdd96 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:31.876726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f38d019-8706-4a47-8df4-708568dfdd96 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:32.119674 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f38d019-8706-4a47-8df4-708568dfdd96 tempest-MigrationsAdminTest-485010690 tempest-MigrationsAdminTest-485010690-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1615 microversion: 2.1 time: 0.471319 Oct 17 15:28:32.128308 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 930/1757] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:31 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1615 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:32.151788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:32.152413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:32.162216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:32.162757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:32.163190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:32.163907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:32.164346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:32.164763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:32.208938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:32.464081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:32.480944 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17ec17e9-5217-4982-a97d-814043de60fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.354062 Oct 17 15:28:32.482091 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 931/1758] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:32 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:32.492218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a60adf8a-5f0d-48ee-93e3-d6d19244896c tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28bedbe790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1469724548", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:32.495550 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a60adf8a-5f0d-48ee-93e3-d6d19244896c tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] HTTP exception thrown: Security group id should be uuid Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a60adf8a-5f0d-48ee-93e3-d6d19244896c tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Request method failure captured: Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 131 Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXSbYAiVm7TJDeWImThZy7yoXZVmFaOBMOTgNImb47gNmaBdFJrPddvYzYs24QWmKc2g_PfBplQuvJVsO3jidDHmKkHG2G--nTmXjqtbN81SVBX7JE1dacASMM62dQQUbgC54mgSQ6LwK0m6fEzNMU3IycRyvNxm_bv9bWa2Ui8YglQ Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:32.498439 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_936ac2a9a05248729865ee111acd8f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 9ce1a0c862c64fb5bca688d5fc37f442 Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1469724548", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:28:32.500429 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group id should be uuid Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1469724548', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:32.501449 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 17 15:28:32.503090 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:32.506151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a60adf8a-5f0d-48ee-93e3-d6d19244896c tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Returning 400 to user: Security group id should be uuid {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:32.507780 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a60adf8a-5f0d-48ee-93e3-d6d19244896c tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.024318 Oct 17 15:28:32.508955 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 932/1759] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:28:32 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:28:32.526069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:32.532128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:32.533063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:32.548631 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f7a3af37-2e22-405e-b97a-8ffe73cef3c8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1521 microversion: 2.1 time: 0.839616 Oct 17 15:28:32.566531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:32.566781 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 828/1760] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:31 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1521 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:32.566781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:32.571040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:32.571242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:32.571355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:32.571355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:32.571355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:32.571355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:32.584719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:32.585604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:32.586352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:32.587867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:32.590848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:32.591608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:32.652816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:32.759783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:32.764333 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-08deb740-1e95-4c39-a142-4c5fa412e782 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "DELETE /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 204 len: 0 microversion: 2.1 time: 0.208402 Oct 17 15:28:32.765062 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 829/1761] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:32 2022] DELETE /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:32.774749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:32.775636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:32.780390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:32.782112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:32.782731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:32.783417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:32.783933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:32.784132 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11640734-0367-45dc-b8b9-40369a1c2686 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.272859 Oct 17 15:28:32.784764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:32.785285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:32.785672 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 933/1762] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:32 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:32.799097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:32.814038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-957b77c9-234a-4ca8-9ad1-c2769f9c33a9 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28bf3e7ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-957535879", "description": "tempest-description-467291772"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:33.137025 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-957b77c9-234a-4ca8-9ad1-c2769f9c33a9 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.328629 Oct 17 15:28:33.138228 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 934/1763] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:28:32 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:33.145471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:33.146540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:33.156404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.157038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.157582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.158402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.159028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.159578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.318224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:33.328605 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ffe5348d-4a48-4cc4-89af-e79348d92153 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f" status: 200 len: 1473 microversion: 2.1 time: 0.559001 Oct 17 15:28:33.329202 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 830/1764] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:32 2022] GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f => generated 1473 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:33.343709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:33.344322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:33.356978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:33.358307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.358833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.359540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.360270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.360806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.361238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.370448 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e118cac-6466-412f-9c18-0ba00800c1fb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1521 microversion: 2.1 time: 0.230769 Oct 17 15:28:33.371078 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 935/1765] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:33 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:33.376099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:33.376912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:33.384707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.385584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.386196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.387123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.387730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.388328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.552341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:33.562798 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f11cc985-0f7c-40e9-9132-03599a507a13 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1468 microversion: 2.1 time: 0.190022 Oct 17 15:28:33.563826 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 936/1766] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:33 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1468 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:33.568938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-955e31b2-804e-4437-beb9-265888aa82fe req-03c9384f-3f65-4269-8c6a-d68ed80df66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0a13ab-993e-497e-8565-47790e0d5721", "tag": "7208a5cc-9906-471a-9f0a-9f7b31850c26"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:33.579823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-955e31b2-804e-4437-beb9-265888aa82fe req-03c9384f-3f65-4269-8c6a-d68ed80df66a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.580702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-955e31b2-804e-4437-beb9-265888aa82fe req-03c9384f-3f65-4269-8c6a-d68ed80df66a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.581382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-955e31b2-804e-4437-beb9-265888aa82fe req-03c9384f-3f65-4269-8c6a-d68ed80df66a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.597976 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-955e31b2-804e-4437-beb9-265888aa82fe req-03c9384f-3f65-4269-8c6a-d68ed80df66a service nova] Creating event network-changed:7208a5cc-9906-471a-9f0a-9f7b31850c26 for instance ed0a13ab-993e-497e-8565-47790e0d5721 on n-h1-854441-12 Oct 17 15:28:33.605983 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-955e31b2-804e-4437-beb9-265888aa82fe req-03c9384f-3f65-4269-8c6a-d68ed80df66a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040523 Oct 17 15:28:33.607159 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 937/1767] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:33.613669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed567fd0-d702-4edf-a425-e2517687b23d tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28bf1a8160>, body: {"security_group_rule": {"parent_group_id": "15d32852-0d0b-4789-9f88-44330ba7740f", "ip_protocol": "tempest-999-24603324", "from_port": 22, "to_port": 22}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:33.666033 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ed567fd0-d702-4edf-a425-e2517687b23d tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] HTTP exception thrown: Invalid IP protocol tempest-999-24603324. Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed567fd0-d702-4edf-a425-e2517687b23d tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Request method failure captured: Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 155 Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXSbYAiVm7TJDeWImThZy7yoXZVmFaOBMOTgNImb47gNmaBdFJrPddvYzYs24QWmKc2g_PfBplQuvJVsO3jidDHmKkHG2G--nTmXjqtbN81SVBX7JE1dacASMM62dQQUbgC54mgSQ6LwK0m6fEzNMU3IycRyvNxm_bv9bWa2Ui8YglQ Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:33.668183 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_936ac2a9a05248729865ee111acd8f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 9ce1a0c862c64fb5bca688d5fc37f442 Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: {"security_group_rule": {"parent_group_id": "15d32852-0d0b-4789-9f88-44330ba7740f", "ip_protocol": "tempest-999-24603324", "from_port": 22, "to_port": 22}} Oct 17 15:28:33.669827 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid IP protocol tempest-999-24603324. Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'security_group_rule': {'parent_group_id': '15d32852-0d0b-4789-9f88-44330ba7740f', 'ip_protocol': 'tempest-999-24603324', 'from_port': 22, 'to_port': 22}}} Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-24603324. Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:33.670757 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-24603324. Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-24603324. Oct 17 15:28:33.672092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:33.675178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed567fd0-d702-4edf-a425-e2517687b23d tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Returning 400 to user: Invalid IP protocol tempest-999-24603324. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:33.676311 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed567fd0-d702-4edf-a425-e2517687b23d tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.067834 Oct 17 15:28:33.677159 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 938/1768] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:28:33 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:28:33.686177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3a92b30-d844-4965-a0bf-fa20af2c1ddf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1017095705"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:33.689380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3a92b30-d844-4965-a0bf-fa20af2c1ddf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:33.697463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a92b30-d844-4965-a0bf-fa20af2c1ddf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.698352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a92b30-d844-4965-a0bf-fa20af2c1ddf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.699065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a92b30-d844-4965-a0bf-fa20af2c1ddf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.700318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a92b30-d844-4965-a0bf-fa20af2c1ddf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.703976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a92b30-d844-4965-a0bf-fa20af2c1ddf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.704976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3a92b30-d844-4965-a0bf-fa20af2c1ddf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.852246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:33.872154 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9e57475e-cb85-48b2-839a-67f09f934406 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1307 microversion: 2.1 time: 0.532037 Oct 17 15:28:33.872929 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 831/1769] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:33 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1307 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:33.893889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:33.894531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:33.909501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.909994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.910434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:33.911179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:33.911627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:33.912049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.121980 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3a92b30-d844-4965-a0bf-fa20af2c1ddf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action" status: 202 len: 0 microversion: 2.1 time: 0.443094 Oct 17 15:28:34.125172 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 939/1770] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:28:33 2022] POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:28:34.134073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a96e95ad-f1b6-4296-b5d0-641736e4bc31 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28bf20e1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-195389688", "description": "tempest-description-2030781016"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:34.493071 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a96e95ad-f1b6-4296-b5d0-641736e4bc31 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.366558 Oct 17 15:28:34.494333 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 940/1771] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:28:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:34.498709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:34.509601 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4677931d-5659-4f4d-bd69-4303db25dfbf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.619604 Oct 17 15:28:34.510183 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 832/1772] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:33 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:34.522671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-748329677"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:34.525033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:34.528999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:34.530885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:34.541910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:34.542363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:34.542946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:34.543380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.544083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:34.544282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:34.545854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.546619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:34.547412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:34.547853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.555214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:34.555933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.605381 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Cannot 'createImage' instance d070bb7e-ed9f-40f4-826a-896eaaca1310 while it is in task_state image_snapshot_pending Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action HTTP/1.1 Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 84 Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:34.607117 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-748329677"}} Oct 17 15:28:34.608994 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: exception: Cannot 'createImage' instance d070bb7e-ed9f-40f4-826a-896eaaca1310 while it is in task_state image_snapshot_pending Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd070bb7e-ed9f-40f4-826a-896eaaca1310', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-748329677'}}} Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:34.609973 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance d070bb7e-ed9f-40f4-826a-896eaaca1310 while it is in task_state image_snapshot_pending Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance d070bb7e-ed9f-40f4-826a-896eaaca1310 while it is in task_state image_snapshot_pending Oct 17 15:28:34.611567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.613085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 409 to user: Cannot 'createImage' instance d070bb7e-ed9f-40f4-826a-896eaaca1310 while it is in task_state image_snapshot_pending {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:34.613085 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4b1e405-7c82-4a42-bc50-b0e0c14cbc94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action" status: 409 len: 167 microversion: 2.1 time: 0.091691 Oct 17 15:28:34.613085 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 833/1773] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:28:34 2022] POST /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310/action => generated 167 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:28:34.615067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:34.615690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:34.622156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:34.622680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:34.623182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.623952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:34.624452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:34.624883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.670840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:34.671409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:34.671911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.672423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lazy-loading 'fault' on Instance uuid 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:34.715880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:34.724176 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d9162856-3c29-49c6-b477-ec135850e699 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f" status: 200 len: 1308 microversion: 2.1 time: 0.112954 Oct 17 15:28:34.725153 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 834/1774] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:34 2022] GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:34.730215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc6a4968-1c65-4866-96f3-c3e04eceb523 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28c2f3cc10>, body: {"security_group_rule": {"parent_group_id": "26de0910-579b-4385-b90f-c1af353edcef", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:34.743199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:34.752688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:34.754171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:34.759316 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6dd80f98-685e-4356-a4bd-d7eb9c93efc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.263522 Oct 17 15:28:34.759840 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 941/1775] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:34 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:34.769778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:34.770393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:34.785361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:34.785877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:34.786301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.787048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:34.787500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:34.787918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:34.802068 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-dc6a4968-1c65-4866-96f3-c3e04eceb523 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc6a4968-1c65-4866-96f3-c3e04eceb523 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Request method failure captured: Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 138 Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXSbYAiVm7TJDeWImThZy7yoXZVmFaOBMOTgNImb47gNmaBdFJrPddvYzYs24QWmKc2g_PfBplQuvJVsO3jidDHmKkHG2G--nTmXjqtbN81SVBX7JE1dacASMM62dQQUbgC54mgSQ6LwK0m6fEzNMU3IycRyvNxm_bv9bWa2Ui8YglQ Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:34.804168 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_936ac2a9a05248729865ee111acd8f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 9ce1a0c862c64fb5bca688d5fc37f442 Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: {"security_group_rule": {"parent_group_id": "26de0910-579b-4385-b90f-c1af353edcef", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 17 15:28:34.805907 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'security_group_rule': {'parent_group_id': '26de0910-579b-4385-b90f-c1af353edcef', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:34.807015 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 15:28:34.808501 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:34.810014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc6a4968-1c65-4866-96f3-c3e04eceb523 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:34.810479 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc6a4968-1c65-4866-96f3-c3e04eceb523 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.083570 Oct 17 15:28:34.817863 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 835/1776] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:28:34 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:28:34.822971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cebd4844-1e4d-4384-a269-9a209ad99af8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '.version_select at 0x7f28bea63e50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:34.942331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:34.952346 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e765c84d-4079-4d3a-a396-e0e4d202480b tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1468 microversion: 2.1 time: 0.186287 Oct 17 15:28:34.953837 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 942/1777] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:34 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1468 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:34.959550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-847010f3-deb3-4000-ba85-01ead2c8c64a tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28beb84a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1749062780", "description": "tempest-description-1863030864"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:34.995548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:35.020005 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cebd4844-1e4d-4384-a269-9a209ad99af8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/images/6b675544-5ff7-4e3b-861a-589f0469f893" status: 204 len: 0 microversion: 2.1 time: 0.200757 Oct 17 15:28:35.020548 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 836/1778] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:34 2022] DELETE /compute/v2.1/images/6b675544-5ff7-4e3b-861a-589f0469f893 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:35.025752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:35.026370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:35.028353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:35.035587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.036406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.037261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.038162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.038780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.039387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.056447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:35.123666 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-847010f3-deb3-4000-ba85-01ead2c8c64a tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.168747 Oct 17 15:28:35.124497 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 943/1779] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:28:34 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:35.130585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:35.131421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:35.145016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.147707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.148361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.149086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.151289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.151741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.227632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:35.241404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-32431e1e-9914-4fcf-887a-99bb09472be2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1307 microversion: 2.1 time: 0.219501 Oct 17 15:28:35.242340 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 837/1780] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:35 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:35.247791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8996b926-436a-4cb1-b4ed-b2dec13f21f8 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28bea4a430>, body: {"security_group_rule": {"parent_group_id": "be5e53f1-78f5-4d7b-8c82-e0c6657b16de", "ip_protocol": "tcp", "from_port": 22, "to_port": 187243719}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:35.318340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:35.319420 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8996b926-436a-4cb1-b4ed-b2dec13f21f8 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] HTTP exception thrown: Invalid port range 22:187243719. Valid TCP ports should be between 1-65535 Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8996b926-436a-4cb1-b4ed-b2dec13f21f8 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Request method failure captured: Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 145 Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXSbYAiVm7TJDeWImThZy7yoXZVmFaOBMOTgNImb47gNmaBdFJrPddvYzYs24QWmKc2g_PfBplQuvJVsO3jidDHmKkHG2G--nTmXjqtbN81SVBX7JE1dacASMM62dQQUbgC54mgSQ6LwK0m6fEzNMU3IycRyvNxm_bv9bWa2Ui8YglQ Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:35.320936 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_936ac2a9a05248729865ee111acd8f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 9ce1a0c862c64fb5bca688d5fc37f442 Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: {"security_group_rule": {"parent_group_id": "be5e53f1-78f5-4d7b-8c82-e0c6657b16de", "ip_protocol": "tcp", "from_port": 22, "to_port": 187243719}} Oct 17 15:28:35.322712 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid port range 22:187243719. Valid TCP ports should be between 1-65535 Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'be5e53f1-78f5-4d7b-8c82-e0c6657b16de', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 187243719}}} Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:187243719. Valid TCP ports should be between 1-65535 Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:35.324069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:187243719. Valid TCP ports should be between 1-65535 Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:187243719. Valid TCP ports should be between 1-65535 Oct 17 15:28:35.325365 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.328299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8996b926-436a-4cb1-b4ed-b2dec13f21f8 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Returning 400 to user: Invalid port range 22:187243719. Valid TCP ports should be between 1-65535 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:35.328299 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8996b926-436a-4cb1-b4ed-b2dec13f21f8 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.078917 Oct 17 15:28:35.328299 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 838/1781] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:28:35 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:28:35.331954 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b500f32b-5c75-4913-bfb1-10e5162aaa94 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1541 microversion: 2.1 time: 0.206183 Oct 17 15:28:35.332526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df891181-7bf5-4de5-9d74-489be9582e04 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Action: 'create', calling method: .version_select at 0x7f28bea52ca0>, body: {"security_group_rule": {"parent_group_id": "49a7f1b8-8abf-4200-a13d-d92890eee510", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:35.332698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 944/1782] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:35 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1541 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:35.358983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-df891181-7bf5-4de5-9d74-489be9582e04 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 49a7f1b8-8abf-4200-a13d-d92890eee510 does not exist", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:28:35.358983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.security_group_api [None req-df891181-7bf5-4de5-9d74-489be9582e04 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Neutron security group 49a7f1b8-8abf-4200-a13d-d92890eee510 not found {{(pid=120407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:28:35.358983 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-df891181-7bf5-4de5-9d74-489be9582e04 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] HTTP exception thrown: Security group 49a7f1b8-8abf-4200-a13d-d92890eee510 does not exist Oct 17 15:28:35.358983 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-d2cbf24c-fe05-44f2-8fcb-b5cefa57bd1b'] Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df891181-7bf5-4de5-9d74-489be9582e04 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Request method failure captured: Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 138 Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXSbYAiVm7TJDeWImThZy7yoXZVmFaOBMOTgNImb47gNmaBdFJrPddvYzYs24QWmKc2g_PfBplQuvJVsO3jidDHmKkHG2G--nTmXjqtbN81SVBX7JE1dacASMM62dQQUbgC54mgSQ6LwK0m6fEzNMU3IycRyvNxm_bv9bWa2Ui8YglQ Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:35.360685 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_936ac2a9a05248729865ee111acd8f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 9ce1a0c862c64fb5bca688d5fc37f442 Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: {"security_group_rule": {"parent_group_id": "49a7f1b8-8abf-4200-a13d-d92890eee510", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 15:28:35.362553 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: exception: Security group 49a7f1b8-8abf-4200-a13d-d92890eee510 does not exist Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-d2cbf24c-fe05-44f2-8fcb-b5cefa57bd1b'] Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'security_group_rule': {'parent_group_id': '49a7f1b8-8abf-4200-a13d-d92890eee510', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:28:35.363458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 49a7f1b8-8abf-4200-a13d-d92890eee510 does not exist Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2cbf24c-fe05-44f2-8fcb-b5cefa57bd1b'] Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 17 15:28:35.365215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 49a7f1b8-8abf-4200-a13d-d92890eee510 does not exist Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2cbf24c-fe05-44f2-8fcb-b5cefa57bd1b'] Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 49a7f1b8-8abf-4200-a13d-d92890eee510 does not exist Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2cbf24c-fe05-44f2-8fcb-b5cefa57bd1b'] Oct 17 15:28:35.366619 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 49a7f1b8-8abf-4200-a13d-d92890eee510 does not exist Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2cbf24c-fe05-44f2-8fcb-b5cefa57bd1b'] Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df891181-7bf5-4de5-9d74-489be9582e04 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Returning 404 to user: Security group 49a7f1b8-8abf-4200-a13d-d92890eee510 does not exist Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-d2cbf24c-fe05-44f2-8fcb-b5cefa57bd1b'] {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:35.368022 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-df891181-7bf5-4de5-9d74-489be9582e04 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.033418 Oct 17 15:28:35.369083 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 839/1783] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:28:35 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:35.373344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56c51540-7e40-462c-abcf-d3de83c48293 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Calling method '.version_select at 0x7f28becbb9d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:35.397764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-56c51540-7e40-462c-abcf-d3de83c48293 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 3100846b-df69-4c14-8edb-e7df2735de8e does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:28:35.398370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-56c51540-7e40-462c-abcf-d3de83c48293 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Neutron security group rule 3100846b-df69-4c14-8edb-e7df2735de8e not found {{(pid=120406) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 17 15:28:35.398925 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-56c51540-7e40-462c-abcf-d3de83c48293 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] HTTP exception thrown: Security group rule 3100846b-df69-4c14-8edb-e7df2735de8e does not exist Oct 17 15:28:35.398925 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-ececc705-3bb2-4bfd-aaea-18422e5cfedb'] Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56c51540-7e40-462c-abcf-d3de83c48293 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Request method failure captured: Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-group-rules/3100846b-df69-4c14-8edb-e7df2735de8e HTTP/1.1 Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXSbYAiVm7TJDeWImThZy7yoXZVmFaOBMOTgNImb47gNmaBdFJrPddvYzYs24QWmKc2g_PfBplQuvJVsO3jidDHmKkHG2G--nTmXjqtbN81SVBX7JE1dacASMM62dQQUbgC54mgSQ6LwK0m6fEzNMU3IycRyvNxm_bv9bWa2Ui8YglQ Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:35.400903 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_936ac2a9a05248729865ee111acd8f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/936ac2a9a05248729865ee111acd8f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 936ac2a9a05248729865ee111acd8f53 Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023 Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 9ce1a0c862c64fb5bca688d5fc37f442 Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group rule 3100846b-df69-4c14-8edb-e7df2735de8e does not exist Oct 17 15:28:35.402767 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-ececc705-3bb2-4bfd-aaea-18422e5cfedb'] Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '3100846b-df69-4c14-8edb-e7df2735de8e'} Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.403761 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 3100846b-df69-4c14-8edb-e7df2735de8e does not exist Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ececc705-3bb2-4bfd-aaea-18422e5cfedb'] Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 17 15:28:35.405317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 3100846b-df69-4c14-8edb-e7df2735de8e does not exist Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ececc705-3bb2-4bfd-aaea-18422e5cfedb'] Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 3100846b-df69-4c14-8edb-e7df2735de8e does not exist Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ececc705-3bb2-4bfd-aaea-18422e5cfedb'] Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.406784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 3100846b-df69-4c14-8edb-e7df2735de8e does not exist Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ececc705-3bb2-4bfd-aaea-18422e5cfedb'] Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56c51540-7e40-462c-abcf-d3de83c48293 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Returning 404 to user: Security group rule 3100846b-df69-4c14-8edb-e7df2735de8e does not exist Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-ececc705-3bb2-4bfd-aaea-18422e5cfedb'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:35.408397 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56c51540-7e40-462c-abcf-d3de83c48293 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-group-rules/3100846b-df69-4c14-8edb-e7df2735de8e" status: 404 len: 199 microversion: 2.1 time: 0.039275 Oct 17 15:28:35.414226 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 945/1784] 10.222.0.87 () {58 vars in 1287 bytes} [Mon Oct 17 15:28:35 2022] DELETE /compute/v2.1/os-security-group-rules/3100846b-df69-4c14-8edb-e7df2735de8e => generated 199 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:35.418340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-16dd1bc0-c91e-4017-96ff-26499adba3c3 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Calling method '.version_select at 0x7f28c2f3cd30>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:35.534955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:35.535721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:35.544001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.544902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.545375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.546155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.547211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.547640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.676257 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-16dd1bc0-c91e-4017-96ff-26499adba3c3 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/be5e53f1-78f5-4d7b-8c82-e0c6657b16de" status: 202 len: 0 microversion: 2.1 time: 0.262094 Oct 17 15:28:35.678102 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 840/1785] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:28:35 2022] DELETE /compute/v2.1/os-security-groups/be5e53f1-78f5-4d7b-8c82-e0c6657b16de => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:28:35.687943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-438a934a-617c-4927-90f4-450128c19967 req-4bfc1b1c-2e0f-429e-8e57-c79b8d8d01c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd095af-cfc4-415b-bd1f-7cf9234fcc2f", "name": "network-vif-deleted", "tag": "fc8831de-bd51-450c-a522-db20043ea8fb"}, {"server_uuid": "be739b8d-d20e-46e8-b17e-e98f66c72ea5", "name": "network-vif-deleted", "tag": "41fbc30e-61ff-4f5b-a5e1-dec150c6c6d1"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:35.702778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-438a934a-617c-4927-90f4-450128c19967 req-4bfc1b1c-2e0f-429e-8e57-c79b8d8d01c6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.703725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-438a934a-617c-4927-90f4-450128c19967 req-4bfc1b1c-2e0f-429e-8e57-c79b8d8d01c6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.704162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-438a934a-617c-4927-90f4-450128c19967 req-4bfc1b1c-2e0f-429e-8e57-c79b8d8d01c6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.719635 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-438a934a-617c-4927-90f4-450128c19967 req-4bfc1b1c-2e0f-429e-8e57-c79b8d8d01c6 service nova] Creating event network-vif-deleted:fc8831de-bd51-450c-a522-db20043ea8fb for instance 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f on n-h1-854441-12 Oct 17 15:28:35.720654 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-438a934a-617c-4927-90f4-450128c19967 req-4bfc1b1c-2e0f-429e-8e57-c79b8d8d01c6 service nova] Creating event network-vif-deleted:41fbc30e-61ff-4f5b-a5e1-dec150c6c6d1 for instance be739b8d-d20e-46e8-b17e-e98f66c72ea5 on n-h1-854441-12 Oct 17 15:28:35.722895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:35.728733 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-438a934a-617c-4927-90f4-450128c19967 req-4bfc1b1c-2e0f-429e-8e57-c79b8d8d01c6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049107 Oct 17 15:28:35.729601 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 841/1786] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:35.731995 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be4ab084-11ea-4ad0-b6cd-9acb38ef1bf7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.201264 Oct 17 15:28:35.737978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-09e3fdd5-911b-4ab9-abe9-641bcbdfb78e tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Calling method '.version_select at 0x7f28c2ecd0d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:35.743710 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 946/1787] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:35 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:35.751405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:35.752114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:35.759467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.759948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.760376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.761071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.761511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.762152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.798479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.799359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.799847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.800604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lazy-loading 'fault' on Instance uuid 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:35.843993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:35.853071 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4849b670-a68b-4075-b7f6-311006479072 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f" status: 200 len: 1308 microversion: 2.1 time: 0.107826 Oct 17 15:28:35.862266 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 947/1788] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:35 2022] GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:35.866152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:35.866808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:35.873771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.874227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.874755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:35.875540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:35.876691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:35.876691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:36.109840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:36.121972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:36.123712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:36.125080 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-557d818e-c4bb-4dd2-a1c9-99bb474ee3d4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.270231 Oct 17 15:28:36.125908 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 948/1789] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:35 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:36.131501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:36.132530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:36.139744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:36.140737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:36.141440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:36.143283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:36.143988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:36.144694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:36.189396 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-09e3fdd5-911b-4ab9-abe9-641bcbdfb78e tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/26de0910-579b-4385-b90f-c1af353edcef" status: 202 len: 0 microversion: 2.1 time: 0.458304 Oct 17 15:28:36.195589 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 842/1790] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:28:35 2022] DELETE /compute/v2.1/os-security-groups/26de0910-579b-4385-b90f-c1af353edcef => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:36.200776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df36d37b-4d0a-44a2-941f-7cdc7c757260 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Calling method '.version_select at 0x7f28bea528b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:36.395125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:36.411538 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6673a207-2183-4f3f-a900-111376658a93 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1468 microversion: 2.1 time: 0.284243 Oct 17 15:28:36.412364 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 949/1791] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:36 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1468 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:36.417263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:36.419147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:36.425694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:36.426254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:36.426780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:36.427560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:36.428237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:36.428869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:36.602175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:36.612530 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a2af06b-84dd-478c-944f-a7d8855e29ac tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1307 microversion: 2.1 time: 0.198820 Oct 17 15:28:36.619215 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 950/1792] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:36 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:36.627581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:36.629182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:36.636381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:36.636898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:36.637539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:36.639023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:36.639482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:36.640280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:36.825077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:36.840451 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-df36d37b-4d0a-44a2-941f-7cdc7c757260 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/15d32852-0d0b-4789-9f88-44330ba7740f" status: 202 len: 0 microversion: 2.1 time: 0.643543 Oct 17 15:28:36.841846 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 843/1793] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:28:36 2022] DELETE /compute/v2.1/os-security-groups/15d32852-0d0b-4789-9f88-44330ba7740f => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:36.847986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:36.848788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:36.855091 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d45b959e-3a98-4d86-8aad-0ccf05394fa9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1533 microversion: 2.1 time: 0.234382 Oct 17 15:28:36.856073 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 951/1794] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:36 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1533 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:36.871833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c2d8776-1909-48c7-9678-cb63dede073c tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Calling method '.version_select at 0x7f28bedda5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:36.886157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:36.887142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:36.887786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:36.888723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:36.889097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:36.889524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.136492 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c2d8776-1909-48c7-9678-cb63dede073c tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/79300f3e-3606-4910-8886-300894046c03" status: 202 len: 0 microversion: 2.1 time: 0.275249 Oct 17 15:28:37.137332 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 952/1795] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:28:36 2022] DELETE /compute/v2.1/os-security-groups/79300f3e-3606-4910-8886-300894046c03 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:37.146123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:37.146810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:37.170032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.170561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.171009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.171729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.172415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.173195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.193044 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] HTTP exception thrown: Instance 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f could not be found. Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Request method failure captured: Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f HTTP/1.1 Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOy4YIV9dGGOlYBRZ0F7igKcjNUQVY_QXu68sdCLtbczdytvezShVmrOiCrYJEIri6bWQZI5Dpv2ZOIKcHeQs-ZZch_pDZ5k4z2CobwVLs0ewF3OswO2gQru1sxNV7EGlzjGqf2fpmTnp4xGD9HMcB_jiM4d1ZfSoRXL_CCR4shTY4 Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:37.196491 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a6d13409eb044988911b34d37730b714 Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f could not be found. Oct 17 15:28:37.198164 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8bd095af-cfc4-415b-bd1f-7cf9234fcc2f'} Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f could not be found. Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:37.199049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f could not be found. Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f could not be found. Oct 17 15:28:37.200578 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.205035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Returning 404 to user: Instance 8bd095af-cfc4-415b-bd1f-7cf9234fcc2f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:37.206428 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea8f0b46-f6de-4623-8e80-610f8333e76b tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f" status: 404 len: 111 microversion: 2.1 time: 0.067366 Oct 17 15:28:37.209473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:37.210388 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 953/1796] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:37 2022] GET /compute/v2.1/servers/8bd095af-cfc4-415b-bd1f-7cf9234fcc2f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:37.215765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42c4b097-5434-487e-a45c-98be79c397d6 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] Calling method '.version_select at 0x7f28be9faee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:37.233375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b908df7c-0cc9-4589-9c04-a620fc936778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.388513 Oct 17 15:28:37.264206 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 844/1797] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:36 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:37.272345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:37.276929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:37.285079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.285963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.286689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.287746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.288312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.288831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.612512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:37.613083 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42c4b097-5434-487e-a45c-98be79c397d6 tempest-SecurityGroupRulesNegativeTestJSON-1003670023 tempest-SecurityGroupRulesNegativeTestJSON-1003670023-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5" status: 202 len: 0 microversion: 2.1 time: 0.401332 Oct 17 15:28:37.614599 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 954/1798] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:28:37 2022] DELETE /compute/v2.1/os-security-groups/d4f28827-1d85-4075-ab7a-9dbbd1ba6ab5 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:37.625043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:37.626941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:37.627867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: be739b8d-d20e-46e8-b17e-e98f66c72ea5] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:37.628486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:37.631591 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02769cbe-734d-4a51-8aea-484732ae5806 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.365279 Oct 17 15:28:37.632416 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 845/1799] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:37 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:37.637383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:37.638071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.638699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:37.639152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.639998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.640950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.641612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.642135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.657533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.658142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.659210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.660923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.663347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.664609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.674107 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] HTTP exception thrown: Instance be739b8d-d20e-46e8-b17e-e98f66c72ea5 could not be found. Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Request method failure captured: Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 HTTP/1.1 Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOy4YIV9dGGOlYBRZ0F7igKcjNUQVY_QXu68sdCLtbczdytvezShVmrOiCrYJEIri6bWQZI5Dpv2ZOIKcHeQs-ZZch_pDZ5k4z2CobwVLs0ewF3OswO2gQru1sxNV7EGlzjGqf2fpmTnp4xGD9HMcB_jiM4d1ZfSoRXL_CCR4shTY4 Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:37.676293 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a6d13409eb044988911b34d37730b714 Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance be739b8d-d20e-46e8-b17e-e98f66c72ea5 could not be found. Oct 17 15:28:37.677776 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'be739b8d-d20e-46e8-b17e-e98f66c72ea5'} Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be739b8d-d20e-46e8-b17e-e98f66c72ea5 could not be found. Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:37.678649 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be739b8d-d20e-46e8-b17e-e98f66c72ea5 could not be found. Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be739b8d-d20e-46e8-b17e-e98f66c72ea5 could not be found. Oct 17 15:28:37.680010 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:37.683781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Returning 404 to user: Instance be739b8d-d20e-46e8-b17e-e98f66c72ea5 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:37.685430 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9367c4a0-b15e-4d68-8c45-f8758053dd62 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5" status: 404 len: 111 microversion: 2.1 time: 0.069081 Oct 17 15:28:37.686988 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 955/1800] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:37 2022] GET /compute/v2.1/servers/be739b8d-d20e-46e8-b17e-e98f66c72ea5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:37.694166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:37.694891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:37.701051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:37.703322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.703858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.704334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.705457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.706827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.707385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.720106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:37.721108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:37.721767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:37.722438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lazy-loading 'fault' on Instance uuid 91a05ba5-2063-49b7-92bb-7122faf92713 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:37.747935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:37.913940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:37.922986 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5eb0c867-597a-4535-9a4b-9a016ca9efbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1307 microversion: 2.1 time: 0.234582 Oct 17 15:28:37.923598 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 956/1801] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:37 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:37.930586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f522abc6-8858-46f9-bdbe-ed5d74077975 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:38.005105 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f522abc6-8858-46f9-bdbe-ed5d74077975 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/f37a43ff-eefa-4838-b0a5-1068b6e615b1" status: 204 len: 0 microversion: 2.1 time: 0.078790 Oct 17 15:28:38.006110 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 957/1802] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:28:37 2022] DELETE /compute/v2.1/os-server-groups/f37a43ff-eefa-4838-b0a5-1068b6e615b1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:38.013425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:38.014140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:38.021858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.022446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.022950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.023726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.024474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.024735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.197153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:38.208213 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4377142b-680d-4783-a8c4-c12066c0f6ff tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1539 microversion: 2.1 time: 0.200576 Oct 17 15:28:38.208904 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 958/1803] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:38 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:38.214859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:38.215806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:38.225889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.226420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.227084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.227797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.228267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.228875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.259836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:38.267267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:38.268914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3148ac9e-70c9-4ef1-838e-fd0669bc38d7 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 200 len: 1303 microversion: 2.1 time: 0.635218 Oct 17 15:28:38.269499 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 846/1804] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:37 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 1303 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:38.274631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1999b048-392d-4669-903a-b9d3f51dfd2d req-fd02829f-3560-4e4b-a2f0-16502d814e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a05ba5-2063-49b7-92bb-7122faf92713", "name": "network-vif-deleted", "tag": "18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:38.279816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:38.299652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1999b048-392d-4669-903a-b9d3f51dfd2d req-fd02829f-3560-4e4b-a2f0-16502d814e27 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.301074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1999b048-392d-4669-903a-b9d3f51dfd2d req-fd02829f-3560-4e4b-a2f0-16502d814e27 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.301587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1999b048-392d-4669-903a-b9d3f51dfd2d req-fd02829f-3560-4e4b-a2f0-16502d814e27 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.319838 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1999b048-392d-4669-903a-b9d3f51dfd2d req-fd02829f-3560-4e4b-a2f0-16502d814e27 service nova] Creating event network-vif-deleted:18a8b0e1-fe13-4a85-8fb1-4fd80638ee7f for instance 91a05ba5-2063-49b7-92bb-7122faf92713 on n-h2-854441-12 Oct 17 15:28:38.327121 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1999b048-392d-4669-903a-b9d3f51dfd2d req-fd02829f-3560-4e4b-a2f0-16502d814e27 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054743 Oct 17 15:28:38.328066 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 847/1805] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:38.338270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:38.339257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:38.346436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.347362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.348175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.349180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.349873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.350532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.436636 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce27104a-a96c-4636-9a4c-35f540cdd544 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 204 len: 0 microversion: 2.1 time: 0.224577 Oct 17 15:28:38.437763 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 959/1806] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:38 2022] DELETE /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:38.455752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:38.457483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:38.466859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.468474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.468920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.470412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.471058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.472632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.648510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:38.657923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b65d5155-f629-4653-b02f-6e403ad1d24a tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1473 microversion: 2.1 time: 0.215471 Oct 17 15:28:38.658540 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 960/1807] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:38 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:38.691762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:38.692401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:38.702654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.703155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.703593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.704304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.704750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.705452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.719203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:38.727446 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1d9ddf0f-76f3-4c9b-a838-e3b22a14a861 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.397570 Oct 17 15:28:38.732622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 848/1808] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:38 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:38.892201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:38.901580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:38.903065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:38.904391 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c44f1310-1dcf-48fe-9128-af8c7151fb78 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.244796 Oct 17 15:28:38.905410 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 961/1809] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:38 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:38.949077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:38.951317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:38.960206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.962313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.963157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:38.964869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:38.966730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:38.972255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.235970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:39.237425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:39.256865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.258104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.258598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.259533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.260164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.260758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.429252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:39.439766 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-338ba934-5d43-438d-ade1-c99018948113 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1539 microversion: 2.1 time: 0.209180 Oct 17 15:28:39.444086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:39.453039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e0d61b6d-20af-48cb-aa2d-0344eafe8bf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1307 microversion: 2.1 time: 0.510401 Oct 17 15:28:39.453891 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 849/1810] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:38 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1307 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:39.457609 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 962/1811] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:39 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1539 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:39.459297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:39.460103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 91a05ba5-2063-49b7-92bb-7122faf92713] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:39.486012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.486542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.487135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.487864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.488323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.489141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.506493 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] HTTP exception thrown: Instance 91a05ba5-2063-49b7-92bb-7122faf92713 could not be found. Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Request method failure captured: Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 HTTP/1.1 Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXMYvpnQDsGGIQ_IabX6Ce5ZCjLhxqJFt2NG7mPJmeSL-8aEn5h-8TVGHoj7doKSnVbAq9mq1oEhx29vwwZXhzMTd6tEAxQwOTsq8ndMnDXkZ9m9E1kgZkuKvaBU52QJg6hwCr9ofOF3rBqOjmnHHarc7t05onsH9k0yx5KccFuC6Y4 Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 72c637634ac84f7299ee3ac1a67f2750 Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-MigrationsAdminTest-103296004 Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:39.508230 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-MigrationsAdminTest-103296004 Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 72c637634ac84f7299ee3ac1a67f2750 Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-MigrationsAdminTest-103296004 Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-MigrationsAdminTest-103296004-project Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 5ec3b5fbeafd47558718a7a9638d0c9e Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-MigrationsAdminTest-103296004-project Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 91a05ba5-2063-49b7-92bb-7122faf92713 could not be found. Oct 17 15:28:39.510155 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '91a05ba5-2063-49b7-92bb-7122faf92713'} Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a05ba5-2063-49b7-92bb-7122faf92713 could not be found. Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:39.511277 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a05ba5-2063-49b7-92bb-7122faf92713 could not be found. Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a05ba5-2063-49b7-92bb-7122faf92713 could not be found. Oct 17 15:28:39.512952 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:39.515386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Returning 404 to user: Instance 91a05ba5-2063-49b7-92bb-7122faf92713 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:39.515386 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e6e00e0a-5d67-432c-b22d-a9ea875eb38d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713" status: 404 len: 111 microversion: 2.1 time: 0.054563 Oct 17 15:28:39.515386 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 850/1812] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:39 2022] GET /compute/v2.1/servers/91a05ba5-2063-49b7-92bb-7122faf92713 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:39.519109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:39.519638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:39.528037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.529333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.529786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.530664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.531468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.532080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.562002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:39.681132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:39.681758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:39.689169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.689616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.690241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.691138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.691743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.692320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.709286 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b25506f1-0115-486a-b64d-b18b6bbdd9c2 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 204 len: 0 microversion: 2.1 time: 0.194079 Oct 17 15:28:39.714729 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 963/1813] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:39 2022] DELETE /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:39.721491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:39.722475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:39.729442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.730183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.730824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.731931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.732648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.733282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.906304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:39.919799 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a02f659e-6b42-488f-9155-43b415d9a191 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1534 microversion: 2.1 time: 0.202363 Oct 17 15:28:39.920407 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 964/1814] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:39 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1534 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:39.925689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:39.926300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:39.933486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.933986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.934430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:39.935187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:39.935640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:39.936062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.141510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:40.157034 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0abebf4-428d-4a23-9022-7dedc2259fad tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.235034 Oct 17 15:28:40.168714 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 965/1815] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:39 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:40.171164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:40.181461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:40.182263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:40.184604 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6cf50866-465a-45cb-b35e-d29ccd3233f3 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1473 microversion: 2.1 time: 0.504199 Oct 17 15:28:40.198524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.198524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.198524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.198524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.199153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.199153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.199332 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 851/1816] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:39 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1473 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:40.201913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-507dfd3d-228c-4843-b064-09a74ba8931a req-79327bd0-6c89-40c1-9a34-56881fa9b497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0a13ab-993e-497e-8565-47790e0d5721", "name": "network-vif-plugged", "status": "completed", "tag": "7208a5cc-9906-471a-9f0a-9f7b31850c26"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:40.212127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-507dfd3d-228c-4843-b064-09a74ba8931a req-79327bd0-6c89-40c1-9a34-56881fa9b497 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.212261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-507dfd3d-228c-4843-b064-09a74ba8931a req-79327bd0-6c89-40c1-9a34-56881fa9b497 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.212595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-507dfd3d-228c-4843-b064-09a74ba8931a req-79327bd0-6c89-40c1-9a34-56881fa9b497 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.224688 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-507dfd3d-228c-4843-b064-09a74ba8931a req-79327bd0-6c89-40c1-9a34-56881fa9b497 service nova] Creating event network-vif-plugged:7208a5cc-9906-471a-9f0a-9f7b31850c26 for instance ed0a13ab-993e-497e-8565-47790e0d5721 on n-h1-854441-12 Oct 17 15:28:40.232898 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-507dfd3d-228c-4843-b064-09a74ba8931a req-79327bd0-6c89-40c1-9a34-56881fa9b497 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034535 Oct 17 15:28:40.234073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 852/1817] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:40.410919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:40.424193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:40.425767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:40.427313 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d04b10b-83e4-4d02-bf3c-afb9b7172452 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.258121 Oct 17 15:28:40.429026 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 966/1818] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:40 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:40.466245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:40.467081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:40.474907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.475687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.476119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.477186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.477676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.478291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.481255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:40.481879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:40.490168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.490168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.491578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.494919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.495768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.496503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.664598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:40.698180 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dce6cfab-571f-4205-9844-68329c650de9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1307 microversion: 2.1 time: 0.221960 Oct 17 15:28:40.703869 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 967/1819] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:40 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1307 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:40.862210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:40.877925 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20eb85db-af3a-4175-bb39-09ecf23a5c9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1521 microversion: 2.1 time: 0.416079 Oct 17 15:28:40.896344 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 853/1820] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:40 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:40.902341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:40.903527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:40.916803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.917296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.917721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.918424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.918893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.919306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.945303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:40.945926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:40.958036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.958575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.959002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.959715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:40.960164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:40.960581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:40.976133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:41.119010 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86d16879-f030-46bd-9d61-dbfba87de3e6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 204 len: 0 microversion: 2.1 time: 0.218236 Oct 17 15:28:41.121130 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 968/1821] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:40 2022] DELETE /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:41.130831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:41.131571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:41.138820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.139376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.139926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.140643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.141072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.141490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.167884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:41.354749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:41.367816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6be3baf8-1f95-40c5-aba2-82b9e839dbbb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1527 microversion: 2.1 time: 0.240766 Oct 17 15:28:41.371028 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 969/1822] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:41 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1527 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:41.382809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:41.383592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:41.396108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.397009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.397666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.399038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.399930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.400580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.478317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:41.489267 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-30a6d814-c1fb-4bdb-a173-cddf153f7222 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1534 microversion: 2.1 time: 0.547824 Oct 17 15:28:41.492899 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 854/1823] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:40 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1534 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:41.510724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:41.511834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:41.524507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.525977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.528437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.532059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.539669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.540980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.576083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:41.588900 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b59e1947-8761-49c7-b8a7-d73eaef613dd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.216641 Oct 17 15:28:41.590942 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 970/1824] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:41 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:41.597130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6d8abfba-a5f0-4d4a-af28-fb9fecf39533 req-a9c27097-17ac-4f5c-9f80-8849e9977955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21af96d-b24a-454b-bc29-715bd73d273b", "name": "network-vif-deleted", "tag": "3a8d5665-e578-4098-aee4-cfbc0995db0c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:41.608993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d8abfba-a5f0-4d4a-af28-fb9fecf39533 req-a9c27097-17ac-4f5c-9f80-8849e9977955 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.609928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d8abfba-a5f0-4d4a-af28-fb9fecf39533 req-a9c27097-17ac-4f5c-9f80-8849e9977955 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.610698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d8abfba-a5f0-4d4a-af28-fb9fecf39533 req-a9c27097-17ac-4f5c-9f80-8849e9977955 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.625284 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6d8abfba-a5f0-4d4a-af28-fb9fecf39533 req-a9c27097-17ac-4f5c-9f80-8849e9977955 service nova] Creating event network-vif-deleted:3a8d5665-e578-4098-aee4-cfbc0995db0c for instance e21af96d-b24a-454b-bc29-715bd73d273b on n-h1-854441-12 Oct 17 15:28:41.631797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.633498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.634136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.634794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lazy-loading 'fault' on Instance uuid e21af96d-b24a-454b-bc29-715bd73d273b {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:41.641817 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6d8abfba-a5f0-4d4a-af28-fb9fecf39533 req-a9c27097-17ac-4f5c-9f80-8849e9977955 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048991 Oct 17 15:28:41.644852 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 971/1825] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:41.654971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:41.655984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:41.665741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.666322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.667287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.668132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.668706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.669239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.810278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13409eb044988911b34d37730b714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5aac724de34054a6a6b0a8ab32a0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:41.830332 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99ce4ba2-8d81-4aac-ae6a-7858aa9f4c45 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 200 len: 1307 microversion: 2.1 time: 0.336065 Oct 17 15:28:41.835209 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 855/1826] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:41 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:41.848187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:41.848802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:41.861974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.862337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.863051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.863962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:41.864712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:41.865017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:41.921469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:41.930469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:41.931996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:41.933178 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09551e4e-b108-487b-947b-b9eab2c49b27 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.286910 Oct 17 15:28:41.934061 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 972/1827] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:41 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:42.167356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:42.183405 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c25aff8e-c2fd-4eb1-9dd1-f688a7446e3e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1488 microversion: 2.1 time: 0.347065 Oct 17 15:28:42.184044 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 856/1828] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:41 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1488 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:42.211547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:42.213669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:42.231288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:42.233591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:42.234277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:42.236032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:42.239944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:42.240611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:42.294194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lazy-loading 'flavor' on Instance uuid ed0a13ab-993e-497e-8565-47790e0d5721 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:42.397771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:42.398401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:42.408750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:42.418684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:42.419281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:42.420570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:42.421541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:42.422065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:42.459144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3869d4d3-3692-49ee-adf8-71d581232f7a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721/action" status: 202 len: 0 microversion: 2.1 time: 0.254790 Oct 17 15:28:42.477384 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 973/1829] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:28:42 2022] POST /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:42.488925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-257e0f7e-e339-4885-967d-d8accc07bfcb req-2c1620fa-b188-47fa-9cf4-ffaf4d866db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21af96d-b24a-454b-bc29-715bd73d273b", "name": "network-vif-unplugged", "status": "completed", "tag": "3a8d5665-e578-4098-aee4-cfbc0995db0c"}, {"server_uuid": "d070bb7e-ed9f-40f4-826a-896eaaca1310", "name": "network-vif-plugged", "status": "completed", "tag": "511df248-5a16-482a-a7e7-9687df270ebf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:42.503216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-257e0f7e-e339-4885-967d-d8accc07bfcb req-2c1620fa-b188-47fa-9cf4-ffaf4d866db3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:42.503872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-257e0f7e-e339-4885-967d-d8accc07bfcb req-2c1620fa-b188-47fa-9cf4-ffaf4d866db3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:42.504327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-257e0f7e-e339-4885-967d-d8accc07bfcb req-2c1620fa-b188-47fa-9cf4-ffaf4d866db3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:42.524504 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-257e0f7e-e339-4885-967d-d8accc07bfcb req-2c1620fa-b188-47fa-9cf4-ffaf4d866db3 service nova] Creating event network-vif-unplugged:3a8d5665-e578-4098-aee4-cfbc0995db0c for instance e21af96d-b24a-454b-bc29-715bd73d273b on n-h1-854441-12 Oct 17 15:28:42.525236 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-257e0f7e-e339-4885-967d-d8accc07bfcb req-2c1620fa-b188-47fa-9cf4-ffaf4d866db3 service nova] Creating event network-vif-plugged:511df248-5a16-482a-a7e7-9687df270ebf for instance d070bb7e-ed9f-40f4-826a-896eaaca1310 on n-h2-854441-12 Oct 17 15:28:42.543072 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-257e0f7e-e339-4885-967d-d8accc07bfcb req-2c1620fa-b188-47fa-9cf4-ffaf4d866db3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.064040 Oct 17 15:28:42.544059 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 974/1830] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:42.550325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:42.551067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:42.562459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:42.563735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:42.564610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:42.565793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:42.566420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:42.567039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:42.689074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:42.699670 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef02643c-ca96-412f-bbfb-092087654a01 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1527 microversion: 2.1 time: 0.306841 Oct 17 15:28:42.719517 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 857/1831] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:42 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1527 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:42.726924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:42.727849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:42.736995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:42.737927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:42.738584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:42.739487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:42.740159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:42.740685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:42.958295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:42.967269 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-39f11158-858d-46be-a9b1-46ef7b2aa123 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1534 microversion: 2.1 time: 0.245517 Oct 17 15:28:42.989393 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 858/1832] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:42 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1534 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:42.996931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:42.998446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:43.006333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:43.007082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:43.007755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:43.008669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:43.009470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:43.010084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:43.055743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:43.066429 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94e89a82-e633-4d1b-86f6-9409fa4a3ed1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1496 microversion: 2.1 time: 0.521084 Oct 17 15:28:43.067373 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 975/1833] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:42 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1496 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:43.082985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:43.083638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] [instance: e21af96d-b24a-454b-bc29-715bd73d273b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:43.093370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:43.094301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:43.095016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:43.096019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:43.096704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:43.097345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:43.113643 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] HTTP exception thrown: Instance e21af96d-b24a-454b-bc29-715bd73d273b could not be found. Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Request method failure captured: Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b HTTP/1.1 Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOy4YIV9dGGOlYBRZ0F7igKcjNUQVY_QXu68sdCLtbczdytvezShVmrOiCrYJEIri6bWQZI5Dpv2ZOIKcHeQs-ZZch_pDZ5k4z2CobwVLs0ewF3OswO2gQru1sxNV7EGlzjGqf2fpmTnp4xGD9HMcB_jiM4d1ZfSoRXL_CCR4shTY4 Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:43.116280 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fc5aac724de34054a6a6b0a8ab32a0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fc5aac724de34054a6a6b0a8ab32a0ac Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-818812972 Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a6d13409eb044988911b34d37730b714 Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersOnMultiNodesTest-818812972-project Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e21af96d-b24a-454b-bc29-715bd73d273b could not be found. Oct 17 15:28:43.117943 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e21af96d-b24a-454b-bc29-715bd73d273b'} Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21af96d-b24a-454b-bc29-715bd73d273b could not be found. Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:43.118862 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21af96d-b24a-454b-bc29-715bd73d273b could not be found. Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21af96d-b24a-454b-bc29-715bd73d273b could not be found. Oct 17 15:28:43.121320 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:43.124341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] Returning 404 to user: Instance e21af96d-b24a-454b-bc29-715bd73d273b could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:43.125740 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b31154ea-750d-41ad-b737-4ce55db3df10 tempest-ServersOnMultiNodesTest-818812972 tempest-ServersOnMultiNodesTest-818812972-project] 10.222.0.87 "GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b" status: 404 len: 111 microversion: 2.1 time: 0.057106 Oct 17 15:28:43.126841 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 976/1834] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:43 2022] GET /compute/v2.1/servers/e21af96d-b24a-454b-bc29-715bd73d273b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:43.132506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:43.133127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:43.140315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:43.151535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:43.152092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:43.152854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:43.153472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:43.153966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:43.255417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:43.267791 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cff69a2f-2627-4f84-bff1-b2cfaa3141d7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.274522 Oct 17 15:28:43.285382 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 859/1835] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:42 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:43.427932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:43.437936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:43.444778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:43.446403 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c57665e-0908-44be-b4cb-071bef01f30e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.318345 Oct 17 15:28:43.447531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 977/1836] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:43 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:43.729243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:43.731034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:43.742856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:43.744266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:43.744720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:43.745460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:43.745925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:43.746351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:43.974907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:43.985125 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61c88669-be67-476b-98ba-fa0697087653 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1527 microversion: 2.1 time: 0.261884 Oct 17 15:28:43.987057 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 860/1837] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:43 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1527 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:43.995954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:43.997313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:44.011594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.015079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.015754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:44.016832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.018372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.021268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:44.095968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:44.096787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:44.111441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.113507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.114123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:44.124082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.124566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.125001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:44.130826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:44.513737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:44.531072 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ec2eb01d-75c1-494d-84b8-a9338f1849b2 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 200 len: 1479 microversion: 2.1 time: 0.437487 Oct 17 15:28:44.533021 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 861/1838] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:44 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 1479 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:44.544013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:44.544709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:44.562582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.567874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.568726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:44.569754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.571055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.575346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:44.836444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:44.846779 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f850899b-bb45-4b50-9f2f-dad6a9971936 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.310831 Oct 17 15:28:44.853740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:44.860674 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 862/1839] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:44 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:44.861977 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77665218-935f-4465-91c0-f20fc4d089d5 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1534 microversion: 2.1 time: 0.870805 Oct 17 15:28:44.863606 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 978/1840] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:43 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1534 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:44.870591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-950ddd0e-f69c-483a-be74-8cdf1dbf31d4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-195773154"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:44.873308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-950ddd0e-f69c-483a-be74-8cdf1dbf31d4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:44.885528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:44.887397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:44.891279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-950ddd0e-f69c-483a-be74-8cdf1dbf31d4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.893038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-950ddd0e-f69c-483a-be74-8cdf1dbf31d4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.893812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-950ddd0e-f69c-483a-be74-8cdf1dbf31d4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:44.894630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-950ddd0e-f69c-483a-be74-8cdf1dbf31d4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.896337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-950ddd0e-f69c-483a-be74-8cdf1dbf31d4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.896945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-950ddd0e-f69c-483a-be74-8cdf1dbf31d4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:44.912278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.914001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.914474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:44.917757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:44.918244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:44.918706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:45.239412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:45.258522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:45.260104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:45.263185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c83a9ff-8f8c-456d-ac97-b46c7dd17d38 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.401050 Oct 17 15:28:45.264990 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 863/1841] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:44 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:45.273151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1b943bdc-0d79-45fb-bf2e-29076b1740f2 req-ed11b4f2-783d-469a-8593-f4944bc99d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d070bb7e-ed9f-40f4-826a-896eaaca1310", "name": "network-vif-unplugged", "status": "completed", "tag": "511df248-5a16-482a-a7e7-9687df270ebf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:45.286975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1b943bdc-0d79-45fb-bf2e-29076b1740f2 req-ed11b4f2-783d-469a-8593-f4944bc99d3b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:45.295292 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-950ddd0e-f69c-483a-be74-8cdf1dbf31d4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721/action" status: 202 len: 0 microversion: 2.1 time: 0.429527 Oct 17 15:28:45.303509 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 979/1842] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:28:44 2022] POST /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:28:45.311254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1b943bdc-0d79-45fb-bf2e-29076b1740f2 req-ed11b4f2-783d-469a-8593-f4944bc99d3b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:45.313081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1b943bdc-0d79-45fb-bf2e-29076b1740f2 req-ed11b4f2-783d-469a-8593-f4944bc99d3b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:45.314279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:45.315653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:45.352276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:45.355914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1b943bdc-0d79-45fb-bf2e-29076b1740f2 req-ed11b4f2-783d-469a-8593-f4944bc99d3b service nova] Creating event network-vif-unplugged:511df248-5a16-482a-a7e7-9687df270ebf for instance d070bb7e-ed9f-40f4-826a-896eaaca1310 on n-h2-854441-12 Oct 17 15:28:45.356136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:45.356888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:45.359244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:45.359723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:45.364937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:45.369381 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1b943bdc-0d79-45fb-bf2e-29076b1740f2 req-ed11b4f2-783d-469a-8593-f4944bc99d3b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102279 Oct 17 15:28:45.375107 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 864/1843] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:45.382083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a1413f47-27bb-4b43-9428-ca5b47e4b2b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f7b040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:45.463045 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a1413f47-27bb-4b43-9428-ca5b47e4b2b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.083566 Oct 17 15:28:45.463736 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 865/1844] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:45 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:45.696965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:45.705827 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d415440f-5a39-4940-a2e9-78178537bf0a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1527 microversion: 2.1 time: 0.400951 Oct 17 15:28:45.706419 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 980/1845] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:45 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1527 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:45.873756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:45.875918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:45.888755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:45.891353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:45.902233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:45.902764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:45.903204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:45.903972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:45.904429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:45.904858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:45.909874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:45.914570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:45.915113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:45.916023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:45.916512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:45.916943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:46.370457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:46.379668 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7d1d265-88d5-4a47-ab19-7fd8c3a5fe51 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1534 microversion: 2.1 time: 0.494736 Oct 17 15:28:46.380582 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 981/1846] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:45 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1534 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:46.385796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:46.386737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:46.393316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:46.394084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:46.394728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:46.395769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:46.396441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:46.397036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:46.766963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:46.776991 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a4782fc-14d0-4a30-a737-5b6e7a89e198 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1513 microversion: 2.1 time: 0.907513 Oct 17 15:28:46.777939 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 866/1847] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:45 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1513 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:46.783363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ae034f7-b319-4259-a864-a9235cbfefba tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f654c0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:46.838179 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1ae034f7-b319-4259-a864-a9235cbfefba tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.058510 Oct 17 15:28:46.839706 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 867/1848] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:46 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:47.016550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:47.027398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:47.033627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:47.038461 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80ece060-3d8e-4b43-9065-0000ccb67fcb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.656608 Oct 17 15:28:47.051532 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 982/1849] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:46 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:47.063450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:47.064382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:47.072991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:47.074024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:47.074686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:47.075515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:47.076351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:47.076601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:47.119530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c9c4c29b-21b1-4223-9d9e-6ee1d7063555 tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Calling method '.version_select at 0x7f28c2f7b040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:47.150913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9c4c29b-21b1-4223-9d9e-6ee1d7063555 tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:47.151410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9c4c29b-21b1-4223-9d9e-6ee1d7063555 tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:47.152116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9c4c29b-21b1-4223-9d9e-6ee1d7063555 tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:47.152875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9c4c29b-21b1-4223-9d9e-6ee1d7063555 tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:47.153409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9c4c29b-21b1-4223-9d9e-6ee1d7063555 tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:47.153968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9c4c29b-21b1-4223-9d9e-6ee1d7063555 tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:47.188449 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c9c4c29b-21b1-4223-9d9e-6ee1d7063555 tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] 10.222.0.87 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.347426 Oct 17 15:28:47.189735 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 868/1850] 10.222.0.87 () {58 vars in 1122 bytes} [Mon Oct 17 15:28:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:47.389904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-84d45edd-f430-4b82-87a5-518ececc8638 req-f2661987-a0ec-49a3-9093-ce4141e5a89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f2d90a-2839-4199-87db-d5739abf33a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f4f8835c-e978-4278-9cc8-bcb8389538d7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:47.408041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-84d45edd-f430-4b82-87a5-518ececc8638 req-f2661987-a0ec-49a3-9093-ce4141e5a89c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:47.409416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-84d45edd-f430-4b82-87a5-518ececc8638 req-f2661987-a0ec-49a3-9093-ce4141e5a89c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:47.410944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-84d45edd-f430-4b82-87a5-518ececc8638 req-f2661987-a0ec-49a3-9093-ce4141e5a89c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:47.439094 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-84d45edd-f430-4b82-87a5-518ececc8638 req-f2661987-a0ec-49a3-9093-ce4141e5a89c service nova] Creating event network-vif-unplugged:f4f8835c-e978-4278-9cc8-bcb8389538d7 for instance b4f2d90a-2839-4199-87db-d5739abf33a8 on n-h2-854441-12 Oct 17 15:28:47.457559 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-84d45edd-f430-4b82-87a5-518ececc8638 req-f2661987-a0ec-49a3-9093-ce4141e5a89c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071661 Oct 17 15:28:47.458650 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 869/1851] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:28:47.465397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:47.466323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:47.490033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:47.491192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:47.491951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:47.492889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:47.493559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:47.494222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:47.682971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:47.695363 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe8ef9a2-95c1-4a52-8911-863c3801b20d tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1492 microversion: 2.1 time: 0.235194 Oct 17 15:28:47.695975 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 870/1852] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:47 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1492 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:47.703116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6bbe629-e132-479d-8b74-dcb3be1d9ecc tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1125748857", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:47.734150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:47.755573 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96203038-77b4-449e-a7ea-76e796003d74 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1527 microversion: 2.1 time: 0.698127 Oct 17 15:28:47.756210 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 983/1853] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:47 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1527 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:47.800848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:47.801809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:47.826411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:47.832071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:47.833023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:47.835374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:47.837880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:47.847425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-c6bbe629-e132-479d-8b74-dcb3be1d9ecc tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:28:47.852063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:48.448414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:48.488131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:48.502088 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ad44460-2edc-44f0-b449-281f7361828f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1519 microversion: 2.1 time: 0.694387 Oct 17 15:28:48.524644 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 984/1854] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:47 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1519 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:48.536803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72da737a-4ad7-4389-93b6-556e135d3fba tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be9cf310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:48.656320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c6bbe629-e132-479d-8b74-dcb3be1d9ecc tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Getting quotas for project aafb20a21cf64a3db5e0d044129d5346. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:48.664930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c6bbe629-e132-479d-8b74-dcb3be1d9ecc tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Getting quotas for user 6dad866fd8d8440186a1b55f9abfeaa3 and project aafb20a21cf64a3db5e0d044129d5346. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:48.680168 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-c6bbe629-e132-479d-8b74-dcb3be1d9ecc tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6bbe629-e132-479d-8b74-dcb3be1d9ecc tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Request method failure captured: Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 1752 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXSuQc2jlsnK1bn-rm6xN6I31wwoJ5g3L7h9U0WUVDrZCYGVu4zExYbNKrGWKS8lqcQ1cY1SSH5PYC_gt85KuH-Y748gHmfz5wS-VcmZugDioL38dngp2JynOgjKHoALz4-w8fe8Dw_fvaf7E0sdxilsbnJmUIoBr_Y2V3qt7_lh74U Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: aafb20a21cf64a3db5e0d044129d5346 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1873027704 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/aafb20a21cf64a3db5e0d044129d5346"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/aafb20a21cf64a3db5e0d044129d5346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_aafb20a21cf64a3db5e0d044129d5346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/aafb20a21cf64a3db5e0d044129d5346"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1873027704 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: aafb20a21cf64a3db5e0d044129d5346 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1873027704 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6dad866fd8d8440186a1b55f9abfeaa3 Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1125748857", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:28:48.682444 n-d-854441-12 devstack@n-api.service[120407]: exception: Maximum number of metadata items exceeds 128 Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1125748857', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:28:48.685459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 17 15:28:48.689069 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:48.691411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6bbe629-e132-479d-8b74-dcb3be1d9ecc tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:48.693046 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c6bbe629-e132-479d-8b74-dcb3be1d9ecc tempest-AbsoluteLimitsNegativeTestJSON-1873027704 tempest-AbsoluteLimitsNegativeTestJSON-1873027704-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.995292 Oct 17 15:28:48.710393 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 871/1855] 10.222.0.87 () {60 vars in 1148 bytes} [Mon Oct 17 15:28:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 1013 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:28:48.732798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-82b0d9f9-029d-4604-947c-38d974f9b81a req-472a2f6a-0119-407b-b0f9-c048de69a619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f2d90a-2839-4199-87db-d5739abf33a8", "name": "network-vif-deleted", "tag": "f4f8835c-e978-4278-9cc8-bcb8389538d7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:48.757269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82b0d9f9-029d-4604-947c-38d974f9b81a req-472a2f6a-0119-407b-b0f9-c048de69a619 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:48.758452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82b0d9f9-029d-4604-947c-38d974f9b81a req-472a2f6a-0119-407b-b0f9-c048de69a619 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:48.759092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82b0d9f9-029d-4604-947c-38d974f9b81a req-472a2f6a-0119-407b-b0f9-c048de69a619 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:48.775445 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-82b0d9f9-029d-4604-947c-38d974f9b81a req-472a2f6a-0119-407b-b0f9-c048de69a619 service nova] Creating event network-vif-deleted:f4f8835c-e978-4278-9cc8-bcb8389538d7 for instance b4f2d90a-2839-4199-87db-d5739abf33a8 on n-h2-854441-12 Oct 17 15:28:48.780709 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-82b0d9f9-029d-4604-947c-38d974f9b81a req-472a2f6a-0119-407b-b0f9-c048de69a619 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058756 Oct 17 15:28:48.786758 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 872/1856] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:48.795126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:48.796710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:48.804125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:48.805739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:48.806371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:48.807330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:48.808116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:48.808735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:48.920030 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72da737a-4ad7-4389-93b6-556e135d3fba tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.394014 Oct 17 15:28:48.921844 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 985/1857] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:48 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:48.936777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:48.940584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:48.957824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:48.957824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:48.957824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:48.957824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:48.958169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:48.958493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:49.006677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:49.007462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:49.008065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:49.008726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lazy-loading 'fault' on Instance uuid b4f2d90a-2839-4199-87db-d5739abf33a8 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:49.059137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:49.069312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a095c73-ae64-4755-a9a0-ccfd9a6e9ee3 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 200 len: 1369 microversion: 2.1 time: 0.137229 Oct 17 15:28:49.070945 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 986/1858] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:48 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:49.077984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:49.079229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:49.087807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:49.088511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:49.089102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:49.090010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:49.090689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:49.091391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:49.191643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:49.203177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:49.204408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:49.204833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:49.205503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:49.207541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lazy-loading 'fault' on Instance uuid d070bb7e-ed9f-40f4-826a-896eaaca1310 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:49.209279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:49.211915 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-08963037-2a9e-465c-8dd1-facd983fb717 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1567 microversion: 2.25 time: 0.422456 Oct 17 15:28:49.214869 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 873/1859] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:48 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1567 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:49.357028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:49.380375 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-672668d1-d835-4527-851f-77cb20d153b5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1314 microversion: 2.1 time: 0.307125 Oct 17 15:28:49.380559 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 987/1860] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:49 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:49.527612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:49.528221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:49.549616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:49.550214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:49.550858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:49.551840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:49.552451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:49.553079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:49.938168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d4cfd84-bb9e-47ea-b20c-5b86b8dfbde5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c30439d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:50.084548 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d4cfd84-bb9e-47ea-b20c-5b86b8dfbde5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.151000 Oct 17 15:28:50.085446 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 988/1861] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:49 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:50.097949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:50.109678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b4f2d90a-2839-4199-87db-d5739abf33a8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:50.127947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:50.132319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:50.134050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:50.139522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:50.140351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:50.143131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:50.197382 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] HTTP exception thrown: Instance b4f2d90a-2839-4199-87db-d5739abf33a8 could not be found. Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Request method failure captured: Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 HTTP/1.1 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMYvpnQDsGGIQ_IabX6Ce5ZCjLhxqJFt2NG7mPJmeSL-8aEn5h-8TVGHoj7doKSnVbAq9mq1oEhx29vwwZXhzMTd6tEAxQwOTsq8ndMnDXkZ9m9E1kgZkuKvaBU52QJg6hwCr9ofOF3rBqOjmnHHarc7t05onsH9k0yx5KccFuC6Y4 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 72c637634ac84f7299ee3ac1a67f2750 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-MigrationsAdminTest-103296004 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-MigrationsAdminTest-103296004 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 72c637634ac84f7299ee3ac1a67f2750 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MigrationsAdminTest-103296004 Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-MigrationsAdminTest-103296004-project Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 5ec3b5fbeafd47558718a7a9638d0c9e Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-MigrationsAdminTest-103296004-project Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance b4f2d90a-2839-4199-87db-d5739abf33a8 could not be found. Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'b4f2d90a-2839-4199-87db-d5739abf33a8'} Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f2d90a-2839-4199-87db-d5739abf33a8 could not be found. Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f2d90a-2839-4199-87db-d5739abf33a8 could not be found. Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:50.207769 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:50.220117 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:50.220117 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:50.220117 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:50.220117 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:50.220117 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:50.220117 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f2d90a-2839-4199-87db-d5739abf33a8 could not be found. Oct 17 15:28:50.220117 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:28:50.220117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Returning 404 to user: Instance b4f2d90a-2839-4199-87db-d5739abf33a8 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:50.220117 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96798014-5b1a-4577-9a98-c902bc1d84de tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8" status: 404 len: 111 microversion: 2.1 time: 0.121213 Oct 17 15:28:50.227510 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 989/1862] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:50 2022] GET /compute/v2.1/servers/b4f2d90a-2839-4199-87db-d5739abf33a8 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:28:50.247329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65dd4810-2b04-49c6-9109-d58e23681a88 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '.version_select at 0x7f28be9cfaf0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:50.336434 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65dd4810-2b04-49c6-9109-d58e23681a88 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523355754" status: 202 len: 0 microversion: 2.1 time: 0.103254 Oct 17 15:28:50.337031 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 990/1863] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:28:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523355754 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:28:50.360871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:50.368746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:50.384942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:50.385883 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c46a3a01-c071-4483-b524-10f57a975cf6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1519 microversion: 2.1 time: 0.863362 Oct 17 15:28:50.394622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 874/1864] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:49 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1519 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:50.405124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:50.416553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:50.418209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:50.424389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:50.427074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:50.428255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:50.431992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:50.439258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:50.450043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:50.451227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:50.458195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:50.459109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:50.461308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:50.462413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:50.575112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:50.575964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:50.576667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:50.577346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lazy-loading 'fault' on Instance uuid d070bb7e-ed9f-40f4-826a-896eaaca1310 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:50.786956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:50.800904 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc5a9bdf-b874-489a-8982-ccc0b21242d0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 200 len: 1314 microversion: 2.1 time: 0.398133 Oct 17 15:28:50.802580 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 875/1865] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:50 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:50.815734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-90cfcb35-00b9-4a50-9c27-cd3bb7ec5d2d req-02220c86-0d16-42fc-aef0-934fa47ec6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0a13ab-993e-497e-8565-47790e0d5721", "name": "network-vif-plugged", "status": "completed", "tag": "7208a5cc-9906-471a-9f0a-9f7b31850c26"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:50.856723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-90cfcb35-00b9-4a50-9c27-cd3bb7ec5d2d req-02220c86-0d16-42fc-aef0-934fa47ec6a5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:50.857494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-90cfcb35-00b9-4a50-9c27-cd3bb7ec5d2d req-02220c86-0d16-42fc-aef0-934fa47ec6a5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:50.858030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-90cfcb35-00b9-4a50-9c27-cd3bb7ec5d2d req-02220c86-0d16-42fc-aef0-934fa47ec6a5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:50.899925 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-90cfcb35-00b9-4a50-9c27-cd3bb7ec5d2d req-02220c86-0d16-42fc-aef0-934fa47ec6a5 service nova] Creating event network-vif-plugged:7208a5cc-9906-471a-9f0a-9f7b31850c26 for instance ed0a13ab-993e-497e-8565-47790e0d5721 on n-h1-854441-12 Oct 17 15:28:50.922037 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-90cfcb35-00b9-4a50-9c27-cd3bb7ec5d2d req-02220c86-0d16-42fc-aef0-934fa47ec6a5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114594 Oct 17 15:28:50.925601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:50.928155 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 876/1866] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:50.946540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d040b59a-e19f-4b93-b6a2-c5bfb55b21fa req-f9f1772c-45f5-4e9a-89c8-7d4d37d9b9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d070bb7e-ed9f-40f4-826a-896eaaca1310", "name": "network-vif-deleted", "tag": "511df248-5a16-482a-a7e7-9687df270ebf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:50.974685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:50.983285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:50.990034 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd8ce7e1-5268-4c33-aa8b-a07aa0385e00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1557 microversion: 2.25 time: 0.647199 Oct 17 15:28:50.993621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d040b59a-e19f-4b93-b6a2-c5bfb55b21fa req-f9f1772c-45f5-4e9a-89c8-7d4d37d9b9df service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:50.994107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d040b59a-e19f-4b93-b6a2-c5bfb55b21fa req-f9f1772c-45f5-4e9a-89c8-7d4d37d9b9df service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:50.994566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d040b59a-e19f-4b93-b6a2-c5bfb55b21fa req-f9f1772c-45f5-4e9a-89c8-7d4d37d9b9df service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:50.997283 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 991/1867] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:50 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1557 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:51.018293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b00b4361-4e23-4ad6-8507-3e1d7159042d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '.version_select at 0x7f28bf287310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:51.029161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b00b4361-4e23-4ad6-8507-3e1d7159042d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:51.032745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b00b4361-4e23-4ad6-8507-3e1d7159042d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:51.033275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b00b4361-4e23-4ad6-8507-3e1d7159042d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:51.041701 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d040b59a-e19f-4b93-b6a2-c5bfb55b21fa req-f9f1772c-45f5-4e9a-89c8-7d4d37d9b9df service nova] Creating event network-vif-deleted:511df248-5a16-482a-a7e7-9687df270ebf for instance d070bb7e-ed9f-40f4-826a-896eaaca1310 on n-h2-854441-12 Oct 17 15:28:51.057309 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d040b59a-e19f-4b93-b6a2-c5bfb55b21fa req-f9f1772c-45f5-4e9a-89c8-7d4d37d9b9df service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127322 Oct 17 15:28:51.057928 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 877/1868] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:51.069428 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b00b4361-4e23-4ad6-8507-3e1d7159042d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 2809 microversion: 2.25 time: 0.054875 Oct 17 15:28:51.080410 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 992/1869] 10.222.0.87 () {60 vars in 1184 bytes} [Mon Oct 17 15:28:51 2022] GET /compute/v2.1/os-migrations => generated 2809 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:51.087409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:51.088153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:51.100583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:51.101087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:51.102175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:51.102963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:51.103426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:51.103857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:51.111359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c15c6d2-f91e-4900-950d-ec763ed41284 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28beedddc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:51.188954 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c15c6d2-f91e-4900-950d-ec763ed41284 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.081623 Oct 17 15:28:51.190237 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 993/1870] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:51 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:51.426985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:51.427902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:51.446128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:51.447268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:51.447967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:51.449685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:51.450402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:51.451061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:51.728942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:28:51.755896 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dd9ff5b7-2cd2-45c9-89b4-b9d4a24645b4 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 2052 microversion: 2.25 time: 0.672770 Oct 17 15:28:51.765030 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 878/1871] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:51 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 2052 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:51.825646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:51.826876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:51.842318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:51.845887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:51.847047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:51.850384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:51.851643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:51.854620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:51.904724 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 HTTP/1.1 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd070bb7e-ed9f-40f4-826a-896eaaca1310'} Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:51.909941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:28:51.914327 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:51.914327 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:28:51.914327 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:28:51.914327 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:28:51.914327 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:28:51.914327 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:28:51.914327 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:28:51.914327 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:28:51.919896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:28:51.926092 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3bb6409b-3d95-4497-94e5-e1272cddf1b0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 404 len: 111 microversion: 2.1 time: 0.104324 Oct 17 15:28:51.928665 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 879/1872] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:51 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:28:51.942947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d3c7cd86-98c9-4d95-8cb6-c6906a678b64 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'create', calling method: .version_select at 0x7f28c2f7b3a0>, body: {"keypair": {"name": "tempest-keypair-1686735731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtNXrXgmye7soybj2E1Fw8MhfYD23otMpCt4Ehh/qTnIz3OUN8XipwAc+TK3ZEwXFHm1ZV8llTXSAMc83KW2544aU81W3tyD/sHC7JsQoDvmO6o1i5PExhQvNEaMNZovQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:52.026541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d3c7cd86-98c9-4d95-8cb6-c6906a678b64 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Getting quotas for project 4e0a35484bd44be0938aaabdee3cf4c2. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:52.040540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d3c7cd86-98c9-4d95-8cb6-c6906a678b64 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Getting quotas for user e5d69af6a3c14dbab949c56fde26ff95 and project 4e0a35484bd44be0938aaabdee3cf4c2. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:52.123677 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d3c7cd86-98c9-4d95-8cb6-c6906a678b64 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185059 Oct 17 15:28:52.127799 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 880/1873] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:28:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:28:52.135826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-535771522", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "367a2d39-b572-49e0-b719-9b2cdd9cfe38"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:52.279817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] validate_networks() for [('367a2d39-b572-49e0-b719-9b2cdd9cfe38', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:28:52.721923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:52.739113 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bdf9947c-4463-47af-b3cc-f50674d1de3c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1519 microversion: 2.1 time: 1.316556 Oct 17 15:28:52.741400 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 994/1874] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:51 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1519 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:52.764555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bc67ca4-cd7b-47a0-8691-ffc68ae849b9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c3043280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:52.843286 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bc67ca4-cd7b-47a0-8691-ffc68ae849b9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.100474 Oct 17 15:28:52.844455 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 995/1875] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:52 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:52.912914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:52.914119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:52.923096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:52.927247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:52.927979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:52.928652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:52.931982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:52.932833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:52.934751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:53.010250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:28:53.232431 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16318bce-5ad4-4c93-846e-15b350b8da87 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 204 len: 0 microversion: 2.1 time: 0.323860 Oct 17 15:28:53.236945 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 996/1876] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:28:52 2022] DELETE /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:28:53.243570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-75b1d96f-19de-4c40-985f-223f10b3dfd7 req-aa8db5c2-2fa4-4fb5-b152-ae55fb0c0ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a6c5fc-30ba-49b2-ab11-747aae6d7f21", "name": "network-vif-unplugged", "status": "completed", "tag": "1d89e5eb-f096-4fd6-ad9f-76b4586513f1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:53.271788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-75b1d96f-19de-4c40-985f-223f10b3dfd7 req-aa8db5c2-2fa4-4fb5-b152-ae55fb0c0ef0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:53.272615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-75b1d96f-19de-4c40-985f-223f10b3dfd7 req-aa8db5c2-2fa4-4fb5-b152-ae55fb0c0ef0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:53.273211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-75b1d96f-19de-4c40-985f-223f10b3dfd7 req-aa8db5c2-2fa4-4fb5-b152-ae55fb0c0ef0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:53.296247 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-75b1d96f-19de-4c40-985f-223f10b3dfd7 req-aa8db5c2-2fa4-4fb5-b152-ae55fb0c0ef0 service nova] Creating event network-vif-unplugged:1d89e5eb-f096-4fd6-ad9f-76b4586513f1 for instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 on n-h2-854441-12 Oct 17 15:28:53.309958 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-75b1d96f-19de-4c40-985f-223f10b3dfd7 req-aa8db5c2-2fa4-4fb5-b152-ae55fb0c0ef0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069451 Oct 17 15:28:53.312909 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 997/1877] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:53.327105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:53.330007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:53.346546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:53.348427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:53.349125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:53.352844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:53.353535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:53.354193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:54.107449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:54.121785 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99cd8992-2ea9-492f-8e4a-6a78f4881db9 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1466 microversion: 2.1 time: 0.806118 Oct 17 15:28:54.122471 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 998/1878] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:53 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1466 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:54.147677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:54.148336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:54.162730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:54.163246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:54.165941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:54.166727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:54.167199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:54.169811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:54.525063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:54.534479 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-822fe04c-1931-4378-8592-8607c7bbe6e6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1519 microversion: 2.1 time: 0.395443 Oct 17 15:28:54.541619 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 999/1879] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:54 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:54.556378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-958afe0e-79fd-4e74-aa96-80f7604ffd8d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bf2338b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:54.674691 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-958afe0e-79fd-4e74-aa96-80f7604ffd8d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.131742 Oct 17 15:28:54.675299 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1000/1880] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:54 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:55.147418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:55.148150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:55.162271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:55.162806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:55.163246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:55.163961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:55.164413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:55.164831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:55.828923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:28:55.830479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:28:55.831985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:28:55.832415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:28:55.832834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:28:55.852750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:55.863019 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc2f0c90-26b6-4e78-82a0-93d447fcdd09 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1466 microversion: 2.1 time: 0.721185 Oct 17 15:28:55.867474 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1001/1881] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:55 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1466 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:55.872129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:55.873878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:55.874821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:55.875093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:55.875567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:55.876381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:55.883815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:55.884330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:55.910912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:55.913137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:55.915787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:55.916625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:55.918359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:55.919060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:56.038283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:28:56.056565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for user 54134ad155cf45d19f6a551710c84a9e and project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:28:56.090536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:28:56.092680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:28:56.096598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:28:56.261702 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f0b22963-149c-4dce-a9f8-9398d486bfd0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.132203 Oct 17 15:28:56.263151 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 881/1882] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:28:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4134 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:28:56.281636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9ce05c05-18eb-4cf0-9dae-d68dc3c00b74 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bf0f0e50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:56.385044 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9ce05c05-18eb-4cf0-9dae-d68dc3c00b74 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.120371 Oct 17 15:28:56.385640 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 882/1883] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:56 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:56.400181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14e273ce-02a4-4a5f-8898-32a80c6239e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:56.400810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-14e273ce-02a4-4a5f-8898-32a80c6239e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:56.526963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:56.538457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e1170bb-3554-4838-83b9-0e3c0e06a47e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1519 microversion: 2.1 time: 0.669626 Oct 17 15:28:56.545280 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1002/1884] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:55 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1519 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:56.891714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:56.892350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:56.905054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:56.912853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:56.913610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:56.916801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:56.917449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:56.918364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:57.877869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:57.892666 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c8e83f5-e05d-4acd-9742-d79a60da0a16 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1466 microversion: 2.1 time: 1.005156 Oct 17 15:28:57.899740 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1003/1885] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:56 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1466 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:57.905098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33f662e6-1290-4a22-91aa-4c43caa501c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bf3a4430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:58.006676 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33f662e6-1290-4a22-91aa-4c43caa501c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.105520 Oct 17 15:28:58.007509 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1004/1886] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:57 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:58.027734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b45094b7-8e74-4787-bd6b-7e3ee522870b req-935732bc-e388-4412-b44b-fcc69e6326c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a6c5fc-30ba-49b2-ab11-747aae6d7f21", "name": "network-vif-plugged", "status": "completed", "tag": "1d89e5eb-f096-4fd6-ad9f-76b4586513f1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:58.078092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b45094b7-8e74-4787-bd6b-7e3ee522870b req-935732bc-e388-4412-b44b-fcc69e6326c4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:58.078786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b45094b7-8e74-4787-bd6b-7e3ee522870b req-935732bc-e388-4412-b44b-fcc69e6326c4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:58.083157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b45094b7-8e74-4787-bd6b-7e3ee522870b req-935732bc-e388-4412-b44b-fcc69e6326c4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:58.144447 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b45094b7-8e74-4787-bd6b-7e3ee522870b req-935732bc-e388-4412-b44b-fcc69e6326c4 service nova] Creating event network-vif-plugged:1d89e5eb-f096-4fd6-ad9f-76b4586513f1 for instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 on n-h2-854441-12 Oct 17 15:28:58.171898 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b45094b7-8e74-4787-bd6b-7e3ee522870b req-935732bc-e388-4412-b44b-fcc69e6326c4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162932 Oct 17 15:28:58.178605 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1005/1887] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:58.205496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:58.213440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:58.247343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:58.250634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:58.251100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:58.255374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:58.261396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:58.265222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:58.483797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-14e273ce-02a4-4a5f-8898-32a80c6239e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:58.499236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-14e273ce-02a4-4a5f-8898-32a80c6239e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:58.504593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-14e273ce-02a4-4a5f-8898-32a80c6239e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:58.510940 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-14e273ce-02a4-4a5f-8898-32a80c6239e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1261 microversion: 2.25 time: 2.119065 Oct 17 15:28:58.511972 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 883/1888] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:56 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1261 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:28:58.919541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:58.920160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:58.933597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:58.963279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:58.964403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:58.968350 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b639551-26db-4dca-9e1c-64cb7f4d52fc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1519 microversion: 2.1 time: 0.775600 Oct 17 15:28:58.969200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:58.970377 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1006/1889] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:58 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1519 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:28:58.975092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:58.981151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:58.988081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:59.024195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa86ac42-79a5-4f12-9680-b406fb520eb0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28beedd430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:59.144378 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa86ac42-79a5-4f12-9680-b406fb520eb0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.124568 Oct 17 15:28:59.144378 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1007/1890] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:28:59 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:59.545074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:59.549258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:28:59.579393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:59.587444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:59.593760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:59.609039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:59.611017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:59.612996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:59.825468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:59.840670 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f06b0ef1-00e6-4f4a-8e63-ab0e3205bad8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 200 len: 1424 microversion: 2.1 time: 0.928477 Oct 17 15:28:59.841606 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 884/1891] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:58 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 1424 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:28:59.897931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0dfe0b9c-e929-4a6c-a5b6-0332542a9424 req-7066396c-8197-4585-bdd8-609359258dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88c7d5d-8596-4064-b313-10976ecf63fa", "name": "network-vif-deleted", "tag": "d40489a8-5c88-4b32-a52a-751ce1cb2d44"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:28:59.934195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0dfe0b9c-e929-4a6c-a5b6-0332542a9424 req-7066396c-8197-4585-bdd8-609359258dcb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:28:59.939268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0dfe0b9c-e929-4a6c-a5b6-0332542a9424 req-7066396c-8197-4585-bdd8-609359258dcb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:28:59.941264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0dfe0b9c-e929-4a6c-a5b6-0332542a9424 req-7066396c-8197-4585-bdd8-609359258dcb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:28:59.978934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:28:59.986520 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0dfe0b9c-e929-4a6c-a5b6-0332542a9424 req-7066396c-8197-4585-bdd8-609359258dcb service nova] Creating event network-vif-deleted:d40489a8-5c88-4b32-a52a-751ce1cb2d44 for instance b88c7d5d-8596-4064-b313-10976ecf63fa on n-h1-854441-12 Oct 17 15:28:59.995312 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0dfe0b9c-e929-4a6c-a5b6-0332542a9424 req-7066396c-8197-4585-bdd8-609359258dcb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128538 Oct 17 15:28:59.995312 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 885/1892] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:28:59.999009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:28:59.999350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:00.046487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:00.047150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:00.047617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:00.048378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:00.048845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:00.049277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:00.057496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:00.059118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:00.060340 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe2ce1cd-683e-4bd3-8c65-0202e57ed65b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1319 microversion: 2.25 time: 0.519939 Oct 17 15:29:00.085586 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1008/1893] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:28:59 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:29:00.160644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5f9dd2f-23cf-40dd-8347-dc77200e94a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be9cf160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:00.287905 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5f9dd2f-23cf-40dd-8347-dc77200e94a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.131830 Oct 17 15:29:00.289006 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1009/1894] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:00 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:00.868015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:00.874572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: b88c7d5d-8596-4064-b313-10976ecf63fa] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:00.887470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:00.888335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:00.889050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:00.891499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:00.892233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:00.893735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:00.987006 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] HTTP exception thrown: Instance b88c7d5d-8596-4064-b313-10976ecf63fa could not be found. Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Request method failure captured: Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa HTTP/1.1 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMYvpnQDsGGIQ_IabX6Ce5ZCjLhxqJFt2NG7mPJmeSL-8aEn5h-8TVGHoj7doKSnVbAq9mq1oEhx29vwwZXhzMTd6tEAxQwOTsq8ndMnDXkZ9m9E1kgZkuKvaBU52QJg6hwCr9ofOF3rBqOjmnHHarc7t05onsH9k0yx5KccFuC6Y4 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 72c637634ac84f7299ee3ac1a67f2750 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-MigrationsAdminTest-103296004 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-MigrationsAdminTest-103296004 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 72c637634ac84f7299ee3ac1a67f2750 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MigrationsAdminTest-103296004 Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-MigrationsAdminTest-103296004-project Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 5ec3b5fbeafd47558718a7a9638d0c9e Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-MigrationsAdminTest-103296004-project Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance b88c7d5d-8596-4064-b313-10976ecf63fa could not be found. Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'b88c7d5d-8596-4064-b313-10976ecf63fa'} Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88c7d5d-8596-4064-b313-10976ecf63fa could not be found. Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88c7d5d-8596-4064-b313-10976ecf63fa could not be found. Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:00.999152 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88c7d5d-8596-4064-b313-10976ecf63fa could not be found. Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Returning 404 to user: Instance b88c7d5d-8596-4064-b313-10976ecf63fa could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8edfeac-1f6c-492a-944f-882ef6af242a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa" status: 404 len: 111 microversion: 2.1 time: 0.142905 Oct 17 15:29:01.009908 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1010/1895] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:00 2022] GET /compute/v2.1/servers/b88c7d5d-8596-4064-b313-10976ecf63fa => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:29:01.034741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:01.036362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:01.068989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:01.070044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:01.070492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:01.071275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:01.071720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:01.072227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:01.114404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:01.217244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:29:01.662259 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b58414a0-6a7f-4538-8392-5b385dfcb929 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "DELETE /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 204 len: 0 microversion: 2.1 time: 0.646162 Oct 17 15:29:01.670631 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1011/1896] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:29:01 2022] DELETE /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:29:01.699969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:01.704516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:01.736750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:01.737800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:01.743356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:01.747341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:01.751122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:01.754601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:02.200686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:02.206579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:02.223055 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a2f1a5f-bc39-4f11-8b4a-b42127d63882 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1519 microversion: 2.1 time: 2.223377 Oct 17 15:29:02.223903 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 886/1897] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:28:59 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1519 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:02.245201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-87a551a1-25a2-4e88-bc7a-4ba47a93ade9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2ecdaf0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:02.249287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:02.257792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:02.264853 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39e94899-43ac-4601-96f9-11c2272b2cda tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1319 microversion: 2.25 time: 0.592432 Oct 17 15:29:02.265501 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1012/1898] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:01 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:02.305546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:02.306307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:02.374969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:02.375480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:02.381565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:02.386121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:02.386677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:02.387128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:02.399300 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-87a551a1-25a2-4e88-bc7a-4ba47a93ade9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.173586 Oct 17 15:29:02.400145 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 887/1899] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:02 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:02.866160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:02.876763 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd1bb380-18a4-43e7-8c3e-c4ca90ae5af8 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1468 microversion: 2.1 time: 0.605258 Oct 17 15:29:02.877897 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1013/1900] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:02 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1468 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:03.209818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-283419431", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "fbf48d23-b6f0-48de-b73a-9c8aad4ee168"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:03.251012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:03.252346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:03.265555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:03.266349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:03.267765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:03.268760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:03.269652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:03.270277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:03.298249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] validate_networks() for [('fbf48d23-b6f0-48de-b73a-9c8aad4ee168', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:29:03.460660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:03.485952 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d731d140-e1a7-45fd-b404-ff636fa972f5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1504 microversion: 2.1 time: 0.237698 Oct 17 15:29:03.488257 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1014/1901] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:03 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:03.500183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:03.501263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:03.517470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:03.518604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:03.520436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:03.522832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:03.528438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:03.529223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:03.618114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:03.632684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:03.634836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:03.636293 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02dc5e36-9ab2-4389-a808-ff91bcc12a8d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1319 microversion: 2.25 time: 0.146687 Oct 17 15:29:03.637059 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1015/1902] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:03 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:03.643872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72cdd23f-8583-402e-8c88-991471699939 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bf3a4160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:03.724517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72cdd23f-8583-402e-8c88-991471699939 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.085957 Oct 17 15:29:03.725914 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1016/1903] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:03 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:03.732648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:03.733553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:03.746633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:03.748367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:03.749111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:03.750105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:03.751008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:03.751857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:04.066946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:04.076667 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5ee44bb-cfe2-4fdf-aeae-491005c46a2b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 200 len: 1504 microversion: 2.1 time: 0.349313 Oct 17 15:29:04.081344 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1017/1904] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:03 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 1504 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:04.092909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:04.095264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:04.109758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:04.113726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:04.114692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:04.115686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:04.116403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:04.117056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:04.336402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:04.348755 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-41b93d86-feda-4046-81e0-b6ccdc5ac713 tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1468 microversion: 2.1 time: 0.265612 Oct 17 15:29:04.350414 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1018/1905] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:04 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1468 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:04.376080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:04.377098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:04.386386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:04.387440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:04.388128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:04.389152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:04.389860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:04.390912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:04.422975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:29:04.542365 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f867f10-46e9-4549-b4a6-e1c69d71c98b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 204 len: 0 microversion: 2.1 time: 0.174066 Oct 17 15:29:04.544889 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1019/1906] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:29:04 2022] DELETE /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:29:04.666278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:04.667345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:04.679676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:04.683055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:04.683807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:04.684667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:04.686556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:04.688479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:04.973902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:04.985992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:04.988015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:04.989479 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd3c72c4-40dc-4822-b893-e80ef0f781ef tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1361 microversion: 2.25 time: 0.328733 Oct 17 15:29:05.011031 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1020/1907] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:04 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:29:05.016830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-14702019", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7d66882a-376e-4e59-a30c-8056586fb6d2"}], "block_device_mapping_v2": [{"uuid": "aae41b5d-2fa0-4976-b0ca-b6dda58e0657", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:05.121425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] validate_networks() for [('7d66882a-376e-4e59-a30c-8056586fb6d2', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:29:05.340525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:05.341696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:05.342235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:05.342787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:05.343445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:05.364440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:05.365225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:05.365867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:05.368470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:05.369134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:05.369756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:05.408909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:05.424258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for user 745a483a369e4e83849cee037f5b67ab and project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:05.450674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:29:05.453572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:29:05.556680 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7028627d-c4e5-4f0e-9d48-027c2aadedbc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.612491 Oct 17 15:29:05.563511 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 888/1908] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:29:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:29:05.568831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-28b6d64d-df9c-4a0b-9fbc-a940e7cf95b3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2ef5280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:05.689150 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-28b6d64d-df9c-4a0b-9fbc-a940e7cf95b3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.124309 Oct 17 15:29:05.689778 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 889/1909] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:05 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:05.705939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-42849004", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "e1442722-4c96-4091-8992-f20bac8a7206"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:05.863858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] validate_networks() for [('e1442722-4c96-4091-8992-f20bac8a7206', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:29:06.144380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:06.147472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:06.148169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:06.151264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:06.152079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:06.184216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:06.186957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:06.187446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:06.192055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:06.193085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:06.193525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:06.245627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:06.264877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Getting quotas for user 13c8d45b2e4d459d92b024476b2f4fbd and project 243aa6b3387c4549b5c94ec1ddc5c850. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:06.478690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:29:06.481599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aae41b5d-2fa0-4976-b0ca-b6dda58e0657',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:29:06.742979 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65397183-df4c-41ed-b2a7-d21d7fcfc332 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730299 Oct 17 15:29:06.748764 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1021/1910] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:29:06.753783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:06.759797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:06.774735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:06.776438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:06.777642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:06.778732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:06.779368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:06.779953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:06.836612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:06.837094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:06.837522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:06.837972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lazy-loading 'fault' on Instance uuid 382fe0d4-2f91-4289-8eea-4619e645a500 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:06.953364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3b5fbeafd47558718a7a9638d0c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c637634ac84f7299ee3ac1a67f2750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:06.970032 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-743d47f0-65af-492e-98fd-611e66e8547c tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 200 len: 1302 microversion: 2.1 time: 0.219654 Oct 17 15:29:06.973415 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1022/1911] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:06 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 1302 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:06.980532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1656087194", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:07.160352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] validate_networks() for [('d03e9e4b-e4e4-4807-a6fd-a00d165be1a3', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:29:08.411918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:08.413140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:08.414098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:08.414748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:08.415374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:08.449678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:08.453053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:08.453782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:08.455000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:08.456990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:08.458462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:08.522986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Getting quotas for project 4e0a35484bd44be0938aaabdee3cf4c2. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:08.540515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Getting quotas for user e5d69af6a3c14dbab949c56fde26ff95 and project 4e0a35484bd44be0938aaabdee3cf4c2. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:08.578771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:29:08.585643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:29:08.752892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-745bc35c-03e4-4053-91b4-99348b61ecbd tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.777968 Oct 17 15:29:08.753560 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1023/1912] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:29:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:29:08.810922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:08.811729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:08.859197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:08.859715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:08.860161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:08.860891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:08.861351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:08.861779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:09.012798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:09.024000 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55e87cb6-7b14-4cdd-9ff9-f1c8d9a84fe9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1274 microversion: 2.1 time: 0.259207 Oct 17 15:29:09.026573 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1024/1913] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:08 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1274 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:09.035808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:09.036411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:09.049832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:09.050768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:09.051493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:09.053298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:09.054305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:09.055025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:09.409013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:09.427719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:09.434663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:09.443293 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a38eba6e-3774-405d-aff0-e95bc7e8f35c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1361 microversion: 2.25 time: 0.416911 Oct 17 15:29:09.462623 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1025/1914] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:09 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1361 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:09.474428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9fdfb3c8-57f0-4d5e-a4a7-2bf3d961550a req-7f490333-67fe-49dc-9e0b-caf2b3126f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382fe0d4-2f91-4289-8eea-4619e645a500", "name": "network-vif-deleted", "tag": "86a21e24-7531-494a-88d1-d4be7315e896"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:09.539306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fdfb3c8-57f0-4d5e-a4a7-2bf3d961550a req-7f490333-67fe-49dc-9e0b-caf2b3126f38 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:09.539830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fdfb3c8-57f0-4d5e-a4a7-2bf3d961550a req-7f490333-67fe-49dc-9e0b-caf2b3126f38 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:09.540264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fdfb3c8-57f0-4d5e-a4a7-2bf3d961550a req-7f490333-67fe-49dc-9e0b-caf2b3126f38 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:09.560099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9fdfb3c8-57f0-4d5e-a4a7-2bf3d961550a req-7f490333-67fe-49dc-9e0b-caf2b3126f38 service nova] Creating event network-vif-deleted:86a21e24-7531-494a-88d1-d4be7315e896 for instance 382fe0d4-2f91-4289-8eea-4619e645a500 on n-h2-854441-12 Oct 17 15:29:09.577490 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9fdfb3c8-57f0-4d5e-a4a7-2bf3d961550a req-7f490333-67fe-49dc-9e0b-caf2b3126f38 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111592 Oct 17 15:29:09.580771 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1026/1915] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:09.588088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ee78f07-adb0-430b-be45-c31675267247 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2fc2b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:09.657576 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ee78f07-adb0-430b-be45-c31675267247 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.073449 Oct 17 15:29:09.658430 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1027/1916] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:09 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:09.835468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:09.836415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:09.838846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:09.847117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:09.848637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:09.849268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:09.850550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:09.851179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:09.852330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:09.878058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:09.980883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:09.983649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:09.987015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:09.990690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:09.991522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:09.994917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:10.009349 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be4f654e-12df-4617-867b-dbe853c7fe07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1149 microversion: 2.1 time: 0.349621 Oct 17 15:29:10.026890 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1028/1917] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:09 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1149 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:10.028731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:10.029330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:10.032211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:10.033267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] [instance: 382fe0d4-2f91-4289-8eea-4619e645a500] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:10.034416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:10.053051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:10.058596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:10.062935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:10.063327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:10.067126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:10.068013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:10.070538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:10.075214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:10.077559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:10.131805 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] HTTP exception thrown: Instance 382fe0d4-2f91-4289-8eea-4619e645a500 could not be found. Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Request method failure captured: Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 HTTP/1.1 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXMYvpnQDsGGIQ_IabX6Ce5ZCjLhxqJFt2NG7mPJmeSL-8aEn5h-8TVGHoj7doKSnVbAq9mq1oEhx29vwwZXhzMTd6tEAxQwOTsq8ndMnDXkZ9m9E1kgZkuKvaBU52QJg6hwCr9ofOF3rBqOjmnHHarc7t05onsH9k0yx5KccFuC6Y4 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 72c637634ac84f7299ee3ac1a67f2750 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-MigrationsAdminTest-103296004 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72c637634ac84f7299ee3ac1a67f2750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-MigrationsAdminTest-103296004 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 72c637634ac84f7299ee3ac1a67f2750 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MigrationsAdminTest-103296004 Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-MigrationsAdminTest-103296004-project Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 5ec3b5fbeafd47558718a7a9638d0c9e Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-MigrationsAdminTest-103296004-project Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 382fe0d4-2f91-4289-8eea-4619e645a500 could not be found. Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '382fe0d4-2f91-4289-8eea-4619e645a500'} Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 382fe0d4-2f91-4289-8eea-4619e645a500 could not be found. Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 382fe0d4-2f91-4289-8eea-4619e645a500 could not be found. Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:10.135487 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:10.140138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:10.140138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:10.140138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:10.140138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:29:10.140138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:29:10.140138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 382fe0d4-2f91-4289-8eea-4619e645a500 could not be found. Oct 17 15:29:10.140138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:10.140642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Getting quotas for project 947ae7af631447ca8963b47e913fb618. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:10.147975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] Returning 404 to user: Instance 382fe0d4-2f91-4289-8eea-4619e645a500 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:29:10.149252 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5acb7534-2b44-4310-8711-6a8302f47f2a tempest-MigrationsAdminTest-103296004 tempest-MigrationsAdminTest-103296004-project] 10.222.0.87 "GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500" status: 404 len: 111 microversion: 2.1 time: 0.134612 Oct 17 15:29:10.152619 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1029/1918] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:10 2022] GET /compute/v2.1/servers/382fe0d4-2f91-4289-8eea-4619e645a500 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:29:10.152840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Getting quotas for user 62f7ab17b8454d049b81bdd07e41e62f and project 947ae7af631447ca8963b47e913fb618. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:10.168792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:10.179789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:10.201872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:10.202955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:10.203574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:10.204384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:10.206236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:29:10.206933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:10.208500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:29:10.210389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:10.408338 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8348932e-0a26-4b65-ab3d-d1d7e13cd02e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.717400 Oct 17 15:29:10.409928 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 890/1919] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:29:10.443683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:10.447648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:10.494806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:10.498965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:10.516996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:10.523633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:10.528041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:10.531278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:10.833498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:10.852190 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fb34b395-6fbf-43b1-98c5-bb84a32a60bb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1272 microversion: 2.1 time: 0.438016 Oct 17 15:29:10.852876 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 891/1920] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:10 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1272 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:10.866836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-345ca7a3-d0db-461a-bb3d-5f200e2c6bf5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:10.868542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-345ca7a3-d0db-461a-bb3d-5f200e2c6bf5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:11.170853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-345ca7a3-d0db-461a-bb3d-5f200e2c6bf5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:11.179556 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-345ca7a3-d0db-461a-bb3d-5f200e2c6bf5 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1216 microversion: 2.1 time: 0.323107 Oct 17 15:29:11.194055 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 892/1921] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:10 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1216 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:11.208701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:11.209303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:11.244010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:11.247690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:11.249639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:11.250904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:11.252160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:11.253794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:11.295233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:12.025705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:12.035917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:12.037400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:12.049353 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e0b5365-89d2-4cfe-b94e-562ff244d3b4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1361 microversion: 2.25 time: 0.842735 Oct 17 15:29:12.052869 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 893/1922] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:11 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1361 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:12.060673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d3b72e49-4700-4fcd-95c2-722d1a31efcd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2ecd550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:12.098539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:12.125568 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d07178b1-67b0-4a1b-92eb-342a33a3a768 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1229 microversion: 2.1 time: 1.967187 Oct 17 15:29:12.131927 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1030/1923] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:10 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1229 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:12.138344 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d3b72e49-4700-4fcd-95c2-722d1a31efcd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.084080 Oct 17 15:29:12.139154 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 894/1924] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:12 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:12.151660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:12.152659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:12.159748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-59bdff6a-e87a-4179-9a18-32aadb4eb3b5 req-12e81ba8-54b6-46ad-884f-f37b0e653fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a6c5fc-30ba-49b2-ab11-747aae6d7f21", "name": "network-vif-deleted", "tag": "1d89e5eb-f096-4fd6-ad9f-76b4586513f1"}, {"name": "network-changed", "server_uuid": "2515b31b-3d10-40b2-a11a-e89640d4c8d6", "tag": "161227d2-c2ea-4581-a464-7d890b9c52af"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:12.182259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:12.183919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-59bdff6a-e87a-4179-9a18-32aadb4eb3b5 req-12e81ba8-54b6-46ad-884f-f37b0e653fb5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:12.185207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:12.185793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:12.186710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-59bdff6a-e87a-4179-9a18-32aadb4eb3b5 req-12e81ba8-54b6-46ad-884f-f37b0e653fb5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:12.187332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-59bdff6a-e87a-4179-9a18-32aadb4eb3b5 req-12e81ba8-54b6-46ad-884f-f37b0e653fb5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:12.190804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:12.195303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:12.197929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:12.219091 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-59bdff6a-e87a-4179-9a18-32aadb4eb3b5 req-12e81ba8-54b6-46ad-884f-f37b0e653fb5 service nova] Creating event network-vif-deleted:1d89e5eb-f096-4fd6-ad9f-76b4586513f1 for instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 on n-h2-854441-12 Oct 17 15:29:12.219597 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-59bdff6a-e87a-4179-9a18-32aadb4eb3b5 req-12e81ba8-54b6-46ad-884f-f37b0e653fb5 service nova] Creating event network-changed:161227d2-c2ea-4581-a464-7d890b9c52af for instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 on n-h1-854441-12 Oct 17 15:29:12.231991 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-59bdff6a-e87a-4179-9a18-32aadb4eb3b5 req-12e81ba8-54b6-46ad-884f-f37b0e653fb5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.082790 Oct 17 15:29:12.239907 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 895/1925] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:12.251801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:12.252858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:12.268428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:12.270759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:12.275274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:12.276275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:12.276750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:12.277263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:12.469052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:12.488255 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c97c69b-c99b-43ec-ba8e-b22708370cd0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1167 microversion: 2.1 time: 0.352932 Oct 17 15:29:12.490378 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1031/1926] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:12 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1167 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:12.500467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:12.501940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:12.519443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:12.520734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:12.521937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:12.522889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:12.523518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:12.527401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:12.963474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:12.972501 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fec3b6a7-4d4a-499c-acdd-a3544891012f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 0.731106 Oct 17 15:29:12.983540 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 896/1927] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:12 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:13.081650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:13.083286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:13.096230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:13.105031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:13.106019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:13.107098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:13.107755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:13.115298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:13.219378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:13.232345 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2197658-a8a3-4af8-a71c-7efe42ac7ca6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1268 microversion: 2.1 time: 0.740553 Oct 17 15:29:13.234345 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1032/1928] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:12 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1268 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:13.262024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ceab261-fb1f-448d-844a-b328dd2a3ce5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f0e700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:13.369009 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ceab261-fb1f-448d-844a-b328dd2a3ce5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.121497 Oct 17 15:29:13.369860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1033/1929] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:13 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:13.398421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:13.410932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:13.427324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:13.428996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:13.434799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:13.436439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:13.442530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:13.444351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:13.818978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:13.836613 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce005b98-54e2-4e9d-9b9c-a226d91b4e97 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1283 microversion: 2.1 time: 0.459852 Oct 17 15:29:13.851514 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1034/1930] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:13 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1283 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:13.870181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:13.872020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:13.888165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:13.888674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:13.889120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:13.892461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:13.894061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:13.898223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:14.335991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:14.372591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:14.373913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:14.376537 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a8bd2b98-427a-4789-af43-485a59b281e1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1361 microversion: 2.25 time: 1.298882 Oct 17 15:29:14.381382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:14.386718 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 897/1931] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:13 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1361 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:14.412774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:14.415104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:14.421782 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9a0218e-b25b-4607-b112-d00806a70055 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1167 microversion: 2.1 time: 0.568576 Oct 17 15:29:14.432843 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1035/1932] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:13 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1167 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:14.434879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:14.439687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:14.440433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:14.441384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:14.442011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:14.444240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:14.457209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:14.459998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:14.475536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:14.476048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:14.476471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:14.486241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:14.488488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:14.491788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:15.092340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:15.101801 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb692e11-0dbe-42aa-ac89-0bfdfda0fc00 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1274 microversion: 2.1 time: 0.667671 Oct 17 15:29:15.106856 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1036/1933] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:14 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1274 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:15.119765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-725b7f29-9a74-4b5e-8d35-2db022ea3b0b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f78160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:15.197224 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-725b7f29-9a74-4b5e-8d35-2db022ea3b0b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.089026 Oct 17 15:29:15.198146 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1037/1934] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:15 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:15.214614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:15.215595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:15.236775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:15.237757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:15.238380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:15.239310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:15.243155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:15.243843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:15.555746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:15.595801 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c5f7ce5-dd81-4a1f-834b-454e848c0f1f tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1283 microversion: 2.1 time: 0.392583 Oct 17 15:29:15.596835 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1038/1935] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:15 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1283 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:15.633167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:15.634309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:15.675346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:15.676244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:15.677002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:15.678277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:15.679121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:15.679893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:16.745011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:16.759330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:16.766859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:16.773151 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43eb9f42-5060-46e6-a125-001d6fc8c317 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1361 microversion: 2.25 time: 1.174908 Oct 17 15:29:16.780797 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1039/1936] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:15 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1361 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:16.803212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:16.805497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:16.835046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:16.842299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:16.843090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:16.846711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:16.848030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:16.851590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:16.992267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:17.010403 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f632d53-f287-471a-988b-671d5c7cb3a9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 2.619778 Oct 17 15:29:17.013096 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 898/1937] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:14 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 2626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:17.033410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:17.036165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:17.050679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:17.052845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:17.054848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:17.056081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:17.057615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:17.059485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:17.547128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:17.572891 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a256acb5-6c2a-4314-b9e0-3ad166003233 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1274 microversion: 2.1 time: 0.543026 Oct 17 15:29:17.575485 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 899/1938] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:17 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1274 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:17.603712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6af87865-b679-4621-8ff5-fc169fc8f5bc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f7b0d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:17.668960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:17.680287 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-081d6e6a-a334-4df1-99f9-710de7c41d86 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1209 microversion: 2.1 time: 0.898104 Oct 17 15:29:17.686541 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1040/1939] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:16 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1209 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:17.713245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:17.727215 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6af87865-b679-4621-8ff5-fc169fc8f5bc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.149462 Oct 17 15:29:17.727962 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 900/1940] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:17 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:17.730084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:17.765886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:17.782392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:17.795175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:17.795175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:17.795175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:17.795982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:17.807983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:17.808798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:17.832987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:17.835992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:17.838033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:17.842878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:17.848983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:17.855250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:18.495380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:18.544009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:18.565685 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e695924-09a3-4ea3-b941-8c3272a8a0bb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.860940 Oct 17 15:29:18.572765 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1041/1941] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:17 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:18.589630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:18.592646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:18.613879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:18.617213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:18.618177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:18.618864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:18.619903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:18.621008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:18.621654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:19.086874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:19.103844 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e6dea4c-0a73-4c28-b894-9efc92568ff5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 0.526506 Oct 17 15:29:19.108235 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1042/1942] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:18 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:19.119589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:19.123404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:19.148222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:19.150318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:19.151322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:19.152854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:19.153561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:19.154246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:19.516217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:19.526465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:19.535028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:19.539117 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-26d8d7af-fe2d-4ca2-a33c-0ff75ae62cac tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1361 microversion: 2.25 time: 1.734713 Oct 17 15:29:19.541054 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 901/1943] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:17 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1361 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:19.550567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:19.556056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:19.592505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:19.593035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:19.593495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:19.602267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:19.602858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:19.606104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:20.097765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:20.295492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:20.309993 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be36593b-23d1-4844-a54f-ea4bd4c04e51 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1274 microversion: 2.1 time: 1.199142 Oct 17 15:29:20.312624 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1043/1944] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:19 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1274 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:20.320677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f635b67-1598-4f41-84e9-de2ecdf56730 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f6cc10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:20.433415 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f635b67-1598-4f41-84e9-de2ecdf56730 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1439 microversion: 2.1 time: 0.120807 Oct 17 15:29:20.434841 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1044/1945] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:20 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1439 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:20.448848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a4e045b0-d182-41ca-9608-68788dc8f7cf req-b57abb4a-3912-45c2-bc6e-d8d7584cc548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66189c64-70e7-4ec5-a3be-20b06e23940d", "tag": "dad068f7-eefd-42f9-96bb-8092defb7bcf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:20.501462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4e045b0-d182-41ca-9608-68788dc8f7cf req-b57abb4a-3912-45c2-bc6e-d8d7584cc548 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:20.503442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4e045b0-d182-41ca-9608-68788dc8f7cf req-b57abb4a-3912-45c2-bc6e-d8d7584cc548 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:20.505502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4e045b0-d182-41ca-9608-68788dc8f7cf req-b57abb4a-3912-45c2-bc6e-d8d7584cc548 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:20.537598 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a4e045b0-d182-41ca-9608-68788dc8f7cf req-b57abb4a-3912-45c2-bc6e-d8d7584cc548 service nova] Creating event network-changed:dad068f7-eefd-42f9-96bb-8092defb7bcf for instance 66189c64-70e7-4ec5-a3be-20b06e23940d on n-h2-854441-12 Oct 17 15:29:20.572388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a4e045b0-d182-41ca-9608-68788dc8f7cf req-b57abb4a-3912-45c2-bc6e-d8d7584cc548 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133893 Oct 17 15:29:20.577850 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1045/1946] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:20.615343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bff453ae-677e-4b25-af26-2b5ce4ef9d3a req-c0dbd262-b1a8-444e-9f51-a4aa2d532a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2515b31b-3d10-40b2-a11a-e89640d4c8d6", "name": "network-vif-plugged", "status": "completed", "tag": "161227d2-c2ea-4581-a464-7d890b9c52af"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:20.642526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bff453ae-677e-4b25-af26-2b5ce4ef9d3a req-c0dbd262-b1a8-444e-9f51-a4aa2d532a89 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:20.644251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bff453ae-677e-4b25-af26-2b5ce4ef9d3a req-c0dbd262-b1a8-444e-9f51-a4aa2d532a89 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:20.644818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bff453ae-677e-4b25-af26-2b5ce4ef9d3a req-c0dbd262-b1a8-444e-9f51-a4aa2d532a89 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:20.683673 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bff453ae-677e-4b25-af26-2b5ce4ef9d3a req-c0dbd262-b1a8-444e-9f51-a4aa2d532a89 service nova] Creating event network-vif-plugged:161227d2-c2ea-4581-a464-7d890b9c52af for instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 on n-h1-854441-12 Oct 17 15:29:20.695937 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bff453ae-677e-4b25-af26-2b5ce4ef9d3a req-c0dbd262-b1a8-444e-9f51-a4aa2d532a89 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101554 Oct 17 15:29:20.702051 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1046/1947] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:20.719890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:20.721796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:20.743668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:20.744577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:20.745772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:20.747973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:20.751567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:20.753595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:21.173509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:21.175487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=32 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:21.188198 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a649471-4240-4e20-a560-d6088c25c339 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.482503 Oct 17 15:29:21.209457 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1047/1948] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:20 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:21.503219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:21.517656 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d8a78e39-9cfd-476c-982c-9de12c35f204 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1209 microversion: 2.1 time: 1.974629 Oct 17 15:29:21.531307 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 902/1949] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:19 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1209 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:21.545931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:21.546964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:21.567950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:21.568858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:21.569460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:21.570548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:21.571167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:21.572496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:21.807287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-214283913", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": "none"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:21.899585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:21.900233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:21.900860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:21.901590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:21.902656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:21.923393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:21.923880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:21.924314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:21.925041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:21.925495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:21.925917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:21.968270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Getting quotas for project f7f7c07172154160bd9587d06dc93ae7. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:21.976720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Getting quotas for user edc795b73d074003b95e575920f10249 and project f7f7c07172154160bd9587d06dc93ae7. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:22.000829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:29:22.003504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:29:22.111048 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3361aaa-f59e-4af2-ad25-4dbde04f43fe tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.900011 Oct 17 15:29:22.120176 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1048/1950] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:29:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:29:22.125477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:22.126018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:22.147156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:22.148222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:22.149393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:22.150298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:22.151116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:22.151709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:22.549273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:22.575640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:22.589980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:22.593166 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90278cdd-db9f-4f68-8901-5027f9ef51ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1361 microversion: 2.25 time: 0.471794 Oct 17 15:29:22.614480 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1049/1951] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:22 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1361 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:22.637095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:22.638160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:22.661881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:22.662766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:22.663429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:22.665015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:22.665664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:22.666830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:22.676691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:22.691450 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-55745c52-3a28-411c-93c9-8265469cd98b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 1.158451 Oct 17 15:29:22.696039 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 903/1952] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:21 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:22.719037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14dbcbb8-425f-4230-9b31-44b9b4704680 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2ecd8b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:22.837898 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-14dbcbb8-425f-4230-9b31-44b9b4704680 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1448 microversion: 2.1 time: 0.140422 Oct 17 15:29:22.858156 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 904/1953] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:22 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:22.863242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b6323c3b-d646-43cb-b857-5386da413c50 req-18134152-8dab-4133-b2b9-6b5a1bebe630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66521d3-f3e0-4388-b5ae-f39088b065ec", "tag": "1d6bd306-d555-465b-8af6-0d1f836e7963"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:22.880191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b6323c3b-d646-43cb-b857-5386da413c50 req-18134152-8dab-4133-b2b9-6b5a1bebe630 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:22.880670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b6323c3b-d646-43cb-b857-5386da413c50 req-18134152-8dab-4133-b2b9-6b5a1bebe630 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:22.885997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b6323c3b-d646-43cb-b857-5386da413c50 req-18134152-8dab-4133-b2b9-6b5a1bebe630 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:22.911958 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b6323c3b-d646-43cb-b857-5386da413c50 req-18134152-8dab-4133-b2b9-6b5a1bebe630 service nova] Creating event network-changed:1d6bd306-d555-465b-8af6-0d1f836e7963 for instance d66521d3-f3e0-4388-b5ae-f39088b065ec on n-h2-854441-12 Oct 17 15:29:22.928527 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b6323c3b-d646-43cb-b857-5386da413c50 req-18134152-8dab-4133-b2b9-6b5a1bebe630 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068882 Oct 17 15:29:22.929456 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 905/1954] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:22.935470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-588a492a-d944-40cb-9b8d-cfa90a44e655 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:22.946236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-588a492a-d944-40cb-9b8d-cfa90a44e655 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:23.130245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-588a492a-d944-40cb-9b8d-cfa90a44e655 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:23.143389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-588a492a-d944-40cb-9b8d-cfa90a44e655 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:23.145409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-588a492a-d944-40cb-9b8d-cfa90a44e655 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:23.154369 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-588a492a-d944-40cb-9b8d-cfa90a44e655 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "PUT /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1358 microversion: 2.75 time: 0.223295 Oct 17 15:29:23.159527 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 906/1955] 10.222.0.87 () {62 vars in 1297 bytes} [Mon Oct 17 15:29:22 2022] PUT /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:23.166336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:23.171252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:23.183611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:23.184425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:23.185040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:23.186025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:23.186683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:23.187269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:23.211109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:23.214201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:23.224893 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-362b04fd-e52f-4550-8a0b-f37b794a80f8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1316 microversion: 2.1 time: 0.608671 Oct 17 15:29:23.225728 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1050/1956] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:22 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:23.232693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:23.236632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:23.247751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:23.248242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:23.248673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:23.249391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:23.250022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:23.250635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:23.552666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:23.571139 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb6b9b57-6d81-4ccf-b84f-18313f678b6b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1197 microversion: 2.1 time: 0.344147 Oct 17 15:29:23.572101 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1051/1957] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:23 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1197 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:23.591774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54250ec6-0c88-4b8c-b3e0-df5e473446b6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f78160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:23.670043 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54250ec6-0c88-4b8c-b3e0-df5e473446b6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 200 len: 1448 microversion: 2.1 time: 0.093965 Oct 17 15:29:23.670865 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1052/1958] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:23 2022] GET /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 1448 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:23.681470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:23.683874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:23.692488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:23.693310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:23.693972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:23.695154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:23.695956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:23.696685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:23.703197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:23.723206 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4ac28d56-3e55-4ce3-9256-318c4f5e48d1 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.557609 Oct 17 15:29:23.723932 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 907/1959] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:23 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:23.737450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:23.738076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:23.766311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:23.767354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:23.768067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:23.769085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:23.769935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:23.771106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:23.915763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:23.934887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:23.943193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:23.950293 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89644b34-36e2-42ae-9c1b-81c0f5a696b3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1354 microversion: 2.75 time: 0.278289 Oct 17 15:29:23.953970 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1053/1960] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:23 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1354 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:23.966264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fea2b96e-ce07-4958-ba44-306fe9cedb76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f78280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:24.816921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:24.826696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:24.828509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:24.830098 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4143378a-7abd-40ec-a9ed-85df3c8e1139 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1556 microversion: 2.25 time: 1.105145 Oct 17 15:29:24.831801 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 908/1961] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:23 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1556 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:24.854174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:24.859027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:24.881016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:24.881521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:24.881956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:24.882705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:24.883162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:24.883586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.051514 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fea2b96e-ce07-4958-ba44-306fe9cedb76 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 204 len: 0 microversion: 2.1 time: 1.095828 Oct 17 15:29:25.057295 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1054/1962] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:23 2022] DELETE /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 0 bytes in 1100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:29:25.062376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:25.063258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:25.070196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.070813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.071732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.072907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.073709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.074388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.340409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:25.340911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:25.352175 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37d3665e-3a99-429c-934b-ad93836d6dfb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1316 microversion: 2.1 time: 0.293679 Oct 17 15:29:25.353511 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1055/1963] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:25 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:25.367063 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa6a1af8-5d63-4bc2-9d1c-4a5da7925f59 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 0.519139 Oct 17 15:29:25.368043 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 909/1964] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:24 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:25.375860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:25.378808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:25.384094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:25.395380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:25.405482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.408878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.409408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.411820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.412526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.413161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.421748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.422607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.423264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.424325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.425270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.437814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.654965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:25.664391 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d91b1da9-34a1-4307-9660-b2c38a542a22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.292731 Oct 17 15:29:25.665297 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 910/1965] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:25 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:25.670185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:25.670830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:25.676751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.677466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.677736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:25.678285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.679030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.679480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.679890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.688204 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30963ef7-c25e-4f1d-abfa-6815cd347957 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1197 microversion: 2.1 time: 0.333250 Oct 17 15:29:25.689194 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1056/1966] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:25 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1197 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:25.703199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:25.707191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:25.715100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.715855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.716474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.717514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.718141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.718887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.830983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:25.840590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:25.841769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 2515b31b-3d10-40b2-a11a-e89640d4c8d6 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:25.842351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:25.847883 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2695d22f-08a8-4b6b-83ed-3694fa05a05d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1416 microversion: 2.75 time: 0.153469 Oct 17 15:29:25.848970 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1057/1967] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:25 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:25.858681 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-de2e74b0-e239-493f-93a7-9ebc2ce94ebc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 2050 microversion: 2.25 time: 0.189756 Oct 17 15:29:25.858681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 911/1968] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:25 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 2050 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:25.867919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9e2a02d3-e081-4558-b83a-2be4c4434f3e req-87f6f015-adf1-4a8f-8fc2-ab57254f2815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f10878-2fa0-4b9b-9b65-b296e034dc8d", "tag": "815c8333-ad3a-4336-b460-1c7a5b419ace"}, {"name": "network-changed", "server_uuid": "efaed5c1-00db-49f6-b605-36e008e852ce", "tag": "cba2595d-0e84-4461-92a6-9374671ead7b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:25.873288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:25.874166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:25.879277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e2a02d3-e081-4558-b83a-2be4c4434f3e req-87f6f015-adf1-4a8f-8fc2-ab57254f2815 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.880346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e2a02d3-e081-4558-b83a-2be4c4434f3e req-87f6f015-adf1-4a8f-8fc2-ab57254f2815 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.880951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e2a02d3-e081-4558-b83a-2be4c4434f3e req-87f6f015-adf1-4a8f-8fc2-ab57254f2815 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.887539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.888292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.888934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.889829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.890641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.891237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.902922 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9e2a02d3-e081-4558-b83a-2be4c4434f3e req-87f6f015-adf1-4a8f-8fc2-ab57254f2815 service nova] Creating event network-changed:815c8333-ad3a-4336-b460-1c7a5b419ace for instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d on n-h1-854441-12 Oct 17 15:29:25.903762 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9e2a02d3-e081-4558-b83a-2be4c4434f3e req-87f6f015-adf1-4a8f-8fc2-ab57254f2815 service nova] Creating event network-changed:cba2595d-0e84-4461-92a6-9374671ead7b for instance efaed5c1-00db-49f6-b605-36e008e852ce on n-h1-854441-12 Oct 17 15:29:25.914424 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9e2a02d3-e081-4558-b83a-2be4c4434f3e req-87f6f015-adf1-4a8f-8fc2-ab57254f2815 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055947 Oct 17 15:29:25.915318 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 912/1969] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:25.923506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:25.924491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:25.932574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.933867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.934535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.935451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:25.936097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:25.936744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:25.954690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:29:26.083697 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d9d58c9-ea94-4961-9a04-8b3e6c44e6d8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 204 len: 0 microversion: 2.1 time: 0.221786 Oct 17 15:29:26.086383 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1058/1970] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:29:25 2022] DELETE /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:29:26.293840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 2515b31b-3d10-40b2-a11a-e89640d4c8d6 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:26.314031 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-69ae2c80-8ef9-4087-8974-440809727ffc tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 2050 microversion: 2.25 time: 0.397169 Oct 17 15:29:26.330338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 913/1971] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:25 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 2050 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:26.350073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-358878395", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "4a4d489b-6847-437c-bb6f-226f2268a1b9"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:26.378618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0d01a210-a6fa-49c4-85fe-cabd4be8ca11 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:26.400936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d01a210-a6fa-49c4-85fe-cabd4be8ca11 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:26.403293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d01a210-a6fa-49c4-85fe-cabd4be8ca11 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:26.406222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d01a210-a6fa-49c4-85fe-cabd4be8ca11 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:26.407287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d01a210-a6fa-49c4-85fe-cabd4be8ca11 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:26.411105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d01a210-a6fa-49c4-85fe-cabd4be8ca11 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:26.412666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d01a210-a6fa-49c4-85fe-cabd4be8ca11 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:26.439470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] validate_networks() for [('4a4d489b-6847-437c-bb6f-226f2268a1b9', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:29:26.459520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:26.491027 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0d01a210-a6fa-49c4-85fe-cabd4be8ca11 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.130243 Oct 17 15:29:26.493767 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 914/1972] 10.222.0.87 () {60 vars in 1217 bytes} [Mon Oct 17 15:29:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:29:26.500218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:26.504221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:26.515157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:26.523519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:26.524329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:26.525329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:26.527002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:26.528408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:26.804555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:26.813400 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1fc6d4c0-0b17-475f-a96f-f24057e46b96 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1316 microversion: 2.1 time: 0.317601 Oct 17 15:29:26.827132 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 915/1973] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:26 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:26.834409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:26.835434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:26.842046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:26.843369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:26.844030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:26.844947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:26.845602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:26.846077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:26.863543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:26.924047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:26.924473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:26.925080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:26.925493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:26.925913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:26.935990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:26.936531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:26.936961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:26.938250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:26.938250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:26.938524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:26.956668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:26.963624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for user 59a1c6dac66a43d9b5e91b78215359ce and project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:26.978444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:29:26.980978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:29:27.053343 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9df32bac-290e-4c16-bd00-704f622f0372 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713547 Oct 17 15:29:27.064062 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1059/1974] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:29:27.075464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-34a9f807-65bd-4c35-8c65-e97105d3c686 req-4657614f-c3ca-4914-a52d-c4d812041a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0a13ab-993e-497e-8565-47790e0d5721", "name": "network-vif-unplugged", "status": "completed", "tag": "7208a5cc-9906-471a-9f0a-9f7b31850c26"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:27.099123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-34a9f807-65bd-4c35-8c65-e97105d3c686 req-4657614f-c3ca-4914-a52d-c4d812041a05 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.099784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-34a9f807-65bd-4c35-8c65-e97105d3c686 req-4657614f-c3ca-4914-a52d-c4d812041a05 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.100015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-34a9f807-65bd-4c35-8c65-e97105d3c686 req-4657614f-c3ca-4914-a52d-c4d812041a05 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.118787 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-34a9f807-65bd-4c35-8c65-e97105d3c686 req-4657614f-c3ca-4914-a52d-c4d812041a05 service nova] Creating event network-vif-unplugged:7208a5cc-9906-471a-9f0a-9f7b31850c26 for instance ed0a13ab-993e-497e-8565-47790e0d5721 on n-h1-854441-12 Oct 17 15:29:27.126392 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-34a9f807-65bd-4c35-8c65-e97105d3c686 req-4657614f-c3ca-4914-a52d-c4d812041a05 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059579 Oct 17 15:29:27.127617 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1060/1975] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:27.134984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e24ca6a-04d6-4a0c-bf05-fc4268600e44 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:27.135802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e24ca6a-04d6-4a0c-bf05-fc4268600e44 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:27.143167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e24ca6a-04d6-4a0c-bf05-fc4268600e44 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.144234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e24ca6a-04d6-4a0c-bf05-fc4268600e44 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.144853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e24ca6a-04d6-4a0c-bf05-fc4268600e44 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.146162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e24ca6a-04d6-4a0c-bf05-fc4268600e44 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.146822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e24ca6a-04d6-4a0c-bf05-fc4268600e44 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.147734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e24ca6a-04d6-4a0c-bf05-fc4268600e44 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.176083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:27.191194 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-901637ed-bae0-41ce-9f64-896047fbf8a4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 0.362804 Oct 17 15:29:27.191792 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 916/1976] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:26 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:27.196624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:27.197235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:27.215827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.216225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.216707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.218066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.218552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.218990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.267121 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e24ca6a-04d6-4a0c-bf05-fc4268600e44 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6/action" status: 202 len: 0 microversion: 2.25 time: 0.137529 Oct 17 15:29:27.271784 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1061/1977] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:29:27 2022] POST /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:29:27.274975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:27.276039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:27.284014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.284507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.284949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.286368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.287334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.288228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.561486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:27.571149 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-da917614-9acf-4689-9faf-4de32daa3da5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.378092 Oct 17 15:29:27.571758 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 917/1978] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:27 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:27.589664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:27.590193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:27.604691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.605274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.608454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.611054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.611558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.612004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.716713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:27.730469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:27.734521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:27.744488 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-857ed2cc-9430-4faa-94d1-3bc665e9102c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1416 microversion: 2.75 time: 0.171236 Oct 17 15:29:27.759412 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 918/1979] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:27 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1416 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:27.768561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:27.768561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:27.785385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.788274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.789323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.790484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.791051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.791564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.911232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:27.923544 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64017216-ef58-4a1c-aca0-468e6a419ca5 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1197 microversion: 2.1 time: 0.653538 Oct 17 15:29:27.924714 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1062/1980] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:27 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1197 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:27.929648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:27.930480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:27.947221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.947737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.948251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:27.948968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:27.949414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:27.949843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.019028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:28.029928 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6ed661bc-8750-4f8a-929d-f69a0a4969f6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1211 microversion: 2.1 time: 0.277009 Oct 17 15:29:28.047601 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 919/1981] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:27 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1211 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:28.071155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:28.071875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:28.089392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.090255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.094356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.095405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.096072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.096683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.181076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 2515b31b-3d10-40b2-a11a-e89640d4c8d6 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:28.200222 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-320e7646-6317-4caa-8e5f-3a3e62de92b3 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 2055 microversion: 2.25 time: 0.274243 Oct 17 15:29:28.201279 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1063/1982] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:27 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 2055 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:28.226080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:28.227118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:28.229439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:28.238323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.239217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.240166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.241061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.241681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.242347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.507935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:28.517714 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56146f00-e8a6-425b-bce5-56a2be1a24e1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 0.295453 Oct 17 15:29:28.530531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1064/1983] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:28 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:28.594566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:28.595517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:28.602823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.603710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.604407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.605422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.606110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.606802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.678158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:28.689121 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d503797f-6330-40a2-97eb-03cda51b0c6b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1316 microversion: 2.1 time: 0.629275 Oct 17 15:29:28.706717 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 920/1984] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:28 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:28.778171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:28.778935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:28.780252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:28.789631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.790169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.790966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.791896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.794321 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4edcff0-ee7c-467a-ab87-45c2271d8fec tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.203530 Oct 17 15:29:28.810157 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1065/1985] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:28 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:28.810778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.811563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.946300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:28.947148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:28.969215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.979457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.980498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:28.981405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:28.982238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:28.982826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.231674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:29.240720 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95dca34c-5b5f-46da-806f-43f7b7f8c928 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1197 microversion: 2.1 time: 0.298621 Oct 17 15:29:29.241736 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1066/1986] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:28 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1197 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:29.247705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:29.248708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:29.255952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.256989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.257673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.258876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.259295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.259812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.330925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:29.333673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:29.344086 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13a72d6c-b0d4-4bbf-bfcf-d2116cdfcaee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1259 microversion: 2.1 time: 0.099940 Oct 17 15:29:29.345145 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1067/1987] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:29 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1259 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:29.370401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:29.375084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:29.385719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.386805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.387541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.391350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.391850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.392301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.467229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:29.485545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:29.488839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:29.497707 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7070faa-8bd6-48a7-8d5a-4ff18d15e855 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1437 microversion: 2.75 time: 0.724304 Oct 17 15:29:29.500284 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 921/1988] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:28 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1437 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:29.529965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:29.533302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:29.543633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.544756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.549906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.550769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 2515b31b-3d10-40b2-a11a-e89640d4c8d6 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:29.551244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.551725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.552148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.600676 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1cdb6f20-0c5d-446c-b32c-101ab2c51420 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 2035 microversion: 2.25 time: 0.243549 Oct 17 15:29:29.602083 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1068/1989] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:29 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 2035 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:29.623149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:29.625336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:29.667712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.669548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.670920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.672452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.673521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.674608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.718768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:29.719169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:29.723019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:29.725494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:29.726211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:29.849653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:29.856942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.857867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.858385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.859191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:29.859724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:29.860220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:29.966600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:29.989163 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5ce93a9-77db-4444-9856-56390389a184 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 0.384719 Oct 17 15:29:30.007725 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1069/1990] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:29 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:30.013844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854441-12", "block_migration": "auto"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:30.017612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:30.025053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:30.025425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:30.026230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:30.026711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:30.027368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:30.027779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:30.056205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'flavor' on Instance uuid 2515b31b-3d10-40b2-a11a-e89640d4c8d6 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:30.072291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Going to try to live migrate instance to n-h2-854441-12 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 15:29:30.101405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:30.117108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:30.120577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:30.145126 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-18590dfa-5d8b-4e89-8548-ef7c907d6a39 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "POST /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9/action" status: 202 len: 1494 microversion: 2.75 time: 0.620146 Oct 17 15:29:30.173898 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 922/1991] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:29:29 2022] POST /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9/action => generated 1494 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 17 15:29:30.182198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:30.183439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:30.190987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:30.191484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:30.191916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:30.192625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:30.193074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:30.193495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:30.862582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:30.874622 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97638700-52d8-403a-83ee-4834e15095f6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1316 microversion: 2.1 time: 0.699506 Oct 17 15:29:30.895373 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 923/1992] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:30 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1316 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:30.902832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:30.903797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:30.912032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:30.913367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:30.914030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:30.915155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:30.915478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:30.915911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:31.529869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:31.541202 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61255f87-c5c7-464a-aebb-6ec814c300b9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.643975 Oct 17 15:29:31.541805 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 924/1993] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:30 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:31.547562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:31.548370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:31.554782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:31.555526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:31.555712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:31.556926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:31.557413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:31.557842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:31.758101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:31.768742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:31.770967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:31.783598 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-93347558-d338-4c1a-84ef-2f29a61be690 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.240131 Oct 17 15:29:31.785802 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 925/1994] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:31 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:31.792371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:31.793246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:31.800138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:31.800710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:31.801084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:31.801933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:31.802348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:31.802833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:32.653432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:32.684517 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a37720a4-b80a-471c-92fb-6973a30b9408 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1197 microversion: 2.1 time: 0.897241 Oct 17 15:29:32.689910 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 926/1995] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:31 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1197 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:32.714956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:32.715609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:32.728150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:32.728893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:32.729549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:32.731747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:32.734468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:32.735235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:32.793299 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8dc6173d-836a-44af-872f-7e604dcee2e6 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6/action" status: 202 len: 0 microversion: 2.25 time: 2.783736 Oct 17 15:29:32.795829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1070/1996] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:29:30 2022] POST /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6/action => generated 0 bytes in 2787 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:29:32.801734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c67c881c-2ae7-42ca-bd4e-07cab7a3c328 req-09e76149-7378-4038-a1a0-2e6a93b36647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66521d3-f3e0-4388-b5ae-f39088b065ec", "name": "network-vif-plugged", "status": "completed", "tag": "1d6bd306-d555-465b-8af6-0d1f836e7963"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:32.844904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c67c881c-2ae7-42ca-bd4e-07cab7a3c328 req-09e76149-7378-4038-a1a0-2e6a93b36647 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:32.846048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c67c881c-2ae7-42ca-bd4e-07cab7a3c328 req-09e76149-7378-4038-a1a0-2e6a93b36647 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:32.847774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c67c881c-2ae7-42ca-bd4e-07cab7a3c328 req-09e76149-7378-4038-a1a0-2e6a93b36647 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:32.865273 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c67c881c-2ae7-42ca-bd4e-07cab7a3c328 req-09e76149-7378-4038-a1a0-2e6a93b36647 service nova] Creating event network-vif-plugged:1d6bd306-d555-465b-8af6-0d1f836e7963 for instance d66521d3-f3e0-4388-b5ae-f39088b065ec on n-h2-854441-12 Oct 17 15:29:32.891842 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c67c881c-2ae7-42ca-bd4e-07cab7a3c328 req-09e76149-7378-4038-a1a0-2e6a93b36647 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094182 Oct 17 15:29:32.893853 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1071/1997] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:32.902330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:32.909847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:32.923655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:32.924541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:32.924993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:32.925732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:32.933028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:32.934264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.034445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.063376 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-866a93b9-3ea1-4708-af19-b7085a11584d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1265 microversion: 2.1 time: 0.367987 Oct 17 15:29:33.065332 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 927/1998] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:32 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:33.106245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:33.106898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:33.136618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.137108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.147787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.148660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.149382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.150129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.150975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:33.236653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.248242 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b6d826d-1eb6-4a3a-80aa-5bfc2912d81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 0.350549 Oct 17 15:29:33.263895 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1072/1999] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:32 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:33.266328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-145875de-9c0d-4d67-9fab-e4179707d657 req-d67f7f52-6444-4883-9867-1701fd50a97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0a13ab-993e-497e-8565-47790e0d5721", "name": "network-vif-deleted", "tag": "7208a5cc-9906-471a-9f0a-9f7b31850c26"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:33.300360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-145875de-9c0d-4d67-9fab-e4179707d657 req-d67f7f52-6444-4883-9867-1701fd50a97b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.301083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-145875de-9c0d-4d67-9fab-e4179707d657 req-d67f7f52-6444-4883-9867-1701fd50a97b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.301708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-145875de-9c0d-4d67-9fab-e4179707d657 req-d67f7f52-6444-4883-9867-1701fd50a97b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.325502 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-145875de-9c0d-4d67-9fab-e4179707d657 req-d67f7f52-6444-4883-9867-1701fd50a97b service nova] Creating event network-vif-deleted:7208a5cc-9906-471a-9f0a-9f7b31850c26 for instance ed0a13ab-993e-497e-8565-47790e0d5721 on n-h1-854441-12 Oct 17 15:29:33.336388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-145875de-9c0d-4d67-9fab-e4179707d657 req-d67f7f52-6444-4883-9867-1701fd50a97b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086237 Oct 17 15:29:33.339752 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1073/2000] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:33.346635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:33.347805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:33.355575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.356583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.357245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.358447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.359159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.359901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.669194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.674873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.677702 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b85b60fe-4c32-4aa8-8400-25f42faff095 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.335554 Oct 17 15:29:33.690557 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1074/2001] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:33 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:33.695696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:33.696290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:33.699922 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9af7d4ac-5218-4ac0-b531-006509cd8313 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1316 microversion: 2.1 time: 0.632162 Oct 17 15:29:33.711277 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 928/2002] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:33 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:33.711277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:33.711277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:33.712634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.713127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.713756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.714737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.715395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.715786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.731711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.735107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.735802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.738286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.739297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.740487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.890219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.900468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.902800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.914065 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8e19fcc2-3c0a-4f78-9ab6-54cd94c5fde3 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.211845 Oct 17 15:29:33.914962 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 929/2003] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:33 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:33.920496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:33.923172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:33.930390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.931151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.931741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.932804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:33.933613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:33.934321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:33.956831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.971001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.972868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:33.974079 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a6fa425b-2048-4b6b-a0d7-796e3ec534f0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1566 microversion: 2.25 time: 0.282430 Oct 17 15:29:33.975782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:33.979013 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1075/2004] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:33 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1566 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:34.097408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:34.098238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:34.105923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:34.106751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:34.107366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:34.108463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:34.109331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:34.110555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:34.345823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:34.358223 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ffbf5dc1-44f6-44f8-871e-ac7b43dc325a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1307 microversion: 2.1 time: 0.265811 Oct 17 15:29:34.376030 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1076/2005] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:34 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:34.385982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:34.386774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:34.393201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:34.393766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:34.394259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:34.395671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:34.396194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:34.397143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:34.408637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:34.418752 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-db1b7582-b303-416a-b8db-f223da2af678 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1197 microversion: 2.1 time: 0.501797 Oct 17 15:29:34.423989 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 930/2006] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:33 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1197 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:34.703125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:34.704622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:34.714922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:34.716006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:34.719677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:34.724071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:34.727601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:34.728089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:34.728535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:34.734125 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c5a73a1-c4f1-48ce-8694-178d048c4a8a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1314 microversion: 2.1 time: 0.356711 Oct 17 15:29:34.735171 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1077/2007] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:34 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:34.742153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:34.744036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:34.759613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:34.763216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:34.764168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:34.765596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:34.766227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:34.766850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.004117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:35.007434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:35.015788 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-41f17ac9-1f65-4220-ae11-61da5baba440 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1316 microversion: 2.1 time: 0.279384 Oct 17 15:29:35.032028 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1078/2008] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:34 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:35.033779 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f5019aa0-7840-40a9-8963-7372ab7d90ea tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.335923 Oct 17 15:29:35.046532 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 931/2009] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:34 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:35.046779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:35.046779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:35.046779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.046779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.046779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.046779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.047377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.047753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.053919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-bf7041f9-6291-4068-b313-55dd2d174a86 req-3a5a9248-600a-4db6-83d6-76e9512165dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f10878-2fa0-4b9b-9b65-b296e034dc8d", "name": "network-vif-plugged", "status": "completed", "tag": "815c8333-ad3a-4336-b460-1c7a5b419ace"}, {"server_uuid": "66189c64-70e7-4ec5-a3be-20b06e23940d", "name": "network-vif-plugged", "status": "completed", "tag": "dad068f7-eefd-42f9-96bb-8092defb7bcf"}, {"server_uuid": "efaed5c1-00db-49f6-b605-36e008e852ce", "name": "network-vif-plugged", "status": "completed", "tag": "cba2595d-0e84-4461-92a6-9374671ead7b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:35.075693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf7041f9-6291-4068-b313-55dd2d174a86 req-3a5a9248-600a-4db6-83d6-76e9512165dc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.076186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf7041f9-6291-4068-b313-55dd2d174a86 req-3a5a9248-600a-4db6-83d6-76e9512165dc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.076614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf7041f9-6291-4068-b313-55dd2d174a86 req-3a5a9248-600a-4db6-83d6-76e9512165dc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.121979 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bf7041f9-6291-4068-b313-55dd2d174a86 req-3a5a9248-600a-4db6-83d6-76e9512165dc service nova] Creating event network-vif-plugged:815c8333-ad3a-4336-b460-1c7a5b419ace for instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d on n-h1-854441-12 Oct 17 15:29:35.122488 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bf7041f9-6291-4068-b313-55dd2d174a86 req-3a5a9248-600a-4db6-83d6-76e9512165dc service nova] Creating event network-vif-plugged:dad068f7-eefd-42f9-96bb-8092defb7bcf for instance 66189c64-70e7-4ec5-a3be-20b06e23940d on n-h2-854441-12 Oct 17 15:29:35.123007 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bf7041f9-6291-4068-b313-55dd2d174a86 req-3a5a9248-600a-4db6-83d6-76e9512165dc service nova] Creating event network-vif-plugged:cba2595d-0e84-4461-92a6-9374671ead7b for instance efaed5c1-00db-49f6-b605-36e008e852ce on n-h1-854441-12 Oct 17 15:29:35.153318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-bf7041f9-6291-4068-b313-55dd2d174a86 req-3a5a9248-600a-4db6-83d6-76e9512165dc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.117101 Oct 17 15:29:35.153940 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 932/2010] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:35.178173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:35.180698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:35.192746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.193671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.193815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.198538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.199481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.199670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.259635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:35.270045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:35.291345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:35.319094 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f17bb29d-dc13-4cdf-a636-79f71ee31b89 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.284933 Oct 17 15:29:35.320921 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1079/2011] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:35 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:35.388281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:35.388895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:35.410909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.411414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.411848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.417894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.418547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.418983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.723393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:35.733469 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-060510b1-68c4-4b1a-97d7-5af2a4a3261d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1307 microversion: 2.1 time: 0.349322 Oct 17 15:29:35.739636 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1080/2012] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:35 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1307 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:35.750798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:35.763420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:35.778658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.779655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.780947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.784122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.797527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.800959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:35.909445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:35.921718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:35.924497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:35.928807 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c11317c-71ad-47ea-8e5a-52fc28b644d2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1566 microversion: 2.25 time: 0.763656 Oct 17 15:29:35.942709 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 933/2013] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:35 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1566 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:35.961220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c3a87408-8c11-4200-a774-27a20acea515 req-4417d174-59d4-4cf6-86c4-7e3370b711ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c186d0-403a-49cd-94fc-cfa45e6b5170", "tag": "58b69e6c-3036-4516-ba10-49aa3cb3f009"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:35.975348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c3a87408-8c11-4200-a774-27a20acea515 req-4417d174-59d4-4cf6-86c4-7e3370b711ce service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:35.976104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c3a87408-8c11-4200-a774-27a20acea515 req-4417d174-59d4-4cf6-86c4-7e3370b711ce service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:35.976993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c3a87408-8c11-4200-a774-27a20acea515 req-4417d174-59d4-4cf6-86c4-7e3370b711ce service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.000333 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c3a87408-8c11-4200-a774-27a20acea515 req-4417d174-59d4-4cf6-86c4-7e3370b711ce service nova] Creating event network-changed:58b69e6c-3036-4516-ba10-49aa3cb3f009 for instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 on n-h1-854441-12 Oct 17 15:29:36.007576 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c3a87408-8c11-4200-a774-27a20acea515 req-4417d174-59d4-4cf6-86c4-7e3370b711ce service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061204 Oct 17 15:29:36.008354 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 934/2014] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:36.016222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-4c26ef62-5163-4e53-9314-59a4f74524f4 req-f82a1a68-f189-4292-a38f-dac79207f2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2515b31b-3d10-40b2-a11a-e89640d4c8d6", "name": "network-vif-unplugged", "status": "completed", "tag": "161227d2-c2ea-4581-a464-7d890b9c52af"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:36.031718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4c26ef62-5163-4e53-9314-59a4f74524f4 req-f82a1a68-f189-4292-a38f-dac79207f2fa service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.032300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4c26ef62-5163-4e53-9314-59a4f74524f4 req-f82a1a68-f189-4292-a38f-dac79207f2fa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.032805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4c26ef62-5163-4e53-9314-59a4f74524f4 req-f82a1a68-f189-4292-a38f-dac79207f2fa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.047640 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-4c26ef62-5163-4e53-9314-59a4f74524f4 req-f82a1a68-f189-4292-a38f-dac79207f2fa service nova] Creating event network-vif-unplugged:161227d2-c2ea-4581-a464-7d890b9c52af for instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 on n-h1-854441-12 Oct 17 15:29:36.054904 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-4c26ef62-5163-4e53-9314-59a4f74524f4 req-f82a1a68-f189-4292-a38f-dac79207f2fa service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043043 Oct 17 15:29:36.056338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 935/2015] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:36.062493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:36.063285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:36.070884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.071467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.072211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.073222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.074444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.075339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.192164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:36.201220 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c41c004e-5bbc-41e2-8643-75fbd7048052 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1197 microversion: 2.1 time: 0.460169 Oct 17 15:29:36.219172 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1081/2016] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:35 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1197 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:36.234800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:36.234800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:36.248479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.249352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.249499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.258109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.258333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.258681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.308286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:36.323268 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1217b4cf-db0d-4439-ab63-f3f52c3a8614 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1502 microversion: 2.1 time: 0.265027 Oct 17 15:29:36.323949 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 936/2017] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:36 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:36.344625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:36.348725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:36.374566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.376727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.379884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.385493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.386594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.388037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.441977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:36.546834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:36.560519 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9568c896-c51c-4924-8260-4d07b32c8d57 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1316 microversion: 2.1 time: 0.340085 Oct 17 15:29:36.561131 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1082/2018] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:36 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:36.580480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:36.580959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:36.594613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.595184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.595625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.596334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.596781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.597201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.624100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:36.635110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:29:36.711314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:36.725334 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b69ff6a-4204-4e81-be1e-97747549b8a5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1325 microversion: 2.1 time: 0.388198 Oct 17 15:29:36.726253 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 937/2019] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:36 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1325 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:36.733350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:36.734426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:36.754097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.755183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.755943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.756774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.757815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.761729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.785026 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e42fe06-50fc-44a4-bab8-4fd647cd157c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 204 len: 0 microversion: 2.1 time: 0.218296 Oct 17 15:29:36.785973 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1083/2020] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:29:36 2022] DELETE /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:29:36.792469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:36.793772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:36.811060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.812670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.813316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.814365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.815034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.815631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.891760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:36.907510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:36.911093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:36.920789 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4b0b6456-5d0f-40ea-8485-0cc24d261cac tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.192822 Oct 17 15:29:36.921737 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 938/2021] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:36 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:36.927600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:36.928312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:36.941804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.942538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.943563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.944864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:36.945928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:36.946591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:36.950439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:36.973423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:37.027813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:37.039946 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1dad261a-e8fe-43a9-b080-90357778bdf0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1307 microversion: 2.1 time: 0.252424 Oct 17 15:29:37.040871 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1084/2022] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:36 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1307 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:37.047864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:37.048756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:37.054810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.055520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.056195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.057093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.057623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.058307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.214327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:37.222939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:37.224858 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-39044015-d84d-4d36-8f7f-e23cbe0ac63f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1508 microversion: 2.1 time: 0.301228 Oct 17 15:29:37.234618 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 939/2023] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:36 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:37.242855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:37.244343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:37.245839 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69e23830-7ec5-4030-96df-f438ce1c2482 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1566 microversion: 2.25 time: 0.203728 Oct 17 15:29:37.246754 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1085/2024] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:37 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:37.248881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:37.249552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:37.258839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.259398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.259971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.261138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.261588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.262008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.426052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:37.435644 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5b58297-16ae-4d01-ae43-0d2c7f4c6596 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1197 microversion: 2.1 time: 0.195472 Oct 17 15:29:37.436280 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 940/2025] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:37 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:37.588869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:37.589506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:37.600234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.601453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.602079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.603472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.604130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.604723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.758643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:37.760301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:37.783388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:37.784319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.785165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.785901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.787433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.787928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.788608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.795563 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55dc311f-80a8-49da-9ca6-4748e953e95b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1505 microversion: 2.1 time: 0.210773 Oct 17 15:29:37.811387 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1086/2026] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:37 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:37.819259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:37.820044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:37.827228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.827828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.828316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.829084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.829619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.830122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.945148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:37.953547 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-369f287a-9a18-4cd8-95e5-3a3583b3bee8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1522 microversion: 2.1 time: 0.205401 Oct 17 15:29:37.954475 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 941/2027] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:37 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:37.959327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:37.960197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:37.966882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.967385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.967820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.968525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:37.969264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:37.969688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:37.985366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:37.995280 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0ea0049-1d9c-450a-a55a-73edd31923a2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1505 microversion: 2.1 time: 0.179974 Oct 17 15:29:37.998549 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1087/2028] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:37 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:38.000705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:38.001327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:38.018099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.018862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.019372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.020142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.020660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.021158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.042859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.052286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.054247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.077125 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-48e8fcf5-4d1c-4119-bc54-02895d5bbcc6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.121549 Oct 17 15:29:38.078235 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 942/2029] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:37 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:38.083100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4aa334d4-0005-48e6-98af-84cff2d2f20b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:38.087307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4aa334d4-0005-48e6-98af-84cff2d2f20b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:38.094210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa334d4-0005-48e6-98af-84cff2d2f20b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.094835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa334d4-0005-48e6-98af-84cff2d2f20b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.095255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa334d4-0005-48e6-98af-84cff2d2f20b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.096238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa334d4-0005-48e6-98af-84cff2d2f20b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.096576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa334d4-0005-48e6-98af-84cff2d2f20b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.097041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa334d4-0005-48e6-98af-84cff2d2f20b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.186179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.195873 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f679858-6d50-4135-8994-a56a53bb71eb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1522 microversion: 2.1 time: 0.198674 Oct 17 15:29:38.197171 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1088/2030] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:37 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:38.200196 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4aa334d4-0005-48e6-98af-84cff2d2f20b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "PUT /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1077 microversion: 2.1 time: 0.120646 Oct 17 15:29:38.200939 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 943/2031] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 15:29:38 2022] PUT /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1077 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:38.203495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:38.204399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:38.207485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e560cbc2-9554-4263-bcd7-c226472f138b req-01027609-6626-4f58-8389-2c8291974960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2515b31b-3d10-40b2-a11a-e89640d4c8d6", "tag": "161227d2-c2ea-4581-a464-7d890b9c52af"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:38.212337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.213363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.214250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.215234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.215809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.216314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.222224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e560cbc2-9554-4263-bcd7-c226472f138b req-01027609-6626-4f58-8389-2c8291974960 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.223181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e560cbc2-9554-4263-bcd7-c226472f138b req-01027609-6626-4f58-8389-2c8291974960 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.223779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e560cbc2-9554-4263-bcd7-c226472f138b req-01027609-6626-4f58-8389-2c8291974960 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.237210 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e560cbc2-9554-4263-bcd7-c226472f138b req-01027609-6626-4f58-8389-2c8291974960 service nova] Creating event network-changed:161227d2-c2ea-4581-a464-7d890b9c52af for instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 on n-h1-854441-12 Oct 17 15:29:38.243061 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e560cbc2-9554-4263-bcd7-c226472f138b req-01027609-6626-4f58-8389-2c8291974960 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040833 Oct 17 15:29:38.243900 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 944/2032] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:38.252250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d15e7af4-36d3-40db-9f63-4339f7d9f40a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1416508918"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:38.260801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d15e7af4-36d3-40db-9f63-4339f7d9f40a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:38.269797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15e7af4-36d3-40db-9f63-4339f7d9f40a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.270377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15e7af4-36d3-40db-9f63-4339f7d9f40a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.270844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15e7af4-36d3-40db-9f63-4339f7d9f40a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.271636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15e7af4-36d3-40db-9f63-4339f7d9f40a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.272101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15e7af4-36d3-40db-9f63-4339f7d9f40a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.272517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15e7af4-36d3-40db-9f63-4339f7d9f40a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.372689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.381959 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1268f6a1-1915-423a-a09e-9c59fd3737ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1307 microversion: 2.1 time: 0.183236 Oct 17 15:29:38.386548 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1089/2033] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:38 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:38.387814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:38.388773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:38.395109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.395844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.396497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.397410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.398115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.398879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.543460 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d15e7af4-36d3-40db-9f63-4339f7d9f40a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d/action" status: 202 len: 0 microversion: 2.1 time: 0.297959 Oct 17 15:29:38.544558 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 945/2034] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:29:38 2022] POST /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:29:38.550038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:38.551712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:38.558209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.558734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.559160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.560075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.560689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.561283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.564791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.574199 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac4422a3-fcaa-4738-93c2-90f4207a26a8 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1503 microversion: 2.1 time: 0.190058 Oct 17 15:29:38.588800 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1090/2035] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:38 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:38.595818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:38.596698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:38.603614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.604153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.604868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.605733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.606342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.606944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.769602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.779620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.781452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.783757 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a502e68e-0de9-44a0-ba59-5c778b114f60 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1566 microversion: 2.25 time: 0.193628 Oct 17 15:29:38.795945 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1091/2036] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:38 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:38.810933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:38.811557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:38.819286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.819286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.820396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.821214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:38.821679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:38.822183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:38.901305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:38.913001 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-04628829-ad6a-4b53-8f07-edb1a22d0fbb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1508 microversion: 2.1 time: 0.366832 Oct 17 15:29:38.915045 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 946/2037] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:38 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:38.924739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a4e3746-a069-4d82-822a-12e0003d3624 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '.version_select at 0x7f28c2eaa3a0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:39.007122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:39.015906 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e658fdd9-f3f4-467d-b9d8-ef93bbc0d227 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1380 microversion: 2.1 time: 0.218759 Oct 17 15:29:39.016793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1092/2038] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:38 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1380 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:39.021271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:39.021890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:39.028041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.028528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.028967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.029670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.030133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.030570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.121707 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a4e3746-a069-4d82-822a-12e0003d3624 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/images/79cc02b0-bb1f-49b4-9632-dae1eab436ca" status: 204 len: 0 microversion: 2.1 time: 0.204678 Oct 17 15:29:39.123094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 947/2039] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:38 2022] DELETE /compute/v2.1/images/79cc02b0-bb1f-49b4-9632-dae1eab436ca => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:29:39.277161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:39.290120 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-334b351f-e9fb-4507-ae88-76d52442e680 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1503 microversion: 2.1 time: 0.270978 Oct 17 15:29:39.290810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aea187b1-01ba-4b82-a8a7-030740d6e760 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:39.291618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aea187b1-01ba-4b82-a8a7-030740d6e760 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:39.293701 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1093/2040] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:39 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:39.299475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea187b1-01ba-4b82-a8a7-030740d6e760 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.300252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea187b1-01ba-4b82-a8a7-030740d6e760 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.301379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea187b1-01ba-4b82-a8a7-030740d6e760 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.302026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:39.302583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea187b1-01ba-4b82-a8a7-030740d6e760 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.303041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:39.303706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea187b1-01ba-4b82-a8a7-030740d6e760 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.304509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea187b1-01ba-4b82-a8a7-030740d6e760 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.321863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.325104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.325557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.326942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.326942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.327251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.424156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:39.442224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:39.443461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:39.450092 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad4ba458-7213-4b7b-856a-4e631f23937c tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.155299 Oct 17 15:29:39.451001 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1094/2041] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:39 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:39.465671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccb4ed7f-1800-4be6-83c1-bc98ceb87c22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '.version_select at 0x7f28c2f23430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:39.503117 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ccb4ed7f-1800-4be6-83c1-bc98ceb87c22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Image not found. Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccb4ed7f-1800-4be6-83c1-bc98ceb87c22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/images/79cc02b0-bb1f-49b4-9632-dae1eab436ca HTTP/1.1 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: exception: Image not found. Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '79cc02b0-bb1f-49b4-9632-dae1eab436ca'} Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 79cc02b0-bb1f-49b4-9632-dae1eab436ca Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:29:39.506411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 79cc02b0-bb1f-49b4-9632-dae1eab436ca could not be found. Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccb4ed7f-1800-4be6-83c1-bc98ceb87c22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ccb4ed7f-1800-4be6-83c1-bc98ceb87c22 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/images/79cc02b0-bb1f-49b4-9632-dae1eab436ca" status: 404 len: 62 microversion: 2.1 time: 0.048491 Oct 17 15:29:39.512324 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1095/2042] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:39 2022] GET /compute/v2.1/images/79cc02b0-bb1f-49b4-9632-dae1eab436ca => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:29:39.516243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:39.525626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:39.544362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.544862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.545297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.546041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.546530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.546979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.653346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:39.654107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:39.654818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:39.655403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:39.656012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:39.768298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:39.790223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.793173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.793682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.798485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.799167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.800197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.903867 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33e427d5-ee0c-437d-bb20-7f3f16e482cf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "POST /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce/action" status: 202 len: 1109 microversion: 2.1 time: 0.393762 Oct 17 15:29:39.919077 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1096/2043] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:29:39 2022] POST /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce/action => generated 1109 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 15:29:39.919077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:39.919077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:39.945526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.945963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.946452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.947153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:39.947610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:39.948034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:39.989851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:40.113290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:40.121750 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aea187b1-01ba-4b82-a8a7-030740d6e760 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1533 microversion: 2.1 time: 0.997213 Oct 17 15:29:40.134021 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 948/2044] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:39 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1533 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:40.141393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:40.142428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:40.153044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.154764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.155685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.156652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.157275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.158039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.272606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:40.284255 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b6bd396-2772-4026-8778-dcabe7672621 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1307 microversion: 2.1 time: 0.378520 Oct 17 15:29:40.285465 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1097/2045] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:39 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1307 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:40.295426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:40.296323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:40.304376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.304883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.305316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.306028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.306479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.306939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.509305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:40.519997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:40.522057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:40.523721 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be80a6bc-c869-4104-9250-b364398997e2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1566 microversion: 2.25 time: 0.236946 Oct 17 15:29:40.537632 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1098/2046] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:40 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:40.544239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:40.545513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:40.555329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.555926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.556603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.558173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.558867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.559489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.572964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:40.610113 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1e4bf774-65d9-4ea6-91ae-3be76640bf75 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1540 microversion: 2.1 time: 0.474139 Oct 17 15:29:40.611857 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 949/2047] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:40 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1540 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:40.625093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:40.626242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:40.640602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.641499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.642531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.643515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.644334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.645694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.743525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.744752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.745756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.746858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lazy-loading 'fault' on Instance uuid d66521d3-f3e0-4388-b5ae-f39088b065ec {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:40.806103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:40.815050 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-803d84a6-aa86-4265-9704-b73fa22ea383 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 200 len: 1304 microversion: 2.1 time: 0.201474 Oct 17 15:29:40.815905 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 950/2048] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:40 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 1304 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:40.831983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bfc40425-fd96-4819-b10e-b776e2fa06e0 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:40.833028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bfc40425-fd96-4819-b10e-b776e2fa06e0 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:40.840341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfc40425-fd96-4819-b10e-b776e2fa06e0 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.841097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfc40425-fd96-4819-b10e-b776e2fa06e0 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.841421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:40.841577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfc40425-fd96-4819-b10e-b776e2fa06e0 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.842218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfc40425-fd96-4819-b10e-b776e2fa06e0 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.842713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfc40425-fd96-4819-b10e-b776e2fa06e0 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.843140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfc40425-fd96-4819-b10e-b776e2fa06e0 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.850607 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9cf4284a-30ff-480a-83c2-eb0cfca07472 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.311485 Oct 17 15:29:40.851819 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1099/2049] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:40 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:40.856737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bdf41d18-a19d-40a8-9b4d-ce649ae2137a req-715471cf-b0eb-4882-9037-50cd849a4499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66521d3-f3e0-4388-b5ae-f39088b065ec", "name": "network-vif-deleted", "tag": "1d6bd306-d555-465b-8af6-0d1f836e7963"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:40.868314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bdf41d18-a19d-40a8-9b4d-ce649ae2137a req-715471cf-b0eb-4882-9037-50cd849a4499 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.868796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bdf41d18-a19d-40a8-9b4d-ce649ae2137a req-715471cf-b0eb-4882-9037-50cd849a4499 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.869505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bdf41d18-a19d-40a8-9b4d-ce649ae2137a req-715471cf-b0eb-4882-9037-50cd849a4499 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.882919 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bdf41d18-a19d-40a8-9b4d-ce649ae2137a req-715471cf-b0eb-4882-9037-50cd849a4499 service nova] Creating event network-vif-deleted:1d6bd306-d555-465b-8af6-0d1f836e7963 for instance d66521d3-f3e0-4388-b5ae-f39088b065ec on n-h2-854441-12 Oct 17 15:29:40.888351 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bdf41d18-a19d-40a8-9b4d-ce649ae2137a req-715471cf-b0eb-4882-9037-50cd849a4499 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035227 Oct 17 15:29:40.889310 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1100/2050] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:40.894934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:40.895622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:40.902003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.902484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.902933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.903632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:40.904079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:40.904516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:40.979928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:40.991859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:40.999857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:41.005338 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bfc40425-fd96-4819-b10e-b776e2fa06e0 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1533 microversion: 2.1 time: 0.176832 Oct 17 15:29:41.007982 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94a35b1b-a148-45c8-a018-13a59bad3323 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.117463 Oct 17 15:29:41.010563 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1101/2051] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:40 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:41.016292 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 951/2052] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:40 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1533 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:41.029129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c68efb1-d51c-4fc6-a7f6-60f36d05ff5e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:41.033488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c68efb1-d51c-4fc6-a7f6-60f36d05ff5e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.034168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c68efb1-d51c-4fc6-a7f6-60f36d05ff5e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.035264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c68efb1-d51c-4fc6-a7f6-60f36d05ff5e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.035467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c68efb1-d51c-4fc6-a7f6-60f36d05ff5e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.035916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c68efb1-d51c-4fc6-a7f6-60f36d05ff5e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.036327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c68efb1-d51c-4fc6-a7f6-60f36d05ff5e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.062231 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c68efb1-d51c-4fc6-a7f6-60f36d05ff5e tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.036961 Oct 17 15:29:41.063037 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1102/2053] 10.222.0.87 () {58 vars in 1176 bytes} [Mon Oct 17 15:29:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:41.077961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854441-12", "block_migration": false, "disk_over_commit": false}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:41.080860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:41.089563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.090664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.091249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.092046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.092677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.095185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.120781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lazy-loading 'flavor' on Instance uuid 66189c64-70e7-4ec5-a3be-20b06e23940d {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:41.136140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Going to try to live migrate instance to n-h1-854441-12 {{(pid=120407) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 15:29:41.310003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:41.311060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:41.321560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.322297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.323567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.324513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.325327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.325823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.493736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:41.507773 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-721857a4-f82d-4969-abaa-3bcbb1dbf8c7 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1307 microversion: 2.1 time: 0.202045 Oct 17 15:29:41.508528 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1103/2054] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:41 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1307 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:41.549207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:41.549873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:41.561845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.562280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.562737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.563438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.563960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.564577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.745936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:41.759802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:41.761687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:41.763533 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ead5e4a-81e5-4b59-b6a6-89ba3a359aa9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1566 microversion: 2.25 time: 0.218289 Oct 17 15:29:41.764819 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1104/2055] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:41 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:41.787297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:41.788246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:41.790554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:41.797142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.797627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.798058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.798778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:41.799225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:41.799638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:41.973985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:41.998816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fef85f38-c1f2-4147-86e8-6b94db761c1b tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1540 microversion: 2.1 time: 0.231591 Oct 17 15:29:42.000436 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1105/2056] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:41 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1540 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:42.007337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:42.009614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:42.024488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:42.024997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:42.025447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:42.026160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:42.026875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:42.027308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:42.043094 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec HTTP/1.1 Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'd66521d3-f3e0-4388-b5ae-f39088b065ec'} Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:42.046539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3ecc3ee-2131-41d8-8afa-bace8e9639c2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 404 len: 111 microversion: 2.1 time: 0.045701 Oct 17 15:29:42.052093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1106/2057] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:42 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:29:42.068341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:42.069025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:42.088666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:42.089363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:42.089928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:42.090888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:42.091411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:42.091896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:42.431661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:42.444213 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91a195bf-9ec3-4e04-b889-719b2831c34c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.394922 Oct 17 15:29:42.445008 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1107/2058] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:42 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:42.454632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:42.455260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:42.474218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:42.475797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:42.476855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:42.478364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:42.479807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:42.480700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:42.617858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:42.630603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:42.638581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:42.656467 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e40fe41b-93ab-4dc3-a621-2a4c8019caee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.204401 Oct 17 15:29:42.677155 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1108/2059] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:42 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:42.692736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-311699042", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "fbf48d23-b6f0-48de-b73a-9c8aad4ee168"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:42.783891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] validate_networks() for [('fbf48d23-b6f0-48de-b73a-9c8aad4ee168', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:29:42.805554 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-39997fe7-2c4f-4de2-8e71-15ddd3e5ebc1 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d/action" status: 202 len: 0 microversion: 2.1 time: 1.731402 Oct 17 15:29:42.806585 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 952/2060] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:29:41 2022] POST /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d/action => generated 0 bytes in 1736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:29:42.813870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a7203119-026c-472f-aa34-924006035ca6 req-7aba81ed-accc-454b-982d-e6d22d8e8fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c186d0-403a-49cd-94fc-cfa45e6b5170", "name": "network-vif-plugged", "status": "completed", "tag": "58b69e6c-3036-4516-ba10-49aa3cb3f009"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:42.833366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:42.842275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a7203119-026c-472f-aa34-924006035ca6 req-7aba81ed-accc-454b-982d-e6d22d8e8fac service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:42.844122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a7203119-026c-472f-aa34-924006035ca6 req-7aba81ed-accc-454b-982d-e6d22d8e8fac service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:42.844921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a7203119-026c-472f-aa34-924006035ca6 req-7aba81ed-accc-454b-982d-e6d22d8e8fac service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:42.892668 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a7203119-026c-472f-aa34-924006035ca6 req-7aba81ed-accc-454b-982d-e6d22d8e8fac service nova] Creating event network-vif-plugged:58b69e6c-3036-4516-ba10-49aa3cb3f009 for instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 on n-h1-854441-12 Oct 17 15:29:42.916565 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a7203119-026c-472f-aa34-924006035ca6 req-7aba81ed-accc-454b-982d-e6d22d8e8fac service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104946 Oct 17 15:29:42.919829 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 953/2061] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:42.934321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:42.937349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:42.955406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:42.956419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:42.957145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:42.959276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:42.959966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:42.960616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.398994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:43.408634 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b6e5dd73-e8fe-4b80-b223-96ac705684be tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1307 microversion: 2.1 time: 0.486550 Oct 17 15:29:43.409330 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 954/2062] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:42 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1307 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:43.414452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:43.415294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:43.421870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.422734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.423420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.424318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.426853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.426853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.506426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:43.508112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:43.508969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:43.509564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:43.510170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:43.528221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.529012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.529663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.530592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.531399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.531995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.555134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:43.561708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for user 745a483a369e4e83849cee037f5b67ab and project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:43.579067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:29:43.582109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:29:43.611507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:43.622717 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-278274f0-b88f-485c-82a6-559bf984678c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.211685 Oct 17 15:29:43.635382 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1e62655-7660-43e9-840e-1f94ce33d3ea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956664 Oct 17 15:29:43.637053 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1109/2063] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:29:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:29:43.642261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:43.643116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:43.652027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.652813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.653423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.653937 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 955/2064] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:43 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:43.654546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.655712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.656331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.680542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:43.681229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:43.692483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.692998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.693435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.695635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.700222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.701861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.858841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:43.871325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:43.873192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:43.874473 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cfc3bafa-628c-42fc-8a3d-5a6d8e4de061 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1566 microversion: 2.25 time: 0.236282 Oct 17 15:29:43.875366 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1110/2065] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:43 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:43.893305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:43.894324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:43.908221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.908472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.909152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:43.909934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:43.910730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:43.911628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.079692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:44.093103 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c914e3c-d177-444a-a37d-e7b5fbbb1dfc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1522 microversion: 2.1 time: 0.437235 Oct 17 15:29:44.111348 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 956/2066] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:43 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:44.111348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5fe87ed-83f5-4ea4-b755-6a609b385eb8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:44.111883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5fe87ed-83f5-4ea4-b755-6a609b385eb8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:44.217517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:44.229802 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89afc3dd-5b1c-4777-b8e7-5128ba39f69b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.342176 Oct 17 15:29:44.247069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5fe87ed-83f5-4ea4-b755-6a609b385eb8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:44.250031 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1111/2067] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:43 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:44.250275 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5fe87ed-83f5-4ea4-b755-6a609b385eb8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1214 microversion: 2.1 time: 0.140105 Oct 17 15:29:44.252390 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 957/2068] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:44 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:44.258009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:44.263130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:44.270025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.270960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.271623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.272837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.273555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.275563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.281043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:44.281599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:44.313358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.319678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.322186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.325692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.329624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.333669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.398184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:44.411327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:44.416883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:44.434346 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd613976-5489-4ac6-9ae9-561b0ef53884 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.180991 Oct 17 15:29:44.438449 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1112/2069] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:44 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:44.451316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:29:44.462366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:44.464685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:44.489822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.493114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.495902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.499868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.500922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.501652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.710686 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a71af1e-1179-4aca-af8c-f796f5482b1c tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 204 len: 0 microversion: 2.1 time: 0.456543 Oct 17 15:29:44.711717 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 958/2070] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:29:44 2022] DELETE /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:29:44.728146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:44.728387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:44.741983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.742535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.743704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.744426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.744884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.745399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.837592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:44.851665 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b223299-f498-4747-9a18-8e629c52b1c3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1307 microversion: 2.1 time: 0.408571 Oct 17 15:29:44.870644 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1113/2071] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:44 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1307 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:44.870644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:44.870644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:44.877380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.878026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.878613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.879779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.880332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.880827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.932879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:44.949399 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-90ea8ed2-c28f-4770-b749-dd624d311303 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.233642 Oct 17 15:29:44.949995 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 959/2072] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:44 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:44.958979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:44.960156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:44.973268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.974097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.976155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:44.977158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:44.977594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:44.978008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.156823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:45.170988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39d34e28-10fc-40bf-83a8-01b47824f050 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1528 microversion: 2.1 time: 0.311668 Oct 17 15:29:45.186679 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1114/2073] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:44 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1528 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:45.186679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f67082c7-91be-4a27-8b44-4613d5a7a630 req-4c3013fa-1e9e-4fc4-b833-075c3022b2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f10878-2fa0-4b9b-9b65-b296e034dc8d", "name": "network-vif-plugged", "status": "completed", "tag": "815c8333-ad3a-4336-b460-1c7a5b419ace"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:45.196071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:45.199490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f67082c7-91be-4a27-8b44-4613d5a7a630 req-4c3013fa-1e9e-4fc4-b833-075c3022b2aa service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.201432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f67082c7-91be-4a27-8b44-4613d5a7a630 req-4c3013fa-1e9e-4fc4-b833-075c3022b2aa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.204242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f67082c7-91be-4a27-8b44-4613d5a7a630 req-4c3013fa-1e9e-4fc4-b833-075c3022b2aa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.211002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:45.216900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:45.221049 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b444f347-7849-4ab2-b281-2c8d2e4c26ff tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1541 microversion: 2.25 time: 0.266910 Oct 17 15:29:45.226608 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 960/2074] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:44 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1541 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:45.237792 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f67082c7-91be-4a27-8b44-4613d5a7a630 req-4c3013fa-1e9e-4fc4-b833-075c3022b2aa service nova] Creating event network-vif-plugged:815c8333-ad3a-4336-b460-1c7a5b419ace for instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d on n-h1-854441-12 Oct 17 15:29:45.246452 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f67082c7-91be-4a27-8b44-4613d5a7a630 req-4c3013fa-1e9e-4fc4-b833-075c3022b2aa service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071906 Oct 17 15:29:45.247533 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1115/2075] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:45.250867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57b4c06a-58c2-4acb-a3c4-4c0add4f3e68 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '.version_select at 0x7f28c2e30160>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:45.255081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57b4c06a-58c2-4acb-a3c4-4c0add4f3e68 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.255559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57b4c06a-58c2-4acb-a3c4-4c0add4f3e68 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.257888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57b4c06a-58c2-4acb-a3c4-4c0add4f3e68 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.267607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:45.270021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:45.273409 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57b4c06a-58c2-4acb-a3c4-4c0add4f3e68 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 3053 microversion: 2.25 time: 0.030070 Oct 17 15:29:45.274561 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 961/2076] 10.222.0.87 () {60 vars in 1184 bytes} [Mon Oct 17 15:29:45 2022] GET /compute/v2.1/os-migrations => generated 3053 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:29:45.279298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:45.280288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:45.284616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.287298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.288676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.289603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.290096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.290749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.291290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.291779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.291942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.292574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.293170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.293656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.416168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:45.429104 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d3d81411-b866-4176-9813-135724989dbe tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1266 microversion: 2.1 time: 0.153268 Oct 17 15:29:45.442240 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 962/2077] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:45 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:45.442240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:45.442240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:45.444175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.444661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.445081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.445771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.446214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.446665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.545478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:45.558257 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-975a5a50-1829-45b6-bfd9-d37dcca49766 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.299730 Oct 17 15:29:45.559158 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1116/2078] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:45 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:45.568000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:45.568973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:45.583782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.584475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.585071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.586755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.587401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.587987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.627817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:45.663143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:45.665886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 2515b31b-3d10-40b2-a11a-e89640d4c8d6 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:45.677020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:45.684676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-83762831-03b3-4799-aba5-6d951bf6bed5 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 2035 microversion: 2.25 time: 0.251392 Oct 17 15:29:45.685599 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 963/2079] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:45 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 2035 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:45.689953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:45.691615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:45.697359 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51c1f27f-951f-4aa6-8ffe-3dec9dc90a16 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.136102 Oct 17 15:29:45.697883 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1117/2080] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:45 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:45.720609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6e7d0d47-f273-4305-aac8-4e4f87340e3f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Action: 'create', calling method: .version_select at 0x7f28bec1cee0>, body: {"keypair": {"name": "tempest-keypair-708831637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZy6oARmewMmL/OefP7NjyCXLaPEPbmVjTGbsoCowPqza/a4ZsixDpNcgtaRVAyWWsximp7zwa1RpXoCJUaH36Kb5DC1Brj5pPKO8hlrdz4rkMANMVay7Y6lV1k9myLDQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:45.741722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-6e7d0d47-f273-4305-aac8-4e4f87340e3f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:45.748466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-6e7d0d47-f273-4305-aac8-4e4f87340e3f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for user 54134ad155cf45d19f6a551710c84a9e and project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:45.774667 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6e7d0d47-f273-4305-aac8-4e4f87340e3f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.059520 Oct 17 15:29:45.775834 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 964/2081] 10.222.0.87 () {62 vars in 1200 bytes} [Mon Oct 17 15:29:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 15:29:45.880680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:45.881483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:45.888791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.889567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.890137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.891072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.891702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.894640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.973047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:45.973662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:45.984072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.984072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.984072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:45.984072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:45.992904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:45.993458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:46.088498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:46.102154 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f00de1e-268d-4066-bae3-c7679759c4fc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 200 len: 1487 microversion: 2.1 time: 0.226181 Oct 17 15:29:46.102931 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1118/2082] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:45 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 1487 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:46.132149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7bfad63-520d-4c0b-9d64-91a9000d8c6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1203211126"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:46.143086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7bfad63-520d-4c0b-9d64-91a9000d8c6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:46.172651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7bfad63-520d-4c0b-9d64-91a9000d8c6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:46.174783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7bfad63-520d-4c0b-9d64-91a9000d8c6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:46.175934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7bfad63-520d-4c0b-9d64-91a9000d8c6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:46.177885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7bfad63-520d-4c0b-9d64-91a9000d8c6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:46.180082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7bfad63-520d-4c0b-9d64-91a9000d8c6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:46.181670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7bfad63-520d-4c0b-9d64-91a9000d8c6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:46.279828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:46.289516 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c403a982-8274-4e8a-a479-9e9dcefe4a9f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.320714 Oct 17 15:29:46.316785 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 965/2083] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:45 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:46.322018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:46.322877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:46.347674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:46.348522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:46.358167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:46.361190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:46.365395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:46.365842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:46.631650 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7bfad63-520d-4c0b-9d64-91a9000d8c6d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170/action" status: 202 len: 0 microversion: 2.1 time: 0.505259 Oct 17 15:29:46.632823 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1119/2084] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:29:46 2022] POST /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:29:46.654337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:46.658015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:46.677577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:46.678952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:46.682036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:46.683943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:46.684598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:46.687208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:46.873331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:46.883198 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b38ba5d-8435-4b73-b48c-c6a28c9dba52 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1528 microversion: 2.1 time: 0.564969 Oct 17 15:29:46.889172 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 966/2085] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:46 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1528 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:46.894009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:46.900591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:46.915487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:46.917606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:46.920435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:46.921381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:46.922267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:46.923627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:47.024898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:47.038923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65ddd7e8-5e9c-4efa-8fb8-497ae5cba7a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1272 microversion: 2.1 time: 0.403163 Oct 17 15:29:47.057796 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1120/2086] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:46 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1272 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:47.066478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b013cdb4-cd34-45c1-afc0-9a3fb9f02b37 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2eead30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:47.137405 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b013cdb4-cd34-45c1-afc0-9a3fb9f02b37 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.078029 Oct 17 15:29:47.137995 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1121/2087] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:47 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:47.157102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:47.163605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:47.208294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:47.209743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:47.211819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:47.214393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:47.217218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:47.219423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:47.227028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:47.235991 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef1efd27-9983-4c82-b45c-8831439a66b0 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.345611 Oct 17 15:29:47.239302 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 967/2088] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:46 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:47.346762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:47.348281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:47.368359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:47.368850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:47.369302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:47.370014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:47.370518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:47.370957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:47.454698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:47.466917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:47.469028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:47.482308 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1755c905-4d0c-415e-b063-c70787aa7679 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.341429 Oct 17 15:29:47.483949 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1122/2089] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:47 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:47.645443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-dd8ab8ce-7693-469a-b4d7-813a3ce9a055 req-fa694e91-74fb-4d0a-915b-92da1c1d1419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f10878-2fa0-4b9b-9b65-b296e034dc8d", "name": "network-vif-deleted", "tag": "815c8333-ad3a-4336-b460-1c7a5b419ace"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:47.668048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd8ab8ce-7693-469a-b4d7-813a3ce9a055 req-fa694e91-74fb-4d0a-915b-92da1c1d1419 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:47.669468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd8ab8ce-7693-469a-b4d7-813a3ce9a055 req-fa694e91-74fb-4d0a-915b-92da1c1d1419 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:47.670389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd8ab8ce-7693-469a-b4d7-813a3ce9a055 req-fa694e91-74fb-4d0a-915b-92da1c1d1419 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:47.710653 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-dd8ab8ce-7693-469a-b4d7-813a3ce9a055 req-fa694e91-74fb-4d0a-915b-92da1c1d1419 service nova] Creating event network-vif-deleted:815c8333-ad3a-4336-b460-1c7a5b419ace for instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d on n-h1-854441-12 Oct 17 15:29:47.726764 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-dd8ab8ce-7693-469a-b4d7-813a3ce9a055 req-fa694e91-74fb-4d0a-915b-92da1c1d1419 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086849 Oct 17 15:29:47.747513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:47.747697 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1123/2090] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:47.762827 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80fd747c-09c5-43af-8c66-1b4170252567 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.418782 Oct 17 15:29:47.764330 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 968/2091] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:47 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:47.916450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:47.917355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:47.933538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:47.938304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:47.939048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:47.940994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:47.943931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:47.947915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:48.029178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:48.030862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:48.031164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:48.034069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lazy-loading 'fault' on Instance uuid 40f10878-2fa0-4b9b-9b65-b296e034dc8d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:29:48.065028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:48.073001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:48.109296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:48.111049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:48.112328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:48.116272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:48.118119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:48.119595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:48.140418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:48.150747 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25c34dac-df3b-4c7e-92fa-3584df762b6d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 200 len: 1315 microversion: 2.1 time: 0.238800 Oct 17 15:29:48.156842 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1124/2092] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:47 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:48.168514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afa9aa35-fc91-4a88-8db8-384e98ef0344 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2eea8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:48.244993 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-afa9aa35-fc91-4a88-8db8-384e98ef0344 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.086629 Oct 17 15:29:48.250538 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1125/2093] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:48 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:48.267116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:48.268131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:48.276386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:48.281720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:48.286283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:48.291899 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5feecf2c-1e42-49b4-baad-40e895878104 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1272 microversion: 2.1 time: 0.234247 Oct 17 15:29:48.292691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:48.295042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:48.296369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:48.296791 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 969/2094] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:48 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:48.297428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:48.513370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:48.513988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:48.528619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:48.529133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:48.529575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:48.530299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:48.530775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:48.531182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:48.632861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:48.647043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:48.649732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:48.652352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:48.659860 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc271a21-f330-4817-a4c7-f2cec0b986d2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.150339 Oct 17 15:29:48.661674 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb71f5d1-53e5-49fa-a390-47ffb1fd3d46 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.398695 Oct 17 15:29:48.667427 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1126/2095] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:48 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:48.680623 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 970/2096] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:48 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:29:48.789969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:48.790959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:48.798824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:48.799710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:48.800375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:48.801338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:48.802016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:48.802693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:49.182335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:49.183180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:49.190856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:49.191439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:49.192574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:49.193285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:49.194270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:49.195214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:49.195876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:49.207565 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35c19ddb-9f85-4237-a1ed-1fb5b600f09c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.421861 Oct 17 15:29:49.208945 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1127/2097] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:48 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:49.237047 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d HTTP/1.1 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '40f10878-2fa0-4b9b-9b65-b296e034dc8d'} Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:29:49.240866 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:29:49.245717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:29:49.245717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:29:49.245717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:29:49.245717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:29:49.245717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:29:49.245717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:29:49.245717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:29:49.245717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:29:49.247757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:29:49.248921 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-62572b5f-5edd-49d3-a4e3-402536aaa64a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 404 len: 111 microversion: 2.1 time: 0.072991 Oct 17 15:29:49.250327 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 971/2098] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:49 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:29:49.262928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7bcf66ca-7cd6-48a1-b30e-7d3b533bf10e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2eea8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:49.357337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:49.358891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:49.375005 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7bcf66ca-7cd6-48a1-b30e-7d3b533bf10e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.117463 Oct 17 15:29:49.383228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:49.386028 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1128/2099] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:49 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:49.386324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:49.386935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:49.388880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:49.392598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:49.394546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:49.469684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-328723956", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:49.602840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] validate_networks() for [('d03e9e4b-e4e4-4807-a6fd-a00d165be1a3', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:29:49.644750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:49.656729 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1dfa151c-a8a5-438b-a5cf-f68f865fae0f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1314 microversion: 2.1 time: 0.342804 Oct 17 15:29:49.658087 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 972/2100] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:49 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:49.674009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-233022969", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "367a2d39-b572-49e0-b719-9b2cdd9cfe38"}], "security_groups": [{"name": "tempest-securitygroup--1220771271"}], "key_name": "tempest-keypair-708831637", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:49.867086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] validate_networks() for [('367a2d39-b572-49e0-b719-9b2cdd9cfe38', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:29:50.546622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:50.547232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:50.555382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:50.556005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:50.556488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:50.584533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:50.589262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:50.590008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:50.599742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:50.600634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:50.601307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:50.662023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Getting quotas for project 4e0a35484bd44be0938aaabdee3cf4c2. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:50.686637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Getting quotas for user e5d69af6a3c14dbab949c56fde26ff95 and project 4e0a35484bd44be0938aaabdee3cf4c2. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:50.725641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:29:50.736841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:29:50.795259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:29:50.797818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:29:50.800894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:29:50.801528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:29:50.803260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:29:50.816451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:50.816940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:50.817577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:50.819998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:50.829871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:50.833043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:50.894533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:29:50.897054 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a170129-028f-42b9-ae44-d3e34ae33dd8 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.429707 Oct 17 15:29:50.904109 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1129/2101] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:29:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:29:50.914405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:50.915701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:50.917215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for user 54134ad155cf45d19f6a551710c84a9e and project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:29:50.934247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:50.943304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:50.943920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:50.957867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:29:50.963209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:29:50.964548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:50.965271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:50.965945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:51.045342 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5a4e4f1b-7368-44ff-a193-682857de66b0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.385669 Oct 17 15:29:51.046376 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 973/2102] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:29:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:29:51.053572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:51.054645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:51.063269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:51.063989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:51.064434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:51.065208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:51.065668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:51.066683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:51.151431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:51.163175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:51.165096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:51.171668 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4b81d44e-7fb1-41b0-8970-a7b4a73103a2 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.124115 Oct 17 15:29:51.186553 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 974/2103] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:51 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:51.186553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:51.186553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:51.196793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:51.197295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:51.198125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:51.198889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:51.199498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:51.199959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:51.521141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:51.533179 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a44fb2d-52a3-449c-9185-16da473e22cb tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.359495 Oct 17 15:29:51.534570 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 975/2104] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:51 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:51.542026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8cfb5414-225a-4d60-ac06-06c78cf08da0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2e3f430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:51.588683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:51.604317 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a3b9d05-a62b-44d3-bddd-7b61dddf7373 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.704632 Oct 17 15:29:51.604977 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1130/2105] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:50 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:51.610069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:51.610720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:51.635585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:51.637549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:51.639604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:51.640901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:51.643951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:51.649040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:51.977146 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8cfb5414-225a-4d60-ac06-06c78cf08da0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.439484 Oct 17 15:29:51.992672 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 976/2106] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:51 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:52.023070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1e4bc34b-3f15-40fe-8488-9357bb49e12f req-93810d7a-b5d0-47da-9a1d-b9541c587132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f40ea7d-a231-4b2e-a119-3213a97b26ba", "tag": "c7be5f5a-5ba7-4598-9141-b53977055e65"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:52.080545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e4bc34b-3f15-40fe-8488-9357bb49e12f req-93810d7a-b5d0-47da-9a1d-b9541c587132 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:52.081883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e4bc34b-3f15-40fe-8488-9357bb49e12f req-93810d7a-b5d0-47da-9a1d-b9541c587132 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:52.089392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e4bc34b-3f15-40fe-8488-9357bb49e12f req-93810d7a-b5d0-47da-9a1d-b9541c587132 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:52.164222 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1e4bc34b-3f15-40fe-8488-9357bb49e12f req-93810d7a-b5d0-47da-9a1d-b9541c587132 service nova] Creating event network-changed:c7be5f5a-5ba7-4598-9141-b53977055e65 for instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba on n-h2-854441-12 Oct 17 15:29:52.181432 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1e4bc34b-3f15-40fe-8488-9357bb49e12f req-93810d7a-b5d0-47da-9a1d-b9541c587132 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186939 Oct 17 15:29:52.191529 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 977/2107] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:52.235733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-999c753e-0cac-4ebb-8473-241cc56862c6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:52.242827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-999c753e-0cac-4ebb-8473-241cc56862c6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:52.378156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:52.391021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-999c753e-0cac-4ebb-8473-241cc56862c6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:52.393923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c09212b8-73a3-4423-9159-850b4475e4f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1314 microversion: 2.1 time: 0.787728 Oct 17 15:29:52.398310 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1131/2108] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:51 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:52.402306 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-999c753e-0cac-4ebb-8473-241cc56862c6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1224 microversion: 2.1 time: 0.195179 Oct 17 15:29:52.404187 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 978/2109] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:52 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1224 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:52.419763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:52.420753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:52.424826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:52.430624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:52.448101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:52.448356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:52.448880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:52.449318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:52.450516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:52.451484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:52.452060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:52.453280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:52.455240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:52.462042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:52.463090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:52.463786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:52.639312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:52.657396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:52.666232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:52.687997 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aafddbef-75d4-4c7f-a92c-d80fa34635b6 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.281634 Oct 17 15:29:52.712632 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 979/2110] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:52 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:52.738313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:52.741513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:52.763707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:52.767909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:52.768475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:52.774004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:52.778451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:52.779236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:52.779862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:52.789012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:52.794819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:52.806616 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0d7d0e0d-cd49-4ebe-afdd-e5a631bf3d35 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1280 microversion: 2.25 time: 0.400339 Oct 17 15:29:52.807469 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1132/2111] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:52 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1280 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:52.846443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:52.853075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:52.900137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:52.900821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:52.901426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:52.902190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:52.908945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:52.913649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.167714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:53.180294 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ebd0702a-5e00-4356-b414-e856fa9a76fa tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.457561 Oct 17 15:29:53.194526 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 980/2112] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:52 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:53.194526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-faec06e6-78a2-4917-9946-688c2eba5191 req-9e2357f8-6054-465c-8441-e8142d7a9174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c186d0-403a-49cd-94fc-cfa45e6b5170", "name": "network-vif-plugged", "status": "completed", "tag": "58b69e6c-3036-4516-ba10-49aa3cb3f009"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:53.215245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-faec06e6-78a2-4917-9946-688c2eba5191 req-9e2357f8-6054-465c-8441-e8142d7a9174 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:53.215732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-faec06e6-78a2-4917-9946-688c2eba5191 req-9e2357f8-6054-465c-8441-e8142d7a9174 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:53.218620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-faec06e6-78a2-4917-9946-688c2eba5191 req-9e2357f8-6054-465c-8441-e8142d7a9174 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.245152 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-faec06e6-78a2-4917-9946-688c2eba5191 req-9e2357f8-6054-465c-8441-e8142d7a9174 service nova] Creating event network-vif-plugged:58b69e6c-3036-4516-ba10-49aa3cb3f009 for instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 on n-h1-854441-12 Oct 17 15:29:53.256830 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-faec06e6-78a2-4917-9946-688c2eba5191 req-9e2357f8-6054-465c-8441-e8142d7a9174 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074620 Oct 17 15:29:53.257441 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 981/2113] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:53.270784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95ed148e-d527-4268-9ee3-7017ec531933 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea52f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:53.318402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:53.327569 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-851f9c57-f0e3-4841-993e-435a03e7a450 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.507090 Oct 17 15:29:53.340263 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1133/2114] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:52 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:53.399168 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95ed148e-d527-4268-9ee3-7017ec531933 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.133050 Oct 17 15:29:53.408812 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 982/2115] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:53 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:53.425118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:53.425736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:53.431596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:53.436127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:53.444417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:53.447726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:53.448431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.449340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:53.449961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:53.450989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.452707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:53.456366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:53.457032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.457958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:53.461793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:53.462419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.604842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:53.625942 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b25275b-29ba-4b85-b5d4-61480c7a25a6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1220 microversion: 2.1 time: 0.197640 Oct 17 15:29:53.627066 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 983/2116] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:53 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1220 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:53.732392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:53.733084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:53.746219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:53.747861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:53.748377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:53.748817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.749536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:53.760793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:53.762902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.771139 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18d82324-7967-4a5f-b034-2b2e3e1ff759 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1314 microversion: 2.1 time: 0.350994 Oct 17 15:29:53.775423 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1134/2117] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:53 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:53.853272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:53.855362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:53.873287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:53.880383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:53.881567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.883743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:53.886114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:53.888266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:53.925225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:53.942844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:53.946246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:53.959742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:53.966183 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e8a7e569-530a-4d53-b3b3-196f971606a7 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.236318 Oct 17 15:29:53.984433 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 984/2118] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:53 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:29:54.102967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:54.117105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:54.122773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:54.124286 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86cda947-ae55-4eac-91de-e99bb8a3f8d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1336 microversion: 2.25 time: 0.283276 Oct 17 15:29:54.125572 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1135/2119] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:53 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1336 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:54.214305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:54.215028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:54.228250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:54.231099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:54.232075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:54.233185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:54.233874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:54.234935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:54.355210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:54.355837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:54.366850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:54.367069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:54.367374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:54.368085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:54.368576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:54.368945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:54.431603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:54.443649 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d5d0ba4d-82ed-4aba-bdc4-a0d5db6b8df7 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.235085 Oct 17 15:29:54.444937 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 985/2120] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:54 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:54.450168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-203fc57f-a8d1-4d90-80ec-f3f477132446 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2ef5af0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:54.512188 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-203fc57f-a8d1-4d90-80ec-f3f477132446 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.065942 Oct 17 15:29:54.521975 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 986/2121] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:54 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:54.626096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:54.635643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:54.639530 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-972e491e-af77-4d12-b952-0830344a9e29 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.288131 Oct 17 15:29:54.640387 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1136/2122] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:54 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:54.665103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:54.669937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:54.678260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:54.679023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:54.679735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:54.680623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:54.682472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:54.683182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:54.802268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:54.803390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:54.844365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:54.844641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:54.844900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:54.847212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:54.848038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:54.855028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:54.977766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:54.981071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:54.999233 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff4e21b6-9528-49c9-83f2-74da53725c2a tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1276 microversion: 2.1 time: 0.337776 Oct 17 15:29:55.012244 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 987/2123] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:54 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1276 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:55.034014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:55.034954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:55.055216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:55.055550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:55.055805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:55.056479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:55.056930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:55.060983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:55.231849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:55.241174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:55.248592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:55.254792 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1277dc33-0388-4c44-a35f-2db34f16f3ba tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.240321 Oct 17 15:29:55.256062 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 988/2124] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:55 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:55.261076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:55.261998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:55.274378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:55.277718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:55.278451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:55.279545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:55.281069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:55.281566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:55.311511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:55.320205 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc31d671-2cb9-4c1d-8640-c295a5ab9657 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1314 microversion: 2.1 time: 0.524345 Oct 17 15:29:55.320996 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1137/2125] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:54 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:55.468070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:55.469008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:55.498799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:55.504326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:55.505794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:55.511155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:55.512325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:55.515967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:55.686091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:55.699373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:55.704291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:55.708047 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-63b782cc-7bb6-40a4-ace5-cdfa75ac196a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1342 microversion: 2.25 time: 0.450764 Oct 17 15:29:55.710403 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 989/2126] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:55 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1342 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:55.722093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b09904b5-99aa-4581-8ab0-062ee68effd8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2e3dee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:55.803780 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b09904b5-99aa-4581-8ab0-062ee68effd8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.089957 Oct 17 15:29:55.804922 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 990/2127] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:55 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:55.815466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:55.816091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:55.832151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:55.832644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:55.835231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:55.836112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:55.836808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:55.837249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:55.935406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:55.945305 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81a04475-b7b2-4887-9ecd-a12fbae347ca tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.481735 Oct 17 15:29:55.948585 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1138/2128] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:55 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:56.028212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:56.029116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:56.039074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:29:56.050490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:56.051351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:56.056133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:56.060645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:56.064445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:56.065572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:56.197917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:56.211122 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f069bc4-682b-46f8-9300-193e64117bdf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1282 microversion: 2.1 time: 0.187948 Oct 17 15:29:56.220102 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1139/2129] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:56 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:56.260664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:56.283404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2b5a0f35-ccf9-4807-8504-79d193d849ce tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.467159 Oct 17 15:29:56.284823 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 991/2130] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:55 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:56.306012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:56.318921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:56.352916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:56.353860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:56.354488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:56.355710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:56.356430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:56.358238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:56.358849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:56.359389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:56.369783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:56.371449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:56.372084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:56.373593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:56.375252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:56.377566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:56.499704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:56.523494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:56.534488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:56.544099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b58e37d5-0dc2-4c30-96bb-7212fc44676a tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.257407 Oct 17 15:29:56.546959 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1140/2131] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:56 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:29:56.743982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:56.745272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:56.753462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:56.754696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:56.755330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:56.756247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:56.756906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:56.757522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:56.853694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:56.867744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:56.869529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:56.875957 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-744a10a9-91ed-49fb-9391-2deb8321c31e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1342 microversion: 2.25 time: 0.136647 Oct 17 15:29:56.877230 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1141/2132] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:56 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1342 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:56.891411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5bcad6cc-2b53-4b14-bbbb-defc8da3b5a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f4c5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:56.979180 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5bcad6cc-2b53-4b14-bbbb-defc8da3b5a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.100197 Oct 17 15:29:56.980206 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1142/2133] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:56 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:56.991342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:56.991971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:57.009300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.014845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.015626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.016410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.016888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.017320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.088821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:57.097704 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e80f79c7-63f6-4b85-b1b9-0df13f8ba49d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1314 microversion: 2.1 time: 0.753989 Oct 17 15:29:57.101968 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 992/2134] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:56 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:29:57.245184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:57.245854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:57.259384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.259893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.260415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.261125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.261822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.262154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.285116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:57.295664 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-641bdd27-d5ec-4fdd-bba0-86132b749d30 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.312138 Oct 17 15:29:57.312266 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1143/2135] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:56 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:57.320148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:57.320414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:57.334770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.336247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.336869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.337674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.338267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.338851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.402367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:57.414830 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dfde3b9e-157a-4d66-8c94-1f99071e15a2 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1282 microversion: 2.1 time: 0.173673 Oct 17 15:29:57.415741 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 993/2136] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:57 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:57.578476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:57.589257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:57.606664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.610061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.612918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.617204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.617921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.618623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.807128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:57.823988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39db6d75-9e65-4e25-a19e-6d021ee54f53 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.510206 Oct 17 15:29:57.825993 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1144/2137] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:57 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:57.898910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:57.910619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:57.911388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:57.912302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:57.914219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:57.928479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.930864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.933031 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ddb70be8-fb97-4d95-a9e6-ee7549fcca21 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.358328 Oct 17 15:29:57.935132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.936774 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 994/2138] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:57 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:29:57.937716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:57.938199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:57.942856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:57.995432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81bae922-a702-4d36-818a-1ad3790e09d6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2df3040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:58.101141 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81bae922-a702-4d36-818a-1ad3790e09d6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.109243 Oct 17 15:29:58.109363 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 995/2139] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:57 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:58.126251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:58.126901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:58.155608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:58.156128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:58.156573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:58.157301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:58.157755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:58.158175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:58.641368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:58.695044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:58.697413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:58.699146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a41531c5-3b03-4701-be18-9a32982eb981 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.794741 Oct 17 15:29:58.700532 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1145/2140] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:57 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:29:58.724459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:58.726243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:58.748700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:58.749207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:58.749649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:58.750363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:58.756557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:58.756557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:58.936907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:58.945826 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-73cbeec8-c229-4409-8da3-2d008d6e2f41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1314 microversion: 2.1 time: 0.823329 Oct 17 15:29:58.946408 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 996/2141] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:58 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:58.962469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:58.963552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:58.978067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:58.979044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:58.979717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:58.981006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:58.982770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:58.983462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:59.293342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:59.302122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:59.305854 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07dc3a37-9504-4a33-9b37-7d595aad08cf tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.355099 Oct 17 15:29:59.308111 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 997/2142] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:58 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:59.318993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9e4b89fc-a8b0-42cb-8e38-103fa616dd31 req-c138c70d-0c82-4961-8775-8bd7b418907c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f40ea7d-a231-4b2e-a119-3213a97b26ba", "name": "network-vif-plugged", "status": "completed", "tag": "c7be5f5a-5ba7-4598-9141-b53977055e65"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:29:59.322059 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3aed2c0-15cb-41b3-9990-0eff2efeb77f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.619057 Oct 17 15:29:59.323093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1146/2143] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:58 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:59.329675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:59.330424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:59.339901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:59.340404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:59.341321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:59.342317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:59.342795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:59.343823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:59.358620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e4b89fc-a8b0-42cb-8e38-103fa616dd31 req-c138c70d-0c82-4961-8775-8bd7b418907c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:59.366948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e4b89fc-a8b0-42cb-8e38-103fa616dd31 req-c138c70d-0c82-4961-8775-8bd7b418907c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:59.367810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e4b89fc-a8b0-42cb-8e38-103fa616dd31 req-c138c70d-0c82-4961-8775-8bd7b418907c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:59.395514 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9e4b89fc-a8b0-42cb-8e38-103fa616dd31 req-c138c70d-0c82-4961-8775-8bd7b418907c service nova] Creating event network-vif-plugged:c7be5f5a-5ba7-4598-9141-b53977055e65 for instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba on n-h2-854441-12 Oct 17 15:29:59.422733 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9e4b89fc-a8b0-42cb-8e38-103fa616dd31 req-c138c70d-0c82-4961-8775-8bd7b418907c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108220 Oct 17 15:29:59.428494 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 998/2144] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:29:59.469537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:59.470295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:59.481108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:59.481606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:59.482780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:59.483548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:59.484508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:59.484991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:59.663640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:59.682916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:59.684776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:29:59.699664 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1b1f141-2956-4d91-ab63-7989f05cde63 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.266170 Oct 17 15:29:59.700648 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 999/2145] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:59 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:29:59.705749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36183740-8cdc-4843-a3c2-386cbaa84756 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2df3b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:59.786542 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36183740-8cdc-4843-a3c2-386cbaa84756 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.084113 Oct 17 15:29:59.787351 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1000/2146] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:29:59 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:29:59.793733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:29:59.795126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:29:59.802981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:59.803479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:59.803915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:29:59.804628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:29:59.805258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:29:59.805702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:00.219920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:00.231236 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-139d85fa-6555-4682-8b7d-2e8c3dcddad7 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.906755 Oct 17 15:30:00.232172 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1147/2147] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:29:59 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:00.237434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:00.238692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:00.245353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:00.246166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:00.246852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:00.248121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:00.248816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:00.249459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:00.481319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:00.492202 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdcd32c6-eaac-41ad-8b64-24bfaa4f3695 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1314 microversion: 2.1 time: 0.258324 Oct 17 15:30:00.493513 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1148/2148] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:00 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:00.499073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:00.500480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:00.525003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:00.526345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:00.527267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:00.529199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:00.536657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:00.537859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:00.633605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:00.665184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:00.684849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:00.690383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:00.696661 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-633ea4ba-1530-4717-b0c1-b31f204f0ad7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.905846 Oct 17 15:30:00.698097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:00.699132 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1001/2149] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:29:59 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:00.707577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:00.708494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:00.717040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:00.718361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:00.719473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:00.726009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:00.726966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:00.738863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:00.799595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:00.825026 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6fc0c56-5979-46f5-8270-4231a6576958 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.329860 Oct 17 15:30:00.826349 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1149/2150] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:00 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:00.832290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:00.832909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:00.839718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:00.840233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:00.840680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:00.841476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:00.841929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:00.842403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:00.880472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:00.949151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:00.963076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:00.966618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:00.974339 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-738e33d9-fe96-499e-a1a2-dbf2377bf478 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.146724 Oct 17 15:30:00.985138 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1150/2151] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:00 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:01.000856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db8736f9-2b97-4cc9-8896-e57f3c78793f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2fc2af0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:01.157801 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db8736f9-2b97-4cc9-8896-e57f3c78793f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.173838 Oct 17 15:30:01.158995 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1151/2152] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:00 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:01.182473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6381aa21-d7d9-4601-a79f-943153002621 req-d6f8ce1c-84ea-4e62-a317-16cd8f58a000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7223bf-635f-444f-98a9-f4764b4cd42c", "tag": "b7b29889-5c2f-436a-b1af-d8cf33437c18"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:01.201231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6381aa21-d7d9-4601-a79f-943153002621 req-d6f8ce1c-84ea-4e62-a317-16cd8f58a000 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:01.204356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6381aa21-d7d9-4601-a79f-943153002621 req-d6f8ce1c-84ea-4e62-a317-16cd8f58a000 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:01.205197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6381aa21-d7d9-4601-a79f-943153002621 req-d6f8ce1c-84ea-4e62-a317-16cd8f58a000 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:01.254635 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6381aa21-d7d9-4601-a79f-943153002621 req-d6f8ce1c-84ea-4e62-a317-16cd8f58a000 service nova] Creating event network-changed:b7b29889-5c2f-436a-b1af-d8cf33437c18 for instance 8b7223bf-635f-444f-98a9-f4764b4cd42c on n-h1-854441-12 Oct 17 15:30:01.268036 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6381aa21-d7d9-4601-a79f-943153002621 req-d6f8ce1c-84ea-4e62-a317-16cd8f58a000 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095972 Oct 17 15:30:01.269523 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1152/2153] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:01.278718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:01.284571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:01.296996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:01.298021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:01.298774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:01.300021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:01.300747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:01.301429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:01.579230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:01.593578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22006437-8b02-4769-b73c-427de1ef7313 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.892130 Oct 17 15:30:01.594486 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1002/2154] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:00 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:01.600363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:01.606881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:01.607934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:01.615742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:01.616495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:01.617096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:01.617489 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eacdea1c-f4c7-45af-b1f3-ce79e8c47f0a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.346035 Oct 17 15:30:01.618416 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1153/2155] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:01 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:01.619926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:01.621273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:01.621868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:01.727301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:01.728014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:01.749046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:01.752912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:01.753470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:01.754701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:01.755851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:01.756984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:02.007568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:02.020995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:02.022872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:02.024260 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5681045-e1ea-4289-b5fd-ee66f767cebb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.301091 Oct 17 15:30:02.026354 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1154/2156] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:01 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:30:02.034275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:02.035865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:02.044389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:02.047077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:02.047853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:02.048781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:02.049671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:02.050268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:02.137959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:02.150756 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-493a4596-4b82-4dea-8865-b9924925b167 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1314 microversion: 2.1 time: 0.549378 Oct 17 15:30:02.153032 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1003/2157] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:01 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:02.165487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:02.166413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:02.177102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:02.179348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:02.179996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:02.181628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:02.186522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:02.187829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:02.288425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:02.300055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7212502-ea70-4d84-a5d3-856bb8686885 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.272349 Oct 17 15:30:02.301056 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1155/2158] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:02 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:02.310629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-215f3149-1d23-4caa-918e-14b1fb36ee05 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2ee1430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:02.381656 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-215f3149-1d23-4caa-918e-14b1fb36ee05 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.079317 Oct 17 15:30:02.383089 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1156/2159] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:02 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:02.396426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=14 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:02.491353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:02.510825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:02.513755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:02.520999 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c77344df-6c18-4128-ba6b-4a40a8046836 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1446 microversion: 2.75 time: 0.364231 Oct 17 15:30:02.523848 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1004/2160] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:02 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1446 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:02.618946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:02.619929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:02.636162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:02.643903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:02.644518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:02.650167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:02.651073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:02.652020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:02.654576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:02.655289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:02.655921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:02.656815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:02.659394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:02.660258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:02.660879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:02.674979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:02.783439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:03.089850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.099678 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-316f1dc7-4fc0-4036-9637-5927530885e8 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.486070 Oct 17 15:30:03.102088 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1157/2161] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:02 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:03.108321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:03.109024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:03.115863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:03.116492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:03.116999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:03.117913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:03.118543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:03.119044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:03.348848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.359870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.361757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.363070 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65510630-50a5-4d48-8532-f60d6b3f6ede tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.259931 Oct 17 15:30:03.364368 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1158/2162] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:03 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:03.374094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.375059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:03.376515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:03.383307 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-16c06ece-06ac-49ea-8b41-d8d55ebcba48 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.743180 Oct 17 15:30:03.384861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:03.385607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:03.385914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:03.386676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:03.387167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:03.387569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:03.388470 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1005/2163] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:02 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:03.393253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:03.393872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:03.410734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:03.411385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:03.423042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:03.424055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:03.425084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:03.425701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:03.560789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.571608 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b22d8e4f-11c0-447c-b0f8-839a9f78004a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1502 microversion: 2.1 time: 0.205072 Oct 17 15:30:03.583489 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1159/2164] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:03 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:03.597695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f57f5f14-475e-4c43-941e-9a2914565481 req-7ea76dc6-ab53-42d5-950a-1cd829bdc50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ef57e2-eb15-4cff-bcef-afe2ee6258d3", "tag": "fa2e7b8c-6534-470c-873a-6dbf6700fdd5"}, {"server_uuid": "66189c64-70e7-4ec5-a3be-20b06e23940d", "name": "network-vif-unplugged", "status": "completed", "tag": "dad068f7-eefd-42f9-96bb-8092defb7bcf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:03.611857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f57f5f14-475e-4c43-941e-9a2914565481 req-7ea76dc6-ab53-42d5-950a-1cd829bdc50c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:03.612349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f57f5f14-475e-4c43-941e-9a2914565481 req-7ea76dc6-ab53-42d5-950a-1cd829bdc50c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:03.612798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f57f5f14-475e-4c43-941e-9a2914565481 req-7ea76dc6-ab53-42d5-950a-1cd829bdc50c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:03.637271 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f57f5f14-475e-4c43-941e-9a2914565481 req-7ea76dc6-ab53-42d5-950a-1cd829bdc50c service nova] Creating event network-changed:fa2e7b8c-6534-470c-873a-6dbf6700fdd5 for instance 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 on n-h1-854441-12 Oct 17 15:30:03.638109 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f57f5f14-475e-4c43-941e-9a2914565481 req-7ea76dc6-ab53-42d5-950a-1cd829bdc50c service nova] Creating event network-vif-unplugged:dad068f7-eefd-42f9-96bb-8092defb7bcf for instance 66189c64-70e7-4ec5-a3be-20b06e23940d on n-h2-854441-12 Oct 17 15:30:03.648938 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f57f5f14-475e-4c43-941e-9a2914565481 req-7ea76dc6-ab53-42d5-950a-1cd829bdc50c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.063939 Oct 17 15:30:03.649935 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1160/2165] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:03.657654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-deff3b03-d705-4c16-9c30-fe1bef41d7b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f780d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:03.726331 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-deff3b03-d705-4c16-9c30-fe1bef41d7b5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.074633 Oct 17 15:30:03.727413 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1161/2166] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:03 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:03.746477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:03.747410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:03.756513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.760422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:03.760723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:03.764512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:03.765499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:03.765974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:03.766713 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-04dee2ac-e459-4474-aa5a-8da654da5964 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.376960 Oct 17 15:30:03.767509 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1006/2167] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:03 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:03.770805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:03.865829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.877826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.879360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:03.885788 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2fe995ea-8ed7-485c-af2f-66a3890012b5 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1452 microversion: 2.75 time: 0.149024 Oct 17 15:30:03.896227 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1162/2168] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:03 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:04.140399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:04.141512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:04.160432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:04.161463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:04.163430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:04.164365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:04.167255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:04.167942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:04.392368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:04.393701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:04.417909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:04.418727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:04.420062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:04.421330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:04.423691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:04.425493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:04.488641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:04.499250 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2bbee7b3-c908-476a-8716-2c5e81f862e2 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.373703 Oct 17 15:30:04.514565 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1007/2169] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:04 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:04.520655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:04.523891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:04.561626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:04.562226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:04.562887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:04.563888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:04.575344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:04.576111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:04.611910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:04.762020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:04.787474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:04.789234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:04.797074 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dabe91a4-cc90-45ee-8dc3-79e06aac2089 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.402469 Oct 17 15:30:04.798207 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1163/2170] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:04 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:30:04.812543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:04.825991 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c646e32d-296c-4dfc-b80b-17843815d4cc tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.319836 Oct 17 15:30:04.827418 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1008/2171] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:04 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:04.832392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e336d69-8418-432d-ba03-25727e52a0db tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f020d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:04.834416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:04.835710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:04.860995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:04.861493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:04.861924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:04.862666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:04.863119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:04.863794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:04.954975 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e336d69-8418-432d-ba03-25727e52a0db tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.151090 Oct 17 15:30:04.956289 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1164/2172] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:04 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:04.970329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:04.982523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:05.007074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:05.007534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:05.007917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:05.008628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:05.013710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:05.018357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:05.096185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:05.108402 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-505b5b5e-4f93-439c-b19d-227f0f49c4e0 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.275951 Oct 17 15:30:05.111064 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1009/2173] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:04 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:05.160768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:05.178696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:05.182250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:05.194309 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-672c9348-fc1d-4947-be3c-a732f9536feb tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1452 microversion: 2.75 time: 0.231265 Oct 17 15:30:05.200149 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1165/2174] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:04 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:05.527106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:05.527839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:05.541233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:05.543975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:05.546586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:05.547964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:05.549974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:05.550921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:05.702422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a193bbcc-969b-47b0-97b4-0ec03276b3a7 req-2c9836d8-4134-4523-b064-3dd4709f2c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66189c64-70e7-4ec5-a3be-20b06e23940d", "tag": "dad068f7-eefd-42f9-96bb-8092defb7bcf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:05.727816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a193bbcc-969b-47b0-97b4-0ec03276b3a7 req-2c9836d8-4134-4523-b064-3dd4709f2c6d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:05.731463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a193bbcc-969b-47b0-97b4-0ec03276b3a7 req-2c9836d8-4134-4523-b064-3dd4709f2c6d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:05.732125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a193bbcc-969b-47b0-97b4-0ec03276b3a7 req-2c9836d8-4134-4523-b064-3dd4709f2c6d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:05.767963 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a193bbcc-969b-47b0-97b4-0ec03276b3a7 req-2c9836d8-4134-4523-b064-3dd4709f2c6d service nova] Creating event network-changed:dad068f7-eefd-42f9-96bb-8092defb7bcf for instance 66189c64-70e7-4ec5-a3be-20b06e23940d on n-h2-854441-12 Oct 17 15:30:05.773608 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a193bbcc-969b-47b0-97b4-0ec03276b3a7 req-2c9836d8-4134-4523-b064-3dd4709f2c6d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074822 Oct 17 15:30:05.774818 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1166/2175] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:05.826830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:05.827888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:05.841125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:05.850264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:05.851218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:05.852189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:05.852856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:05.853483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:05.974913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:05.987945 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bbcd4e24-289c-47af-926a-6446a3fad6ce tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.466559 Oct 17 15:30:05.988795 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1010/2176] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:05 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:05.993833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:06.002359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:06.014839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:06.015706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:06.016896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:06.017809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:06.018688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:06.018880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:06.083121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:06.095594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:06.098535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:06.099994 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-19ee007b-46aa-457d-863d-03cd22e5f9fd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.279066 Oct 17 15:30:06.100888 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1167/2177] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:05 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:06.118742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97016f51-910f-46a8-8c61-d03abd4336af tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2eab4c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:06.197355 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97016f51-910f-46a8-8c61-d03abd4336af tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.094544 Oct 17 15:30:06.198182 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1168/2178] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:06 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:06.215509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:06.218556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:06.227070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:06.228032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:06.228811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:06.229779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:06.230735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:06.231407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:06.526385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:06.536273 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57378a19-d79a-46a7-90d1-c6eb32720437 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.336941 Oct 17 15:30:06.536876 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1169/2179] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:06 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:06.543675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:06.544311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:06.553758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:06.553758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:06.557116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:06.557280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:06.557727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:06.558172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:06.558873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:06.584310 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca65572d-d8af-4e01-914f-0db609f26d2e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.594192 Oct 17 15:30:06.585222 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1011/2180] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:05 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:06.609127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-103c0b97-b6dc-4a04-85ce-319b51c3c639 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0087488f-c028-43bd-bc46-b024b6347e9f"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:06.631367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-103c0b97-b6dc-4a04-85ce-319b51c3c639 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:06.656313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c0b97-b6dc-4a04-85ce-319b51c3c639 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:06.659861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c0b97-b6dc-4a04-85ce-319b51c3c639 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:06.666125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c0b97-b6dc-4a04-85ce-319b51c3c639 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:06.673069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c0b97-b6dc-4a04-85ce-319b51c3c639 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:06.673792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c0b97-b6dc-4a04-85ce-319b51c3c639 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:06.678725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-103c0b97-b6dc-4a04-85ce-319b51c3c639 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:06.740005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:06.753138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:06.764714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:06.774089 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-75569ce6-9e8f-4430-be75-6c700be5e747 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1452 microversion: 2.75 time: 0.235121 Oct 17 15:30:06.789123 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1170/2181] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:06 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1452 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:07.016153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:07.016846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:07.027069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:07.035058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:07.035520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:07.036274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:07.036733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:07.037157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:07.639088 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-103c0b97-b6dc-4a04-85ce-319b51c3c639 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.052119 Oct 17 15:30:07.640546 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1012/2182] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:30:06 2022] POST /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba/os-volume_attachments => generated 194 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:07.653983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:07.660830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:07.675872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:07.676823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:07.677430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:07.678437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:07.679349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:07.683032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:07.780028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:07.792171 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-742a1f0d-b75d-4b4d-9d96-8f0daa079bf9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.780847 Oct 17 15:30:07.795984 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1171/2183] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:07 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:07.807657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e62fff4-c3b8-4cac-91c0-47865ebacbf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2f02d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:07.931960 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e62fff4-c3b8-4cac-91c0-47865ebacbf5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.133790 Oct 17 15:30:07.932737 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1172/2184] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:07 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:07.964155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:07.969516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:08.004378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.005656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.006748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.019789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:08.023880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.029544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:08.030137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.032201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.044034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:08.045317 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-980d8797-840d-48c9-a6da-87f244c4213c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.402092 Oct 17 15:30:08.047120 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1013/2185] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:07 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:08.060068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:08.062067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:08.073951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.075271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.075993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.076971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.077776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.078436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.261165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:08.270967 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-73c1426b-c744-4fed-8c7b-058833a2d428 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.217442 Oct 17 15:30:08.273130 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1014/2186] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:08 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:08.278536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:08.279390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:08.285893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.286651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.287388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.288488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.289368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.289965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.348051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:08.356665 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1974dbba-f104-4a06-8f43-b4776d9b561d tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.422561 Oct 17 15:30:08.360845 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1173/2187] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:07 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:08.376492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:08.390930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:08.392740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:08.401441 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca9047c7-fae7-4c7e-8b28-61dc42cf39f9 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1437 microversion: 2.75 time: 0.126945 Oct 17 15:30:08.402632 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1015/2188] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:08 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1437 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:08.647559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:08.651214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:08.667023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.667588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.670445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.671227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.671696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.672125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.821340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:08.822990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:08.837475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:30:08.838128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:30:08.839071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.839575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.840017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.840732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:08.841190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:08.841615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:08.845991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:30:08.846583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:30:08.847185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:30:09.036198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:09.068731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.077869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.084717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.093105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.096647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.098208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.200453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:09.215756 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d54c65ae-a1d2-4fc1-bcd7-cab41f448e8b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.397350 Oct 17 15:30:09.218990 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1016/2189] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:08 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:09.235755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a7eb711-2e8f-41ed-8f17-b2fdda61137b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2df3160>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:09.272125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:09.325027 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26d0e9d7-b4ca-43dc-8a47-b01ca2851bdc tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9/action" status: 202 len: 1942 microversion: 2.75 time: 0.898283 Oct 17 15:30:09.328081 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1174/2190] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:30:08 2022] POST /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9/action => generated 1942 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 15:30:09.340894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:09.342287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:09.366850 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a7eb711-2e8f-41ed-8f17-b2fdda61137b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.144778 Oct 17 15:30:09.368450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.368948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.377040 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1017/2191] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:09 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:09.377676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.377676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.377676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.377676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.386480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:09.387341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:09.405397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.405920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.406446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.407190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.408809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.409950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.702792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:09.722777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:09.727886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:09.733731 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f76c9c83-e9ab-449d-811b-92665ceae144 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.403092 Oct 17 15:30:09.736182 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1175/2192] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:09 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:09.746414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:09.748682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:09.766553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.767418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.769092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.770084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.772282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.773663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.820062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:09.889602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:09.908160 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57db7906-27f6-48e9-b86b-c2543c2ca1b6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.533123 Oct 17 15:30:09.908842 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1018/2193] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:09 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:09.930324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:09.933232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:09.951752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:09.960866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.961629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.962605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.963789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:09.964435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:09.965085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:09.984680 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8e1d1d7-ca52-47ad-8b94-73f6d86908fa tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.246889 Oct 17 15:30:09.985286 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1176/2194] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:09 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:10.014966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9f67acb1-bc26-424c-a676-cdd72dff9bf7 req-b08f6b8d-b508-417e-ac58-8c339c3da3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ef57e2-eb15-4cff-bcef-afe2ee6258d3", "name": "network-vif-plugged", "status": "completed", "tag": "fa2e7b8c-6534-470c-873a-6dbf6700fdd5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:10.056657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f67acb1-bc26-424c-a676-cdd72dff9bf7 req-b08f6b8d-b508-417e-ac58-8c339c3da3d9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:10.057131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f67acb1-bc26-424c-a676-cdd72dff9bf7 req-b08f6b8d-b508-417e-ac58-8c339c3da3d9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:10.057558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f67acb1-bc26-424c-a676-cdd72dff9bf7 req-b08f6b8d-b508-417e-ac58-8c339c3da3d9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:10.081831 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9f67acb1-bc26-424c-a676-cdd72dff9bf7 req-b08f6b8d-b508-417e-ac58-8c339c3da3d9 service nova] Creating event network-vif-plugged:fa2e7b8c-6534-470c-873a-6dbf6700fdd5 for instance 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 on n-h1-854441-12 Oct 17 15:30:10.090417 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9f67acb1-bc26-424c-a676-cdd72dff9bf7 req-b08f6b8d-b508-417e-ac58-8c339c3da3d9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102416 Oct 17 15:30:10.091383 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1177/2195] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:10.248804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:10.251474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:10.252179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:10.261628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:10.262125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:10.262732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:10.263607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:10.264253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:10.264956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:10.265390 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dddd5289-56df-4113-926c-a7845cc33330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.352221 Oct 17 15:30:10.268191 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1019/2196] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:09 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:10.386613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7deae4f-988f-4bd2-a9d5-efd75c3af73f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be506430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:10.444824 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7deae4f-988f-4bd2-a9d5-efd75c3af73f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.062804 Oct 17 15:30:10.445764 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1020/2197] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:10 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:10.480655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:10.492179 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77be6970-5f82-46f6-ac6a-2ca374e11f07 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.248354 Oct 17 15:30:10.502140 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1178/2198] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:10 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:10.763862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:10.764887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:10.771819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:10.774100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:10.774904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:10.777305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:10.778023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:10.778660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:10.934486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:10.935146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:10.943570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:10.952509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:10.953648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:10.954615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:10.955305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:10.955482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:10.955932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:10.977711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:10.981137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:10.982814 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a80e7734-f9d8-4181-ae23-6108de42c61f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.223633 Oct 17 15:30:10.986020 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1021/2199] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:10 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:11.021697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:11.022707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:11.031218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:11.032997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:11.033771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:11.034865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:11.036369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:11.037273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:11.144475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:11.148986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:11.159151 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d05395de-8dff-4a48-bd10-f802e599b9fa tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.228648 Oct 17 15:30:11.175759 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1179/2200] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:10 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:11.178713 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b9fda5b-dae9-4d96-a058-ac96daa79c7b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.161352 Oct 17 15:30:11.179631 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1022/2201] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:11 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:11.293078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:11.293707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:11.300896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:11.301404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:11.301853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:11.302609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:11.303067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:11.303496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:11.462897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d06c635b-3bbd-4b1a-af23-036b6b02a0a3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c2e3fd30>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:11.467121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:11.481307 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd3dce5e-f38f-4096-93e5-4d8d2bf994bc tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.192197 Oct 17 15:30:11.495436 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1180/2202] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:11 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:11.518082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:11.518953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:11.525841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:11.526363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:11.526945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:11.527696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:11.528152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:11.528574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:11.594668 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d06c635b-3bbd-4b1a-af23-036b6b02a0a3 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.136308 Oct 17 15:30:11.595736 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1023/2203] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:11 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:11.755039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:11.767382 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf8ee015-a053-4743-98c6-ae0710801c0b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.253288 Oct 17 15:30:11.768865 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1181/2204] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:11 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:12.015179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:12.016667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:12.029193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:12.031091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:12.031836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:12.033198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:12.037846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:12.038686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:12.110372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-40224498-cb1a-4d6f-9167-260a27b17e5f req-bed99745-9ea5-4521-a37f-88ccd74c7b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7223bf-635f-444f-98a9-f4764b4cd42c", "name": "network-vif-plugged", "status": "completed", "tag": "b7b29889-5c2f-436a-b1af-d8cf33437c18"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:12.141072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-40224498-cb1a-4d6f-9167-260a27b17e5f req-bed99745-9ea5-4521-a37f-88ccd74c7b54 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:12.144284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-40224498-cb1a-4d6f-9167-260a27b17e5f req-bed99745-9ea5-4521-a37f-88ccd74c7b54 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:12.147979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-40224498-cb1a-4d6f-9167-260a27b17e5f req-bed99745-9ea5-4521-a37f-88ccd74c7b54 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:12.185517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-40224498-cb1a-4d6f-9167-260a27b17e5f req-bed99745-9ea5-4521-a37f-88ccd74c7b54 service nova] Creating event network-vif-plugged:b7b29889-5c2f-436a-b1af-d8cf33437c18 for instance 8b7223bf-635f-444f-98a9-f4764b4cd42c on n-h1-854441-12 Oct 17 15:30:12.196793 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-40224498-cb1a-4d6f-9167-260a27b17e5f req-bed99745-9ea5-4521-a37f-88ccd74c7b54 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091380 Oct 17 15:30:12.200156 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1182/2205] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:30:12.212431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:12.213571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:12.229561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:12.230402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:12.231105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:12.232078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:12.236990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:12.237727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:12.336817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:12.373782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:12.379419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:12.383679 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-35f1ed00-475e-4fdd-a551-37f563e73ae5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.372406 Oct 17 15:30:12.408809 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1024/2206] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:12 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:12.422952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:12.424889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:12.442681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:12.443528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:12.445624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:12.451346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:12.454666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:12.458940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:12.704152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:12.719226 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a5afdcf-e833-4138-842a-30ec8a7085c3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1514 microversion: 2.1 time: 0.511390 Oct 17 15:30:12.735009 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1183/2207] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:12 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1514 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:12.747220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:12.748215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:12.768529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:12.769039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:12.769543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:12.770286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:12.770781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:12.771213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:12.894403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:12.925223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:12.957817 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f4bc934-70e7-4d31-91f8-9045cf3aa39c tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.545990 Oct 17 15:30:12.970626 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1025/2208] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:12 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:12.974583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6a08729-7428-407b-be47-b3e99853d111 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be4eca60>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:13.099963 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6a08729-7428-407b-be47-b3e99853d111 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1414 microversion: 2.1 time: 0.134483 Oct 17 15:30:13.102314 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1026/2209] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:12 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:13.125060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:13.132097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:13.164471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:13.168845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:13.169730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:13.173460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:13.178640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:13.186955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:13.407912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:13.420375 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3cb4f8c-b4e7-4115-84e7-2f842403e6f6 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1324 microversion: 2.1 time: 0.683516 Oct 17 15:30:13.445313 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1184/2210] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:12 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1324 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:13.452398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:13.453617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:13.460865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:13.461734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:13.462444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:13.463513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:13.464216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:13.464859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:13.541384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:13.556913 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-21595a28-368a-4030-8335-1c99782f3522 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.453373 Oct 17 15:30:13.557717 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1027/2211] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:13 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:13.747674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:13.748288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:13.755578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:13.755932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:13.756415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:13.757123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:13.757626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:13.758067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:13.783087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:13.793301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:13.795431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:13.796921 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6533825f-09fa-404e-9b90-f878a4e8feb0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1410 microversion: 2.25 time: 0.348996 Oct 17 15:30:13.797720 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1185/2212] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:13 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1410 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:14.004070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:14.004977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:14.014836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:14.016744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:14.016744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:14.016744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:14.017144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:14.017837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:14.027503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:14.042577 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e991177f-7d16-48d8-b17c-bee5213a043f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1520 microversion: 2.1 time: 0.298985 Oct 17 15:30:14.043951 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1028/2213] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:13 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:14.117515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-da0c7071-3004-4986-9257-f1df6f04d7ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea52f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:14.163108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:14.239244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:14.242944 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7986e1fb-cb0d-4ff9-8167-4ed21b59ab8b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.252403 Oct 17 15:30:14.247112 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-da0c7071-3004-4986-9257-f1df6f04d7ce tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1423 microversion: 2.1 time: 0.133527 Oct 17 15:30:14.247908 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1029/2214] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:14 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1423 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:14.254873 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1186/2215] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:13 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:30:14.267013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f9115bf4-418c-4233-8803-fadba0ff28c8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be4eca60>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:14.345489 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f9115bf4-418c-4233-8803-fadba0ff28c8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 200 len: 1423 microversion: 2.1 time: 0.086269 Oct 17 15:30:14.358969 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1030/2216] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:14 2022] GET /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:14.415159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-529964720", "imageRef": "27c5770b-3817-405f-8de6-cff8f66d76f6", "flavorRef": "452", "networks": [{"uuid": "4a4d489b-6847-437c-bb6f-226f2268a1b9"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:14.445905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:14.447218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:14.455839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:14.456446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:14.456995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:14.457802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:14.458280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:14.458743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:14.483662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] validate_networks() for [('4a4d489b-6847-437c-bb6f-226f2268a1b9', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:30:14.663851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:14.678205 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a3fe142-991c-467c-989e-881384583566 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1521 microversion: 2.1 time: 0.238243 Oct 17 15:30:14.680457 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1031/2217] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:14 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:14.686121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:14.687020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:14.695179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:14.699467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:14.700364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:14.702014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:14.702779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:14.703424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.051299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:30:15.051722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:30:15.052203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:30:15.052715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:30:15.053131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:30:15.064711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.065207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.065646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.066582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.067232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.067823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.095804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:30:15.102756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for user 59a1c6dac66a43d9b5e91b78215359ce and project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:30:15.117009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:30:15.119822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27c5770b-3817-405f-8de6-cff8f66d76f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:30:15.198598 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcb71bd4-c05b-4906-953c-defa2c52eaab tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785959 Oct 17 15:30:15.200598 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1187/2218] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:30:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:30:15.213938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:15.215389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:15.226685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.227606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.230773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.231973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.235031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.235943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.251792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:15.270829 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-abef09dc-a4e8-4586-b942-1f676a9b1b38 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.588692 Oct 17 15:30:15.292709 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1032/2219] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:14 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:15.304319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:15.307685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:15.329160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.329711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.330117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.330916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.331334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.331784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.341460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:30:15.495898 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10284017-2579-4fe1-b481-23344e787257 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 204 len: 0 microversion: 2.1 time: 0.292525 Oct 17 15:30:15.500130 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1188/2220] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:15 2022] DELETE /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:15.511417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:15.512616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:15.519708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.520609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.521559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.523398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.524097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.525072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.741983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:15.755599 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56b7d659-e91a-49ef-8933-76c6b48b9156 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1520 microversion: 2.1 time: 0.252702 Oct 17 15:30:15.756578 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1189/2221] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:15 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:15.761822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-46be1a3b-d2a3-4e5e-90a0-dcd15ee09952 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:15.762720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-46be1a3b-d2a3-4e5e-90a0-dcd15ee09952 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:15.812519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:15.835896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:15.837473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:15.838780 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3f684bdb-dfba-4831-9a44-87a15d429e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1606 microversion: 2.25 time: 0.544707 Oct 17 15:30:15.839142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-46be1a3b-d2a3-4e5e-90a0-dcd15ee09952 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:15.842280 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1033/2222] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:15 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1606 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:15.848523 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-46be1a3b-d2a3-4e5e-90a0-dcd15ee09952 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1207 microversion: 2.1 time: 0.090559 Oct 17 15:30:15.849105 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1190/2223] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:15 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1207 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:15.850372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:15.851018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:15.867432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:15.869058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:15.871576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.879354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.879354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.879354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.887861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.888499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.888961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.890068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:15.890673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.891672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:15.895733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:15.896786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:16.059557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:16.103010 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef2f95af-5942-4d55-8f96-4ecd753b9d90 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.259646 Oct 17 15:30:16.108381 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1034/2224] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:15 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:16.123132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ffea3573-7750-44e3-a571-4665aee21ac7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:16.123759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ffea3573-7750-44e3-a571-4665aee21ac7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:16.139130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffea3573-7750-44e3-a571-4665aee21ac7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:16.139633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffea3573-7750-44e3-a571-4665aee21ac7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:16.140072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffea3573-7750-44e3-a571-4665aee21ac7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:16.157721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffea3573-7750-44e3-a571-4665aee21ac7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:16.158264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffea3573-7750-44e3-a571-4665aee21ac7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:16.161142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffea3573-7750-44e3-a571-4665aee21ac7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:16.214760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:16.225735 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bfce2d5f-248c-4620-8096-a8a01d22ee9e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1527 microversion: 2.1 time: 0.374905 Oct 17 15:30:16.226640 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1191/2225] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:15 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1527 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:16.299623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:16.300693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:16.308879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:16.309637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:16.310266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:16.311218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:16.312103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:16.313027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:16.321038 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ffea3573-7750-44e3-a571-4665aee21ac7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.211225 Oct 17 15:30:16.322530 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1035/2226] 10.222.0.87 () {60 vars in 1316 bytes} [Mon Oct 17 15:30:16 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-interface => generated 285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:30:16.328135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f973abe4-3f7a-46f1-8648-d1bacb465d7d req-28c610a9-7b84-4bee-ae47-21eb8b3201e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efaed5c1-00db-49f6-b605-36e008e852ce", "name": "network-vif-unplugged", "status": "completed", "tag": "cba2595d-0e84-4461-92a6-9374671ead7b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:16.336845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:16.359577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f973abe4-3f7a-46f1-8648-d1bacb465d7d req-28c610a9-7b84-4bee-ae47-21eb8b3201e0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:16.360654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f973abe4-3f7a-46f1-8648-d1bacb465d7d req-28c610a9-7b84-4bee-ae47-21eb8b3201e0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:16.361254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f973abe4-3f7a-46f1-8648-d1bacb465d7d req-28c610a9-7b84-4bee-ae47-21eb8b3201e0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:16.395708 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f973abe4-3f7a-46f1-8648-d1bacb465d7d req-28c610a9-7b84-4bee-ae47-21eb8b3201e0 service nova] Creating event network-vif-unplugged:cba2595d-0e84-4461-92a6-9374671ead7b for instance efaed5c1-00db-49f6-b605-36e008e852ce on n-h1-854441-12 Oct 17 15:30:16.407483 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f973abe4-3f7a-46f1-8648-d1bacb465d7d req-28c610a9-7b84-4bee-ae47-21eb8b3201e0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083286 Oct 17 15:30:16.410525 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1036/2227] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:16.784238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:16.785344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:16.806419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:16.806984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:16.807432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:16.808372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:16.809000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:16.809428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:16.861456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:16.872177 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f7e9efe-b1f6-4e73-bf70-121348a103dc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.577002 Oct 17 15:30:16.875403 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1192/2228] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:16 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:16.883247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:16.884161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:16.895974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:16.897207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:16.898263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:16.901377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:16.903554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:16.905217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:17.493720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:17.501634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:17.511258 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6bfe2bc8-c7ed-4311-8fa9-8e1f6e540719 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1259 microversion: 2.1 time: 0.628511 Oct 17 15:30:17.525759 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1193/2229] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:16 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1259 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:17.550139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:17.551466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:17.573793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:17.589707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:17.595085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:17.597034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:17.598230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:17.601718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:17.912356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:17.974533 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0dd1a7c3-f99f-4871-b83f-e6ce90b3af1b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.449929 Oct 17 15:30:17.988655 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1194/2230] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:17 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:18.014989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:18.020069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:18.034013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:18.037724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:18.038579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:18.041178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:18.045267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:18.046248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:19.273886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:19.286341 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d320ec93-cb24-41a6-a5bd-d296a1eb9361 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1520 microversion: 2.1 time: 2.506517 Oct 17 15:30:19.291184 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1037/2231] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:16 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1520 bytes in 2512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:19.301429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:19.315889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:19.323902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:19.330762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:19.332423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:19.334228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:19.335414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:19.336170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:19.860775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:19.877763 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f5b8fbaf-9257-4067-8781-af42789e246c tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1390 microversion: 2.1 time: 0.584724 Oct 17 15:30:19.897826 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1038/2232] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:19 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1390 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:19.909965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:19.920516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:19.941058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:19.944935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:19.946364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:19.947953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:19.951113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:19.955245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:20.291279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:20.302762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:20.311705 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53c565ad-a5bc-4ac2-8dcd-97af8dec5e72 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1527 microversion: 2.1 time: 2.303934 Oct 17 15:30:20.313698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1195/2233] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:17 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1527 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:20.322139 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b6399ff5-d1ef-48e8-a255-44dc6559d25a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1265 microversion: 2.1 time: 0.421362 Oct 17 15:30:20.337198 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1039/2234] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:19 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1265 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:20.344628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-df795c01-6d02-4bf4-a63d-45150edae252 req-7846a669-12e5-4f2e-8169-f2ad9449eefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c186d0-403a-49cd-94fc-cfa45e6b5170", "name": "network-vif-unplugged", "status": "completed", "tag": "58b69e6c-3036-4516-ba10-49aa3cb3f009"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:20.353388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:20.354112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:20.363036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:20.364180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:20.364809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:20.365913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:20.367071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:20.367785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:20.377950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-df795c01-6d02-4bf4-a63d-45150edae252 req-7846a669-12e5-4f2e-8169-f2ad9449eefd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:20.387046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-df795c01-6d02-4bf4-a63d-45150edae252 req-7846a669-12e5-4f2e-8169-f2ad9449eefd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:20.387046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-df795c01-6d02-4bf4-a63d-45150edae252 req-7846a669-12e5-4f2e-8169-f2ad9449eefd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:20.413684 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-df795c01-6d02-4bf4-a63d-45150edae252 req-7846a669-12e5-4f2e-8169-f2ad9449eefd service nova] Creating event network-vif-unplugged:58b69e6c-3036-4516-ba10-49aa3cb3f009 for instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 on n-h1-854441-12 Oct 17 15:30:20.426767 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-df795c01-6d02-4bf4-a63d-45150edae252 req-7846a669-12e5-4f2e-8169-f2ad9449eefd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092470 Oct 17 15:30:20.429219 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1196/2235] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:20.442390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:20.444352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:20.459500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:20.463257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:20.464169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:20.466034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:20.466744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:20.469255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:20.551462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:20.609918 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a20be27-15da-4f7a-a03c-78613d54ff1f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.262978 Oct 17 15:30:20.630626 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1040/2236] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:20 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:20.932151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:20.942979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:20.988083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:21.004269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:21.008498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:21.008498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:21.008498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:21.008498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:21.956482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:21.984114 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9ec897ca-3a25-4f69-b556-996023875ba9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1380 microversion: 2.1 time: 1.082047 Oct 17 15:30:22.001186 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1041/2237] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:20 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1380 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:22.026363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:22.027333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:22.035245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.035910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.036434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.037427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.038099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.038706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.133111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.134236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.136084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.137076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lazy-loading 'fault' on Instance uuid 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:22.170984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:22.184555 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-208454df-654b-41e9-9028-8e21e0a567df tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1520 microversion: 2.1 time: 1.753779 Oct 17 15:30:22.185233 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1197/2238] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:20 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1520 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:22.215309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:22.228380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:22.250176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.251519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d69af6a3c14dbab949c56fde26ff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a35484bd44be0938aaabdee3cf4c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:22.252719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.254310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.261296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.263642 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c2829ec1-2e75-490a-8543-7366aef9e823 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 200 len: 1314 microversion: 2.1 time: 0.251430 Oct 17 15:30:22.264797 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1042/2239] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:22 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:22.270057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:22.270963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:22.276497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.280820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.286277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.287170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.287781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.288927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.289693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.290627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.470191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:22.498930 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7f0591c2-964e-4aa7-9e46-3fd1e23f1631 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.232506 Oct 17 15:30:22.525350 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1043/2240] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:22 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:22.530649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-769dfd2d-0d14-4a03-ac26-cdcf8c9052d4 req-0ba23911-cd2e-4eb9-b033-7170d27fbac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ef57e2-eb15-4cff-bcef-afe2ee6258d3", "name": "network-vif-deleted", "tag": "fa2e7b8c-6534-470c-873a-6dbf6700fdd5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:22.544018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-769dfd2d-0d14-4a03-ac26-cdcf8c9052d4 req-0ba23911-cd2e-4eb9-b033-7170d27fbac1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.544641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-769dfd2d-0d14-4a03-ac26-cdcf8c9052d4 req-0ba23911-cd2e-4eb9-b033-7170d27fbac1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.545080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-769dfd2d-0d14-4a03-ac26-cdcf8c9052d4 req-0ba23911-cd2e-4eb9-b033-7170d27fbac1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.565381 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-769dfd2d-0d14-4a03-ac26-cdcf8c9052d4 req-0ba23911-cd2e-4eb9-b033-7170d27fbac1 service nova] Creating event network-vif-deleted:fa2e7b8c-6534-470c-873a-6dbf6700fdd5 for instance 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 on n-h1-854441-12 Oct 17 15:30:22.571399 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-769dfd2d-0d14-4a03-ac26-cdcf8c9052d4 req-0ba23911-cd2e-4eb9-b033-7170d27fbac1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044690 Oct 17 15:30:22.572867 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1044/2241] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:22.581901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7309f84d-88c1-4b76-85c4-8bf4b6a3bd2d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '.version_select at 0x7f28be507940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:22.587120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7309f84d-88c1-4b76-85c4-8bf4b6a3bd2d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.588222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7309f84d-88c1-4b76-85c4-8bf4b6a3bd2d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.589185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7309f84d-88c1-4b76-85c4-8bf4b6a3bd2d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.604379 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7309f84d-88c1-4b76-85c4-8bf4b6a3bd2d tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 2343 microversion: 2.1 time: 0.028113 Oct 17 15:30:22.623133 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1045/2242] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:30:22 2022] GET /compute/v2.1/os-migrations => generated 2343 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:22.628741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-26986673-74f6-45bc-8dce-f5c6c005589e req-52e47ee0-0bc5-4a8d-b237-a710bc0d11ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efaed5c1-00db-49f6-b605-36e008e852ce", "name": "network-vif-plugged", "status": "completed", "tag": "cba2595d-0e84-4461-92a6-9374671ead7b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:22.641850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-26986673-74f6-45bc-8dce-f5c6c005589e req-52e47ee0-0bc5-4a8d-b237-a710bc0d11ed service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.643894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-26986673-74f6-45bc-8dce-f5c6c005589e req-52e47ee0-0bc5-4a8d-b237-a710bc0d11ed service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.644517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-26986673-74f6-45bc-8dce-f5c6c005589e req-52e47ee0-0bc5-4a8d-b237-a710bc0d11ed service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.671042 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-26986673-74f6-45bc-8dce-f5c6c005589e req-52e47ee0-0bc5-4a8d-b237-a710bc0d11ed service nova] Creating event network-vif-plugged:cba2595d-0e84-4461-92a6-9374671ead7b for instance efaed5c1-00db-49f6-b605-36e008e852ce on n-h1-854441-12 Oct 17 15:30:22.676606 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-26986673-74f6-45bc-8dce-f5c6c005589e req-52e47ee0-0bc5-4a8d-b237-a710bc0d11ed service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051844 Oct 17 15:30:22.677530 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1046/2243] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:22.690197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ac1f3083-2620-4a0e-9c98-54813ac2bfa5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:22.691436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ac1f3083-2620-4a0e-9c98-54813ac2bfa5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:22.700700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1f3083-2620-4a0e-9c98-54813ac2bfa5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.701650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1f3083-2620-4a0e-9c98-54813ac2bfa5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.702285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1f3083-2620-4a0e-9c98-54813ac2bfa5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.703341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1f3083-2620-4a0e-9c98-54813ac2bfa5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:22.704016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1f3083-2620-4a0e-9c98-54813ac2bfa5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:22.705971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1f3083-2620-4a0e-9c98-54813ac2bfa5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:22.735668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:22.951096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:22.980618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-482e2f2b-f45f-43a3-a478-0aca82d0e33a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1265 microversion: 2.1 time: 0.790269 Oct 17 15:30:22.989185 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1198/2244] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:22 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1265 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:23.046957 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ac1f3083-2620-4a0e-9c98-54813ac2bfa5 tempest-LiveMigrationTest-1724084738 tempest-LiveMigrationTest-1724084738-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1533 microversion: 2.1 time: 0.367901 Oct 17 15:30:23.049497 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1047/2245] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:22 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1533 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:23.108675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:23.111059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:23.164476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.169279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.172228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:23.176223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.188151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.194119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:23.209590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:23.211909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:23.252432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.256767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.263615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:23.269565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.275332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.276819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:23.380308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:30:23.783445 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7288543-9ced-4cb1-a1f0-e220907fd7ab tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "DELETE /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 204 len: 0 microversion: 2.1 time: 0.687379 Oct 17 15:30:23.792124 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1199/2246] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:23 2022] DELETE /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:23.820742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:23.824010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 29ef57e2-eb15-4cff-bcef-afe2ee6258d3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:23.848476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.849101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.853385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:23.865089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.869675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.870705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:23.872698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:23.885507 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-41abf9e6-47f0-41dc-a951-cad207dfde81 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1520 microversion: 2.1 time: 0.680106 Oct 17 15:30:23.917282 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1048/2247] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:23 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1520 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:23.921438 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Instance 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 could not be found. Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 HTTP/1.1 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 could not be found. Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '29ef57e2-eb15-4cff-bcef-afe2ee6258d3'} Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 could not be found. Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 could not be found. Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:23.923153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 could not be found. Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Instance 29ef57e2-eb15-4cff-bcef-afe2ee6258d3 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:23.928216 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45042ad8-de13-4495-b361-12d95de0d804 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3" status: 404 len: 111 microversion: 2.1 time: 0.130040 Oct 17 15:30:23.932720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:23.934355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:23.941210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.942911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.943529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:23.944723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.945499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.946180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:23.946991 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1200/2248] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:23 2022] GET /compute/v2.1/servers/29ef57e2-eb15-4cff-bcef-afe2ee6258d3 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:23.953114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:23.953969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:23.968456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.969267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.969868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:23.970839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:23.971465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:23.972051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:24.106186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:24.187092 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1332112a-121e-4e84-af78-c95a435a8d57 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.249618 Oct 17 15:30:24.188873 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1049/2249] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:23 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:24.205780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-13f10a93-0f3b-412c-a629-5b02311ce7cb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '.version_select at 0x7f28c2dff670>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:24.262596 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-13f10a93-0f3b-412c-a629-5b02311ce7cb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Image not found. Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-13f10a93-0f3b-412c-a629-5b02311ce7cb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/79cc02b0-bb1f-49b4-9632-dae1eab436ca HTTP/1.1 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '79cc02b0-bb1f-49b4-9632-dae1eab436ca'} Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 79cc02b0-bb1f-49b4-9632-dae1eab436ca to delete Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 79cc02b0-bb1f-49b4-9632-dae1eab436ca could not be found. Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:24.264878 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:30:24.270804 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.276576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-13f10a93-0f3b-412c-a629-5b02311ce7cb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:24.284746 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-13f10a93-0f3b-412c-a629-5b02311ce7cb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/images/79cc02b0-bb1f-49b4-9632-dae1eab436ca" status: 404 len: 62 microversion: 2.1 time: 0.094405 Oct 17 15:30:24.285977 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1050/2250] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:24 2022] DELETE /compute/v2.1/images/79cc02b0-bb1f-49b4-9632-dae1eab436ca => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:30:24.291946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:24.301278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:24.320449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:24.320984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:24.321434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:24.322266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:24.322752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:24.323183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:24.666050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:24.674686 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df5b0ac6-59f6-4844-a73d-debd7f5b066d tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1386 microversion: 2.1 time: 0.725408 Oct 17 15:30:24.679349 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1201/2251] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:23 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1386 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:24.695192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0b5fd2ef-78ed-472d-906f-21e161f14d5c req-8fb8d68a-9135-47a5-a64b-8b47ffb79843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7223bf-635f-444f-98a9-f4764b4cd42c", "tag": "b7b29889-5c2f-436a-b1af-d8cf33437c18"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:24.728552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0b5fd2ef-78ed-472d-906f-21e161f14d5c req-8fb8d68a-9135-47a5-a64b-8b47ffb79843 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:24.733871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0b5fd2ef-78ed-472d-906f-21e161f14d5c req-8fb8d68a-9135-47a5-a64b-8b47ffb79843 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:24.734453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0b5fd2ef-78ed-472d-906f-21e161f14d5c req-8fb8d68a-9135-47a5-a64b-8b47ffb79843 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:24.738300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:24.752018 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-adfd31eb-a0a8-4ea0-a3ed-4b7b65959874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.464591 Oct 17 15:30:24.757392 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0b5fd2ef-78ed-472d-906f-21e161f14d5c req-8fb8d68a-9135-47a5-a64b-8b47ffb79843 service nova] Creating event network-changed:b7b29889-5c2f-436a-b1af-d8cf33437c18 for instance 8b7223bf-635f-444f-98a9-f4764b4cd42c on n-h1-854441-12 Oct 17 15:30:24.770911 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1051/2252] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:24 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:24.779665 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0b5fd2ef-78ed-472d-906f-21e161f14d5c req-8fb8d68a-9135-47a5-a64b-8b47ffb79843 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093440 Oct 17 15:30:24.780852 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1202/2253] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:24.791443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:24.792599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:24.796678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4357fecb-9612-4b5e-9964-7d46168c4902 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Action: 'create', calling method: .version_select at 0x7f28c2f6ce50>, body: {"keypair": {"name": "tempest-keypair-1398717733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYHbtll3Zz7gYmTE/r26VAI4pVtnbp11CT0f98+/37T6gTE+qcs3Minw6tBESwaM9KB1llPc29G1Jc4vYUQuUc76WrylRZnw8ScumvBNNMT5u4x/OPrD8KkVU+RJGLf/g=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:24.817519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:24.822077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:24.825116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:24.826653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:24.828674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:24.831905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:24.861429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4357fecb-9612-4b5e-9964-7d46168c4902 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Getting quotas for project 3df3bc4988604cee968194ee80fbbd82. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:30:24.875712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4357fecb-9612-4b5e-9964-7d46168c4902 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Getting quotas for user 30eeba6526d5434eaa0e8c1ddf728270 and project 3df3bc4988604cee968194ee80fbbd82. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:30:24.876493 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d HTTP/1.1 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '40f10878-2fa0-4b9b-9b65-b296e034dc8d'} Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:24.879492 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:24.886210 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:24.892545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:24.894912 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a7e3f94-2145-4888-b18a-d1047a97ba7e tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 404 len: 111 microversion: 2.1 time: 0.119606 Oct 17 15:30:24.903592 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1052/2254] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:24 2022] DELETE /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:24.916898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:24.919640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: 40f10878-2fa0-4b9b-9b65-b296e034dc8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:24.937549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:24.942543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:24.943527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:24.945646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:24.947315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:24.948277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:24.958768 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4357fecb-9612-4b5e-9964-7d46168c4902 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.171866 Oct 17 15:30:24.961470 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1203/2255] 10.222.0.87 () {62 vars in 1200 bytes} [Mon Oct 17 15:30:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 15:30:24.986388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:24.992086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:25.016860 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:25.019120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d HTTP/1.1 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '40f10878-2fa0-4b9b-9b65-b296e034dc8d'} Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:25.021567 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:25.030563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:25.030563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:25.030563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:25.030563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:25.030563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:25.030563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:25.030563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. Oct 17 15:30:25.030563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:25.031529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:25.031823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:25.035943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:25.036825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:25.037865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:25.048135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Instance 40f10878-2fa0-4b9b-9b65-b296e034dc8d could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:25.049760 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57048bee-e693-4d84-9135-7e8741fecc43 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d" status: 404 len: 111 microversion: 2.1 time: 0.144450 Oct 17 15:30:25.063196 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1053/2256] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:24 2022] GET /compute/v2.1/servers/40f10878-2fa0-4b9b-9b65-b296e034dc8d => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:25.090585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-50ef1f00-e94b-414f-b46f-f7ecbbbf17cb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '.version_select at 0x7f28be507430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:25.114447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:25.169274 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-50ef1f00-e94b-414f-b46f-f7ecbbbf17cb tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1686735731" status: 202 len: 0 microversion: 2.1 time: 0.097850 Oct 17 15:30:25.180792 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1054/2257] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 15:30:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1686735731 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:30:25.222391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:25.223542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:25.236847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:25.241343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:25.241343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:25.245093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:25.246059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:25.246816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:25.547962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:25.600883 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a74a5de6-3393-4afb-8c12-ef8ea7688771 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.383417 Oct 17 15:30:25.614534 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1055/2258] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:25 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:25.699476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:25.700545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:25.709471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:25.710385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:25.711133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:25.712081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:25.712824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:25.713629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:25.937581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:25.950304 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-118603cb-a098-4f42-99d5-bda06afd1a1a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1505 microversion: 2.1 time: 0.986596 Oct 17 15:30:25.952779 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1204/2259] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:24 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1505 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:25.958642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:25.959596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:25.970278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:25.971178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:25.972011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:25.973204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:25.974207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:25.974896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:26.460553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:26.469008 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf6a2d0e-49fb-4dd9-b43e-bab3b043eee9 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1386 microversion: 2.1 time: 0.774789 Oct 17 15:30:26.469804 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1056/2260] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:25 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1386 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:26.483697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:26.484319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:26.504220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:26.504709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:26.505146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:26.505979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:26.506297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:26.506751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:26.674286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:26.688913 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a23aacb1-801c-450b-9793-39f00bae860b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.729582 Oct 17 15:30:26.701603 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1205/2261] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:25 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:26.701603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:26.715174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:26.720600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:26.721141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:26.721576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:26.722652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:26.723277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:26.728243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:27.137363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:27.159573 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f18a8125-e163-4084-bb3d-6b97d5be59b2 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 200 len: 1505 microversion: 2.1 time: 0.688530 Oct 17 15:30:27.175353 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1057/2262] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:26 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 1505 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:27.203935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:27.204624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c258e694-06d2-4722-bcdf-685bcc23e5b7 req-3227451d-7adb-4693-ba02-33df592c092c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66189c64-70e7-4ec5-a3be-20b06e23940d", "name": "network-vif-deleted", "tag": "dad068f7-eefd-42f9-96bb-8092defb7bcf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:27.245489 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc2d44e0-09d2-431c-b790-9b1f03cf1260 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.554213 Oct 17 15:30:27.288937 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1206/2263] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:26 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:27.294894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c258e694-06d2-4722-bcdf-685bcc23e5b7 req-3227451d-7adb-4693-ba02-33df592c092c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:27.298143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c258e694-06d2-4722-bcdf-685bcc23e5b7 req-3227451d-7adb-4693-ba02-33df592c092c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:27.302305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c258e694-06d2-4722-bcdf-685bcc23e5b7 req-3227451d-7adb-4693-ba02-33df592c092c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:27.305357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:27.312333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:27.333645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:27.342756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:27.342756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:27.342756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:27.342756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:27.342756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:27.392786 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c258e694-06d2-4722-bcdf-685bcc23e5b7 req-3227451d-7adb-4693-ba02-33df592c092c service nova] Creating event network-vif-deleted:dad068f7-eefd-42f9-96bb-8092defb7bcf for instance 66189c64-70e7-4ec5-a3be-20b06e23940d on n-h1-854441-12 Oct 17 15:30:27.421743 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c258e694-06d2-4722-bcdf-685bcc23e5b7 req-3227451d-7adb-4693-ba02-33df592c092c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240242 Oct 17 15:30:27.428837 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1058/2264] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:27.500573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:27.507172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:27.516579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:30:27.554616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:27.559708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:27.563683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:27.571680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:27.581782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:27.582970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:27.729652 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4416933e-e00d-4bed-8ff7-a789da5c378b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "DELETE /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 204 len: 0 microversion: 2.1 time: 0.437665 Oct 17 15:30:27.729898 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1207/2265] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:27 2022] DELETE /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:27.745682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-46e4cfc1-eeb8-4c14-9315-adcea15e8e4f req-0cfb0e2e-dffd-40d0-b43f-a60c1590e83b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "463dc9de-88df-4179-b399-6379972b35f8", "tag": "45377c1c-4d2b-4e7f-bed1-b5919c1d80c0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:27.766634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-46e4cfc1-eeb8-4c14-9315-adcea15e8e4f req-0cfb0e2e-dffd-40d0-b43f-a60c1590e83b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:27.773518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-46e4cfc1-eeb8-4c14-9315-adcea15e8e4f req-0cfb0e2e-dffd-40d0-b43f-a60c1590e83b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:27.776714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-46e4cfc1-eeb8-4c14-9315-adcea15e8e4f req-0cfb0e2e-dffd-40d0-b43f-a60c1590e83b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:27.793160 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-46e4cfc1-eeb8-4c14-9315-adcea15e8e4f req-0cfb0e2e-dffd-40d0-b43f-a60c1590e83b service nova] Creating event network-changed:45377c1c-4d2b-4e7f-bed1-b5919c1d80c0 for instance 463dc9de-88df-4179-b399-6379972b35f8 on n-h2-854441-12 Oct 17 15:30:27.799207 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-46e4cfc1-eeb8-4c14-9315-adcea15e8e4f req-0cfb0e2e-dffd-40d0-b43f-a60c1590e83b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067044 Oct 17 15:30:27.800439 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1208/2266] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:27.812185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:27.813550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:27.833437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:27.838060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:27.846964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:27.856973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:27.857742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:27.862287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:28.046848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:28.102877 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-48a3b4c4-ba1d-4773-ae5c-9b2e80413502 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1182 microversion: 2.1 time: 0.611998 Oct 17 15:30:28.133183 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1059/2267] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:27 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1182 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:28.300924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:28.312513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:28.366006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:28.369237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:28.381897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:28.385900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:28.388362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:28.394742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:28.649254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:28.737286 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd852d45-3b72-4f01-959e-8a806e13c5a6 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.457896 Oct 17 15:30:28.750757 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1060/2268] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:28 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:28.750757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1414611560", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "e1442722-4c96-4091-8992-f20bac8a7206"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:28.876302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] validate_networks() for [('e1442722-4c96-4091-8992-f20bac8a7206', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:30:28.989756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:29.001906 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a2a1580-3455-4025-8ef2-1ef3263d795d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 1.199944 Oct 17 15:30:29.011148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1209/2269] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:27 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:29.035068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:29.036018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:29.050637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:29.055639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:29.057838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:29.059551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:29.065646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:29.067056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:29.127628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:29.141324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:30:29.460647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:29.487611 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f91c02ee-9457-4b19-887b-b31bd2328236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 204 len: 0 microversion: 2.1 time: 0.473728 Oct 17 15:30:29.489838 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1210/2270] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:29 2022] DELETE /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:29.504037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:29.513242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:29.533058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:29.535415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:29.537066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:29.538146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:29.539093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:29.540195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:29.685275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:29.730069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4a1002f-4d36-4fcb-849c-7e2fb6dc042b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1182 microversion: 2.1 time: 0.235976 Oct 17 15:30:29.736657 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1211/2271] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:29 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1182 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:29.762955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:29.768321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:29.823142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:29.826304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:29.827687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:29.848172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:29.849792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:29.851482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:30.278940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:30.290153 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3c2a225-be81-47d1-992b-c00304871fa3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1554 microversion: 2.1 time: 0.551423 Oct 17 15:30:30.291320 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1212/2272] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:29 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1554 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:30.296706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:30.297326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:30.315498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:30.316036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:30.316424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:30.317198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:30.317656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:30.318084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:30.494047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:30.527493 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95151952-f766-4f57-924f-d5231b3417d1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.235240 Oct 17 15:30:30.529058 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1213/2273] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:30 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:30.536557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:30.538829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:30.547868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:30.549995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:30.549995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:30.551487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:30.552680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:30.554076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:30.892314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:30:30.894794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:30:30.895471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:30:30.896055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:30:30.896726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:30:30.912067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:30.912820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:30.913446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:30.914369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:30.917338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:30.918120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:30.947986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Getting quotas for project 947ae7af631447ca8963b47e913fb618. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:30:30.957112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Getting quotas for user 62f7ab17b8454d049b81bdd07e41e62f and project 947ae7af631447ca8963b47e913fb618. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:30:31.008458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:30:31.017370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:30:31.097518 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d327cc5e-2d34-4576-a7db-e1b16cc0314f tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.356459 Oct 17 15:30:31.100730 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1061/2274] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:30:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:30:31.110355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:31.115348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6c29271-dc40-400d-92b7-dc676ed78da9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '.version_select at 0x7f28be51edc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:31.153927 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-c6c29271-dc40-400d-92b7-dc676ed78da9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Image not found. Oct 17 15:30:31.160136 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-38e777b8-3fbd-49e4-aabe-3aff6024397a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.629396 Oct 17 15:30:31.165649 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1214/2275] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:30 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6c29271-dc40-400d-92b7-dc676ed78da9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/6b675544-5ff7-4e3b-861a-589f0469f893 HTTP/1.1 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6b675544-5ff7-4e3b-861a-589f0469f893'} Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6b675544-5ff7-4e3b-861a-589f0469f893 to delete Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b675544-5ff7-4e3b-861a-589f0469f893 could not be found. Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:31.167657 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6c29271-dc40-400d-92b7-dc676ed78da9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c6c29271-dc40-400d-92b7-dc676ed78da9 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/images/6b675544-5ff7-4e3b-861a-589f0469f893" status: 404 len: 62 microversion: 2.1 time: 0.064443 Oct 17 15:30:31.180512 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1062/2276] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:31 2022] DELETE /compute/v2.1/images/6b675544-5ff7-4e3b-861a-589f0469f893 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:30:31.200096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-87959a62-d447-48d4-bfea-b3c031b6df47 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:31.200983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-87959a62-d447-48d4-bfea-b3c031b6df47 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:31.216553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:31.217229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:31.282676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:31.284742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:31.285399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:31.286604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:31.287270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:31.288533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:31.483523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-87959a62-d447-48d4-bfea-b3c031b6df47 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:31.513747 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-87959a62-d447-48d4-bfea-b3c031b6df47 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1218 microversion: 2.1 time: 0.333898 Oct 17 15:30:31.531810 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1063/2277] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:31 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1218 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:31.561378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:31.562925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:31.587626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:31.603924 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c07c584-e7fe-4be6-9f48-935ff979b09f tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1182 microversion: 2.1 time: 0.431711 Oct 17 15:30:31.605734 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1215/2278] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:31 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1182 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:31.612267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:31.613809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:31.617154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:31.619471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:31.623745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f7570d23-45d8-456b-9b77-ebe1cfe520d6 req-fa5f5135-3614-490d-9a80-afdf0b394647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efaed5c1-00db-49f6-b605-36e008e852ce", "name": "network-vif-deleted", "tag": "cba2595d-0e84-4461-92a6-9374671ead7b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:31.630007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:31.630973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:31.663360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f7570d23-45d8-456b-9b77-ebe1cfe520d6 req-fa5f5135-3614-490d-9a80-afdf0b394647 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:31.669283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f7570d23-45d8-456b-9b77-ebe1cfe520d6 req-fa5f5135-3614-490d-9a80-afdf0b394647 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:31.670193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f7570d23-45d8-456b-9b77-ebe1cfe520d6 req-fa5f5135-3614-490d-9a80-afdf0b394647 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:31.703589 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f7570d23-45d8-456b-9b77-ebe1cfe520d6 req-fa5f5135-3614-490d-9a80-afdf0b394647 service nova] Creating event network-vif-deleted:cba2595d-0e84-4461-92a6-9374671ead7b for instance efaed5c1-00db-49f6-b605-36e008e852ce on n-h1-854441-12 Oct 17 15:30:31.715288 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f7570d23-45d8-456b-9b77-ebe1cfe520d6 req-fa5f5135-3614-490d-9a80-afdf0b394647 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104853 Oct 17 15:30:31.718698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1216/2279] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:31.742144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:31.747666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:31.769494 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 HTTP/1.1 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd070bb7e-ed9f-40f4-826a-896eaaca1310'} Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:31.781454 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:31.802383 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:31.811596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:31.816289 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1c2e5373-25f8-4dd0-b78f-fe6e8e5af7c5 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 404 len: 111 microversion: 2.1 time: 0.282159 Oct 17 15:30:31.827468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:31.831131 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1064/2280] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:31 2022] DELETE /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 111 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:31.834539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:31.840223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:31.847022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:31.851214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:31.857743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:31.879377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:31.888799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:31.946963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:31.951964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:31.952414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:31.953162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:31.953737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:31.954029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:32.160823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:32.937872 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-30fcda88-8c27-4212-8588-e860ad0402dd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 1.098801 Oct 17 15:30:32.942446 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1065/2281] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:31 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:32.959424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:32.962814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] [instance: d070bb7e-ed9f-40f4-826a-896eaaca1310] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:32.982048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:33.000157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:33.000676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:33.001785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:33.002328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:33.002896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:33.052151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:33.067020 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00c45eea-6da0-479c-9b58-267aa5aa42d6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1554 microversion: 2.1 time: 1.346470 Oct 17 15:30:33.070761 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1217/2282] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:31 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1554 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:33.075546 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] HTTP exception thrown: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:33.081382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Request method failure captured: Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 HTTP/1.1 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXR3OeZUvvA_IRVeAVAnBYoU813dUpEO2QkM_obXc3anDrhsgSgXHX2W5W1gkoPVZ0L5RwRSiv4aRVW1ZXRExQxmhrtVeLPTR25BqC2Y87so1bvNyHbkreLeVxDbWzBtzOG50JKd2iTJaeNFOPed2s-mjysjH1zjxVk0nWlZX5dbwAU Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4e0a35484bd44be0938aaabdee3cf4c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4e0a35484bd44be0938aaabdee3cf4c2 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-817081653 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e5d69af6a3c14dbab949c56fde26ff95 Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-817081653-project Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd070bb7e-ed9f-40f4-826a-896eaaca1310'} Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:33.086273 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:33.091121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:33.091121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:33.091121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:33.091121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:33.091121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:33.091121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:33.091121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. Oct 17 15:30:33.091121 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:30:33.093830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] Returning 404 to user: Instance d070bb7e-ed9f-40f4-826a-896eaaca1310 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:33.096305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:33.104993 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-012dc24b-3a2c-4002-99b2-2226a6a2c330 tempest-ImagesOneServerNegativeTestJSON-817081653 tempest-ImagesOneServerNegativeTestJSON-817081653-project] 10.222.0.87 "GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310" status: 404 len: 111 microversion: 2.1 time: 0.157346 Oct 17 15:30:33.112243 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1066/2283] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:32 2022] GET /compute/v2.1/servers/d070bb7e-ed9f-40f4-826a-896eaaca1310 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:33.126849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-43b78b87-28c2-4a21-abc2-a18c5279a9eb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:33.127506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-43b78b87-28c2-4a21-abc2-a18c5279a9eb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:33.128098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:33.132200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:33.137652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:33.138586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:33.139431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:33.140052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:33.408283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-43b78b87-28c2-4a21-abc2-a18c5279a9eb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:33.435730 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-43b78b87-28c2-4a21-abc2-a18c5279a9eb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1218 microversion: 2.1 time: 0.319925 Oct 17 15:30:33.457415 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1067/2284] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:33 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1218 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:33.489725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:33.499964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:33.527005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:33.531857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:33.532821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:33.538602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:33.539781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:33.540773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:33.899444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:33.940966 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-173dd38b-9392-43a9-8258-a5be8c4a5602 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1182 microversion: 2.1 time: 0.481461 Oct 17 15:30:33.941937 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1068/2285] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:33 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1182 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:33.985737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:33.991232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:34.049023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:34.053115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:34.057378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:34.061663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:34.069651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:34.072132 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3495f7d-6c47-41fe-8eab-3bb4f0fd8438 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.997307 Oct 17 15:30:34.074820 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1218/2286] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:33 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:34.096847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:34.096847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:34.098797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:34.100625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:34.131044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:34.135310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:34.153989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:34.160002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:34.167033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:34.173314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:34.517220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:34.636432 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-04cdc1d6-5be3-4c31-83b0-81f7183fb4ed tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.660181 Oct 17 15:30:34.639124 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1069/2287] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:33 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:30:34.658449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:34.673483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:34.708380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:34.709248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:34.709994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:34.735761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:34.736639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:34.737449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:34.915878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:35.232677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:35.247347 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-18d30641-045a-4b91-9720-0424f98fd88c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1270 microversion: 2.1 time: 0.606414 Oct 17 15:30:35.301976 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1070/2288] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:34 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1270 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:35.319979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-918725345", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "afb6986f-91e8-47f4-ab6d-98ea69b4d7fe"}, {"port": "7638adff-3c05-4d72-827e-6283c228f4dd", "tag": "port-1"}, {"port": "a70fc0cc-532d-48ea-adcb-5fe9b4bf0584", "tag": "port-2"}, {"uuid": "a8980dd7-1e95-46e8-b474-aae49cbd1aca", "tag": "net-1"}, {"uuid": "a8980dd7-1e95-46e8-b474-aae49cbd1aca"}, {"uuid": "1c9fa9d7-d07e-4234-8bac-996c6b0d9f42", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1c9fa9d7-d07e-4234-8bac-996c6b0d9f42", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "827924a9-1da4-4f8c-b99b-f0fd23003d0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "940c921e-0091-4fff-8728-c73d4a040380", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c5943578-d5f3-4210-b2c7-c07d0b4277a0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1586142409"}], "key_name": "tempest-keypair-1398717733", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:35.396047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:35.672891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:35.727276 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d020abd-c675-4705-a025-fe6fd9a71035 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1554 microversion: 2.1 time: 1.636725 Oct 17 15:30:35.740595 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1219/2289] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:34 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1554 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:35.753824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:35.754908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:35.771457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:35.772376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:35.773005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:35.773925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:35.774703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:35.777478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:35.870468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] validate_networks() for [('afb6986f-91e8-47f4-ab6d-98ea69b4d7fe', None, None, None, None, None), (None, None, '7638adff-3c05-4d72-827e-6283c228f4dd', None, None, None), (None, None, 'a70fc0cc-532d-48ea-adcb-5fe9b4bf0584', None, None, None), ('a8980dd7-1e95-46e8-b474-aae49cbd1aca', None, None, None, None, None), ('a8980dd7-1e95-46e8-b474-aae49cbd1aca', None, None, None, None, None), ('1c9fa9d7-d07e-4234-8bac-996c6b0d9f42', '10.2.2.100', None, None, None, None), ('1c9fa9d7-d07e-4234-8bac-996c6b0d9f42', '10.2.2.200', None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:30:35.944653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:35.967717 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2ec171e-4035-47d5-97ea-e109f41d8165 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1182 microversion: 2.1 time: 0.225375 Oct 17 15:30:35.971184 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1220/2290] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:35 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1182 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:35.981296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:35.983604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:35.995020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:35.996330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:35.997881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:36.000226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:36.001105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:36.001983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:36.343464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:36.354574 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c81a4b75-4784-42d1-b140-7a365db037bb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.381096 Oct 17 15:30:36.374295 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1221/2291] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:35 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:36.382376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-aec40d3a-5cc4-46d1-bc2e-0f39ec59053b req-8b032735-b137-472a-b7e9-020e6b15bdea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f40ea7d-a231-4b2e-a119-3213a97b26ba", "name": "network-vif-deleted", "tag": "c7be5f5a-5ba7-4598-9141-b53977055e65"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:36.398796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-aec40d3a-5cc4-46d1-bc2e-0f39ec59053b req-8b032735-b137-472a-b7e9-020e6b15bdea service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:36.399202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-aec40d3a-5cc4-46d1-bc2e-0f39ec59053b req-8b032735-b137-472a-b7e9-020e6b15bdea service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:36.399683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-aec40d3a-5cc4-46d1-bc2e-0f39ec59053b req-8b032735-b137-472a-b7e9-020e6b15bdea service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:36.413747 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-aec40d3a-5cc4-46d1-bc2e-0f39ec59053b req-8b032735-b137-472a-b7e9-020e6b15bdea service nova] Creating event network-vif-deleted:c7be5f5a-5ba7-4598-9141-b53977055e65 for instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba on n-h2-854441-12 Oct 17 15:30:36.419459 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-aec40d3a-5cc4-46d1-bc2e-0f39ec59053b req-8b032735-b137-472a-b7e9-020e6b15bdea service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043683 Oct 17 15:30:36.420313 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1222/2292] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:36.426815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:36.427621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:36.436607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:36.437376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:36.437923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:36.439394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:36.439559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:36.440106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:36.588495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:36.638784 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ace8196b-5650-4ff3-b780-283d4ff0245f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.217119 Oct 17 15:30:36.639743 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1223/2293] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:36 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:36.646857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:36.647980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:36.655641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:36.656582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:36.657307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:36.663742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:36.664826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:36.665606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:36.793534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:36.816353 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-267e3d02-6da4-4518-990e-60d11f415fe4 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1276 microversion: 2.1 time: 0.175165 Oct 17 15:30:36.822366 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1224/2294] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:36 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:36.830587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:36.831504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:36.850775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:36.852146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:36.852939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:36.856934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:36.859670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:36.860386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:36.986935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:36.990763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:37.008478 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a152505-d177-44ae-b83c-fbe81eb15b6b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1345 microversion: 2.1 time: 0.184560 Oct 17 15:30:37.009777 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1225/2295] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:36 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:37.021569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:37.023746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:37.041284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:37.041782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:37.042228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:37.042984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:37.043446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:37.043875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:37.175276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:37.191593 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f95cf1f5-c70a-47e9-9a23-a3962e11f349 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 200 len: 1182 microversion: 2.1 time: 0.177730 Oct 17 15:30:37.192443 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1226/2296] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:37 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 1182 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:37.383295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:37.383997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:37.405378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:37.405881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:37.406334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:37.407088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:37.414982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:37.415693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:38.624736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:38.662104 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6fca4b5-60b1-4491-88c8-24818a6230a4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 1.279979 Oct 17 15:30:38.664041 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1227/2297] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:37 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:38.692031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:38.693510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:38.730145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:38.731618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:38.732259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:38.734533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:38.737832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:38.742806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:38.984807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:39.086242 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a8b9d88-5ec9-4be4-9f5a-805084f5a1f3 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.419336 Oct 17 15:30:39.098070 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1228/2298] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:38 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:39.137723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:39.140505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:39.162440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:39.169931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:39.171095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:39.176335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:39.182159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:39.183353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:39.542594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:39.557068 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac1c5db3-454c-4d18-b2c9-fb0f9a515cac tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1318 microversion: 2.1 time: 0.467412 Oct 17 15:30:39.557994 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1229/2299] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:39 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:39.566612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:39.575434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:39.584617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:39.588252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:39.591095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:39.592135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:39.595213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:39.595887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:39.724638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:39.739094 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4f88348-134b-4e9c-9583-7650c2ba8145 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1345 microversion: 2.1 time: 0.179737 Oct 17 15:30:39.741057 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1230/2300] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:39 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:39.747799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:39.748697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 66189c64-70e7-4ec5-a3be-20b06e23940d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:39.755906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:39.757221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:39.757925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:39.759141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:39.759838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:39.760487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:39.782164 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] HTTP exception thrown: Instance 66189c64-70e7-4ec5-a3be-20b06e23940d could not be found. Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Request method failure captured: Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d HTTP/1.1 Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOLmfFwgk_ZQCuhxZvfajtzc1xwyl5ZP03KBNNFxl2mYkeBYGhqSPyOoQhsmngLF1wyxiuGkJW_H75csjEuvCA1gDvV2q-ws5RaPtbMco157-ejDAl65NSkBj5PPKBdpIoMG5kB0zy-02fKF3C2jig_7qJ98WGxK8CnzjrF4RyTSCw Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 243aa6b3387c4549b5c94ec1ddc5c850 Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-LiveMigrationTest-1409490073 Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-LiveMigrationTest-1409490073 Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 243aa6b3387c4549b5c94ec1ddc5c850 Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-LiveMigrationTest-1409490073 Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-LiveMigrationTest-1409490073-project Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 13c8d45b2e4d459d92b024476b2f4fbd Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-LiveMigrationTest-1409490073-project Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 66189c64-70e7-4ec5-a3be-20b06e23940d could not be found. Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '66189c64-70e7-4ec5-a3be-20b06e23940d'} Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66189c64-70e7-4ec5-a3be-20b06e23940d could not be found. Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66189c64-70e7-4ec5-a3be-20b06e23940d could not be found. Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:39.784538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:39.789707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:39.789707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:39.789707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:39.789707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:39.789707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:39.789707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66189c64-70e7-4ec5-a3be-20b06e23940d could not be found. Oct 17 15:30:39.789707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:39.792277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Returning 404 to user: Instance 66189c64-70e7-4ec5-a3be-20b06e23940d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:39.794718 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c5bb78d-eee4-4578-a59c-6aef53ba78fc tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d" status: 404 len: 111 microversion: 2.1 time: 0.052364 Oct 17 15:30:39.795603 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1231/2301] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:39 2022] GET /compute/v2.1/servers/66189c64-70e7-4ec5-a3be-20b06e23940d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:39.801869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:39.802784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:39.811249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:39.814375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:39.815166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:39.816427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:39.817118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:39.817775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:40.169246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:40.184002 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-75fd6018-12d4-475a-995c-6444578f4d85 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.387026 Oct 17 15:30:40.184611 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1232/2302] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:39 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:40.190162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:40.193295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:40.205580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:40.206167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:40.212929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:40.214046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:40.216843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:40.217619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:40.379340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:40.453743 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0db1ecb6-b18c-4519-a9e6-c0fb8859438a tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.267468 Oct 17 15:30:40.476429 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1233/2303] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:40 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:40.581855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:40.582990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:40.592088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:40.592532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:40.593668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:40.593668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:40.594094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:40.594559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:40.904166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:40.918900 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bc7c8f6-6be8-46ea-9deb-e9bc866c516c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1318 microversion: 2.1 time: 0.338237 Oct 17 15:30:40.919953 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1234/2304] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:40 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:40.927481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:40.931917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:40.932554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:40.952918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:40.953421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:40.953857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:40.954594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:40.955120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:40.955576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:41.071986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:41.083592 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b0ac3bc-9a5f-4d8c-b644-39187408b282 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1345 microversion: 2.1 time: 0.162473 Oct 17 15:30:41.093793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1235/2305] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:40 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:41.205246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-901b3a3e-eef6-4614-9bc3-2fb9c26685de req-25c0eed4-65d5-4880-a020-6c6057b55933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb70717-c1e8-403a-970f-035f1442dae3", "tag": "c86cb9a6-5221-48ce-8dc2-8707a86f9a1f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:41.219713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-901b3a3e-eef6-4614-9bc3-2fb9c26685de req-25c0eed4-65d5-4880-a020-6c6057b55933 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:41.220673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-901b3a3e-eef6-4614-9bc3-2fb9c26685de req-25c0eed4-65d5-4880-a020-6c6057b55933 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:41.221948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-901b3a3e-eef6-4614-9bc3-2fb9c26685de req-25c0eed4-65d5-4880-a020-6c6057b55933 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:41.242631 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-901b3a3e-eef6-4614-9bc3-2fb9c26685de req-25c0eed4-65d5-4880-a020-6c6057b55933 service nova] Creating event network-changed:c86cb9a6-5221-48ce-8dc2-8707a86f9a1f for instance 7fb70717-c1e8-403a-970f-035f1442dae3 on n-h1-854441-12 Oct 17 15:30:41.249487 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-901b3a3e-eef6-4614-9bc3-2fb9c26685de req-25c0eed4-65d5-4880-a020-6c6057b55933 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048098 Oct 17 15:30:41.251390 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1236/2306] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:41.263727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:41.265715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:41.276220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:41.277090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:41.277716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:41.278774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:41.279419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:41.280116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:41.517558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:41.528104 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d53f6559-644c-4b48-9729-659e9e3d3fbf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.275195 Oct 17 15:30:41.529227 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1237/2307] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:41 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:41.534947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:41.536152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:41.544324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:41.544972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:41.545651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:41.546576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:41.550536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:41.550536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:41.642817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:41.664440 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3207759-aae7-4303-8d58-0498be689d6b tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.133916 Oct 17 15:30:41.680293 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1238/2308] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:41 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:41.942923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:41.947164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:41.956541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:41.957337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:41.958588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:41.958588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:41.960655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:41.960655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:42.135164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:30:42.136862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:30:42.137742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:30:42.138393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:30:42.139079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:30:42.157669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:42.169389 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d244570c-9a4a-48bd-b1e5-11a17cddf696 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1318 microversion: 2.1 time: 0.230699 Oct 17 15:30:42.172086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:42.173040 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1239/2309] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:41 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:42.175285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:42.175989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:42.178690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:42.182008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:42.182448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:42.183168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:42.187435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:42.201625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:42.203066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:42.204949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:42.205931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:42.207432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:42.209243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:42.210272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:42.230053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Getting quotas for project 3df3bc4988604cee968194ee80fbbd82. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:30:42.235778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Getting quotas for user 30eeba6526d5434eaa0e8c1ddf728270 and project 3df3bc4988604cee968194ee80fbbd82. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:30:42.427899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:42.446536 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-471f1380-dc27-41d0-bb87-d89a7ae3f7f5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1345 microversion: 2.1 time: 0.270600 Oct 17 15:30:42.464007 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1240/2310] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:42 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1345 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:42.563421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:42.564377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:42.571664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:42.572962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:42.573615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:42.574684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:42.575227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:42.575771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:42.823800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:30:42.826540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='827924a9-1da4-4f8c-b99b-f0fd23003d0c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='940c921e-0091-4fff-8728-c73d4a040380',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5943578-d5f3-4210-b2c7-c07d0b4277a0',volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:30:42.889150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:42.898935 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d982de13-a5c9-42f8-93d9-5edb09c67427 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.346664 Oct 17 15:30:42.918531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1241/2311] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:42 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:42.918531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:42.918531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:42.934689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:42.934959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:42.935413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:42.936210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:42.936697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:42.937164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:43.067628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:43.075648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:43.103134 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ed33485-39d3-45f6-8eec-1ec725fce7c8 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1929 microversion: 2.75 time: 0.197353 Oct 17 15:30:43.104077 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1242/2312] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:42 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1929 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:43.109956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4972d63f-2c11-4c5b-b565-c75428df2b9a req-7a523c60-37c5-480e-927a-9d42add16507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "463dc9de-88df-4179-b399-6379972b35f8", "name": "network-vif-plugged", "status": "completed", "tag": "45377c1c-4d2b-4e7f-bed1-b5919c1d80c0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:43.120799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4972d63f-2c11-4c5b-b565-c75428df2b9a req-7a523c60-37c5-480e-927a-9d42add16507 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:43.121286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4972d63f-2c11-4c5b-b565-c75428df2b9a req-7a523c60-37c5-480e-927a-9d42add16507 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:43.121775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4972d63f-2c11-4c5b-b565-c75428df2b9a req-7a523c60-37c5-480e-927a-9d42add16507 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:43.151337 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4972d63f-2c11-4c5b-b565-c75428df2b9a req-7a523c60-37c5-480e-927a-9d42add16507 service nova] Creating event network-vif-plugged:45377c1c-4d2b-4e7f-bed1-b5919c1d80c0 for instance 463dc9de-88df-4179-b399-6379972b35f8 on n-h2-854441-12 Oct 17 15:30:43.168491 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4972d63f-2c11-4c5b-b565-c75428df2b9a req-7a523c60-37c5-480e-927a-9d42add16507 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062665 Oct 17 15:30:43.172737 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1243/2313] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:43.202553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:43.203650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:43.215953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:43.219516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:43.220380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:43.221477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:43.222159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:43.222841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:43.470957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:43.482266 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf7eec95-2813-453d-8d6c-e4ee991d351c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1318 microversion: 2.1 time: 0.285726 Oct 17 15:30:43.495793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1244/2314] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:43 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:43.498099 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed30b230-f8d1-4d09-b2e0-adf7321bf0be tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.194432 Oct 17 15:30:43.499653 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1071/2315] 10.222.0.87 () {62 vars in 1189 bytes} [Mon Oct 17 15:30:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 8197 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:30:43.506463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:43.507456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:43.512727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d53d9766-802a-404c-b4cf-b689fd6e6ca7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:43.513362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d53d9766-802a-404c-b4cf-b689fd6e6ca7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:43.515913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:43.516815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:43.517445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:43.518338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:43.518992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:43.519791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:43.657277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:43.669174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d53d9766-802a-404c-b4cf-b689fd6e6ca7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:43.675278 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16103207-ee5c-4656-95e6-0ec91aaa0f26 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1345 microversion: 2.1 time: 0.177473 Oct 17 15:30:43.675925 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1245/2316] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:43 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:43.681986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d53d9766-802a-404c-b4cf-b689fd6e6ca7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:43.684449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d53d9766-802a-404c-b4cf-b689fd6e6ca7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:43.686432 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d53d9766-802a-404c-b4cf-b689fd6e6ca7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1285 microversion: 2.32 time: 0.178956 Oct 17 15:30:43.687901 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1072/2317] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:43 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:43.943355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:43.945200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:43.963337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:43.965681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:43.966991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:43.968084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:43.968844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:43.969933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:44.155909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:44.156880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:44.177211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:44.181156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:44.183682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:44.189423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:44.190994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:44.194207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:44.207621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:44.220452 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-daff9f30-d676-47b3-80ed-5093733cde51 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.287448 Oct 17 15:30:44.226740 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1246/2318] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:43 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:44.511656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:44.512262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:44.523712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:44.525685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:44.526087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:44.529733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:44.532961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:44.533977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:44.748685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:44.791639 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e68e61d2-cc89-467d-bd7f-6a4fb6c40ffd tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1935 microversion: 2.75 time: 0.641737 Oct 17 15:30:44.794874 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1073/2319] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:44 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1935 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:30:44.800431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:44.803150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:44.822776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:44.823562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:44.824174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:44.825090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:44.832970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:44.834084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:44.839929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:44.849232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-abfe9b95-edc2-4e82-af7b-60b0abd04849 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1318 microversion: 2.1 time: 0.342785 Oct 17 15:30:44.850092 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1247/2320] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:44 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:30:44.855439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16b4befe-3694-4e06-8011-44c635bcda06 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:44.856345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16b4befe-3694-4e06-8011-44c635bcda06 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:44.941804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16b4befe-3694-4e06-8011-44c635bcda06 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:44.954578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16b4befe-3694-4e06-8011-44c635bcda06 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:44.957808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16b4befe-3694-4e06-8011-44c635bcda06 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:44.959975 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16b4befe-3694-4e06-8011-44c635bcda06 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1285 microversion: 2.32 time: 0.108597 Oct 17 15:30:44.968250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:44.991698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1248/2321] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:44 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:45.003759 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1d1ebd7-336b-45a2-8afb-a258f3585490 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1345 microversion: 2.1 time: 0.203727 Oct 17 15:30:45.005618 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1074/2322] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:44 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1345 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:45.271063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:45.271868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:45.285953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:45.286361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:45.286828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:45.287565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:45.287994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:45.290898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:45.558670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:45.590284 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-266289a2-f5eb-4f80-9cfd-27450b318afc tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1307 microversion: 2.1 time: 0.327232 Oct 17 15:30:45.592654 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1249/2323] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:45 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:45.821935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:45.823679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:45.831838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:45.832731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:45.833400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:45.834330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:45.835119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:45.835804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:45.888106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:45.891447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:45.911639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:45.912158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:45.912600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:45.914434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:45.914434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:45.914434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:45.967053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:46.013353 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7afb10a7-25bc-4de5-8f35-6e418ebc078f tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1935 microversion: 2.75 time: 0.195489 Oct 17 15:30:46.013353 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1075/2324] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:45 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1935 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:46.037229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:46.040446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:46.059735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:46.060272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:46.061837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:46.062023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:46.062838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:46.063532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:46.166479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:46.179533 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6cdfe10e-536b-4a65-8f9d-1e09bfea3054 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1318 microversion: 2.1 time: 0.298577 Oct 17 15:30:46.181306 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1250/2325] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:45 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:46.188129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:46.189054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:46.199482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:46.200768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:46.201497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:46.202749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:46.203589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:46.207071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:46.309751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:46.321838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:46.323017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:46.323874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:46.326218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lazy-loading 'fault' on Instance uuid 0f40ea7d-a231-4b2e-a119-3213a97b26ba {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:46.413162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:46.429309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:46.430702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:46.434776 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0e559a59-b532-4868-b75e-d985f3e1035d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1575 microversion: 2.32 time: 0.418896 Oct 17 15:30:46.437417 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1076/2326] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:46 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1575 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:46.453891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:46.468780 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a2a750b-0404-4dac-8f3b-8bcea2c24a18 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 200 len: 1350 microversion: 2.1 time: 0.285308 Oct 17 15:30:46.475278 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1251/2327] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:46 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 1350 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:46.618743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:46.619897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:46.663379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:46.663379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:46.663743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:46.664302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:46.664876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:46.665308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.044426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:47.045964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:47.074766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:47.077203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.078069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.078862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.080085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.083886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.085170 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-19768cec-91f8-4b05-a307-262dc46ceea8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1487 microversion: 2.1 time: 0.471235 Oct 17 15:30:47.087285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.103005 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1077/2328] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:46 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1487 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:47.108738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:47.109465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:47.128857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.132249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.138739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.141779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.142474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.143097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.194078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:30:47.310272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] Lazy-loading 'services' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:47.365329 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e31d2a64-9124-40ba-a0e6-4e92ac4725c1 tempest-ServersAdmin275Test-2034690822 tempest-ServersAdmin275Test-2034690822-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1920 microversion: 2.75 time: 0.324705 Oct 17 15:30:47.403569 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1252/2329] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:47 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1920 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:30:47.424424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:47.427615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:47.442745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.445859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.448408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.450174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.451085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.453334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.501520 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a5cc3c46-e7b8-428c-8640-6a00af13210d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 204 len: 0 microversion: 2.1 time: 0.396048 Oct 17 15:30:47.527900 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1078/2330] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:47 2022] DELETE /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:47.566116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:47.567140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:47.613770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.614645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.615420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.616658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.617457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.618256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.769602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:30:47.829983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:47.841459 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4069df08-a49b-4d5c-adf2-4c60908a82cb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1318 microversion: 2.1 time: 0.436483 Oct 17 15:30:47.842543 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1253/2331] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:47 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:47.850250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:47.851249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:47.862037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.863072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.863809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:47.865536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:47.866857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:47.867508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.060337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:48.081538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:48.087994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:48.091270 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdfc3a95-49c8-45b1-893c-5aae7b9cc720 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1593 microversion: 2.32 time: 0.247117 Oct 17 15:30:48.095375 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1254/2332] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:47 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1593 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:48.105279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:48.107124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:48.121884 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2da1ced-f072-4c14-9c17-3d4f75ae04bd tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "DELETE /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 204 len: 0 microversion: 2.75 time: 0.589897 Oct 17 15:30:48.125126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:48.127124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:48.128570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.129726 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1079/2333] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:30:47 2022] DELETE /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:30:48.131449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:48.132011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:48.133938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.149420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:48.156388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:48.171797 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba HTTP/1.1 Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '0f40ea7d-a231-4b2e-a119-3213a97b26ba'} Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:48.175049 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0ca0f9c-3fea-4761-a140-0a8997b40979 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 404 len: 111 microversion: 2.1 time: 0.083436 Oct 17 15:30:48.190719 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1255/2334] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:48 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:48.195951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:48.195951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:48.195951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.195951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:48.195951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:48.195951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.203196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:48.203196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:48.228349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:48.229208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:48.229684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.230365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:48.230851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:48.231270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.472179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:48.505256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:48.506776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:48.526609 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bcf7e34-2564-4b59-9fef-627de0710bee tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1443 microversion: 2.75 time: 0.341774 Oct 17 15:30:48.531629 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1256/2335] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:48 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1443 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:48.546678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a2993829-2e95-42f6-b966-4c0cb4b4d6aa req-e5a59962-b0e5-4f00-9384-e870ad59d255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb70717-c1e8-403a-970f-035f1442dae3", "name": "network-vif-plugged", "status": "completed", "tag": "c86cb9a6-5221-48ce-8dc2-8707a86f9a1f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:48.573706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2993829-2e95-42f6-b966-4c0cb4b4d6aa req-e5a59962-b0e5-4f00-9384-e870ad59d255 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:48.578395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2993829-2e95-42f6-b966-4c0cb4b4d6aa req-e5a59962-b0e5-4f00-9384-e870ad59d255 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:48.579294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2993829-2e95-42f6-b966-4c0cb4b4d6aa req-e5a59962-b0e5-4f00-9384-e870ad59d255 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.609377 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a2993829-2e95-42f6-b966-4c0cb4b4d6aa req-e5a59962-b0e5-4f00-9384-e870ad59d255 service nova] Creating event network-vif-plugged:c86cb9a6-5221-48ce-8dc2-8707a86f9a1f for instance 7fb70717-c1e8-403a-970f-035f1442dae3 on n-h1-854441-12 Oct 17 15:30:48.623726 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a2993829-2e95-42f6-b966-4c0cb4b4d6aa req-e5a59962-b0e5-4f00-9384-e870ad59d255 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089320 Oct 17 15:30:48.625114 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1257/2336] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:48.639204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:48.653525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:48.689149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:48.690886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:48.691640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.693365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:48.695367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:48.699183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:48.732889 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba/os-volume_attachments HTTP/1.1 Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': '0f40ea7d-a231-4b2e-a119-3213a97b26ba'} Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:48.744158 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:48.748773 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a41f4447-833e-4a70-a9c5-08e2d08a7324 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.117629 Oct 17 15:30:48.755750 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1258/2337] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:30:48 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba/os-volume_attachments => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:49.072170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70b0630d-30c1-40c1-9461-f4a72f358261 tempest-ListImageFiltersNegativeTestJSON-1689154159 tempest-ListImageFiltersNegativeTestJSON-1689154159-project] Calling method '.version_select at 0x7f28bef40430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:49.108822 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-70b0630d-30c1-40c1-9461-f4a72f358261 tempest-ListImageFiltersNegativeTestJSON-1689154159 tempest-ListImageFiltersNegativeTestJSON-1689154159-project] HTTP exception thrown: Image not found. Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70b0630d-30c1-40c1-9461-f4a72f358261 tempest-ListImageFiltersNegativeTestJSON-1689154159 tempest-ListImageFiltersNegativeTestJSON-1689154159-project] Request method failure captured: Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/images/9f15e334-f80c-40da-857a-84cbfabd48fe HTTP/1.1 Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXUo5VFiNpC4vzktDkBJ88v6mzbpWNJvb2Pv3a_bM9nIJpy34GWfbHGSCteVBhFoN_Wb01S86D3sAg909HJXuhnrJDg7feIsU5UbI1TX8QVMNBTPsR3XRCsF7XdjMwuZ4Wp-L5_FiZitCL9TPtqO93O2O_XsbkaPaBGIW90UQU31f8s Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: a913a7a2dc0940c7ac5f8be99c1dbf94 Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1689154159 Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a913a7a2dc0940c7ac5f8be99c1dbf94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a913a7a2dc0940c7ac5f8be99c1dbf94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a913a7a2dc0940c7ac5f8be99c1dbf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a913a7a2dc0940c7ac5f8be99c1dbf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1689154159 Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: a913a7a2dc0940c7ac5f8be99c1dbf94 Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1689154159 Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ListImageFiltersNegativeTestJSON-1689154159-project Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b90973b314964b509c8e2d834210b48d Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1689154159-project Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: exception: Image not found. Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '9f15e334-f80c-40da-857a-84cbfabd48fe'} Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9f15e334-f80c-40da-857a-84cbfabd48fe Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:30:49.111869 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f15e334-f80c-40da-857a-84cbfabd48fe could not be found. Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70b0630d-30c1-40c1-9461-f4a72f358261 tempest-ListImageFiltersNegativeTestJSON-1689154159 tempest-ListImageFiltersNegativeTestJSON-1689154159-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:49.119791 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70b0630d-30c1-40c1-9461-f4a72f358261 tempest-ListImageFiltersNegativeTestJSON-1689154159 tempest-ListImageFiltersNegativeTestJSON-1689154159-project] 10.222.0.87 "GET /compute/v2.1/images/9f15e334-f80c-40da-857a-84cbfabd48fe" status: 404 len: 62 microversion: 2.1 time: 0.356540 Oct 17 15:30:49.125839 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1259/2338] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:30:48 2022] GET /compute/v2.1/images/9f15e334-f80c-40da-857a-84cbfabd48fe => generated 62 bytes in 364 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:30:49.131141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:49.132129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:49.143252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:49.145014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:49.146194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:49.150430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:49.151219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:49.152041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:49.790859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:49.799276 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cb2bda9-40bd-4e58-b60a-e1cf01026894 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1318 microversion: 2.1 time: 0.677425 Oct 17 15:30:49.799888 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1260/2339] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:49 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:49.818524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:49.824319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:49.839700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:49.841797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:49.845564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:49.849336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:49.850384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:49.861167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:50.194430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:50.209556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:50.215323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:50.217680 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d695fac6-6506-47a3-8ef1-76a8222789b7 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1661 microversion: 2.32 time: 0.411527 Oct 17 15:30:50.225451 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1261/2340] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:49 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1661 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:50.250554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2112310059", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "fbf48d23-b6f0-48de-b73a-9c8aad4ee168"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:50.302759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:50.327318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5fbc31ea-245e-45cb-9765-f2e390fa9f7f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1493 microversion: 2.1 time: 2.190506 Oct 17 15:30:50.339678 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1080/2341] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:48 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1493 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:50.345575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] validate_networks() for [('fbf48d23-b6f0-48de-b73a-9c8aad4ee168', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:30:50.374886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:50.375918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:50.386815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:50.399441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:50.400354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:50.401378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:50.402082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:50.402796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:50.779024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 8b7223bf-635f-444f-98a9-f4764b4cd42c {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:50.838150 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-74785a86-4766-4ea6-bb68-d7c3e780433c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 2344 microversion: 2.25 time: 0.484299 Oct 17 15:30:50.852322 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1081/2342] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:50 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 2344 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:50.880260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:50.881540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:50.900369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:50.901446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:50.902457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:50.904202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:50.905358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:50.906319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:51.326875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:51.359811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:51.367351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:51.389521 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23feb675-a188-416b-9c7b-57590e894835 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1443 microversion: 2.75 time: 0.534037 Oct 17 15:30:51.394066 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1082/2343] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:50 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1443 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:51.411665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:51.413822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:51.449437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:51.461045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:51.465171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:51.472159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:51.472956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:51.482037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:51.699646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:30:51.701291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:30:51.702286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:30:51.703304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:30:51.704243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:30:51.761689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:51.763212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:51.764304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:51.765877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:51.766975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:51.767680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:51.867821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:30:51.890119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for user 745a483a369e4e83849cee037f5b67ab and project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:30:51.937839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:30:51.955615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 6cdaacde-1d92-4613-9434-fc02bb1a88ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:30:52.144526 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d01c8058-a26e-48fc-8251-13e9b8c25d07 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.916238 Oct 17 15:30:52.151205 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1262/2344] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:30:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:30:52.183941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4c6de50-5cc0-46bc-8712-daddc5dfc52e tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:52.198404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c6de50-5cc0-46bc-8712-daddc5dfc52e tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:52.201748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c6de50-5cc0-46bc-8712-daddc5dfc52e tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:52.202941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c6de50-5cc0-46bc-8712-daddc5dfc52e tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:52.204823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c6de50-5cc0-46bc-8712-daddc5dfc52e tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:52.207922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c6de50-5cc0-46bc-8712-daddc5dfc52e tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:52.208871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c6de50-5cc0-46bc-8712-daddc5dfc52e tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:52.211261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:52.277675 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4c6de50-5cc0-46bc-8712-daddc5dfc52e tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.122001 Oct 17 15:30:52.280518 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1263/2345] 10.222.0.87 () {60 vars in 1217 bytes} [Mon Oct 17 15:30:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:30:52.286115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:52.287177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:52.313328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:52.317031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:52.319682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:52.321924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:52.324756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:52.325341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:52.385766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:52.449865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:52.473086 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-65914833-f7dc-4b50-baf8-b2bb51a5f762 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1318 microversion: 2.1 time: 1.070714 Oct 17 15:30:52.493702 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1083/2346] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:51 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1318 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:52.503216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:52.505709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:52.517216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:52.523827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:52.524575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:52.533076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:52.533920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:52.534378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:52.656719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:52.662571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:52.663050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:52.663532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lazy-loading 'fault' on Instance uuid 463dc9de-88df-4179-b399-6379972b35f8 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:52.788249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:52.795949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:52.806030 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7caea733-a652-4a0f-a229-6c02f7b04f80 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 200 len: 1297 microversion: 2.1 time: 0.310096 Oct 17 15:30:52.812451 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1084/2347] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:52 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 1297 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:52.817873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a0779e1e-5488-48e6-98d5-99fa6f83c32e req-b126908e-c8c1-434f-ab13-1705e0ddfe02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "463dc9de-88df-4179-b399-6379972b35f8", "name": "network-vif-deleted", "tag": "45377c1c-4d2b-4e7f-bed1-b5919c1d80c0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:52.855019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:52.866409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:52.874896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a0779e1e-5488-48e6-98d5-99fa6f83c32e req-b126908e-c8c1-434f-ab13-1705e0ddfe02 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:52.876564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a0779e1e-5488-48e6-98d5-99fa6f83c32e req-b126908e-c8c1-434f-ab13-1705e0ddfe02 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:52.878993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a0779e1e-5488-48e6-98d5-99fa6f83c32e req-b126908e-c8c1-434f-ab13-1705e0ddfe02 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:52.893118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:52.894419 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f2c870d-894e-47de-a9db-b2efc8a040ea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1708 microversion: 2.32 time: 0.612585 Oct 17 15:30:52.898038 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1264/2348] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:52 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1708 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:52.915654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c443dc3-cd8e-404e-959e-afdef9b85ea1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:52.915654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6c443dc3-cd8e-404e-959e-afdef9b85ea1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 6cdaacde-1d92-4613-9434-fc02bb1a88ee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:52.920389 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a0779e1e-5488-48e6-98d5-99fa6f83c32e req-b126908e-c8c1-434f-ab13-1705e0ddfe02 service nova] Creating event network-vif-deleted:45377c1c-4d2b-4e7f-bed1-b5919c1d80c0 for instance 463dc9de-88df-4179-b399-6379972b35f8 on n-h2-854441-12 Oct 17 15:30:52.943715 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a0779e1e-5488-48e6-98d5-99fa6f83c32e req-b126908e-c8c1-434f-ab13-1705e0ddfe02 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127193 Oct 17 15:30:52.947787 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1085/2349] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:52.973358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:52.974281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:53.007215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:53.009392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:53.010095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:53.012517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:53.016108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:53.016719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:53.143312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c443dc3-cd8e-404e-959e-afdef9b85ea1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:53.152146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c443dc3-cd8e-404e-959e-afdef9b85ea1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee" status: 200 len: 1215 microversion: 2.1 time: 0.252723 Oct 17 15:30:53.152754 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1265/2350] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:52 2022] GET /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:53.193766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0afec1df-e1fc-4eed-8214-9a6c33d630ab tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:53.200357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0afec1df-e1fc-4eed-8214-9a6c33d630ab tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 6cdaacde-1d92-4613-9434-fc02bb1a88ee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:53.235897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:53.236600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:53.237387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:53.238023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lazy-loading 'fault' on Instance uuid 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:30:53.315954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0afec1df-e1fc-4eed-8214-9a6c33d630ab tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 6cdaacde-1d92-4613-9434-fc02bb1a88ee] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:30:53.431702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:53.454043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:53.462255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edc795b73d074003b95e575920f10249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f7c07172154160bd9587d06dc93ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:53.538126 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d625d304-441f-4034-b080-8cd97b8ab876 tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 200 len: 1448 microversion: 2.75 time: 0.585716 Oct 17 15:30:53.539885 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1086/2351] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:52 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 1448 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:53.545980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:53.546837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:53.558188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:53.559650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:53.560454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:53.561548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:53.562233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:53.563763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:53.654280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:30:53.678881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=18 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:53.963781 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-114aade5-c3cb-470e-b26b-18ef288e062a tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 204 len: 0 microversion: 2.1 time: 0.421524 Oct 17 15:30:53.976173 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1087/2352] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:53 2022] DELETE /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:53.997025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:54.000347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:54.021266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:54.027102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:54.027869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:54.035712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:54.036259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:54.039083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:54.369415 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.scheduler.client.report [None req-0afec1df-e1fc-4eed-8214-9a6c33d630ab tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Deleted allocations for instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee Oct 17 15:30:54.426422 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0afec1df-e1fc-4eed-8214-9a6c33d630ab tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee" status: 204 len: 0 microversion: 2.1 time: 1.251170 Oct 17 15:30:54.427863 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1266/2353] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:53 2022] DELETE /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee => generated 0 bytes in 1253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:54.444489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:54.445745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:54.461517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:54.464882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:54.465651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:54.466559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:54.467154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:54.469257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:54.506467 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 HTTP/1.1 Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '463dc9de-88df-4179-b399-6379972b35f8'} Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:54.524240 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:54.528001 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:54.528001 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:54.528001 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:54.528001 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:54.528001 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:30:54.528001 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:54.531393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:54.532708 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-160f3a69-19df-45bc-b716-55e87d708118 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 404 len: 111 microversion: 2.1 time: 0.102272 Oct 17 15:30:54.535340 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1267/2354] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:54 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:54.552846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:54.553668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:54.561184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:54.566308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:54.567108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:54.568073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:54.568736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:54.569366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:54.878520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:54.892804 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-098b02a6-50f0-4b3f-a82c-ae63067a15af tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1507 microversion: 2.1 time: 0.914965 Oct 17 15:30:54.899798 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1088/2355] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:53 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1507 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:54.905187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:54.912656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:54.925962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:54.935078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:54.935725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:54.937395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:54.938030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:54.939258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:55.091923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:55.110440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:55.112910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:55.114335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1373922b-4d72-4a75-a478-b818046619f9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1755 microversion: 2.32 time: 0.577069 Oct 17 15:30:55.127232 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1268/2356] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:54 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1755 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:55.337409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-977014c0-51f4-457e-8dd7-239c2cc6b801 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Action: 'create', calling method: .version_select at 0x7f28bf09a430>, body: {"keypair": {"name": "tempest-keypair-124838112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnhdKK/UjU7rPJbfFfzTC+fA/JdgXOqh5znKNpW6qTbUqYPA8AD/yyhVhlYbrqen3Xa/dhCvPlMrpI61SNdPDEG4DUfE84UfEH8oieVNLY/hLkZtTGMiavEQLCykTTPMw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:55.408266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-977014c0-51f4-457e-8dd7-239c2cc6b801 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:30:55.425147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-977014c0-51f4-457e-8dd7-239c2cc6b801 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for user 500c8f62368b4e51b919befdbc0a9179 and project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:30:55.493494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:55.503359 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-977014c0-51f4-457e-8dd7-239c2cc6b801 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.370982 Oct 17 15:30:55.508538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd945070-1268-4f88-9152-7858900c0335 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1668 microversion: 2.1 time: 0.606959 Oct 17 15:30:55.509080 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1269/2357] 10.222.0.87 () {62 vars in 1199 bytes} [Mon Oct 17 15:30:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 381 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 15:30:55.509668 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1089/2358] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:54 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1668 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:55.517945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-21d27d1c-6282-4a49-9289-94f598f6679c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28be50b040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:55.524276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:55.527222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 6cdaacde-1d92-4613-9434-fc02bb1a88ee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:55.552762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:55.553602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:55.554155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:55.558373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:55.566224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:55.566224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee HTTP/1.1 Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6cdaacde-1d92-4613-9434-fc02bb1a88ee'} Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:55.584174 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:55.589906 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9da50155-9c70-4743-b599-5c7ca77e16b0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee" status: 404 len: 111 microversion: 2.1 time: 0.072143 Oct 17 15:30:55.601711 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1270/2359] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:55 2022] GET /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:30:55.608303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:55.609035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] [instance: 86fdd429-8f17-4a7e-8a9a-e2620825d8a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:55.618971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:55.619577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:55.620115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:55.622043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:55.622634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:55.623177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:55.646690 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] HTTP exception thrown: Instance 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 could not be found. Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Request method failure captured: Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 HTTP/1.1 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXTNrwIBN6w0Xif4aTHjhRT5iSzpSVbX6TYA5AtMY5ar6-PmDDdTkAIeY-b_GHVneM3l5KrAFjQjF_ipVRKjWAM_o_igo4XkXNfK9-L5IV-dwa2kWN_ApGYg4h4kLdA7R88senFaGOArwz9YLf8vwW1Czb1xDKBXn9OgLgJei_1P9sM Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.75 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: f7f7c07172154160bd9587d06dc93ae7 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdmin275Test-484936816 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f7f7c07172154160bd9587d06dc93ae7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/f7f7c07172154160bd9587d06dc93ae7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_f7f7c07172154160bd9587d06dc93ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f7f7c07172154160bd9587d06dc93ae7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdmin275Test-484936816 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: f7f7c07172154160bd9587d06dc93ae7 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdmin275Test-484936816 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersAdmin275Test-484936816-project Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: edc795b73d074003b95e575920f10249 Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdmin275Test-484936816-project Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 could not be found. Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '86fdd429-8f17-4a7e-8a9a-e2620825d8a9'} Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 could not be found. Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 could not be found. Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:30:55.648590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.652677 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:30:55.652677 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:30:55.652677 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:30:55.652677 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:30:55.652677 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:30:55.652677 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 could not be found. Oct 17 15:30:55.652677 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:30:55.653828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] Returning 404 to user: Instance 86fdd429-8f17-4a7e-8a9a-e2620825d8a9 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:30:55.654912 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e4baa9d-ecce-4f32-89fd-67735865065d tempest-ServersAdmin275Test-484936816 tempest-ServersAdmin275Test-484936816-project] 10.222.0.87 "GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9" status: 404 len: 111 microversion: 2.75 time: 0.051467 Oct 17 15:30:55.656136 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1271/2360] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:55 2022] GET /compute/v2.1/servers/86fdd429-8f17-4a7e-8a9a-e2620825d8a9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:30:55.667805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:55.668934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:55.677387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:55.677991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:55.678688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:55.679544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:55.681758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:55.681758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:56.123002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:56.138196 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54a45844-b33f-49d0-8b3a-9e06bfd2403e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1507 microversion: 2.1 time: 0.479660 Oct 17 15:30:56.142067 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1272/2361] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:55 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:56.147313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98d98f8e-1ab4-43fa-943b-6c2421e0919d tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28c2f6c160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:56.188726 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98d98f8e-1ab4-43fa-943b-6c2421e0919d tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "GET /compute/v2.1/os-keypairs/tempest-keypair-124838112" status: 200 len: 512 microversion: 2.2 time: 0.044588 Oct 17 15:30:56.192089 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1273/2362] 10.222.0.87 () {60 vars in 1255 bytes} [Mon Oct 17 15:30:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-124838112 => generated 512 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:56.220352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55eedbb7-cace-41b5-9dae-652d6481350e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a981553-3a51-49e3-b3f8-b9a6af4420f7", "device": "/dev/xvdb"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:56.229391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55eedbb7-cace-41b5-9dae-652d6481350e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:56.240541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55eedbb7-cace-41b5-9dae-652d6481350e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:56.241611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55eedbb7-cace-41b5-9dae-652d6481350e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:56.242778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55eedbb7-cace-41b5-9dae-652d6481350e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:56.243918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55eedbb7-cace-41b5-9dae-652d6481350e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:56.246022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55eedbb7-cace-41b5-9dae-652d6481350e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:56.247265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55eedbb7-cace-41b5-9dae-652d6481350e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:56.614710 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-21d27d1c-6282-4a49-9289-94f598f6679c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 204 len: 0 microversion: 2.1 time: 1.102532 Oct 17 15:30:56.616162 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1090/2363] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:55 2022] DELETE /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 0 bytes in 1105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:56.622418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2137414262", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "fbf48d23-b6f0-48de-b73a-9c8aad4ee168"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:56.739411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] validate_networks() for [('fbf48d23-b6f0-48de-b73a-9c8aad4ee168', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:30:56.802760 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55eedbb7-cace-41b5-9dae-652d6481350e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "POST /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.608916 Oct 17 15:30:56.805576 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1274/2364] 10.222.0.87 () {62 vars in 1364 bytes} [Mon Oct 17 15:30:56 2022] POST /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments => generated 194 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:30:56.824704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:56.829935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:56.850524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:56.851295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:56.851752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:56.852527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:56.852987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:56.857077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:57.145822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:57.156487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:57.164581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:57.167375 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-961407ff-3dbc-417f-9aec-679c83692ad9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1802 microversion: 2.32 time: 0.360571 Oct 17 15:30:57.169052 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1275/2365] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:56 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1802 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:57.175570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9575c0e-5513-4be0-823b-aab37bbdd778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:57.187860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9575c0e-5513-4be0-823b-aab37bbdd778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:57.203709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9575c0e-5513-4be0-823b-aab37bbdd778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:57.207137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9575c0e-5513-4be0-823b-aab37bbdd778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:57.209263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9575c0e-5513-4be0-823b-aab37bbdd778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:57.210619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9575c0e-5513-4be0-823b-aab37bbdd778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:57.212056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9575c0e-5513-4be0-823b-aab37bbdd778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:57.215342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9575c0e-5513-4be0-823b-aab37bbdd778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:57.363561 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9575c0e-5513-4be0-823b-aab37bbdd778 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "PUT /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1079 microversion: 2.1 time: 0.191684 Oct 17 15:30:57.364654 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1276/2366] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 15:30:57 2022] PUT /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1079 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:57.370259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73acdbda-e321-4f97-a2db-6905f8c7f695 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28bedbe670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:57.429558 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73acdbda-e321-4f97-a2db-6905f8c7f695 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124838112" status: 204 len: 0 microversion: 2.2 time: 0.063812 Oct 17 15:30:57.430206 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1277/2367] 10.222.0.87 () {60 vars in 1258 bytes} [Mon Oct 17 15:30:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124838112 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:57.438289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:57.438958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:57.442157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:57.471346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:57.471791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:57.472229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:57.472937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:57.473385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:57.473804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:57.641088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:57.657016 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8456e59e-31d4-423d-a83a-6875072ad9fe tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 200 len: 1600 microversion: 2.1 time: 0.225706 Oct 17 15:30:57.657806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1278/2368] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:57 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 1600 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:57.663841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:57.664671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:57.672335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:57.673171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:57.673990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:57.674916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:57.675535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:57.676149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:57.707646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:30:57.941779 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6688775b-0614-4d81-bb2d-9f70ba93310d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 204 len: 0 microversion: 2.1 time: 0.282548 Oct 17 15:30:57.947230 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1279/2369] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:30:57 2022] DELETE /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:30:57.962328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:57.980701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:57.986955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:57.987450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:57.987890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:57.988598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:57.989055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:57.989476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:58.542942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:58.567611 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-223a8fce-caa4-46e8-ac8d-5e583ef080fb tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1505 microversion: 2.1 time: 0.612854 Oct 17 15:30:58.571608 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1280/2370] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:57 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1505 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:30:58.588043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50283da9-31db-477f-be93-b1827562247e tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Action: 'create', calling method: .version_select at 0x7f28bf11a8b0>, body: {"keypair": {"name": "tempest-keypair-139871592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn+RZaIwMcfnw0o9Hn0C9JrQH72FMfqjSphmCl79j47JvkiM091dztPXWEJxpE6X8Cf03H1Ncsa1UMQaCIFj7rldCGp3BpwYL5qnUzxWfcDnovCBgznfSu1rHDY8YXr7g=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:58.701204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-50283da9-31db-477f-be93-b1827562247e tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:30:58.722460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-50283da9-31db-477f-be93-b1827562247e tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for user 500c8f62368b4e51b919befdbc0a9179 and project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:30:58.804722 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50283da9-31db-477f-be93-b1827562247e tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.231738 Oct 17 15:30:58.805396 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1281/2371] 10.222.0.87 () {62 vars in 1199 bytes} [Mon Oct 17 15:30:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 233 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 15:30:58.821361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-688060570", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "4a4d489b-6847-437c-bb6f-226f2268a1b9"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:58.936414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] validate_networks() for [('4a4d489b-6847-437c-bb6f-226f2268a1b9', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:30:58.977453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:30:58.977988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:30:58.979811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:30:58.980409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:30:58.981370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:30:58.995314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:58.996107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:58.997401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:58.998447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:58.999071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:58.999853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:59.038101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:30:59.044226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for user 745a483a369e4e83849cee037f5b67ab and project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:30:59.058739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:30:59.062880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:30:59.096106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:30:59.124188 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e35d869e-fb23-4494-b047-9ecdd5e32210 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.506544 Oct 17 15:30:59.125408 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1091/2372] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:30:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:30:59.130826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:59.132119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:30:59.139775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:59.140533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:59.141110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:59.142092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:59.142721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:59.143496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:59.784715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:59.803231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:59.822969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:30:59.824537 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c1b4e54b-853c-426d-b56d-d1c77d697064 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1802 microversion: 2.32 time: 0.697899 Oct 17 15:30:59.839551 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1092/2373] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:30:59 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1802 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:30:59.861635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-375273d3-01d9-4f7c-917d-c067bf316d83 req-9af71e98-d681-452d-acc8-13867f1c877d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c128f7c3-d3e6-4664-979e-e424581346e1", "name": "network-vif-deleted", "tag": "0ae18c17-0b0d-49c1-8d85-94306923e42f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:30:59.896326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-375273d3-01d9-4f7c-917d-c067bf316d83 req-9af71e98-d681-452d-acc8-13867f1c877d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:59.901961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:30:59.902437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:30:59.903121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:30:59.903332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-375273d3-01d9-4f7c-917d-c067bf316d83 req-9af71e98-d681-452d-acc8-13867f1c877d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:59.903685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:30:59.904135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-375273d3-01d9-4f7c-917d-c067bf316d83 req-9af71e98-d681-452d-acc8-13867f1c877d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:59.904268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:30:59.941419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:59.941923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:59.947117 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-375273d3-01d9-4f7c-917d-c067bf316d83 req-9af71e98-d681-452d-acc8-13867f1c877d service nova] Creating event network-vif-deleted:0ae18c17-0b0d-49c1-8d85-94306923e42f for instance c128f7c3-d3e6-4664-979e-e424581346e1 on n-h2-854441-12 Oct 17 15:30:59.949151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:59.954868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:30:59.955367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:30:59.962160 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-375273d3-01d9-4f7c-917d-c067bf316d83 req-9af71e98-d681-452d-acc8-13867f1c877d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121094 Oct 17 15:30:59.966230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:30:59.969167 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1093/2374] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:30:59.987147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:30:59.996478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:00.026401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:00.026932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:00.027380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:00.031708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:00.032208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:00.032661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:00.053727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:31:00.083764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Getting quotas for user 59a1c6dac66a43d9b5e91b78215359ce and project 1ecc5c53621946e0bd84b2a94584f5bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:31:00.147108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:31:00.155415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:31:00.289566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b3bfc4b-e5e7-43d2-b2ad-69814bcbdce0 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482643 Oct 17 15:31:00.290240 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1282/2375] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:31:00.301780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:00.302588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: c128f7c3-d3e6-4664-979e-e424581346e1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:00.321384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:00.322164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:00.322855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:00.323724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:00.324332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:00.324917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:00.386679 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] HTTP exception thrown: Instance c128f7c3-d3e6-4664-979e-e424581346e1 could not be found. Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Request method failure captured: Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 HTTP/1.1 Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXOLmfFwgk_ZQCuhxZvfajtzc1xwyl5ZP03KBNNFxl2mYkeBYGhqSPyOoQhsmngLF1wyxiuGkJW_H75csjEuvCA1gDvV2q-ws5RaPtbMco157-ejDAl65NSkBj5PPKBdpIoMG5kB0zy-02fKF3C2jig_7qJ98WGxK8CnzjrF4RyTSCw Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 243aa6b3387c4549b5c94ec1ddc5c850 Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-LiveMigrationTest-1409490073 Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-LiveMigrationTest-1409490073 Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 243aa6b3387c4549b5c94ec1ddc5c850 Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-LiveMigrationTest-1409490073 Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-LiveMigrationTest-1409490073-project Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 13c8d45b2e4d459d92b024476b2f4fbd Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-LiveMigrationTest-1409490073-project Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance c128f7c3-d3e6-4664-979e-e424581346e1 could not be found. Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'c128f7c3-d3e6-4664-979e-e424581346e1'} Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c128f7c3-d3e6-4664-979e-e424581346e1 could not be found. Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c128f7c3-d3e6-4664-979e-e424581346e1 could not be found. Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:00.391820 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:00.395644 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:00.395644 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:00.395644 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:00.395644 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:00.395644 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:00.395644 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c128f7c3-d3e6-4664-979e-e424581346e1 could not be found. Oct 17 15:31:00.395644 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:00.397134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Returning 404 to user: Instance c128f7c3-d3e6-4664-979e-e424581346e1 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:00.413712 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec3689b5-e9ce-4f8e-82d6-a38ab87f5849 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1" status: 404 len: 111 microversion: 2.1 time: 0.120485 Oct 17 15:31:00.422273 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1283/2376] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:00 2022] GET /compute/v2.1/servers/c128f7c3-d3e6-4664-979e-e424581346e1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:00.432000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09ba863e-af74-4468-9af8-2ad23989ebf4 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28bedbe0d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:00.474347 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09ba863e-af74-4468-9af8-2ad23989ebf4 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-139871592" status: 204 len: 0 microversion: 2.2 time: 0.050565 Oct 17 15:31:00.480501 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1284/2377] 10.222.0.87 () {60 vars in 1258 bytes} [Mon Oct 17 15:31:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-139871592 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:00.492323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:00.493034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:00.514856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:00.515366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:00.515809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:00.520583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:00.521487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:00.522235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:00.651156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:00.661893 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-195b7531-3e9d-4b76-9434-70d79a57a2be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1219 microversion: 2.1 time: 0.179692 Oct 17 15:31:00.676119 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1285/2378] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:00 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1219 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:00.705034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a4797b0-8eba-44d9-b41f-5d60bc681e2a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:00.706248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a4797b0-8eba-44d9-b41f-5d60bc681e2a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:00.870924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a4797b0-8eba-44d9-b41f-5d60bc681e2a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:00.902243 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a4797b0-8eba-44d9-b41f-5d60bc681e2a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1207 microversion: 2.1 time: 0.213678 Oct 17 15:31:00.903001 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1286/2379] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:00 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1207 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:00.910645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e141eaeb-fd68-4c46-b8eb-13dbc1919af1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '.version_select at 0x7f28beee5dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:00.966427 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e141eaeb-fd68-4c46-b8eb-13dbc1919af1 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048118819" status: 202 len: 0 microversion: 2.1 time: 0.061918 Oct 17 15:31:00.967372 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1287/2380] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 15:31:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048118819 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:31:00.984775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90c3b296-a2fd-4e7f-a577-d9a2529666e8 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Action: 'create', calling method: .version_select at 0x7f28bee14940>, body: {"keypair": {"name": "tempest-keypair-601183931", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:00.987812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:01.003761 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dcdacd77-3353-47ad-be0d-f0960a16929b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1505 microversion: 2.1 time: 1.031257 Oct 17 15:31:01.005982 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1094/2381] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:30:59 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1505 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:01.023627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:01.025031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:01.042725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.043550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.044017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:01.045107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.045580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.046159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:01.048743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-90c3b296-a2fd-4e7f-a577-d9a2529666e8 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:31:01.063105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-90c3b296-a2fd-4e7f-a577-d9a2529666e8 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for user 500c8f62368b4e51b919befdbc0a9179 and project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:31:01.160939 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90c3b296-a2fd-4e7f-a577-d9a2529666e8 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.192385 Oct 17 15:31:01.161714 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1288/2382] 10.222.0.87 () {62 vars in 1199 bytes} [Mon Oct 17 15:31:00 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 15:31:01.172872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a8228b4-8b5d-46da-916e-fc18b4aa2d77 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:01.175414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a8228b4-8b5d-46da-916e-fc18b4aa2d77 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:01.199914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8228b4-8b5d-46da-916e-fc18b4aa2d77 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.200704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8228b4-8b5d-46da-916e-fc18b4aa2d77 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.202054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8228b4-8b5d-46da-916e-fc18b4aa2d77 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:01.203372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8228b4-8b5d-46da-916e-fc18b4aa2d77 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.204041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8228b4-8b5d-46da-916e-fc18b4aa2d77 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.205345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8228b4-8b5d-46da-916e-fc18b4aa2d77 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:01.376822 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a8228b4-8b5d-46da-916e-fc18b4aa2d77 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "PUT /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1081 microversion: 2.1 time: 0.213765 Oct 17 15:31:01.377907 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1289/2383] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 15:31:01 2022] PUT /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1081 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:01.385516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a1e117a-ecfb-4459-a4a0-766fc4bbb006 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28bf09a430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:01.417171 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a1e117a-ecfb-4459-a4a0-766fc4bbb006 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601183931" status: 204 len: 0 microversion: 2.2 time: 0.036721 Oct 17 15:31:01.418325 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1290/2384] 10.222.0.87 () {60 vars in 1258 bytes} [Mon Oct 17 15:31:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601183931 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:01.428285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:01.429194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:01.439173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.440311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.440994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:01.442404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.443083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.444134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:01.480385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:01.803590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:01.821274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:01.829562 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f262476f-f828-418f-a7c3-392d6d50720e tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1507 microversion: 2.1 time: 0.408385 Oct 17 15:31:01.830213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:01.833301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:01.833446 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1291/2385] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:01 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:01.834930 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-88391b7b-35e1-419a-8639-ad7b4199220b tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1802 microversion: 2.32 time: 0.826661 Oct 17 15:31:01.846623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e89aa40-d6e1-4339-85a4-97f076fb0d2a tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Action: 'create', calling method: .version_select at 0x7f28bedb90d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1421106018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmfC+Ft7hMLkywDf9b1BXs6KdPMWAtS/6bpetD6odEm4fFoxOtoBmswMk4EZeUpavOnss+ZRbj9U8KBDx1RGFvAjceY25tWE/BZBJw1uHCVaBHmE1B0lgksFPEm27oLNw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:01.847315 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1095/2386] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:01 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1802 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:01.864123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:01.874973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:01.891194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6e89aa40-d6e1-4339-85a4-97f076fb0d2a tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:31:01.903319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.906201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6e89aa40-d6e1-4339-85a4-97f076fb0d2a tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for user 500c8f62368b4e51b919befdbc0a9179 and project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:31:01.921610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.924921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:01.928173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.931183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.933857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:01.963451 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e89aa40-d6e1-4339-85a4-97f076fb0d2a tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.125277 Oct 17 15:31:01.964906 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1292/2387] 10.222.0.87 () {62 vars in 1199 bytes} [Mon Oct 17 15:31:01 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 15:31:01.972564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:01.973604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:01.985325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.986018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.986581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:01.987464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:01.988635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:01.989067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.180805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:02.201042 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61a14ac6-1ea6-42b2-8a36-1551557b5fc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1273 microversion: 2.1 time: 0.341456 Oct 17 15:31:02.201905 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1096/2388] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:01 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1273 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:02.215151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:02.216046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:02.224315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:02.224817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:02.225255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.226173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:02.227298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:02.227997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.404550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:02.419386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:02.428656 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b4149303-7d20-4728-918d-ea5920e3819a tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1507 microversion: 2.1 time: 0.460048 Oct 17 15:31:02.430201 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-53837711-65fc-4162-990d-b6f6b0558f5b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1259 microversion: 2.1 time: 0.226839 Oct 17 15:31:02.432474 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1293/2389] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:01 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:02.436463 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1097/2390] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:02 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:02.442758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5cf13db-e540-45a5-8abe-fd3928b38b97 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Action: 'create', calling method: .version_select at 0x7f28bedde310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1525535713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc3u939l6sAd3qonuLQSkFP3Tw9Hvb1wdF1usSoXQrxMnhP9dmErTZgDqEwGDUufv3obAW/WWE5kd4dur0LfFDBO6TN6dwdyoz29j9MooHxF7c9FRLFmw+8oTwJ3dVvaw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:02.455323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:02.455848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:02.483309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:02.483840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:02.484445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.485179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:02.485636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:02.486065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.519669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c5cf13db-e540-45a5-8abe-fd3928b38b97 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:31:02.529018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c5cf13db-e540-45a5-8abe-fd3928b38b97 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for user 500c8f62368b4e51b919befdbc0a9179 and project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:31:02.574182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:31:02.583409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:02.606758 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5cf13db-e540-45a5-8abe-fd3928b38b97 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.173009 Oct 17 15:31:02.608287 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1294/2391] 10.222.0.87 () {62 vars in 1199 bytes} [Mon Oct 17 15:31:02 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 15:31:02.624808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-79c8b25b-d66b-4332-a930-5c91bb183457 req-9a316443-7f4a-457e-ab5c-df07571cbfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c186d0-403a-49cd-94fc-cfa45e6b5170", "name": "network-vif-deleted", "tag": "58b69e6c-3036-4516-ba10-49aa3cb3f009"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:02.663865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-79c8b25b-d66b-4332-a930-5c91bb183457 req-9a316443-7f4a-457e-ab5c-df07571cbfed service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:02.664923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-79c8b25b-d66b-4332-a930-5c91bb183457 req-9a316443-7f4a-457e-ab5c-df07571cbfed service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:02.665645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-79c8b25b-d66b-4332-a930-5c91bb183457 req-9a316443-7f4a-457e-ab5c-df07571cbfed service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.682863 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-79c8b25b-d66b-4332-a930-5c91bb183457 req-9a316443-7f4a-457e-ab5c-df07571cbfed service nova] Creating event network-vif-deleted:58b69e6c-3036-4516-ba10-49aa3cb3f009 for instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 on n-h1-854441-12 Oct 17 15:31:02.693748 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-79c8b25b-d66b-4332-a930-5c91bb183457 req-9a316443-7f4a-457e-ab5c-df07571cbfed service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083685 Oct 17 15:31:02.694762 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1295/2392] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:02.704005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6002af08-0f0c-45ce-9283-0e3f704c7ce8 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Action: 'create', calling method: .version_select at 0x7f28bedbe4c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1974465501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqsJI1h3OUyU71pShwhCOpXYku0SWeKMvnK2BPqY2aGrns8PvgS2/YKXdvj2ubc8AJicrWdyCJO0274eVDcw0xjkbbIHfLDsHPD2fhMq6W0ABnLif82zgv2+UEr1NAbDA=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:02.732966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6002af08-0f0c-45ce-9283-0e3f704c7ce8 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:31:02.740888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6002af08-0f0c-45ce-9283-0e3f704c7ce8 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for user 500c8f62368b4e51b919befdbc0a9179 and project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:31:02.756014 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3dc9b42a-0cbe-4c24-985e-a40f8769e86c tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 204 len: 0 microversion: 2.1 time: 0.304388 Oct 17 15:31:02.757044 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1098/2393] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:02 2022] DELETE /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:31:02.769361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:02.770115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:02.787315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:02.788016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:02.788727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.790633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:02.795340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:02.796141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.799368 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6002af08-0f0c-45ce-9283-0e3f704c7ce8 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.102620 Oct 17 15:31:02.800356 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1296/2394] 10.222.0.87 () {62 vars in 1199 bytes} [Mon Oct 17 15:31:02 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 15:31:02.833549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9407054a-9d60-4fe4-b93f-df5fd24db8b6 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28bedda160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:02.859933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:31:02.865668 n-d-854441-12 devstack@n-api.service[120406]: WARNING oslo_db.sqlalchemy.utils [None req-9407054a-9d60-4fe4-b93f-df5fd24db8b6 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 15:31:02.877879 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9407054a-9d60-4fe4-b93f-df5fd24db8b6 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.060450 Oct 17 15:31:02.879290 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1297/2395] 10.222.0.87 () {60 vars in 1177 bytes} [Mon Oct 17 15:31:02 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:02.887422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:02.888586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:02.896540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:02.897299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:02.897882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.899043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:02.899676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:02.900245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:02.960106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:03.003620 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.api [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Instance is already in deleting state, ignoring this request Oct 17 15:31:03.005611 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f03df0e6-bb25-434a-b194-e82c13342e8b tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 204 len: 0 microversion: 2.1 time: 0.241169 Oct 17 15:31:03.016077 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1099/2396] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:02 2022] DELETE /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:31:03.024473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c84ec0e7-9a51-438d-b5a9-61c10a143306 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28c2e865e0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:03.054255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c84ec0e7-9a51-438d-b5a9-61c10a143306 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1974465501" status: 204 len: 0 microversion: 2.2 time: 0.036255 Oct 17 15:31:03.064560 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1100/2397] 10.222.0.87 () {60 vars in 1321 bytes} [Mon Oct 17 15:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1974465501 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:03.070774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:03.071462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:03.079302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:03.079797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:03.080401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:03.081272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:03.081883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:03.083557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:03.546777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:03.563455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:03.563455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:03.563455 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d67756ba-65cf-4912-aaad-0df76f730879 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1849 microversion: 2.32 time: 0.681214 Oct 17 15:31:03.578112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:03.579292 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1298/2398] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:02 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1849 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:03.590443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f498042e-db72-420b-a2d1-a7a00a9d2669 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28bedda040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:03.609354 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5d8c5fc2-1a2e-4913-bb49-462a1e370bcf tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1513 microversion: 2.1 time: 0.542560 Oct 17 15:31:03.625108 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1101/2399] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:03 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1513 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:03.632318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:03.633890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:03.636571 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f498042e-db72-420b-a2d1-a7a00a9d2669 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1525535713" status: 204 len: 0 microversion: 2.2 time: 0.055931 Oct 17 15:31:03.637321 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1299/2400] 10.222.0.87 () {60 vars in 1321 bytes} [Mon Oct 17 15:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1525535713 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:03.645086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:03.645709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:03.646373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:03.647161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:03.647845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:03.648858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:03.649594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:03.650232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:03.670911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:03.671125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:03.671543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:03.680446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:03.681552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:03.681552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:03.764846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:03.767840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:03.779608 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-78c6f653-ab5a-4b14-ad9c-c9f551927664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1273 microversion: 2.1 time: 0.152264 Oct 17 15:31:03.780232 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1102/2401] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:03 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:03.783114 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9535567-641c-413f-a30b-53cc6cdf544f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1265 microversion: 2.1 time: 0.144599 Oct 17 15:31:03.784150 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1300/2402] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:03 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:03.792663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed5e016f-5079-4ba6-a378-8e715fd2687b tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28c2e86ee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:03.793197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:03.794164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:03.803105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:03.804856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:03.805637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:03.806787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:03.807883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:03.808571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:03.831869 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed5e016f-5079-4ba6-a378-8e715fd2687b tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1421106018" status: 204 len: 0 microversion: 2.2 time: 0.047753 Oct 17 15:31:03.840474 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1103/2403] 10.222.0.87 () {60 vars in 1321 bytes} [Mon Oct 17 15:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1421106018 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:03.848243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d34a4af3-8309-4261-9f2d-4669d990d9f6 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Action: 'create', calling method: .version_select at 0x7f28c2fe3e50>, body: {"keypair": {"name": "tempest-keypair-204055972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6ys014zhIqnx405c7XnGrVj1bwBIbbAbB4UlR6IeB3teDneWPP6QlRX+S0TfjazOLpfGYY+04YoH604uv2/NCXJCkocv8tCzvoNpHdHY4GeKPFvo0IsA+95JGeX+Jy1g=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:03.872097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:31:03.896056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d34a4af3-8309-4261-9f2d-4669d990d9f6 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:31:03.913219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d34a4af3-8309-4261-9f2d-4669d990d9f6 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for user 500c8f62368b4e51b919befdbc0a9179 and project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:31:03.985144 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d34a4af3-8309-4261-9f2d-4669d990d9f6 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.141544 Oct 17 15:31:03.994138 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1104/2404] 10.222.0.87 () {62 vars in 1199 bytes} [Mon Oct 17 15:31:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 17 15:31:04.000067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd09b15c-993c-4691-8aff-65c07aa985d4 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28c30148b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:04.011339 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd09b15c-993c-4691-8aff-65c07aa985d4 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "GET /compute/v2.1/os-keypairs/tempest-keypair-204055972" status: 200 len: 512 microversion: 2.2 time: 0.015342 Oct 17 15:31:04.019688 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1105/2405] 10.222.0.87 () {60 vars in 1255 bytes} [Mon Oct 17 15:31:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-204055972 => generated 512 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:04.025488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-089369c2-8839-4cbd-96c2-516bbd54c36f tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28c2fe33a0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:04.032624 n-d-854441-12 devstack@n-api.service[120407]: WARNING oslo_db.sqlalchemy.utils [None req-089369c2-8839-4cbd-96c2-516bbd54c36f tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 15:31:04.038866 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-089369c2-8839-4cbd-96c2-516bbd54c36f tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.017530 Oct 17 15:31:04.040505 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1106/2406] 10.222.0.87 () {60 vars in 1177 bytes} [Mon Oct 17 15:31:04 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:04.052835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-43c6e97f-ec84-4f38-9813-fc2b4b3e8a70 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28c300c310>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:04.079007 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-43c6e97f-ec84-4f38-9813-fc2b4b3e8a70 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204055972" status: 204 len: 0 microversion: 2.2 time: 0.030321 Oct 17 15:31:04.085999 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1107/2407] 10.222.0.87 () {60 vars in 1258 bytes} [Mon Oct 17 15:31:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204055972 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:31:04.096741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Action: 'create', calling method: .version_select at 0x7f28c303d9d0>, body: {"keypair": {"name": "tempest-keypair-1434320436", "type": "x509"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:04.103242 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff33d9f2-95d9-4e77-bf49-02d92e1d93ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "DELETE /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 204 len: 0 microversion: 2.1 time: 0.316548 Oct 17 15:31:04.104058 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1301/2408] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:03 2022] DELETE /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:04.121707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:04.122439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:04.130225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:31:04.137058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:04.137566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:04.141823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for user 500c8f62368b4e51b919befdbc0a9179 and project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:31:04.143514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:04.144447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:04.144938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:04.145380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:04.181172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.processutils [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1zr947jt/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1zr947jt/temp.key -subj /CN=500c8f62368b4e51b919befdbc0a9179 -extensions v3_req_client {{(pid=120407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 17 15:31:04.385677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.processutils [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1zr947jt/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1zr947jt/temp.key -subj /CN=500c8f62368b4e51b919befdbc0a9179 -extensions v3_req_client" returned: 0 in 0.204s {{(pid=120407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 17 15:31:04.387883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.processutils [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1zr947jt/temp.key -password pass: {{(pid=120407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 17 15:31:04.438141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.processutils [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1zr947jt/temp.key -password pass:" returned: 0 in 0.050s {{(pid=120407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 17 15:31:04.504309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:31:04.518127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Getting quotas for user 500c8f62368b4e51b919befdbc0a9179 and project ca0fbe448eb247219dde31dc7b13029c. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:31:04.549210 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-413c8f97-ce1d-4174-bfdd-bdc71c516251 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.460731 Oct 17 15:31:04.558189 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1108/2409] 10.222.0.87 () {62 vars in 1198 bytes} [Mon Oct 17 15:31:04 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 471 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:04.567702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b2f3bf0-a9d0-44c9-b310-313288a3069c tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28c2f65b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:04.606265 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b2f3bf0-a9d0-44c9-b310-313288a3069c tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "GET /compute/v2.1/os-keypairs/tempest-keypair-1434320436" status: 200 len: 1534 microversion: 2.2 time: 0.045237 Oct 17 15:31:04.619972 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1109/2410] 10.222.0.87 () {60 vars in 1258 bytes} [Mon Oct 17 15:31:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1434320436 => generated 1534 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:04.636711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:04.639457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:04.668894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:04.669756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:04.671033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:04.685491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:04.685639 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aaec9a77-c7fd-45ba-9ea4-47045af0ae5b tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1486 microversion: 2.1 time: 0.576596 Oct 17 15:31:04.687720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:04.688259 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1302/2411] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:04 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1486 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:31:04.689071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:04.690627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:04.712755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-370f9160-abfd-4aa3-a680-9df38a827805 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28bf2339d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:04.728374 n-d-854441-12 devstack@n-api.service[120406]: WARNING oslo_db.sqlalchemy.utils [None req-370f9160-abfd-4aa3-a680-9df38a827805 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 15:31:04.764104 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-370f9160-abfd-4aa3-a680-9df38a827805 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.074539 Oct 17 15:31:04.766430 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1303/2412] 10.222.0.87 () {60 vars in 1177 bytes} [Mon Oct 17 15:31:04 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:04.788634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:04.797999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:04.819968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:04.821291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:04.826834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:04.828213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:04.829251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:04.831878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:05.154059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:05.170416 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35925722-30e4-47d1-af7c-784810915cbd tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1513 microversion: 2.1 time: 0.390934 Oct 17 15:31:05.172526 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1304/2413] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:04 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1513 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:05.179095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84b9c09c-a2f2-4a67-87fd-5421c5a9f539 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] Calling method '.version_select at 0x7f28bf0e2040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:05.213387 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84b9c09c-a2f2-4a67-87fd-5421c5a9f539 tempest-KeyPairsV22TestJSON-709819076 tempest-KeyPairsV22TestJSON-709819076-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434320436" status: 204 len: 0 microversion: 2.2 time: 0.039261 Oct 17 15:31:05.215680 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1305/2414] 10.222.0.87 () {60 vars in 1261 bytes} [Mon Oct 17 15:31:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434320436 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:05.222844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:05.223511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:05.234365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:05.235102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:05.235560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:05.236506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:05.237079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:05.237832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:05.491946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:05.500349 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c92b82d-4ba1-4e04-86c0-953d884bb927 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 0.283406 Oct 17 15:31:05.504593 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1306/2415] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:05 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:05.509817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:05.510445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:05.529966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:05.530473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:05.530966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:05.533600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:05.534040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:05.534481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:05.776364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:05.811121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:05.820806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:05.823945 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-65dae9f7-5f52-41d4-90ac-feef19bac0fb tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1849 microversion: 2.32 time: 1.199672 Oct 17 15:31:05.827088 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1110/2416] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:04 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1849 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:05.841010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:05.841649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:05.857211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:05.857719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:05.858159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:05.861558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:05.863059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:05.863511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:06.051656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:06.065852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b74c88ab-45eb-44c7-8487-c53acb66de20 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1307 microversion: 2.1 time: 0.560060 Oct 17 15:31:06.071866 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1307/2417] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:05 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1307 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:06.087358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6a709b64-4a16-4488-9e42-7d59c203fe80 req-0af59f9b-8e9b-416b-9b5f-321db3ab0f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "tag": "15d6381f-175a-4753-8720-a7363204b9d6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:06.102164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a709b64-4a16-4488-9e42-7d59c203fe80 req-0af59f9b-8e9b-416b-9b5f-321db3ab0f95 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:06.103092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a709b64-4a16-4488-9e42-7d59c203fe80 req-0af59f9b-8e9b-416b-9b5f-321db3ab0f95 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:06.103684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a709b64-4a16-4488-9e42-7d59c203fe80 req-0af59f9b-8e9b-416b-9b5f-321db3ab0f95 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:06.131905 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6a709b64-4a16-4488-9e42-7d59c203fe80 req-0af59f9b-8e9b-416b-9b5f-321db3ab0f95 service nova] Creating event network-changed:15d6381f-175a-4753-8720-a7363204b9d6 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:31:06.145933 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6a709b64-4a16-4488-9e42-7d59c203fe80 req-0af59f9b-8e9b-416b-9b5f-321db3ab0f95 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072508 Oct 17 15:31:06.146777 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1308/2418] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:06.199056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:06.199795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:06.212243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:06.212728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:06.213165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:06.213891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:06.214339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:06.214780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:06.547397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:06.563547 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d9fe30fe-988b-449c-9a04-7ef8233946ed tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1486 microversion: 2.1 time: 0.735155 Oct 17 15:31:06.579328 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1111/2419] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:05 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1486 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:06.589033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:06.595540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:06.611372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:06.612119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:06.612790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:06.613657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:06.614262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:06.614877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:07.042600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:07.044336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:07.057619 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c56d8dc4-08c3-41b4-91fe-0bda16fb4bef tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 0.476791 Oct 17 15:31:07.061661 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1112/2420] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:06 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:07.064943 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94a026a4-a826-422f-8154-8b6b0a2b6fd3 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1513 microversion: 2.1 time: 0.870226 Oct 17 15:31:07.067735 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1309/2421] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:06 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1513 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:31:07.070567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:07.071402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:07.084824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:07.088497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:07.092580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:07.093454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:07.093939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:07.094384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:07.101267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:07.114337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:07.130044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:07.135040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:07.136414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:07.138523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:07.139159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:07.140557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:07.704798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:07.714618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6e5d862-37af-47aa-8dc7-81160c7e29ec tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1307 microversion: 2.1 time: 0.620489 Oct 17 15:31:07.721954 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1310/2422] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:07 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1307 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:07.737207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-30b18742-9684-4445-88bb-4a06fd13cc4d req-646ca836-a785-4008-b24a-a3b74c0b3792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae0e4163-6ad8-4c7b-bdc3-248b002e922a", "tag": "01806898-993c-4781-a839-d2f7bfbaa141"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:07.749700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30b18742-9684-4445-88bb-4a06fd13cc4d req-646ca836-a785-4008-b24a-a3b74c0b3792 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:07.753133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30b18742-9684-4445-88bb-4a06fd13cc4d req-646ca836-a785-4008-b24a-a3b74c0b3792 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:07.755706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-30b18742-9684-4445-88bb-4a06fd13cc4d req-646ca836-a785-4008-b24a-a3b74c0b3792 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:07.782437 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-30b18742-9684-4445-88bb-4a06fd13cc4d req-646ca836-a785-4008-b24a-a3b74c0b3792 service nova] Creating event network-changed:01806898-993c-4781-a839-d2f7bfbaa141 for instance ae0e4163-6ad8-4c7b-bdc3-248b002e922a on n-h2-854441-12 Oct 17 15:31:07.789486 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-30b18742-9684-4445-88bb-4a06fd13cc4d req-646ca836-a785-4008-b24a-a3b74c0b3792 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065943 Oct 17 15:31:07.793064 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1311/2423] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:07.804431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:07.807142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:07.822619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:07.825782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:07.828203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:07.829420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:07.831161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:07.833659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:08.193625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:08.202717 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85f51acb-0ec3-4686-ba9c-0b9f87c11f36 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1486 microversion: 2.1 time: 0.408193 Oct 17 15:31:08.211234 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1312/2424] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:07 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1486 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:08.216508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:08.217405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:08.228668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:08.233179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:08.234439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:08.236347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:08.243075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:08.243763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:08.560862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:08.585014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:08.607434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:08.608831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8252ce53-7b2d-43db-af32-8b90fd14d9db tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1849 microversion: 2.32 time: 1.545836 Oct 17 15:31:08.609468 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1113/2425] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:07 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1849 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:08.646212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:08.648267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:08.679199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:08.687863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:08.688607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:08.689522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:08.695214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:08.695932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:08.968504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:08.981886 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d2d0dad-f2fe-4bb7-be54-396cc7e02856 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 0.766848 Oct 17 15:31:08.995218 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1313/2426] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:08 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:09.009999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2c6de5af-413e-4814-9cc2-d23772198deb req-b06946db-4a8c-40cc-ae09-4af13ecd5c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb70717-c1e8-403a-970f-035f1442dae3", "name": "network-vif-deleted", "tag": "c86cb9a6-5221-48ce-8dc2-8707a86f9a1f"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:09.012602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:09.031805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c6de5af-413e-4814-9cc2-d23772198deb req-b06946db-4a8c-40cc-ae09-4af13ecd5c34 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:09.033741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c6de5af-413e-4814-9cc2-d23772198deb req-b06946db-4a8c-40cc-ae09-4af13ecd5c34 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:09.035554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c6de5af-413e-4814-9cc2-d23772198deb req-b06946db-4a8c-40cc-ae09-4af13ecd5c34 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:09.062125 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2c6de5af-413e-4814-9cc2-d23772198deb req-b06946db-4a8c-40cc-ae09-4af13ecd5c34 service nova] Creating event network-vif-deleted:c86cb9a6-5221-48ce-8dc2-8707a86f9a1f for instance 7fb70717-c1e8-403a-970f-035f1442dae3 on n-h1-854441-12 Oct 17 15:31:09.073557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2c6de5af-413e-4814-9cc2-d23772198deb req-b06946db-4a8c-40cc-ae09-4af13ecd5c34 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075590 Oct 17 15:31:09.075744 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1314/2427] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:09.090781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:09.092024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:09.107002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:09.109758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:09.112506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:09.113533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:09.114242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:09.117188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:09.132928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f7ab17b8454d049b81bdd07e41e62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947ae7af631447ca8963b47e913fb618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:09.203626 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ad75f05-92cb-47d4-9d28-9f2e614b74d9 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 200 len: 1303 microversion: 2.1 time: 0.578386 Oct 17 15:31:09.210592 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1114/2428] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:08 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 1303 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:09.255469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:09.256344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:09.273401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:09.274013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:09.279476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:09.289182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:09.290285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:09.291958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:09.383496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:09.384395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:09.385012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:09.385628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lazy-loading 'fault' on Instance uuid 189db5a7-8cc1-43e9-8edd-162434dd4ecf {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:31:09.528721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:09.540929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-08057f94-58b9-4a5d-aa37-97dfb6ce3a80 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 200 len: 1301 microversion: 2.1 time: 0.289927 Oct 17 15:31:09.545848 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1115/2429] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:09 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 1301 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:09.645364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:09.657685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:09.659633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:09.660933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:09.676440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:09.677227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:09.677876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:09.679678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:09.680424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:09.681045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:09.681244 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89737180-fdad-4163-994a-67a341e2e74d tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1307 microversion: 2.1 time: 0.603922 Oct 17 15:31:09.700349 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1315/2430] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:09 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1307 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:10.012437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:10.013714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:10.021505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:10.042031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.049152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.051615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.056186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.057326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.065055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.451059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:10.469614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:10.471252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:10.472690 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-478541d1-1e4e-473c-9150-502bc2d677ee tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1870 microversion: 2.32 time: 0.818230 Oct 17 15:31:10.496749 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1116/2431] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:09 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1870 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:31:10.505950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:10.506804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: 7fb70717-c1e8-403a-970f-035f1442dae3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:10.528058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.528905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.529509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.530420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.531378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.531970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.569711 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] HTTP exception thrown: Instance 7fb70717-c1e8-403a-970f-035f1442dae3 could not be found. Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Request method failure captured: Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 HTTP/1.1 Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRrotFyOT3s7GHzIHPE6uWMfx8F-CdclkI7hwDl8hWg6X5gNoUmRLJYpPL1EHO3IZfquc22fjYs_N9-6hJL8xRnGVX09Tpr2CsY4izv73mBzW12sp4pjboh3kBRrieeYM1gbqA1pXG3FvpLNLKNuPNyQu6zPljRgQjo2Fg_nYiZI0Q Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/947ae7af631447ca8963b47e913fb618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_947ae7af631447ca8963b47e913fb618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 62f7ab17b8454d049b81bdd07e41e62f Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 7fb70717-c1e8-403a-970f-035f1442dae3 could not be found. Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7fb70717-c1e8-403a-970f-035f1442dae3'} Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb70717-c1e8-403a-970f-035f1442dae3 could not be found. Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb70717-c1e8-403a-970f-035f1442dae3 could not be found. Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:10.571798 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.575521 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:10.575521 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:10.575521 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:10.575521 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:10.575521 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:10.575521 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb70717-c1e8-403a-970f-035f1442dae3 could not be found. Oct 17 15:31:10.575521 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.575521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Returning 404 to user: Instance 7fb70717-c1e8-403a-970f-035f1442dae3 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:10.575521 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aaae4476-6006-41c0-8a73-bf2fbb4701d6 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3" status: 404 len: 111 microversion: 2.1 time: 0.075285 Oct 17 15:31:10.587831 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1117/2432] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:10 2022] GET /compute/v2.1/servers/7fb70717-c1e8-403a-970f-035f1442dae3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:10.602775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:10.612665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 189db5a7-8cc1-43e9-8edd-162434dd4ecf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:10.620115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.622957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.625294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.627062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.630142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.632597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.665645 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] HTTP exception thrown: Instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf could not be found. Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Request method failure captured: Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf HTTP/1.1 Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOLmfFwgk_ZQCuhxZvfajtzc1xwyl5ZP03KBNNFxl2mYkeBYGhqSPyOoQhsmngLF1wyxiuGkJW_H75csjEuvCA1gDvV2q-ws5RaPtbMco157-ejDAl65NSkBj5PPKBdpIoMG5kB0zy-02fKF3C2jig_7qJ98WGxK8CnzjrF4RyTSCw Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 243aa6b3387c4549b5c94ec1ddc5c850 Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-LiveMigrationTest-1409490073 Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-LiveMigrationTest-1409490073 Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 243aa6b3387c4549b5c94ec1ddc5c850 Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-LiveMigrationTest-1409490073 Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-LiveMigrationTest-1409490073-project Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 13c8d45b2e4d459d92b024476b2f4fbd Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-LiveMigrationTest-1409490073-project Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf could not be found. Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '189db5a7-8cc1-43e9-8edd-162434dd4ecf'} Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf could not be found. Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf could not be found. Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:10.683359 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.686846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:10.686846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:10.686846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:10.686846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:10.686846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:10.686846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf could not be found. Oct 17 15:31:10.686846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.688161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Returning 404 to user: Instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:10.689215 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61b963cd-0146-4835-9471-68c45861c825 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf" status: 404 len: 111 microversion: 2.1 time: 0.099090 Oct 17 15:31:10.694201 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1118/2433] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:10 2022] GET /compute/v2.1/servers/189db5a7-8cc1-43e9-8edd-162434dd4ecf => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:10.708970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:10.709729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:10.718257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:10.721452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.722333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.723070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.724352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.725043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.725757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.753691 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] HTTP exception thrown: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Request method failure captured: Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce HTTP/1.1 Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRrotFyOT3s7GHzIHPE6uWMfx8F-CdclkI7hwDl8hWg6X5gNoUmRLJYpPL1EHO3IZfquc22fjYs_N9-6hJL8xRnGVX09Tpr2CsY4izv73mBzW12sp4pjboh3kBRrieeYM1gbqA1pXG3FvpLNLKNuPNyQu6zPljRgQjo2Fg_nYiZI0Q Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/947ae7af631447ca8963b47e913fb618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_947ae7af631447ca8963b47e913fb618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 62f7ab17b8454d049b81bdd07e41e62f Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'efaed5c1-00db-49f6-b605-36e008e852ce'} Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:10.755533 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Returning 404 to user: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:10.759114 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-482cca27-afce-4e63-9688-3e768cab4a92 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "DELETE /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 404 len: 111 microversion: 2.1 time: 0.062271 Oct 17 15:31:10.762808 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1119/2434] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:10 2022] DELETE /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:10.770366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:10.772371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:10.781116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.782600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.784015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.784015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:10.784648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:10.785489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:10.828599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:31:10.987500 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97def72b-c1f8-4963-a2f6-6623f0da4ccd tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "DELETE /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 204 len: 0 microversion: 2.1 time: 0.212431 Oct 17 15:31:10.990003 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1120/2435] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:10 2022] DELETE /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:11.000684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:11.001747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:11.013832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:11.014728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:11.015397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:11.016385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:11.017505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:11.019653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:11.099470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:11.112606 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d219ab4f-0ea2-43ad-9cae-3bea43a9c9e6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 1.103582 Oct 17 15:31:11.128598 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1316/2436] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:10 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:31:11.128598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:11.128598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: efaed5c1-00db-49f6-b605-36e008e852ce] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:11.149314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:11.149816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:11.150260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:11.155119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:11.155629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:11.156075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:11.194434 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] HTTP exception thrown: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Request method failure captured: Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce HTTP/1.1 Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXRrotFyOT3s7GHzIHPE6uWMfx8F-CdclkI7hwDl8hWg6X5gNoUmRLJYpPL1EHO3IZfquc22fjYs_N9-6hJL8xRnGVX09Tpr2CsY4izv73mBzW12sp4pjboh3kBRrieeYM1gbqA1pXG3FvpLNLKNuPNyQu6zPljRgQjo2Fg_nYiZI0Q Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/947ae7af631447ca8963b47e913fb618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_947ae7af631447ca8963b47e913fb618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 62f7ab17b8454d049b81bdd07e41e62f Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'efaed5c1-00db-49f6-b605-36e008e852ce'} Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:11.202872 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:11.206428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:11.206428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:11.206428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:11.206428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:11.206428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:11.206428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. Oct 17 15:31:11.206428 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:11.206428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Returning 404 to user: Instance efaed5c1-00db-49f6-b605-36e008e852ce could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:11.210492 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80d622fa-8a8d-4941-8f71-eae36683e2ed tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce" status: 404 len: 111 microversion: 2.1 time: 0.091005 Oct 17 15:31:11.211478 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1317/2437] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:11 2022] GET /compute/v2.1/servers/efaed5c1-00db-49f6-b605-36e008e852ce => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:11.224054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:11.226215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:11.234486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:11.235007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:11.237086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:11.238203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:11.239542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:11.240873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:11.893120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:11.903407 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7dd89117-aff9-4834-b061-6133bb1271d0 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1500 microversion: 2.1 time: 0.687078 Oct 17 15:31:11.904629 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1318/2438] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:11 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1500 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:11.912191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-80c1e803-6f79-4d4d-a7c0-260b4cdab41a req-9aa6c684-e8f7-4e77-805d-b9a01ec2a51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189db5a7-8cc1-43e9-8edd-162434dd4ecf", "name": "network-vif-deleted", "tag": "a616fde1-6d69-41c3-9362-6f07d6ec877d"}, {"name": "network-changed", "server_uuid": "10e9df62-80cd-443d-b507-9f6177caec29", "tag": "b5b55dcd-5d2d-406e-b51b-55cafd9c3cf1"}, {"name": "network-changed", "server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "tag": "7638adff-3c05-4d72-827e-6283c228f4dd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:11.925344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-80c1e803-6f79-4d4d-a7c0-260b4cdab41a req-9aa6c684-e8f7-4e77-805d-b9a01ec2a51d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:11.926085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-80c1e803-6f79-4d4d-a7c0-260b4cdab41a req-9aa6c684-e8f7-4e77-805d-b9a01ec2a51d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:11.926754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-80c1e803-6f79-4d4d-a7c0-260b4cdab41a req-9aa6c684-e8f7-4e77-805d-b9a01ec2a51d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:11.944971 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-80c1e803-6f79-4d4d-a7c0-260b4cdab41a req-9aa6c684-e8f7-4e77-805d-b9a01ec2a51d service nova] Creating event network-vif-deleted:a616fde1-6d69-41c3-9362-6f07d6ec877d for instance 189db5a7-8cc1-43e9-8edd-162434dd4ecf on n-h1-854441-12 Oct 17 15:31:11.945820 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-80c1e803-6f79-4d4d-a7c0-260b4cdab41a req-9aa6c684-e8f7-4e77-805d-b9a01ec2a51d service nova] Creating event network-changed:b5b55dcd-5d2d-406e-b51b-55cafd9c3cf1 for instance 10e9df62-80cd-443d-b507-9f6177caec29 on n-h2-854441-12 Oct 17 15:31:11.949105 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-80c1e803-6f79-4d4d-a7c0-260b4cdab41a req-9aa6c684-e8f7-4e77-805d-b9a01ec2a51d service nova] Creating event network-changed:7638adff-3c05-4d72-827e-6283c228f4dd for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:31:11.963065 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-80c1e803-6f79-4d4d-a7c0-260b4cdab41a req-9aa6c684-e8f7-4e77-805d-b9a01ec2a51d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.056977 Oct 17 15:31:11.964196 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1319/2439] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:11.972174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:11.973023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:11.980591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:11.981689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:11.982290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:11.983263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:11.983873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:11.984445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:12.005066 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] HTTP exception thrown: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Request method failure captured: Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 HTTP/1.1 Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXRrotFyOT3s7GHzIHPE6uWMfx8F-CdclkI7hwDl8hWg6X5gNoUmRLJYpPL1EHO3IZfquc22fjYs_N9-6hJL8xRnGVX09Tpr2CsY4izv73mBzW12sp4pjboh3kBRrieeYM1gbqA1pXG3FvpLNLKNuPNyQu6zPljRgQjo2Fg_nYiZI0Q Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/947ae7af631447ca8963b47e913fb618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_947ae7af631447ca8963b47e913fb618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 62f7ab17b8454d049b81bdd07e41e62f Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'd0a6c5fc-30ba-49b2-ab11-747aae6d7f21'} Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:12.007486 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.011205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.014781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Returning 404 to user: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:12.015844 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba0ecf75-aba5-490d-96ce-dac77da17391 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 404 len: 111 microversion: 2.1 time: 0.050396 Oct 17 15:31:12.020139 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1320/2440] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:11 2022] DELETE /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:12.031530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:12.032451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:12.043171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:12.044661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:12.045301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:12.046226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:12.046907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:12.047812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:12.267852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:12.297448 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ccd71255-95ba-49fc-b277-308a31b9a68a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1307 microversion: 2.1 time: 1.305598 Oct 17 15:31:12.315701 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1121/2441] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:10 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1307 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:12.326892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:12.327966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] [instance: d0a6c5fc-30ba-49b2-ab11-747aae6d7f21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:12.338705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:12.340131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:12.340823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:12.341933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:12.342629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:12.343839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:12.368633 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] HTTP exception thrown: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Request method failure captured: Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 HTTP/1.1 Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRrotFyOT3s7GHzIHPE6uWMfx8F-CdclkI7hwDl8hWg6X5gNoUmRLJYpPL1EHO3IZfquc22fjYs_N9-6hJL8xRnGVX09Tpr2CsY4izv73mBzW12sp4pjboh3kBRrieeYM1gbqA1pXG3FvpLNLKNuPNyQu6zPljRgQjo2Fg_nYiZI0Q Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/947ae7af631447ca8963b47e913fb618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_947ae7af631447ca8963b47e913fb618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/947ae7af631447ca8963b47e913fb618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 947ae7af631447ca8963b47e913fb618 Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1093190684 Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 62f7ab17b8454d049b81bdd07e41e62f Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1093190684-project Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd0a6c5fc-30ba-49b2-ab11-747aae6d7f21'} Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:12.372215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.376038 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:12.376038 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:12.376038 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:12.376038 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:12.376038 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:12.376038 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. Oct 17 15:31:12.376038 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:12.380226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] Returning 404 to user: Instance d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:12.381698 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d233b9da-f05b-4ba3-a61b-9413692a5e90 tempest-ServerDiskConfigTestJSON-1093190684 tempest-ServerDiskConfigTestJSON-1093190684-project] 10.222.0.87 "GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21" status: 404 len: 111 microversion: 2.1 time: 0.064314 Oct 17 15:31:12.382903 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1122/2442] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:12 2022] GET /compute/v2.1/servers/d0a6c5fc-30ba-49b2-ab11-747aae6d7f21 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:12.389365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:12.390601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:12.400494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:12.401261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:12.401847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:12.402770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:12.403371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:12.403938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:12.755729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=44 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:13.006888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:13.016456 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3e93fab-d14d-46e2-bb09-49ee96aa136b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 0.632145 Oct 17 15:31:13.043964 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1123/2443] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:12 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:13.054753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:13.057515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:13.071693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:13.072959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:13.073570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:13.074707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:13.075365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:13.075948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:13.102876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:13.123171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:13.129331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:13.133097 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-489afdd6-3924-4790-9e29-01ba9c39a541 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1891 microversion: 2.32 time: 1.110257 Oct 17 15:31:13.135339 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1321/2444] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:12 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1891 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:13.145778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d2d4cf30-8dd1-487c-8957-c737508c638b req-e0b0f599-d844-4e6e-81ff-3ff14a95341b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33832aef-61a6-417f-9061-676bd10b92ac", "name": "network-vif-deleted", "tag": "b2d5c653-09bc-422e-8ea4-94b4d18f9d5b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:13.164780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2d4cf30-8dd1-487c-8957-c737508c638b req-e0b0f599-d844-4e6e-81ff-3ff14a95341b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:13.165554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2d4cf30-8dd1-487c-8957-c737508c638b req-e0b0f599-d844-4e6e-81ff-3ff14a95341b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:13.166165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d2d4cf30-8dd1-487c-8957-c737508c638b req-e0b0f599-d844-4e6e-81ff-3ff14a95341b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:13.179075 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d2d4cf30-8dd1-487c-8957-c737508c638b req-e0b0f599-d844-4e6e-81ff-3ff14a95341b service nova] Creating event network-vif-deleted:b2d5c653-09bc-422e-8ea4-94b4d18f9d5b for instance 33832aef-61a6-417f-9061-676bd10b92ac on n-h2-854441-12 Oct 17 15:31:13.185379 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d2d4cf30-8dd1-487c-8957-c737508c638b req-e0b0f599-d844-4e6e-81ff-3ff14a95341b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046701 Oct 17 15:31:13.186478 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1322/2445] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:13.331423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:13.331423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:13.344073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:13.346880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:13.349067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:13.351475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:13.352085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:13.355264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:13.460314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c8d45b2e4d459d92b024476b2f4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243aa6b3387c4549b5c94ec1ddc5c850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:13.463369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:13.475929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e661e8bb-cbba-40f1-a691-989746b02e68 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 200 len: 1458 microversion: 2.1 time: 0.430394 Oct 17 15:31:13.478622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1124/2446] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:13 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 1458 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:14.041561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:14.042443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:14.061098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:14.063103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:14.067623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:14.068733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:14.069396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:14.070006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:14.162158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:14.184388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-511e98f2-430e-4bc4-8335-0446f1822254 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1307 microversion: 2.1 time: 0.857220 Oct 17 15:31:14.187919 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1323/2447] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:13 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1307 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:14.229837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:14.232616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:14.242376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:14.247065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:14.248157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:14.250270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:14.250807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:14.251261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:14.536819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=18 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:14.895245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:14.908583 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1ab8cc68-8d1f-4a3b-a39e-fec68184d193 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 0.870968 Oct 17 15:31:14.909533 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1125/2448] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:14 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:31:14.920016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2af6c3ff-8be0-4634-bc1d-36facbd8d555 req-2b9c25cd-9ac8-4ec7-88ee-411c49985635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "tag": "a70fc0cc-532d-48ea-adcb-5fe9b4bf0584"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:14.955082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2af6c3ff-8be0-4634-bc1d-36facbd8d555 req-2b9c25cd-9ac8-4ec7-88ee-411c49985635 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:14.955780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2af6c3ff-8be0-4634-bc1d-36facbd8d555 req-2b9c25cd-9ac8-4ec7-88ee-411c49985635 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:14.956537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2af6c3ff-8be0-4634-bc1d-36facbd8d555 req-2b9c25cd-9ac8-4ec7-88ee-411c49985635 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:14.993091 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2af6c3ff-8be0-4634-bc1d-36facbd8d555 req-2b9c25cd-9ac8-4ec7-88ee-411c49985635 service nova] Creating event network-changed:a70fc0cc-532d-48ea-adcb-5fe9b4bf0584 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:31:15.012973 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2af6c3ff-8be0-4634-bc1d-36facbd8d555 req-2b9c25cd-9ac8-4ec7-88ee-411c49985635 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097596 Oct 17 15:31:15.014081 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1126/2449] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:15.028170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:15.031489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] [instance: 33832aef-61a6-417f-9061-676bd10b92ac] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:15.046275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:15.051757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:15.052465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:15.054111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:15.056655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:15.059402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:15.094306 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] HTTP exception thrown: Instance 33832aef-61a6-417f-9061-676bd10b92ac could not be found. Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Request method failure captured: Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac HTTP/1.1 Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXOLmfFwgk_ZQCuhxZvfajtzc1xwyl5ZP03KBNNFxl2mYkeBYGhqSPyOoQhsmngLF1wyxiuGkJW_H75csjEuvCA1gDvV2q-ws5RaPtbMco157-ejDAl65NSkBj5PPKBdpIoMG5kB0zy-02fKF3C2jig_7qJ98WGxK8CnzjrF4RyTSCw Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 243aa6b3387c4549b5c94ec1ddc5c850 Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-LiveMigrationTest-1409490073 Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/243aa6b3387c4549b5c94ec1ddc5c850"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-LiveMigrationTest-1409490073 Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 243aa6b3387c4549b5c94ec1ddc5c850 Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-LiveMigrationTest-1409490073 Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-LiveMigrationTest-1409490073-project Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 13c8d45b2e4d459d92b024476b2f4fbd Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-LiveMigrationTest-1409490073-project Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 33832aef-61a6-417f-9061-676bd10b92ac could not be found. Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '33832aef-61a6-417f-9061-676bd10b92ac'} Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33832aef-61a6-417f-9061-676bd10b92ac could not be found. Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33832aef-61a6-417f-9061-676bd10b92ac could not be found. Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:15.096209 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:15.099618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:15.099618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:15.099618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:15.099618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:15.099618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:15.099618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33832aef-61a6-417f-9061-676bd10b92ac could not be found. Oct 17 15:31:15.099618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:15.099618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] Returning 404 to user: Instance 33832aef-61a6-417f-9061-676bd10b92ac could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:15.099618 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a0feeb0-d21c-453e-9d4c-eb40c3649175 tempest-LiveMigrationTest-1409490073 tempest-LiveMigrationTest-1409490073-project] 10.222.0.87 "GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac" status: 404 len: 111 microversion: 2.1 time: 0.082146 Oct 17 15:31:15.102956 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1127/2450] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:15 2022] GET /compute/v2.1/servers/33832aef-61a6-417f-9061-676bd10b92ac => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:15.217227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:15.219591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:15.237826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:15.241046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:15.241616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:15.242438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:15.242959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:15.247999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:15.830141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:15.843689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:15.845365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:15.855104 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ae14a76-0de9-4f1e-9780-3bbf2593e28c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1891 microversion: 2.32 time: 1.640835 Oct 17 15:31:15.855574 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1324/2451] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:14 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1891 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:15.890349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:15.891025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:15.904537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:15.907311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:15.907987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:15.910479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:15.915938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:15.916568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:16.749960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:16.796352 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-306d4a7a-35c3-4318-9146-3b09573ecffb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1307 microversion: 2.1 time: 1.580201 Oct 17 15:31:16.812392 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1128/2452] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:15 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1307 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:16.827820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:16.831136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:16.851007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:16.851532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:16.857067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:16.859532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:16.863397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:16.864134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:17.037789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 8b7223bf-635f-444f-98a9-f4764b4cd42c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:31:17.074684 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bb4416e-c30b-461a-9e2e-6a57aebfe961 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 2422 microversion: 2.25 time: 1.194557 Oct 17 15:31:17.092410 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1325/2453] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:15 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 2422 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:17.104940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fce0aed3-f012-432a-bcad-df95c846cf9d req-6b19537b-514e-4ff6-82f5-fa91e0782e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae0e4163-6ad8-4c7b-bdc3-248b002e922a", "name": "network-vif-plugged", "status": "completed", "tag": "01806898-993c-4781-a839-d2f7bfbaa141"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:17.119219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fce0aed3-f012-432a-bcad-df95c846cf9d req-6b19537b-514e-4ff6-82f5-fa91e0782e76 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:17.120095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fce0aed3-f012-432a-bcad-df95c846cf9d req-6b19537b-514e-4ff6-82f5-fa91e0782e76 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:17.120767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fce0aed3-f012-432a-bcad-df95c846cf9d req-6b19537b-514e-4ff6-82f5-fa91e0782e76 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:17.138872 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fce0aed3-f012-432a-bcad-df95c846cf9d req-6b19537b-514e-4ff6-82f5-fa91e0782e76 service nova] Creating event network-vif-plugged:01806898-993c-4781-a839-d2f7bfbaa141 for instance ae0e4163-6ad8-4c7b-bdc3-248b002e922a on n-h2-854441-12 Oct 17 15:31:17.144435 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fce0aed3-f012-432a-bcad-df95c846cf9d req-6b19537b-514e-4ff6-82f5-fa91e0782e76 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050156 Oct 17 15:31:17.145567 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1326/2454] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:17.153179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:17.167443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:17.178591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:17.180414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:17.180919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:17.181734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:17.182361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:17.182865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:17.680080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:17.694404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe0fe6a3-6979-42b8-baf4-305de5b2ae6d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 0.880224 Oct 17 15:31:17.695601 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1129/2455] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:16 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:17.709488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854441-12", "block_migration": "auto"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:17.712767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:17.720846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:17.730192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:17.733516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:17.733516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:17.733882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:17.734558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:17.735217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:17.738797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:17.739323 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bab2ff99-942a-419e-bc87-614f25cc5071 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1891 microversion: 2.32 time: 0.590739 Oct 17 15:31:17.739632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:17.740622 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1327/2456] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:17 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1891 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:17.799305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'flavor' on Instance uuid 8b7223bf-635f-444f-98a9-f4764b4cd42c {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:31:17.827108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:17.827737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:17.838374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:17.838911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:17.839254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Going to try to live migrate instance to n-h2-854441-12 {{(pid=120407) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 15:31:17.839373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:17.840077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:17.840532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:17.840962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:18.436278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:18.449610 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d66d2318-b89e-4be0-8b23-4f7037bf9fe8 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1307 microversion: 2.1 time: 0.624193 Oct 17 15:31:18.451415 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1328/2457] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:17 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1307 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:18.729719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:18.732417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:18.768565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:18.771287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:18.772058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:18.784290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:18.784708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:18.785161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:19.723434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:19.744120 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3636668e-b004-46f5-a55b-6f10bbfa72e2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 1.028629 Oct 17 15:31:19.773093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1329/2458] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:18 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:19.788106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:19.789296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:19.804409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:19.804803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:19.805654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:19.806769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:19.807673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:19.808239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:20.564241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:20.587292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:20.614096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:20.616392 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de2cfa5e-0ed3-43a2-9df6-b94b06174a5a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1891 microversion: 2.32 time: 0.841431 Oct 17 15:31:20.620846 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1330/2459] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:19 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1891 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:20.673611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c5fbfcae-13a5-4d6f-afaf-f14892066606 req-112de86e-003b-4b5c-83ec-30719fb58eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "tag": "28f4ade6-9249-408e-bddf-227f23b2d6f1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:20.704271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5fbfcae-13a5-4d6f-afaf-f14892066606 req-112de86e-003b-4b5c-83ec-30719fb58eaf service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:20.704914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5fbfcae-13a5-4d6f-afaf-f14892066606 req-112de86e-003b-4b5c-83ec-30719fb58eaf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:20.705368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5fbfcae-13a5-4d6f-afaf-f14892066606 req-112de86e-003b-4b5c-83ec-30719fb58eaf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:20.750276 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c5fbfcae-13a5-4d6f-afaf-f14892066606 req-112de86e-003b-4b5c-83ec-30719fb58eaf service nova] Creating event network-changed:28f4ade6-9249-408e-bddf-227f23b2d6f1 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:31:20.762462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c5fbfcae-13a5-4d6f-afaf-f14892066606 req-112de86e-003b-4b5c-83ec-30719fb58eaf service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097733 Oct 17 15:31:20.765997 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1331/2460] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:20.802410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:20.803316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:20.821722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:20.822228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:20.830387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:20.832527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:20.834457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:20.834946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:21.906066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:21.929065 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3d9cd35-cbf1-4042-92cc-b633eacb9143 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1487 microversion: 2.1 time: 1.158741 Oct 17 15:31:21.929702 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1332/2461] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:20 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1487 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:21.953040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:21.963677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:21.978431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:21.979184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:21.979644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:21.980466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:21.980920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:21.981386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:22.556431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:22.593968 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8c75505-ff81-4f61-ad60-83ce4246ece2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 0.654139 Oct 17 15:31:22.617844 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1333/2462] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:21 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:22.632053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:22.642554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:22.655137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:22.660598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:22.661537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:22.662619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:22.668553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:22.669570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:22.670203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:23.057534 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7fa03108-bfa4-4c41-8d74-190c5c963f8d tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/action" status: 202 len: 0 microversion: 2.25 time: 5.358346 Oct 17 15:31:23.059336 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1130/2463] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:31:17 2022] POST /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/action => generated 0 bytes in 5364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:23.072677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d87f4057-37d4-4ea1-8167-848c9dda3619 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-804958770"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:23.077278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d87f4057-37d4-4ea1-8167-848c9dda3619 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:23.127096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d87f4057-37d4-4ea1-8167-848c9dda3619 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:23.130226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d87f4057-37d4-4ea1-8167-848c9dda3619 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:23.134427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d87f4057-37d4-4ea1-8167-848c9dda3619 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:23.136222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d87f4057-37d4-4ea1-8167-848c9dda3619 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:23.137531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d87f4057-37d4-4ea1-8167-848c9dda3619 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:23.139142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d87f4057-37d4-4ea1-8167-848c9dda3619 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:23.552375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:23.579195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:23.584044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:23.590048 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e16d42c-d421-43bf-b139-36685366ff27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.969757 Oct 17 15:31:23.592130 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1334/2464] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:22 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:23.610216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e7292d14-3773-4496-a439-e6984b932c84 req-e5215e81-14f5-44be-89d8-ca1272760e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e9df62-80cd-443d-b507-9f6177caec29", "name": "network-vif-plugged", "status": "completed", "tag": "b5b55dcd-5d2d-406e-b51b-55cafd9c3cf1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:23.639799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e7292d14-3773-4496-a439-e6984b932c84 req-e5215e81-14f5-44be-89d8-ca1272760e3e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:23.640293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e7292d14-3773-4496-a439-e6984b932c84 req-e5215e81-14f5-44be-89d8-ca1272760e3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:23.640724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e7292d14-3773-4496-a439-e6984b932c84 req-e5215e81-14f5-44be-89d8-ca1272760e3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:23.693534 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e7292d14-3773-4496-a439-e6984b932c84 req-e5215e81-14f5-44be-89d8-ca1272760e3e service nova] Creating event network-vif-plugged:b5b55dcd-5d2d-406e-b51b-55cafd9c3cf1 for instance 10e9df62-80cd-443d-b507-9f6177caec29 on n-h2-854441-12 Oct 17 15:31:23.700937 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d87f4057-37d4-4ea1-8167-848c9dda3619 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "POST /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a/action" status: 202 len: 0 microversion: 2.1 time: 0.638658 Oct 17 15:31:23.706090 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1131/2465] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:31:23 2022] POST /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:31:23.723303 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e7292d14-3773-4496-a439-e6984b932c84 req-e5215e81-14f5-44be-89d8-ca1272760e3e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115567 Oct 17 15:31:23.729017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:23.732934 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1335/2466] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:23.737528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:23.755331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b72d5f05-2766-4764-8b00-13aba05a6105 req-bc23c6dc-9794-4da2-8f32-5faebad4e4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "tag": "939b9377-081a-4450-baf8-394f3055e596"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:23.763790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:23.770227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:23.773947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:23.774142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b72d5f05-2766-4764-8b00-13aba05a6105 req-bc23c6dc-9794-4da2-8f32-5faebad4e4f5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:23.774374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b72d5f05-2766-4764-8b00-13aba05a6105 req-bc23c6dc-9794-4da2-8f32-5faebad4e4f5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:23.774942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b72d5f05-2766-4764-8b00-13aba05a6105 req-bc23c6dc-9794-4da2-8f32-5faebad4e4f5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:23.779009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:23.780101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:23.781015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:23.813573 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b72d5f05-2766-4764-8b00-13aba05a6105 req-bc23c6dc-9794-4da2-8f32-5faebad4e4f5 service nova] Creating event network-changed:939b9377-081a-4450-baf8-394f3055e596 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:31:23.820301 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b72d5f05-2766-4764-8b00-13aba05a6105 req-bc23c6dc-9794-4da2-8f32-5faebad4e4f5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085742 Oct 17 15:31:23.822052 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1336/2467] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:23.839085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:23.839969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:23.856879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:23.857382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:23.857816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:23.858546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:23.858999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:23.859418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:23.890081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:24.662691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:24.675082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:24.682115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:24.684163 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-51f98fce-8df2-427b-90bb-95e4bf837a05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.976086 Oct 17 15:31:24.695853 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1132/2468] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:23 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:24.711387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-52c56bc0-b5e6-48a5-b611-1e4812dbd081 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28beb0b670>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:24.785654 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-52c56bc0-b5e6-48a5-b611-1e4812dbd081 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0" status: 200 len: 1413 microversion: 2.1 time: 0.088485 Oct 17 15:31:24.788251 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1133/2469] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:31:24 2022] GET /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:24.807056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:24.808347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:24.827977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:24.829042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:24.834476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:24.835774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:24.836573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:24.837203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:25.416952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:25.431912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:25.448826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:25.450583 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-87742867-0898-4aba-8feb-36c354dc22fa tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.659739 Oct 17 15:31:25.454226 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1134/2470] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:24 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:25.479504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-09916577-04de-41d2-bf2a-5922617e0726 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea56280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:25.486280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:25.500647 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55f349ce-fdd2-4a3b-bfb6-62f1b5538fc5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1315 microversion: 2.1 time: 1.673159 Oct 17 15:31:25.516573 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1337/2471] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:23 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1315 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:25.549201 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-09916577-04de-41d2-bf2a-5922617e0726 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0" status: 200 len: 1413 microversion: 2.1 time: 0.092052 Oct 17 15:31:25.549837 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1135/2472] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:31:25 2022] GET /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:25.573871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-259851c3-d761-4e89-a8dd-027c3e862ee1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28c3043670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:25.721715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:25.733618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:25.769050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:25.772001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:25.772740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:25.785152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:25.786212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:25.791986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:26.184208 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-259851c3-d761-4e89-a8dd-027c3e862ee1 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0" status: 204 len: 0 microversion: 2.1 time: 0.617824 Oct 17 15:31:26.185476 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1338/2473] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:25 2022] DELETE /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:26.191613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b2218187-134a-47db-82ca-58e7cf4d8b52 req-a14a1028-5f9c-489f-954e-46cd47719984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "tag": "82b2b4fa-2b93-4223-9b70-a4bef4b4a357"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:26.220229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2218187-134a-47db-82ca-58e7cf4d8b52 req-a14a1028-5f9c-489f-954e-46cd47719984 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:26.221496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2218187-134a-47db-82ca-58e7cf4d8b52 req-a14a1028-5f9c-489f-954e-46cd47719984 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:26.222228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b2218187-134a-47db-82ca-58e7cf4d8b52 req-a14a1028-5f9c-489f-954e-46cd47719984 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:26.238691 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b2218187-134a-47db-82ca-58e7cf4d8b52 req-a14a1028-5f9c-489f-954e-46cd47719984 service nova] Creating event network-changed:82b2b4fa-2b93-4223-9b70-a4bef4b4a357 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:31:26.243249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:26.246344 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b2218187-134a-47db-82ca-58e7cf4d8b52 req-a14a1028-5f9c-489f-954e-46cd47719984 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059168 Oct 17 15:31:26.248838 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1339/2474] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:26.259293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-909f74aa-215c-4af3-bac4-8199ce7ee91e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bed1d3a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:26.260810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:26.262312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:26.263842 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2e1ed42c-c68f-4018-942a-eacbe87ba9ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.551425 Oct 17 15:31:26.267339 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1136/2475] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:25 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:26.302435 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-909f74aa-215c-4af3-bac4-8199ce7ee91e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Image not found. Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-909f74aa-215c-4af3-bac4-8199ce7ee91e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0 HTTP/1.1 Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: exception: Image not found. Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '9b71effd-d514-4c9b-8aed-39cfced830a0'} Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9b71effd-d514-4c9b-8aed-39cfced830a0 Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:31:26.305313 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b71effd-d514-4c9b-8aed-39cfced830a0 could not be found. Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:26.309256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-909f74aa-215c-4af3-bac4-8199ce7ee91e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:26.311810 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-909f74aa-215c-4af3-bac4-8199ce7ee91e tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0" status: 404 len: 62 microversion: 2.1 time: 0.060484 Oct 17 15:31:26.313156 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1340/2476] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:31:26 2022] GET /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:31:26.324329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:26.324958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:26.340388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:26.341345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:26.342312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:26.343764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:26.345105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:26.346244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:26.489922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:26.490890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:26.500886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:26.501666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:26.502606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:26.503998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:26.504710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:26.505361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:27.183874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:27.206292 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d8fa6c95-80b7-451b-8471-a1d50c6e48a5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1505 microversion: 2.1 time: 0.886478 Oct 17 15:31:27.207687 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1137/2477] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:26 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1505 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:27.213813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:27.214696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:27.222242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:27.223177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:27.223790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:27.224677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:27.225282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:27.225855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:27.241848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:27.258658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:27.260311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:27.261581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1699588e-d76d-42c3-9fb0-a51fafc07f63 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.776884 Oct 17 15:31:27.262174 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1341/2478] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:26 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:27.307156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:27.307861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:27.317547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:27.318053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:27.326643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:27.327911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:27.328722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:27.329336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:27.635796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:27.648474 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c036a598-57df-45a5-84c9-17256871f20d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1502 microversion: 2.1 time: 0.437356 Oct 17 15:31:27.662126 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1138/2479] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:27 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1502 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:27.682617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a218f61-f5c9-4d1d-b910-d0856a871c0c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:27.683461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a218f61-f5c9-4d1d-b910-d0856a871c0c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:27.692886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a218f61-f5c9-4d1d-b910-d0856a871c0c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:27.694255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a218f61-f5c9-4d1d-b910-d0856a871c0c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:27.697315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a218f61-f5c9-4d1d-b910-d0856a871c0c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:27.700453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a218f61-f5c9-4d1d-b910-d0856a871c0c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:27.702941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a218f61-f5c9-4d1d-b910-d0856a871c0c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:27.703538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a218f61-f5c9-4d1d-b910-d0856a871c0c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:27.848102 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a218f61-f5c9-4d1d-b910-d0856a871c0c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29/action" status: 202 len: 0 microversion: 2.1 time: 0.169340 Oct 17 15:31:27.849467 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1139/2480] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:31:27 2022] POST /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:31:27.908970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:27.910743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:27.979085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:27.979996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:27.980783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:27.982109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:27.982953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:27.983716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:28.060538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:28.279049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:28.296021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:28.298327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:28.300243 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0fe67146-05b7-4ed5-924f-0c359bace588 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.997167 Oct 17 15:31:28.301094 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1342/2481] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:27 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:28.317176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:28.318847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:28.333427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:28.341009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:28.341853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:28.342891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:28.343599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:28.344384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:28.746751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:28.775530 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c4723273-a493-4fa7-8d10-a86e09ad7e7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1507 microversion: 2.1 time: 0.904998 Oct 17 15:31:28.776334 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1140/2482] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:27 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1507 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:28.792619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-05a84476-6c93-4d30-96dc-65d8e19dddaa req-855d9d38-88d6-43b3-a4f9-93465a5a00d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "tag": "6d195a6f-05bb-41b8-9a6a-e8ec5eb28188"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:28.816857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-05a84476-6c93-4d30-96dc-65d8e19dddaa req-855d9d38-88d6-43b3-a4f9-93465a5a00d2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:28.820269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-05a84476-6c93-4d30-96dc-65d8e19dddaa req-855d9d38-88d6-43b3-a4f9-93465a5a00d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:28.829336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-05a84476-6c93-4d30-96dc-65d8e19dddaa req-855d9d38-88d6-43b3-a4f9-93465a5a00d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:28.858571 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-05a84476-6c93-4d30-96dc-65d8e19dddaa req-855d9d38-88d6-43b3-a4f9-93465a5a00d2 service nova] Creating event network-changed:6d195a6f-05bb-41b8-9a6a-e8ec5eb28188 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:31:28.901106 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-05a84476-6c93-4d30-96dc-65d8e19dddaa req-855d9d38-88d6-43b3-a4f9-93465a5a00d2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114158 Oct 17 15:31:28.906461 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1141/2483] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:28.966816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:28.967878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:28.981318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:28.982289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:28.983095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:28.984774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:28.985948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:28.987008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:29.603222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:29.622624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:29.627010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:29.629255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a995962c-d54f-4af5-bad2-ddcf810e0e5e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.712427 Oct 17 15:31:29.639788 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1142/2484] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:28 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:29.645678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:29.646773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:29.671637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:29.672617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:29.673374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:29.674485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:29.675296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:29.675983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:30.193172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:30.213780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:30.218387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:30.221263 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-026c44fb-97f3-4047-a505-75c08af283b8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.579931 Oct 17 15:31:30.223093 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1143/2485] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:29 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:30.235760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:30.239520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:30.266754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:30.268546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:30.269354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:30.272483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:30.277905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:30.279675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:30.574803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:30.637165 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8acc0b30-aed0-42ba-8093-93fe381253c9 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1487 microversion: 2.1 time: 2.332072 Oct 17 15:31:30.649465 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1343/2486] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:28 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1487 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:30.686323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:30.687352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:30.694113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:30.697243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:30.698072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:30.699037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:30.702181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:30.703027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:30.766678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:31:30.932155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:30.945100 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b670f357-1d15-4513-83ce-305263a8b41b tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 204 len: 0 microversion: 2.1 time: 0.282913 Oct 17 15:31:30.955030 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1344/2487] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:30 2022] DELETE /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:30.978925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:30.986144 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eeef5034-45eb-4f97-8d69-97fa20e89910 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1487 microversion: 2.1 time: 0.755616 Oct 17 15:31:30.986820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:30.988101 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1144/2488] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:30 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1487 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:30.998965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-911f756b-43c5-45bc-9989-6c005e1a1c8a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea48670>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:31.003483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:31.009660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:31.014794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:31.016998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:31.022252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:31.025127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:31.062183 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-911f756b-43c5-45bc-9989-6c005e1a1c8a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Image not found. Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-911f756b-43c5-45bc-9989-6c005e1a1c8a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0 HTTP/1.1 Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '9b71effd-d514-4c9b-8aed-39cfced830a0'} Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9b71effd-d514-4c9b-8aed-39cfced830a0 to delete Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b71effd-d514-4c9b-8aed-39cfced830a0 could not be found. Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:31.067220 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:31:31.075940 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:31.081861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-911f756b-43c5-45bc-9989-6c005e1a1c8a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:31.083972 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-911f756b-43c5-45bc-9989-6c005e1a1c8a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0" status: 404 len: 62 microversion: 2.1 time: 0.092771 Oct 17 15:31:31.085341 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1145/2489] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:30 2022] DELETE /compute/v2.1/images/9b71effd-d514-4c9b-8aed-39cfced830a0 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:31:31.100357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:31.101990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:31.123934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:31.125257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:31.126374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:31.128562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:31.130017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:31.131102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:31.191641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:31:31.429706 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-19a8c415-42cc-4a54-9e49-47bf9c2e6377 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 204 len: 0 microversion: 2.1 time: 0.340006 Oct 17 15:31:31.433650 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1146/2490] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:31 2022] DELETE /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:31.447703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:31.449789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:31.466424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:31.467941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:31.469596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:31.471609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:31.479560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:31.480980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:31.599982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:31:31.726724 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.api [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Instance is already in deleting state, ignoring this request Oct 17 15:31:31.732556 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6eb87ee-b65f-464b-b751-cff1437db3cb tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 204 len: 0 microversion: 2.1 time: 0.294493 Oct 17 15:31:31.734327 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1147/2491] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:31 2022] DELETE /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:31:31.744911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:31.745717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:31.758007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:31.758752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:31.759409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:31.760334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:31.761014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:31.765010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:31.851852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:31.869208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:31.877359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:31.880053 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60e47149-e018-49e7-908e-68d3e648606a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.920394 Oct 17 15:31:31.882733 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1345/2492] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:30 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:31.897292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:31.898318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:31.981513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:31.986031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:31.996375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:32.004649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:32.010967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:32.022015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:32.211298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:32.228338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:32.242537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:32.245033 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dd94cc26-065d-4f1c-a084-4b0119c3f0e5 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.508528 Oct 17 15:31:32.253379 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1148/2493] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:31 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:32.259358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:32.266850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:32.295480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:32.296370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:32.297205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:32.298162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:32.298874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:32.299494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:32.776801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:32.795119 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aabdfe93-77ed-4c28-99d0-aa5626ca4e66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1493 microversion: 2.1 time: 0.910579 Oct 17 15:31:32.814682 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1346/2494] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:31 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1493 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:33.023669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:33.035560 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4875d2e5-0adc-4a1a-8a72-82383027c2ee tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1493 microversion: 2.1 time: 0.780326 Oct 17 15:31:33.036694 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1149/2495] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:32 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1493 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:33.060274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:33.060932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:33.087817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:33.088334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:33.088784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:33.089546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:33.090543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:33.090543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:33.261600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12259530-f1cc-4b65-b3b0-445a56090b40 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Calling method '.version_select at 0x7f28bebd3790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:33.551197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-12259530-f1cc-4b65-b3b0-445a56090b40 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e4fa760a-92fc-4373-9071-d885f433fd5c does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:31:33.551800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-12259530-f1cc-4b65-b3b0-445a56090b40 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Neutron security group e4fa760a-92fc-4373-9071-d885f433fd5c not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:31:33.552336 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-12259530-f1cc-4b65-b3b0-445a56090b40 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] HTTP exception thrown: Security group e4fa760a-92fc-4373-9071-d885f433fd5c does not exist Oct 17 15:31:33.552336 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-8d775fb2-dd38-4040-a7f3-face07ddedb4'] Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12259530-f1cc-4b65-b3b0-445a56090b40 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Request method failure captured: Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/e4fa760a-92fc-4373-9071-d885f433fd5c HTTP/1.1 Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXVUW32CeM81o4fAp7-MZPwTFv7ukS93thIMAl6ag_L0yjYq9r9ZVFP2kGKIg8mrXRWTquAaFYpXoyClgOZYPMF2ShDEVbEH4sn9rzVsJD_SJ4po924r9_pGSzu8QufEyiknXrVxiEdpKgTJFu1Gv6zZAJKNammV1cvhPLmYisctv9w Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 75777f66e5594362906965364de7cf3c Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/75777f66e5594362906965364de7cf3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/75777f66e5594362906965364de7cf3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_75777f66e5594362906965364de7cf3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/75777f66e5594362906965364de7cf3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 75777f66e5594362906965364de7cf3c Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsNegativeTestJSON-780550356-project Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 75d00942217b48ccb7551ed84683dc35 Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-780550356-project Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group e4fa760a-92fc-4373-9071-d885f433fd5c does not exist Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-8d775fb2-dd38-4040-a7f3-face07ddedb4'] Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e4fa760a-92fc-4373-9071-d885f433fd5c'} Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:31:33.554540 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e4fa760a-92fc-4373-9071-d885f433fd5c does not exist Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d775fb2-dd38-4040-a7f3-face07ddedb4'] Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e4fa760a-92fc-4373-9071-d885f433fd5c does not exist Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d775fb2-dd38-4040-a7f3-face07ddedb4'] Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e4fa760a-92fc-4373-9071-d885f433fd5c does not exist Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d775fb2-dd38-4040-a7f3-face07ddedb4'] Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e4fa760a-92fc-4373-9071-d885f433fd5c does not exist Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d775fb2-dd38-4040-a7f3-face07ddedb4'] Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12259530-f1cc-4b65-b3b0-445a56090b40 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Returning 404 to user: Security group e4fa760a-92fc-4373-9071-d885f433fd5c does not exist Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-8d775fb2-dd38-4040-a7f3-face07ddedb4'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-12259530-f1cc-4b65-b3b0-445a56090b40 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/e4fa760a-92fc-4373-9071-d885f433fd5c" status: 404 len: 194 microversion: 2.1 time: 0.740275 Oct 17 15:31:33.564156 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1347/2496] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:31:32 2022] DELETE /compute/v2.1/os-security-groups/e4fa760a-92fc-4373-9071-d885f433fd5c => generated 194 bytes in 742 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:33.566546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:33.566546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:33.597996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:33.598594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:33.603524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:33.604377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:33.604882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:33.611290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:34.586239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:34.599183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:34.600729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:34.602045 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4104d66c-6b29-4a2c-8b07-d3249e920779 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 1.044203 Oct 17 15:31:34.617602 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1348/2497] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:33 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:34.652801 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-779c247b-9177-4058-85d5-b1bbf99ea28c tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.032668 Oct 17 15:31:34.653390 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1349/2498] 10.222.0.87 () {58 vars in 1164 bytes} [Mon Oct 17 15:31:34 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 15:31:34.658237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:34.680304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:34.705430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:34.707125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:34.711116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:34.711914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:34.712402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:34.712838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:35.400503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:35.414606 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-779b742f-974b-4df9-8995-eb7a73fff83b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1493 microversion: 2.1 time: 0.755902 Oct 17 15:31:35.415696 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1350/2499] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:34 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1493 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:35.445362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:35.447333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:35.465352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:35.466116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:35.466853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:35.467759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:35.470611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:35.471284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:35.773077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:35.794371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:35.809196 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-449d86b0-5ddd-4f09-9a09-741c779731b4 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1493 microversion: 2.1 time: 0.371850 Oct 17 15:31:35.810561 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1351/2500] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:35 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1493 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:35.826250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:35.829941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c29b627b-7a7e-46f8-80b6-d1d257c49c9d tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Calling method '.version_select at 0x7f28bea69af0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:35.831530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:35.833853 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a5cf7671-58c0-47bf-ad3d-c7069b726ff5 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 2.795748 Oct 17 15:31:35.837035 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1150/2501] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:33 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 2799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:35.863375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:35.870467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:35.913602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:35.915313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:35.916028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:35.926915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:35.927687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:35.928377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:36.492126 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c29b627b-7a7e-46f8-80b6-d1d257c49c9d tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.679335 Oct 17 15:31:36.493669 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1352/2502] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:31:35 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:36.498803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:36.499649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:36.524702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:36.527389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:36.529221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:36.535182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:36.536073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:36.536766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:37.481316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:37.518682 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b7cdb17-642a-4f18-8df4-5f1e1c0d8815 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1493 microversion: 2.1 time: 1.023242 Oct 17 15:31:37.525482 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1353/2503] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:36 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1493 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:37.594300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-261a2494-a37e-4589-8d33-02f35f1b5788 req-49a5c5d9-243e-4347-9479-3bbabdc493f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e9df62-80cd-443d-b507-9f6177caec29", "name": "network-vif-unplugged", "status": "completed", "tag": "b5b55dcd-5d2d-406e-b51b-55cafd9c3cf1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:37.672517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-261a2494-a37e-4589-8d33-02f35f1b5788 req-49a5c5d9-243e-4347-9479-3bbabdc493f3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:37.675758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-261a2494-a37e-4589-8d33-02f35f1b5788 req-49a5c5d9-243e-4347-9479-3bbabdc493f3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:37.676620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-261a2494-a37e-4589-8d33-02f35f1b5788 req-49a5c5d9-243e-4347-9479-3bbabdc493f3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:37.743407 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-261a2494-a37e-4589-8d33-02f35f1b5788 req-49a5c5d9-243e-4347-9479-3bbabdc493f3 service nova] Creating event network-vif-unplugged:b5b55dcd-5d2d-406e-b51b-55cafd9c3cf1 for instance 10e9df62-80cd-443d-b507-9f6177caec29 on n-h2-854441-12 Oct 17 15:31:37.760766 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-261a2494-a37e-4589-8d33-02f35f1b5788 req-49a5c5d9-243e-4347-9479-3bbabdc493f3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.228025 Oct 17 15:31:37.764386 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1354/2504] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:37.777990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3194d97-20e7-4710-9bd5-1c1796a0115d tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Calling method '.version_select at 0x7f28bed1d5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:38.115390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:38.133359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:38.140995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:38.145085 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-032219a3-bbd1-4d90-ba41-d19d65f5bebf tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 2.305822 Oct 17 15:31:38.149927 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1151/2505] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:35 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:38.172451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:38.174247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:38.194664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:38.198877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:38.199865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:38.202240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:38.204819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:38.205560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:38.246750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-f3194d97-20e7-4710-9bd5-1c1796a0115d tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:31:38.247933 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f3194d97-20e7-4710-9bd5-1c1796a0115d tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 17 15:31:38.247933 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-3fe9e10c-672e-4222-be14-0399a97ee7b9'] Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3194d97-20e7-4710-9bd5-1c1796a0115d tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Request method failure captured: Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-security-groups/35afef0b-8af1-4bfa-aa0c-76ed98cebaed HTTP/1.1 Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXVUW32CeM81o4fAp7-MZPwTFv7ukS93thIMAl6ag_L0yjYq9r9ZVFP2kGKIg8mrXRWTquAaFYpXoyClgOZYPMF2ShDEVbEH4sn9rzVsJD_SJ4po924r9_pGSzu8QufEyiknXrVxiEdpKgTJFu1Gv6zZAJKNammV1cvhPLmYisctv9w Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 75777f66e5594362906965364de7cf3c Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/75777f66e5594362906965364de7cf3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/75777f66e5594362906965364de7cf3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_75777f66e5594362906965364de7cf3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/75777f66e5594362906965364de7cf3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 75777f66e5594362906965364de7cf3c Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsNegativeTestJSON-780550356-project Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 75d00942217b48ccb7551ed84683dc35 Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-780550356-project Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: exception: Insufficient rights for removing default security group. Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-3fe9e10c-672e-4222-be14-0399a97ee7b9'] Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '35afef0b-8af1-4bfa-aa0c-76ed98cebaed'} Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:31:38.251064 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fe9e10c-672e-4222-be14-0399a97ee7b9'] Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fe9e10c-672e-4222-be14-0399a97ee7b9'] Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fe9e10c-672e-4222-be14-0399a97ee7b9'] Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fe9e10c-672e-4222-be14-0399a97ee7b9'] Oct 17 15:31:38.254712 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.260829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3194d97-20e7-4710-9bd5-1c1796a0115d tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 17 15:31:38.260829 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-3fe9e10c-672e-4222-be14-0399a97ee7b9'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:38.262035 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3194d97-20e7-4710-9bd5-1c1796a0115d tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/35afef0b-8af1-4bfa-aa0c-76ed98cebaed" status: 400 len: 182 microversion: 2.1 time: 0.496121 Oct 17 15:31:38.263217 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1355/2506] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:31:37 2022] DELETE /compute/v2.1/os-security-groups/35afef0b-8af1-4bfa-aa0c-76ed98cebaed => generated 182 bytes in 498 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:31:38.277971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:38.279362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:38.307548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:38.313848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:38.317825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:38.320003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:38.320180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:38.321775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:38.322397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:38.323497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lazy-loading 'fault' on Instance uuid ae0e4163-6ad8-4c7b-bdc3-248b002e922a {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:31:38.324952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:38.335908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:38.608820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a1c6dac66a43d9b5e91b78215359ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecc5c53621946e0bd84b2a94584f5bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:38.627985 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc77f0dc-7518-4268-abe1-e7fbe2e88874 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 200 len: 1297 microversion: 2.1 time: 0.475012 Oct 17 15:31:38.639140 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1152/2507] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:38 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 1297 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:38.652128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1e357474-0154-4683-aaba-3a93b7c26e7e req-c5fc2993-c8a3-4690-a93c-279a44c1434d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae0e4163-6ad8-4c7b-bdc3-248b002e922a", "name": "network-vif-deleted", "tag": "01806898-993c-4781-a839-d2f7bfbaa141"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:38.680844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e357474-0154-4683-aaba-3a93b7c26e7e req-c5fc2993-c8a3-4690-a93c-279a44c1434d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:38.681599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e357474-0154-4683-aaba-3a93b7c26e7e req-c5fc2993-c8a3-4690-a93c-279a44c1434d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:38.682193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e357474-0154-4683-aaba-3a93b7c26e7e req-c5fc2993-c8a3-4690-a93c-279a44c1434d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:38.703168 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1e357474-0154-4683-aaba-3a93b7c26e7e req-c5fc2993-c8a3-4690-a93c-279a44c1434d service nova] Creating event network-vif-deleted:01806898-993c-4781-a839-d2f7bfbaa141 for instance ae0e4163-6ad8-4c7b-bdc3-248b002e922a on n-h2-854441-12 Oct 17 15:31:38.728974 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1e357474-0154-4683-aaba-3a93b7c26e7e req-c5fc2993-c8a3-4690-a93c-279a44c1434d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087874 Oct 17 15:31:38.729484 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1153/2508] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:38.746079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5d7ac1a-0360-4546-abec-0eb07368d3d2 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Calling method '.version_select at 0x7f28bea4aa60>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:38.904286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-c5d7ac1a-0360-4546-abec-0eb07368d3d2 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cbbc8e6a-96ba-4cf3-8f77-499d32045d77 does not exist", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:31:38.905388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.security_group_api [None req-c5d7ac1a-0360-4546-abec-0eb07368d3d2 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Neutron security group cbbc8e6a-96ba-4cf3-8f77-499d32045d77 not found {{(pid=120407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:31:38.906198 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-c5d7ac1a-0360-4546-abec-0eb07368d3d2 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] HTTP exception thrown: Security group cbbc8e6a-96ba-4cf3-8f77-499d32045d77 does not exist Oct 17 15:31:38.906198 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-a02ae5fc-b8f1-4cb5-94e4-5c601f1b53d9'] Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5d7ac1a-0360-4546-abec-0eb07368d3d2 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Request method failure captured: Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-security-groups/cbbc8e6a-96ba-4cf3-8f77-499d32045d77 HTTP/1.1 Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXVUW32CeM81o4fAp7-MZPwTFv7ukS93thIMAl6ag_L0yjYq9r9ZVFP2kGKIg8mrXRWTquAaFYpXoyClgOZYPMF2ShDEVbEH4sn9rzVsJD_SJ4po924r9_pGSzu8QufEyiknXrVxiEdpKgTJFu1Gv6zZAJKNammV1cvhPLmYisctv9w Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 75777f66e5594362906965364de7cf3c Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/75777f66e5594362906965364de7cf3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/75777f66e5594362906965364de7cf3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_75777f66e5594362906965364de7cf3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/75777f66e5594362906965364de7cf3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 75777f66e5594362906965364de7cf3c Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-SecurityGroupsNegativeTestJSON-780550356-project Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 75d00942217b48ccb7551ed84683dc35 Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-780550356-project Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: exception: Security group cbbc8e6a-96ba-4cf3-8f77-499d32045d77 does not exist Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-a02ae5fc-b8f1-4cb5-94e4-5c601f1b53d9'] Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'cbbc8e6a-96ba-4cf3-8f77-499d32045d77'} Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:31:38.908638 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cbbc8e6a-96ba-4cf3-8f77-499d32045d77 does not exist Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a02ae5fc-b8f1-4cb5-94e4-5c601f1b53d9'] Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cbbc8e6a-96ba-4cf3-8f77-499d32045d77 does not exist Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a02ae5fc-b8f1-4cb5-94e4-5c601f1b53d9'] Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cbbc8e6a-96ba-4cf3-8f77-499d32045d77 does not exist Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a02ae5fc-b8f1-4cb5-94e4-5c601f1b53d9'] Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cbbc8e6a-96ba-4cf3-8f77-499d32045d77 does not exist Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a02ae5fc-b8f1-4cb5-94e4-5c601f1b53d9'] Oct 17 15:31:38.912522 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:38.916473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5d7ac1a-0360-4546-abec-0eb07368d3d2 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Returning 404 to user: Security group cbbc8e6a-96ba-4cf3-8f77-499d32045d77 does not exist Oct 17 15:31:38.916473 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-a02ae5fc-b8f1-4cb5-94e4-5c601f1b53d9'] {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:38.917700 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5d7ac1a-0360-4546-abec-0eb07368d3d2 tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups/cbbc8e6a-96ba-4cf3-8f77-499d32045d77" status: 404 len: 194 microversion: 2.1 time: 0.176612 Oct 17 15:31:38.923761 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1154/2509] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:31:38 2022] GET /compute/v2.1/os-security-groups/cbbc8e6a-96ba-4cf3-8f77-499d32045d77 => generated 194 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:38.933649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:38.937891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:38.974273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:38.977252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:38.978221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:38.978916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:38.980070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:38.980727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:38.981341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:38.998077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:39.009988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:39.011802 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6cec737f-c021-43f1-bd74-865fc7817560 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.747283 Oct 17 15:31:39.012794 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1356/2510] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:38 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:39.024627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2296aa1c-1cd4-4a9f-a2b6-c0cb6281d94f tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Action: 'update', calling method: .version_select at 0x7f28bebd3280>, body: {"security_group": {"name": "tempest-sg-306772880", "description": "tempest-description-204252463"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:39.201421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG neutronclient.v2_0.client [None req-2296aa1c-1cd4-4a9f-a2b6-c0cb6281d94f tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1e15013b-4391-452a-8322-d94cb2b3da42 does not exist", "detail": ""}} {{(pid=120406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:31:39.202291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-2296aa1c-1cd4-4a9f-a2b6-c0cb6281d94f tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Neutron security group 1e15013b-4391-452a-8322-d94cb2b3da42 not found {{(pid=120406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:31:39.203465 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2296aa1c-1cd4-4a9f-a2b6-c0cb6281d94f tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] HTTP exception thrown: Security group 1e15013b-4391-452a-8322-d94cb2b3da42 does not exist Oct 17 15:31:39.203465 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-354d218d-c51f-4798-8658-a8382ff1a257'] Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2296aa1c-1cd4-4a9f-a2b6-c0cb6281d94f tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Request method failure captured: Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/os-security-groups/1e15013b-4391-452a-8322-d94cb2b3da42 HTTP/1.1 Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 100 Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXVUW32CeM81o4fAp7-MZPwTFv7ukS93thIMAl6ag_L0yjYq9r9ZVFP2kGKIg8mrXRWTquAaFYpXoyClgOZYPMF2ShDEVbEH4sn9rzVsJD_SJ4po924r9_pGSzu8QufEyiknXrVxiEdpKgTJFu1Gv6zZAJKNammV1cvhPLmYisctv9w Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 75777f66e5594362906965364de7cf3c Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/75777f66e5594362906965364de7cf3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/75777f66e5594362906965364de7cf3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_75777f66e5594362906965364de7cf3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/75777f66e5594362906965364de7cf3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 75777f66e5594362906965364de7cf3c Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-780550356 Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-SecurityGroupsNegativeTestJSON-780550356-project Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 75d00942217b48ccb7551ed84683dc35 Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-780550356-project Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: {"security_group": {"name": "tempest-sg-306772880", "description": "tempest-description-204252463"}} Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: exception: Security group 1e15013b-4391-452a-8322-d94cb2b3da42 does not exist Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-354d218d-c51f-4798-8658-a8382ff1a257'] Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1e15013b-4391-452a-8322-d94cb2b3da42', 'body': {'security_group': {'name': 'tempest-sg-306772880', 'description': 'tempest-description-204252463'}}} Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:31:39.206273 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1e15013b-4391-452a-8322-d94cb2b3da42 does not exist Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-354d218d-c51f-4798-8658-a8382ff1a257'] Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1e15013b-4391-452a-8322-d94cb2b3da42 does not exist Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-354d218d-c51f-4798-8658-a8382ff1a257'] Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1e15013b-4391-452a-8322-d94cb2b3da42 does not exist Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-354d218d-c51f-4798-8658-a8382ff1a257'] Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1e15013b-4391-452a-8322-d94cb2b3da42 does not exist Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-354d218d-c51f-4798-8658-a8382ff1a257'] Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2296aa1c-1cd4-4a9f-a2b6-c0cb6281d94f tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] Returning 404 to user: Security group 1e15013b-4391-452a-8322-d94cb2b3da42 does not exist Oct 17 15:31:39.209760 n-d-854441-12 devstack@n-api.service[120406]: Neutron server returns request_ids: ['req-354d218d-c51f-4798-8658-a8382ff1a257'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:39.212152 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2296aa1c-1cd4-4a9f-a2b6-c0cb6281d94f tempest-SecurityGroupsNegativeTestJSON-780550356 tempest-SecurityGroupsNegativeTestJSON-780550356-project] 10.222.0.87 "PUT /compute/v2.1/os-security-groups/1e15013b-4391-452a-8322-d94cb2b3da42" status: 404 len: 194 microversion: 2.1 time: 0.193706 Oct 17 15:31:39.212303 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1357/2511] 10.222.0.87 () {60 vars in 1290 bytes} [Mon Oct 17 15:31:39 2022] PUT /compute/v2.1/os-security-groups/1e15013b-4391-452a-8322-d94cb2b3da42 => generated 194 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:39.230920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:39.233391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:39.250629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:39.251302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:39.251790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:39.255490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:39.259553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:39.260250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:39.283886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:39.298880 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f2c13abb-83e4-45e2-a394-d4e53f36d25e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 200 len: 1451 microversion: 2.1 time: 0.373298 Oct 17 15:31:39.301103 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1155/2512] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:38 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 1451 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:39.633284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b73e2e77-4ab7-4d1c-8d80-86800d2bc587 req-a7b96824-6664-49e1-bb03-bb227046d65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e9df62-80cd-443d-b507-9f6177caec29", "name": "network-vif-deleted", "tag": "b5b55dcd-5d2d-406e-b51b-55cafd9c3cf1"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:39.692596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b73e2e77-4ab7-4d1c-8d80-86800d2bc587 req-a7b96824-6664-49e1-bb03-bb227046d65e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:39.693882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b73e2e77-4ab7-4d1c-8d80-86800d2bc587 req-a7b96824-6664-49e1-bb03-bb227046d65e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:39.695278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b73e2e77-4ab7-4d1c-8d80-86800d2bc587 req-a7b96824-6664-49e1-bb03-bb227046d65e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:39.735110 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b73e2e77-4ab7-4d1c-8d80-86800d2bc587 req-a7b96824-6664-49e1-bb03-bb227046d65e service nova] Creating event network-vif-deleted:b5b55dcd-5d2d-406e-b51b-55cafd9c3cf1 for instance 10e9df62-80cd-443d-b507-9f6177caec29 on n-h2-854441-12 Oct 17 15:31:39.748820 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b73e2e77-4ab7-4d1c-8d80-86800d2bc587 req-a7b96824-6664-49e1-bb03-bb227046d65e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123312 Oct 17 15:31:39.752108 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1156/2513] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:31:39.774266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:39.776175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ae0e4163-6ad8-4c7b-bdc3-248b002e922a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:39.799568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:39.800911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:39.803807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:39.805830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:39.806615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:39.807235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:39.828011 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance ae0e4163-6ad8-4c7b-bdc3-248b002e922a could not be found. Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a HTTP/1.1 Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ae0e4163-6ad8-4c7b-bdc3-248b002e922a could not be found. Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ae0e4163-6ad8-4c7b-bdc3-248b002e922a'} Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae0e4163-6ad8-4c7b-bdc3-248b002e922a could not be found. Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae0e4163-6ad8-4c7b-bdc3-248b002e922a could not be found. Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.832920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.837789 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:39.837789 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:39.837789 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:39.837789 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:39.837789 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae0e4163-6ad8-4c7b-bdc3-248b002e922a could not be found. Oct 17 15:31:39.837789 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.840199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance ae0e4163-6ad8-4c7b-bdc3-248b002e922a could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:39.841653 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bed9db69-5e84-4377-88c8-7862403b2010 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a" status: 404 len: 111 microversion: 2.1 time: 0.086289 Oct 17 15:31:39.843074 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1157/2514] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:39 2022] GET /compute/v2.1/servers/ae0e4163-6ad8-4c7b-bdc3-248b002e922a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:39.853455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:39.856038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:39.867373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:39.868226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:39.868932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:39.870236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:39.871052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:39.871696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:39.892457 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 HTTP/1.1 Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '463dc9de-88df-4179-b399-6379972b35f8'} Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:39.895730 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.899740 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.903251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:39.904745 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-51ad3fb6-ebdd-4e1a-922b-01011f0450cf tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 404 len: 111 microversion: 2.1 time: 0.056983 Oct 17 15:31:39.906333 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1158/2515] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:39 2022] DELETE /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:31:39.917008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:39.919030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 463dc9de-88df-4179-b399-6379972b35f8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:39.937999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:39.939188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:39.939884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:39.941168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:39.941790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:39.942304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:39.950596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:39.967185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 HTTP/1.1 Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '463dc9de-88df-4179-b399-6379972b35f8'} Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.970564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:39.976017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:39.976017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:39.976017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:39.976017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:39.976017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. Oct 17 15:31:39.976017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:39.976017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance 463dc9de-88df-4179-b399-6379972b35f8 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:39.976017 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dbb23357-893d-4209-a3f6-d059b6a6bd47 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8" status: 404 len: 111 microversion: 2.1 time: 0.061785 Oct 17 15:31:39.980481 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1159/2516] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:39 2022] GET /compute/v2.1/servers/463dc9de-88df-4179-b399-6379972b35f8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:39.987044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9946a78-19a7-4acb-a6c7-b22b2c252946 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea48430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:40.074240 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-a9946a78-19a7-4acb-a6c7-b22b2c252946 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Image not found. Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9946a78-19a7-4acb-a6c7-b22b2c252946 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 HTTP/1.1 Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '27c5770b-3817-405f-8de6-cff8f66d76f6'} Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 27c5770b-3817-405f-8de6-cff8f66d76f6 to delete Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 27c5770b-3817-405f-8de6-cff8f66d76f6 could not be found. Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.078133 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:31:40.082128 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.098792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9946a78-19a7-4acb-a6c7-b22b2c252946 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:40.101172 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9946a78-19a7-4acb-a6c7-b22b2c252946 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6" status: 404 len: 62 microversion: 2.1 time: 0.118624 Oct 17 15:31:40.101905 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1160/2517] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:39 2022] DELETE /compute/v2.1/images/27c5770b-3817-405f-8de6-cff8f66d76f6 => generated 62 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:31:40.122409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:40.123694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:40.143491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:40.144870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:40.146038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:40.148149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:40.152597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:40.153718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:40.857345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:40.886123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:40.889674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:40.893078 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78a35b06-5db1-4ffe-ad3a-ac6083b9a238 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 1.678536 Oct 17 15:31:40.907634 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1358/2518] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:39 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:40.937709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:40.939153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:40.950469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:40.951668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:40.952651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:40.953859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:40.954798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:40.955738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:40.984957 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 HTTP/1.1 Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '83c186d0-403a-49cd-94fc-cfa45e6b5170'} Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:40.987573 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f18cd28e-6dd3-4e1b-ad83-3afbe06a3090 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 404 len: 111 microversion: 2.1 time: 0.079672 Oct 17 15:31:40.996295 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1359/2519] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:40 2022] DELETE /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:41.003131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:41.003131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:41.008062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.008332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.008736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.009467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.010063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.010537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.028098 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 HTTP/1.1 Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '10e9df62-80cd-443d-b507-9f6177caec29'} Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.029915 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.038554 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.038554 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.038554 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.038554 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:41.038554 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:41.038554 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:31:41.038554 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.038554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:41.038554 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2ca673f-003d-4b49-89f3-b89f85a1dd70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 404 len: 111 microversion: 2.1 time: 0.036490 Oct 17 15:31:41.051886 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1360/2520] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:40 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:41.067308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:41.068270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 83c186d0-403a-49cd-94fc-cfa45e6b5170] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:41.086857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.087405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.087824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.088913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.091326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.093603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.114280 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 HTTP/1.1 Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '83c186d0-403a-49cd-94fc-cfa45e6b5170'} Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.116564 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.120609 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.120609 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.120609 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:41.120609 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:41.120609 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. Oct 17 15:31:41.120609 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.122718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance 83c186d0-403a-49cd-94fc-cfa45e6b5170 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:41.123922 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-612e5ff5-f109-4080-b5c8-4a497c62d162 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170" status: 404 len: 111 microversion: 2.1 time: 0.067909 Oct 17 15:31:41.124750 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1361/2521] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:41 2022] GET /compute/v2.1/servers/83c186d0-403a-49cd-94fc-cfa45e6b5170 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:41.139080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c3bf075-64d7-4f2e-b535-ee756d504f04 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bedb9310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:41.179290 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2c3bf075-64d7-4f2e-b535-ee756d504f04 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Image not found. Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c3bf075-64d7-4f2e-b535-ee756d504f04 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd HTTP/1.1 Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: exception: Image not found. Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8a301688-f96a-4ec2-a3fc-c68d9719b5fd'} Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8a301688-f96a-4ec2-a3fc-c68d9719b5fd to delete Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a301688-f96a-4ec2-a3fc-c68d9719b5fd could not be found. Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.182263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:31:41.186451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.188243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c3bf075-64d7-4f2e-b535-ee756d504f04 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:41.189649 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c3bf075-64d7-4f2e-b535-ee756d504f04 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd" status: 404 len: 62 microversion: 2.1 time: 0.058418 Oct 17 15:31:41.190762 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1362/2522] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:41 2022] DELETE /compute/v2.1/images/8a301688-f96a-4ec2-a3fc-c68d9719b5fd => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 15:31:41.201451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:41.202524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:41.229622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.230595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.231356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.232690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.233525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.234284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.271288 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 HTTP/1.1 Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'ed0a13ab-993e-497e-8565-47790e0d5721'} Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:41.273674 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.277065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.279342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:41.280515 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09e7686a-ec8c-4286-b81c-ebd7ba245abd tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 404 len: 111 microversion: 2.1 time: 0.083634 Oct 17 15:31:41.281819 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1363/2523] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:41 2022] DELETE /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:31:41.287612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1503632804", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "fbf48d23-b6f0-48de-b73a-9c8aad4ee168"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:41.363277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] validate_networks() for [('fbf48d23-b6f0-48de-b73a-9c8aad4ee168', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:31:41.707450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:41.760008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:41.761522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:41.762821 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aac606f8-35ed-44f2-9158-f1c28b226568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.648590 Oct 17 15:31:41.780955 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1161/2524] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:40 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:41.780955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:41.780955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: ed0a13ab-993e-497e-8565-47790e0d5721] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:41.780955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:41.780955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.787782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.788718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.789641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.790127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.790606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.813544 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 HTTP/1.1 Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ed0a13ab-993e-497e-8565-47790e0d5721'} Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.815224 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.819043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.819043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.819043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:41.819043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:41.819043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. Oct 17 15:31:41.819043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.819043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance ed0a13ab-993e-497e-8565-47790e0d5721 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:41.819043 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a645933f-b9c9-4ba8-87de-db569ccc5cb5 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721" status: 404 len: 111 microversion: 2.1 time: 0.051903 Oct 17 15:31:41.836174 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1162/2525] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:41 2022] GET /compute/v2.1/servers/ed0a13ab-993e-497e-8565-47790e0d5721 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:41.841268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6285164f-3f79-43de-89f5-6d6b800a680f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bea56af0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:41.876277 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-6285164f-3f79-43de-89f5-6d6b800a680f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Image not found. Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6285164f-3f79-43de-89f5-6d6b800a680f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 HTTP/1.1 Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '711991ba-0e3c-45c6-ba89-87a668bc5fa3'} Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 711991ba-0e3c-45c6-ba89-87a668bc5fa3 to delete Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 711991ba-0e3c-45c6-ba89-87a668bc5fa3 could not be found. Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.878733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6285164f-3f79-43de-89f5-6d6b800a680f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6285164f-3f79-43de-89f5-6d6b800a680f tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3" status: 404 len: 62 microversion: 2.1 time: 0.043759 Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1163/2526] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:41 2022] DELETE /compute/v2.1/images/711991ba-0e3c-45c6-ba89-87a668bc5fa3 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:41.893706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:41.902665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.902665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.903127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.904146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.904146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.904644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.925357 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 HTTP/1.1 Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'e39bc6c0-63e8-43f1-8b4a-15706f69c7d3'} Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:41.927410 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d4f7a70c-1ba6-448e-a05a-543c649fa2e6 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 404 len: 111 microversion: 2.1 time: 0.042506 Oct 17 15:31:41.940233 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1164/2527] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:41 2022] DELETE /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:41.941939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:41.941939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: e39bc6c0-63e8-43f1-8b4a-15706f69c7d3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:41.956803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.956922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.957377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.963261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:41.963888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:41.964352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:41.989831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 HTTP/1.1 Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'e39bc6c0-63e8-43f1-8b4a-15706f69c7d3'} Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.991392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:41.994946 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:41.994946 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:41.994946 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:41.994946 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:41.994946 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. Oct 17 15:31:41.994946 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:41.994946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:41.994946 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24d8c41a-f502-40c7-85e9-2d06ada76f88 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3" status: 404 len: 111 microversion: 2.1 time: 0.058273 Oct 17 15:31:41.997357 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1165/2528] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:41 2022] GET /compute/v2.1/servers/e39bc6c0-63e8-43f1-8b4a-15706f69c7d3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:42.003244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:42.004254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:42.012249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.012997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.013656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:42.015035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.020162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.021057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:42.534611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:42.582314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:42.610128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:31:42.611154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:31:42.612276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:31:42.613619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:31:42.619969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:31:42.623154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:42.642943 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-25c5f857-b5a7-45af-bd0c-89ac0cc59fb1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.642361 Oct 17 15:31:42.644423 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1166/2529] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:41 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:42.665782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84539cf4-88f2-4c86-825e-94367717dd1c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '.version_select at 0x7f28bf4d6dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:42.684785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.690166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.690166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:42.691079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.691575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.692030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:42.715317 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-84539cf4-88f2-4c86-825e-94367717dd1c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Image not found. Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84539cf4-88f2-4c86-825e-94367717dd1c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 HTTP/1.1 Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: exception: Image not found. Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '3da1e0ad-58b8-4ef4-b739-ab17c0130168'} Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3da1e0ad-58b8-4ef4-b739-ab17c0130168 to delete Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3da1e0ad-58b8-4ef4-b739-ab17c0130168 could not be found. Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.720721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:31:42.724785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.727185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84539cf4-88f2-4c86-825e-94367717dd1c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Image not found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:42.732976 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-84539cf4-88f2-4c86-825e-94367717dd1c tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168" status: 404 len: 62 microversion: 2.1 time: 0.076568 Oct 17 15:31:42.734213 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1167/2530] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:42 2022] DELETE /compute/v2.1/images/3da1e0ad-58b8-4ef4-b739-ab17c0130168 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:31:42.743484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:42.745593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:42.761595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:31:42.771295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.771844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.772300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:42.777486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.778102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.778782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:42.784775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for user 745a483a369e4e83849cee037f5b67ab and project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:31:42.822168 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:42.825779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 HTTP/1.1 Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7ef56e60-7257-4eb3-82e1-bef0667ed073'} Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:42.827453 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:31:42.837903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:42.839017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:31:42.839172 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ac4424f-964b-46ea-b5a0-855770442504 tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 404 len: 111 microversion: 2.1 time: 0.095890 Oct 17 15:31:42.839172 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1168/2531] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:31:42 2022] DELETE /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:42.844725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:42.845413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:42.859334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.859931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.860468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:42.861286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.861862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.862318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:42.962443 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17ee9be5-3e65-4227-b35b-17b5f6b9f74a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679045 Oct 17 15:31:42.975076 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1364/2532] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:31:42.981423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:42.982060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] [instance: 7ef56e60-7257-4eb3-82e1-bef0667ed073] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:42.989733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.990256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.990736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:42.991741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:42.992532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:42.993344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:43.011654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:43.013978 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] HTTP exception thrown: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Request method failure captured: Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 HTTP/1.1 Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXQHwiO-Mb3D6jRRdXY_LiAAy5Nh0n9__ExINjd2xUBdikl1wKRq_L2qlFMzeYdBu0rEB-b-PYG-YYS7FDgrNPR_DbQbvnssUuCrhkjTPsFjjoakzfvEwEl4kM0rvyyR_KfrYDpjr15lcfmULHZTVN4tZkr2h8X-ndaS3aYZWOfE5jU Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1ecc5c53621946e0bd84b2a94584f5bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 1ecc5c53621946e0bd84b2a94584f5bb Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesTestJSON-2061362672 Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 59a1c6dac66a43d9b5e91b78215359ce Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesTestJSON-2061362672-project Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '7ef56e60-7257-4eb3-82e1-bef0667ed073'} Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:43.016684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:31:43.020411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:31:43.020411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:31:43.020411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:31:43.020411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:31:43.020411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. Oct 17 15:31:43.020411 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:31:43.022789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] Returning 404 to user: Instance 7ef56e60-7257-4eb3-82e1-bef0667ed073 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:31:43.024345 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97e62bd1-96d6-4f46-899f-abf4f13f759a tempest-ImagesTestJSON-2061362672 tempest-ImagesTestJSON-2061362672-project] 10.222.0.87 "GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073" status: 404 len: 111 microversion: 2.1 time: 0.047806 Oct 17 15:31:43.025796 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1365/2533] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:42 2022] GET /compute/v2.1/servers/7ef56e60-7257-4eb3-82e1-bef0667ed073 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:31:43.049110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2638e7bb-f583-4cd6-aede-bff45d2fae12 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:43.051613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2638e7bb-f583-4cd6-aede-bff45d2fae12 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:43.509266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2638e7bb-f583-4cd6-aede-bff45d2fae12 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:43.518814 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2638e7bb-f583-4cd6-aede-bff45d2fae12 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1215 microversion: 2.1 time: 0.491298 Oct 17 15:31:43.519509 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1366/2534] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:43 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1215 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:43.677225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:43.678482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:43.689240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:43.693661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:43.694486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:43.697364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:43.698191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:43.702172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:43.705170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:43.723805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:43.725504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:43.726915 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b66fabe-6df9-4483-bc2c-32ae02c5da4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.889388 Oct 17 15:31:43.746551 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1169/2535] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:42 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:44.545748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:44.547391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:44.564586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:44.565778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:44.566534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:44.569229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:44.570620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:44.571287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:44.874613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:44.959017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:44.968814 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a3c5b97e-42f8-4ff8-a856-91b9d0672bd3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1267 microversion: 2.1 time: 0.428957 Oct 17 15:31:44.980246 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1170/2536] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:44 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1267 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:31:44.985677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:44.986642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:45.002952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:45.003165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:45.004236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:45.004941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:45.005905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:45.006628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:45.007240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:45.007446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:45.018233 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6638fbf0-19ce-4987-95ab-a8760d66ad3d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 1.345377 Oct 17 15:31:45.034971 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1367/2537] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:43 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:31:45.800245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:45.822749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:45.825012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:45.826640 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4438edd-2249-4d13-8d87-8f9f8d1e4518 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.844989 Oct 17 15:31:45.827855 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1171/2538] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:44 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:46.009542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:46.011254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:46.031314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:46.032064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:46.036573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:46.038085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:46.038851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:46.042340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:46.050220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:46.051601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:46.060292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:46.060800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:46.061249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:46.061966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:46.062435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:46.062949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:46.327416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:46.347451 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e54673e-5312-4f8d-80d2-54abc33c53cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1273 microversion: 2.1 time: 0.341687 Oct 17 15:31:46.350336 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1368/2539] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:46 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:46.794948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:46.852035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:46.861026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:46.861680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:46.874971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:46.877490 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7ab95809-0c94-44ca-970c-f532eafeea92 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.831153 Oct 17 15:31:46.883836 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1172/2540] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:46 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:31:46.888751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:46.889263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:46.889713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:46.890519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:46.895195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:46.895684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:47.377954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:47.379189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:47.394884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:47.396262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:47.396743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:47.398276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:47.398591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:47.398988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:47.580699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:47.608255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a7bf34f7-909d-4a8f-bdab-7bb09da10e8b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1273 microversion: 2.1 time: 0.234645 Oct 17 15:31:47.615609 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1173/2541] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:47 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:47.887781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:47.914816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:47.920301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:47.922590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:47.923218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:47.932232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6fd9e62-15d3-40d2-875c-497d663bd271 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.068110 Oct 17 15:31:47.935468 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1369/2542] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:46 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:31:47.989671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:47.990690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:47.992772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:47.995539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:47.999562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:48.000837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:48.667243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:48.669810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:48.705449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:48.706989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:48.708065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:48.709741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:48.710879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:48.712182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:48.934444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:48.953411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:48.971667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:48.973002 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-48636821-593d-4231-b0b8-b18f8f4caf96 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 1.056184 Oct 17 15:31:48.973604 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1174/2543] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:47 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:49.024478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:49.028998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:49.056023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:49.065894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:49.066381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:49.067929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:49.068528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:49.068982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:49.555496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:49.566034 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57458a01-0866-4518-a402-3b9ed4116941 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 0.909001 Oct 17 15:31:49.583946 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1370/2544] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:48 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:49.745864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e25054ba-1445-42a6-9373-032d76079a91 req-041ed28b-35ca-41db-869e-244163e28669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7223bf-635f-444f-98a9-f4764b4cd42c", "name": "network-vif-unplugged", "status": "completed", "tag": "b7b29889-5c2f-436a-b1af-d8cf33437c18"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:49.794245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e25054ba-1445-42a6-9373-032d76079a91 req-041ed28b-35ca-41db-869e-244163e28669 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:49.809825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e25054ba-1445-42a6-9373-032d76079a91 req-041ed28b-35ca-41db-869e-244163e28669 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:49.810612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e25054ba-1445-42a6-9373-032d76079a91 req-041ed28b-35ca-41db-869e-244163e28669 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:49.867806 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e25054ba-1445-42a6-9373-032d76079a91 req-041ed28b-35ca-41db-869e-244163e28669 service nova] Creating event network-vif-unplugged:b7b29889-5c2f-436a-b1af-d8cf33437c18 for instance 8b7223bf-635f-444f-98a9-f4764b4cd42c on n-h1-854441-12 Oct 17 15:31:49.881761 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e25054ba-1445-42a6-9373-032d76079a91 req-041ed28b-35ca-41db-869e-244163e28669 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141795 Oct 17 15:31:49.884039 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1371/2545] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:31:50.007679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:50.009013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:50.022354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:50.038616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:50.039781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:50.040932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:50.041656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:50.042334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:50.826427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:50.857961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:50.862695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:50.872488 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebf29701-e7ac-433a-8415-12457ecb0346 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.870306 Oct 17 15:31:50.899052 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1372/2546] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:50 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:50.915452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:50.916827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:50.944808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:50.945503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:50.946114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:50.948016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:50.948571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:50.949457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:51.419093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:51.440477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:51.448366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:51.450323 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c3eb9210-e67f-4a1e-bbc3-c16acac160de tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 2.443353 Oct 17 15:31:51.453857 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1175/2547] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:49 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 2448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:51.827814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:51.856673 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b08d8b5d-2e9c-41b7-9521-13948ba0db00 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 0.952291 Oct 17 15:31:51.866450 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1373/2548] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:50 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:51.907200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:51.908574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:51.922938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:51.929300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:51.939503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-59b96873-b42d-44ff-b27c-c80e5f64f3f9 req-14dd8ad7-f608-42ae-a8ac-9a68650205cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7223bf-635f-444f-98a9-f4764b4cd42c", "tag": "b7b29889-5c2f-436a-b1af-d8cf33437c18"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:31:51.946051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:51.949475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:51.951081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:51.955351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:51.964908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59b96873-b42d-44ff-b27c-c80e5f64f3f9 req-14dd8ad7-f608-42ae-a8ac-9a68650205cb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:51.972807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59b96873-b42d-44ff-b27c-c80e5f64f3f9 req-14dd8ad7-f608-42ae-a8ac-9a68650205cb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:51.973544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59b96873-b42d-44ff-b27c-c80e5f64f3f9 req-14dd8ad7-f608-42ae-a8ac-9a68650205cb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:52.021854 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-59b96873-b42d-44ff-b27c-c80e5f64f3f9 req-14dd8ad7-f608-42ae-a8ac-9a68650205cb service nova] Creating event network-changed:b7b29889-5c2f-436a-b1af-d8cf33437c18 for instance 8b7223bf-635f-444f-98a9-f4764b4cd42c on n-h1-854441-12 Oct 17 15:31:52.043635 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-59b96873-b42d-44ff-b27c-c80e5f64f3f9 req-14dd8ad7-f608-42ae-a8ac-9a68650205cb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107528 Oct 17 15:31:52.063262 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1374/2549] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:31:52.484164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:52.485108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:52.499103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:52.499776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:52.500351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:52.504378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:52.507623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:52.508276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:52.713816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:53.012547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:53.028159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:53.033787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:53.035944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-26808707-fb84-435e-bf81-9e48e9a336eb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 1.132883 Oct 17 15:31:53.052419 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1176/2550] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:51 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:31:53.069995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:53.071570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:53.083079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:53.084050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:53.084948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:53.088294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:53.090253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:53.091329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:53.513608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:53.816360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:53.887192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:53.892904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:53.894209 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7dd89fa1-266c-42e1-a8b9-74666636a9e6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.414692 Oct 17 15:31:53.895255 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1375/2551] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:52 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:54.075658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:54.075658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:54.075658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:31:54.115317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:54.119238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:54.120468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:54.122067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:54.124800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:54.127012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:54.412006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:54.451051 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-db15aa3c-dcf7-41e8-9e21-6aaef19abc1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 1.396877 Oct 17 15:31:54.452357 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1177/2552] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:53 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:54.921809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:54.922424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:54.944310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:54.945244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:54.945928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:54.947977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:54.951305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:54.952059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:55.418847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:55.463149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:55.470337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:55.486055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7c8530a-3b87-4c4f-aaed-f5136e4077a3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 1.411679 Oct 17 15:31:55.489275 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1376/2553] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:54 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:55.525739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:55.533795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:55.565017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:55.575703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:55.576225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:55.577036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:55.577489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:55.603217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:55.982488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:56.011356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:56.024854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:56.031393 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92a209f3-7e67-4938-93f3-ca7cba44eb02 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.113694 Oct 17 15:31:56.037459 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1178/2554] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:54 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:31:56.524598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:56.525855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:56.572883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:56.575911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:56.576702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:56.591591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:56.593787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:56.599885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:58.200128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:31:58.221618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33c2f472-cefd-4684-bae9-14749dbd18c4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 2.730041 Oct 17 15:31:58.244921 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1377/2555] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:31:55 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 2755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:31:58.298087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:31:58.299761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:31:58.329633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:58.350205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:58.352305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:31:58.354475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:31:58.355836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:31:58.356954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:00.049301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:00.119919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:00.139328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:00.146555 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-22848540-237f-40ee-950a-c1f1fe0270f4 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.884458 Oct 17 15:32:00.150860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1378/2556] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:58 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:00.171473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d7a2a35e-cb34-4797-8ded-257a2ee4002d req-2d97c592-6d9c-4758-a112-66047060abb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf163cb1-81b4-4969-a6d2-5caa98ae4525", "tag": "c958c84d-2595-4536-aeb2-e83c146fdb74"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:00.214147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d7a2a35e-cb34-4797-8ded-257a2ee4002d req-2d97c592-6d9c-4758-a112-66047060abb4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:00.215104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d7a2a35e-cb34-4797-8ded-257a2ee4002d req-2d97c592-6d9c-4758-a112-66047060abb4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:00.215750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d7a2a35e-cb34-4797-8ded-257a2ee4002d req-2d97c592-6d9c-4758-a112-66047060abb4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:00.264386 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d7a2a35e-cb34-4797-8ded-257a2ee4002d req-2d97c592-6d9c-4758-a112-66047060abb4 service nova] Creating event network-changed:c958c84d-2595-4536-aeb2-e83c146fdb74 for instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 on n-h2-854441-12 Oct 17 15:32:00.288049 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d7a2a35e-cb34-4797-8ded-257a2ee4002d req-2d97c592-6d9c-4758-a112-66047060abb4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134149 Oct 17 15:32:00.295141 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1379/2557] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:00.311884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:00.314445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:00.331928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:00.332901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:00.336769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:00.337823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:00.341499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:00.341668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:00.534179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:00.548538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:00.556099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:00.560499 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c8c8a6df-9c2c-401b-ae35-6af8b0e1b32e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 4.044544 Oct 17 15:32:00.592159 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1179/2558] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:31:56 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 4077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:00.709829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:00.724029 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d1470dc-5bc8-424c-a186-9fae7cb6f816 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 0.426916 Oct 17 15:32:00.736117 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1380/2559] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:00 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:01.183457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:01.184201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:01.197927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:01.198444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:01.198930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:01.199662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:01.204259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:01.204726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:01.601387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:01.602144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:01.620901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:01.623247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:01.625031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:01.629903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:01.630880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:01.631402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:02.057453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:02.079109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:02.085157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:02.090476 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36c713d4-1a25-4f50-be33-677f4edec5b1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.912694 Oct 17 15:32:02.092552 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1180/2560] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:01 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:32:02.104976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:02.107968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:02.125294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:02.128361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:02.131469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:02.132695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:02.135820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:02.136655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:02.501793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:02.518330 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5dfe8d26-67f4-4df5-97d7-0fff8c5c57dd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 0.423309 Oct 17 15:32:02.521173 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1181/2561] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:02 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:02.634211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:02.645214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:02.656674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:02.657853 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2d7a5d8-ea1a-461e-bd91-ae16d0b91d66 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 1.061603 Oct 17 15:32:02.658572 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1381/2562] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:01 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:03.128868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:03.134891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:03.167278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:03.168098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:03.168710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:03.169903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:03.172337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:03.175440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:03.206263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:03.547296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:03.548206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:03.560711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:03.561592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:03.568126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:03.569299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:03.569992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:03.570751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:05.452239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:05.466433 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a567057-ad4b-49d3-9234-0d006e026da6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 1.924365 Oct 17 15:32:05.467860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1382/2563] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:03 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:05.481760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:05.483969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:05.509567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:05.510893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:05.512512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:05.515236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:05.518920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:05.521981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:05.783245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:05.866198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:05.884145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:05.931489 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab9d5950-ad75-47fe-a0ee-69a78d5add49 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 2.772320 Oct 17 15:32:05.946439 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1182/2564] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:03 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 2823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:06.680653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:06.687805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-101435518", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "677ddb03-4140-483e-9f15-c06f7e585739"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:06.702868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:06.713120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:06.722005 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0fae0d22-3094-442b-b23a-863c815142fc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 1.248909 Oct 17 15:32:06.740434 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1383/2565] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:05 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:06.766617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:06.770671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:06.796952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:06.798875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:06.802080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:06.805006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:06.805864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:06.809813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:07.298310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:07.308686 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6619c472-f099-4d50-9d7a-b393070f9d1f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 0.565767 Oct 17 15:32:07.326725 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1384/2566] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:06 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:07.347381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:07.351270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:07.383100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:07.384304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:07.386445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:07.388016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:07.392220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:07.393145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:07.452081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:07.888204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] validate_networks() for [('677ddb03-4140-483e-9f15-c06f7e585739', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:32:08.157932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:08.179930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:08.182985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:08.188036 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec0dfc5b-53ef-4cbf-9478-aded6adce7dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.857030 Oct 17 15:32:08.189556 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1385/2567] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:07 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:08.199165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:08.203528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:08.223715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:08.224754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:08.226123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:08.232094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:08.233389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:08.234235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:09.015274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:09.046493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:09.048905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:09.050865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce979496-2312-43ad-ad6d-b5d951c9328d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.859785 Oct 17 15:32:09.051979 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1386/2568] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:08 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:09.057405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:09.059880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:09.069167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:09.070104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:09.070881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:09.071855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:09.072541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:09.073329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:09.558976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:09.574135 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a1767f5-42cf-41e7-a60b-99efb6cd8a7e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 0.520754 Oct 17 15:32:09.575176 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1387/2569] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:09 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:09.587977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:09.593644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:09.607195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:09.608112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:09.608773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:09.611926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:09.616337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:09.617998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:09.895410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:32:09.896162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:32:09.897361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:32:09.898410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:32:09.899474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:32:09.944436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:09.945408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:09.946188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:09.952431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:09.958718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:09.959903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:10.059772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Getting quotas for project 4277beda3bda44709a6698b08b9ee2ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:10.093692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Getting quotas for user 4fda708e5e714da08080451102f2a9b8 and project 4277beda3bda44709a6698b08b9ee2ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:10.158186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:32:10.171495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:32:10.405323 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc9e72b1-5164-4222-97b4-0722b7fb219f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.436584 Oct 17 15:32:10.407001 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1183/2570] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:32:10.425312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:10.432196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:10.462053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:10.486540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:10.488509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:10.489478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:10.493318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:10.494079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:10.871629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:10.876420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:10.887427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:10.893803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:10.895680 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6798af4d-0822-40cf-94b5-1ab224f1be26 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1812 microversion: 2.25 time: 0.486884 Oct 17 15:32:10.899353 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1184/2571] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:10 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1812 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:10.901345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:10.915974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-349eba4d-72ec-48c2-8ea9-985cbd740148 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:10.915974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-349eba4d-72ec-48c2-8ea9-985cbd740148 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:10.921483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:10.927597 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d67a3754-2b97-43d3-b26b-cc120d18ee16 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.347933 Oct 17 15:32:10.929081 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1388/2572] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:09 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:11.120754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-349eba4d-72ec-48c2-8ea9-985cbd740148 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:11.132834 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-349eba4d-72ec-48c2-8ea9-985cbd740148 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1216 microversion: 2.1 time: 0.229657 Oct 17 15:32:11.137794 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1185/2573] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:10 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:11.158418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:11.161617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:11.186150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:11.191855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:11.193010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:11.203511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:11.205118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:11.208694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:11.689911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:11.728998 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0ea822ae-b73f-4d4e-860a-2b753bcf9ff6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 0.583293 Oct 17 15:32:11.730431 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1186/2574] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:11 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:11.928847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-601579944", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:11.954627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:11.966493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:11.991220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:12.023127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:12.025173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:12.027093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:12.031505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:12.032660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:12.037774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:12.136678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:32:12.484493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:12.498463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:12.500935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:12.502922 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-665452f0-a109-447a-8678-bc50d856e164 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1802 microversion: 2.25 time: 0.559709 Oct 17 15:32:12.525208 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1187/2575] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:11 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1802 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:32:12.553841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:12.555809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:12.585654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:12.602686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:12.603374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:12.611191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:12.611699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:12.612161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:12.645530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:32:12.645954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:32:12.646439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:32:12.646875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:32:12.647424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:32:12.676019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:12.676511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:12.688532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:12.691495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:12.693673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:12.698361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:12.735936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Getting quotas for project 8c2f4600658d49738f4e00f44b2cd1d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:12.743664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Getting quotas for user a371ebfdf0034f3f890044609df5da40 and project 8c2f4600658d49738f4e00f44b2cd1d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:12.760953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:32:12.763521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:32:12.856062 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3184ab6-8545-4a42-88fd-a9c2e98ef3ec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.924769 Oct 17 15:32:12.863274 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1389/2576] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:32:12.882825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:12.884006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:12.907381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:12.909050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:12.913413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:12.914572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:12.919268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:12.922986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:13.152496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:13.168569 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58d2b642-0669-4527-8f32-8e00061a6f15 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1212 microversion: 2.1 time: 0.303741 Oct 17 15:32:13.187283 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1390/2577] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:12 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1212 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:13.317749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:13.346277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:13.354789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:13.362351 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-afafa4b4-9661-4460-b9cd-d7680a8336bf tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.833874 Oct 17 15:32:13.366030 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1188/2578] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:12 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:13.391276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1da751f7-316c-4c03-9fc2-31fff1efe849 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '.version_select at 0x7f28beca1700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:13.410778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1da751f7-316c-4c03-9fc2-31fff1efe849 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:13.411870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1da751f7-316c-4c03-9fc2-31fff1efe849 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:13.414999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1da751f7-316c-4c03-9fc2-31fff1efe849 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:13.452806 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1da751f7-316c-4c03-9fc2-31fff1efe849 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 1289 microversion: 2.25 time: 0.084080 Oct 17 15:32:13.459758 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1189/2579] 10.222.0.87 () {60 vars in 1184 bytes} [Mon Oct 17 15:32:13 2022] GET /compute/v2.1/os-migrations => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:13.481333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:13.489553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:13.516873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:13.517805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:13.519528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:13.520565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:13.525057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:13.525740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:13.682944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1583172859", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:13.841034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:32:13.949254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:13.977250 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36a200ac-2ec8-47cd-b649-50657c057dc9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 0.514674 Oct 17 15:32:13.996762 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1190/2580] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:13 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:13.996762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:13.996762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:14.034683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:14.037728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:14.040092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:14.044078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:14.044598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:14.045409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:14.561852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:14.594119 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-08b05813-43f1-463e-9486-ef405df62199 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1220 microversion: 2.1 time: 0.609224 Oct 17 15:32:14.594705 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1191/2581] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:13 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1220 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:14.599487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:14.600105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:14.636257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:14.636828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:14.637356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:14.638223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:14.638761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:14.639203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:14.980261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 8b7223bf-635f-444f-98a9-f4764b4cd42c {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:32:15.011034 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-366ebae4-8f18-4866-95de-ca71b400d0a8 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 2422 microversion: 2.25 time: 0.414974 Oct 17 15:32:15.017644 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1192/2582] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:14 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 2422 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:15.032450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:15.033480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:15.051138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:15.052029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:15.052759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:15.053752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:15.054466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:15.055212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:15.091249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:32:15.091841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:32:15.092835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:32:15.093832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:32:15.094664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:32:15.141146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:15.144684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:15.148817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:15.150263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:15.154907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:15.156097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:15.165861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:15.180185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-602d05f1-f95c-4fe9-b33b-d9b2bfb2d70e tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1274 microversion: 2.1 time: 0.152004 Oct 17 15:32:15.181052 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1193/2583] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:15 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:15.186275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:15.188466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:15.223474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:15.224054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:15.224507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:15.231768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:15.231768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:15.232066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:15.242973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Getting quotas for project 98e9a6e643c54bc7bd4a28c9e5937a30. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:15.269684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Getting quotas for user ba709d7db06a4acd9436d532c4b6aa18 and project 98e9a6e643c54bc7bd4a28c9e5937a30. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:15.335374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:32:15.339277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:32:15.471312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9555900-543e-4950-9fd9-415e9b1bdec8 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.281286 Oct 17 15:32:15.472414 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1391/2584] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:32:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:32:15.484771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:15.488706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:15.497354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:15.499174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:15.500209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:15.501530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:15.502291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:15.503199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:16.052383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:16.068657 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-035d2bc9-8b02-4494-9092-565f0a7edc70 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 0.587921 Oct 17 15:32:16.073505 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1392/2585] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:15 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:16.083554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:16.088656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:16.101576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:16.107434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:16.108531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:16.109534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:16.110264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:16.111051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:16.573017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:16.596939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:16.616292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:16.621566 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99be571f-1d93-4d82-8c0d-ebcf2a809ded tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.438112 Oct 17 15:32:16.623570 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1194/2586] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:15 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:16.636434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:16.639203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:16.647869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:16.648795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:16.649555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:16.651083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:16.661839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:16.663325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:16.821264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid 8b7223bf-635f-444f-98a9-f4764b4cd42c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:32:16.892638 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a298238a-1b0c-448d-b0e9-7c054226c982 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 2422 microversion: 2.25 time: 0.817499 Oct 17 15:32:16.893279 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1393/2587] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:16 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 2422 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:16.922606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:16.923252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:16.955198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:16.955726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:16.956177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:16.956904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:16.957362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:16.957790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:16.997433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:17.010162 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f42fef9a-fad0-427f-b459-f5c1531e77d5 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1223 microversion: 2.1 time: 0.384298 Oct 17 15:32:17.011729 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1195/2588] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:16 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1223 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:17.016861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:17.035168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:17.069269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:17.070101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:17.085719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:17.087062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:17.091994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:17.092756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:17.274856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:17.307655 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43351f34-36cc-4be6-a5be-13b1878cae7a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1274 microversion: 2.1 time: 0.403792 Oct 17 15:32:17.350116 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1394/2589] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:16 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1274 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:17.371935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-441f6d9f-aa8f-4914-87f8-8bb39c29ca54 req-ba4b877a-5da9-4f43-9fd2-2ca6e3253bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf163cb1-81b4-4969-a6d2-5caa98ae4525", "name": "network-vif-plugged", "status": "completed", "tag": "c958c84d-2595-4536-aeb2-e83c146fdb74"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:17.409914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-441f6d9f-aa8f-4914-87f8-8bb39c29ca54 req-ba4b877a-5da9-4f43-9fd2-2ca6e3253bfb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:17.415466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-441f6d9f-aa8f-4914-87f8-8bb39c29ca54 req-ba4b877a-5da9-4f43-9fd2-2ca6e3253bfb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:17.416460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-441f6d9f-aa8f-4914-87f8-8bb39c29ca54 req-ba4b877a-5da9-4f43-9fd2-2ca6e3253bfb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:17.476068 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-441f6d9f-aa8f-4914-87f8-8bb39c29ca54 req-ba4b877a-5da9-4f43-9fd2-2ca6e3253bfb service nova] Creating event network-vif-plugged:c958c84d-2595-4536-aeb2-e83c146fdb74 for instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 on n-h2-854441-12 Oct 17 15:32:17.519153 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-441f6d9f-aa8f-4914-87f8-8bb39c29ca54 req-ba4b877a-5da9-4f43-9fd2-2ca6e3253bfb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147856 Oct 17 15:32:17.524296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1395/2590] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:17.571133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:17.572103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:17.639952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:17.640787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:17.641530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:17.656082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:17.657075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:17.660675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:18.163626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lazy-loading 'services' on Instance uuid 8b7223bf-635f-444f-98a9-f4764b4cd42c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:32:18.192968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:18.246193 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0afaeffd-2d3c-471b-816b-5fdeb6ab429c tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1316 microversion: 2.1 time: 1.232113 Oct 17 15:32:18.251645 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1196/2591] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:17 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1316 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:18.263465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:18.271868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:18.311846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:18.312994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:18.320509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:18.322715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:18.329299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:18.332589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:18.535245 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53578de5-c3ab-4d38-9d87-c87a0a09299f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments/0a981553-3a51-49e3-b3f8-b9a6af4420f7" status: 202 len: 0 microversion: 2.25 time: 0.993419 Oct 17 15:32:18.536081 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1396/2592] 10.222.0.87 () {60 vars in 1457 bytes} [Mon Oct 17 15:32:17 2022] DELETE /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments/0a981553-3a51-49e3-b3f8-b9a6af4420f7 => generated 0 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:32:18.546948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:18.560956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:18.612436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:18.612976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:18.613432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:18.614188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:18.614708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:18.625689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:19.650640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:19.866644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:19.891414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:19.893991 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea05595c-db9e-44e6-938f-c625ef3029c6 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.356219 Oct 17 15:32:19.907123 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1397/2593] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:18 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:19.935621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:19.941538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:20.004896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:20.013838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:20.021328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:20.025133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:20.035475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:20.044396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:20.048770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:20.375242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:20.422821 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-829a0b2d-87b7-49c7-91e3-a711e3715f16 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1277 microversion: 2.1 time: 0.513214 Oct 17 15:32:20.430824 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1398/2594] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:19 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1277 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:20.476169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:20.480563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:20.560236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:20.563742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:20.571539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:20.581304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:20.595460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:20.598638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:20.778890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:20.798131 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c6075e53-82c6-493a-bfdc-6f6cd0d7c450 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1315 microversion: 2.1 time: 2.544487 Oct 17 15:32:20.810079 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1197/2595] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:18 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1315 bytes in 2557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:20.831581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab6fde48-d06f-4c59-b901-7e480e798e85 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:20.842080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab6fde48-d06f-4c59-b901-7e480e798e85 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:20.862326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab6fde48-d06f-4c59-b901-7e480e798e85 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:20.865149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab6fde48-d06f-4c59-b901-7e480e798e85 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:20.867809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab6fde48-d06f-4c59-b901-7e480e798e85 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:20.871133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab6fde48-d06f-4c59-b901-7e480e798e85 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:20.871973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab6fde48-d06f-4c59-b901-7e480e798e85 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:20.875922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab6fde48-d06f-4c59-b901-7e480e798e85 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:20.981384 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab6fde48-d06f-4c59-b901-7e480e798e85 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.169099 Oct 17 15:32:20.985085 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1198/2596] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:32:20 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:32:20.999367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:21.000543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:21.007891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:21.024695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:21.028366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:21.029167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:21.030138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:21.030664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:21.031108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:21.049982 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8b1aa91-922b-420a-9d83-6beb7b96847b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1274 microversion: 2.1 time: 0.612912 Oct 17 15:32:21.052028 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1399/2597] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:20 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1274 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:21.070905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e99de3c1-1ffc-4aad-becb-dc5f2aa50bfa req-b67d025c-e53e-4e06-9375-7e1f83a8fde9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-plugged", "status": "completed", "tag": "28f4ade6-9249-408e-bddf-227f23b2d6f1"}, {"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-plugged", "status": "completed", "tag": "15d6381f-175a-4753-8720-a7363204b9d6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:21.114585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e99de3c1-1ffc-4aad-becb-dc5f2aa50bfa req-b67d025c-e53e-4e06-9375-7e1f83a8fde9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:21.120372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e99de3c1-1ffc-4aad-becb-dc5f2aa50bfa req-b67d025c-e53e-4e06-9375-7e1f83a8fde9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:21.124234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e99de3c1-1ffc-4aad-becb-dc5f2aa50bfa req-b67d025c-e53e-4e06-9375-7e1f83a8fde9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:21.125763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:21.175793 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e99de3c1-1ffc-4aad-becb-dc5f2aa50bfa req-b67d025c-e53e-4e06-9375-7e1f83a8fde9 service nova] Creating event network-vif-plugged:28f4ade6-9249-408e-bddf-227f23b2d6f1 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:32:21.181135 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e99de3c1-1ffc-4aad-becb-dc5f2aa50bfa req-b67d025c-e53e-4e06-9375-7e1f83a8fde9 service nova] Creating event network-vif-plugged:15d6381f-175a-4753-8720-a7363204b9d6 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:32:21.210427 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e99de3c1-1ffc-4aad-becb-dc5f2aa50bfa req-b67d025c-e53e-4e06-9375-7e1f83a8fde9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.146585 Oct 17 15:32:21.212403 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1400/2598] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:21.222826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:21.224794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:21.237470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:21.239133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:21.240522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:21.242242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:21.243479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:21.244554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:21.843346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:21.874279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:21.881996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:21.887109 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c473a000-f8aa-48e0-91c9-522fdbaf8b27 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.672413 Oct 17 15:32:21.893096 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1401/2599] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:21 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:21.906801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:21.909933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:21.943501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:21.945133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:21.946966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:21.952327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:21.952845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:21.953298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:22.159894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:22.174994 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-717c722a-edf1-4413-84b8-614015dfa345 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1277 microversion: 2.1 time: 0.277543 Oct 17 15:32:22.175705 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1402/2600] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:21 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:22.199231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:22.199725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:22.251717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:22.253007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:22.258806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:22.269887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:22.285058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:22.286103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:22.825737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:22.837642 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d803c3fd-af42-4ca5-99c2-6ac7e893433b tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1316 microversion: 2.1 time: 1.851052 Oct 17 15:32:22.838976 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1199/2601] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:20 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1316 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:22.844854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e667e832-2aed-4904-be2a-d98df14964e9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:22.849773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e667e832-2aed-4904-be2a-d98df14964e9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:22.858710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e667e832-2aed-4904-be2a-d98df14964e9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:22.859604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e667e832-2aed-4904-be2a-d98df14964e9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:22.860477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e667e832-2aed-4904-be2a-d98df14964e9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:22.861479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e667e832-2aed-4904-be2a-d98df14964e9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:22.862185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e667e832-2aed-4904-be2a-d98df14964e9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:22.863445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e667e832-2aed-4904-be2a-d98df14964e9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:22.937993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:22.965113 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e667e832-2aed-4904-be2a-d98df14964e9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122666 Oct 17 15:32:22.966352 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1200/2602] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:32:22 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:32:22.990684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:22.993050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:23.011779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:23.013718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:23.015088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:23.017726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:23.020463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:23.021406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:23.355629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:23.358856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:23.376297 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72788135-05ef-4a3a-9297-1371bbf3bdb4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1503 microversion: 2.1 time: 1.196684 Oct 17 15:32:23.383016 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1403/2603] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:22 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1503 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:23.391689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:23.407095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:23.444131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:23.447587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:23.449642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:23.452487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:23.465100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:23.465561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:24.236991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:24.246006 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-21b67dda-228f-4c93-9d67-bc9c32ca59f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 1.266977 Oct 17 15:32:24.270553 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1201/2604] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:22 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:24.270553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:24.270553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:24.295048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:24.295574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:24.296027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:24.297013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:24.297603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:24.298144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:24.504057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:24.524679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:24.529754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:24.533313 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-151d71b6-beda-4aea-bb39-d7dbf6432546 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.148537 Oct 17 15:32:24.534199 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1404/2605] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:23 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:24.543248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:24.544424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:24.553119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:24.554825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:24.555391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:24.556139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:24.557235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:24.589118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:24.591270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:24.771691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lazy-loading 'flavor' on Instance uuid cf163cb1-81b4-4969-a6d2-5caa98ae4525 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:32:24.922254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:24.947853 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7be0fadd-7654-4800-be87-b4b0a14ae2b4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1277 microversion: 2.1 time: 0.682221 Oct 17 15:32:24.951137 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1202/2606] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:24 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1277 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:24.963397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-dd9097f4-c705-42dc-9a3c-e675178bddb8 req-44b03387-5851-4774-a508-29f2d63c03ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-plugged", "status": "completed", "tag": "939b9377-081a-4450-baf8-394f3055e596"}, {"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-plugged", "status": "completed", "tag": "82b2b4fa-2b93-4223-9b70-a4bef4b4a357"}, {"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-plugged", "status": "completed", "tag": "7638adff-3c05-4d72-827e-6283c228f4dd"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:24.997492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dd9097f4-c705-42dc-9a3c-e675178bddb8 req-44b03387-5851-4774-a508-29f2d63c03ef service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:25.003127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dd9097f4-c705-42dc-9a3c-e675178bddb8 req-44b03387-5851-4774-a508-29f2d63c03ef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:25.003758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dd9097f4-c705-42dc-9a3c-e675178bddb8 req-44b03387-5851-4774-a508-29f2d63c03ef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:25.056624 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-dd9097f4-c705-42dc-9a3c-e675178bddb8 req-44b03387-5851-4774-a508-29f2d63c03ef service nova] Creating event network-vif-plugged:939b9377-081a-4450-baf8-394f3055e596 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:32:25.058377 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-dd9097f4-c705-42dc-9a3c-e675178bddb8 req-44b03387-5851-4774-a508-29f2d63c03ef service nova] Creating event network-vif-plugged:82b2b4fa-2b93-4223-9b70-a4bef4b4a357 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:32:25.059277 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-dd9097f4-c705-42dc-9a3c-e675178bddb8 req-44b03387-5851-4774-a508-29f2d63c03ef service nova] Creating event network-vif-plugged:7638adff-3c05-4d72-827e-6283c228f4dd for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:32:25.089523 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-dd9097f4-c705-42dc-9a3c-e675178bddb8 req-44b03387-5851-4774-a508-29f2d63c03ef service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.135783 Oct 17 15:32:25.105578 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1203/2607] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:25.130395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:25.133815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:25.157875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:25.166706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:25.167864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:25.169331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:25.170129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:25.170841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:25.196789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:25.326892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:25.633381 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a2a509c-9da1-4ee5-a577-cf0790e6d504 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525/action" status: 202 len: 0 microversion: 2.1 time: 1.097430 Oct 17 15:32:25.642115 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1405/2608] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:32:24 2022] POST /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525/action => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:32:25.648518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd71a25e-360c-426b-a12e-f72f0a888267 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:25.665716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd71a25e-360c-426b-a12e-f72f0a888267 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:25.712344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd71a25e-360c-426b-a12e-f72f0a888267 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:25.712905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd71a25e-360c-426b-a12e-f72f0a888267 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:25.713365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd71a25e-360c-426b-a12e-f72f0a888267 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:25.714147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd71a25e-360c-426b-a12e-f72f0a888267 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:25.714745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd71a25e-360c-426b-a12e-f72f0a888267 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:25.715218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd71a25e-360c-426b-a12e-f72f0a888267 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:25.843831 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd71a25e-360c-426b-a12e-f72f0a888267 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.199487 Oct 17 15:32:25.849411 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1406/2609] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:32:25 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:32:25.876101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:25.882536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:25.911440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:25.911983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:25.912466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:25.913487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:25.914033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:25.914473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:26.552417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:26.591196 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1787f518-e3b5-401b-a1d0-3a04f067b24a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 0.733613 Oct 17 15:32:26.644882 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1407/2610] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:25 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:26.666836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:26.676897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:26.735040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:26.736025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:26.739699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:26.748260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:26.751774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:26.752912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:27.772895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:27.823642 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b6d5496-b376-4260-bcbd-85b9d231e1ca tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1316 microversion: 2.1 time: 2.714980 Oct 17 15:32:27.836908 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1204/2611] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:25 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1316 bytes in 2731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:27.860773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:27.861424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:27.886202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:27.886764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:27.887224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:27.887999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:27.888471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:27.888906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:28.557973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:28.595339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:28.603348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:28.611001 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2a7a9f4-db2f-417c-bb18-2cc14595fb4d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 1.962512 Oct 17 15:32:28.614028 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1408/2612] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:26 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:28.624560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:28.632677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:28.677312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:28.680093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:28.682425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:28.687370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:28.691110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:28.695995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:29.068892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:29.081735 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc60bb2b-5eec-486b-9e39-752b1f279321 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 1.243556 Oct 17 15:32:29.085191 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1205/2613] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:27 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:29.093123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-72804210-e798-4484-8b83-b590766c0ef6 req-7ee3cc7e-bf2d-4a04-8006-d97152a6eee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ffaf2e3-9b09-4035-9136-1544a1ca8087", "tag": "531dd7a3-abcc-42b4-a568-c968310ad10b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:29.116828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-72804210-e798-4484-8b83-b590766c0ef6 req-7ee3cc7e-bf2d-4a04-8006-d97152a6eee8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:29.119212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-72804210-e798-4484-8b83-b590766c0ef6 req-7ee3cc7e-bf2d-4a04-8006-d97152a6eee8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:29.121599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-72804210-e798-4484-8b83-b590766c0ef6 req-7ee3cc7e-bf2d-4a04-8006-d97152a6eee8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:29.154282 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-72804210-e798-4484-8b83-b590766c0ef6 req-7ee3cc7e-bf2d-4a04-8006-d97152a6eee8 service nova] Creating event network-changed:531dd7a3-abcc-42b4-a568-c968310ad10b for instance 5ffaf2e3-9b09-4035-9136-1544a1ca8087 on n-h1-854441-12 Oct 17 15:32:29.169727 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-72804210-e798-4484-8b83-b590766c0ef6 req-7ee3cc7e-bf2d-4a04-8006-d97152a6eee8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082909 Oct 17 15:32:29.170645 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1206/2614] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:29.177651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea91f70e-e398-4290-bd45-8d4cfee7fda3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:29.186218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea91f70e-e398-4290-bd45-8d4cfee7fda3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:29.203935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:29.205954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea91f70e-e398-4290-bd45-8d4cfee7fda3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:29.206850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea91f70e-e398-4290-bd45-8d4cfee7fda3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:29.207470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea91f70e-e398-4290-bd45-8d4cfee7fda3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:29.208367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea91f70e-e398-4290-bd45-8d4cfee7fda3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:29.211689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea91f70e-e398-4290-bd45-8d4cfee7fda3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:29.212471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea91f70e-e398-4290-bd45-8d4cfee7fda3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:29.227816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-339c6c86-6607-4ff7-9aee-b8ffc94bec95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.611891 Oct 17 15:32:29.242867 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1409/2615] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:28 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:29.264802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-59994f49-e972-4987-971a-cc9b5932e003 req-67e00168-fd49-44c4-a1d3-686070ef5ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-plugged", "status": "completed", "tag": "a70fc0cc-532d-48ea-adcb-5fe9b4bf0584"}, {"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-plugged", "status": "completed", "tag": "6d195a6f-05bb-41b8-9a6a-e8ec5eb28188"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:29.310159 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea91f70e-e398-4290-bd45-8d4cfee7fda3 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138058 Oct 17 15:32:29.317870 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1207/2616] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:32:29 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:32:29.323638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59994f49-e972-4987-971a-cc9b5932e003 req-67e00168-fd49-44c4-a1d3-686070ef5ee9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:29.324613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59994f49-e972-4987-971a-cc9b5932e003 req-67e00168-fd49-44c4-a1d3-686070ef5ee9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:29.325386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59994f49-e972-4987-971a-cc9b5932e003 req-67e00168-fd49-44c4-a1d3-686070ef5ee9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:29.330928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:29.337771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:29.359969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:29.364896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:29.368119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:29.372432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:29.375102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:29.375555 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-59994f49-e972-4987-971a-cc9b5932e003 req-67e00168-fd49-44c4-a1d3-686070ef5ee9 service nova] Creating event network-vif-plugged:a70fc0cc-532d-48ea-adcb-5fe9b4bf0584 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:32:29.376375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:29.376510 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-59994f49-e972-4987-971a-cc9b5932e003 req-67e00168-fd49-44c4-a1d3-686070ef5ee9 service nova] Creating event network-vif-plugged:6d195a6f-05bb-41b8-9a6a-e8ec5eb28188 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:32:29.388937 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-59994f49-e972-4987-971a-cc9b5932e003 req-67e00168-fd49-44c4-a1d3-686070ef5ee9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.142658 Oct 17 15:32:29.390569 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1410/2617] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:29.401503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:29.402356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:29.452591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:29.456516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:29.457620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:29.468572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:29.469817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:29.470966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:29.824929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:29.835872 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da1f5b8b-266b-4a1e-ae73-50ef98877a5d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1316 microversion: 2.1 time: 0.443308 Oct 17 15:32:29.855430 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1411/2618] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:29 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:30.021975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d4a9c54-30b9-4592-943b-d92d7cee3da6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Action: 'create', calling method: .version_select at 0x7f28beb1f670>, body: {"keypair": {"name": "tempest-keypair-1664714901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2kss1dbHLnVgcol3Pyb7HwXVoxcUEK8XK6bAHySzy+go8SaEOMo35iDrr+t8DBWbcrC4bv1/qzyNM50ey6S36ELIFGaY1sTkKnH/vxjhDk2nG6FzKzDZQAX2xsd8sjuQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:30.061140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9d4a9c54-30b9-4592-943b-d92d7cee3da6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Getting quotas for project 6d9e8d41de3843668933339c133246ff. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:30.084511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9d4a9c54-30b9-4592-943b-d92d7cee3da6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Getting quotas for user ef506aa8a503449382d7d72fa1916b6e and project 6d9e8d41de3843668933339c133246ff. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:30.182126 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d4a9c54-30b9-4592-943b-d92d7cee3da6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.316944 Oct 17 15:32:30.185215 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1412/2619] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:32:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:30.221134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:30.226127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:30.259167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:30.261438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:30.263958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:30.269466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:30.273498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:30.274511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:30.504031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:30.513038 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-627a2c2c-9341-40aa-a51c-5ce0307e79a9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 1.193576 Oct 17 15:32:30.537051 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1208/2620] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:29 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:30.542337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:30.563363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:30.581362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:30.582225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:30.588841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:30.600220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:30.601480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:30.602634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:31.154382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:31.168868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:31.172279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:31.173928 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c99094b-d33d-4886-a0bb-bf103fa54d12 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.983702 Oct 17 15:32:31.178745 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1413/2621] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:30 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:31.189865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:31.208663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:31.210080 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c752b163-cd73-4ffe-afaa-fc7a362d8c56 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.671726 Oct 17 15:32:31.216306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:31.217389 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1209/2622] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:30 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:31.249964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:31.256935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7b2d6082-4b3f-4bb6-b3f9-9bccdae32d2c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:31.261095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7b2d6082-4b3f-4bb6-b3f9-9bccdae32d2c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:31.261665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:31.262426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:31.263473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:31.264180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:31.267265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:31.285110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b2d6082-4b3f-4bb6-b3f9-9bccdae32d2c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:31.293708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b2d6082-4b3f-4bb6-b3f9-9bccdae32d2c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:31.294788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b2d6082-4b3f-4bb6-b3f9-9bccdae32d2c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:31.295841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b2d6082-4b3f-4bb6-b3f9-9bccdae32d2c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:31.298055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b2d6082-4b3f-4bb6-b3f9-9bccdae32d2c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:31.307734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b2d6082-4b3f-4bb6-b3f9-9bccdae32d2c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:31.404960 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7b2d6082-4b3f-4bb6-b3f9-9bccdae32d2c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.181876 Oct 17 15:32:31.406281 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1210/2623] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:32:31 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:32:31.411542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:31.412410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:31.419461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:31.420280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:31.420898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:31.422699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:31.423396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:31.423985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:31.637790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:31.671923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76e4e4a6-36dd-4fdf-9235-03c789d38558 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.491335 Oct 17 15:32:31.678548 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1414/2624] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:31 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:31.698381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:31.701180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:31.725562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:31.725562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:31.725562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:31.726985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:31.728939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:31.730206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:31.953443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:31.963375 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6b48331-9476-4b50-bc58-9c8acdec4886 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 0.283152 Oct 17 15:32:31.964013 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1415/2625] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:31 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:32.241241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:32.241965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:32.289549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:32.294569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:32.297988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:32.301633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:32.302483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:32.305023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:32.804010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:32.827427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:32.831953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:32.837929 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d330431c-1652-4d92-8976-48e37184a5fc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1879 microversion: 2.32 time: 0.603559 Oct 17 15:32:32.860495 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1416/2626] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:32 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1879 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:32.868018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:32.883974 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-67ea6ec6-245b-43c6-ba10-adedcd778490 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1316 microversion: 2.1 time: 1.476212 Oct 17 15:32:32.885677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:32.894230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:32.906051 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1211/2627] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:31 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1316 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:32.914813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-09d822c2-428c-4c21-8459-67f86cda53dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:32.925202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-09d822c2-428c-4c21-8459-67f86cda53dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:32.932661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:32.936795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:32.944220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:32.947911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09d822c2-428c-4c21-8459-67f86cda53dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:32.948673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09d822c2-428c-4c21-8459-67f86cda53dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:32.952497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09d822c2-428c-4c21-8459-67f86cda53dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:32.954147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:32.955211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:32.956184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09d822c2-428c-4c21-8459-67f86cda53dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:32.957171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09d822c2-428c-4c21-8459-67f86cda53dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:32.958062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09d822c2-428c-4c21-8459-67f86cda53dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:32.958299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:33.035567 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-09d822c2-428c-4c21-8459-67f86cda53dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127850 Oct 17 15:32:33.038251 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1212/2628] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:32:32 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:32:33.045053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:33.046190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:33.055644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:33.056446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:33.057045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:33.057944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:33.058600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:33.059188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:33.418794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:33.436835 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd7e050e-f2f3-4c81-9809-c7650b8d35be tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.573615 Oct 17 15:32:33.439009 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1417/2629] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:32 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:33.450772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:33.452252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:33.469506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:33.471029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:33.472217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:33.473836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:33.475213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:33.476858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:33.715973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:33.730669 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc7d5c19-f56e-40cd-8d52-0b4823008b78 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 0.285773 Oct 17 15:32:33.730669 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1418/2630] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:33 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:33.854325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:33.881022 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff0641e5-8d9e-4ecd-b525-13d04648b1fa tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.841111 Oct 17 15:32:33.904631 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1213/2631] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:33 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:33.905072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:33.905911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:33.918234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:33.919214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:33.920009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:33.920933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:33.921606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:33.922399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:33.951117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:33.955532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:34.021736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:34.032611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:34.043152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:34.059107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:34.064400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:34.065256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:34.586403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:34.612945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:34.631154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:34.633843 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ede2f287-fffb-41ad-a7bf-a8185412af4a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2834 microversion: 2.32 time: 0.734925 Oct 17 15:32:34.651209 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1419/2632] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:32:33 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2834 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:34.690036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7fad4aa4-7043-433c-a8d5-d1ed0e915011 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:34.694660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7fad4aa4-7043-433c-a8d5-d1ed0e915011 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:34.723933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fad4aa4-7043-433c-a8d5-d1ed0e915011 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:34.725204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fad4aa4-7043-433c-a8d5-d1ed0e915011 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:34.727986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fad4aa4-7043-433c-a8d5-d1ed0e915011 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:34.729954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fad4aa4-7043-433c-a8d5-d1ed0e915011 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:34.731019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fad4aa4-7043-433c-a8d5-d1ed0e915011 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:34.746233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7fad4aa4-7043-433c-a8d5-d1ed0e915011 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:34.817198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:34.901837 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7fad4aa4-7043-433c-a8d5-d1ed0e915011 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.248299 Oct 17 15:32:34.903975 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1420/2633] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:32:34 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c/os-volume_attachments => generated 25 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:34.921263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e6faba5d-9863-479e-bab1-126a8cded565 req-4ee981c1-e093-4117-a112-d2a2d76ded06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8eba4c-6082-4902-8f19-8d43b764b5d9", "tag": "805607b3-b87b-4c13-bd12-0be56f094425"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:34.947801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e6faba5d-9863-479e-bab1-126a8cded565 req-4ee981c1-e093-4117-a112-d2a2d76ded06 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:34.949604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e6faba5d-9863-479e-bab1-126a8cded565 req-4ee981c1-e093-4117-a112-d2a2d76ded06 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:34.950862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e6faba5d-9863-479e-bab1-126a8cded565 req-4ee981c1-e093-4117-a112-d2a2d76ded06 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:34.980770 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e6faba5d-9863-479e-bab1-126a8cded565 req-4ee981c1-e093-4117-a112-d2a2d76ded06 service nova] Creating event network-changed:805607b3-b87b-4c13-bd12-0be56f094425 for instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 on n-h1-854441-12 Oct 17 15:32:34.995035 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e6faba5d-9863-479e-bab1-126a8cded565 req-4ee981c1-e093-4117-a112-d2a2d76ded06 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086297 Oct 17 15:32:34.997169 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1421/2634] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:35.010951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:35.013006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:35.028741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:35.030189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:35.031962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:35.035484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:35.036865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:35.038109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:35.113297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:35.171152 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cecb70da-9f1a-46e2-a73b-17bda64bd2fa tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1316 microversion: 2.1 time: 1.255928 Oct 17 15:32:35.180786 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1214/2635] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:33 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1316 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:35.216652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f79382b8-6684-4c21-9f33-23416321890c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:35.222614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f79382b8-6684-4c21-9f33-23416321890c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:35.270149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f79382b8-6684-4c21-9f33-23416321890c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:35.272356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f79382b8-6684-4c21-9f33-23416321890c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:35.273811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f79382b8-6684-4c21-9f33-23416321890c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:35.275647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f79382b8-6684-4c21-9f33-23416321890c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:35.276883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f79382b8-6684-4c21-9f33-23416321890c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:35.277936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f79382b8-6684-4c21-9f33-23416321890c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:35.919697 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f79382b8-6684-4c21-9f33-23416321890c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.729938 Oct 17 15:32:35.920835 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1215/2636] 10.222.0.87 () {60 vars in 1316 bytes} [Mon Oct 17 15:32:35 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68/os-interface => generated 1832 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:32:35.947480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:35.948906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:35.983862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:35.984432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:35.985141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:35.986054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:35.986938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:35.987805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:36.655829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:36.691022 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-828162d5-aab1-4b18-b1c6-4acf8e13f167 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 0.768064 Oct 17 15:32:36.699496 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1216/2637] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:35 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:36.718097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:36.718761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:36.758194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:36.765637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:36.770150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:36.771743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:36.778804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:36.780125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:37.272476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:37.288227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:37.301064 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a672d288-099f-40ae-add5-2a8c150435ed tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 2.301537 Oct 17 15:32:37.325944 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1422/2638] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:34 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:37.343564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5d7dc8ee-bcc1-4930-a2e6-95e2beabe64c req-2d4d9f81-8307-4ceb-bf56-2833ccd7fff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ffaf2e3-9b09-4035-9136-1544a1ca8087", "name": "network-vif-plugged", "status": "completed", "tag": "531dd7a3-abcc-42b4-a568-c968310ad10b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:37.355681 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a6a0baf8-48a2-4459-83a8-7df80a866a2c tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.640207 Oct 17 15:32:37.370530 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1217/2639] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:36 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:37.375339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d7dc8ee-bcc1-4930-a2e6-95e2beabe64c req-2d4d9f81-8307-4ceb-bf56-2833ccd7fff5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:37.376295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d7dc8ee-bcc1-4930-a2e6-95e2beabe64c req-2d4d9f81-8307-4ceb-bf56-2833ccd7fff5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:37.377100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d7dc8ee-bcc1-4930-a2e6-95e2beabe64c req-2d4d9f81-8307-4ceb-bf56-2833ccd7fff5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:37.384546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:37.385182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:37.394908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:37.395429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:37.395919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:37.396880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:37.398130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:37.398876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:37.409512 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5d7dc8ee-bcc1-4930-a2e6-95e2beabe64c req-2d4d9f81-8307-4ceb-bf56-2833ccd7fff5 service nova] Creating event network-vif-plugged:531dd7a3-abcc-42b4-a568-c968310ad10b for instance 5ffaf2e3-9b09-4035-9136-1544a1ca8087 on n-h1-854441-12 Oct 17 15:32:37.426540 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5d7dc8ee-bcc1-4930-a2e6-95e2beabe64c req-2d4d9f81-8307-4ceb-bf56-2833ccd7fff5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097312 Oct 17 15:32:37.427572 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1423/2640] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:37.440515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b5709d7b-6029-4bb6-a8fc-8242dfc356d2 req-314b6996-bb32-44f8-8cb1-af2b9ee33fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af2b7c2-346e-4c07-82fd-071570f5a865", "tag": "1614ba00-cbc1-4afb-8413-36ca45b8205e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:37.467355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b5709d7b-6029-4bb6-a8fc-8242dfc356d2 req-314b6996-bb32-44f8-8cb1-af2b9ee33fbb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:37.467923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b5709d7b-6029-4bb6-a8fc-8242dfc356d2 req-314b6996-bb32-44f8-8cb1-af2b9ee33fbb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:37.468378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b5709d7b-6029-4bb6-a8fc-8242dfc356d2 req-314b6996-bb32-44f8-8cb1-af2b9ee33fbb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:37.510946 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b5709d7b-6029-4bb6-a8fc-8242dfc356d2 req-314b6996-bb32-44f8-8cb1-af2b9ee33fbb service nova] Creating event network-changed:1614ba00-cbc1-4afb-8413-36ca45b8205e for instance 5af2b7c2-346e-4c07-82fd-071570f5a865 on n-h2-854441-12 Oct 17 15:32:37.517902 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b5709d7b-6029-4bb6-a8fc-8242dfc356d2 req-314b6996-bb32-44f8-8cb1-af2b9ee33fbb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087609 Oct 17 15:32:37.519331 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1424/2641] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:37.735559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:37.736675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:37.751778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:37.756399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:37.756964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:37.757815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:37.758299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:37.758771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:38.163948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:38.177729 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d5a926f1-105f-4742-910d-ca0f37eb02a7 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1316 microversion: 2.1 time: 0.812422 Oct 17 15:32:38.182361 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1218/2642] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:37 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1316 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:38.197827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1347132885", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7b62848d-2240-4fa6-af4a-52be70c49c3c"}], "security_groups": [{"name": "tempest-securitygroup--1536605906"}], "key_name": "tempest-keypair-1664714901", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:38.273620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:38.302741 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76f72406-25b5-40ee-9c99-5a0e702f34e1 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 0.572399 Oct 17 15:32:38.348077 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1425/2643] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:37 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:38.371381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:38.372374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:38.393141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:38.395548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:38.396288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:38.397374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:38.398014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:38.398826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:39.033324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:39.067013 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7922456b-e086-4b8b-90c6-0f24523ad532 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.707310 Oct 17 15:32:39.096488 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1426/2644] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:38 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:39.149193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:39.161362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:39.193419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:39.202063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:39.203710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:39.208250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:39.212249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:39.232504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:39.888537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:39.898461 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f866f30-4459-49a6-9c34-87ceec8ab4f6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.786323 Oct 17 15:32:39.912158 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1427/2645] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:39 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:39.925122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:39.926269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:39.934140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:39.935071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:39.936130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:39.937426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:39.938162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:39.938793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:40.113815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:40.286225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:40.296632 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a313c85-cce5-48a6-9eae-74e374e33ffc tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1505 microversion: 2.1 time: 0.383209 Oct 17 15:32:40.319675 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1428/2646] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:39 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:40.348861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:40.351850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:40.369390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:40.385051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:40.385530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:40.386327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:40.389562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:40.394165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:40.832930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:40.868890 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac3bb00c-a19e-43bd-aae1-f4ebc7bbec96 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 0.547431 Oct 17 15:32:40.883292 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1429/2647] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:40 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:40.894701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:40.899389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:40.913266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:40.914584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:40.916126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:40.918307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:40.920758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:40.921959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:41.178482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:41.202637 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2aa7f924-9966-43c6-8334-9ced1fee4e38 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.316269 Oct 17 15:32:41.214598 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1430/2648] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:40 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:41.215696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:41.216853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:41.237199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:41.237199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:41.237199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:41.237199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:41.237199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:41.237199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:41.277382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:41.279775 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ea70f6a-1a05-4b5e-b0d7-f8beae763a16 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087/os-instance-actions/req-fc9e72b1-5164-4222-97b4-0722b7fb219f" status: 200 len: 313 microversion: 2.1 time: 0.073218 Oct 17 15:32:41.281353 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1431/2649] 10.222.0.87 () {58 vars in 1419 bytes} [Mon Oct 17 15:32:41 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087/os-instance-actions/req-fc9e72b1-5164-4222-97b4-0722b7fb219f => generated 313 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:41.502180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6cd5e585-e34f-4170-9863-679d668401f5 req-df341623-aabf-489c-93cf-f3484ed07f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "tag": "15d6381f-175a-4753-8720-a7363204b9d6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:41.580353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6cd5e585-e34f-4170-9863-679d668401f5 req-df341623-aabf-489c-93cf-f3484ed07f65 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:41.581711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6cd5e585-e34f-4170-9863-679d668401f5 req-df341623-aabf-489c-93cf-f3484ed07f65 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:41.583664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6cd5e585-e34f-4170-9863-679d668401f5 req-df341623-aabf-489c-93cf-f3484ed07f65 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:41.638669 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6cd5e585-e34f-4170-9863-679d668401f5 req-df341623-aabf-489c-93cf-f3484ed07f65 service nova] Creating event network-changed:15d6381f-175a-4753-8720-a7363204b9d6 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:32:41.670653 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6cd5e585-e34f-4170-9863-679d668401f5 req-df341623-aabf-489c-93cf-f3484ed07f65 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.387457 Oct 17 15:32:41.695596 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1432/2650] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:41.719688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:41.722999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:41.739888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:41.742383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:41.743711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:41.747099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:41.748457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:41.749592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:42.193886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:42.219233 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c8958ec-4537-4f0a-b2b0-2abdf217375e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.519068 Oct 17 15:32:42.234785 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1433/2651] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:41 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:42.248711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b62a797d-8b13-42d1-9619-a31ad53bd6ed tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:42.255743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b62a797d-8b13-42d1-9619-a31ad53bd6ed tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:42.281436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b62a797d-8b13-42d1-9619-a31ad53bd6ed tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:42.285800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b62a797d-8b13-42d1-9619-a31ad53bd6ed tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:42.286118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b62a797d-8b13-42d1-9619-a31ad53bd6ed tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:42.287479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b62a797d-8b13-42d1-9619-a31ad53bd6ed tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:42.288297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b62a797d-8b13-42d1-9619-a31ad53bd6ed tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:42.290631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b62a797d-8b13-42d1-9619-a31ad53bd6ed tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:42.484667 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b62a797d-8b13-42d1-9619-a31ad53bd6ed tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "POST /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087/action" status: 202 len: 0 microversion: 2.1 time: 0.246866 Oct 17 15:32:42.488886 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1434/2652] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:32:42 2022] POST /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:32:42.501443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:42.502953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:42.534571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:42.540699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:42.542030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:42.543471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:42.544288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:42.545043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:42.907193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:42.931678 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5eb111ea-3afe-4602-aac4-2abb60691011 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 0.442389 Oct 17 15:32:42.936039 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1435/2653] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:42 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:42.959928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:42.962086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:42.971909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:42.973969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:42.991730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:42.993669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:42.994596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:42.995521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:43.507539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:43.529213 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62840e66-ec2a-4657-801e-2ebb69297c4c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.585200 Oct 17 15:32:43.531727 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1436/2654] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:42 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:43.571036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:43.573870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:43.624145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:43.634915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:43.636472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:43.640005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:43.647443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:43.649301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:44.061483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:44.086324 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54108846-b2a9-463e-a013-cff608680b50 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1507 microversion: 2.1 time: 0.550529 Oct 17 15:32:44.088309 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1437/2655] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:43 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:44.098098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:44.099651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:44.112101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:44.113367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:44.114382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:44.117073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:44.118295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:44.119311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:44.203038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:44.471869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:44.482281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] validate_networks() for [('7b62848d-2240-4fa6-af4a-52be70c49c3c', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:32:44.484201 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e6f353d-b43c-4284-92e9-5cdad4ec2ec1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.393727 Oct 17 15:32:44.485234 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1438/2656] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:44 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:44.510471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1b368806-9725-4c28-a243-c2fc0468320c req-53810c66-fbac-4b97-a756-c003a839e0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8eba4c-6082-4902-8f19-8d43b764b5d9", "name": "network-vif-plugged", "status": "completed", "tag": "805607b3-b87b-4c13-bd12-0be56f094425"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:44.525009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1b368806-9725-4c28-a243-c2fc0468320c req-53810c66-fbac-4b97-a756-c003a839e0f1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:44.525516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1b368806-9725-4c28-a243-c2fc0468320c req-53810c66-fbac-4b97-a756-c003a839e0f1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:44.525960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1b368806-9725-4c28-a243-c2fc0468320c req-53810c66-fbac-4b97-a756-c003a839e0f1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:44.544969 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1b368806-9725-4c28-a243-c2fc0468320c req-53810c66-fbac-4b97-a756-c003a839e0f1 service nova] Creating event network-vif-plugged:805607b3-b87b-4c13-bd12-0be56f094425 for instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 on n-h1-854441-12 Oct 17 15:32:44.551291 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1b368806-9725-4c28-a243-c2fc0468320c req-53810c66-fbac-4b97-a756-c003a839e0f1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046923 Oct 17 15:32:44.552965 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1439/2657] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:44.561000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:44.562273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:44.571747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:44.572248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:44.573213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:44.574698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:44.575795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:44.576620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:44.813744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:44.839234 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07ed6bfe-7f3f-4ff7-a270-0d0673419ba7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 0.283787 Oct 17 15:32:44.842075 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1440/2658] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:44 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:45.064173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e40d601-8910-4c1d-b3a1-17cd3c5dbe58 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Action: 'create', calling method: .version_select at 0x7f28be3fdc10>, body: {"keypair": {"name": "tempest-keypair-1926342222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPyrkzQnTMUwY+vFtf4Ao8/xcqx0RfH/gp3o/OrNjd4qzW0dX4ZWin4CaUD0tyAadiOVKdofVwJ3cTS98itzVPCDMEKnQXi5MaG2M/1mh9YgUp+fKku315SjrKOwIm9Kw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:45.101500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8e40d601-8910-4c1d-b3a1-17cd3c5dbe58 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Getting quotas for project 17260d6e6104443aadd1f8d2894f256e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:45.114615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8e40d601-8910-4c1d-b3a1-17cd3c5dbe58 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Getting quotas for user a238ad41ef1e44658b2c7a0edfb7aefe and project 17260d6e6104443aadd1f8d2894f256e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:45.166237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e40d601-8910-4c1d-b3a1-17cd3c5dbe58 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.321700 Oct 17 15:32:45.177823 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1441/2659] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:32:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:45.191888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:45.202862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:45.230002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:45.231964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:45.234661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:45.237043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:45.238345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:45.239657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:45.580365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:45.609635 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-050e53d1-b086-40f7-a0ab-e1fe187d54d5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.439345 Oct 17 15:32:45.610819 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1442/2660] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:45 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:45.646632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=64 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:45.653108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:45.656881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:45.674677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:45.683892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:45.690816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:45.692684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:45.693725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:45.697266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:46.128348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:46.151851 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-103b6275-ebf3-4886-86cf-860ab0c6a60f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1505 microversion: 2.1 time: 0.538493 Oct 17 15:32:46.153400 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1443/2661] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:45 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:46.184424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:46.186015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:46.203847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:46.212046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:46.213801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:46.215271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:46.217377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:46.222714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:46.285563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Getting quotas for project 6d9e8d41de3843668933339c133246ff. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:46.295839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Getting quotas for user ef506aa8a503449382d7d72fa1916b6e and project 6d9e8d41de3843668933339c133246ff. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:46.320715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:32:46.321457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:32:46.322654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:32:46.323412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:32:46.324211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:32:46.345637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:46.346724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:46.348144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:46.349782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:46.350737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:46.351677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:46.365204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:46.386886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Getting quotas for project 6d9e8d41de3843668933339c133246ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:46.398600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Getting quotas for user ef506aa8a503449382d7d72fa1916b6e and project 6d9e8d41de3843668933339c133246ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:46.423224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:32:46.427941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:32:46.538914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e0cbf588-a397-4a0c-b332-9d180aa6fa2d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 8.354615 Oct 17 15:32:46.542268 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1219/2662] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:32:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 8359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:32:46.558200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:46.559694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:46.561237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:46.577776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:46.578424 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c226cc2e-0c8d-4c6d-837c-a757e3ffcc84 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.414118 Oct 17 15:32:46.579071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:46.580081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:46.581558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:46.583062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:46.584065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:46.598059 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1444/2663] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:46 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:46.625743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f861bfed-f1ab-4503-a4ae-081aac43b11f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '.version_select at 0x7f28be3fd700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:46.626152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f861bfed-f1ab-4503-a4ae-081aac43b11f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:46.629423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:46.648434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f861bfed-f1ab-4503-a4ae-081aac43b11f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:46.649452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f861bfed-f1ab-4503-a4ae-081aac43b11f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:46.652144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f861bfed-f1ab-4503-a4ae-081aac43b11f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:46.656441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f861bfed-f1ab-4503-a4ae-081aac43b11f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:46.657433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f861bfed-f1ab-4503-a4ae-081aac43b11f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:46.658525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f861bfed-f1ab-4503-a4ae-081aac43b11f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:46.760432 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f861bfed-f1ab-4503-a4ae-081aac43b11f tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.151103 Oct 17 15:32:46.761966 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1445/2664] 10.222.0.87 () {58 vars in 1296 bytes} [Mon Oct 17 15:32:46 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087/os-instance-actions => generated 611 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:46.771036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57b2ae6d-0a0d-4e71-8159-d6a3e9e3054e tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:46.776726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57b2ae6d-0a0d-4e71-8159-d6a3e9e3054e tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:46.920393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57b2ae6d-0a0d-4e71-8159-d6a3e9e3054e tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:46.959395 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57b2ae6d-0a0d-4e71-8159-d6a3e9e3054e tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1270 microversion: 2.1 time: 0.193679 Oct 17 15:32:46.962730 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1446/2665] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:46 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:47.172140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-85a40780-806a-4b61-951c-305d0369029a req-9da63d5d-1f72-48be-8211-3e0dc8d8e861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af2b7c2-346e-4c07-82fd-071570f5a865", "name": "network-vif-plugged", "status": "completed", "tag": "1614ba00-cbc1-4afb-8413-36ca45b8205e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:47.189001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:47.204943 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f06d5025-0bc9-4c83-9724-b4a98be5bb41 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1316 microversion: 2.1 time: 0.660266 Oct 17 15:32:47.206384 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1220/2666] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:46 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:47.218837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:47.226535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:47.233770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:47.234750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:47.236069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:47.237660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:47.238773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:47.239628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:47.242604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85a40780-806a-4b61-951c-305d0369029a req-9da63d5d-1f72-48be-8211-3e0dc8d8e861 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:47.243313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85a40780-806a-4b61-951c-305d0369029a req-9da63d5d-1f72-48be-8211-3e0dc8d8e861 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:47.252618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85a40780-806a-4b61-951c-305d0369029a req-9da63d5d-1f72-48be-8211-3e0dc8d8e861 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:47.292847 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-85a40780-806a-4b61-951c-305d0369029a req-9da63d5d-1f72-48be-8211-3e0dc8d8e861 service nova] Creating event network-vif-plugged:1614ba00-cbc1-4afb-8413-36ca45b8205e for instance 5af2b7c2-346e-4c07-82fd-071570f5a865 on n-h2-854441-12 Oct 17 15:32:47.320973 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-85a40780-806a-4b61-951c-305d0369029a req-9da63d5d-1f72-48be-8211-3e0dc8d8e861 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354627 Oct 17 15:32:47.322483 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1447/2667] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:47.337301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:47.338393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:47.376905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:47.378709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:47.381989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:47.384343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:47.387232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:47.390946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:47.483858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:32:47.681310 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd5d3b9f-b135-4a1a-be3e-74738edb20bf tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 204 len: 0 microversion: 2.1 time: 0.355329 Oct 17 15:32:47.687762 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1448/2668] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:32:47 2022] DELETE /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:32:47.698944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:47.700104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:47.713826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:47.715160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:47.716049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:47.717916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:47.719086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:47.720060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:47.823909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:47.864734 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-34e51975-077c-4a3d-b045-a05d18859b50 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.654057 Oct 17 15:32:47.885082 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1221/2669] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:47 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:47.915300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:47.916800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:47.930229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:47.931514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:47.932521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:47.933991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:47.938719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:47.940204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:48.059820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:48.077085 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09f08e2d-3efe-4aea-bbe1-1cd0b22e902d tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.386869 Oct 17 15:32:48.078731 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1449/2670] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:47 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:48.089526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:48.091589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:48.105274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:48.106747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:48.107361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:48.108257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:48.109319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:48.110308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:48.213462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:48.229071 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6370a8da-5b07-4043-8082-d94544d59078 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1274 microversion: 2.1 time: 0.148143 Oct 17 15:32:48.230872 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1450/2671] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:48 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:48.248796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:48.249883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:48.265515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:48.266563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:48.268341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:48.269649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:48.270747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:48.271594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:48.409995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:48.426252 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2e2472e-2e88-486f-89d3-c2f01a28d8df tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1511 microversion: 2.1 time: 0.525062 Oct 17 15:32:48.427814 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1222/2672] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:47 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:48.490316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:48.503438 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-efdc83a0-2df3-4154-a7dc-3777c829902a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1465 microversion: 2.1 time: 0.263167 Oct 17 15:32:48.505217 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1451/2673] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:48 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1465 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:48.535647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1420379067", "metadata": {"image_type": "test"}}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:48.543555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:48.557918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:48.560737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:48.563143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:48.565848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:48.567094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:48.568363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:48.628913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Getting quotas for project 8c2f4600658d49738f4e00f44b2cd1d3. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:48.638572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Getting quotas for user a371ebfdf0034f3f890044609df5da40 and project 8c2f4600658d49738f4e00f44b2cd1d3. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:48.875197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-469662156", "imageRef": "cfb2633a-854d-4ee8-bbd1-1e655b91e7e3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1cf7b01f-b644-4af4-82ed-22c25c815a63"}], "security_groups": [{"name": "tempest-securitygroup--65221037"}], "key_name": "tempest-keypair-1926342222", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:48.899125 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b80929d1-d710-478c-84bc-de69394b9a5b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "POST /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.373545 Oct 17 15:32:48.900244 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1223/2674] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:32:48 2022] POST /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:32:48.921276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:48.922310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:48.933796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:48.934653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:48.935424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:48.936491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:48.937120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:48.937676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:49.108414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] validate_networks() for [('1cf7b01f-b644-4af4-82ed-22c25c815a63', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:32:49.166438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:49.179748 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1554a44-7129-4a8a-b464-e8d04a67c04e tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.266872 Oct 17 15:32:49.182223 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1224/2675] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:48 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:49.191514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f8e8f356-84c6-4705-ab79-87f799c403dd tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28c2fe3040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:49.313570 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f8e8f356-84c6-4705-ab79-87f799c403dd tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610" status: 200 len: 1424 microversion: 2.1 time: 0.123113 Oct 17 15:32:49.332963 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1225/2676] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:32:49 2022] GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 => generated 1424 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:49.359001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:49.362065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:49.377885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:49.379202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:49.380876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:49.383089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:49.384659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:49.385889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:49.748767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:49.763662 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-852bdfd1-d245-4c8e-a892-f722997d42a0 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1319 microversion: 2.1 time: 0.429065 Oct 17 15:32:49.774200 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1226/2677] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:49 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:49.792197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:49.794299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:49.811850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:49.813282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:49.814537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:49.816086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:49.816692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:49.817697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:49.953983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:49.990982 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-49a95248-c8bc-402a-9f42-45fbac0e5727 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1322 microversion: 2.1 time: 0.211266 Oct 17 15:32:49.991777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:32:49.992440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:32:49.992608 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1227/2678] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:49 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:49.992740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:32:50.003069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:32:50.003265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:50.003550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:32:50.004130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:50.017911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:50.019199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:50.020159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:50.021601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:50.022661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:50.023753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:50.024645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:50.025227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:50.025737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:50.026595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:50.027389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:50.028108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:50.072087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Getting quotas for project 17260d6e6104443aadd1f8d2894f256e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:50.086270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Getting quotas for user a238ad41ef1e44658b2c7a0edfb7aefe and project 17260d6e6104443aadd1f8d2894f256e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:50.132806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:32:50.143576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfb2633a-854d-4ee8-bbd1-1e655b91e7e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:32:50.236757 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-325eb3d5-2c65-4177-9cd7-e43e74fce293 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.369519 Oct 17 15:32:50.238086 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1452/2679] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:32:48 2022] POST /compute/v2.1/servers => generated 404 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:32:50.243892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:50.244789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:50.252238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:50.252739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:50.253191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:50.254160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:50.254633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:50.255372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:50.380446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:50.402557 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-371cafab-b32c-418e-9692-645ead2a96e2 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1511 microversion: 2.1 time: 0.408025 Oct 17 15:32:50.410584 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1228/2680] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:49 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:50.435644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5818e849-3ef0-40df-9a36-0440fcea18dc tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:50.444800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5818e849-3ef0-40df-9a36-0440fcea18dc tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:50.511204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:50.528213 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8db74ee-2a98-4541-bc0c-a9cac107b567 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.286278 Oct 17 15:32:50.532693 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1453/2681] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:50 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:50.553427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe58d840-2f9e-4543-bfd9-123118370aec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be99c790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:50.749572 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe58d840-2f9e-4543-bfd9-123118370aec tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610" status: 200 len: 1424 microversion: 2.1 time: 0.215501 Oct 17 15:32:50.757277 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1454/2682] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:32:50 2022] GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 => generated 1424 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:50.801059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:50.802137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:50.820198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:50.820701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:50.821148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:50.821962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:50.822421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:50.822925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:50.966102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5818e849-3ef0-40df-9a36-0440fcea18dc tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:51.005716 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5818e849-3ef0-40df-9a36-0440fcea18dc tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1245 microversion: 2.1 time: 0.600408 Oct 17 15:32:51.012488 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1229/2683] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:50 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1245 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:51.021496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-282ce5b0-3d24-4a82-9652-6be643782364 req-471e39da-545c-4692-b56c-c658826ee7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ffaf2e3-9b09-4035-9136-1544a1ca8087", "name": "network-vif-deleted", "tag": "531dd7a3-abcc-42b4-a568-c968310ad10b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:51.078031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-282ce5b0-3d24-4a82-9652-6be643782364 req-471e39da-545c-4692-b56c-c658826ee7f5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.079154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-282ce5b0-3d24-4a82-9652-6be643782364 req-471e39da-545c-4692-b56c-c658826ee7f5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.080002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-282ce5b0-3d24-4a82-9652-6be643782364 req-471e39da-545c-4692-b56c-c658826ee7f5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.127447 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-282ce5b0-3d24-4a82-9652-6be643782364 req-471e39da-545c-4692-b56c-c658826ee7f5 service nova] Creating event network-vif-deleted:531dd7a3-abcc-42b4-a568-c968310ad10b for instance 5ffaf2e3-9b09-4035-9136-1544a1ca8087 on n-h1-854441-12 Oct 17 15:32:51.142096 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-282ce5b0-3d24-4a82-9652-6be643782364 req-471e39da-545c-4692-b56c-c658826ee7f5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127509 Oct 17 15:32:51.147019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1230/2684] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:51.164631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:51.165370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:51.192488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.193784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.194740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.195707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.196350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.196939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.230448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:51.245704 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7946eaf9-9b38-4abf-9259-505017412e4e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1469 microversion: 2.1 time: 0.460340 Oct 17 15:32:51.247451 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1455/2685] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:50 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1469 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:51.338187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:51.352358 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fd13eefe-a7f7-4c79-8223-e917acf871ff tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1328 microversion: 2.1 time: 0.203514 Oct 17 15:32:51.357872 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1231/2686] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:51 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1328 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:51.423998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2031794278", "block_migration": true, "disk_over_commit": false}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:51.426748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:51.443907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:51.444533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.445172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:51.445918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.448295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.451414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.452227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.454642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.461807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.462868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.466557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.466557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.466881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.471221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.515516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lazy-loading 'flavor' on Instance uuid 5af2b7c2-346e-4c07-82fd-071570f5a865 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:32:51.539337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Going to try to live migrate instance to tempest-host-2031794278 {{(pid=120406) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 15:32:51.559613 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] HTTP exception thrown: Compute host tempest-host-2031794278 could not be found. Oct 17 15:32:51.562174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.562773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.563256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.563731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lazy-loading 'fault' on Instance uuid 5ffaf2e3-9b09-4035-9136-1544a1ca8087 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Request method failure captured: Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865/action HTTP/1.1 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 107 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXV8xb3eiYZea1lbUumaLmNTORs_3rALgHDmAM-6enu1U5XxGtHDUArmNWDfZAStpocuLTLYHKrEb3QQHzCqeRng4UMlW6wQllqUNMsOSYQ519VpHmFpcRkIfkTzU8iPpwD60QBlxV6X5Jm4au-CEgZl4nl403mXDoo_TUKkZwKuZ3o Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 06539bb41c294c638d480195ac082c89 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-LiveMigrationNegativeTest-1592144498 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06539bb41c294c638d480195ac082c89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/06539bb41c294c638d480195ac082c89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_06539bb41c294c638d480195ac082c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06539bb41c294c638d480195ac082c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-LiveMigrationNegativeTest-1592144498 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 06539bb41c294c638d480195ac082c89 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1592144498 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-LiveMigrationNegativeTest-1592144498-project-admin Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 3696b8405e8b4ca8a306727eaf757014 Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-LiveMigrationNegativeTest-1592144498-project-admin Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: {"os-migrateLive": {"host": "tempest-host-2031794278", "block_migration": true, "disk_over_commit": false}} Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: exception: Compute host tempest-host-2031794278 could not be found. Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5af2b7c2-346e-4c07-82fd-071570f5a865', 'body': {'os-migrateLive': {'host': 'tempest-host-2031794278', 'block_migration': True, 'disk_over_commit': False}}} Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 17 15:32:51.569687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2031794278 could not be found. Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2031794278 could not be found. Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2031794278 could not be found. Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Returning 400 to user: Compute host tempest-host-2031794278 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c551260-5c9e-4614-9a18-3de52ffb702b tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865/action" status: 400 len: 100 microversion: 2.1 time: 0.277287 Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1456/2687] 10.222.0.87 () {60 vars in 1279 bytes} [Mon Oct 17 15:32:51 2022] POST /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865/action => generated 100 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:51.585726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:51.600790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.602012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.602012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.602482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.602971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.603398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.679011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fda708e5e714da08080451102f2a9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277beda3bda44709a6698b08b9ee2ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:51.690808 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a0bccadc-8c64-496e-afda-7de349bbc24d tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 200 len: 1306 microversion: 2.1 time: 0.252747 Oct 17 15:32:51.691420 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1232/2688] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:51 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:51.696473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:51.697097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:51.717712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.718202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.718894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.720048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:51.720765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:51.721241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:51.867665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:51.888257 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07db499d-458a-429b-a316-8e766b15ac35 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.313423 Oct 17 15:32:51.889738 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1457/2689] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:51 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:51.899197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b742ea9-4f5e-42e8-b744-f53a64a8e494 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be336670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:52.005388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b742ea9-4f5e-42e8-b744-f53a64a8e494 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610" status: 200 len: 1424 microversion: 2.1 time: 0.112024 Oct 17 15:32:52.006786 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1458/2690] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:32:51 2022] GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 => generated 1424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:52.042685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:52.048746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:52.072661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:52.074025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:52.075597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:52.078285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:52.080603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:52.081681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:52.096386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:52.163456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:52.172901 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9adf68a1-cb0b-4ad2-9573-d0ed078de736 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1469 microversion: 2.1 time: 0.480308 Oct 17 15:32:52.185796 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1233/2691] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:51 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1469 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:52.276631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:52.294713 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4cef5d25-bed6-4dab-a39c-bb1b393c0c7a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1297 microversion: 2.1 time: 0.261582 Oct 17 15:32:52.297897 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1459/2692] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:52 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1297 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:32:52.348791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-716763695", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:52.401143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:52.402118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:52.416077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:52.419782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:52.420494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:52.423991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:52.425915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:52.427346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:52.507221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:32:52.563605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:52.589022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37f1929c-66b0-4bad-9827-2907a13d1b27 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1328 microversion: 2.1 time: 0.192202 Oct 17 15:32:52.596132 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1460/2693] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:52 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:52.732792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:52.733869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] [instance: 5ffaf2e3-9b09-4035-9136-1544a1ca8087] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:52.754730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:52.757666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:52.761902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:52.765156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:52.765727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:52.767016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:52.804185 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] HTTP exception thrown: Instance 5ffaf2e3-9b09-4035-9136-1544a1ca8087 could not be found. Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Request method failure captured: Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 HTTP/1.1 Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXV1NEYiXyr9jziXnlXJyx6YmJKQNiWx8jp7cSmmCcNQGbiySMOe5TE53UKMZQAMjxSRqwyh6hibWWfzZihm2AxxCLb9OkJ2uW3aasxmH7Yc5PJrmcMB1vkr_jEPfDIcjmUWktlQoFX6nXF_zGbVUZtvxQo6tqfOTuqZYMrplHh6Xug Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 4277beda3bda44709a6698b08b9ee2ce Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceActionsTestJSON-914724453 Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4277beda3bda44709a6698b08b9ee2ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4277beda3bda44709a6698b08b9ee2ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4277beda3bda44709a6698b08b9ee2ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4277beda3bda44709a6698b08b9ee2ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceActionsTestJSON-914724453 Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 4277beda3bda44709a6698b08b9ee2ce Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceActionsTestJSON-914724453 Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-InstanceActionsTestJSON-914724453-project Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 4fda708e5e714da08080451102f2a9b8 Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceActionsTestJSON-914724453-project Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5ffaf2e3-9b09-4035-9136-1544a1ca8087 could not be found. Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5ffaf2e3-9b09-4035-9136-1544a1ca8087'} Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ffaf2e3-9b09-4035-9136-1544a1ca8087 could not be found. Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ffaf2e3-9b09-4035-9136-1544a1ca8087 could not be found. Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:32:52.805876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ffaf2e3-9b09-4035-9136-1544a1ca8087 could not be found. Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] Returning 404 to user: Instance 5ffaf2e3-9b09-4035-9136-1544a1ca8087 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5329c6ed-751e-44ed-939e-44fb0bbce577 tempest-InstanceActionsTestJSON-914724453 tempest-InstanceActionsTestJSON-914724453-project] 10.222.0.87 "GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087" status: 404 len: 111 microversion: 2.1 time: 0.079786 Oct 17 15:32:52.821526 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1461/2694] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:52 2022] GET /compute/v2.1/servers/5ffaf2e3-9b09-4035-9136-1544a1ca8087 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:32:52.919130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:52.921770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:52.945808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:52.946324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:52.946832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:52.951796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:52.952680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:52.957032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:53.692563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:53.703296 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1872497-b14e-46f9-8fc9-ad13157e73d3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1509 microversion: 2.1 time: 0.792870 Oct 17 15:32:53.708130 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1462/2695] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:52 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1509 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:53.721320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6c3e889-7ddf-421f-826f-aa1618d9c2fe tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28bea69e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:53.841965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:32:53.842821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:32:53.843440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:32:53.845516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:32:53.846177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:32:53.885148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:53.885991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:53.886794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:53.894486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:53.898425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:53.899640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:53.990680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Getting quotas for project 98e9a6e643c54bc7bd4a28c9e5937a30. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:32:54.021764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Getting quotas for user ba709d7db06a4acd9436d532c4b6aa18 and project 98e9a6e643c54bc7bd4a28c9e5937a30. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:32:54.075658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:32:54.079287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:32:54.148183 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f656d03-9f47-4981-bd49-c195816d65b7 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.806013 Oct 17 15:32:54.148438 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1234/2696] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:32:54.155417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:54.156497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:54.166597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:54.167412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:54.168155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:54.169217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:54.169958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:54.170653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:55.051027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:55.066328 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b743f55-a660-4a40-93d5-9375b2baee08 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1303 microversion: 2.1 time: 0.916019 Oct 17 15:32:55.069283 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1235/2697] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:54 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1303 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:55.076478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:55.082432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:55.106893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:55.108524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:55.114141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:55.116248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:55.119359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:55.129658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:56.551674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:56.579194 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2e50a762-32c3-4a0c-9c85-b2677a114de2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1396 microversion: 2.1 time: 1.507287 Oct 17 15:32:56.579907 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1236/2698] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:55 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1396 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:56.587852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:56.592382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:56.603227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:56.604007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:56.605358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:56.611940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:56.612749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:56.613714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:56.649362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:32:57.190172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:57.203405 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f19db063-b0ba-4789-8990-77d6850383a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1270 microversion: 2.1 time: 0.621735 Oct 17 15:32:57.207398 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1237/2699] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:56 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1270 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:57.222324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:57.223492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:57.233872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:57.239425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:57.241025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:57.242337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:57.243253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:57.245157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:59.483677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:32:59.499095 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-79542587-9474-4c4c-8e38-b8839a2255c6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1530 microversion: 2.1 time: 2.289967 Oct 17 15:32:59.499755 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1238/2700] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:57 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1530 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:32:59.527921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5e44e74f-a847-42f6-ad4e-f81608c91218 req-d13a62a1-dbf4-4178-855d-94fa91af721a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8eba4c-6082-4902-8f19-8d43b764b5d9", "name": "network-vif-plugged", "status": "completed", "tag": "805607b3-b87b-4c13-bd12-0be56f094425"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:32:59.556478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5e44e74f-a847-42f6-ad4e-f81608c91218 req-d13a62a1-dbf4-4178-855d-94fa91af721a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:59.559341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5e44e74f-a847-42f6-ad4e-f81608c91218 req-d13a62a1-dbf4-4178-855d-94fa91af721a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:59.560219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5e44e74f-a847-42f6-ad4e-f81608c91218 req-d13a62a1-dbf4-4178-855d-94fa91af721a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:59.610918 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5e44e74f-a847-42f6-ad4e-f81608c91218 req-d13a62a1-dbf4-4178-855d-94fa91af721a service nova] Creating event network-vif-plugged:805607b3-b87b-4c13-bd12-0be56f094425 for instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 on n-h1-854441-12 Oct 17 15:32:59.639473 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5e44e74f-a847-42f6-ad4e-f81608c91218 req-d13a62a1-dbf4-4178-855d-94fa91af721a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132661 Oct 17 15:32:59.640286 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1239/2701] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:32:59.681466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:32:59.682369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:32:59.725012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:59.725584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:59.726747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:32:59.729803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:32:59.730310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:32:59.732021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:00.038233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:00.113751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:00.788105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:00.804022 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4a1af325-50eb-499c-b94f-5a5d73f150e5 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 1.155297 Oct 17 15:33:00.804973 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1240/2702] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:32:59 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:00.818754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:00.822068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:00.839038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:00.840391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:00.841016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:00.844209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:00.844971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:00.847131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:02.937117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:03.461230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:03.493830 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e88c8d17-571a-43d7-b4f7-c1ed60be299d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1396 microversion: 2.1 time: 2.686161 Oct 17 15:33:03.495766 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1241/2703] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:00 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1396 bytes in 2689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:03.513866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:03.518035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:03.541785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:03.543971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:03.545578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:03.547731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:03.549492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:03.551666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:03.698262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=19 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:03.950367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:04.055826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:04.086434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=18 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:04.100894 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-58319377-eb40-44aa-9f72-df480b151488 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1276 microversion: 2.1 time: 0.600243 Oct 17 15:33:04.104147 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1242/2704] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:03 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1276 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:04.128165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:04.129897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:04.151196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:04.152701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:04.155321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:04.164353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:04.165718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:04.167018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:05.576810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:05.594029 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7acb3db4-1d69-405b-b6d3-1e0b9a923543 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 1.486706 Oct 17 15:33:05.618310 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1243/2705] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:04 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:05.629092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:05.630830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:05.649164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:05.652247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:05.654578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:05.658918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:05.660370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:05.665595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:07.919142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:07.937337 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-248018b6-c0b0-4672-b70c-9da60b3fc35c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 2.310617 Oct 17 15:33:07.944512 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1244/2706] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:05 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:07.960166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9c82f6bf-6886-4f63-bb8c-576d342396cd req-e9da500a-d4f3-458b-b092-1c1ac8d32220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf163cb1-81b4-4969-a6d2-5caa98ae4525", "name": "network-vif-plugged", "status": "completed", "tag": "c958c84d-2595-4536-aeb2-e83c146fdb74"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:08.063855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9c82f6bf-6886-4f63-bb8c-576d342396cd req-e9da500a-d4f3-458b-b092-1c1ac8d32220 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:08.073064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9c82f6bf-6886-4f63-bb8c-576d342396cd req-e9da500a-d4f3-458b-b092-1c1ac8d32220 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:08.074793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9c82f6bf-6886-4f63-bb8c-576d342396cd req-e9da500a-d4f3-458b-b092-1c1ac8d32220 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:08.173757 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9c82f6bf-6886-4f63-bb8c-576d342396cd req-e9da500a-d4f3-458b-b092-1c1ac8d32220 service nova] Creating event network-vif-plugged:c958c84d-2595-4536-aeb2-e83c146fdb74 for instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 on n-h2-854441-12 Oct 17 15:33:08.193181 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9c82f6bf-6886-4f63-bb8c-576d342396cd req-e9da500a-d4f3-458b-b092-1c1ac8d32220 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244478 Oct 17 15:33:08.198686 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1245/2707] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:08.379685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-156dff8c-7c26-4666-8761-4cc350b15f4d req-010c4adb-19ef-4992-b127-5251933115fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358b1061-ccb3-435d-81eb-ce398beb8a75", "tag": "8e472bc8-b3fe-44a5-a84e-d82528a12b96"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:08.434031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:08.438934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-156dff8c-7c26-4666-8761-4cc350b15f4d req-010c4adb-19ef-4992-b127-5251933115fb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:08.440334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-156dff8c-7c26-4666-8761-4cc350b15f4d req-010c4adb-19ef-4992-b127-5251933115fb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:08.441350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-156dff8c-7c26-4666-8761-4cc350b15f4d req-010c4adb-19ef-4992-b127-5251933115fb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:08.503023 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-156dff8c-7c26-4666-8761-4cc350b15f4d req-010c4adb-19ef-4992-b127-5251933115fb service nova] Creating event network-changed:8e472bc8-b3fe-44a5-a84e-d82528a12b96 for instance 358b1061-ccb3-435d-81eb-ce398beb8a75 on n-h2-854441-12 Oct 17 15:33:08.533760 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-156dff8c-7c26-4666-8761-4cc350b15f4d req-010c4adb-19ef-4992-b127-5251933115fb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.332204 Oct 17 15:33:08.548298 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1246/2708] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:08.587685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:08.595090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:08.631625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:08.633856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:08.634830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:08.636557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:08.640559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:08.646437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:10.205138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:10.220474 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1c26f1a-a5fa-4e75-800d-faa666b5ef61 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1396 microversion: 2.1 time: 1.666555 Oct 17 15:33:10.242623 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1247/2709] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:08 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1396 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:10.271468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:10.272878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:10.316386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:10.323017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:10.323915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:10.327711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:10.332525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:10.335542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:11.624493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:11.654019 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-40fb0ebc-b40c-455b-b703-a7c5b41fdf95 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1318 microversion: 2.1 time: 1.407629 Oct 17 15:33:11.658221 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1248/2710] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:10 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1318 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:11.685122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:11.688325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:11.709743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:11.711434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:11.712716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:11.714372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:11.718986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:11.720779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:12.824099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:12.846714 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b4982fb6-00a4-4ca6-9e36-41b1ec3e2988 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 1.186256 Oct 17 15:33:12.849443 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1249/2711] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:11 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:12.863220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:12.864265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:12.886845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:12.888191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:12.889097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:12.891688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:12.894206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:12.895307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:13.920273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:13.936108 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a0416848-0dda-41a0-806a-7235e3733c47 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 1.082656 Oct 17 15:33:13.957768 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1250/2712] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:12 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:13.970019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:13.978356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:13.989471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:13.990284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:13.990996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:13.992192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:13.992853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:13.995029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:15.204821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:15.246688 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-705e639a-efdd-42cd-b2f6-25aa73ffd1e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1396 microversion: 2.1 time: 1.283474 Oct 17 15:33:15.246688 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1251/2713] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:13 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1396 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:15.283900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-757d3a32-c733-43f7-86ee-ee66aba38752 req-8da9b5bc-e30f-4e67-a3b4-f0748ee31fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623adb03-8bce-4cd5-a01c-b21495fcc870", "tag": "57d051c2-d615-47a8-a187-da3238f72760"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:15.321985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-757d3a32-c733-43f7-86ee-ee66aba38752 req-8da9b5bc-e30f-4e67-a3b4-f0748ee31fbb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:15.335912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-757d3a32-c733-43f7-86ee-ee66aba38752 req-8da9b5bc-e30f-4e67-a3b4-f0748ee31fbb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:15.336999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-757d3a32-c733-43f7-86ee-ee66aba38752 req-8da9b5bc-e30f-4e67-a3b4-f0748ee31fbb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:15.387357 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-757d3a32-c733-43f7-86ee-ee66aba38752 req-8da9b5bc-e30f-4e67-a3b4-f0748ee31fbb service nova] Creating event network-changed:57d051c2-d615-47a8-a187-da3238f72760 for instance 623adb03-8bce-4cd5-a01c-b21495fcc870 on n-h1-854441-12 Oct 17 15:33:15.405677 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-757d3a32-c733-43f7-86ee-ee66aba38752 req-8da9b5bc-e30f-4e67-a3b4-f0748ee31fbb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158679 Oct 17 15:33:15.407812 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1252/2714] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:15.425889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:15.439606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:15.462213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:15.463719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:15.464842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:15.466560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:15.467874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:15.470290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:16.649910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:16.689675 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-73088fec-dd22-4224-8210-1ee99cf9a491 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1318 microversion: 2.1 time: 1.275653 Oct 17 15:33:16.694280 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1253/2715] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:15 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1318 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:16.729562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-6bd4520e-f59f-4a29-ab01-87299f921f7f req-dc61ba4e-82e4-47f6-9757-0ad469742135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358b1061-ccb3-435d-81eb-ce398beb8a75", "name": "network-vif-plugged", "status": "completed", "tag": "8e472bc8-b3fe-44a5-a84e-d82528a12b96"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:16.761859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6bd4520e-f59f-4a29-ab01-87299f921f7f req-dc61ba4e-82e4-47f6-9757-0ad469742135 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:16.763342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6bd4520e-f59f-4a29-ab01-87299f921f7f req-dc61ba4e-82e4-47f6-9757-0ad469742135 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:16.766329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6bd4520e-f59f-4a29-ab01-87299f921f7f req-dc61ba4e-82e4-47f6-9757-0ad469742135 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:16.796922 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-6bd4520e-f59f-4a29-ab01-87299f921f7f req-dc61ba4e-82e4-47f6-9757-0ad469742135 service nova] Creating event network-vif-plugged:8e472bc8-b3fe-44a5-a84e-d82528a12b96 for instance 358b1061-ccb3-435d-81eb-ce398beb8a75 on n-h2-854441-12 Oct 17 15:33:16.808939 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-6bd4520e-f59f-4a29-ab01-87299f921f7f req-dc61ba4e-82e4-47f6-9757-0ad469742135 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110946 Oct 17 15:33:16.816822 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1254/2716] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:16.842979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:16.844559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:16.892131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:16.897101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:16.898655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:16.900456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:16.901701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:16.908094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:17.348783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:17.369074 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b08b7318-628b-447e-b70b-6640e8995f83 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 0.549847 Oct 17 15:33:17.370217 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1255/2717] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:16 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:17.387059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:17.388228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:17.403753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:17.405826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:17.408231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:17.409990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:17.410878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:17.412009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:17.626846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:17.639755 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-708a2094-cbc4-4858-9e70-d32e155f4982 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 0.261435 Oct 17 15:33:17.642883 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1256/2718] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:17 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:17.669689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:17.671297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:17.682173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:17.683010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:17.683691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:17.684669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:17.685355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:17.686965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:17.736477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:17.990913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:18.004777 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2ac2c27f-e1ec-4aef-9f46-26076eae44b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1396 microversion: 2.1 time: 0.339008 Oct 17 15:33:18.006354 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1257/2719] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:17 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1396 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:18.015499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:18.016629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:18.035658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:18.036091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:18.040437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:18.041599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:18.042130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:18.042646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:18.046663 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6c3e889-7ddf-421f-826f-aa1618d9c2fe tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610" status: 200 len: 1424 microversion: 2.1 time: 24.336334 Oct 17 15:33:18.048554 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1463/2720] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:32:53 2022] GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 => generated 1424 bytes in 24339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:18.270339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ad1a2377-f767-4275-8ba9-1540efc61b66 req-1ba09605-4844-4568-9d74-0dd5fb4da40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753b3d81-0147-4938-9bf0-5d96328f83b4", "tag": "dfcd3036-5d69-49cc-92bc-0f665bb60336"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:18.296121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad1a2377-f767-4275-8ba9-1540efc61b66 req-1ba09605-4844-4568-9d74-0dd5fb4da40b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:18.299729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad1a2377-f767-4275-8ba9-1540efc61b66 req-1ba09605-4844-4568-9d74-0dd5fb4da40b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:18.309638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad1a2377-f767-4275-8ba9-1540efc61b66 req-1ba09605-4844-4568-9d74-0dd5fb4da40b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:18.356060 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ad1a2377-f767-4275-8ba9-1540efc61b66 req-1ba09605-4844-4568-9d74-0dd5fb4da40b service nova] Creating event network-changed:dfcd3036-5d69-49cc-92bc-0f665bb60336 for instance 753b3d81-0147-4938-9bf0-5d96328f83b4 on n-h1-854441-12 Oct 17 15:33:18.374454 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ad1a2377-f767-4275-8ba9-1540efc61b66 req-1ba09605-4844-4568-9d74-0dd5fb4da40b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108018 Oct 17 15:33:18.376089 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1464/2721] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:18.402427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:18.404627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:18.415942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:18.416957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:18.418129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:18.434575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:18.436999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:18.437842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:18.539619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:18.552277 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d0df9843-3a18-44b3-93c9-4629ed35cb26 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1318 microversion: 2.1 time: 0.544521 Oct 17 15:33:18.554029 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1258/2722] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:18 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:18.666807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:18.668065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:18.686817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:18.701475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:18.703810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:18.708339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:18.711938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:18.713187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:19.718959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:19.730007 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e88ffebf-0af3-459b-80b6-7eadab577db7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 1.337606 Oct 17 15:33:19.730648 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1465/2723] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:18 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:19.755582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:19.756766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:19.770797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:19.771794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:19.774816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:19.776006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:19.776683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:19.778624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:20.328487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:20.337307 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b13f95df-b679-471c-89ef-54232b9f4c65 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1578 microversion: 2.1 time: 0.603778 Oct 17 15:33:20.340663 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1466/2724] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:19 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1578 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:20.356431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d847d1ec-fbb5-47a9-96d1-dfad370d3016 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28c2e0fe50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:20.780623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:20.792092 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-839b9dbd-7d79-4988-88a9-129408e8657a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 2.130677 Oct 17 15:33:20.800928 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1259/2725] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:18 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:20.807053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:20.810812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:20.845283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:20.851799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:20.854653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:20.862408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:20.863777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:20.866628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:21.343741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:21.362987 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d07d4605-dcc8-46d9-90ce-a6a8c589ef1e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1318 microversion: 2.1 time: 0.560392 Oct 17 15:33:21.377812 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1260/2726] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:20 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:21.384803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fb73bf53-7f8b-41ad-bf15-2fef2544ee38 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:21.384803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fb73bf53-7f8b-41ad-bf15-2fef2544ee38 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:21.402809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb73bf53-7f8b-41ad-bf15-2fef2544ee38 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:21.403483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb73bf53-7f8b-41ad-bf15-2fef2544ee38 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:21.404020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb73bf53-7f8b-41ad-bf15-2fef2544ee38 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:21.404859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb73bf53-7f8b-41ad-bf15-2fef2544ee38 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:21.405429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb73bf53-7f8b-41ad-bf15-2fef2544ee38 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:21.405978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb73bf53-7f8b-41ad-bf15-2fef2544ee38 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:21.746202 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fb73bf53-7f8b-41ad-bf15-2fef2544ee38 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.377444 Oct 17 15:33:21.746874 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1261/2727] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:33:21 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75/os-interface => generated 285 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:21.763529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:21.764149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:21.774809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:21.775887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:21.776345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:21.777092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:21.777639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:21.778350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:23.018079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:23.021888 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d847d1ec-fbb5-47a9-96d1-dfad370d3016 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610" status: 200 len: 1433 microversion: 2.1 time: 2.671198 Oct 17 15:33:23.038023 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1467/2728] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:20 2022] GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 => generated 1433 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:23.047883 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2285cd76-b7b2-4d9c-9af8-3b8239a12266 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 1.299455 Oct 17 15:33:23.048520 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1262/2729] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:21 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:23.062854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-88a0279d-adc6-4ec8-b4fc-280cd6240ed9 req-3f1bef4f-14fb-4779-938e-2d6deefd3a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8eba4c-6082-4902-8f19-8d43b764b5d9", "name": "network-vif-unplugged", "status": "completed", "tag": "805607b3-b87b-4c13-bd12-0be56f094425"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:23.069914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:23.074156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:23.097795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-88a0279d-adc6-4ec8-b4fc-280cd6240ed9 req-3f1bef4f-14fb-4779-938e-2d6deefd3a4e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:23.100196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-88a0279d-adc6-4ec8-b4fc-280cd6240ed9 req-3f1bef4f-14fb-4779-938e-2d6deefd3a4e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:23.100600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:23.101417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:23.102146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-88a0279d-adc6-4ec8-b4fc-280cd6240ed9 req-3f1bef4f-14fb-4779-938e-2d6deefd3a4e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:23.106198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:23.108672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:23.113986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:23.115353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:23.149267 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-88a0279d-adc6-4ec8-b4fc-280cd6240ed9 req-3f1bef4f-14fb-4779-938e-2d6deefd3a4e service nova] Creating event network-vif-unplugged:805607b3-b87b-4c13-bd12-0be56f094425 for instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 on n-h1-854441-12 Oct 17 15:33:23.158055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-88a0279d-adc6-4ec8-b4fc-280cd6240ed9 req-3f1bef4f-14fb-4779-938e-2d6deefd3a4e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115522 Oct 17 15:33:23.159103 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1468/2730] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:23.176719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:23.178394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:23.193775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:23.196367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:23.197226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:23.203790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:23.204677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:23.205613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:23.470040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:23.504870 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-218e6396-eceb-4c81-9d09-29faa7788276 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 0.450436 Oct 17 15:33:23.510881 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1263/2731] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:23 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:23.515999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a7167c0-5e38-44ec-88ba-cc9ec4778d00 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28c2e24430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:23.688087 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a7167c0-5e38-44ec-88ba-cc9ec4778d00 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610" status: 200 len: 1433 microversion: 2.1 time: 0.175938 Oct 17 15:33:23.688706 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1264/2732] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:23 2022] GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 => generated 1433 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:23.703496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:23.704193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:23.718945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:23.718945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:23.720617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:23.721451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:23.721931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:23.722368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:23.789118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:23.801240 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ba3aeed-bf66-4a0e-9f42-0e4d6f8f28dd tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1318 microversion: 2.1 time: 0.640235 Oct 17 15:33:23.819064 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1469/2733] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:23 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:24.090173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:24.090870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:24.106208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:24.106756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:24.107208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:24.108005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:24.108520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:24.109062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:24.478812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:24.517105 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-16893de8-ad53-4e82-9f3f-ee0d08cf3f01 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1465 microversion: 2.1 time: 0.815872 Oct 17 15:33:24.521263 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1265/2734] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:23 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1465 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:33:24.549789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:24.551500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:24.576357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:24.613076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:24.614408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:24.616470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:24.620184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:24.621372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:24.691292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:24.724221 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a167d88a-ab45-4589-aebf-0a1d1f7bcaf6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 0.634142 Oct 17 15:33:24.728404 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1470/2735] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:24 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:24.762117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6c7cb28-3d24-44de-a2ae-96df8fb6b9e5 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be407280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:24.946988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6c7cb28-3d24-44de-a2ae-96df8fb6b9e5 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/c489ef08-d3af-4c49-859b-7a55ed37ba8d" status: 200 len: 784 microversion: 2.1 time: 0.216357 Oct 17 15:33:24.949686 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1471/2736] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:24 2022] GET /compute/v2.1/images/c489ef08-d3af-4c49-859b-7a55ed37ba8d => generated 784 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:24.963978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:24.968826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:24.996905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:24.999443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:25.000542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:25.002072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:25.003288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:25.004310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:25.319243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:25.346380 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e97e4306-857c-404a-8760-6881813e7b81 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 0.812889 Oct 17 15:33:25.363406 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1266/2737] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:24 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:25.377043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b24886fa-b20f-4611-98c2-744625f14ea3 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:25.401859 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b24886fa-b20f-4611-98c2-744625f14ea3 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030511 Oct 17 15:33:25.403777 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1267/2738] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:33:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:25.416009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e7b0a82f-e265-4160-9996-f2081f0ef992 req-600feae4-4157-447d-9569-5f81bc765802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753b3d81-0147-4938-9bf0-5d96328f83b4", "name": "network-vif-plugged", "status": "completed", "tag": "dfcd3036-5d69-49cc-92bc-0f665bb60336"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:25.442207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e7b0a82f-e265-4160-9996-f2081f0ef992 req-600feae4-4157-447d-9569-5f81bc765802 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:25.444993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e7b0a82f-e265-4160-9996-f2081f0ef992 req-600feae4-4157-447d-9569-5f81bc765802 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:25.448113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e7b0a82f-e265-4160-9996-f2081f0ef992 req-600feae4-4157-447d-9569-5f81bc765802 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:25.488284 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e7b0a82f-e265-4160-9996-f2081f0ef992 req-600feae4-4157-447d-9569-5f81bc765802 service nova] Creating event network-vif-plugged:dfcd3036-5d69-49cc-92bc-0f665bb60336 for instance 753b3d81-0147-4938-9bf0-5d96328f83b4 on n-h1-854441-12 Oct 17 15:33:25.510223 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e7b0a82f-e265-4160-9996-f2081f0ef992 req-600feae4-4157-447d-9569-5f81bc765802 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104056 Oct 17 15:33:25.512161 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1268/2739] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:25.548429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0d204ba3-ae04-4d87-80e3-d4cd746a64cd tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28c2e06f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:25.884185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:25.896636 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1287983c-b9e8-4f0d-935c-3694721ab1d1 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1318 microversion: 2.1 time: 0.944841 Oct 17 15:33:25.914532 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1472/2740] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:24 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1318 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:25.922927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:25.925993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:25.957456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:25.962349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:25.963924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:25.967395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:25.969300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:25.972365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:26.935735 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0d204ba3-ae04-4d87-80e3-d4cd746a64cd tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "DELETE /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610" status: 204 len: 0 microversion: 2.1 time: 1.418916 Oct 17 15:33:26.943658 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1269/2741] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:25 2022] DELETE /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 => generated 0 bytes in 1427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:33:26.959361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:26.961794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:26.993957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:26.995080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:26.998849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:27.000289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:27.007447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:27.007909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:27.072093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:27.097566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c23a0fbc-fba5-4f56-9b47-e8953028d6e8 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 1.184377 Oct 17 15:33:27.105271 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1473/2742] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:25 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:27.128847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:27.134472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:27.161983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:27.162525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:27.163023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:27.174384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:27.177337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:27.183977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:27.760339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:27.798411 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d000c905-926f-406a-9dbd-e1253d4ac5e6 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1318 microversion: 2.1 time: 0.691265 Oct 17 15:33:27.799012 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1474/2743] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:27 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:27.825802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:27.835128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73824b41-9528-4820-a748-80b6e21fefa9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be360310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:27.841626 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9ffae455-23a3-4668-b1fe-adb682d0f33a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 0.896402 Oct 17 15:33:27.844853 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1270/2744] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:26 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:27.883041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:27.887332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:27.925011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:27.927529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:27.930966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:27.938191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:27.941809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:27.946097 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-73824b41-9528-4820-a748-80b6e21fefa9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] HTTP exception thrown: Image not found. Oct 17 15:33:27.946388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73824b41-9528-4820-a748-80b6e21fefa9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Request method failure captured: Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 HTTP/1.1 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXV61Io3WeqDew-RxiVHQZde5UuLsfqEfgmx3bBhwShz0s8_jtXjh5rIvGznvk6C8GbAh5Hyb3O8TyX-VZKzFojgPd-d2_WwMhNV6uA8rcAd9bYRbeKXkzmCVr30mLTwfN6FobA7Wzsqhv1-8ew0EKDXIG-5lo4Yytu5znKxK4tlBBY Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8c2f4600658d49738f4e00f44b2cd1d3 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerTestJSON-1448854289 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerTestJSON-1448854289 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8c2f4600658d49738f4e00f44b2cd1d3 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1448854289 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerTestJSON-1448854289-project Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a371ebfdf0034f3f890044609df5da40 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerTestJSON-1448854289-project Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: exception: Image not found. Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'c74d72f6-f9d1-4f99-9ee0-a55dd0553610'} Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c74d72f6-f9d1-4f99-9ee0-a55dd0553610 Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 15:33:27.950655 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c74d72f6-f9d1-4f99-9ee0-a55dd0553610 could not be found. Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73824b41-9528-4820-a748-80b6e21fefa9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:33:27.958319 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73824b41-9528-4820-a748-80b6e21fefa9 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610" status: 404 len: 62 microversion: 2.1 time: 0.147871 Oct 17 15:33:27.965696 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1475/2745] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:27 2022] GET /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 => generated 62 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:33:27.985310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7fe8866c-79a0-4136-a530-53d5a07305c8 req-3a3706b3-ffe2-4bb9-a748-ae59abc24821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358b1061-ccb3-435d-81eb-ce398beb8a75", "tag": "8e472bc8-b3fe-44a5-a84e-d82528a12b96"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:28.014414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7fe8866c-79a0-4136-a530-53d5a07305c8 req-3a3706b3-ffe2-4bb9-a748-ae59abc24821 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:28.015402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7fe8866c-79a0-4136-a530-53d5a07305c8 req-3a3706b3-ffe2-4bb9-a748-ae59abc24821 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:28.016287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7fe8866c-79a0-4136-a530-53d5a07305c8 req-3a3706b3-ffe2-4bb9-a748-ae59abc24821 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:28.070653 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7fe8866c-79a0-4136-a530-53d5a07305c8 req-3a3706b3-ffe2-4bb9-a748-ae59abc24821 service nova] Creating event network-changed:8e472bc8-b3fe-44a5-a84e-d82528a12b96 for instance 358b1061-ccb3-435d-81eb-ce398beb8a75 on n-h2-854441-12 Oct 17 15:33:28.102288 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7fe8866c-79a0-4136-a530-53d5a07305c8 req-3a3706b3-ffe2-4bb9-a748-ae59abc24821 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136413 Oct 17 15:33:28.103485 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1476/2746] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:28.175258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83e732af-4f15-41bb-9362-9961709fcb9c tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1719058850"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:28.179915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83e732af-4f15-41bb-9362-9961709fcb9c tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:28.194702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e732af-4f15-41bb-9362-9961709fcb9c tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:28.196352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e732af-4f15-41bb-9362-9961709fcb9c tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:28.197393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e732af-4f15-41bb-9362-9961709fcb9c tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:28.200062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e732af-4f15-41bb-9362-9961709fcb9c tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:28.201256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e732af-4f15-41bb-9362-9961709fcb9c tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:28.202278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83e732af-4f15-41bb-9362-9961709fcb9c tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:29.010833 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83e732af-4f15-41bb-9362-9961709fcb9c tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "POST /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.859806 Oct 17 15:33:29.015904 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1477/2747] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:33:28 2022] POST /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9/action => generated 0 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:33:29.060478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:29.062271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:29.106904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:29.117818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:29.122439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:29.123911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:29.136409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:29.138046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:29.657984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:29.710308 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef896d85-8bc5-48ff-867e-b10c0e0cccb2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 0.689737 Oct 17 15:33:29.730674 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1478/2748] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:29 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:30.214905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:30.219436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-427750074", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:30.248423 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c13fa789-ebeb-4ebc-83e2-6b167fbbda2f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1578 microversion: 2.1 time: 2.401726 Oct 17 15:33:30.253983 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1271/2749] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:27 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1578 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:30.273898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:30.279083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:30.317563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:30.327713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:30.331150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:30.333739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:30.334863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:30.335794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:30.425773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] validate_networks() for [('aeb48324-2e34-47ca-a64a-f14801e654f3', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:33:31.675373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:33:31.677408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:33:31.678574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:33:31.680927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:33:31.682116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:33:31.702492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:31.703923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:31.705207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:31.707318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:31.708574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:31.709994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:31.759969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Getting quotas for project 66fbb247e57942cf8c6e76c9c6a2f499. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:33:31.778986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Getting quotas for user d72b67f070cb43f69c568a3d38f02463 and project 66fbb247e57942cf8c6e76c9c6a2f499. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:33:31.845113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:33:31.854159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:33:31.948597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:31.999664 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95b66c0b-2d09-417d-9ac3-93c734d0041e tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1467 microversion: 2.1 time: 1.739223 Oct 17 15:33:32.010833 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1272/2750] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:30 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1467 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:32.046380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:32.049304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:32.080268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:32.097201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:32.098634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:32.100302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:32.104624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:32.105938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:32.165459 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9cf64d98-7cc5-4a65-acd8-8d3f60c06815 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.431959 Oct 17 15:33:32.175249 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1479/2751] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:33:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:33:32.186969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7bc13bc7-9e10-4b2c-9e0a-094a9dbb1650 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be3d75e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:32.305608 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7bc13bc7-9e10-4b2c-9e0a-094a9dbb1650 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.127066 Oct 17 15:33:32.307148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1480/2752] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:32 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:32.317904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:32.318973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:32.332193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:32.333009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:32.333750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:32.335033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:32.336032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:32.336768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:32.773253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:32.798360 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-de281032-132b-4694-a13d-53283fb9ddad tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 0.784426 Oct 17 15:33:32.810690 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1273/2753] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:32 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:32.825706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:32.831561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:32.832484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:32.847887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:32.848397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:32.852894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:32.853707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:32.854204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:32.854694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:32.862249 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d990191f-06a0-4f80-80f2-536f6feac623 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 0.548729 Oct 17 15:33:32.865363 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1481/2754] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:32 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:32.881141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:32.885422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:32.915549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:32.917013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:32.918019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:32.919661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:32.922002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:32.923874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:33.008901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lazy-loading 'flavor' on Instance uuid 753b3d81-0147-4938-9bf0-5d96328f83b4 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:33:33.274632 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-273ccab5-95e4-4813-a24a-dbab21f7bb80 tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4/action" status: 202 len: 0 microversion: 2.1 time: 0.406663 Oct 17 15:33:33.276482 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1482/2755] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:33:32 2022] POST /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:33:33.334447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34916fae-f691-494f-b51f-04b6514fa02c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:33.349172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34916fae-f691-494f-b51f-04b6514fa02c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:33.393093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:33.433187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:33.446078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:33.448750 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff7e5ee0-d65b-4e4a-bc34-4446355fce1c tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2952 microversion: 2.32 time: 0.636210 Oct 17 15:33:33.450411 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1274/2756] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:33:32 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2952 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:33:33.484536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:33.486165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:33.526008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:33.527695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:33.528818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:33.538129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:33.541038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:33.547820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:33.595007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34916fae-f691-494f-b51f-04b6514fa02c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:33.608423 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34916fae-f691-494f-b51f-04b6514fa02c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1213 microversion: 2.1 time: 0.330449 Oct 17 15:33:33.610035 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1483/2757] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:33 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1213 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:33.620883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-529d38fd-745c-4c56-86db-65515b940b31 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be414940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:33.799429 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-529d38fd-745c-4c56-86db-65515b940b31 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.186351 Oct 17 15:33:33.804865 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1484/2758] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:33 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:33.824003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-075d9394-bb00-497d-b177-9273cfd1a55e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:33.826092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-075d9394-bb00-497d-b177-9273cfd1a55e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:33.860298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-075d9394-bb00-497d-b177-9273cfd1a55e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:33.862791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-075d9394-bb00-497d-b177-9273cfd1a55e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:33.865278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-075d9394-bb00-497d-b177-9273cfd1a55e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:33.870302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-075d9394-bb00-497d-b177-9273cfd1a55e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:33.873813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-075d9394-bb00-497d-b177-9273cfd1a55e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:33.877737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-075d9394-bb00-497d-b177-9273cfd1a55e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:34.215057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:34.227077 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3eb01a82-a069-4e4b-91d6-31c6952ddd47 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1475 microversion: 2.1 time: 0.769972 Oct 17 15:33:34.236168 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1275/2759] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:33 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1475 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:34.254990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:34.259155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:34.287950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:34.289324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:34.290420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:34.292050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:34.293507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:34.297561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:34.472720 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-075d9394-bb00-497d-b177-9273cfd1a55e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.665569 Oct 17 15:33:34.490816 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1485/2760] 10.222.0.87 () {60 vars in 1316 bytes} [Mon Oct 17 15:33:33 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68/os-interface => generated 1832 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:33:34.490816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:34.490816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:34.524571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:34.525329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:34.527841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:34.538267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:34.546526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:34.558717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:34.681371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:34.917901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:34.942642 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bff599ee-ebf0-4d05-956d-44904ba32bb2 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 0.698085 Oct 17 15:33:34.951205 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1276/2761] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:34 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:34.983479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:34.985151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:35.012627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:35.013479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:35.014261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:35.020725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:35.025913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:35.029919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:35.102286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:35.113348 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a797c202-825d-40b0-9fca-5c15c5e86883 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 0.638752 Oct 17 15:33:35.115444 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1486/2762] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:34 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:35.121176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d594810f-68ba-4fea-89ce-7a119d81d7d4 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be3df160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:35.291374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:35.350559 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7fd0daa4-31b9-4c1d-a128-4c6420e7663d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1265 microversion: 2.1 time: 0.397593 Oct 17 15:33:35.355038 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1277/2763] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:34 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:35.372952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:35.379968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:35.417746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:35.418430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:35.419673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:35.420635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:35.421598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:35.422466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:35.445164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:36.011323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:36.063441 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7d1098aa-faff-400c-8401-fa9d65eb16da tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1458 microversion: 2.1 time: 0.699821 Oct 17 15:33:36.076046 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1278/2764] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:35 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1458 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:36.086330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:36.087754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:36.100761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:36.101718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:36.102332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:36.103297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:36.104080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:36.104690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:37.582743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:37.617392 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8acac4c-73fb-4e6c-af06-2516a351caf6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 1.539722 Oct 17 15:33:37.621944 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1279/2765] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:36 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:37.649971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a6e9aee-f836-416c-ab89-d60f197bb8cd tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:37.651067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a6e9aee-f836-416c-ab89-d60f197bb8cd tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:37.699127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6e9aee-f836-416c-ab89-d60f197bb8cd tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:37.700632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6e9aee-f836-416c-ab89-d60f197bb8cd tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:37.701683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6e9aee-f836-416c-ab89-d60f197bb8cd tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:37.705108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6e9aee-f836-416c-ab89-d60f197bb8cd tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:37.705929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6e9aee-f836-416c-ab89-d60f197bb8cd tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:37.706717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6e9aee-f836-416c-ab89-d60f197bb8cd tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:38.551558 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a6e9aee-f836-416c-ab89-d60f197bb8cd tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1611 microversion: 2.1 time: 0.921602 Oct 17 15:33:38.568367 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1280/2766] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:37 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1611 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:38.584290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:38.588034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:38.607784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:38.608598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:38.609204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:38.610168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:38.612203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:38.613105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:39.341391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:39.353617 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f8441050-89f6-458a-9876-d0289380a292 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 0.783513 Oct 17 15:33:39.369969 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1281/2767] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:38 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:39.390701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:39.391344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:39.417331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=68 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:39.427826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:39.428368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:39.428907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:39.434461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:39.436730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:39.437324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:40.354280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:40.369357 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a285e71b-260a-4109-a963-220366d29169 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1313 microversion: 2.1 time: 0.997979 Oct 17 15:33:40.371383 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1282/2768] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:39 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1313 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:40.385171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e82ef390-4d00-4bcf-8d8f-d78330c91b83 req-4b9d62ae-24cc-4f00-b149-c42edb81efee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623adb03-8bce-4cd5-a01c-b21495fcc870", "name": "network-vif-plugged", "status": "completed", "tag": "57d051c2-d615-47a8-a187-da3238f72760"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:40.421149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e82ef390-4d00-4bcf-8d8f-d78330c91b83 req-4b9d62ae-24cc-4f00-b149-c42edb81efee service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:40.422637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e82ef390-4d00-4bcf-8d8f-d78330c91b83 req-4b9d62ae-24cc-4f00-b149-c42edb81efee service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:40.423368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e82ef390-4d00-4bcf-8d8f-d78330c91b83 req-4b9d62ae-24cc-4f00-b149-c42edb81efee service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:40.454996 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e82ef390-4d00-4bcf-8d8f-d78330c91b83 req-4b9d62ae-24cc-4f00-b149-c42edb81efee service nova] Creating event network-vif-plugged:57d051c2-d615-47a8-a187-da3238f72760 for instance 623adb03-8bce-4cd5-a01c-b21495fcc870 on n-h1-854441-12 Oct 17 15:33:40.476214 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e82ef390-4d00-4bcf-8d8f-d78330c91b83 req-4b9d62ae-24cc-4f00-b149-c42edb81efee service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095594 Oct 17 15:33:40.481617 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1283/2769] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:40.500448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff3c66c5-338a-4e1c-94e8-7b1e7875566c tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:40.522922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff3c66c5-338a-4e1c-94e8-7b1e7875566c tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:40.524751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff3c66c5-338a-4e1c-94e8-7b1e7875566c tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:40.526791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff3c66c5-338a-4e1c-94e8-7b1e7875566c tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:40.529592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff3c66c5-338a-4e1c-94e8-7b1e7875566c tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:40.531912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff3c66c5-338a-4e1c-94e8-7b1e7875566c tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:40.535617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff3c66c5-338a-4e1c-94e8-7b1e7875566c tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:40.664929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff3c66c5-338a-4e1c-94e8-7b1e7875566c tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.175990 Oct 17 15:33:40.675399 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1284/2770] 10.222.0.87 () {58 vars in 1176 bytes} [Mon Oct 17 15:33:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:40.690558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:40.693991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:40.712452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:40.714886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:40.715626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:40.718052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:40.720415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:40.720853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:41.443075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:41.461961 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1b4a94aa-70cf-4232-9652-40ea513f61d9 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1369 microversion: 2.1 time: 0.780899 Oct 17 15:33:41.475592 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1285/2771] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:40 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1369 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:41.488719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1682234748", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "367a2d39-b572-49e0-b719-9b2cdd9cfe38"}], "block_device_mapping_v2": [{"uuid": "5d0b8e1d-28be-468f-a291-b4f0ee777f95", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:41.584232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] validate_networks() for [('367a2d39-b572-49e0-b719-9b2cdd9cfe38', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:33:41.732514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:43.226887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:33:43.228779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:33:43.230152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:33:43.233989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:33:43.239299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:33:43.266474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:43.268745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:43.269822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:43.271653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:43.273020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:43.274073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:43.336600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:33:43.357512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Getting quotas for user 54134ad155cf45d19f6a551710c84a9e and project 02edcfcf47504f30a7d6770b945a1cf7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:33:43.474275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:33:43.489082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d0b8e1d-28be-468f-a291-b4f0ee777f95',volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:33:43.601551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:43.960656 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e607ddad-9a9d-463c-b4b0-80826e26dbf4 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.464140 Oct 17 15:33:43.967946 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1286/2772] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:33:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:33:43.981819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:43.982701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:43.998006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:43.999024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:44.003306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:44.004451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:44.006360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:44.007104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:44.316378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:44.338458 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b9d75a69-cad2-4c2e-af5b-0c16c2f94d84 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 0.362142 Oct 17 15:33:44.355203 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1287/2773] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:43 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:44.382871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854441-12", "block_migration": true, "disk_over_commit": false}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:44.388514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:44.403492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:44.404498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:44.405251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:44.406491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:44.407369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:44.408136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:44.499031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:44.563620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Lazy-loading 'flavor' on Instance uuid 753b3d81-0147-4938-9bf0-5d96328f83b4 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:33:44.622838 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 753b3d81-0147-4938-9bf0-5d96328f83b4 while it is in vm_state suspended Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Request method failure captured: Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4/action HTTP/1.1 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 98 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXV8xb3eiYZea1lbUumaLmNTORs_3rALgHDmAM-6enu1U5XxGtHDUArmNWDfZAStpocuLTLYHKrEb3QQHzCqeRng4UMlW6wQllqUNMsOSYQ519VpHmFpcRkIfkTzU8iPpwD60QBlxV6X5Jm4au-CEgZl4nl403mXDoo_TUKkZwKuZ3o Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 06539bb41c294c638d480195ac082c89 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-LiveMigrationNegativeTest-1592144498 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06539bb41c294c638d480195ac082c89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/06539bb41c294c638d480195ac082c89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_06539bb41c294c638d480195ac082c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/06539bb41c294c638d480195ac082c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-LiveMigrationNegativeTest-1592144498 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 06539bb41c294c638d480195ac082c89 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1592144498 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-LiveMigrationNegativeTest-1592144498-project-admin Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 3696b8405e8b4ca8a306727eaf757014 Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-LiveMigrationNegativeTest-1592144498-project-admin Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: {"os-migrateLive": {"host": "n-h2-854441-12", "block_migration": true, "disk_over_commit": false}} Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: exception: Cannot 'os-migrateLive' instance 753b3d81-0147-4938-9bf0-5d96328f83b4 while it is in vm_state suspended Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '753b3d81-0147-4938-9bf0-5d96328f83b4', 'body': {'os-migrateLive': {'host': 'n-h2-854441-12', 'block_migration': True, 'disk_over_commit': False}}} Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 753b3d81-0147-4938-9bf0-5d96328f83b4 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:44.636474 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 753b3d81-0147-4938-9bf0-5d96328f83b4 while it is in vm_state suspended Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 753b3d81-0147-4938-9bf0-5d96328f83b4 while it is in vm_state suspended Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 753b3d81-0147-4938-9bf0-5d96328f83b4 while it is in vm_state suspended {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b06472db-3187-45bd-b61b-99e2ef92328a tempest-LiveMigrationNegativeTest-1592144498 tempest-LiveMigrationNegativeTest-1592144498-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4/action" status: 409 len: 155 microversion: 2.1 time: 0.288792 Oct 17 15:33:44.662006 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1288/2774] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:33:44 2022] POST /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4/action => generated 155 bytes in 291 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:33:44.670060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:44.675055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:44.693384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:44.699174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:44.702754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:44.708147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:44.709037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:44.709869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:45.093834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:45.104918 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f79b789-080e-4c5b-bf7e-466b4409b254 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1313 microversion: 2.1 time: 0.456120 Oct 17 15:33:45.112941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:45.118723 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1289/2775] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:44 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:45.127530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d090d0b0-7757-485b-8b8d-e011397b4453 req-e83605c2-bb1a-4b77-b878-07204cfaa9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faca81c2-979f-4b9e-bc24-0ef9e7a9b418", "tag": "925d597a-79ef-4b38-82c8-f8a52dcabf95"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:45.207185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d090d0b0-7757-485b-8b8d-e011397b4453 req-e83605c2-bb1a-4b77-b878-07204cfaa9a7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:45.209033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d090d0b0-7757-485b-8b8d-e011397b4453 req-e83605c2-bb1a-4b77-b878-07204cfaa9a7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:45.210236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d090d0b0-7757-485b-8b8d-e011397b4453 req-e83605c2-bb1a-4b77-b878-07204cfaa9a7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:45.262964 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d090d0b0-7757-485b-8b8d-e011397b4453 req-e83605c2-bb1a-4b77-b878-07204cfaa9a7 service nova] Creating event network-changed:925d597a-79ef-4b38-82c8-f8a52dcabf95 for instance faca81c2-979f-4b9e-bc24-0ef9e7a9b418 on n-h2-854441-12 Oct 17 15:33:45.274455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d090d0b0-7757-485b-8b8d-e011397b4453 req-e83605c2-bb1a-4b77-b878-07204cfaa9a7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152890 Oct 17 15:33:45.276036 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1290/2776] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:45.288471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:45.289883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:45.306617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:45.308048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:45.308775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:45.309970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:45.310767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:45.311575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:45.692114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:45.723111 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-63f1a28d-bb65-429d-a312-2b40f82b52c6 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1556 microversion: 2.1 time: 0.443724 Oct 17 15:33:45.724472 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1291/2777] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:45 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1556 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:45.727173 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d594810f-68ba-4fea-89ce-7a119d81d7d4 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 10.602521 Oct 17 15:33:45.728709 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1487/2778] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:35 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 10612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:45.733353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8514835b-5232-45d8-b8ff-b1cedd209b0d req-bcb2e5a6-7033-4b1a-ae3d-a3986f1b144a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8eba4c-6082-4902-8f19-8d43b764b5d9", "name": "network-vif-plugged", "status": "completed", "tag": "805607b3-b87b-4c13-bd12-0be56f094425"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:45.737809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:45.747099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:45.772728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8514835b-5232-45d8-b8ff-b1cedd209b0d req-bcb2e5a6-7033-4b1a-ae3d-a3986f1b144a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:45.774020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8514835b-5232-45d8-b8ff-b1cedd209b0d req-bcb2e5a6-7033-4b1a-ae3d-a3986f1b144a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:45.774210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:45.775563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:45.777749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:45.778637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8514835b-5232-45d8-b8ff-b1cedd209b0d req-bcb2e5a6-7033-4b1a-ae3d-a3986f1b144a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:45.780296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:45.781347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:45.782465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:45.858638 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8514835b-5232-45d8-b8ff-b1cedd209b0d req-bcb2e5a6-7033-4b1a-ae3d-a3986f1b144a service nova] Creating event network-vif-plugged:805607b3-b87b-4c13-bd12-0be56f094425 for instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 on n-h1-854441-12 Oct 17 15:33:45.884375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8514835b-5232-45d8-b8ff-b1cedd209b0d req-bcb2e5a6-7033-4b1a-ae3d-a3986f1b144a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150840 Oct 17 15:33:45.885661 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1292/2779] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:45.896530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:45.909247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:45.933165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:45.939584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:45.941081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:45.945823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:45.947930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:45.956034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:46.016452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:46.045092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:33:46.055385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:46.060991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:46.063274 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2199e50-531e-453c-b188-50e0aca114d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1233 microversion: 2.25 time: 0.332817 Oct 17 15:33:46.067612 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1488/2780] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:33:45 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1233 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:33:46.076549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:46.078267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:46.091102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:46.092493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:46.093625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:46.095595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:46.096739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:46.100167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:46.363593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5e93e45-aab5-4d93-8c95-e6fcc22775de tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "DELETE /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 204 len: 0 microversion: 2.1 time: 0.470952 Oct 17 15:33:46.364417 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1293/2781] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:33:45 2022] DELETE /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:33:46.382309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aec56de2-ebdc-4dd8-a08d-66c4f3be2d2c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:46.382975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aec56de2-ebdc-4dd8-a08d-66c4f3be2d2c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:46.400836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aec56de2-ebdc-4dd8-a08d-66c4f3be2d2c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:46.401390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aec56de2-ebdc-4dd8-a08d-66c4f3be2d2c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:46.401862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aec56de2-ebdc-4dd8-a08d-66c4f3be2d2c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:46.402758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aec56de2-ebdc-4dd8-a08d-66c4f3be2d2c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:46.403115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aec56de2-ebdc-4dd8-a08d-66c4f3be2d2c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:46.403561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aec56de2-ebdc-4dd8-a08d-66c4f3be2d2c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:46.536156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:46.556788 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe8f156b-a0cf-456e-a4bc-514c1df000a6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1525 microversion: 2.1 time: 0.486954 Oct 17 15:33:46.563070 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1489/2782] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:46 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1525 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:46.568714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:46.569824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:46.579729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:46.580868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:46.581548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:46.582533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:46.583363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:46.583984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:46.640578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aec56de2-ebdc-4dd8-a08d-66c4f3be2d2c tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.273594 Oct 17 15:33:46.643494 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1294/2783] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:33:46 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-interface => generated 285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:46.657285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:46.665360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:46.688883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:46.691566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:46.692019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:46.692999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:46.695092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:46.695744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:46.995387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:47.006294 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6c99c1d9-4d6a-4469-9037-b9f4f389257b tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1464 microversion: 2.1 time: 0.360664 Oct 17 15:33:47.019300 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1295/2784] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:46 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:47.029653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d5fdef11-eb67-4f27-8d72-31012b81bcee tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28c2e1b280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:47.085517 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d5fdef11-eb67-4f27-8d72-31012b81bcee tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.064809 Oct 17 15:33:47.086634 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1296/2785] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:47 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:47.107391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:47.108039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:47.115952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:47.116472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:47.116943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:47.117716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:47.118197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:47.122586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:47.194673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:47.197432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:47.209704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:47.212896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:47.214660 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c5111d0-a219-47fc-9f7f-1a6d4aad78c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1233 microversion: 2.25 time: 0.111982 Oct 17 15:33:47.230572 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1297/2786] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:33:47 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1233 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:33:47.232894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:47.265888 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d55f42a-d88e-47e9-b502-17b820b11b05 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1313 microversion: 2.1 time: 0.700651 Oct 17 15:33:47.267984 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1490/2787] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:46 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:47.614176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:47.617664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:47.634093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:47.635083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:47.635865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:47.637323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:47.638195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:47.639864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:48.040059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:48.046968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:48.100213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:48.103598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:48.105264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:48.108715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:48.117453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:48.118954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:48.120909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:48.145970 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d9ffabfa-3940-4f71-bcc1-2a7469454ac5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1507 microversion: 2.1 time: 0.538197 Oct 17 15:33:48.150275 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1298/2788] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:47 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1507 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:33:48.173939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-32c7e367-9690-4d0e-896e-ce88878edcdb tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28bf485dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:48.380406 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-32c7e367-9690-4d0e-896e-ce88878edcdb tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.226995 Oct 17 15:33:48.394924 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1299/2789] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:48 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:48.412199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:48.417359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:48.432192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:48.432782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:48.438581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:48.439594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:48.440146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:48.440622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:48.740028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:48.770716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:48.785338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:48.793954 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3cac1663-69ce-4942-b42b-6ca8d44aff0c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1251 microversion: 2.25 time: 0.394901 Oct 17 15:33:48.795923 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1300/2790] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:33:48 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1251 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:33:48.810257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:48.824915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:48.840205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:48.846025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:48.847451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:48.850318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:48.851929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:48.853080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:49.200343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:49.231766 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9acb7688-c454-4439-84f1-f96ad57ce015 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1464 microversion: 2.1 time: 1.200417 Oct 17 15:33:49.239799 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1491/2791] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:48 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1464 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:49.249422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0d3374b7-421b-4b5f-ba30-df8017d0f045 req-b8c17ab8-b9de-49ea-adc4-01e84f1ff188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf163cb1-81b4-4969-a6d2-5caa98ae4525", "name": "network-vif-unplugged", "status": "completed", "tag": "c958c84d-2595-4536-aeb2-e83c146fdb74"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:49.301661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0d3374b7-421b-4b5f-ba30-df8017d0f045 req-b8c17ab8-b9de-49ea-adc4-01e84f1ff188 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:49.308695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0d3374b7-421b-4b5f-ba30-df8017d0f045 req-b8c17ab8-b9de-49ea-adc4-01e84f1ff188 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:49.310595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0d3374b7-421b-4b5f-ba30-df8017d0f045 req-b8c17ab8-b9de-49ea-adc4-01e84f1ff188 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:49.355435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:49.382918 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1e4a7539-576c-4e61-8074-be55676b9ca0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1313 microversion: 2.1 time: 0.584769 Oct 17 15:33:49.406556 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1301/2792] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:48 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:49.406879 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0d3374b7-421b-4b5f-ba30-df8017d0f045 req-b8c17ab8-b9de-49ea-adc4-01e84f1ff188 service nova] Creating event network-vif-unplugged:c958c84d-2595-4536-aeb2-e83c146fdb74 for instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 on n-h2-854441-12 Oct 17 15:33:49.412484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:49.417877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:49.418532 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0d3374b7-421b-4b5f-ba30-df8017d0f045 req-b8c17ab8-b9de-49ea-adc4-01e84f1ff188 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172890 Oct 17 15:33:49.423351 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1492/2793] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:49.442651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:49.446339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:49.448943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:49.450768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:49.452025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:49.453108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:49.455856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3508e233-dddb-4655-a58e-d3b9135e2779 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be3541f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:49.656958 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3508e233-dddb-4655-a58e-d3b9135e2779 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.230103 Oct 17 15:33:49.672995 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1493/2794] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:49 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:49.827680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:49.833465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:49.858891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:49.860199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:49.871761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:49.873652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:49.874933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:49.876183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:50.187242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:50.214169 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3209c30-2b2e-460a-b280-807a50159a94 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1507 microversion: 2.1 time: 0.809043 Oct 17 15:33:50.232547 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1302/2795] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:49 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1507 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:50.291563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:50.295523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:50.319171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:50.320114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:50.320902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:50.327649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:50.330058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:50.330948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:50.605082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:50.637541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:50.640875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:50.643125 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a4a7f02-ae15-4512-97fa-6c261a51ba4e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1251 microversion: 2.25 time: 0.823126 Oct 17 15:33:50.649127 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1494/2796] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:33:49 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1251 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:33:50.674834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:50.681493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:50.709412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:50.710917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:50.712036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:50.716294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:50.717598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:50.720683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:50.760142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:50.771812 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9e0a0dc1-788b-46f3-b45a-e10b844175b9 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1422 microversion: 2.1 time: 0.488979 Oct 17 15:33:50.774741 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1303/2797] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:50 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1422 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:50.788536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-68d07b4b-1bc5-4267-95cd-7cf83933f8eb tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28c2e391f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:50.910582 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-68d07b4b-1bc5-4267-95cd-7cf83933f8eb tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.134558 Oct 17 15:33:50.928007 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1304/2798] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:50 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:51.259514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:51.260392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:51.276258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:51.276685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:51.277140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:51.282115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:51.288400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:51.288935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:51.303573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:51.356613 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-797a9107-1a6c-4dcd-a13d-ba53bc8d6abe tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1313 microversion: 2.1 time: 0.701606 Oct 17 15:33:51.365210 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1495/2799] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:50 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:51.688920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:51.695562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:51.747126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:51.749106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:51.773403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:51.775956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:51.777266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:51.779964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:52.090454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:52.107535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:52.116990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:52.127809 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31801a0d-5539-4e35-b11a-93119020a6db tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1251 microversion: 2.25 time: 0.461392 Oct 17 15:33:52.133729 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1496/2800] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:33:51 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1251 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:33:52.143573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:52.152219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:52.167063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:52.176868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:52.177587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:52.178706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:52.179666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:52.180668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:52.325017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:52.340882 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9747092-c8fa-426e-93d8-6dd372f04a13 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1422 microversion: 2.1 time: 0.202023 Oct 17 15:33:52.343164 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1497/2801] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:52 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1422 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:52.349078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d923f7d-71aa-4fbd-8122-efdd80fd5f5e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28c2e82c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:52.424372 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d923f7d-71aa-4fbd-8122-efdd80fd5f5e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.079611 Oct 17 15:33:52.426036 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1498/2802] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:52 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:52.431896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-423e2cab-15bc-499c-9bd6-347c323d7650 req-70fd8007-0cf1-417b-8196-a92aa7135c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623adb03-8bce-4cd5-a01c-b21495fcc870", "tag": "57d051c2-d615-47a8-a187-da3238f72760"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:52.444988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-423e2cab-15bc-499c-9bd6-347c323d7650 req-70fd8007-0cf1-417b-8196-a92aa7135c90 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:52.445977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-423e2cab-15bc-499c-9bd6-347c323d7650 req-70fd8007-0cf1-417b-8196-a92aa7135c90 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:52.446732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-423e2cab-15bc-499c-9bd6-347c323d7650 req-70fd8007-0cf1-417b-8196-a92aa7135c90 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:52.476651 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-423e2cab-15bc-499c-9bd6-347c323d7650 req-70fd8007-0cf1-417b-8196-a92aa7135c90 service nova] Creating event network-changed:57d051c2-d615-47a8-a187-da3238f72760 for instance 623adb03-8bce-4cd5-a01c-b21495fcc870 on n-h1-854441-12 Oct 17 15:33:52.492110 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-423e2cab-15bc-499c-9bd6-347c323d7650 req-70fd8007-0cf1-417b-8196-a92aa7135c90 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060753 Oct 17 15:33:52.493226 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1499/2803] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:52.530199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-de8b27c5-ba38-48a2-bc38-645be42d22da req-d2d76bcc-e57a-4e68-b482-9ab4aa531a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753b3d81-0147-4938-9bf0-5d96328f83b4", "name": "network-vif-deleted", "tag": "dfcd3036-5d69-49cc-92bc-0f665bb60336"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:52.548501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-de8b27c5-ba38-48a2-bc38-645be42d22da req-d2d76bcc-e57a-4e68-b482-9ab4aa531a04 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:52.549428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-de8b27c5-ba38-48a2-bc38-645be42d22da req-d2d76bcc-e57a-4e68-b482-9ab4aa531a04 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:52.550118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-de8b27c5-ba38-48a2-bc38-645be42d22da req-d2d76bcc-e57a-4e68-b482-9ab4aa531a04 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:52.567497 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-de8b27c5-ba38-48a2-bc38-645be42d22da req-d2d76bcc-e57a-4e68-b482-9ab4aa531a04 service nova] Creating event network-vif-deleted:dfcd3036-5d69-49cc-92bc-0f665bb60336 for instance 753b3d81-0147-4938-9bf0-5d96328f83b4 on n-h1-854441-12 Oct 17 15:33:52.589199 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-de8b27c5-ba38-48a2-bc38-645be42d22da req-d2d76bcc-e57a-4e68-b482-9ab4aa531a04 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092396 Oct 17 15:33:52.594152 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1500/2804] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:52.615687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:52.617546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:52.629132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:52.630379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:52.631468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:52.632803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:52.633614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:52.634464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:53.060450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:53.078817 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c58e00ab-7970-402c-92d3-f222f8468f88 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1507 microversion: 2.1 time: 1.820119 Oct 17 15:33:53.095900 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1305/2805] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:51 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1507 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:33:53.106174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-71f11ee3-023e-4e4f-a72e-269599baa653 req-9abb770d-2de1-4ddd-93a4-b68b93251051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faca81c2-979f-4b9e-bc24-0ef9e7a9b418", "name": "network-vif-plugged", "status": "completed", "tag": "925d597a-79ef-4b38-82c8-f8a52dcabf95"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:53.131338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-71f11ee3-023e-4e4f-a72e-269599baa653 req-9abb770d-2de1-4ddd-93a4-b68b93251051 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:53.135745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-71f11ee3-023e-4e4f-a72e-269599baa653 req-9abb770d-2de1-4ddd-93a4-b68b93251051 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:53.137569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-71f11ee3-023e-4e4f-a72e-269599baa653 req-9abb770d-2de1-4ddd-93a4-b68b93251051 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:53.161276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:53.179740 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-71f11ee3-023e-4e4f-a72e-269599baa653 req-9abb770d-2de1-4ddd-93a4-b68b93251051 service nova] Creating event network-vif-plugged:925d597a-79ef-4b38-82c8-f8a52dcabf95 for instance faca81c2-979f-4b9e-bc24-0ef9e7a9b418 on n-h2-854441-12 Oct 17 15:33:53.205403 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-71f11ee3-023e-4e4f-a72e-269599baa653 req-9abb770d-2de1-4ddd-93a4-b68b93251051 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107749 Oct 17 15:33:53.206066 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1306/2806] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:53.237821 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84953253-e413-4077-9e2d-d902a2f50ca3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1313 microversion: 2.1 time: 0.636163 Oct 17 15:33:53.238152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:53.249239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:53.280094 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1501/2807] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:52 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1313 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:53.296117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:53.297958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:53.302898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:53.304199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:53.304771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:53.305424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:53.309711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:53.378953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:53.403255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:53.404683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:53.483983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:53.491856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:53.492595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:53.503431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:53.504374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:53.505180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:53.741021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:53.748238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:53.750846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:53.753123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lazy-loading 'fault' on Instance uuid 753b3d81-0147-4938-9bf0-5d96328f83b4 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:33:53.865663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:53.882288 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f011634-5324-4a57-8cb9-7ff00d1ba38a tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 200 len: 1308 microversion: 2.1 time: 0.504005 Oct 17 15:33:53.901749 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1502/2808] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:53 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:53.929584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a14d8914-85b2-4a08-84f5-a6610bcd514a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be3d7c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:54.041710 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a14d8914-85b2-4a08-84f5-a6610bcd514a tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.127134 Oct 17 15:33:54.043524 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1503/2809] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:53 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:54.143124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:54.151402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:54.185377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:54.188376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:54.189560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:54.191626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:54.192914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:54.194442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:54.251137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:54.288564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:54.299576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:54.304644 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fad09b04-9b6e-41d4-8783-883d20269ace tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1293 microversion: 2.25 time: 1.087004 Oct 17 15:33:54.307578 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1307/2810] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:33:53 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1293 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:33:54.327014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:54.328537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:54.353453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:54.354722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:54.356858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:54.358688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:54.359816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:54.361025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:54.684828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:54.702631 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2305066b-aefc-4584-95f3-0432d5d77b66 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 200 len: 1450 microversion: 2.1 time: 0.597702 Oct 17 15:33:54.711547 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1504/2811] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:54 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 1450 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:54.757829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:54.758745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:54.782553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:54.787258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:54.790390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:54.791697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:54.792558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:54.793328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:54.905959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:33:54.935410 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.compute.api [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Working on deleting snapshot ed58a2ef-a959-40ac-9262-78ccbee4f786 from shelved instance... Oct 17 15:33:55.737300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:55.766719 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-15f22883-94b5-4e2c-bf01-a93370a0f9a2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1313 microversion: 2.1 time: 1.455287 Oct 17 15:33:55.768259 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1308/2812] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:54 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1313 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:55.778815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:55.780217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 753b3d81-0147-4938-9bf0-5d96328f83b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:55.800158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:55.801033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:55.801807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:55.806938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:55.807966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:55.808626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:55.902153 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] HTTP exception thrown: Instance 753b3d81-0147-4938-9bf0-5d96328f83b4 could not be found. Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Request method failure captured: Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 HTTP/1.1 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXV6T_a8_E5gD00aunuxLBBlt4KXl851nDHzj81rJ1Yaog44x2XDNVooMF0tqu_TSJ4ZzlV2b9tjXEVhWEXI9tpRbDyHHhsYFRB9IWWYy7JW9p4uYPvyqYhgx_24gFJuU6Fd6JDXKggixAXEfqLibqZD56DzsjY6g4i-3DtSdyUry3s Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 98e9a6e643c54bc7bd4a28c9e5937a30 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-LiveMigrationNegativeTest-1341197372 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/98e9a6e643c54bc7bd4a28c9e5937a30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/98e9a6e643c54bc7bd4a28c9e5937a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_98e9a6e643c54bc7bd4a28c9e5937a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/98e9a6e643c54bc7bd4a28c9e5937a30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-LiveMigrationNegativeTest-1341197372 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 98e9a6e643c54bc7bd4a28c9e5937a30 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1341197372 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-LiveMigrationNegativeTest-1341197372-project Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ba709d7db06a4acd9436d532c4b6aa18 Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-LiveMigrationNegativeTest-1341197372-project Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 753b3d81-0147-4938-9bf0-5d96328f83b4 could not be found. Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '753b3d81-0147-4938-9bf0-5d96328f83b4'} Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753b3d81-0147-4938-9bf0-5d96328f83b4 could not be found. Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753b3d81-0147-4938-9bf0-5d96328f83b4 could not be found. Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:33:55.925000 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:55.933320 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:55.933320 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:33:55.933320 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:33:55.933320 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:33:55.933320 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:33:55.933320 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753b3d81-0147-4938-9bf0-5d96328f83b4 could not be found. Oct 17 15:33:55.933320 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:55.940522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Returning 404 to user: Instance 753b3d81-0147-4938-9bf0-5d96328f83b4 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:33:55.942800 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9efea60c-1e83-4fdb-87a6-6416597229e2 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4" status: 404 len: 111 microversion: 2.1 time: 0.172345 Oct 17 15:33:55.955462 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1309/2813] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:55 2022] GET /compute/v2.1/servers/753b3d81-0147-4938-9bf0-5d96328f83b4 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:33:55.969014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-71057d99-9387-4f21-a49a-13f8b501ddf2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28bf4d6b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:56.489100 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-71057d99-9387-4f21-a49a-13f8b501ddf2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.528661 Oct 17 15:33:56.493264 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1310/2814] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:55 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:56.524277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:56.531519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:56.587320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:56.588915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:56.590148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:56.592662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:56.596814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:56.601458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:56.623477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Doing local delete in cell 4ec06080-01b5-4793-9448-66de7d08c56d(cell1) {{(pid=120406) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 17 15:33:56.624397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:56.628373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:56.629834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:56.633645 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.compute.api [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 17 15:33:56.655966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] deallocate_for_instance() {{(pid=120406) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 17 15:33:57.012356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:57.029047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:57.031111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:57.032336 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-35dfe699-0141-4ab6-866b-fcaf760e9e05 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1293 microversion: 2.25 time: 0.530031 Oct 17 15:33:57.035979 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1311/2815] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:33:56 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1293 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:33:57.042548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:57.047878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:57.064377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:57.064873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:57.079259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:57.082620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:57.083886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:57.084519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:57.148405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:33:57.368513 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-06552bd5-8058-4145-b39f-79e12277dd90 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 204 len: 0 microversion: 2.1 time: 0.330397 Oct 17 15:33:57.377076 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1312/2816] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:33:57 2022] DELETE /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:33:57.389986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:57.391670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:57.403037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:57.403948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:57.404836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:57.406200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:57.407219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:57.408483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:57.929532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:57.946825 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9c68d022-98b0-43fd-a2b4-e39f9b14b5ab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1499 microversion: 2.1 time: 0.567454 Oct 17 15:33:57.962534 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1313/2817] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:57 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1499 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:57.962846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cb72208d-2d76-44f3-b19e-414e5883104b req-09ba5e57-07bd-4b49-b2dc-8160d11bd737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05b8d74-dc5f-433d-bd93-328e0511f478", "tag": "b06a0418-6456-4d25-8cf6-75d075422311"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:57.978209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cb72208d-2d76-44f3-b19e-414e5883104b req-09ba5e57-07bd-4b49-b2dc-8160d11bd737 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:57.978730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cb72208d-2d76-44f3-b19e-414e5883104b req-09ba5e57-07bd-4b49-b2dc-8160d11bd737 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:57.979168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cb72208d-2d76-44f3-b19e-414e5883104b req-09ba5e57-07bd-4b49-b2dc-8160d11bd737 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:58.011980 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cb72208d-2d76-44f3-b19e-414e5883104b req-09ba5e57-07bd-4b49-b2dc-8160d11bd737 service nova] Creating event network-changed:b06a0418-6456-4d25-8cf6-75d075422311 for instance c05b8d74-dc5f-433d-bd93-328e0511f478 on n-h1-854441-12 Oct 17 15:33:58.024905 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cb72208d-2d76-44f3-b19e-414e5883104b req-09ba5e57-07bd-4b49-b2dc-8160d11bd737 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075761 Oct 17 15:33:58.025988 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1314/2818] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:33:58.037935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:58.038820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:58.061871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:58.062391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:58.062895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:58.063763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:58.064422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:58.064961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:58.080366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Updating instance_info_cache with network_info: [] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:33:58.344874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:58.561069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebadf3ef-20a7-45c5-8463-3eded00d388d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 204 len: 0 microversion: 2.1 time: 3.811136 Oct 17 15:33:58.561939 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1505/2819] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:33:54 2022] DELETE /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 0 bytes in 3813 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:33:58.571434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f88848d-2309-466a-a567-71726a760a99 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be3e49d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:58.579040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:58.607661 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-19a908e3-3874-4b7b-99c1-149d4075fa04 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1475 microversion: 2.1 time: 0.573961 Oct 17 15:33:58.631388 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1315/2820] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:58 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1475 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:58.654884 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f88848d-2309-466a-a567-71726a760a99 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1429 microversion: 2.1 time: 0.091166 Oct 17 15:33:58.656083 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1506/2821] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:33:58 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:58.663239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:58.667908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:58.670780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:58.680293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:58.681527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:58.682692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:58.683313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:58.684756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:58.685854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:58.686914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:58.698952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:58.699767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:58.700555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:58.701791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:58.702533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:58.703216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:58.773332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lazy-loading 'flavor' on Instance uuid faca81c2-979f-4b9e-bc24-0ef9e7a9b418 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:33:58.981074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:33:59.055688 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7a85bad3-807a-414f-afb3-9dca3cc0b7b0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "POST /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418/action" status: 200 len: 32 microversion: 2.1 time: 0.421313 Oct 17 15:33:59.066423 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1316/2822] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:33:58 2022] POST /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418/action => generated 32 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:33:59.078925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1263093f-3f2f-4779-a700-5a38fea368da req-f491c017-a1c0-4c5b-a641-b16e290bd6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf163cb1-81b4-4969-a6d2-5caa98ae4525", "name": "network-vif-deleted", "tag": "c958c84d-2595-4536-aeb2-e83c146fdb74"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:59.099277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1263093f-3f2f-4779-a700-5a38fea368da req-f491c017-a1c0-4c5b-a641-b16e290bd6be service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:59.100040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1263093f-3f2f-4779-a700-5a38fea368da req-f491c017-a1c0-4c5b-a641-b16e290bd6be service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:59.100761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1263093f-3f2f-4779-a700-5a38fea368da req-f491c017-a1c0-4c5b-a641-b16e290bd6be service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:59.129305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.compute.server_external_events [req-1263093f-3f2f-4779-a700-5a38fea368da req-f491c017-a1c0-4c5b-a641-b16e290bd6be service nova] Unable to find a host for instance cf163cb1-81b4-4969-a6d2-5caa98ae4525. Dropping event network-vif-deleted {{(pid=120407) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 15:33:59.133104 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1263093f-3f2f-4779-a700-5a38fea368da req-f491c017-a1c0-4c5b-a641-b16e290bd6be service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.064153 Oct 17 15:33:59.135192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1317/2823] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 15:33:59.145491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:59.147429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:59.173267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:59.175252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:59.176530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:59.183357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:59.187733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:59.188051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:59.220652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:59.223039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 HTTP/1.1 Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'cf163cb1-81b4-4969-a6d2-5caa98ae4525'} Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:33:59.225017 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:59.233419 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:33:59.233419 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:33:59.233419 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:33:59.233419 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:33:59.233419 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:33:59.233419 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:33:59.233419 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:33:59.233419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:33:59.233419 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa50da8d-38e1-4c88-9a0e-d1b5596ad4a5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 404 len: 111 microversion: 2.1 time: 0.093294 Oct 17 15:33:59.239414 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1318/2824] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:59 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:33:59.249697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:59.256504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:59.257523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:59.259137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:59.265014 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e526e94-2572-4138-996e-ef657f5abf03 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1293 microversion: 2.25 time: 0.604494 Oct 17 15:33:59.271991 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1507/2825] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:33:58 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1293 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:33:59.293648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:59.294269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:59.294809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:59.295793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:59.301890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:59.302426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:59.487974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:33:59.524825 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6c945fb0-0c0a-4ddb-ac7d-6b44faa7e569 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.284049 Oct 17 15:33:59.525725 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1319/2826] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:59 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:33:59.612678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1365777031", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "fbf48d23-b6f0-48de-b73a-9c8aad4ee168"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:33:59.658441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:33:59.659126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:33:59.672931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:59.673233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:59.673776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:59.674547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:33:59.679976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:33:59.680471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:33:59.755047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] validate_networks() for [('fbf48d23-b6f0-48de-b73a-9c8aad4ee168', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:34:00.292128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:00.308314 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b55a541d-29e3-44e0-b5a4-27773289c1db tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1475 microversion: 2.1 time: 0.653869 Oct 17 15:34:00.309320 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1320/2827] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:33:59 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1475 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:00.318368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8e4f8a0-d581-4c96-ae36-b3b914d45971 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28bec6c040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:00.449309 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e8e4f8a0-d581-4c96-ae36-b3b914d45971 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1438 microversion: 2.1 time: 0.138842 Oct 17 15:34:00.455019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1321/2828] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:00 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1438 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:00.471388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:00.475127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:00.502277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:00.504518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:00.505488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:00.510077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:00.513669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:00.515137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.102423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:34:01.103075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:34:01.103350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:34:01.103762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:34:01.104174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:34:01.115932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.116762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.117405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.118565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.119239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.119897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.157838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:34:01.165401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for user 745a483a369e4e83849cee037f5b67ab and project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:34:01.182962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:34:01.186105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:34:01.234956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:01.248639 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-856a8fdd-fda2-4a8c-9d78-5a51b37aff67 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644196 Oct 17 15:34:01.250083 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1508/2829] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:33:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:34:01.255334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e52173f0-84f6-48b6-bd2b-95b1c0f35681 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be3d7310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:01.284087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:01.288174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:01.290125 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-259739c7-173d-47ef-b80b-b0b7439e7925 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1293 microversion: 2.25 time: 0.833661 Oct 17 15:34:01.291124 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1322/2830] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:00 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1293 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:01.305278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:01.308110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:01.325236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:01.328564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.331607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.334550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.336519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.337543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.338399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.412554 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e52173f0-84f6-48b6-bd2b-95b1c0f35681 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 200 len: 1438 microversion: 2.1 time: 0.159869 Oct 17 15:34:01.426842 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1509/2831] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:01 2022] GET /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 1438 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:01.455277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e5966ec3-f893-4c13-9015-054cc07f98c4 req-e1cba982-ab30-493f-9a90-fa780315ecbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af2b7c2-346e-4c07-82fd-071570f5a865", "name": "network-vif-deleted", "tag": "1614ba00-cbc1-4afb-8413-36ca45b8205e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:01.474624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e5966ec3-f893-4c13-9015-054cc07f98c4 req-e1cba982-ab30-493f-9a90-fa780315ecbf service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.475512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e5966ec3-f893-4c13-9015-054cc07f98c4 req-e1cba982-ab30-493f-9a90-fa780315ecbf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.476346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e5966ec3-f893-4c13-9015-054cc07f98c4 req-e1cba982-ab30-493f-9a90-fa780315ecbf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.524519 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e5966ec3-f893-4c13-9015-054cc07f98c4 req-e1cba982-ab30-493f-9a90-fa780315ecbf service nova] Creating event network-vif-deleted:1614ba00-cbc1-4afb-8413-36ca45b8205e for instance 5af2b7c2-346e-4c07-82fd-071570f5a865 on n-h2-854441-12 Oct 17 15:34:01.541273 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e5966ec3-f893-4c13-9015-054cc07f98c4 req-e1cba982-ab30-493f-9a90-fa780315ecbf service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098333 Oct 17 15:34:01.548366 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1510/2832] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:01.571265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b9928a7-1c1c-4f90-aa26-ee6f9429efcb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:01.572591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b9928a7-1c1c-4f90-aa26-ee6f9429efcb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:01.750328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b9928a7-1c1c-4f90-aa26-ee6f9429efcb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:01.766835 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b9928a7-1c1c-4f90-aa26-ee6f9429efcb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1215 microversion: 2.1 time: 0.214720 Oct 17 15:34:01.778990 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1511/2833] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:01 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:01.790981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:01.793610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:01.811247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.812128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.813249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.814576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.815245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.815957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.882454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.883289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.884012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.884646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lazy-loading 'fault' on Instance uuid 5af2b7c2-346e-4c07-82fd-071570f5a865 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:34:01.900130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:01.917697 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-04a27f77-5dc5-4190-8a7a-132919ba9996 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.623900 Oct 17 15:34:01.918752 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1323/2834] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:01 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:01.957871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:01.958971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:01.970072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.971312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.972274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.973707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:01.974524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:01.975407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:01.997551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba709d7db06a4acd9436d532c4b6aa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e9a6e643c54bc7bd4a28c9e5937a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:02.007667 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32da0469-826b-4648-b014-a787cee911a4 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 200 len: 1309 microversion: 2.1 time: 0.226691 Oct 17 15:34:02.015231 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1512/2835] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:01 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 1309 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:02.187843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:02.197629 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92b6930e-5ea6-42bf-8410-859bc973f241 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1465 microversion: 2.1 time: 0.265397 Oct 17 15:34:02.198258 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1324/2836] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:01 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1465 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:02.241760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47dd2901-06f0-4a8e-b086-209a86d3b964 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28be2bb670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:02.331784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:02.334175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:02.349940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:02.351825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:02.352812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:02.354417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:02.356872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:02.358630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:02.743157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:02.767070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:02.770237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:02.773087 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-000f294c-8dc2-4f95-b9ff-73816bab24d1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1281 microversion: 2.25 time: 0.446371 Oct 17 15:34:02.774580 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1325/2837] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:02 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1281 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:02.811819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:02.813940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:02.829063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:02.830029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:02.830955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:02.832597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:02.833803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:02.835156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.009445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:03.030989 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-47b54da4-d559-4fab-9cbe-3e5a4a09e897 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1267 microversion: 2.1 time: 0.236651 Oct 17 15:34:03.032888 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1326/2838] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:02 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:03.039314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:03.040337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:03.047681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.048560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.049158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.050468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.051484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.052384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.144521 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47dd2901-06f0-4a8e-b086-209a86d3b964 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "DELETE /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602" status: 204 len: 0 microversion: 2.1 time: 0.909796 Oct 17 15:34:03.145641 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1513/2839] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:02 2022] DELETE /compute/v2.1/images/17aceeb3-8b44-4d19-92b9-7224ed7b3602 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:34:03.155781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:03.156891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] [instance: 5af2b7c2-346e-4c07-82fd-071570f5a865] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:03.168441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.169348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.170137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.171802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.172639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.173411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.193653 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] HTTP exception thrown: Instance 5af2b7c2-346e-4c07-82fd-071570f5a865 could not be found. Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Request method failure captured: Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 HTTP/1.1 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXV6T_a8_E5gD00aunuxLBBlt4KXl851nDHzj81rJ1Yaog44x2XDNVooMF0tqu_TSJ4ZzlV2b9tjXEVhWEXI9tpRbDyHHhsYFRB9IWWYy7JW9p4uYPvyqYhgx_24gFJuU6Fd6JDXKggixAXEfqLibqZD56DzsjY6g4i-3DtSdyUry3s Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 98e9a6e643c54bc7bd4a28c9e5937a30 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-LiveMigrationNegativeTest-1341197372 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/98e9a6e643c54bc7bd4a28c9e5937a30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/98e9a6e643c54bc7bd4a28c9e5937a30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_98e9a6e643c54bc7bd4a28c9e5937a30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/98e9a6e643c54bc7bd4a28c9e5937a30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-LiveMigrationNegativeTest-1341197372 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 98e9a6e643c54bc7bd4a28c9e5937a30 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1341197372 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-LiveMigrationNegativeTest-1341197372-project Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ba709d7db06a4acd9436d532c4b6aa18 Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-LiveMigrationNegativeTest-1341197372-project Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5af2b7c2-346e-4c07-82fd-071570f5a865 could not be found. Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5af2b7c2-346e-4c07-82fd-071570f5a865'} Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5af2b7c2-346e-4c07-82fd-071570f5a865 could not be found. Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5af2b7c2-346e-4c07-82fd-071570f5a865 could not be found. Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:03.197331 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.203891 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:03.203891 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:03.203891 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:03.203891 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:34:03.203891 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:34:03.203891 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af2b7c2-346e-4c07-82fd-071570f5a865 could not be found. Oct 17 15:34:03.203891 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.205696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] Returning 404 to user: Instance 5af2b7c2-346e-4c07-82fd-071570f5a865 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:03.206797 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f969bd29-ebdd-4d0e-aba7-71ea2a51ff50 tempest-LiveMigrationNegativeTest-1341197372 tempest-LiveMigrationNegativeTest-1341197372-project] 10.222.0.87 "GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865" status: 404 len: 111 microversion: 2.1 time: 0.059428 Oct 17 15:34:03.207648 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1514/2840] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:03 2022] GET /compute/v2.1/servers/5af2b7c2-346e-4c07-82fd-071570f5a865 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:34:03.217623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8fb9f88-9e17-4957-aced-e1b7af86437b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '.version_select at 0x7f28bf3260d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:03.244097 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e8fb9f88-9e17-4957-aced-e1b7af86437b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] HTTP exception thrown: Image not found. Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8fb9f88-9e17-4957-aced-e1b7af86437b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Request method failure captured: Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 HTTP/1.1 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXV61Io3WeqDew-RxiVHQZde5UuLsfqEfgmx3bBhwShz0s8_jtXjh5rIvGznvk6C8GbAh5Hyb3O8TyX-VZKzFojgPd-d2_WwMhNV6uA8rcAd9bYRbeKXkzmCVr30mLTwfN6FobA7Wzsqhv1-8ew0EKDXIG-5lo4Yytu5znKxK4tlBBY Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8c2f4600658d49738f4e00f44b2cd1d3 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerTestJSON-1448854289 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerTestJSON-1448854289 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8c2f4600658d49738f4e00f44b2cd1d3 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1448854289 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerTestJSON-1448854289-project Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a371ebfdf0034f3f890044609df5da40 Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerTestJSON-1448854289-project Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: exception: Image not found. Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'c74d72f6-f9d1-4f99-9ee0-a55dd0553610'} Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c74d72f6-f9d1-4f99-9ee0-a55dd0553610 to delete Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c74d72f6-f9d1-4f99-9ee0-a55dd0553610 could not be found. Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.248736 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8fb9f88-9e17-4957-aced-e1b7af86437b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Returning 404 to user: Image not found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8fb9f88-9e17-4957-aced-e1b7af86437b tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "DELETE /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610" status: 404 len: 62 microversion: 2.1 time: 0.042319 Oct 17 15:34:03.256542 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1515/2841] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:03 2022] DELETE /compute/v2.1/images/c74d72f6-f9d1-4f99-9ee0-a55dd0553610 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:34:03.265355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:03.267930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:03.279364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.280230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.280979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.282224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.283089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.283840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.338419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:34:03.446444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:03.477289 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-65fdb1f9-708a-402b-933b-d55c259debab tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.442309 Oct 17 15:34:03.481072 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1327/2842] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:03 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:03.540065 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a709ab7a-9f3b-40d3-9f5d-419b7b2f1b8f tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 204 len: 0 microversion: 2.1 time: 0.280994 Oct 17 15:34:03.540761 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1516/2843] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:34:03 2022] DELETE /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:34:03.554362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:03.559375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:03.570367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.571591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.572345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.573844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.574947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.576253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.803981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-037f3c6e-8f75-4d09-b9dc-0c62b6c39e14 req-399ab588-4a22-4e3d-b002-71c9c2052010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8eba4c-6082-4902-8f19-8d43b764b5d9", "name": "network-vif-unplugged", "status": "completed", "tag": "805607b3-b87b-4c13-bd12-0be56f094425"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:03.831347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-037f3c6e-8f75-4d09-b9dc-0c62b6c39e14 req-399ab588-4a22-4e3d-b002-71c9c2052010 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.835157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-037f3c6e-8f75-4d09-b9dc-0c62b6c39e14 req-399ab588-4a22-4e3d-b002-71c9c2052010 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.836165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-037f3c6e-8f75-4d09-b9dc-0c62b6c39e14 req-399ab588-4a22-4e3d-b002-71c9c2052010 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.841945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:03.870519 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-037f3c6e-8f75-4d09-b9dc-0c62b6c39e14 req-399ab588-4a22-4e3d-b002-71c9c2052010 service nova] Creating event network-vif-unplugged:805607b3-b87b-4c13-bd12-0be56f094425 for instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 on n-h1-854441-12 Oct 17 15:34:03.872650 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cb8f7546-fdcb-4754-afc6-c0a3ad1e0141 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1471 microversion: 2.1 time: 0.325608 Oct 17 15:34:03.874362 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1328/2844] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:03 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:03.881707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:03.883287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:03.895363 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-037f3c6e-8f75-4d09-b9dc-0c62b6c39e14 req-399ab588-4a22-4e3d-b002-71c9c2052010 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096161 Oct 17 15:34:03.897831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.899351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.900627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:03.902682 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1517/2845] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:34:03.903197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:03.904400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:03.905490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:04.111953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:04.131526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:04.135584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:04.138378 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5a40362f-590a-424a-8c89-b35c401db852 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1281 microversion: 2.25 time: 0.261881 Oct 17 15:34:04.155335 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1329/2846] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:03 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1281 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:04.468725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:04.469596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:04.477095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:04.477718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:04.478136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:04.479112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:04.479576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:04.480051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:04.527959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:04.529304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:04.538181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:04.539088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:04.539799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:04.540752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:04.541429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:04.542111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:04.597352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:04.612779 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73400b68-9033-4c74-bc1e-84d34810f43a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1275 microversion: 2.1 time: 0.543902 Oct 17 15:34:04.613833 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1518/2847] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:04 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1275 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:04.799051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:04.809388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d38ee34f-0a76-41eb-a60d-9ef932e2be21 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.287984 Oct 17 15:34:04.810374 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1330/2848] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:04 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:04.922244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:04.922895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:04.933956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:04.933956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:04.934253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:04.935019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:04.936720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:04.937233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:05.100079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:05.108662 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ce18097-2d19-4af7-8231-b4bf7175566e tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1471 microversion: 2.1 time: 0.191015 Oct 17 15:34:05.110236 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1519/2849] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:04 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:05.194932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:05.195620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:05.203399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:05.204209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:05.204639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:05.205542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:05.206468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:05.207238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:05.609722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:05.625717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:05.629985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:05.632026 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ce39c081-6c85-4ae1-b285-72017720dac8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1281 microversion: 2.25 time: 0.441262 Oct 17 15:34:05.634247 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1331/2850] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:05 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1281 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:34:05.651289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:05.652176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:05.665171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:05.666725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:05.667777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:05.669274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:05.669977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:05.670654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:05.767484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:05.777990 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-673cc4e0-1e2b-4b70-bc6d-a6c4364e2c90 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1273 microversion: 2.1 time: 0.139287 Oct 17 15:34:05.779010 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1520/2851] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:05 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:05.848330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:05.849123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:05.858780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:05.867330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:05.872568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:05.875285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:05.875888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:05.876409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.160930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:06.163632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:06.184402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:06.192934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:06.196299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.200906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:06.202642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:06.205135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.299621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:06.312822 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-300f1589-5dbf-4615-8571-1b4013507feb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.470916 Oct 17 15:34:06.316197 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1332/2852] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:05 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:06.322998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:06.337687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:06.340741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Searching by: {'deleted': False, 'project_id': '6d9e8d41de3843668933339c133246ff'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:34:06.348362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:06.349141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:06.349794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.350971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:06.353333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:06.354215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.389702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:34:06.454389 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f569ff1a-3895-4e8a-a1a6-a030332d5334 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.135017 Oct 17 15:34:06.455984 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1333/2853] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:34:06 2022] GET /compute/v2.1/servers => generated 334 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:06.469008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:06.481597 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8b407f9-5f63-44e3-8f9b-2aefc1b2b3d2 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1471 microversion: 2.1 time: 0.332991 Oct 17 15:34:06.484854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:06.496487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:06.496790 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1521/2854] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:06 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:06.499026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Searching by: {'deleted': False, 'project_id': '6d9e8d41de3843668933339c133246ff'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:34:06.511834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:06.513111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:06.514149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.516184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:06.517968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:06.519107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.673076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:06.674273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:06.682480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:06.684387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:06.687305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.689928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:06.690660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:06.691711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.696613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:06.718749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:34:06.811807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:06.822795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:06.823594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:06.824190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:06.986205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:07.005660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:07.009716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:07.012281 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2fba1ed3-b43d-4335-b201-dabb08860738 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1281 microversion: 2.25 time: 0.343501 Oct 17 15:34:07.014275 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1522/2855] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:06 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1281 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:34:07.042638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-240bc0cd-bdd6-423f-86e3-0997cba62654 req-4c060dd9-9c1d-433f-a56f-5a3f59065c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8eba4c-6082-4902-8f19-8d43b764b5d9", "name": "network-vif-deleted", "tag": "805607b3-b87b-4c13-bd12-0be56f094425"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:07.092106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-240bc0cd-bdd6-423f-86e3-0997cba62654 req-4c060dd9-9c1d-433f-a56f-5a3f59065c1a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:07.093989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-240bc0cd-bdd6-423f-86e3-0997cba62654 req-4c060dd9-9c1d-433f-a56f-5a3f59065c1a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:07.095426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-240bc0cd-bdd6-423f-86e3-0997cba62654 req-4c060dd9-9c1d-433f-a56f-5a3f59065c1a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:07.147553 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-240bc0cd-bdd6-423f-86e3-0997cba62654 req-4c060dd9-9c1d-433f-a56f-5a3f59065c1a service nova] Creating event network-vif-deleted:805607b3-b87b-4c13-bd12-0be56f094425 for instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 on n-h1-854441-12 Oct 17 15:34:07.166219 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-240bc0cd-bdd6-423f-86e3-0997cba62654 req-4c060dd9-9c1d-433f-a56f-5a3f59065c1a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149434 Oct 17 15:34:07.167348 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1523/2856] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:07.193234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:07.200754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:07.233611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:07.234543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:07.235385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:07.236773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:07.237505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:07.238257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:07.398035 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b371de9e-c741-4849-ab3f-f4b85f644b7d tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/detail" status: 200 len: 1700 microversion: 2.1 time: 0.921435 Oct 17 15:34:07.408070 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1334/2857] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:34:06 2022] GET /compute/v2.1/servers/detail => generated 1700 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:07.422946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:07.431109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:07.451732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:07.453102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:07.454112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:07.461499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:07.463246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:07.465116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:07.639717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:07.650463 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6cdf083-0332-4559-b179-7787030fab77 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1315 microversion: 2.1 time: 0.474396 Oct 17 15:34:07.655714 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1524/2858] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:07 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:07.667828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b89987b-069a-4efd-af82-455a8f3bd72f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:07.679671 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b89987b-069a-4efd-af82-455a8f3bd72f tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019077 Oct 17 15:34:07.681588 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1525/2859] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:34:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:07.687431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:07.688138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:07.695273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:07.695902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:07.696415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:07.697245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:07.697801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:07.698342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:07.735131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:07.737537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:07.743317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:07.744106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:07.744821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:07.745565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lazy-loading 'fault' on Instance uuid 4b8eba4c-6082-4902-8f19-8d43b764b5d9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:34:07.752094 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c21dbf2-9db1-4960-aa9c-1c616ad7e8af tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.341690 Oct 17 15:34:07.752920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:07.753091 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1335/2860] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:07 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:07.817193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a371ebfdf0034f3f890044609df5da40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2f4600658d49738f4e00f44b2cd1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:07.835670 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29683fd6-0f62-4d56-bc55-74df1674a6f7 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 200 len: 1306 microversion: 2.1 time: 0.148852 Oct 17 15:34:07.835670 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1526/2861] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:07 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 1306 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:08.046343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ceb15865-830a-45a7-8a39-0426eac4fbb0 tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] Action: 'create', calling method: .version_select at 0x7f28bec8dd30>, body: {"security_group": {"name": "tempest-securitygroup-1968226593", "description": "tempest-description-1294114718"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:08.066033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:08.066817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:08.073564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:08.074183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:08.074723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:08.075588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:08.076145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:08.076699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:08.262893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:08.283952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:08.289906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:08.292816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c7d2528-1aab-4ec1-b2e8-42c6fdc54498 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1281 microversion: 2.25 time: 0.232845 Oct 17 15:34:08.295296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1527/2862] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:08 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1281 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:34:08.690609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:08.691705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:08.699157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:08.699658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:08.700092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:08.700821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:08.701274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:08.701695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:08.855792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:08.866982 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68c95d21-b584-4bdf-8aa3-e5a05be9458d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1315 microversion: 2.1 time: 0.181340 Oct 17 15:34:08.869734 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1528/2863] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:08 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:08.888051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:08.889861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:08.899097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:08.899894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:08.900669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:08.901479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:08.903367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:08.903877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.001030 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ceb15865-830a-45a7-8a39-0426eac4fbb0 tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.241577 Oct 17 15:34:09.001681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1336/2864] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:34:07 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:09.006890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:09.007676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:09.016103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:09.016899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:09.017335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.018073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:09.018555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:09.018983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.064172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:34:09.121409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:09.137332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2241458-8b3f-4bde-a553-23006d5660bc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.257619 Oct 17 15:34:09.138263 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1529/2865] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:08 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:09.200352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:09.201418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] [instance: 4b8eba4c-6082-4902-8f19-8d43b764b5d9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:09.220783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:09.221334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:09.221808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.222791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:09.223589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:09.224245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.250024 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] HTTP exception thrown: Instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 could not be found. Oct 17 15:34:09.253676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d4e00a23-056e-480f-b37d-025aed20672c tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "DELETE /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 204 len: 0 microversion: 2.1 time: 0.250176 Oct 17 15:34:09.255285 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1337/2866] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:34:09 2022] DELETE /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Request method failure captured: Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 HTTP/1.1 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXV61Io3WeqDew-RxiVHQZde5UuLsfqEfgmx3bBhwShz0s8_jtXjh5rIvGznvk6C8GbAh5Hyb3O8TyX-VZKzFojgPd-d2_WwMhNV6uA8rcAd9bYRbeKXkzmCVr30mLTwfN6FobA7Wzsqhv1-8ew0EKDXIG-5lo4Yytu5znKxK4tlBBY Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8c2f4600658d49738f4e00f44b2cd1d3 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ImagesOneServerTestJSON-1448854289 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8c2f4600658d49738f4e00f44b2cd1d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ImagesOneServerTestJSON-1448854289 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8c2f4600658d49738f4e00f44b2cd1d3 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1448854289 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ImagesOneServerTestJSON-1448854289-project Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a371ebfdf0034f3f890044609df5da40 Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ImagesOneServerTestJSON-1448854289-project Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 could not be found. Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '4b8eba4c-6082-4902-8f19-8d43b764b5d9'} Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 could not be found. Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 could not be found. Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:09.256092 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:09.265284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:09.265284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:09.265284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:09.265284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:34:09.265284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:34:09.265284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 could not be found. Oct 17 15:34:09.265284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:09.269993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] Returning 404 to user: Instance 4b8eba4c-6082-4902-8f19-8d43b764b5d9 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:09.272782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5cedef36-ef55-4f99-8b69-80a578e466a6 tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] Action: 'create', calling method: .version_select at 0x7f28c2ebeb80>, body: {"security_group": {"name": "tempest-securitygroup-1780564216", "description": "tempest-description-1855097918"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:09.274359 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5ed84e7-0ac5-46e1-8400-ffcf1137fe50 tempest-ImagesOneServerTestJSON-1448854289 tempest-ImagesOneServerTestJSON-1448854289-project] 10.222.0.87 "GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9" status: 404 len: 111 microversion: 2.1 time: 0.133277 Oct 17 15:34:09.278231 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1530/2867] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:09 2022] GET /compute/v2.1/servers/4b8eba4c-6082-4902-8f19-8d43b764b5d9 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:34:09.299395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-dd99e052-0bc2-4f47-a70b-e9dbcaef38cc req-dc165088-bb68-4aac-bbdd-344e944ef7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66796bdf-a914-42c2-b4cb-576f956f5bd7", "tag": "eba218cb-4690-4a0b-ad4f-14ec9a2eca52"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:09.324767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd99e052-0bc2-4f47-a70b-e9dbcaef38cc req-dc165088-bb68-4aac-bbdd-344e944ef7de service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:09.328094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd99e052-0bc2-4f47-a70b-e9dbcaef38cc req-dc165088-bb68-4aac-bbdd-344e944ef7de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:09.329012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dd99e052-0bc2-4f47-a70b-e9dbcaef38cc req-dc165088-bb68-4aac-bbdd-344e944ef7de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.349811 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-dd99e052-0bc2-4f47-a70b-e9dbcaef38cc req-dc165088-bb68-4aac-bbdd-344e944ef7de service nova] Creating event network-changed:eba218cb-4690-4a0b-ad4f-14ec9a2eca52 for instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 on n-h1-854441-12 Oct 17 15:34:09.356947 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-dd99e052-0bc2-4f47-a70b-e9dbcaef38cc req-dc165088-bb68-4aac-bbdd-344e944ef7de service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070597 Oct 17 15:34:09.358717 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1531/2868] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:09.369002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:09.370683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:09.386364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:09.387487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:09.388451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.390244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:09.391372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:09.392609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.624933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:09.639891 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24676ade-641f-4eed-bc57-5bcccbd53679 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1703 microversion: 2.1 time: 0.278654 Oct 17 15:34:09.642180 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1532/2869] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:09 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1703 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:09.648515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:09.649477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:09.676329 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5cedef36-ef55-4f99-8b69-80a578e466a6 tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.415874 Oct 17 15:34:09.676885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:09.678855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:09.679466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.683669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:09.685299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:09.686613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:09.696750 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1338/2870] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:34:09 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:10.021700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:10.038333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:10.045158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:10.046953 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bfeca6d8-f829-48b5-b5cd-557515e4016e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1281 microversion: 2.25 time: 0.404060 Oct 17 15:34:10.067557 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1533/2871] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:09 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1281 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:10.072807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:10.073422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:10.083433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:10.083935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:10.084375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:10.085152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:10.085612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:10.086041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:10.105871 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:34:10.106460 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 15:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.87) !!! Oct 17 15:34:10.224185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-76d4a254-fb12-4ab8-a3c8-d3538f8f5153 tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] Action: 'create', calling method: .version_select at 0x7f28c2de1d30>, body: {"security_group": {"name": "tempest-securitygroup-2122920780", "description": "tempest-description-269879282"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:10.435089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:10.453017 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1e4f626-f84a-4d2e-af6d-65c4f07b5d55 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1315 microversion: 2.1 time: 0.384056 Oct 17 15:34:10.455236 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1534/2872] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:10 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:10.463775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:10.464799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:10.476126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:10.476990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:10.477432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:10.478148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:10.478621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:10.479383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:10.737134 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-76d4a254-fb12-4ab8-a3c8-d3538f8f5153 tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.037402 Oct 17 15:34:10.738832 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1339/2873] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:34:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:10.758340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:10.759353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:10.772306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:10.773419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:10.774041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:10.775068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:10.775585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:10.776124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:10.784080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:10.804323 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca19e3c1-5e78-4093-8ed5-41608211e659 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.347229 Oct 17 15:34:10.805917 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1535/2874] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:10 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:10.816565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0037fb9d-72a6-42e9-91f4-aad6bd2ce2b8 tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] Action: 'create', calling method: .version_select at 0x7f28bed1d0d0>, body: {"security_group": {"name": "tempest-securitygroup-1767501702", "description": "tempest-description-1694088264"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:11.123751 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0037fb9d-72a6-42e9-91f4-aad6bd2ce2b8 tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.315307 Oct 17 15:34:11.124655 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1536/2875] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:34:10 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:11.132494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:11.144475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:11.145492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:11.174242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:11.175425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:11.177091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:11.178561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:11.178745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:11.179790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:11.180530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:11.193123 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6fe2e49c-5cee-433d-8421-eb19f332bbed tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1703 microversion: 2.1 time: 0.452558 Oct 17 15:34:11.194627 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1340/2876] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:10 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1703 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:11.210035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3189dbc-3f6c-457d-95e4-51dad899e1fc tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] Calling method '.version_select at 0x7f28c2ed3280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:11.430605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:11.445958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:11.448881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:11.450779 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c52fb97-d41c-44c2-9b9f-4b886d719eab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1281 microversion: 2.25 time: 0.323869 Oct 17 15:34:11.451701 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1537/2877] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:11 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1281 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:11.495702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:11.496784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:11.506349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:11.507068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:11.507584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:11.508405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:11.508914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:11.509434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:11.747593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:11.759270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:11.764251 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ccdb67e1-375d-4aaa-b913-a98a271da3f1 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1315 microversion: 2.1 time: 0.274190 Oct 17 15:34:11.776318 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1538/2878] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:11 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:11.848877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:11.850016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:11.875450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:11.876917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:11.877726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:11.879599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:11.881312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:11.882248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:12.141652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:12.167359 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de0378ab-b1e5-487a-922b-3029019e8f9b tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.336448 Oct 17 15:34:12.168727 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1539/2879] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:11 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:12.208618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1c7aaf13-f3bc-4530-8e2f-59cefaf95600 req-77b87fac-7c31-4762-9f98-a21df614e083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05b8d74-dc5f-433d-bd93-328e0511f478", "name": "network-vif-plugged", "status": "completed", "tag": "b06a0418-6456-4d25-8cf6-75d075422311"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:12.244922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1c7aaf13-f3bc-4530-8e2f-59cefaf95600 req-77b87fac-7c31-4762-9f98-a21df614e083 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:12.246292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1c7aaf13-f3bc-4530-8e2f-59cefaf95600 req-77b87fac-7c31-4762-9f98-a21df614e083 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:12.247389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1c7aaf13-f3bc-4530-8e2f-59cefaf95600 req-77b87fac-7c31-4762-9f98-a21df614e083 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:12.286731 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1c7aaf13-f3bc-4530-8e2f-59cefaf95600 req-77b87fac-7c31-4762-9f98-a21df614e083 service nova] Creating event network-vif-plugged:b06a0418-6456-4d25-8cf6-75d075422311 for instance c05b8d74-dc5f-433d-bd93-328e0511f478 on n-h1-854441-12 Oct 17 15:34:12.297837 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1c7aaf13-f3bc-4530-8e2f-59cefaf95600 req-77b87fac-7c31-4762-9f98-a21df614e083 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099427 Oct 17 15:34:12.299036 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1540/2880] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:12.310782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:12.312063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:12.327012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:12.327616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:12.328375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:12.329883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:12.331135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:12.332874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:12.538414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:12.554352 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2c8f562-e498-41fb-85ec-336a12ed6cbc tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1703 microversion: 2.1 time: 0.253000 Oct 17 15:34:12.565684 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1541/2881] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:12 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1703 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:12.574965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:12.576197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:12.587357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:12.588245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:12.589057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:12.590337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:12.591214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:12.591974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:12.792647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:12.804134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:12.805844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:12.807429 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49998a32-be90-47b0-af1f-6462ef894099 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1281 microversion: 2.25 time: 0.250072 Oct 17 15:34:12.808125 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1542/2882] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:12 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:12.815090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:12.815658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:12.823933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:12.824654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:12.825238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:12.826116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:12.826856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:12.827422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:13.029623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:13.040164 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-767f89db-ceee-4a09-a770-57c0cc783896 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1315 microversion: 2.1 time: 0.230684 Oct 17 15:34:13.041361 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1543/2883] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:12 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:13.209443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:13.210759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:13.218535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:13.219277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:13.219975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:13.221185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:13.221881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:13.222403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:13.494456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:13.510227 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06a7af79-305f-47ff-9c9b-32cdd87e2f50 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.302420 Oct 17 15:34:13.510227 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1544/2884] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:13 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:13.594697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:13.596754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:13.607528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:13.608740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:13.609497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:13.610782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:13.611871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:13.612609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:13.761810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:13.785789 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20babb0c-58e0-4ac3-8da6-101d669a0f7a tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1635 microversion: 2.1 time: 0.200036 Oct 17 15:34:13.787388 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1545/2885] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:13 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1635 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:13.857651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:13.862291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:13.891462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:13.893946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:13.894840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:13.896067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:13.896754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:13.899558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:13.909515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:14.234112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:14.245985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:14.247896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:14.249167 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66632660-90ec-41b1-930e-b11949f196ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1281 microversion: 2.25 time: 0.401951 Oct 17 15:34:14.269217 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1546/2886] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:13 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1281 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:14.274544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-149128b1-2308-4965-bbc3-f3fcf3a652d8 req-5f17aba1-bdb7-4d3c-a240-177583bddc3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358b1061-ccb3-435d-81eb-ce398beb8a75", "name": "network-vif-deleted", "tag": "8e472bc8-b3fe-44a5-a84e-d82528a12b96"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:14.290541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-149128b1-2308-4965-bbc3-f3fcf3a652d8 req-5f17aba1-bdb7-4d3c-a240-177583bddc3d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:14.291342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-149128b1-2308-4965-bbc3-f3fcf3a652d8 req-5f17aba1-bdb7-4d3c-a240-177583bddc3d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:14.292025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-149128b1-2308-4965-bbc3-f3fcf3a652d8 req-5f17aba1-bdb7-4d3c-a240-177583bddc3d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:14.308088 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-149128b1-2308-4965-bbc3-f3fcf3a652d8 req-5f17aba1-bdb7-4d3c-a240-177583bddc3d service nova] Creating event network-vif-deleted:8e472bc8-b3fe-44a5-a84e-d82528a12b96 for instance 358b1061-ccb3-435d-81eb-ce398beb8a75 on n-h2-854441-12 Oct 17 15:34:14.315603 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-149128b1-2308-4965-bbc3-f3fcf3a652d8 req-5f17aba1-bdb7-4d3c-a240-177583bddc3d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044860 Oct 17 15:34:14.317583 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1547/2887] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:14.327008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:14.328406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:14.338871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:14.339966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:14.341070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:14.342065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:14.342822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:14.343542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:14.581825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:14.591916 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6028cc4-e87b-433b-aa20-5a14f68812c7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1315 microversion: 2.1 time: 0.272371 Oct 17 15:34:14.595227 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1548/2888] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:14 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:14.616533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37818ce6-9b21-4c0b-aa98-077eefbd4569 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2f4820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:14.670291 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37818ce6-9b21-4c0b-aa98-077eefbd4569 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/0ceef9d3-6c43-4b2a-905c-522c6c9e6d20" status: 200 len: 661 microversion: 2.1 time: 0.073003 Oct 17 15:34:14.680221 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1549/2889] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:14 2022] GET /compute/v2.1/images/0ceef9d3-6c43-4b2a-905c-522c6c9e6d20 => generated 661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:14.685398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:14.686025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:14.692847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:14.693358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:14.693799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:14.694657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:14.695127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:14.695554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:14.911625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:14.926698 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4700eb3d-de96-4222-a89c-6f3a6756d1ac tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.245133 Oct 17 15:34:14.927445 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1550/2890] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:14 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:14.951456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e2447ed-21dc-41a7-a181-71a0f152e8f0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2f4700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:15.017312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e2447ed-21dc-41a7-a181-71a0f152e8f0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/0ceef9d3-6c43-4b2a-905c-522c6c9e6d20" status: 200 len: 661 microversion: 2.1 time: 0.079283 Oct 17 15:34:15.018602 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1551/2891] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:14 2022] GET /compute/v2.1/images/0ceef9d3-6c43-4b2a-905c-522c6c9e6d20 => generated 661 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:15.028554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:15.029786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:15.041469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:15.042257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:15.042979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:15.044122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:15.044719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:15.045290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:15.124610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:15.125652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:15.126406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:15.127220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lazy-loading 'fault' on Instance uuid 358b1061-ccb3-435d-81eb-ce398beb8a75 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:34:15.214437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef506aa8a503449382d7d72fa1916b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9e8d41de3843668933339c133246ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:15.238548 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ae95212-36b4-4a62-8a56-d3f9314d07e6 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 200 len: 1360 microversion: 2.1 time: 0.217763 Oct 17 15:34:15.240262 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1552/2892] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:15 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 1360 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:15.281370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:15.283308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:15.298350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:15.299426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:15.300501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:15.302642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:15.303886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:15.305017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:15.532319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:15.543728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:15.545998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:15.548636 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b6de556-6e01-4597-a286-19a7ac433cc6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1476 microversion: 2.25 time: 0.275287 Oct 17 15:34:15.549812 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1553/2893] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:15 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1476 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:34:15.648864 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f3189dbc-3f6c-457d-95e4-51dad899e1fc tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] 10.222.0.87 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12920 microversion: 2.1 time: 4.452390 Oct 17 15:34:15.649622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1341/2894] 10.222.0.87 () {58 vars in 1191 bytes} [Mon Oct 17 15:34:11 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12920 bytes in 4454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:34:15.656145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:15.657058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:15.672382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:15.672874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:15.673307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:15.674006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:15.674734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:15.675314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:15.854752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:15.867001 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d78f211-c62b-4a76-a163-ca851632aad9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1315 microversion: 2.1 time: 0.215698 Oct 17 15:34:15.879148 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1342/2895] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:15 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:15.889732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0dfb54ee-77a7-488a-b981-3ea5f3d2110c tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] Calling method '.version_select at 0x7f28be426b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:15.911886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:15.912611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:15.919524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:15.920021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:15.920452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:15.921354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:15.921818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:15.922244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.112693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid c05b8d74-dc5f-433d-bd93-328e0511f478 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:34:16.128884 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23995b09-d3f7-49d2-b66b-9a52a52e87f2 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1971 microversion: 2.25 time: 0.558558 Oct 17 15:34:16.129682 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1554/2896] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:15 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1971 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:16.154850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:16.155469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:16.162239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.162849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.163278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.163991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.164715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.165146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.186396 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0dfb54ee-77a7-488a-b981-3ea5f3d2110c tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.306039 Oct 17 15:34:16.187033 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1343/2897] 10.222.0.87 () {58 vars in 1191 bytes} [Mon Oct 17 15:34:15 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:16.192010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:16.192894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:16.200480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.201216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.201641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.202608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.203211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.203779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.365258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:16.395998 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce8ace26-95d3-4341-8987-46c227ba11f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.249841 Oct 17 15:34:16.415007 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1555/2898] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:16 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:16.426555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid c05b8d74-dc5f-433d-bd93-328e0511f478 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:34:16.432815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a47c7f04-458c-4d8d-8f9f-004bee72df46 tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] Calling method '.version_select at 0x7f28be26d3a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:16.455050 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7f79d528-cf4c-495f-ac0e-89cc093af049 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1971 microversion: 2.25 time: 0.265537 Oct 17 15:34:16.461216 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1344/2899] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:16 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1971 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:16.470767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:16.475722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] [instance: 358b1061-ccb3-435d-81eb-ce398beb8a75] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:16.485505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.486008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.486561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.487933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.488421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.488860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.516356 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] HTTP exception thrown: Instance 358b1061-ccb3-435d-81eb-ce398beb8a75 could not be found. Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Request method failure captured: Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 HTTP/1.1 Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXWM-1aMeSHojjRbF0i2_Ny_JBBxbCwC20PLVlimHgT4T4yRoRRBn9sZ3Ta3y2dFVIIDVvMdPT_oIWd4ozqcFyWn-A82gXBW4Fmky1VCMFtSS1KG2Wcjo02CmbONqZI41g0_i5QVwb0L_Q9IzPG4Dxhe3PDtke6bpHpREy-z-e8xLHY Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6d9e8d41de3843668933339c133246ff Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestJSON-943414680 Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6d9e8d41de3843668933339c133246ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6d9e8d41de3843668933339c133246ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6d9e8d41de3843668933339c133246ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6d9e8d41de3843668933339c133246ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestJSON-943414680 Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6d9e8d41de3843668933339c133246ff Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestJSON-943414680 Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestJSON-943414680-project Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ef506aa8a503449382d7d72fa1916b6e Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestJSON-943414680-project Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 358b1061-ccb3-435d-81eb-ce398beb8a75 could not be found. Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '358b1061-ccb3-435d-81eb-ce398beb8a75'} Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 358b1061-ccb3-435d-81eb-ce398beb8a75 could not be found. Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358b1061-ccb3-435d-81eb-ce398beb8a75 could not be found. Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:16.519796 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358b1061-ccb3-435d-81eb-ce398beb8a75 could not be found. Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Returning 404 to user: Instance 358b1061-ccb3-435d-81eb-ce398beb8a75 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3c271fc1-1841-40c8-b7d0-0528f9cb47f9 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75" status: 404 len: 111 microversion: 2.1 time: 0.058863 Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1345/2900] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:16 2022] GET /compute/v2.1/servers/358b1061-ccb3-435d-81eb-ce398beb8a75 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:34:16.529743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f50f3e4b-5b07-4373-b908-b8a76eeefd3c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:16.533110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f50f3e4b-5b07-4373-b908-b8a76eeefd3c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.534978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f50f3e4b-5b07-4373-b908-b8a76eeefd3c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.534978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f50f3e4b-5b07-4373-b908-b8a76eeefd3c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.534978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f50f3e4b-5b07-4373-b908-b8a76eeefd3c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.535715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f50f3e4b-5b07-4373-b908-b8a76eeefd3c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.535715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f50f3e4b-5b07-4373-b908-b8a76eeefd3c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.579565 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f50f3e4b-5b07-4373-b908-b8a76eeefd3c tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.055773 Oct 17 15:34:16.588634 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1346/2901] 10.222.0.87 () {60 vars in 1217 bytes} [Mon Oct 17 15:34:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:34:16.593772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d7b1ee1-2818-4020-8cb5-3dbdb1e4c7b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] Calling method '.version_select at 0x7f28be3ffee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:16.640241 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9d7b1ee1-2818-4020-8cb5-3dbdb1e4c7b2 tempest-ServersTestJSON-943414680 tempest-ServersTestJSON-943414680-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664714901" status: 202 len: 0 microversion: 2.1 time: 0.056856 Oct 17 15:34:16.641166 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1347/2902] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 15:34:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664714901 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:34:16.653178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854441-12", "block_migration": "auto"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:16.657219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:16.673417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.674268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.675088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.677336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.678251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.679345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.731926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'flavor' on Instance uuid c05b8d74-dc5f-433d-bd93-328e0511f478 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:34:16.735182 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a47c7f04-458c-4d8d-8f9f-004bee72df46 tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/d7339591-4da7-4768-90a3-5f7aa8414c3a" status: 202 len: 0 microversion: 2.1 time: 0.318531 Oct 17 15:34:16.736975 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1556/2903] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:34:16 2022] DELETE /compute/v2.1/os-security-groups/d7339591-4da7-4768-90a3-5f7aa8414c3a => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:34:16.753670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f560f943-5b84-4186-a5ba-5f952e56551d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3df280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:16.765107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Going to try to live migrate instance to n-h2-854441-12 {{(pid=120407) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 15:34:16.823287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:16.873531 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f560f943-5b84-4186-a5ba-5f952e56551d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/b7f4e6f8-bcea-4c42-8998-b605a3217ebd" status: 200 len: 662 microversion: 2.1 time: 0.133837 Oct 17 15:34:16.875062 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1557/2904] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:16 2022] GET /compute/v2.1/images/b7f4e6f8-bcea-4c42-8998-b605a3217ebd => generated 662 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:16.886360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c694dd6c-f5f0-4724-9379-1c1d579830f3 req-752c1ffe-0412-4359-aa58-5bc62344a18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66796bdf-a914-42c2-b4cb-576f956f5bd7", "name": "network-vif-plugged", "status": "completed", "tag": "eba218cb-4690-4a0b-ad4f-14ec9a2eca52"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:16.925307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c694dd6c-f5f0-4724-9379-1c1d579830f3 req-752c1ffe-0412-4359-aa58-5bc62344a18d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:16.928959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c694dd6c-f5f0-4724-9379-1c1d579830f3 req-752c1ffe-0412-4359-aa58-5bc62344a18d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:16.932214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c694dd6c-f5f0-4724-9379-1c1d579830f3 req-752c1ffe-0412-4359-aa58-5bc62344a18d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:16.955388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c694dd6c-f5f0-4724-9379-1c1d579830f3 req-752c1ffe-0412-4359-aa58-5bc62344a18d service nova] Creating event network-vif-plugged:eba218cb-4690-4a0b-ad4f-14ec9a2eca52 for instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 on n-h1-854441-12 Oct 17 15:34:16.961398 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c694dd6c-f5f0-4724-9379-1c1d579830f3 req-752c1ffe-0412-4359-aa58-5bc62344a18d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084525 Oct 17 15:34:16.962551 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1558/2905] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:16.967972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e4a0689-39d5-4c39-a9d7-28617e0d3c03 tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] Calling method '.version_select at 0x7f28be3dff70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:17.302347 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e4a0689-39d5-4c39-a9d7-28617e0d3c03 tempest-SecurityGroupsTestAdminJSON-1567028503 tempest-SecurityGroupsTestAdminJSON-1567028503-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/f79e60ad-7af1-4f0a-a774-6fb8d033ce4b" status: 202 len: 0 microversion: 2.1 time: 0.338461 Oct 17 15:34:17.303070 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1559/2906] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:34:16 2022] DELETE /compute/v2.1/os-security-groups/f79e60ad-7af1-4f0a-a774-6fb8d033ce4b => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:34:17.308235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:17.308985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:17.321344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:17.326920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:17.328154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:17.329642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:17.331883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:17.334118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:17.599739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:17.611475 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c8e3346-adec-4e5a-ab0d-7b7bb106dcdd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1315 microversion: 2.1 time: 0.307096 Oct 17 15:34:17.612086 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1560/2907] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:17 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:17.622550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4e643df-50b8-447c-bec4-d05b757805d4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be280940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:17.673252 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4e643df-50b8-447c-bec4-d05b757805d4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/b7f4e6f8-bcea-4c42-8998-b605a3217ebd" status: 200 len: 662 microversion: 2.1 time: 0.059957 Oct 17 15:34:17.674605 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1561/2908] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:17 2022] GET /compute/v2.1/images/b7f4e6f8-bcea-4c42-8998-b605a3217ebd => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:17.678877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c58f34f-bd65-4725-b256-edaeb29d1ad3 tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] Calling method '.version_select at 0x7f28be280790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:17.987106 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c58f34f-bd65-4725-b256-edaeb29d1ad3 tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/5927f3e2-ec68-4ba0-aba9-a90be2ec8fb7" status: 202 len: 0 microversion: 2.1 time: 0.311714 Oct 17 15:34:17.989643 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1562/2909] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:34:17 2022] DELETE /compute/v2.1/os-security-groups/5927f3e2-ec68-4ba0-aba9-a90be2ec8fb7 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:34:17.998881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:18.000108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:18.014579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:18.016287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:18.017590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:18.028691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:18.030614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:18.031652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:18.268075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:18.295735 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b3b0308-457e-47d2-9f77-fd61919e9cba tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.303398 Oct 17 15:34:18.296799 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1563/2910] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:17 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:18.313492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edb41cc0-8d00-4707-8c9d-12a0187e7ae3 tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] Calling method '.version_select at 0x7f28be2bda60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:18.662859 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-edb41cc0-8d00-4707-8c9d-12a0187e7ae3 tempest-SecurityGroupsTestAdminJSON-1466174166 tempest-SecurityGroupsTestAdminJSON-1466174166-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/70983728-4b4f-4bf6-b5d5-6c9bf003113b" status: 202 len: 0 microversion: 2.1 time: 0.357181 Oct 17 15:34:18.665272 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1564/2911] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:34:18 2022] DELETE /compute/v2.1/os-security-groups/70983728-4b4f-4bf6-b5d5-6c9bf003113b => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:34:18.675332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:18.676733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:18.689241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:18.690094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:18.691345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:18.692703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:18.693666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:18.694483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:18.933988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:18.947872 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-238bef9e-622f-4484-a847-ae58c9d35929 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1502 microversion: 2.1 time: 0.279982 Oct 17 15:34:18.949263 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1565/2912] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:18 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1502 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:18.994872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1cff7472-d4d3-4d9c-b15d-1288e2eff650 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:19.018022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cff7472-d4d3-4d9c-b15d-1288e2eff650 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:19.019705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cff7472-d4d3-4d9c-b15d-1288e2eff650 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:19.020490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cff7472-d4d3-4d9c-b15d-1288e2eff650 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:19.083804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1cff7472-d4d3-4d9c-b15d-1288e2eff650 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Going to try to stop instance {{(pid=120406) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 15:34:19.207753 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1cff7472-d4d3-4d9c-b15d-1288e2eff650 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7/action" status: 202 len: 0 microversion: 2.1 time: 0.217636 Oct 17 15:34:19.229538 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1566/2913] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:34:18 2022] POST /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:34:19.251838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:19.256274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:19.269529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:19.270694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:19.271592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:19.274751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:19.275583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:19.276922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:19.596692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:19.614346 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20e19d8d-3fe6-4d36-bb78-57057b804c57 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.375947 Oct 17 15:34:19.615188 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1567/2914] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:19 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:19.630306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:19.631879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:19.649536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:19.650629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:19.651022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:19.651774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:19.652242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:19.652676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:19.824692 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7330d49e-f6a4-4e62-b46c-f9f9634646e1 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478/action" status: 202 len: 0 microversion: 2.25 time: 3.178100 Oct 17 15:34:19.826122 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1348/2915] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:34:16 2022] POST /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478/action => generated 0 bytes in 3184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:34:19.844878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e057e054-50a3-46f9-ad1f-c091efb1cbd3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be413700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:19.985461 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e057e054-50a3-46f9-ad1f-c091efb1cbd3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/f54f171b-f57b-422f-b1a3-e10e7ddc04ad" status: 200 len: 662 microversion: 2.1 time: 0.156903 Oct 17 15:34:19.988563 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1349/2916] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:19 2022] GET /compute/v2.1/images/f54f171b-f57b-422f-b1a3-e10e7ddc04ad => generated 662 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:20.020574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:20.029266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:20.034635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:20.060370 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4cb3c722-4b12-4751-a84f-0a5098637270 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.443290 Oct 17 15:34:20.062927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:20.063467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:20.063927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:20.066950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:20.069173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:20.072129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:20.079148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1568/2917] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:19 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:20.104812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3760be34-dc24-4c51-b74c-d3849f69d3b0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be41dc10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:20.221345 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3760be34-dc24-4c51-b74c-d3849f69d3b0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/f54f171b-f57b-422f-b1a3-e10e7ddc04ad" status: 200 len: 662 microversion: 2.1 time: 0.139705 Oct 17 15:34:20.222885 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1569/2918] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:20 2022] GET /compute/v2.1/images/f54f171b-f57b-422f-b1a3-e10e7ddc04ad => generated 662 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:20.445431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1286939381", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:20.580066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:34:20.976043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:34:20.976887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:34:20.977554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:34:20.977970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:34:20.978382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:34:20.985889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:20.993189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:20.994102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:20.994804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:20.996114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:20.997081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:20.997869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:21.002838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:21.005484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:21.007960 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb34b95d-82dc-4b63-ba7e-2794043d26d6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.017173 Oct 17 15:34:21.008848 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1350/2919] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:19 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:21.019668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:21.021902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:21.035505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Getting quotas for project 84785781b05d481f84a9c3106647123e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:34:21.042752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Getting quotas for user 760daef1285a42ce8b52668549f9d7e9 and project 84785781b05d481f84a9c3106647123e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:34:21.056650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:21.057487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:21.058782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:21.060168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:21.061231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:21.062755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:21.066360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:34:21.071159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:34:21.142216 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b7b658a-8921-4079-ba77-c00a770f0057 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707732 Oct 17 15:34:21.154594 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1570/2920] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:34:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:34:21.161944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:21.166158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:21.183091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:21.183974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:21.184644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:21.187302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:21.190153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:21.191022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:21.391744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:21.400833 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bc5e5aa-a8be-4e5e-be65-126925010fdf tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.252248 Oct 17 15:34:21.402069 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1571/2921] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:21 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:21.411763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-968939962", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:21.488859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:34:21.525641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:21.536249 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-467b9f2f-d382-403c-bdbe-58528d490862 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.525485 Oct 17 15:34:21.537147 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1351/2922] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:21 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:21.853103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:34:21.853986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:34:21.855030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:34:21.855742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:34:21.856354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:34:21.877447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:21.880468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:21.882779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:21.888062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:21.890428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:21.892628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:21.921502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:21.960076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Getting quotas for project 84785781b05d481f84a9c3106647123e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:34:21.966718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Getting quotas for user 760daef1285a42ce8b52668549f9d7e9 and project 84785781b05d481f84a9c3106647123e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:34:21.997888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:34:22.000250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:34:22.024425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:22.076768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:22.081844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:22.115063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:22.120329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:22.122098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:22.128743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:22.133140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:22.137247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:22.167865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f51c1a6f-b728-492d-bb57-3a38191dc6c5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745883 Oct 17 15:34:22.170054 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1572/2923] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:34:22.186821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82a81281-2439-4f4f-a006-6dd4eeb3778b tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:22.189659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82a81281-2439-4f4f-a006-6dd4eeb3778b tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:22.364590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82a81281-2439-4f4f-a006-6dd4eeb3778b tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:22.386432 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82a81281-2439-4f4f-a006-6dd4eeb3778b tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1217 microversion: 2.1 time: 0.208250 Oct 17 15:34:22.389325 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1573/2924] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:22 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:22.443123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:22.444515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:22.462404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:22.464654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:22.465822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:22.467592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:22.469225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:22.470228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:22.972841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:23.012335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bba6095b-eb75-49a3-9106-1244d669c56c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.575748 Oct 17 15:34:23.023249 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1574/2925] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:22 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:23.058241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:23.079076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:23.126447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:23.138780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:23.147886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:23.150817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:23.156820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:23.159618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:23.226740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:23.246656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:23.253022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:23.254593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-256dca36-a95b-4f40-b0cb-bcbb52e1f937 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.194626 Oct 17 15:34:23.257377 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1352/2926] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:22 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:23.414540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:23.415411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:23.430609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:23.434466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:23.435910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:23.436886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:23.439919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:23.444448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:23.599085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:23.624982 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c38ccc54-5c23-4118-9392-f7fc26a179cf tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.597227 Oct 17 15:34:23.626413 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1575/2927] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:23 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:23.894223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:23.930938 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fda21d6f-391d-42b3-a8f5-f21b926e3096 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1221 microversion: 2.1 time: 0.521181 Oct 17 15:34:23.942437 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1353/2928] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:23 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1221 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:24.049540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:24.056283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:24.107461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:24.108382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:24.109156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:24.110428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:24.122426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:24.123687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:24.319429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:24.332277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:24.374287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:24.382732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:24.384573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:24.386318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:24.387791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:24.390977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:24.475295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:24.485630 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0df31fd0-c0f9-4136-844e-3482b37bf2fa tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.447334 Oct 17 15:34:24.509964 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1576/2929] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:24 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:24.650170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:24.652068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:24.668428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:24.669597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:24.675283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:24.676281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:24.676843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:24.677360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:24.968164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:24.987175 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a2dac27-93d9-474c-99cb-e057e7867f93 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.332889 Oct 17 15:34:24.999714 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1577/2930] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:24 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:25.010030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:25.010815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:25.027152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:25.027984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:25.028655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:25.031907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:25.032671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:25.039302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:25.174079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:25.185865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a02647f7-0bbb-494c-974b-7b459e760a69 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1269 microversion: 2.1 time: 0.184885 Oct 17 15:34:25.186490 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1578/2931] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:24 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1269 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:25.403237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:25.406631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:25.416222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:25.436744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:25.443791 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-13793b59-71f5-4345-bf40-eba855a4636c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.137604 Oct 17 15:34:25.452124 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1354/2932] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:24 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:25.517373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:25.518014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:25.557606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:25.561513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:25.576487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:25.577502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:25.583533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:25.584538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.192908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-354903f4-f29e-4e75-810f-4ffc30bd2ed7 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:26.203670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-354903f4-f29e-4e75-810f-4ffc30bd2ed7 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.204262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-354903f4-f29e-4e75-810f-4ffc30bd2ed7 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.204798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-354903f4-f29e-4e75-810f-4ffc30bd2ed7 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.205642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-354903f4-f29e-4e75-810f-4ffc30bd2ed7 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.206270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-354903f4-f29e-4e75-810f-4ffc30bd2ed7 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.214895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-354903f4-f29e-4e75-810f-4ffc30bd2ed7 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.226832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:26.263996 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-030720a7-4e59-4ca1-ac47-591df2d92b5f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.746599 Oct 17 15:34:26.269238 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1579/2933] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:25 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:26.273026 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-354903f4-f29e-4e75-810f-4ffc30bd2ed7 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.582756 Oct 17 15:34:26.273653 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1355/2934] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:34:25 2022] GET /compute/v2.1/os-services => generated 949 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:34:26.289681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:26.290315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:26.292040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:26.295638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:26.314773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.315271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.315715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.316473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.316904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.317334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.325672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.327841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.330026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.332252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.335795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.336531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.542968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:26.576214 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3f114bc5-d01d-4ba3-b9fa-30808ad132f8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1275 microversion: 2.1 time: 0.292082 Oct 17 15:34:26.593387 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1356/2935] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:26 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1275 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:26.617565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd106df1-2476-472e-8a64-6f4dc1802cb5 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:26.621516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd106df1-2476-472e-8a64-6f4dc1802cb5 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.622018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd106df1-2476-472e-8a64-6f4dc1802cb5 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.622443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd106df1-2476-472e-8a64-6f4dc1802cb5 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.623227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd106df1-2476-472e-8a64-6f4dc1802cb5 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.637426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd106df1-2476-472e-8a64-6f4dc1802cb5 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.641604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd106df1-2476-472e-8a64-6f4dc1802cb5 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.823874 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd106df1-2476-472e-8a64-6f4dc1802cb5 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.228133 Oct 17 15:34:26.825242 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1357/2936] 10.222.0.87 () {58 vars in 1170 bytes} [Mon Oct 17 15:34:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:26.855034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f7037ab-b583-4925-a1cc-b9da9d6cfdfa tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55583328-b2ef-4727-926f-6587dc0ccc2e"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:26.860678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f7037ab-b583-4925-a1cc-b9da9d6cfdfa tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:26.871909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f7037ab-b583-4925-a1cc-b9da9d6cfdfa tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.873146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f7037ab-b583-4925-a1cc-b9da9d6cfdfa tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.874049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f7037ab-b583-4925-a1cc-b9da9d6cfdfa tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.876033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f7037ab-b583-4925-a1cc-b9da9d6cfdfa tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.877417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f7037ab-b583-4925-a1cc-b9da9d6cfdfa tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.879348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f7037ab-b583-4925-a1cc-b9da9d6cfdfa tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.900376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:26.917144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8305da0-39a9-40e8-92f3-3276892e9471 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.645618 Oct 17 15:34:26.935879 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1580/2937] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:26 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:26.941902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:26.942889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:26.951986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.952759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.953401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:26.954305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:26.957775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:26.958536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:27.310973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:27.355465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:27.363981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:27.369922 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e872987-8a77-4917-9236-9bbd35b07ecb tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.428973 Oct 17 15:34:27.374885 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1581/2938] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:26 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:27.399180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec6396c9-a6b7-4e67-b52d-05d87cc8a756 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:27.414368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec6396c9-a6b7-4e67-b52d-05d87cc8a756 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:27.420059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec6396c9-a6b7-4e67-b52d-05d87cc8a756 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:27.422042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec6396c9-a6b7-4e67-b52d-05d87cc8a756 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:27.424218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec6396c9-a6b7-4e67-b52d-05d87cc8a756 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:27.429970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec6396c9-a6b7-4e67-b52d-05d87cc8a756 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:27.431201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec6396c9-a6b7-4e67-b52d-05d87cc8a756 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:27.496512 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec6396c9-a6b7-4e67-b52d-05d87cc8a756 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.119486 Oct 17 15:34:27.498049 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1582/2939] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:34:27 2022] GET /compute/v2.1/os-services => generated 949 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:27.508072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:27.509661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:27.524204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:27.526904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:27.528026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:27.529611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:27.530858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:27.532849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:27.635714 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f7037ab-b583-4925-a1cc-b9da9d6cfdfa tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "POST /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796022 Oct 17 15:34:27.648013 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1358/2940] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:34:26 2022] POST /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:27.667888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c4e9bd6c-d949-460d-9d26-c3301cd6b10a tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:27.706922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4e9bd6c-d949-460d-9d26-c3301cd6b10a tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:27.710331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4e9bd6c-d949-460d-9d26-c3301cd6b10a tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:27.714726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4e9bd6c-d949-460d-9d26-c3301cd6b10a tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:27.716364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4e9bd6c-d949-460d-9d26-c3301cd6b10a tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:27.722172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4e9bd6c-d949-460d-9d26-c3301cd6b10a tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:27.728063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c4e9bd6c-d949-460d-9d26-c3301cd6b10a tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:27.876518 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c4e9bd6c-d949-460d-9d26-c3301cd6b10a tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?host=n-d-854441-12&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.225845 Oct 17 15:34:27.881540 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1359/2941] 10.222.0.87 () {58 vars in 1196 bytes} [Mon Oct 17 15:34:27 2022] GET /compute/v2.1/os-services?host=n-d-854441-12&binary=xxx => generated 16 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:34:27.908577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:27.913654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:27.955100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:27.956054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:27.956913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:27.962306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:27.963261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:27.970343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:28.211537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:28.250311 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee7171c3-7ea2-4f5d-8649-39e104346adb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1275 microversion: 2.1 time: 0.364173 Oct 17 15:34:28.268484 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1360/2942] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:27 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1275 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:28.297790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:28.299832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b29e47c-7456-44c5-809b-5f2eb12a5eff tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:28.307551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b29e47c-7456-44c5-809b-5f2eb12a5eff tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:28.308628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b29e47c-7456-44c5-809b-5f2eb12a5eff tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:28.309467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b29e47c-7456-44c5-809b-5f2eb12a5eff tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:28.311629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b29e47c-7456-44c5-809b-5f2eb12a5eff tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:28.312940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b29e47c-7456-44c5-809b-5f2eb12a5eff tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:28.313737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b29e47c-7456-44c5-809b-5f2eb12a5eff tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:28.323335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f10b6d8-1f87-4b7a-898b-b9bb8f9d1a8f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.823128 Oct 17 15:34:28.329766 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1583/2943] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:27 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:28.352209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:28.365908 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1b29e47c-7456-44c5-809b-5f2eb12a5eff tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.096743 Oct 17 15:34:28.367216 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1361/2944] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:34:28 2022] GET /compute/v2.1/os-services => generated 949 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:28.368085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:28.379946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9aa1f629-d993-41de-85a4-be51c9a2e7f1 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:28.393039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa1f629-d993-41de-85a4-be51c9a2e7f1 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:28.394532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa1f629-d993-41de-85a4-be51c9a2e7f1 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:28.395556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa1f629-d993-41de-85a4-be51c9a2e7f1 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:28.396602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa1f629-d993-41de-85a4-be51c9a2e7f1 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:28.397332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa1f629-d993-41de-85a4-be51c9a2e7f1 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:28.397946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aa1f629-d993-41de-85a4-be51c9a2e7f1 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:28.408820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:28.413446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:28.414254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:28.415628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:28.416473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:28.417187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:28.437355 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9aa1f629-d993-41de-85a4-be51c9a2e7f1 tempest-ServicesAdminNegativeTestJSON-20140802 tempest-ServicesAdminNegativeTestJSON-20140802-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.061163 Oct 17 15:34:28.439619 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1362/2945] 10.222.0.87 () {58 vars in 1198 bytes} [Mon Oct 17 15:34:28 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:34:28.445377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:28.446780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:28.455464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:28.456262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:28.457284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:28.458587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:28.459884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:28.460545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:28.933520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:28.967185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:28.970854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:28.973307 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9ee1cf8-2166-4556-a8bf-0983a39c767e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.532120 Oct 17 15:34:28.974753 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1363/2946] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:28 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:29.612957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfc9f06d-8c31-48d2-91e9-f0bbf9f7bbaf tempest-ServicesAdminNegativeTestJSON-1013513602 tempest-ServicesAdminNegativeTestJSON-1013513602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:29.629507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dfc9f06d-8c31-48d2-91e9-f0bbf9f7bbaf tempest-ServicesAdminNegativeTestJSON-1013513602 tempest-ServicesAdminNegativeTestJSON-1013513602-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a2cd5c97719a4e828a87dbfa8d82d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ee3d4b67424d53bcb51d29139399db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfc9f06d-8c31-48d2-91e9-f0bbf9f7bbaf tempest-ServicesAdminNegativeTestJSON-1013513602 tempest-ServicesAdminNegativeTestJSON-1013513602-project] Request method failure captured: Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXX_GxFmP8zyCJgYE4TYD27hAlrCsahQSf14I1kznEt1vT57ig3b6cG8PpR8wdkHksHSGWYtMzXReRQyiLsi4gTklP3TAjuz3j1IAP8c3GtzXAv5ZEmF310vH8ImeiDHTma-OG19N-QBbyj3RR16mXPGX57qqua_-Lya7_0Nz_eXYcI Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 44ee3d4b67424d53bcb51d29139399db Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1013513602 Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44ee3d4b67424d53bcb51d29139399db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/44ee3d4b67424d53bcb51d29139399db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_44ee3d4b67424d53bcb51d29139399db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/44ee3d4b67424d53bcb51d29139399db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1013513602 Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 44ee3d4b67424d53bcb51d29139399db Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1013513602 Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServicesAdminNegativeTestJSON-1013513602-project Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a2cd5c97719a4e828a87dbfa8d82d5a9 Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1013513602-project Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: action_args: {} Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 15:34:29.633635 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:29.639538 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:29.639538 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:29.639538 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:29.639538 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:29.639538 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:29.639538 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 15:34:29.639538 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 15:34:29.639538 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 15:34:29.639538 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:29.646978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfc9f06d-8c31-48d2-91e9-f0bbf9f7bbaf tempest-ServicesAdminNegativeTestJSON-1013513602 tempest-ServicesAdminNegativeTestJSON-1013513602-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:29.648845 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dfc9f06d-8c31-48d2-91e9-f0bbf9f7bbaf tempest-ServicesAdminNegativeTestJSON-1013513602 tempest-ServicesAdminNegativeTestJSON-1013513602-project] 10.222.0.87 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.671279 Oct 17 15:34:29.655608 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1364/2947] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:34:28 2022] GET /compute/v2.1/os-services => generated 112 bytes in 674 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:34:29.661801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:29.663026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:29.680779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:29.692096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:29.692946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:29.693770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:29.695194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:29.696168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:29.696932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:29.702182 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0047c793-f641-42c3-b5cc-506488057a92 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 1.370468 Oct 17 15:34:29.702862 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1584/2948] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:28 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:29.716502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:29.716502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:29.717360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:29.718229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:29.719004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:29.720080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:29.720773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:29.721417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:30.277023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:30.305976 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8ce28d7-692d-4d10-b2f5-afb022746dc0 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1505 microversion: 2.1 time: 0.600963 Oct 17 15:34:30.313108 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1585/2949] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:29 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:30.322471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:30.325187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:30.343369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:30.344221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:30.345811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:30.346988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:30.348765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:30.349433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:30.558680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:30.578149 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-358cbb87-cd81-4a8a-ad54-1a2964bce5a2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1317 microversion: 2.1 time: 0.926311 Oct 17 15:34:30.580161 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1365/2950] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:29 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1317 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:30.759616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:30.764654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:30.811313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:30.813745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:30.815633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:30.818760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:30.820692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:30.824288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:30.940760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:30.961930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:30.964915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:30.967741 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-880b5e36-23fd-4489-b0d5-b8a9ca104631 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.659214 Oct 17 15:34:30.969970 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1586/2951] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:30 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:30.984637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-51fc12cf-5685-4e5e-9d5f-f1dab8553a6e req-0090d363-99b8-48cc-be0d-c4e90ab0c2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa21afee-1c0c-49b3-b91c-bf7fa5438381", "tag": "8a3944bf-786e-467e-8893-ff95b6e28ff0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:31.014260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-51fc12cf-5685-4e5e-9d5f-f1dab8553a6e req-0090d363-99b8-48cc-be0d-c4e90ab0c2b1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:31.015303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-51fc12cf-5685-4e5e-9d5f-f1dab8553a6e req-0090d363-99b8-48cc-be0d-c4e90ab0c2b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:31.016929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-51fc12cf-5685-4e5e-9d5f-f1dab8553a6e req-0090d363-99b8-48cc-be0d-c4e90ab0c2b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:31.085517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-51fc12cf-5685-4e5e-9d5f-f1dab8553a6e req-0090d363-99b8-48cc-be0d-c4e90ab0c2b1 service nova] Creating event network-changed:8a3944bf-786e-467e-8893-ff95b6e28ff0 for instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 on n-h2-854441-12 Oct 17 15:34:31.119704 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-51fc12cf-5685-4e5e-9d5f-f1dab8553a6e req-0090d363-99b8-48cc-be0d-c4e90ab0c2b1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143451 Oct 17 15:34:31.125726 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1587/2952] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:31.342022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:31.345838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:31.349337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:31.362798 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-64c18c12-09c2-4780-bbfd-dd401f75af7f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.617482 Oct 17 15:34:31.363854 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1366/2953] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:30 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:31.376172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:31.376687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:31.377288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:31.378322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:31.378985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:31.379492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:31.604716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:31.605389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:31.609563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:31.614105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:31.614667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:31.615115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:31.615881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:31.616339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:31.616770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:31.774446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:31.790680 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d77274e-ad50-4131-aefa-b48e982d80bb tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1485 microversion: 2.1 time: 0.461612 Oct 17 15:34:31.793947 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1588/2954] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:31 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1485 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:31.978424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:31.991658 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d5b9ec04-9306-4628-b2a5-ec574c0425d6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1317 microversion: 2.1 time: 0.390789 Oct 17 15:34:31.992269 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1367/2955] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:31 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:32.001833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:32.002955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:32.024097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:32.024674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:32.030986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:32.034453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:32.037304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:32.041077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:32.144062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-256720116", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:32.287064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] validate_networks() for [('aeb48324-2e34-47ca-a64a-f14801e654f3', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:34:32.383380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:32.504936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:32.524550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:32.526888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:32.531802 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6fc7fddb-fe0b-47a0-b513-d10baaeaaae9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.533932 Oct 17 15:34:32.533236 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1589/2956] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:31 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:32.543456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-10d0d668-cd72-4d18-a8fb-285b4d2e3e07 req-ff0a41b3-e79b-4ddd-93ab-c1539bb8349d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43cdafe-be87-49e3-be6d-d64b0f3b45f4", "tag": "2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:32.557762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-10d0d668-cd72-4d18-a8fb-285b4d2e3e07 req-ff0a41b3-e79b-4ddd-93ab-c1539bb8349d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:32.558855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-10d0d668-cd72-4d18-a8fb-285b4d2e3e07 req-ff0a41b3-e79b-4ddd-93ab-c1539bb8349d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:32.559666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-10d0d668-cd72-4d18-a8fb-285b4d2e3e07 req-ff0a41b3-e79b-4ddd-93ab-c1539bb8349d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:32.579006 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-10d0d668-cd72-4d18-a8fb-285b4d2e3e07 req-ff0a41b3-e79b-4ddd-93ab-c1539bb8349d service nova] Creating event network-changed:2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43 for instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 on n-h2-854441-12 Oct 17 15:34:32.590021 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-10d0d668-cd72-4d18-a8fb-285b4d2e3e07 req-ff0a41b3-e79b-4ddd-93ab-c1539bb8349d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054677 Oct 17 15:34:32.596031 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1590/2957] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:32.603444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:32.604575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:32.617415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:32.618566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:32.627719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:32.631595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:32.632132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:32.633501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:32.888352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:32.907695 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-664c8682-d76f-40c1-8ae6-8f5f2858dba0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.309969 Oct 17 15:34:32.922881 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1591/2958] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:32 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:33.161000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:34:33.161947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:34:33.163536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:34:33.164930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:34:33.167356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:34:33.187236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:33.188469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:33.189296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:33.190837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:33.192026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:33.194112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:33.206311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b493424-dd18-48d0-aa06-8ed067dd24ec tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1686509118", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:33.215756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5b493424-dd18-48d0-aa06-8ed067dd24ec tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] HTTP exception thrown: min_count must be <= max_count Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b493424-dd18-48d0-aa06-8ed067dd24ec tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Request method failure captured: Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 184 Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXYIH_dxIiklbJD9WP5rCHtH1ixhcQtfGhhqiyMOVYf3rV9JcPfFCMgZFBL8nTY4Fi5BWRWFzY7ZeAt3iaxhZ1pLStTMLzTMMElZhDQv0mwmUjhLaMe79cV85YnW4rZ2PgzevdKPIW4fY2zfTJawUCIPFNGakb5YLh8N3BMLWNvdFWM Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: c5c993a86f2e4411b1203f213baace19 Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1686509118", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: exception: min_count must be <= max_count Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1686509118', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 17 15:34:33.222837 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.233349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Getting quotas for project 66fbb247e57942cf8c6e76c9c6a2f499. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:34:33.239680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b493424-dd18-48d0-aa06-8ed067dd24ec tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Returning 400 to user: min_count must be <= max_count {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:33.241913 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b493424-dd18-48d0-aa06-8ed067dd24ec tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.317144 Oct 17 15:34:33.243740 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1592/2959] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:34:32 2022] POST /compute/v2.1/servers => generated 74 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:34:33.257089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:33.259056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:33.268219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Getting quotas for user d72b67f070cb43f69c568a3d38f02463 and project 66fbb247e57942cf8c6e76c9c6a2f499. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:34:33.279770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:33.280669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:33.281338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:33.283248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:33.284318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:33.284966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:33.301596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:34:33.307957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:34:33.394393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:33.497397 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-84c42edb-74e1-406d-8fbd-34c24393c2d3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.358219 Oct 17 15:34:33.499134 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1368/2960] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:34:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:34:33.509999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fda845a4-7cd6-4f8a-94c6-b6e1cdb3b765 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-12100531", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "max_count": 0}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fda845a4-7cd6-4f8a-94c6-b6e1cdb3b765 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Request method failure captured: Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 166 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYIH_dxIiklbJD9WP5rCHtH1ixhcQtfGhhqiyMOVYf3rV9JcPfFCMgZFBL8nTY4Fi5BWRWFzY7ZeAt3iaxhZ1pLStTMLzTMMElZhDQv0mwmUjhLaMe79cV85YnW4rZ2PgzevdKPIW4fY2zfTJawUCIPFNGakb5YLh8N3BMLWNvdFWM Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: c5c993a86f2e4411b1203f213baace19 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-12100531", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "max_count": 0}} Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-12100531', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'max_count': 0}}} Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 0 Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:34:33.519075 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fda845a4-7cd6-4f8a-94c6-b6e1cdb3b765 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:33.523608 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fda845a4-7cd6-4f8a-94c6-b6e1cdb3b765 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020820 Oct 17 15:34:33.538670 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1369/2961] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:34:33 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:34:33.556582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d9e5e366-8843-4bdb-83c2-3261ce526697 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:33.558464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d9e5e366-8843-4bdb-83c2-3261ce526697 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:33.830416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d9e5e366-8843-4bdb-83c2-3261ce526697 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:33.891586 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d9e5e366-8843-4bdb-83c2-3261ce526697 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1213 microversion: 2.1 time: 0.350479 Oct 17 15:34:33.893076 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1370/2962] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:33 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1213 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:33.907502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:33.910665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:33.929001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:33.929538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:33.929993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:33.930941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:33.931394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:33.931829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:34.209493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:34.225399 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca0ec0fc-626a-41ef-92d8-a6fc5e08467f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1317 microversion: 2.1 time: 0.978356 Oct 17 15:34:34.226261 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1593/2963] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:33 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1317 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:34.237084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ad7451a-4208-40a4-b45f-51b814376ce8 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-913591852", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "max_count": 2.5}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ad7451a-4208-40a4-b45f-51b814376ce8 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Request method failure captured: Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 169 Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXYIH_dxIiklbJD9WP5rCHtH1ixhcQtfGhhqiyMOVYf3rV9JcPfFCMgZFBL8nTY4Fi5BWRWFzY7ZeAt3iaxhZ1pLStTMLzTMMElZhDQv0mwmUjhLaMe79cV85YnW4rZ2PgzevdKPIW4fY2zfTJawUCIPFNGakb5YLh8N3BMLWNvdFWM Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: c5c993a86f2e4411b1203f213baace19 Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-913591852", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "max_count": 2.5}} Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-913591852', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'max_count': 2.5}}} Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 2.5 Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:34:34.247880 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 15:34:34.252590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.260610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ad7451a-4208-40a4-b45f-51b814376ce8 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:34.261911 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ad7451a-4208-40a4-b45f-51b814376ce8 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029263 Oct 17 15:34:34.269454 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1594/2964] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:34:34 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:34:34.288598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:34.289819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:34.782734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:34.811290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:34.813739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:34.815657 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2f70afac-1071-4a1d-aae0-11cbe193a93e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.918339 Oct 17 15:34:34.818899 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1371/2965] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:33 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:34.824900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04e4ca3b-0735-4afe-a437-42bb3e849f32 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1003776414", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 0}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04e4ca3b-0735-4afe-a437-42bb3e849f32 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Request method failure captured: Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 168 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYIH_dxIiklbJD9WP5rCHtH1ixhcQtfGhhqiyMOVYf3rV9JcPfFCMgZFBL8nTY4Fi5BWRWFzY7ZeAt3iaxhZ1pLStTMLzTMMElZhDQv0mwmUjhLaMe79cV85YnW4rZ2PgzevdKPIW4fY2zfTJawUCIPFNGakb5YLh8N3BMLWNvdFWM Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: c5c993a86f2e4411b1203f213baace19 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1003776414", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 0}} Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1003776414', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'min_count': 0}}} Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 0 Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:34:34.849589 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 15:34:34.853797 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:34.855452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04e4ca3b-0735-4afe-a437-42bb3e849f32 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:34.856725 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-04e4ca3b-0735-4afe-a437-42bb3e849f32 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.036220 Oct 17 15:34:34.865877 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1372/2966] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:34:34 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:34:34.941742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:34.942634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:34.954467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:34.955323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:34.955953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:34.957136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:34.966833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:34.967415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:35.141733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:35.158218 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ec5a0afb-4df2-4334-857e-f6bbd86d0455 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1217 microversion: 2.1 time: 0.220957 Oct 17 15:34:35.161369 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1373/2967] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:34 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:35.167973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2356a1c0-4acb-4442-97e4-5245fe042dc7 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-704969937", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 2.5}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2356a1c0-4acb-4442-97e4-5245fe042dc7 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Request method failure captured: Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 169 Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYIH_dxIiklbJD9WP5rCHtH1ixhcQtfGhhqiyMOVYf3rV9JcPfFCMgZFBL8nTY4Fi5BWRWFzY7ZeAt3iaxhZ1pLStTMLzTMMElZhDQv0mwmUjhLaMe79cV85YnW4rZ2PgzevdKPIW4fY2zfTJawUCIPFNGakb5YLh8N3BMLWNvdFWM Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dabce8a45c3f4f5d89ee2255dcb31c8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: dabce8a45c3f4f5d89ee2255dcb31c8b Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1029483480 Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: c5c993a86f2e4411b1203f213baace19 Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1029483480-project Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-704969937", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 2.5}} Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-704969937', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'min_count': 2.5}}} Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 2.5 Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:34:35.179775 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 15:34:35.183578 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:34:35.192628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2356a1c0-4acb-4442-97e4-5245fe042dc7 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:34:35.193981 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2356a1c0-4acb-4442-97e4-5245fe042dc7 tempest-MultipleCreateNegativeTestJSON-1029483480 tempest-MultipleCreateNegativeTestJSON-1029483480-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.031168 Oct 17 15:34:35.195642 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1374/2968] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:34:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:34:35.242378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:35.244639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:35.245906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:35.249809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:35.252149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:35.253782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:35.290186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:35.290858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:35.309378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:35.320985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:35.322834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:35.323904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:35.325417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:35.331299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:35.925480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:35.956632 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d818efb5-8735-4e85-aa2e-2ef938e5be53 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 1.682755 Oct 17 15:34:35.960356 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1595/2969] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:34 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:35.966255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:35.978828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:35.979870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:35.987920 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ba2e9eb-8e7d-4957-8303-52fa4d5ace5a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1317 microversion: 2.1 time: 0.701419 Oct 17 15:34:35.989368 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1375/2970] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:35 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:35.998262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:35.999405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:36.000310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:36.001384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:36.001854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:36.002568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:36.198541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:36.199783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:36.221788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:36.222887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:36.223641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:36.224613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:36.225575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:36.226944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:36.354766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:36.385423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:36.394207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:36.400471 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e9e33b7-685c-4bcb-8dcf-88c18accffab tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.436378 Oct 17 15:34:36.403720 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1596/2971] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:35 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:36.495626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:36.513096 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2b1659d-685d-4ed4-ba35-f7faec674132 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1265 microversion: 2.1 time: 0.319216 Oct 17 15:34:36.514075 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1376/2972] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:36 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1265 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:37.016512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:37.017581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:37.032623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:37.034444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:37.051871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:37.052793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:37.053606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:37.055541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:37.056650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:37.057326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:37.058491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:37.059492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:37.060299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:37.061400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:37.062608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:37.063366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:37.451033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:37.509816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:37.551940 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b606e0c-0c08-4085-996d-4906f11f1236 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.543484 Oct 17 15:34:37.567588 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1597/2973] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:37 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:37.586005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:37.592966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:37.613303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:37.616291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:37.617916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:37.621260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:37.622572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:37.623704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:37.648818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:37.661827 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c4d07d0-6cee-45cd-ba8d-361fa6ea8cca tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1317 microversion: 2.1 time: 0.633143 Oct 17 15:34:37.665863 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1377/2974] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:37 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:37.676622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:37.679901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:37.695977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:37.697692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:37.698191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:37.701564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:37.702078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:37.704379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:37.895958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:37.911133 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f6e39af-ba42-4ee9-bb09-29df18801771 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1271 microversion: 2.1 time: 0.243610 Oct 17 15:34:37.916140 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1378/2975] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:37 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1271 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:37.929215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:37.941969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:37.944698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:37.946705 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ce3e0b5-127c-44c9-8cc6-413f432085fa tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.376939 Oct 17 15:34:37.948308 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1598/2976] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:37 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:38.597361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:38.601291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:38.639991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:38.643225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:38.645346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:38.650709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:38.653468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:38.655443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:38.673565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:38.689801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:38.690738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:38.715157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:38.716535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:38.717641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:38.725060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:38.732800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:38.735515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:39.234150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:39.261386 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6c9c0f2e-bcad-4567-9938-3f325f800024 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.677399 Oct 17 15:34:39.262376 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1379/2977] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:38 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:39.279085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:39.280935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:39.316488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:39.317511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:39.318446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:39.319718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:39.321219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:39.321900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:39.924549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:39.945418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:39.955189 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09891273-356e-485a-aebb-ac2cd8bb32df tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1317 microversion: 2.1 time: 1.269099 Oct 17 15:34:39.963531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1599/2978] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:38 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1317 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:39.974634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:39.975382 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-53661b0c-d1aa-4120-b4a3-67f8ff31f8b7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1313 microversion: 2.1 time: 0.700817 Oct 17 15:34:39.978901 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1380/2979] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:39 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1313 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:39.987331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:40.013324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:40.014776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:40.015893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:40.018065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:40.019306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:40.020376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:40.302092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:40.307056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:40.338891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:40.344767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:40.349906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:40.352372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:40.356688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:40.361106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:41.001675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:41.021321 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ce86a862-7536-4dfa-956e-4b0c50ff5884 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.724133 Oct 17 15:34:41.023757 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1381/2980] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:40 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:41.042050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8f0d8219-bfb4-424f-9d4b-934d5b518922 req-e47ac814-4b7a-4b94-b554-c5a615b15ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43cdafe-be87-49e3-be6d-d64b0f3b45f4", "name": "network-vif-plugged", "status": "completed", "tag": "2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:41.072369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:41.090805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8f0d8219-bfb4-424f-9d4b-934d5b518922 req-e47ac814-4b7a-4b94-b554-c5a615b15ae2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:41.091317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8f0d8219-bfb4-424f-9d4b-934d5b518922 req-e47ac814-4b7a-4b94-b554-c5a615b15ae2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:41.092451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:41.096552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8f0d8219-bfb4-424f-9d4b-934d5b518922 req-e47ac814-4b7a-4b94-b554-c5a615b15ae2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:41.099312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:41.103566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7591b9ed-b66b-4d55-94ad-00f37b7114d9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.138198 Oct 17 15:34:41.107522 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1600/2981] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:39 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:41.123684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5fb8c9f0-2a63-4f53-b1a9-3602651f1015 req-1a16b554-ec20-480b-a15a-984875fe12db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad9d856-6811-4d1b-a6a5-7a4065f5c209", "tag": "0a94060f-7ed4-4f6b-bfce-136b14e90e29"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:41.140506 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8f0d8219-bfb4-424f-9d4b-934d5b518922 req-e47ac814-4b7a-4b94-b554-c5a615b15ae2 service nova] Creating event network-vif-plugged:2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43 for instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 on n-h2-854441-12 Oct 17 15:34:41.161222 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8f0d8219-bfb4-424f-9d4b-934d5b518922 req-e47ac814-4b7a-4b94-b554-c5a615b15ae2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130676 Oct 17 15:34:41.164435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5fb8c9f0-2a63-4f53-b1a9-3602651f1015 req-1a16b554-ec20-480b-a15a-984875fe12db service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:41.165053 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1382/2982] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:41.168685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5fb8c9f0-2a63-4f53-b1a9-3602651f1015 req-1a16b554-ec20-480b-a15a-984875fe12db service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:41.170600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5fb8c9f0-2a63-4f53-b1a9-3602651f1015 req-1a16b554-ec20-480b-a15a-984875fe12db service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:41.185220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:41.197428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:41.233055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5fb8c9f0-2a63-4f53-b1a9-3602651f1015 req-1a16b554-ec20-480b-a15a-984875fe12db service nova] Creating event network-changed:0a94060f-7ed4-4f6b-bfce-136b14e90e29 for instance 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 on n-h1-854441-12 Oct 17 15:34:41.237586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:41.243329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:41.244045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:41.244940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:41.248493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:41.250599 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5fb8c9f0-2a63-4f53-b1a9-3602651f1015 req-1a16b554-ec20-480b-a15a-984875fe12db service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141736 Oct 17 15:34:41.264430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:41.269977 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1601/2983] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:41.290858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:41.291857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:41.308391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:41.309042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:41.309510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:41.310100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:41.310654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:41.311104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:41.806041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:41.825602 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-080ca252-b490-47a4-b56b-476b4a4b2e34 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1313 microversion: 2.1 time: 0.553952 Oct 17 15:34:41.826223 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1602/2984] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:41 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:41.912528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:41.932968 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0284c7db-999e-4413-8b46-d3581e15753d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1317 microversion: 2.1 time: 0.762118 Oct 17 15:34:41.937950 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1383/2985] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:41 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:42.083401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:42.085636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:42.106251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:42.107558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:42.111651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:42.113378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:42.116820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:42.118119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:42.141929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:42.143065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:42.173669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:42.174706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:42.175372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:42.179116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:42.180087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:42.189562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:42.567335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:42.591992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:42.595099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:42.597607 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b685de3f-851a-4bb7-81ce-ad2ce9399835 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.464331 Oct 17 15:34:42.598952 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1384/2986] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:42 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:42.849740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:42.850477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:42.859119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:42.859633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:42.860089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:42.860848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:42.861320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:42.861767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:43.083573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:43.108244 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bff015c6-bd5f-43e0-97b1-f098aedcb8b5 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 1.036392 Oct 17 15:34:43.109213 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1603/2987] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:42 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:43.123959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:43.124982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:43.163258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:43.164395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:43.166037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:43.167670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:43.169092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:43.170037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:43.215408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=18 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:43.364671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:43.382684 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d9fc544d-af90-449c-8c54-ee1b1989f3ae tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1313 microversion: 2.1 time: 0.537574 Oct 17 15:34:43.383802 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1385/2988] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:42 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:43.393124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d8705354-d854-42ee-830a-4f6c6c6684b2 req-69c6a408-6534-4ace-b748-defbd2abdf10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa21afee-1c0c-49b3-b91c-bf7fa5438381", "name": "network-vif-plugged", "status": "completed", "tag": "8a3944bf-786e-467e-8893-ff95b6e28ff0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:43.409948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d8705354-d854-42ee-830a-4f6c6c6684b2 req-69c6a408-6534-4ace-b748-defbd2abdf10 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:43.410901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d8705354-d854-42ee-830a-4f6c6c6684b2 req-69c6a408-6534-4ace-b748-defbd2abdf10 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:43.411583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d8705354-d854-42ee-830a-4f6c6c6684b2 req-69c6a408-6534-4ace-b748-defbd2abdf10 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:43.439979 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d8705354-d854-42ee-830a-4f6c6c6684b2 req-69c6a408-6534-4ace-b748-defbd2abdf10 service nova] Creating event network-vif-plugged:8a3944bf-786e-467e-8893-ff95b6e28ff0 for instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 on n-h2-854441-12 Oct 17 15:34:43.453364 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d8705354-d854-42ee-830a-4f6c6c6684b2 req-69c6a408-6534-4ace-b748-defbd2abdf10 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063965 Oct 17 15:34:43.458644 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1386/2989] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:43.628468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:43.629245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:43.638298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:43.657151 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b03357a-52c3-4189-89d4-8e1d37efcec3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1317 microversion: 2.1 time: 0.545037 Oct 17 15:34:43.658685 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1604/2990] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:43 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:43.660455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:43.662882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:43.663388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:43.664319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:43.665837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:43.669041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:43.887851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:44.158394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:44.162798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:44.200474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:44.213284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:44.214636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:44.219822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:44.221675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:44.226848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:44.770304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:44.786894 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5451d8f9-4a8a-4e01-bd3b-821e0cb8bceb tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.635209 Oct 17 15:34:44.789102 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1605/2991] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:44 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:44.796872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:44.798147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:44.810732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:44.811682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:44.812406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:44.813665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:44.814411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:44.817050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:45.019125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:45.038430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:45.040038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:45.041255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b1449a24-b644-4714-84e8-c4998ad06ee1 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.418857 Oct 17 15:34:45.043530 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1387/2992] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:43 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:34:45.070111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:45.075530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:45.083482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:45.084389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:45.085152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:45.086111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:45.087104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:45.087827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:45.210829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:45.227584 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec05f921-fb7b-4b75-85e4-5fabf46b656a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1313 microversion: 2.1 time: 0.434307 Oct 17 15:34:45.229222 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1606/2993] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:44 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:45.502991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:45.517263 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-96c165a3-1b6b-4871-817e-3a827bc6521d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1467 microversion: 2.1 time: 0.471637 Oct 17 15:34:45.522703 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1388/2994] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:45 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1467 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:45.542000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:45.542895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:45.550838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:45.551588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:45.558040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:45.559521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:45.560263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:45.560944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:45.831357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:45.831985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:45.846197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:45.846758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:45.847212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:45.847941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:45.848399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:45.848820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:46.037477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:46.049809 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d47cafb9-7f34-46d7-8114-0edb6ffae40e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 200 len: 1318 microversion: 2.1 time: 0.512116 Oct 17 15:34:46.057669 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1607/2995] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:45 2022] GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:46.080405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:46.081479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:46.088392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:46.089319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:46.089981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:46.090992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:46.091746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:46.092428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:46.096728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:46.109806 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ce5db6e6-001f-477b-9793-1d977e917997 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.284061 Oct 17 15:34:46.116410 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1389/2996] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:45 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:46.268643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:46.269467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:46.295319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:46.296370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:46.297361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:46.304598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:46.306044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:46.309132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:46.634712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:46.651484 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ecc155e-3e6b-4c21-9b1a-1eedbe15a256 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1313 microversion: 2.1 time: 0.388505 Oct 17 15:34:46.653357 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1390/2997] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:46 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:46.838363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:46.856323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:46.857855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:46.868988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0a0177b-a41a-4c3e-9586-5034840df827 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.795695 Oct 17 15:34:46.889394 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1608/2998] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:46 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:47.086204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:47.087393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:47.096785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:47.100491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:47.104870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:47.105917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:47.108827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:47.110759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:47.140677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:47.141045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:47.164742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:47.172342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:47.173259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:47.177923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:47.181369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:47.182167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:47.474362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:47.491333 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c16c0540-e23a-4b8c-a461-63b2a35500af tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 200 len: 1468 microversion: 2.1 time: 0.404991 Oct 17 15:34:47.492364 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1391/2999] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:47 2022] GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 1468 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:47.542555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e4963f91-0795-4299-9ba4-6164156b8acf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1841154393"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:47.545795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e4963f91-0795-4299-9ba4-6164156b8acf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:47.559129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4963f91-0795-4299-9ba4-6164156b8acf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:47.560427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4963f91-0795-4299-9ba4-6164156b8acf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:47.564091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4963f91-0795-4299-9ba4-6164156b8acf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:47.565282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4963f91-0795-4299-9ba4-6164156b8acf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:47.567499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4963f91-0795-4299-9ba4-6164156b8acf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:47.568192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4963f91-0795-4299-9ba4-6164156b8acf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:48.224172 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e4963f91-0795-4299-9ba4-6164156b8acf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "POST /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381/action" status: 202 len: 0 microversion: 2.1 time: 0.688117 Oct 17 15:34:48.226073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1392/3000] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:34:47 2022] POST /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:34:48.239154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:48.240176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:48.266629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:48.269795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:48.271501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:48.272507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:48.273154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:48.273760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:48.274249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:48.290434 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95f07163-987d-4212-acc8-e35e90909f32 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 1.156230 Oct 17 15:34:48.291216 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1609/3001] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:47 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:48.304651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:48.309535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:48.328180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:48.329780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:48.336025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:48.337400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:48.338656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:48.342942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:48.583854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:48.606421 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4321a62b-849a-4d40-acfa-d8c94efe2515 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1313 microversion: 2.1 time: 0.371880 Oct 17 15:34:48.608094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1393/3002] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:48 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:48.624529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b50f69c-181d-403d-a80b-508164ba2620 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3ff820>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:48.700927 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b50f69c-181d-403d-a80b-508164ba2620 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.091436 Oct 17 15:34:48.701796 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1394/3003] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:48 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:48.716050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-7d77166e-c639-405c-a6eb-746a0d803049 req-3da5ebe8-61ee-4d0b-a4ad-c1126597c22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05b8d74-dc5f-433d-bd93-328e0511f478", "name": "network-vif-unplugged", "status": "completed", "tag": "b06a0418-6456-4d25-8cf6-75d075422311"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:48.727856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7d77166e-c639-405c-a6eb-746a0d803049 req-3da5ebe8-61ee-4d0b-a4ad-c1126597c22c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:48.729019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7d77166e-c639-405c-a6eb-746a0d803049 req-3da5ebe8-61ee-4d0b-a4ad-c1126597c22c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:48.730411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7d77166e-c639-405c-a6eb-746a0d803049 req-3da5ebe8-61ee-4d0b-a4ad-c1126597c22c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:48.755885 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-7d77166e-c639-405c-a6eb-746a0d803049 req-3da5ebe8-61ee-4d0b-a4ad-c1126597c22c service nova] Creating event network-vif-unplugged:b06a0418-6456-4d25-8cf6-75d075422311 for instance c05b8d74-dc5f-433d-bd93-328e0511f478 on n-h1-854441-12 Oct 17 15:34:48.767322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-7d77166e-c639-405c-a6eb-746a0d803049 req-3da5ebe8-61ee-4d0b-a4ad-c1126597c22c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054775 Oct 17 15:34:48.768356 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1395/3004] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:49.334606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:49.335888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:49.357914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:49.358737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:49.360303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:49.371868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:49.373365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:49.374315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:49.646738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:49.673538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-211eaea6-96ae-4fde-889c-27eb3fb599cd tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1512 microversion: 2.1 time: 0.356735 Oct 17 15:34:49.688425 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1396/3005] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:49 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1512 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:49.705037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-af6765d5-c3eb-45a9-b74a-34e3aca12636 req-a43174a7-05a3-4ea9-838a-ec8f8ffa77a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad9d856-6811-4d1b-a6a5-7a4065f5c209", "name": "network-vif-plugged", "status": "completed", "tag": "0a94060f-7ed4-4f6b-bfce-136b14e90e29"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:49.733035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-af6765d5-c3eb-45a9-b74a-34e3aca12636 req-a43174a7-05a3-4ea9-838a-ec8f8ffa77a8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:49.733901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-af6765d5-c3eb-45a9-b74a-34e3aca12636 req-a43174a7-05a3-4ea9-838a-ec8f8ffa77a8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:49.734993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-af6765d5-c3eb-45a9-b74a-34e3aca12636 req-a43174a7-05a3-4ea9-838a-ec8f8ffa77a8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:49.758987 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-af6765d5-c3eb-45a9-b74a-34e3aca12636 req-a43174a7-05a3-4ea9-838a-ec8f8ffa77a8 service nova] Creating event network-vif-plugged:0a94060f-7ed4-4f6b-bfce-136b14e90e29 for instance 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 on n-h1-854441-12 Oct 17 15:34:49.768600 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-af6765d5-c3eb-45a9-b74a-34e3aca12636 req-a43174a7-05a3-4ea9-838a-ec8f8ffa77a8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077520 Oct 17 15:34:49.770224 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1397/3006] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:49.780693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:49.782296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:49.794542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:49.796207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:49.797463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:49.800555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:49.801711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:49.803365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:49.816530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:50.092375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:50.132794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:50.138397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:50.141643 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-324a7209-36e3-4fd2-945f-87ea17fbed0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.848374 Oct 17 15:34:50.146277 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1610/3007] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:48 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:50.183973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4253db8d-c4d9-4daf-944a-8f2916177625 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2bb790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:50.201883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:50.232999 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b786a37-5178-466a-9747-e21bf5662ad7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1313 microversion: 2.1 time: 0.451878 Oct 17 15:34:50.235298 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1398/3008] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:49 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:50.304618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4253db8d-c4d9-4daf-944a-8f2916177625 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.154977 Oct 17 15:34:50.306203 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1611/3009] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:50 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:50.348726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c176aaf-ff66-4c2a-b3c6-d85886f82082 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:50.352235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c176aaf-ff66-4c2a-b3c6-d85886f82082 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:50.360145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c176aaf-ff66-4c2a-b3c6-d85886f82082 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:50.361596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c176aaf-ff66-4c2a-b3c6-d85886f82082 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:50.363047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c176aaf-ff66-4c2a-b3c6-d85886f82082 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:50.364717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c176aaf-ff66-4c2a-b3c6-d85886f82082 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:50.365411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c176aaf-ff66-4c2a-b3c6-d85886f82082 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:50.365914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c176aaf-ff66-4c2a-b3c6-d85886f82082 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:50.433283 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c176aaf-ff66-4c2a-b3c6-d85886f82082 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089531 Oct 17 15:34:50.434269 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1399/3010] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:34:50 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:50.451829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:50.453576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:50.468678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:50.469559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:50.470345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:50.471947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:50.473014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:50.473994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:50.625625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:50.633268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lazy-loading 'services' on Instance uuid 623adb03-8bce-4cd5-a01c-b21495fcc870 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:34:50.717751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:50.718616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:50.730755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:50.731641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:50.732258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:50.734434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:50.735350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:50.736457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:50.740826 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9fd467aa-a5f4-4404-88bb-b00918defc73 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "DELETE /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments/55583328-b2ef-4727-926f-6587dc0ccc2e" status: 202 len: 0 microversion: 2.1 time: 0.298039 Oct 17 15:34:50.757480 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1612/3011] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:34:50 2022] DELETE /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments/55583328-b2ef-4727-926f-6587dc0ccc2e => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:34:50.833096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3dd0bcd8-b420-48e4-b205-b37b9ebcb070 req-414fdad3-c732-4492-874b-c27ddfce7f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05b8d74-dc5f-433d-bd93-328e0511f478", "tag": "b06a0418-6456-4d25-8cf6-75d075422311"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:50.853908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3dd0bcd8-b420-48e4-b205-b37b9ebcb070 req-414fdad3-c732-4492-874b-c27ddfce7f3c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:50.854425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3dd0bcd8-b420-48e4-b205-b37b9ebcb070 req-414fdad3-c732-4492-874b-c27ddfce7f3c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:50.854894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3dd0bcd8-b420-48e4-b205-b37b9ebcb070 req-414fdad3-c732-4492-874b-c27ddfce7f3c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:50.868445 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3dd0bcd8-b420-48e4-b205-b37b9ebcb070 req-414fdad3-c732-4492-874b-c27ddfce7f3c service nova] Creating event network-changed:b06a0418-6456-4d25-8cf6-75d075422311 for instance c05b8d74-dc5f-433d-bd93-328e0511f478 on n-h1-854441-12 Oct 17 15:34:50.874291 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3dd0bcd8-b420-48e4-b205-b37b9ebcb070 req-414fdad3-c732-4492-874b-c27ddfce7f3c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058887 Oct 17 15:34:50.875265 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1613/3012] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:51.085747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:51.095893 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-67e52604-d7cc-4ff7-8dd0-ea8e2d2b5d1a tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1489 microversion: 2.1 time: 0.382723 Oct 17 15:34:51.096809 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1400/3013] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:50 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1489 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:51.137275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:51.140461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:51.149988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:51.150486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:51.151380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:51.152284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:51.152916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:51.153607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:51.194971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:51.195868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:51.207529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:51.215084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:51.217497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:51.218652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:51.222215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:51.224069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:51.228141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:34:51.385746 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed6004ca-ca94-4b47-94d8-e7b928f94dda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 204 len: 0 microversion: 2.1 time: 0.254239 Oct 17 15:34:51.388578 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1614/3014] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:34:51 2022] DELETE /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:34:51.402870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:51.404216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:51.420654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:51.424765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:51.425581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:51.430893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:51.431499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:51.432376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:51.593928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:51.607412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:51.628702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:51.638831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d291ddd7-fc3a-489a-bd9b-faecfd96cbfd tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.451406 Oct 17 15:34:51.652179 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1401/3015] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:51 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:34:51.652179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dbb5fe15-e352-4e7d-8d88-93d2f99f3568 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be426820>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:51.717978 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dbb5fe15-e352-4e7d-8d88-93d2f99f3568 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.076992 Oct 17 15:34:51.718636 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1402/3016] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:51 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:51.723865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:51.724486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:51.743098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:51.743983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:51.744736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:51.746009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:51.747170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:51.747919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:52.007438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:52.011678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:52.024021 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13b5bcb3-0e7d-42f0-b874-6b80fb126d07 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1313 microversion: 2.1 time: 0.631096 Oct 17 15:34:52.025924 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1615/3017] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:51 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:52.036924 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4003f65d-5e0e-4780-bd5c-e1554d4f3343 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1495 microversion: 2.1 time: 0.316683 Oct 17 15:34:52.038575 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1403/3018] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:51 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1495 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:52.698412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:52.699439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:52.703931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:34:52.723063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:52.723480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:52.726255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:52.727191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:52.732922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:52.733550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:52.746966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1f05415-8b6e-4ee8-a8ea-1b583ad1fbe1 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3c9790>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:52.865291 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1f05415-8b6e-4ee8-a8ea-1b583ad1fbe1 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.124424 Oct 17 15:34:52.866094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1404/3019] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:52 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:53.094596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:53.095364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:53.111101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:53.112348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:53.113079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:53.114266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:53.114939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:53.118466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:53.823640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:53.890652 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d60ce25a-cbbd-4f5d-8fe1-b4ce9064db22 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1500 microversion: 2.1 time: 0.798443 Oct 17 15:34:53.912017 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1405/3020] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:53 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1500 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:53.923329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:53.937617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:53.958652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:53.959960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:53.960886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:53.962492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:53.964384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:53.965558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:54.963409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:55.045460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:55.068967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:55.071232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c86ad6d-51d0-488f-a8b9-1b99b986936d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 2.378380 Oct 17 15:34:55.093634 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1616/3021] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:52 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:34:55.131591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-624b08f4-803b-4cc8-a5c1-1e51a4e3cc03 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be360160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:55.380756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-624b08f4-803b-4cc8-a5c1-1e51a4e3cc03 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.285083 Oct 17 15:34:55.383234 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1617/3022] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:55 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:55.427904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:55.433456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:55.492805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:55.497124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:55.497583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:55.506884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:55.507764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:55.508412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:55.614637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lazy-loading 'flavor' on Instance uuid 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:34:55.869704 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8538bfe7-2c13-4342-bc34-faef9fc97868 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "POST /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209/action" status: 200 len: 32 microversion: 2.1 time: 0.476879 Oct 17 15:34:55.898293 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1618/3023] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:34:55 2022] POST /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209/action => generated 32 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:34:55.919131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:55.924974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:55.959846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:55.964828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:55.965703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:55.966999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:55.973217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:55.973992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:56.350952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:56.365154 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-af96c053-ee60-445b-96d7-85b5592be7de tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1495 microversion: 2.1 time: 2.451013 Oct 17 15:34:56.368114 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1406/3024] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:53 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1495 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:56.378774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:56.385999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:56.413308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:56.416124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:56.421892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:56.423091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:56.423810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:56.427137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:56.659396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:56.775234 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bcd2c59b-105b-4889-981e-56613b974d94 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 0.858470 Oct 17 15:34:56.776428 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1619/3025] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:55 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:56.815193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c44c5457-2f3c-4b2d-8b0a-8e0bd66bbef0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be360040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:56.909677 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c44c5457-2f3c-4b2d-8b0a-8e0bd66bbef0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.131889 Oct 17 15:34:56.910290 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1620/3026] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:56 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:57.428524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:57.429791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:57.507320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:57.508488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:57.509005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:57.509776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:57.510247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:57.515085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:58.233582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:58.299933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:58.316720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:58.323710 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c8d22f9-a066-4f11-a20e-c04b42bb2221 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.953614 Oct 17 15:34:58.360552 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1407/3027] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:56 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:34:58.382415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b7a1bfe3-f8dd-43f2-bcc5-db010a79c929 req-ae326a12-5971-4a73-86fd-08bee1941287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa21afee-1c0c-49b3-b91c-bf7fa5438381", "name": "network-vif-plugged", "status": "completed", "tag": "8a3944bf-786e-467e-8893-ff95b6e28ff0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:34:58.407955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b7a1bfe3-f8dd-43f2-bcc5-db010a79c929 req-ae326a12-5971-4a73-86fd-08bee1941287 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:58.427631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b7a1bfe3-f8dd-43f2-bcc5-db010a79c929 req-ae326a12-5971-4a73-86fd-08bee1941287 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:58.428461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b7a1bfe3-f8dd-43f2-bcc5-db010a79c929 req-ae326a12-5971-4a73-86fd-08bee1941287 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:58.466367 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b7a1bfe3-f8dd-43f2-bcc5-db010a79c929 req-ae326a12-5971-4a73-86fd-08bee1941287 service nova] Creating event network-vif-plugged:8a3944bf-786e-467e-8893-ff95b6e28ff0 for instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 on n-h2-854441-12 Oct 17 15:34:58.493389 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b7a1bfe3-f8dd-43f2-bcc5-db010a79c929 req-ae326a12-5971-4a73-86fd-08bee1941287 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128040 Oct 17 15:34:58.498645 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1408/3028] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:34:58.514417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:58.524893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:58.552255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:58.553746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:58.554756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:58.556251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:58.566049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:58.567649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:58.794423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:34:58.836333 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1c890bb-22aa-4d2a-8b0e-9f97d28c5d4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1495 microversion: 2.1 time: 1.417787 Oct 17 15:34:58.839871 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1621/3029] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:57 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1495 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:34:58.852564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5140ad1-1896-4e8f-9159-77d5b04427d4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2404c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:58.979694 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5140ad1-1896-4e8f-9159-77d5b04427d4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.138477 Oct 17 15:34:58.980405 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1622/3030] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:34:58 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:34:59.406395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:34:59.415646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:34:59.469959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:59.476605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:59.483880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:34:59.491443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:34:59.511206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:34:59.512385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:00.099595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:00.180361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:00.190902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:00.197393 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-606e3cdc-a476-46bb-a265-83e74220b96d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.802841 Oct 17 15:35:00.199578 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1623/3031] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:34:59 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:00.223824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:00.224705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:00.244567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:00.249264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:00.250250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:00.263618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:00.264531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:00.265486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:00.380561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:00.439253 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b7ab60c0-68dd-46ed-8514-aca5278dc6ca tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 1.937537 Oct 17 15:35:00.464286 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1409/3032] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:34:58 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:00.501174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccf40df6-2638-4692-bfbd-178cf9ddfd74 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3e3af0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:00.721529 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ccf40df6-2638-4692-bfbd-178cf9ddfd74 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.255025 Oct 17 15:35:00.733479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:00.736257 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1410/3033] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:00 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:00.781406 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0e579b2-9f78-4918-8145-73fb91b34d48 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1453 microversion: 2.1 time: 0.568895 Oct 17 15:35:00.801961 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1624/3034] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:00 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1453 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:00.830869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b9125404-3237-4d87-a69b-df19a3ac7536 req-391d1b03-ab67-41bd-8be0-137ed4d70be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66796bdf-a914-42c2-b4cb-576f956f5bd7", "name": "network-vif-deleted", "tag": "eba218cb-4690-4a0b-ad4f-14ec9a2eca52"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:00.894812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b9125404-3237-4d87-a69b-df19a3ac7536 req-391d1b03-ab67-41bd-8be0-137ed4d70be7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:00.898580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b9125404-3237-4d87-a69b-df19a3ac7536 req-391d1b03-ab67-41bd-8be0-137ed4d70be7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:00.902073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b9125404-3237-4d87-a69b-df19a3ac7536 req-391d1b03-ab67-41bd-8be0-137ed4d70be7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:01.012595 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b9125404-3237-4d87-a69b-df19a3ac7536 req-391d1b03-ab67-41bd-8be0-137ed4d70be7 service nova] Creating event network-vif-deleted:eba218cb-4690-4a0b-ad4f-14ec9a2eca52 for instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 on n-h1-854441-12 Oct 17 15:35:01.051665 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b9125404-3237-4d87-a69b-df19a3ac7536 req-391d1b03-ab67-41bd-8be0-137ed4d70be7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245952 Oct 17 15:35:01.066851 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1625/3035] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:01.110672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e92035ba-5618-41d5-9621-a0051d59763b req-24fc19b0-5481-4aa1-a846-6e1865f95c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66796bdf-a914-42c2-b4cb-576f956f5bd7", "name": "network-vif-unplugged", "status": "completed", "tag": "eba218cb-4690-4a0b-ad4f-14ec9a2eca52"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:01.260878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e92035ba-5618-41d5-9621-a0051d59763b req-24fc19b0-5481-4aa1-a846-6e1865f95c25 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:01.266063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e92035ba-5618-41d5-9621-a0051d59763b req-24fc19b0-5481-4aa1-a846-6e1865f95c25 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:01.267918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e92035ba-5618-41d5-9621-a0051d59763b req-24fc19b0-5481-4aa1-a846-6e1865f95c25 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:01.360124 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e92035ba-5618-41d5-9621-a0051d59763b req-24fc19b0-5481-4aa1-a846-6e1865f95c25 service nova] Creating event network-vif-unplugged:eba218cb-4690-4a0b-ad4f-14ec9a2eca52 for instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 on n-h1-854441-12 Oct 17 15:35:01.386352 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e92035ba-5618-41d5-9621-a0051d59763b req-24fc19b0-5481-4aa1-a846-6e1865f95c25 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.316442 Oct 17 15:35:01.405508 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1626/3036] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:01.480638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:01.496531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:01.543262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:01.553879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:01.558859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:01.560322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:01.561334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:01.565619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:01.616231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02c5445a-4efc-44f6-b26c-a9be158ebb36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'create', calling method: .version_select at 0x7f28be426af0>, body: {"keypair": {"name": "tempest-keypair-1840657135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcQGQ/qarJWkOVzZnyY20KjMpPcLZUyoMvOaQa5KVRZFikjaR5wah0O0xwyj4ss3leYp7bfEogQRDCjYIg4Q6fMy7dqmP5+qfGYlgc4dVrdTyPrd4w9A8AshtJRn4qtKw=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:01.683804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:01.769719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-02c5445a-4efc-44f6-b26c-a9be158ebb36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for project cd4152066a8f430fb2fc99bf60b20203. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:35:01.824187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-02c5445a-4efc-44f6-b26c-a9be158ebb36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for user 15cc78a142a148398dc438b5ff2a25e9 and project cd4152066a8f430fb2fc99bf60b20203. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:35:01.972606 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02c5445a-4efc-44f6-b26c-a9be158ebb36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.233881 Oct 17 15:35:01.980662 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1411/3037] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:35:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:02.023708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:02.024885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:02.061335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:02.061567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:02.062297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:02.086765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:02.095373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:02.101370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:02.197551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:02.213556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:02.219826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:02.225670 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5409c8ec-08b9-48ea-a0f0-7b597620b94a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.816633 Oct 17 15:35:02.227928 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1627/3038] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:01 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:02.239764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a651b34b-52de-4f71-8ebc-653325255ebb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2bd0d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:02.392235 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a651b34b-52de-4f71-8ebc-653325255ebb tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.162683 Oct 17 15:35:02.404429 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1628/3039] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:02 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:02.415861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:02.419992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:02.439021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:02.441773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:02.442669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:02.447157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:02.448745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:02.449453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:02.677106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:02.678117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:02.678932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:02.679749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lazy-loading 'fault' on Instance uuid 66796bdf-a914-42c2-b4cb-576f956f5bd7 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:35:03.085559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:03.120593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5077b636-3451-4979-b6df-f72922eb2a0c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 1.138101 Oct 17 15:35:03.132060 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1412/3040] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:01 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:03.280377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:03.286367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:03.311109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:03.312556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:03.316002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:03.323380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:03.333118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:03.334533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:03.685170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:03.717292 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2671f45-3205-4d3b-8adf-c54ced4e666c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 200 len: 1305 microversion: 2.1 time: 1.318124 Oct 17 15:35:03.724006 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1629/3041] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:02 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 1305 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:03.733488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df134411-7af0-40d9-b326-4c04967ac1da tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2f41f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:03.898204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:03.916362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:03.922711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:03.924685 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5039c23e-c32d-4c0e-b0b8-d649008dfca0 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.652977 Oct 17 15:35:03.925585 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1413/3042] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:03 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:03.960341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df134411-7af0-40d9-b326-4c04967ac1da tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.233982 Oct 17 15:35:03.961783 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1630/3043] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:03 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:04.172988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:04.173922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:04.192909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:04.195291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:04.196361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:04.200417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:04.204554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:04.210267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:04.765021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:04.765790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:04.788297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:04.796950 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d40c5829-1973-487e-a817-98c2d6759e13 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 0.628224 Oct 17 15:35:04.799473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:04.800442 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1414/3044] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:04 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:35:04.808227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:04.809245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:04.810243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:04.813738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:04.814551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:04.844462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 HTTP/1.1 Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '66796bdf-a914-42c2-b4cb-576f956f5bd7'} Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:04.846656 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:04.850730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:04.850730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:04.850730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:04.850730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:04.850730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:04.850730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:04.850730 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:04.852826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:04.854060 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be25bb2c-bf69-4835-9055-92c0b4a4f88b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 404 len: 111 microversion: 2.1 time: 0.093701 Oct 17 15:35:04.854934 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1631/3045] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:04 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:35:04.978589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:04.979568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:04.992886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-efa292d4-72e7-4c24-b1af-b8aeaefd1797 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be414c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:05.023312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:05.023824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:05.024263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:05.024994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:05.025452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:05.025879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:05.081382 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-efa292d4-72e7-4c24-b1af-b8aeaefd1797 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.092639 Oct 17 15:35:05.082303 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1632/3046] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:04 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:05.289427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-809324137", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "fbf48d23-b6f0-48de-b73a-9c8aad4ee168"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:05.430440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] validate_networks() for [('fbf48d23-b6f0-48de-b73a-9c8aad4ee168', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:35:06.749718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:06.785630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:06.788915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:06.803456 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b403a814-0d2c-4a1e-b907-17b28a261415 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.816935 Oct 17 15:35:06.811973 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1415/3047] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:04 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:35:06.821523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:06.827402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:06.849812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:06.850813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:06.874680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:06.881073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:06.890746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:06.893471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:07.618368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:07.647157 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5355f46-ae3b-4f8c-94c4-85475d449c02 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 0.832927 Oct 17 15:35:07.666915 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1416/3048] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:06 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:07.688607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5765ccf2-11d2-4a14-a349-c385e4b48f75 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be397040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:07.946463 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5765ccf2-11d2-4a14-a349-c385e4b48f75 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.265532 Oct 17 15:35:07.956456 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1417/3049] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:07 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:07.974100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:07.996123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:08.053319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:08.060052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:08.075559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:08.079030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:08.080426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:08.081563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:09.677045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:09.690259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:09.692587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:09.693133 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d72b10a4-675a-48b8-a690-35989efea023 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.735096 Oct 17 15:35:09.708174 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1418/3050] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:07 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:09.716338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:09.724169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:09.748137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:09.755359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:09.756688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:09.757783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:09.763827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:09.766105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:10.623311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:35:10.624247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:35:10.625091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:35:10.625863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:35:10.631878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:35:10.743242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:10.769020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:10.789485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:10.791730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:10.796095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:10.801211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:10.871098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:35:10.885065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Getting quotas for user 745a483a369e4e83849cee037f5b67ab and project 2e0ace059be046f4bf77aa4419fec590. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:35:10.917109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:35:10.921744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:35:11.098464 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16423e5d-fa62-4e0e-9951-e4b04d9116f2 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.816414 Oct 17 15:35:11.112639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1633/3051] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:35:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 5833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:35:11.133401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a20d1f87-6d9c-48a7-8573-81efb6a8b6b3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2bd160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:11.273316 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a20d1f87-6d9c-48a7-8573-81efb6a8b6b3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.158298 Oct 17 15:35:11.273943 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1634/3052] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:11 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:11.295225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-196856a5-7e8b-48db-957b-6909dc9aa1a1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:11.300161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:11.302439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-196856a5-7e8b-48db-957b-6909dc9aa1a1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:11.314039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ffef76ae-0ec4-4b80-9bcc-781febf077d6 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 1.604203 Oct 17 15:35:11.322521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-196856a5-7e8b-48db-957b-6909dc9aa1a1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:11.323365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-196856a5-7e8b-48db-957b-6909dc9aa1a1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:11.323988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-196856a5-7e8b-48db-957b-6909dc9aa1a1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:11.324927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-196856a5-7e8b-48db-957b-6909dc9aa1a1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:11.325604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-196856a5-7e8b-48db-957b-6909dc9aa1a1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:11.326196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-196856a5-7e8b-48db-957b-6909dc9aa1a1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:11.335046 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1419/3053] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:09 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:11.381005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:11.403986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:11.408464 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-196856a5-7e8b-48db-957b-6909dc9aa1a1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130993 Oct 17 15:35:11.413441 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1635/3054] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:35:11 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:35:11.420876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:11.426288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6e0bc53-17ec-445a-885f-2f96763399e4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:11.442882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6e0bc53-17ec-445a-885f-2f96763399e4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:11.465835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:11.473235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:11.475097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:11.482122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:11.486148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:11.488046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:11.553490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:11.767403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6e0bc53-17ec-445a-885f-2f96763399e4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:11.809357 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6e0bc53-17ec-445a-885f-2f96763399e4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1214 microversion: 2.1 time: 0.386930 Oct 17 15:35:11.819184 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1636/3055] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:11 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1214 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:11.852872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8627aca9-4bb7-4d2f-9475-ab8b3d39e016 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:11.867363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8627aca9-4bb7-4d2f-9475-ab8b3d39e016 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:11.889189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:11.890777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8627aca9-4bb7-4d2f-9475-ab8b3d39e016 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:11.893536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8627aca9-4bb7-4d2f-9475-ab8b3d39e016 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:11.898751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8627aca9-4bb7-4d2f-9475-ab8b3d39e016 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:11.900259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8627aca9-4bb7-4d2f-9475-ab8b3d39e016 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:11.901262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8627aca9-4bb7-4d2f-9475-ab8b3d39e016 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:11.904178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8627aca9-4bb7-4d2f-9475-ab8b3d39e016 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:12.074233 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8627aca9-4bb7-4d2f-9475-ab8b3d39e016 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.252852 Oct 17 15:35:12.087317 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1637/3056] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:35:11 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870/os-volume_attachments => generated 25 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:35:12.291273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d153f83e-ce2b-4247-bd98-1ff96839c115 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2bba60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:12.477134 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d153f83e-ce2b-4247-bd98-1ff96839c115 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.190967 Oct 17 15:35:12.490175 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1638/3057] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:12 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:35:12.502157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:12.506119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:12.526855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:12.528970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:12.532478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:12.551018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:12.551412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:12.554720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:12.689316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:35:12.727284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:12.755188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:12.759106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:12.766214 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-59ef2bb5-ebeb-4cb3-beb6-038612e92c4c tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.388596 Oct 17 15:35:12.768615 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1420/3058] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:11 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:12.785134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:12.794101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:12.827619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:12.831535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:12.832394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:12.834599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:12.835840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:12.841748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:13.060969 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc29737f-aed2-4ea3-9b31-6c49ae07723e tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "DELETE /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 204 len: 0 microversion: 2.1 time: 0.559411 Oct 17 15:35:13.067063 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1639/3059] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:12 2022] DELETE /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:35:13.087641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:13.088520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:13.127276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:13.130153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:13.132282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:13.133890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:13.134585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:13.135382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:13.665819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:13.675227 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1775165b-5e5c-4063-ab44-c4d66b345b4f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 0.905183 Oct 17 15:35:13.680179 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1421/3060] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:12 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:13.682708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:13.691438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:13.694772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:13.710452 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-060aa558-42de-454e-971b-492fa3d73a4f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1218 microversion: 2.1 time: 0.629987 Oct 17 15:35:13.726076 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1640/3061] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:13 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1218 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:13.731148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:13.732518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:13.733208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:13.734209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:13.735892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:13.736618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:13.773721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1ed9557-8a15-49fe-8860-1242f7ae3a9d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be280ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:14.000248 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1ed9557-8a15-49fe-8860-1242f7ae3a9d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.267499 Oct 17 15:35:14.005768 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1641/3062] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:13 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:14.014330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:14.017456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:14.040885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:14.041704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:14.042317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:14.043460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:14.044101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:14.046601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:14.223708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:14.261172 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5f1c8ad9-0800-4b96-be9b-d5fb987fd024 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1681 microversion: 2.1 time: 0.564192 Oct 17 15:35:14.278780 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1422/3063] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:13 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1681 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:14.390557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1479699840", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd932f3b-36f3-4be3-9d4c-cbbd034c0114"}], "security_groups": [{"name": "tempest-securitygroup--1075747318"}], "key_name": "tempest-keypair-1840657135", "user_data": "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:14.463465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:14.492146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:14.493708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:14.495028 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8aa2689-5e7b-47f9-885c-77b378474a0f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.487549 Oct 17 15:35:14.526542 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1642/3064] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:14 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:14.694728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] validate_networks() for [('dd932f3b-36f3-4be3-9d4c-cbbd034c0114', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:35:14.735594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:14.736824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:14.782082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:14.782958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:14.783710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:14.791475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:14.792357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:14.793189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:15.514311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:15.523333 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2535515-4034-46d8-bf1d-35b4b4eb125c tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 0.795422 Oct 17 15:35:15.530223 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1643/3065] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:14 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:15.573203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:15.588986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:15.619741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:15.623362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:15.627329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:15.629798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:15.633861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:15.636268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:16.129069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:16.143397 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d77ee13f-728d-433d-aefe-135c4d71557d tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1274 microversion: 2.1 time: 0.592059 Oct 17 15:35:16.144295 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1644/3066] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:15 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1274 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:16.150623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62488cec-48c3-4264-9a66-18c8836587ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be41df70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:16.205387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:35:16.205933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:35:16.207317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:35:16.207317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:35:16.210979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:35:16.233627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:16.239894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:16.241121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:16.242243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:16.243766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:16.247221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:16.252020 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62488cec-48c3-4264-9a66-18c8836587ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.106211 Oct 17 15:35:16.262148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1645/3067] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:16 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:16.269428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:16.270745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:16.279315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:16.280090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:16.280919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:16.282475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:16.283188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:16.283782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:16.302812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:35:16.313958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for user 15cc78a142a148398dc438b5ff2a25e9 and project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:35:16.356081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:35:16.361205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:35:16.581476 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1020fc2c-7562-4969-9016-7bdccebac116 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.195382 Oct 17 15:35:16.586701 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1423/3068] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:35:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:35:16.606144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:16.613537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:16.627580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:16.630256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:16.631670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:16.637659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:16.638887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:16.642214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:17.225284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:17.240002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:17.244545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:17.258191 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2221a92b-3983-4909-80e8-785497dc659b tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.669114 Oct 17 15:35:17.261568 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1424/3069] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:16 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:17.272434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:17.273210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:17.303439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:17.304075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:17.304810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:17.305874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:17.306636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:17.307245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:17.651077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:17.661388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee143698-bf71-4ad7-b0b2-e9ee497de1cd tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 0.398378 Oct 17 15:35:17.670943 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1425/3070] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:17 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:17.694421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46e9307a-307e-4b74-bbe1-deaeb172ec1a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:17.695186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-46e9307a-307e-4b74-bbe1-deaeb172ec1a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:17.708717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:17.743935 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10751f0c-ea8f-4ba9-84d7-120dbf408e34 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1681 microversion: 2.1 time: 1.479767 Oct 17 15:35:17.745014 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1646/3071] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:16 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1681 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:17.765007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:17.771984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:17.803217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:17.804525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:17.807739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:17.809545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:17.814287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:17.815397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:17.924138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-46e9307a-307e-4b74-bbe1-deaeb172ec1a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:17.936201 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-46e9307a-307e-4b74-bbe1-deaeb172ec1a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1239 microversion: 2.1 time: 0.246103 Oct 17 15:35:17.944686 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1426/3072] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:17 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1239 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:17.950231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-625c9786-96db-42c8-a0c3-347837ba4aa2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be426ca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:18.112844 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-625c9786-96db-42c8-a0c3-347837ba4aa2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.166950 Oct 17 15:35:18.121233 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1427/3073] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:17 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:18.142427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b1a7ac89-1995-4b91-a841-b75aced6ad3f req-9caa39f9-a404-44f5-8e99-09bae661d126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623adb03-8bce-4cd5-a01c-b21495fcc870", "name": "network-vif-unplugged", "status": "completed", "tag": "57d051c2-d615-47a8-a187-da3238f72760"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:18.203447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b1a7ac89-1995-4b91-a841-b75aced6ad3f req-9caa39f9-a404-44f5-8e99-09bae661d126 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:18.204755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b1a7ac89-1995-4b91-a841-b75aced6ad3f req-9caa39f9-a404-44f5-8e99-09bae661d126 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:18.205669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b1a7ac89-1995-4b91-a841-b75aced6ad3f req-9caa39f9-a404-44f5-8e99-09bae661d126 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:18.252363 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b1a7ac89-1995-4b91-a841-b75aced6ad3f req-9caa39f9-a404-44f5-8e99-09bae661d126 service nova] Creating event network-vif-unplugged:57d051c2-d615-47a8-a187-da3238f72760 for instance 623adb03-8bce-4cd5-a01c-b21495fcc870 on n-h1-854441-12 Oct 17 15:35:18.281321 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b1a7ac89-1995-4b91-a841-b75aced6ad3f req-9caa39f9-a404-44f5-8e99-09bae661d126 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155179 Oct 17 15:35:18.282701 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1428/3074] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:18.332695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:18.334111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:18.375915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:18.377277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:18.380778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:18.385588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:18.388203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:18.388777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:18.540422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:18.618021 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b8238ec-4ef9-4bc0-90e4-b131cb16efb7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1272 microversion: 2.1 time: 0.807421 Oct 17 15:35:18.635387 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1647/3075] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:17 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1272 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:18.699411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:18.705476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:18.738202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:18.740908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:18.742050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:18.743689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:18.747879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:18.749238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:18.923304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:18.939362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:18.949944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:18.952486 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5f03304-8063-428d-b91b-dae23d6600ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.641236 Oct 17 15:35:18.954989 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1429/3076] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:18 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:18.962841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:18.965853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:18.982150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:18.983068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:18.984423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:18.986040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:19.006047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:19.007640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:19.218223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:19.228098 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bf7c7171-39f3-40f1-8f58-bacb57ac5252 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1615 microversion: 2.1 time: 0.271185 Oct 17 15:35:19.229250 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1430/3077] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:18 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1615 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:19.235881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:19.236554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:19.243403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:19.244050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:19.244619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:19.245671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:19.246236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:19.246964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:19.389176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:19.400459 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-862dee73-17fe-4111-be17-6d63c32ead03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1291 microversion: 2.1 time: 0.169910 Oct 17 15:35:19.401787 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1431/3078] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:19 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1291 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:19.411542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca68ce36-3ac5-4179-8e7f-0b7007423db7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2df68b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:19.470589 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca68ce36-3ac5-4179-8e7f-0b7007423db7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.065938 Oct 17 15:35:19.471483 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1432/3079] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:19 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:19.477607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-967e1281-1cf5-4fb0-8cfa-5e32d13d9bc5 req-9ec20f91-7c4f-46c0-9215-f906db237cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623adb03-8bce-4cd5-a01c-b21495fcc870", "name": "network-vif-deleted", "tag": "57d051c2-d615-47a8-a187-da3238f72760"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:19.489676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-967e1281-1cf5-4fb0-8cfa-5e32d13d9bc5 req-9ec20f91-7c4f-46c0-9215-f906db237cef service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:19.490565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-967e1281-1cf5-4fb0-8cfa-5e32d13d9bc5 req-9ec20f91-7c4f-46c0-9215-f906db237cef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:19.491187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-967e1281-1cf5-4fb0-8cfa-5e32d13d9bc5 req-9ec20f91-7c4f-46c0-9215-f906db237cef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:19.509455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-967e1281-1cf5-4fb0-8cfa-5e32d13d9bc5 req-9ec20f91-7c4f-46c0-9215-f906db237cef service nova] Creating event network-vif-deleted:57d051c2-d615-47a8-a187-da3238f72760 for instance 623adb03-8bce-4cd5-a01c-b21495fcc870 on n-h1-854441-12 Oct 17 15:35:19.515174 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-967e1281-1cf5-4fb0-8cfa-5e32d13d9bc5 req-9ec20f91-7c4f-46c0-9215-f906db237cef service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042215 Oct 17 15:35:19.515971 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1433/3080] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:19.680315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:19.682487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:19.708006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:19.716131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:19.717513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:19.720605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:19.721798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:19.726353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:19.774040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:19.788544 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d6274ba-bce8-4c77-89f7-f9dbfe0a226a tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1486 microversion: 2.1 time: 1.096537 Oct 17 15:35:19.795844 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1648/3081] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:18 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1486 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:19.843545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5d73b30-4193-4970-9b36-c7c1932cf2b3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:19.844416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5d73b30-4193-4970-9b36-c7c1932cf2b3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:19.854370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5d73b30-4193-4970-9b36-c7c1932cf2b3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:19.863349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5d73b30-4193-4970-9b36-c7c1932cf2b3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:19.865026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5d73b30-4193-4970-9b36-c7c1932cf2b3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:19.867731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5d73b30-4193-4970-9b36-c7c1932cf2b3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:19.868450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5d73b30-4193-4970-9b36-c7c1932cf2b3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:19.871410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5d73b30-4193-4970-9b36-c7c1932cf2b3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:20.034689 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5d73b30-4193-4970-9b36-c7c1932cf2b3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "POST /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209/action" status: 202 len: 0 microversion: 2.1 time: 0.195381 Oct 17 15:35:20.047188 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1649/3082] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:35:19 2022] POST /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:35:20.072199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:20.073615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:20.098800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:20.099365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:20.099818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:20.100553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:20.103823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:20.112814 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2377f5c-a734-4c75-921e-659e38994d1b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1272 microversion: 2.1 time: 0.452861 Oct 17 15:35:20.113426 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1434/3083] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:19 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1272 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:20.123158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:20.123647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:20.140351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:20.140987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:20.162010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:20.162543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:20.163202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:20.164327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:20.165101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:20.165774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:20.672032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:20.693672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:20.704929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:20.707945 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca97f95d-096e-4d9b-acfe-4b2a81a9e734 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 0.651726 Oct 17 15:35:20.711809 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1650/3084] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:20 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:20.722888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:20.730661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:20.752211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:20.755763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:20.759876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:20.764626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:20.765709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:20.766415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:20.849127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:20.850651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:20.851397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:20.852111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lazy-loading 'fault' on Instance uuid 623adb03-8bce-4cd5-a01c-b21495fcc870 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:35:20.863625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:20.946894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a238ad41ef1e44658b2c7a0edfb7aefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17260d6e6104443aadd1f8d2894f256e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:20.957510 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06c7c6c6-b390-4497-8c83-bd2961eb73bb tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 200 len: 1331 microversion: 2.1 time: 0.241050 Oct 17 15:35:20.980946 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1651/3085] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:20 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 1331 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:20.987311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:20.994310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:21.013946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:21.014999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:21.015833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:21.019571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:21.020457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:21.021435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:21.163786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:21.175142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:21.178255 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2e40f25-3afc-4eed-a193-8c2fe4bc8398 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1297 microversion: 2.1 time: 0.194754 Oct 17 15:35:21.201839 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1652/3086] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:20 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1297 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:21.207539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-558ac433-5b3c-4d5b-826a-de91884db03e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2e0f5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:21.398938 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-558ac433-5b3c-4d5b-826a-de91884db03e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.195432 Oct 17 15:35:21.399634 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1653/3087] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:21 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:21.741953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e49d7e9-87a2-4e42-9b12-a8f659f6f108 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Action: 'create', calling method: .version_select at 0x7f28be3ef3a0>, body: {"keypair": {"name": "tempest-keypair-382506872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1mXtRovzHv8sOcYdH9QDWH2wbGKr6DxOHvESpE8TL+LebimL9SF+kTnSUITQXw3KvPchnSRhulzk/vT9/XzseJELB8f8cd/B9s570fWk1YXtvRas3Fl7G2MnOc1YJ+Tw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:21.783659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5e49d7e9-87a2-4e42-9b12-a8f659f6f108 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Getting quotas for project 2455cda838ea4befb6a3702d07b7b1ca. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:35:21.794178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5e49d7e9-87a2-4e42-9b12-a8f659f6f108 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Getting quotas for user 1a75d59cdb6f45df9fc90e515601a4be and project 2455cda838ea4befb6a3702d07b7b1ca. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:35:21.866784 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e49d7e9-87a2-4e42-9b12-a8f659f6f108 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.465547 Oct 17 15:35:21.878148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1654/3088] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:35:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:21.897712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:21.899123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:21.939562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:21.944437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:21.948227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:21.956098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:21.958850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:21.963482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:22.732338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:22.809742 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f5c8d4eb-a2d6-4ebb-a32e-41a9ce5092f8 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1494 microversion: 2.1 time: 2.687895 Oct 17 15:35:22.815838 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1435/3089] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:20 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1494 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:22.858728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:22.862470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:22.899214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:22.900840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:22.901378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:22.907762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:22.911474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:22.914825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:23.227943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:23.237839 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8cf6f4d3-c12d-467c-860b-c736d85b6bea tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1314 microversion: 2.1 time: 1.356813 Oct 17 15:35:23.244749 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1655/3090] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:21 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1314 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:23.258267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:23.261426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:23.273598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:23.283062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:23.288842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:23.289696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:23.293295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:23.294179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:23.297948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:23.333834 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] HTTP exception thrown: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Request method failure captured: Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 HTTP/1.1 Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXVPIUyj69_G1ZbCfY67HIEKeOnC8qpn_QDVY8RK_kdm2GvahofnapolnAB9WNtLCXqFEq3mS4EUQg9GHNsN6223q3E6A006Eq62Abd8XPPneurmZMTEQ1XBnrV076hO6PlSWlGi0nI2v2neMu9bL4ZsJB5xDnV6qNIW90Mj1BdwvTQ Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 17260d6e6104443aadd1f8d2894f256e Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-690180758 Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-690180758 Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 17260d6e6104443aadd1f8d2894f256e Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-690180758 Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachSCSIVolumeTestJSON-690180758-project Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a238ad41ef1e44658b2c7a0edfb7aefe Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-690180758-project Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '623adb03-8bce-4cd5-a01c-b21495fcc870'} Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:23.335844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:23.340304 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:23.340304 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:23.340304 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:23.340304 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:23.340304 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:23.340304 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:23.340304 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:23.356964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Returning 404 to user: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:23.358588 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba79de46-f9b6-4ea8-be40-24d5a967de60 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 404 len: 111 microversion: 2.1 time: 0.112153 Oct 17 15:35:23.363204 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1656/3091] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:23 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:23.380366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:23.381083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:23.389907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:23.395639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:23.397051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:23.398942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:23.402153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:23.407563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:23.759723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:23.792372 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbfec5b8-6fc0-4cea-a138-0279c3391682 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1297 microversion: 2.1 time: 0.421750 Oct 17 15:35:23.793862 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1657/3092] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:23 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1297 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:23.809770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7854679a-0121-472d-bf2a-ee4b3dc04599 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3ef5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:23.965144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7854679a-0121-472d-bf2a-ee4b3dc04599 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.168817 Oct 17 15:35:23.975226 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1658/3093] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:23 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:23.981595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:23.989218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac0212e4-00c3-4fc0-baaf-a177950449ec tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '.version_select at 0x7f28c2e0f3a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:23.998642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:24.000583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:24.002205 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5df8f13-49d0-46b3-bda6-226e247b6e74 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.182021 Oct 17 15:35:24.005631 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1436/3094] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:22 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:24.019554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:24.020682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:24.032826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:24.034520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:24.036196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:24.037700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:24.043215 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac0212e4-00c3-4fc0-baaf-a177950449ec tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926342222" status: 202 len: 0 microversion: 2.1 time: 0.066013 Oct 17 15:35:24.045327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:24.046236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:24.050150 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1659/3095] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 15:35:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926342222 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:35:24.293401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:24.294903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:24.315267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:24.316089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:24.316699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:24.317669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:24.318364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:24.319043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:24.857732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:24.901024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:24.912629 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-626bdf7b-4467-4bec-a775-f60d8ef2dea6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1314 microversion: 2.1 time: 0.623238 Oct 17 15:35:24.917388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a7d568ff-529b-401c-b1b3-59d4c0ded805 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1494 microversion: 2.1 time: 0.907195 Oct 17 15:35:24.918043 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1437/3096] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:24 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1494 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:24.918708 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1660/3097] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:24 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:35:24.938089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8cae5584-6f54-414b-828d-90c5b17f4a2a req-f06ec3dd-71eb-4430-a8ff-c69cd1f5e5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32", "tag": "5f9d6d3c-e50e-4240-a11d-1cd02eabfeaf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:24.956334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:24.957444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:24.987497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8cae5584-6f54-414b-828d-90c5b17f4a2a req-f06ec3dd-71eb-4430-a8ff-c69cd1f5e5fe service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:24.988011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8cae5584-6f54-414b-828d-90c5b17f4a2a req-f06ec3dd-71eb-4430-a8ff-c69cd1f5e5fe service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:24.988427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8cae5584-6f54-414b-828d-90c5b17f4a2a req-f06ec3dd-71eb-4430-a8ff-c69cd1f5e5fe service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:24.993930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:24.994579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:24.995155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:24.996117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:24.996593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:24.997028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:25.028016 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8cae5584-6f54-414b-828d-90c5b17f4a2a req-f06ec3dd-71eb-4430-a8ff-c69cd1f5e5fe service nova] Creating event network-changed:5f9d6d3c-e50e-4240-a11d-1cd02eabfeaf for instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 on n-h2-854441-12 Oct 17 15:35:25.035718 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8cae5584-6f54-414b-828d-90c5b17f4a2a req-f06ec3dd-71eb-4430-a8ff-c69cd1f5e5fe service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114896 Oct 17 15:35:25.037305 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1438/3098] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:25.072583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3475236d-1e19-4c49-938f-33823906e31d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2ee9550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:25.274874 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3475236d-1e19-4c49-938f-33823906e31d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.236109 Oct 17 15:35:25.276333 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1439/3099] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:25 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:25.289771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:25.291583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:25.311534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:25.312318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:25.312939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:25.314322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:25.319036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:25.319782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:25.657676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:25.681545 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a23789c5-ea9f-46b4-a43b-b3e3fada6bcd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.742430 Oct 17 15:35:25.682664 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1661/3100] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:24 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:25.949970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:25.951114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:26.003552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:26.005479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:26.010990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:26.016858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:26.025549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:26.026709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:26.270598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:26.483132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:26.506087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:26.513102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:26.518427 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31f311bd-df58-47a6-88dc-316cd2d4b4ec tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1486 microversion: 2.25 time: 1.240666 Oct 17 15:35:26.533326 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1440/3101] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:25 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1486 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:26.563881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:26.571855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:26.591334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:26.591334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:26.591334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:26.592043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:26.601053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:26.609906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:27.030922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:27.044608 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0d36babd-db2a-4bb7-85ea-5a51edbb55dc tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1314 microversion: 2.1 time: 1.100675 Oct 17 15:35:27.046854 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1662/3102] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:25 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1314 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:27.060950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f48fb968-edc8-4cac-91ae-b2ddbf033f5c tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3dfdc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:27.163071 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f48fb968-edc8-4cac-91ae-b2ddbf033f5c tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.113239 Oct 17 15:35:27.166305 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1663/3103] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:27 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:27.172064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:27.173402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:27.182526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:27.185084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:27.187152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:27.188709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:27.191362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:27.192051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:27.448137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:27.464349 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-423be74b-4c9a-4e71-bfc9-fadb685b784d tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1500 microversion: 2.1 time: 0.923337 Oct 17 15:35:27.478563 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1441/3104] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:26 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1500 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:27.514067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:27.516602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:27.534192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:27.536502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:27.537484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:27.544172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:27.544764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:27.546366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:27.582723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:35:27.650177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:27.713164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:27.749964 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0ec81fa-7dc1-44c6-bc50-97ee58ad7193 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.571801 Oct 17 15:35:27.751254 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1664/3105] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:27 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:27.766283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:27.770775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:27.788203 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea67c51f-f5b7-4781-ac46-e4f9bc1a3d62 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 204 len: 0 microversion: 2.1 time: 0.280856 Oct 17 15:35:27.796235 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1442/3106] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:27 2022] DELETE /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:35:27.801669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:27.803209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:27.805893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:27.806813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:27.807598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:27.809291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:27.819120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:27.830118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:27.862615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:27.864039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:27.865203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:27.867481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:27.868622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:27.869744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:27.938101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:28.287822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:28.306343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:28.308172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:28.309613 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0412435e-3109-480d-b782-1113627a8514 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1476 microversion: 2.25 time: 0.556572 Oct 17 15:35:28.336561 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1665/3107] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:27 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1476 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:28.343994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:28.344679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:28.352505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:28.353186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:28.354013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:28.355186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:28.356049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:28.357187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:28.507704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:28.525538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-517388b1-1c69-486d-ada8-8da083fb05fc tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 0.725480 Oct 17 15:35:28.526157 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1443/3108] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:27 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:28.535190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc2c1989-93c4-44ec-aaa9-defe753014ff tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be39a4c0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:28.812517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:28.838862 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f6e6974-d64b-4946-9ff4-3cffef731899 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1314 microversion: 2.1 time: 0.500437 Oct 17 15:35:28.840200 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1666/3109] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:28 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:28.848987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e51a8448-de7b-45fd-b9ba-b736bc770194 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '.version_select at 0x7f28be414ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:28.856604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e51a8448-de7b-45fd-b9ba-b736bc770194 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:28.858185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e51a8448-de7b-45fd-b9ba-b736bc770194 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:28.859355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e51a8448-de7b-45fd-b9ba-b736bc770194 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:28.906292 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e51a8448-de7b-45fd-b9ba-b736bc770194 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.060426 Oct 17 15:35:28.908568 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1667/3110] 10.222.0.87 () {60 vars in 1184 bytes} [Mon Oct 17 15:35:28 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:28.920736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-09cef159-d286-4eca-b551-e2836d8fd35d req-cd68fd83-9bfd-44d8-8f3a-7d811db1ca43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:28.945529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-09cef159-d286-4eca-b551-e2836d8fd35d req-cd68fd83-9bfd-44d8-8f3a-7d811db1ca43 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:28.947044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-09cef159-d286-4eca-b551-e2836d8fd35d req-cd68fd83-9bfd-44d8-8f3a-7d811db1ca43 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:28.948067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-09cef159-d286-4eca-b551-e2836d8fd35d req-cd68fd83-9bfd-44d8-8f3a-7d811db1ca43 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:28.988321 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-09cef159-d286-4eca-b551-e2836d8fd35d req-cd68fd83-9bfd-44d8-8f3a-7d811db1ca43 service nova] Creating event network-changed:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:35:28.998825 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-09cef159-d286-4eca-b551-e2836d8fd35d req-cd68fd83-9bfd-44d8-8f3a-7d811db1ca43 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084820 Oct 17 15:35:29.000380 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1668/3111] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:29.016674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1365106943", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "b12d676c-c73e-4753-981d-9ad4331d0511"}], "security_groups": [{"name": "tempest-securitygroup--1607072460"}], "key_name": "tempest-keypair-382506872", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:29.480019 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc2c1989-93c4-44ec-aaa9-defe753014ff tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1455 microversion: 2.1 time: 0.952432 Oct 17 15:35:29.481178 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1444/3112] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:28 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1455 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:29.489559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:29.506015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:29.526074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:29.526964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:29.527830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:29.529274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:29.530311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:29.531336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:29.605676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] validate_networks() for [('b12d676c-c73e-4753-981d-9ad4331d0511', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:35:29.742660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:29.754937 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aebd414f-05cb-4ea0-9227-65af0542eb45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.272505 Oct 17 15:35:29.759559 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1445/3113] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:29 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:29.764598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:29.765586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:29.773249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:29.774200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:29.774981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:29.775980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:29.776785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:29.777473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:29.998171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] Lazy-loading 'services' on Instance uuid c05b8d74-dc5f-433d-bd93-328e0511f478 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:35:30.016353 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f07e1f2e-3266-4fe2-a30f-6e3aa41c92f0 tempest-LiveAutoBlockMigrationV225Test-899541247 tempest-LiveAutoBlockMigrationV225Test-899541247-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1971 microversion: 2.25 time: 0.254530 Oct 17 15:35:30.016756 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1446/3114] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:29 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1971 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:30.022688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:30.023320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:30.030894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:30.031393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:30.031830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:30.033135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:30.033609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:30.034261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:30.234183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:35:30.235025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:35:30.235245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:30.236239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:35:30.236882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:35:30.237541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:35:30.245894 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7d122f09-ead3-47a7-81ee-911f396e4e5e tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 0.227885 Oct 17 15:35:30.247349 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1447/3115] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:30 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:30.253126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:30.253807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:30.254314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:30.255126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:30.255908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:30.257252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:30.257793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:30.258353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:30.281038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:30.281369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Getting quotas for project 2455cda838ea4befb6a3702d07b7b1ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:35:30.281531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:30.281969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:30.282941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:30.283417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:30.284355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:30.288725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Getting quotas for user 1a75d59cdb6f45df9fc90e515601a4be and project 2455cda838ea4befb6a3702d07b7b1ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:35:30.333309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:35:30.333309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:35:30.381655 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da784e55-2e78-4924-a99a-a2df40c9758b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.379021 Oct 17 15:35:30.390556 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1669/3116] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:35:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:35:30.390556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:30.390556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:30.405310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:30.406105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:30.406779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:30.407909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:30.408568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:30.409354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:30.518970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:35:30.678948 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d3a4a01-dee9-4fae-8e60-bad2663257c9 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 204 len: 0 microversion: 2.25 time: 0.293961 Oct 17 15:35:30.684906 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1670/3117] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:35:30 2022] DELETE /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:35:30.691362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-229ea025-43b9-4c13-a7a3-fef2320f96ce tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:30.692143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-229ea025-43b9-4c13-a7a3-fef2320f96ce tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:30.832454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-229ea025-43b9-4c13-a7a3-fef2320f96ce tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:30.862080 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-229ea025-43b9-4c13-a7a3-fef2320f96ce tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1241 microversion: 2.1 time: 0.174626 Oct 17 15:35:30.874586 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1671/3118] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:30 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:30.885923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a42b244c-60e5-487d-82e9-030225c5c06c tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be414f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:30.974392 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a42b244c-60e5-487d-82e9-030225c5c06c tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1464 microversion: 2.1 time: 0.098379 Oct 17 15:35:30.976502 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1672/3119] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:30 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1464 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:30.990117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:30.994657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:31.013669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:31.014941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:31.016175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:31.017863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:31.018803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:31.019643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:31.313205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:31.325514 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-49143c25-ed40-4176-8aa8-d2393f92d94f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1314 microversion: 2.1 time: 1.076967 Oct 17 15:35:31.331223 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1448/3120] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:30 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1314 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:31.336916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:31.337747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:31.343975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:31.359480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:31.360493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:31.361390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:31.362587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:31.363420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:31.364147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:31.368309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:31.384900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:31.389022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-160b4fb7-25a7-4912-aab8-a60648c4fe28 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1482 microversion: 2.25 time: 0.408617 Oct 17 15:35:31.390415 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1673/3121] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:30 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1482 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:31.400046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-819b8d38-3fc5-46d1-bdcb-514975a15905 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2e0f1f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:31.486768 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-819b8d38-3fc5-46d1-bdcb-514975a15905 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 200 len: 1464 microversion: 2.1 time: 0.090813 Oct 17 15:35:31.487390 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1674/3122] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:31 2022] GET /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 1464 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:31.513280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:31.518937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:31.532670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:31.533178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:31.533624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:31.539324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:31.540217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:31.543981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:31.850907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:31.892101 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa4c625b-83e5-495b-975b-c3fa3d624147 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1506 microversion: 2.1 time: 0.402069 Oct 17 15:35:31.897492 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1675/3123] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:31 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:31.924017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:31.928126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:31.943094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:31.944387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:31.946198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:31.948716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:31.950371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:31.951691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:32.163696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:32.175525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5dc9a03c-5fa6-432f-a3b2-fc63c01e3056 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.842659 Oct 17 15:35:32.176144 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1449/3124] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:31 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:32.197727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:32.198738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:32.205700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:32.207706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:32.208553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:32.209226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:32.210212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:32.210980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:32.211661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:32.286587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:32.300806 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-860b9d25-077c-4eab-b583-0c6e8c057c0a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 200 len: 1468 microversion: 2.1 time: 0.400553 Oct 17 15:35:32.308369 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1676/3125] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:31 2022] GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 1468 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:32.340579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2167d53d-e8b3-486c-b03b-1cecd532867d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-77330200"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:32.343547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2167d53d-e8b3-486c-b03b-1cecd532867d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:32.352245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2167d53d-e8b3-486c-b03b-1cecd532867d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:32.352744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2167d53d-e8b3-486c-b03b-1cecd532867d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:32.353183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2167d53d-e8b3-486c-b03b-1cecd532867d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:32.353908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2167d53d-e8b3-486c-b03b-1cecd532867d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:32.354363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2167d53d-e8b3-486c-b03b-1cecd532867d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:32.354816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2167d53d-e8b3-486c-b03b-1cecd532867d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:32.534346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:32.565199 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-85e7d468-fcf1-477e-b074-eb53bd206ea3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1293 microversion: 2.1 time: 0.373402 Oct 17 15:35:32.572465 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1450/3126] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:32 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1293 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:32.579427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:32.580359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:32.590944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:32.591856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:32.592661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:32.595294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:32.596800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:32.597254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:32.680421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:32.764455 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2167d53d-e8b3-486c-b03b-1cecd532867d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "POST /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4/action" status: 202 len: 0 microversion: 2.1 time: 0.427770 Oct 17 15:35:32.767046 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1677/3127] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:35:32 2022] POST /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:35:32.774645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:32.776030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:32.800928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:32.802077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:32.803277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:32.804352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:32.805119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:32.805866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:33.192082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:33.212154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:33.216297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:33.231626 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8ec55f6-a927-4256-9316-a9b1be793e4d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1482 microversion: 2.25 time: 0.449669 Oct 17 15:35:33.239403 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1678/3128] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:32 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1482 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:33.260004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-907e8b22-7bb7-4ae8-8b7d-7fc1bf340a6d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be280d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:33.327741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:33.353290 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97593341-6a62-405a-b5e1-f2c1b960c9ad tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1314 microversion: 2.1 time: 0.774666 Oct 17 15:35:33.354359 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1451/3129] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:32 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:33.375497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:33.376918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:33.404693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:33.406076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:33.406748 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-907e8b22-7bb7-4ae8-8b7d-7fc1bf340a6d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.164932 Oct 17 15:35:33.407440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:33.408200 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1679/3130] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:33 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:33.409478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:33.415002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:33.416202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:33.426765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:33.427960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:33.459921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:33.465431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:33.466546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:33.470016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:33.477733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:33.478420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:34.104339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:34.113172 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9dc9a2b9-de31-4823-879d-f0d93e2d9a92 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1464 microversion: 2.1 time: 0.757316 Oct 17 15:35:34.136716 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1452/3131] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:33 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1464 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:34.185493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:34.188282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:34.228237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:34.229770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:34.232918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:34.238699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:34.240295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:34.244805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:34.248074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:34.299506 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bed939a1-2946-4355-bf74-18e09eeb583d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.871497 Oct 17 15:35:34.302853 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1680/3132] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:33 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:34.361689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d18ef19c-6135-439a-9fa2-5d9de72b7d63 req-f23175e7-e52d-4041-9e06-3be14f1d8376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32", "name": "network-vif-plugged", "status": "completed", "tag": "5f9d6d3c-e50e-4240-a11d-1cd02eabfeaf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:34.460991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d18ef19c-6135-439a-9fa2-5d9de72b7d63 req-f23175e7-e52d-4041-9e06-3be14f1d8376 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:34.461733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d18ef19c-6135-439a-9fa2-5d9de72b7d63 req-f23175e7-e52d-4041-9e06-3be14f1d8376 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:34.462713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d18ef19c-6135-439a-9fa2-5d9de72b7d63 req-f23175e7-e52d-4041-9e06-3be14f1d8376 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:34.485822 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d18ef19c-6135-439a-9fa2-5d9de72b7d63 req-f23175e7-e52d-4041-9e06-3be14f1d8376 service nova] Creating event network-vif-plugged:5f9d6d3c-e50e-4240-a11d-1cd02eabfeaf for instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 on n-h2-854441-12 Oct 17 15:35:34.505720 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d18ef19c-6135-439a-9fa2-5d9de72b7d63 req-f23175e7-e52d-4041-9e06-3be14f1d8376 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199737 Oct 17 15:35:34.507727 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1681/3133] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:34.541371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:34.545163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:34.571333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:34.577596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:34.583271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:34.584214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:34.588851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:34.591849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:34.619147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:34.645186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5027e51c-475a-4af0-a1db-d3acc0e4cd38 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1299 microversion: 2.1 time: 0.503881 Oct 17 15:35:34.673614 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1453/3134] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:34 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1299 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:34.679322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ce701a85-64a8-4185-964b-c011dbae80a1 req-2f898925-276e-4599-ba44-775e2dcc24c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad9d856-6811-4d1b-a6a5-7a4065f5c209", "name": "network-vif-deleted", "tag": "0a94060f-7ed4-4f6b-bfce-136b14e90e29"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:34.697653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ce701a85-64a8-4185-964b-c011dbae80a1 req-2f898925-276e-4599-ba44-775e2dcc24c5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:34.698460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ce701a85-64a8-4185-964b-c011dbae80a1 req-2f898925-276e-4599-ba44-775e2dcc24c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:34.699047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ce701a85-64a8-4185-964b-c011dbae80a1 req-2f898925-276e-4599-ba44-775e2dcc24c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:34.735896 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ce701a85-64a8-4185-964b-c011dbae80a1 req-2f898925-276e-4599-ba44-775e2dcc24c5 service nova] Creating event network-vif-deleted:0a94060f-7ed4-4f6b-bfce-136b14e90e29 for instance 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 on n-h1-854441-12 Oct 17 15:35:34.769501 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ce701a85-64a8-4185-964b-c011dbae80a1 req-2f898925-276e-4599-ba44-775e2dcc24c5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092717 Oct 17 15:35:34.782845 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1454/3135] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:34.791626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:34.793579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:34.802262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:34.803966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:34.804794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:34.806326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:34.807071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:34.807739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:34.889598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:34.903338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:34.909560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:34.913688 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3cce19a6-da3f-439f-a197-d82bc9d708dc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1266 microversion: 2.25 time: 0.395879 Oct 17 15:35:34.922175 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1682/3136] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:34 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1266 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:34.934285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d9c24f0-78b5-4fc9-b72d-1eaf3c6d7257 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be26d9d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:35.027055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d9c24f0-78b5-4fc9-b72d-1eaf3c6d7257 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.103340 Oct 17 15:35:35.028245 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1683/3137] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:34 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:35.157751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:35.159275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:35.167281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.168052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.169019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.170094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.171227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.171881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.218104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.218900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.219909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.220683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lazy-loading 'fault' on Instance uuid 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:35:35.231130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:35.256142 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-706c266f-cf26-405c-a9bc-aef730821ec4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1314 microversion: 2.1 time: 0.471316 Oct 17 15:35:35.257053 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1455/3138] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:34 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:35.286707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:35.298710 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-38f4e232-b412-4650-b0ee-3552b4a1b3d2 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 200 len: 1303 microversion: 2.1 time: 0.144878 Oct 17 15:35:35.299462 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1684/3139] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:35 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 1303 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:35.324136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:35.325075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:35.333083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.333083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.333520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.334044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.334585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.335234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.486242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:35.486783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:35.493847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.494823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.495521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.496506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.497240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.497982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.531237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] HTTP exception thrown: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Request method failure captured: Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 HTTP/1.1 Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXVPIUyj69_G1ZbCfY67HIEKeOnC8qpn_QDVY8RK_kdm2GvahofnapolnAB9WNtLCXqFEq3mS4EUQg9GHNsN6223q3E6A006Eq62Abd8XPPneurmZMTEQ1XBnrV076hO6PlSWlGi0nI2v2neMu9bL4ZsJB5xDnV6qNIW90Mj1BdwvTQ Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 17260d6e6104443aadd1f8d2894f256e Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-690180758 Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-690180758 Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 17260d6e6104443aadd1f8d2894f256e Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-690180758 Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachSCSIVolumeTestJSON-690180758-project Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a238ad41ef1e44658b2c7a0edfb7aefe Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-690180758-project Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '623adb03-8bce-4cd5-a01c-b21495fcc870'} Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:35.535241 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.543365 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.551050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:35.551312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Returning 404 to user: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:35.551312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf840d81-6594-44a8-a26c-81ef2116860a tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "DELETE /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 404 len: 111 microversion: 2.1 time: 0.065462 Oct 17 15:35:35.551312 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1685/3140] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:35 2022] DELETE /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:35:35.556224 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b46e9601-2094-4009-a35e-927e402dddf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.235823 Oct 17 15:35:35.557413 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1456/3141] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:35 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:35.572747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:35.573655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] [instance: 623adb03-8bce-4cd5-a01c-b21495fcc870] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:35.582609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.583546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.584416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.585536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.586234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.587308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.607683 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] HTTP exception thrown: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Request method failure captured: Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 HTTP/1.1 Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXVPIUyj69_G1ZbCfY67HIEKeOnC8qpn_QDVY8RK_kdm2GvahofnapolnAB9WNtLCXqFEq3mS4EUQg9GHNsN6223q3E6A006Eq62Abd8XPPneurmZMTEQ1XBnrV076hO6PlSWlGi0nI2v2neMu9bL4ZsJB5xDnV6qNIW90Mj1BdwvTQ Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 17260d6e6104443aadd1f8d2894f256e Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-690180758 Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/17260d6e6104443aadd1f8d2894f256e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-690180758 Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 17260d6e6104443aadd1f8d2894f256e Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-690180758 Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachSCSIVolumeTestJSON-690180758-project Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a238ad41ef1e44658b2c7a0edfb7aefe Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-690180758-project Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '623adb03-8bce-4cd5-a01c-b21495fcc870'} Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:35.610188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] Returning 404 to user: Instance 623adb03-8bce-4cd5-a01c-b21495fcc870 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e186979-9e38-41c9-bf73-6194a5b585f1 tempest-AttachSCSIVolumeTestJSON-690180758 tempest-AttachSCSIVolumeTestJSON-690180758-project] 10.222.0.87 "GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870" status: 404 len: 111 microversion: 2.1 time: 0.056658 Oct 17 15:35:35.620715 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1686/3142] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:35 2022] GET /compute/v2.1/servers/623adb03-8bce-4cd5-a01c-b21495fcc870 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:35.680971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:35.681633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:35.706292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.711362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.712108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.713652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.713652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.715772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.948798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:35.949698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:35.974398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.975588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.979538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:35.982158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:35.987615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:35.989419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.164074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:36.183398 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-98824193-4e36-401b-8d29-5a2be24a61b9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1367 microversion: 2.1 time: 0.507054 Oct 17 15:35:36.184407 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1457/3143] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:35 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1367 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:36.190367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8355eae6-968d-46ce-8998-9d93654b1c25 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be39adc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:36.326444 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8355eae6-968d-46ce-8998-9d93654b1c25 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.140631 Oct 17 15:35:36.327495 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1458/3144] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:36 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:36.335003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:36.339255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:36.358676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:36.359530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:36.359968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.360705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:36.361159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:36.361579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.551947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:36.612664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:36.616952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:36.620291 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21cd7d86-9462-405b-8777-b4df28af314a tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1266 microversion: 2.25 time: 0.677314 Oct 17 15:35:36.621815 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1687/3145] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:35 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1266 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:35:36.635033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:36.636783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: 1ad9d856-6811-4d1b-a6a5-7a4065f5c209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:36.655776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:36.656855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:36.659088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.660791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:36.661995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:36.663065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.683473 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] HTTP exception thrown: Instance 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 could not be found. Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Request method failure captured: Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 HTTP/1.1 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXXIzVWZ5a_ZGvPFxliXwuUbLyWNsSmzs6XLHlmW8M9M0WBaOBpuiy0C-o9DXAfu7luPxknj0X7ZiIon8w8AhxpymgL9b7_eWiWwrZXSt19SmM0rCgsFyRblPPn3zrNN_HpoOQLvDAk6Yl5IjP4UCtYGKIF-aPz8iFkPu4g_eFt9cK8 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 66fbb247e57942cf8c6e76c9c6a2f499 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueTestJSON-2031144191 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/66fbb247e57942cf8c6e76c9c6a2f499"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/66fbb247e57942cf8c6e76c9c6a2f499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_66fbb247e57942cf8c6e76c9c6a2f499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/66fbb247e57942cf8c6e76c9c6a2f499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueTestJSON-2031144191 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 66fbb247e57942cf8c6e76c9c6a2f499 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueTestJSON-2031144191 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerRescueTestJSON-2031144191-project Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: d72b67f070cb43f69c568a3d38f02463 Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueTestJSON-2031144191-project Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 could not be found. Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1ad9d856-6811-4d1b-a6a5-7a4065f5c209'} Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 could not be found. Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 could not be found. Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:36.685124 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 could not be found. Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Returning 404 to user: Instance 1ad9d856-6811-4d1b-a6a5-7a4065f5c209 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d87eaa96-8199-4606-8a1b-a4561d61efa3 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209" status: 404 len: 111 microversion: 2.1 time: 0.062684 Oct 17 15:35:36.693740 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1688/3146] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:36 2022] GET /compute/v2.1/servers/1ad9d856-6811-4d1b-a6a5-7a4065f5c209 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:36.696751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ac2898ce-de20-405d-9396-96ff2f0721fb req-9e5a5b24-32de-417a-a0ae-e0ac60347d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa21afee-1c0c-49b3-b91c-bf7fa5438381", "name": "network-vif-unplugged", "status": "completed", "tag": "8a3944bf-786e-467e-8893-ff95b6e28ff0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:36.700783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:36.714157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac2898ce-de20-405d-9396-96ff2f0721fb req-9e5a5b24-32de-417a-a0ae-e0ac60347d51 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:36.714688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac2898ce-de20-405d-9396-96ff2f0721fb req-9e5a5b24-32de-417a-a0ae-e0ac60347d51 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:36.715126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ac2898ce-de20-405d-9396-96ff2f0721fb req-9e5a5b24-32de-417a-a0ae-e0ac60347d51 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.716722 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-da730245-5a07-49bc-bb0c-041151bd72a0 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1314 microversion: 2.1 time: 0.379734 Oct 17 15:35:36.717397 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1459/3147] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:36 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:36.724098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:36.724415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:36.742003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:36.742804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:36.743885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.744779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:36.745439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:36.746053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.750483 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ac2898ce-de20-405d-9396-96ff2f0721fb req-9e5a5b24-32de-417a-a0ae-e0ac60347d51 service nova] Creating event network-vif-unplugged:8a3944bf-786e-467e-8893-ff95b6e28ff0 for instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 on n-h2-854441-12 Oct 17 15:35:36.766798 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ac2898ce-de20-405d-9396-96ff2f0721fb req-9e5a5b24-32de-417a-a0ae-e0ac60347d51 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077739 Oct 17 15:35:36.774933 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1689/3148] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:36.785598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:36.787053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:36.806811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:36.811906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:36.813027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.814608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:36.820449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:36.821532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:36.884037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:35:37.048602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:37.066707 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f172771b-bbd3-4a08-b0e6-e0ba975612d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.346479 Oct 17 15:35:37.069010 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1460/3149] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:36 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:37.075151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8c2847d8-36fd-4eb4-96b5-2725c9f26bb4 req-79a95dbb-eb94-4b7c-9b2f-beac53ce83f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05b8d74-dc5f-433d-bd93-328e0511f478", "name": "network-vif-deleted", "tag": "b06a0418-6456-4d25-8cf6-75d075422311"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:37.093219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8c2847d8-36fd-4eb4-96b5-2725c9f26bb4 req-79a95dbb-eb94-4b7c-9b2f-beac53ce83f1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.094651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8c2847d8-36fd-4eb4-96b5-2725c9f26bb4 req-79a95dbb-eb94-4b7c-9b2f-beac53ce83f1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.095748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8c2847d8-36fd-4eb4-96b5-2725c9f26bb4 req-79a95dbb-eb94-4b7c-9b2f-beac53ce83f1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.104756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:37.126305 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8c2847d8-36fd-4eb4-96b5-2725c9f26bb4 req-79a95dbb-eb94-4b7c-9b2f-beac53ce83f1 service nova] Creating event network-vif-deleted:b06a0418-6456-4d25-8cf6-75d075422311 for instance c05b8d74-dc5f-433d-bd93-328e0511f478 on n-h2-854441-12 Oct 17 15:35:37.139326 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8c2847d8-36fd-4eb4-96b5-2725c9f26bb4 req-79a95dbb-eb94-4b7c-9b2f-beac53ce83f1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064747 Oct 17 15:35:37.140779 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1461/3150] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:37.142058 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f1113d49-96f2-479e-a470-92416021be40 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "DELETE /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 204 len: 0 microversion: 2.1 time: 0.364076 Oct 17 15:35:37.143416 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1690/3151] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:36 2022] DELETE /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:35:37.149866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-24bcdfb4-50b4-4b27-8bba-965bd4234e45 req-6e9eac4d-8b6f-4e6a-8c3b-76355a9c73a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40d53c0-6353-460c-ade7-186346f19950", "tag": "0c2e3201-6294-48eb-a5cf-b63c7654f569"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:37.165973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:37.167929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:37.180386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-24bcdfb4-50b4-4b27-8bba-965bd4234e45 req-6e9eac4d-8b6f-4e6a-8c3b-76355a9c73a0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.180989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-24bcdfb4-50b4-4b27-8bba-965bd4234e45 req-6e9eac4d-8b6f-4e6a-8c3b-76355a9c73a0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.181434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-24bcdfb4-50b4-4b27-8bba-965bd4234e45 req-6e9eac4d-8b6f-4e6a-8c3b-76355a9c73a0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.194249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.196101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.197202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.198912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.206536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.207505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.209692 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-24bcdfb4-50b4-4b27-8bba-965bd4234e45 req-6e9eac4d-8b6f-4e6a-8c3b-76355a9c73a0 service nova] Creating event network-changed:0c2e3201-6294-48eb-a5cf-b63c7654f569 for instance c40d53c0-6353-460c-ade7-186346f19950 on n-h1-854441-12 Oct 17 15:35:37.223829 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-24bcdfb4-50b4-4b27-8bba-965bd4234e45 req-6e9eac4d-8b6f-4e6a-8c3b-76355a9c73a0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080318 Oct 17 15:35:37.224924 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1462/3152] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:37.234385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:37.235142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:37.243213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.244129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.244129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.244852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.245762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.246198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.465424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:37.475517 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa6fe9a5-ec2b-45ab-bdc4-4a3c99bf0876 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1367 microversion: 2.1 time: 0.245924 Oct 17 15:35:37.476374 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1463/3153] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:37 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:35:37.492411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-12ef677f-ea86-4fbf-ac1e-37bb68d7a7f6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3e3f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:37.623779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:37.636958 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-12ef677f-ea86-4fbf-ac1e-37bb68d7a7f6 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.159328 Oct 17 15:35:37.645372 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-486d05c4-dadf-4388-b5c7-328129378479 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1491 microversion: 2.1 time: 0.497097 Oct 17 15:35:37.648930 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1691/3154] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:37 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1491 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:37.651249 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1464/3155] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:37 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:37.690810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:37.698209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:37.718143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.718690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.719133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.719854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.720309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.730676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.747614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:37.749006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:37.781225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.782440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.783512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.785098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:37.786135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:37.787299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:37.942698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:37.961497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:37.969096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:37.970448 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7e825ab-5380-4822-9ca4-0bf6f1200f00 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1266 microversion: 2.25 time: 0.319902 Oct 17 15:35:37.971087 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1692/3156] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:37 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:38.110918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:38.111547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:38.130840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:38.131388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:38.132123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:38.132840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:38.133291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:38.133710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:38.246612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:38.255693 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-472bcee2-2503-43b8-a23c-7c5022880020 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1501 microversion: 2.1 time: 0.515300 Oct 17 15:35:38.256824 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1465/3157] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:37 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1501 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:38.295100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:38.296420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:38.307864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:38.308699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:38.309511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:38.313616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:38.314654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:38.315480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:38.375440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lazy-loading 'flavor' on Instance uuid 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:35:38.573655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:38.602200 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f13ba1b-67ca-4b95-a0eb-afca64f611b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.495247 Oct 17 15:35:38.603154 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1693/3158] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:38 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:35:38.619401 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-550abd3a-0c5c-4f60-9007-696f7a77ef6f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "POST /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32/action" status: 202 len: 0 microversion: 2.1 time: 0.331061 Oct 17 15:35:38.628990 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1466/3159] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:35:38 2022] POST /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:35:38.632181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:38.633068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:38.646679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:38.651036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:38.651637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:38.652078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:38.652826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:38.653285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:38.653712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:38.667226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:38.689596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:38.690112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:38.690586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:38.691341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:38.691805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:38.692233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:38.900883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:38.910328 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e35db951-1726-4216-a593-b8c0972cf7f8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1367 microversion: 2.1 time: 0.298506 Oct 17 15:35:38.926529 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1694/3160] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:38 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:38.935729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f1116638-d8a9-4ecb-b4af-45c32916a314 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2e0f310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:39.082557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f1116638-d8a9-4ecb-b4af-45c32916a314 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.156755 Oct 17 15:35:39.099003 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1695/3161] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:38 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:39.104382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:39.105143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:39.122870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:39.123538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:39.124079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:39.124965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:39.125547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:39.126071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:39.143134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:39.157737 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-64f54b1d-2a9a-4fe1-afca-0f64f442a3e7 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1509 microversion: 2.1 time: 0.525843 Oct 17 15:35:39.172005 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1467/3162] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:38 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:39.185105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:39.185719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:39.204086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:39.206149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:39.206653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:39.207409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:39.207870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:39.212077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:39.370253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:39.385701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:39.387251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:39.393628 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-73faa8d7-fd0e-4093-a47b-60b718a45615 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1266 microversion: 2.25 time: 0.220172 Oct 17 15:35:39.394586 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1468/3163] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:39 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:39.630071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:39.631189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:39.642427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:39.642953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:39.643392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:39.644123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:39.644582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:39.645012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:39.954099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:39.966164 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e15509b0-1461-41e8-a20d-c3110b846de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.341323 Oct 17 15:35:39.967797 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1469/3164] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:39 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:35:39.974124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:39.975042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:39.983352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:39.984385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:39.985091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:39.986078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:39.986876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:39.987507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:40.242107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:40.257934 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c73550bb-9402-402b-bf91-2afd971e2220 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1491 microversion: 2.1 time: 1.157499 Oct 17 15:35:40.271985 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1696/3165] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:39 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1491 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:40.282170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9c8bb1e7-51df-4bff-a9af-0d5a07ce19d3 req-e21e9327-413c-4312-933f-3a60758ba73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "name": "network-vif-plugged", "status": "completed", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:40.290806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:40.292279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:40.297824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c8bb1e7-51df-4bff-a9af-0d5a07ce19d3 req-e21e9327-413c-4312-933f-3a60758ba73f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:40.298710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c8bb1e7-51df-4bff-a9af-0d5a07ce19d3 req-e21e9327-413c-4312-933f-3a60758ba73f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:40.300635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c8bb1e7-51df-4bff-a9af-0d5a07ce19d3 req-e21e9327-413c-4312-933f-3a60758ba73f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:40.315690 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9c8bb1e7-51df-4bff-a9af-0d5a07ce19d3 req-e21e9327-413c-4312-933f-3a60758ba73f service nova] Creating event network-vif-plugged:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:35:40.322389 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9c8bb1e7-51df-4bff-a9af-0d5a07ce19d3 req-e21e9327-413c-4312-933f-3a60758ba73f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048120 Oct 17 15:35:40.324243 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1697/3166] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:40.331910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b17fb2d6-212e-4eb2-8274-9ad19c198476 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be26d160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:40.411130 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b17fb2d6-212e-4eb2-8274-9ad19c198476 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.085278 Oct 17 15:35:40.411795 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1698/3167] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:40 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:40.427536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:40.435866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:40.462126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:40.462990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:40.463605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:40.464895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:40.465196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:40.465621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:40.504105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:40.532832 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1c40c4ba-69e4-4e71-989a-ef1766ec2088 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1367 microversion: 2.1 time: 0.546426 Oct 17 15:35:40.534667 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1470/3168] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:39 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:40.592293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:40.593267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:40.607272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:40.608148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:40.608860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:40.609923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:40.610706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:40.612133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:40.846348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=20 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:40.927249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:40.938965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:40.942329 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d606e64a-2f62-49ac-8662-7409682f40ff tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1509 microversion: 2.1 time: 0.519153 Oct 17 15:35:40.943258 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1699/3169] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:40 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1509 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:41.092982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:41.093770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:41.102986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:41.103699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:41.104286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:41.105491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:41.106103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:41.106747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:41.114329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:41.128376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:41.129962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:41.131314 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f6e1feb-23c1-4eab-8e10-74cbb38ba878 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1266 microversion: 2.25 time: 0.575094 Oct 17 15:35:41.144389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:35:41.154261 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1471/3170] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:40 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1266 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:41.166355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:41.167069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:41.179641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:41.180159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:41.180611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:41.185753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:41.186474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:41.187969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:41.319167 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7924b915-2879-4884-b011-9369cba03a5f tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 204 len: 0 microversion: 2.32 time: 0.374155 Oct 17 15:35:41.320327 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1700/3171] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:35:40 2022] DELETE /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:35:41.332804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:41.334066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:41.342929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:41.343701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:41.346965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:41.351881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:41.352799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:41.353631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:41.550899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:41.571262 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f3d1c024-f9fd-4559-bad0-4c778b4b598b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.415738 Oct 17 15:35:41.578325 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1472/3172] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:41 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:41.590130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:41.603911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:41.613803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:41.615132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:41.623506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:41.624762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:41.625366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:41.625921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:42.099834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:42.141138 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79a119ab-3c39-4178-892b-ec7f0b49547f tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1491 microversion: 2.1 time: 0.818925 Oct 17 15:35:42.160853 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1701/3173] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:41 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1491 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:42.194862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e8cf1e1-55e6-438b-a5b6-72fd9debd468 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28beac65e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:42.199820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:42.237399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:42.240697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:42.256365 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f76b78c4-46b3-40f0-8a90-f3ae1a5e4018 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2958 microversion: 2.32 time: 0.658332 Oct 17 15:35:42.267042 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1473/3174] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:41 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2958 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:42.299387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:42.300528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:42.335997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:42.339327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:42.339873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:42.341916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:42.343175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:42.344024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:42.356891 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e8cf1e1-55e6-438b-a5b6-72fd9debd468 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.176253 Oct 17 15:35:42.358034 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1702/3175] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:42 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:42.380605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:42.383178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:42.410610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:42.413667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:42.416107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:42.417889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:42.419299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:42.420371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:42.661174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:42.689816 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9d43ad7e-a9b2-47d9-96b1-9febce880e5e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1367 microversion: 2.1 time: 0.412252 Oct 17 15:35:42.696199 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1474/3176] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:42 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:42.708064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:42.725531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:42.754925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:42.756351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:42.757732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:42.759330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:42.760531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:42.761559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:42.940683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:42.962871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:42.967658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:42.970172 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7aaef45b-6712-4281-ab95-85251f5d1532 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1266 microversion: 2.25 time: 0.269694 Oct 17 15:35:42.971806 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1475/3177] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:42 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:42.974010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:42.990413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-6caefb70-a6af-422c-ba33-9aea25ba2a70 req-dd20ea37-1619-4ce7-956b-6bc619fd19f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43cdafe-be87-49e3-be6d-d64b0f3b45f4", "name": "network-vif-plugged", "status": "completed", "tag": "2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:42.997107 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d13f65a-f642-4c3c-9ed2-f6217dbe0bda tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1492 microversion: 2.1 time: 0.618053 Oct 17 15:35:42.998366 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1703/3178] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:42 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1492 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:43.011695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6caefb70-a6af-422c-ba33-9aea25ba2a70 req-dd20ea37-1619-4ce7-956b-6bc619fd19f9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.014444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6caefb70-a6af-422c-ba33-9aea25ba2a70 req-dd20ea37-1619-4ce7-956b-6bc619fd19f9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.015646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6caefb70-a6af-422c-ba33-9aea25ba2a70 req-dd20ea37-1619-4ce7-956b-6bc619fd19f9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.040511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d561bdd2-8a0f-4233-bf2c-06db266b5b4b req-b229ba5d-d55e-4c4a-b6e1-87994da972c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faca81c2-979f-4b9e-bc24-0ef9e7a9b418", "name": "network-vif-deleted", "tag": "925d597a-79ef-4b38-82c8-f8a52dcabf95"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:43.047687 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-6caefb70-a6af-422c-ba33-9aea25ba2a70 req-dd20ea37-1619-4ce7-956b-6bc619fd19f9 service nova] Creating event network-vif-plugged:2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43 for instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 on n-h2-854441-12 Oct 17 15:35:43.064729 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-6caefb70-a6af-422c-ba33-9aea25ba2a70 req-dd20ea37-1619-4ce7-956b-6bc619fd19f9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090040 Oct 17 15:35:43.066268 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1476/3179] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:43.076380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:43.077173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d561bdd2-8a0f-4233-bf2c-06db266b5b4b req-b229ba5d-d55e-4c4a-b6e1-87994da972c4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.080859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d561bdd2-8a0f-4233-bf2c-06db266b5b4b req-b229ba5d-d55e-4c4a-b6e1-87994da972c4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.082432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:43.083282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d561bdd2-8a0f-4233-bf2c-06db266b5b4b req-b229ba5d-d55e-4c4a-b6e1-87994da972c4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.130792 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d561bdd2-8a0f-4233-bf2c-06db266b5b4b req-b229ba5d-d55e-4c4a-b6e1-87994da972c4 service nova] Creating event network-vif-deleted:925d597a-79ef-4b38-82c8-f8a52dcabf95 for instance faca81c2-979f-4b9e-bc24-0ef9e7a9b418 on n-h2-854441-12 Oct 17 15:35:43.149740 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d561bdd2-8a0f-4233-bf2c-06db266b5b4b req-b229ba5d-d55e-4c4a-b6e1-87994da972c4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135433 Oct 17 15:35:43.150241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.153849 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1704/3180] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:43.154329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.155681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.156974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.157804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.158579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.169432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:43.175063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:43.197765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.204310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.206058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.207872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.211676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.214647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.326584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:35:43.602000 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8944d154-cfa0-46e5-a3b2-0a16f04fbe9f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 204 len: 0 microversion: 2.1 time: 0.441557 Oct 17 15:35:43.604577 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1705/3181] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:43 2022] DELETE /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:35:43.615995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:43.616791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:43.625280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.625784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.626423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.627200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.627658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.628280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.675050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.675592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.675978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.676442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lazy-loading 'fault' on Instance uuid faca81c2-979f-4b9e-bc24-0ef9e7a9b418 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:35:43.746358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:43.759017 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7423ddf-f791-403f-b778-42959fb466e7 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1303 microversion: 2.1 time: 0.153088 Oct 17 15:35:43.760957 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1706/3182] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:43 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:43.767621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:43.768824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:43.776716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.777461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.778367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.779340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:43.779982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:43.780759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:43.914341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:43.932857 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-50940a6c-8020-4a86-b57a-e69b7eb9f1d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1365 microversion: 2.1 time: 0.864705 Oct 17 15:35:43.936553 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1477/3183] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:43 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1365 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:43.950000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-750f1674-7063-45a7-9ab8-461bc08c9cea tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3a7670>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:44.065613 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-750f1674-7063-45a7-9ab8-461bc08c9cea tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.127418 Oct 17 15:35:44.067309 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1478/3184] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:43 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:44.087316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:44.088076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:44.132171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:44.135811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:44.136450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:44.144084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:44.144589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:44.148433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:44.277619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:44.327548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:44.333827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:44.337588 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ecae5e3-958b-491d-8826-dc6f2b7003ab tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2958 microversion: 2.32 time: 0.574564 Oct 17 15:35:44.352982 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1707/3185] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:43 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2958 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:44.392724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:44.399012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:44.426761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:44.432969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:44.433478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:44.434232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:44.434744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:44.435179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:44.862284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:44.877469 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a8a97fa-f706-4db3-8884-ad1bfca84034 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1367 microversion: 2.1 time: 0.522551 Oct 17 15:35:44.878344 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1708/3186] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:44 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1367 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:44.883968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:44.892718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:44.905282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:44.906036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:44.906735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:44.907650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:44.908262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:44.908898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:44.989380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:44.989950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:44.990392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:44.990893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lazy-loading 'fault' on Instance uuid c05b8d74-dc5f-433d-bd93-328e0511f478 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:35:45.108269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:45.133049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:45.142335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:45.143770 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dead96d2-6d8a-425a-a4b4-1948d69441ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 200 len: 1271 microversion: 2.25 time: 0.264115 Oct 17 15:35:45.169154 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1709/3187] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:44 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:45.174767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:45.178478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:45.186823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:45.194474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.195059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.198603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:45.199448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.199933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.200371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:45.201184 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8e703d5e-37a8-4747-b859-d62d85d04389 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1498 microversion: 2.1 time: 1.132265 Oct 17 15:35:45.206639 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1479/3188] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:44 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1498 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:45.213887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:45.217537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:45.231367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.235275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.236056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:45.237120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.237832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.241119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:45.245740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:45.251823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.253002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.255272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:45.255941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lazy-loading 'fault' on Instance uuid faca81c2-979f-4b9e-bc24-0ef9e7a9b418 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:35:45.327970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72b67f070cb43f69c568a3d38f02463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fbb247e57942cf8c6e76c9c6a2f499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:45.350772 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a71faaf6-afe1-4cfb-aa39-488b2a0cb414 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 200 len: 1303 microversion: 2.1 time: 0.178760 Oct 17 15:35:45.352520 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1710/3189] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:45 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:45.362631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3a3681e1-0300-4a61-926d-e5bab19608a3 req-4d4a15ff-edec-4a75-8bc1-caf7fc869615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40d53c0-6353-460c-ade7-186346f19950", "name": "network-vif-plugged", "status": "completed", "tag": "0c2e3201-6294-48eb-a5cf-b63c7654f569"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:45.391763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3a3681e1-0300-4a61-926d-e5bab19608a3 req-4d4a15ff-edec-4a75-8bc1-caf7fc869615 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.392869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3a3681e1-0300-4a61-926d-e5bab19608a3 req-4d4a15ff-edec-4a75-8bc1-caf7fc869615 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.393888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3a3681e1-0300-4a61-926d-e5bab19608a3 req-4d4a15ff-edec-4a75-8bc1-caf7fc869615 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:45.424129 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3a3681e1-0300-4a61-926d-e5bab19608a3 req-4d4a15ff-edec-4a75-8bc1-caf7fc869615 service nova] Creating event network-vif-plugged:0c2e3201-6294-48eb-a5cf-b63c7654f569 for instance c40d53c0-6353-460c-ade7-186346f19950 on n-h1-854441-12 Oct 17 15:35:45.438012 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3a3681e1-0300-4a61-926d-e5bab19608a3 req-4d4a15ff-edec-4a75-8bc1-caf7fc869615 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082919 Oct 17 15:35:45.440951 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1711/3190] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:45.455264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2bc67df5-6747-433b-9c60-95a76132265e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2f4280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:45.618948 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2bc67df5-6747-433b-9c60-95a76132265e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.174907 Oct 17 15:35:45.627899 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1712/3191] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:45 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:45.632142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:45.634887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:45.653363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.654375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.655423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:45.657218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.658331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.659421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:45.859235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:45.872078 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c326ad73-82ec-432f-a97f-e54c2c42e61c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1551 microversion: 2.1 time: 0.663789 Oct 17 15:35:45.879178 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1480/3192] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:45 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1551 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:45.896141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea3b04e1-7a63-4fa7-9aca-11f9c389d62b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:45.898536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea3b04e1-7a63-4fa7-9aca-11f9c389d62b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:45.914682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea3b04e1-7a63-4fa7-9aca-11f9c389d62b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.915660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea3b04e1-7a63-4fa7-9aca-11f9c389d62b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.919632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea3b04e1-7a63-4fa7-9aca-11f9c389d62b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:45.920794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea3b04e1-7a63-4fa7-9aca-11f9c389d62b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:45.921571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea3b04e1-7a63-4fa7-9aca-11f9c389d62b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:45.922257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea3b04e1-7a63-4fa7-9aca-11f9c389d62b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:46.116280 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea3b04e1-7a63-4fa7-9aca-11f9c389d62b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225326 Oct 17 15:35:46.116934 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1481/3193] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:35:45 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:35:46.122657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:46.124779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:46.146443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:46.147979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:46.148529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:46.153684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:46.154257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:46.157054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:46.521526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:46.531575 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ac1097ba-10f9-405a-be76-ad2316e65557 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1367 microversion: 2.1 time: 0.413272 Oct 17 15:35:46.532218 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1482/3194] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:46 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:46.546102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:46.547978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: c05b8d74-dc5f-433d-bd93-328e0511f478] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:46.564108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:46.569639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:46.571068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:46.576077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:46.576889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:46.577517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:46.619146 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] HTTP exception thrown: Instance c05b8d74-dc5f-433d-bd93-328e0511f478 could not be found. Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Request method failure captured: Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 HTTP/1.1 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRk3lxhSzaIedWLrfscY-HNfx03spIsrZD38End5rw-61WfZFCkknyT-_71OiL6lrqXSUFqYiaIi4BqWQJHzmJHbabpl77EA7S3eCkOtsUQ8zOwoiVYZGUGUWUq0rMXVyJvcqdb_nnzXPJ27iZHKtnJjT97MQZCHOP865Z7-cRluL8 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 02edcfcf47504f30a7d6770b945a1cf7 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 02edcfcf47504f30a7d6770b945a1cf7 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-LiveAutoBlockMigrationV225Test-734225104-project Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 54134ad155cf45d19f6a551710c84a9e Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-734225104-project Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance c05b8d74-dc5f-433d-bd93-328e0511f478 could not be found. Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'c05b8d74-dc5f-433d-bd93-328e0511f478'} Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c05b8d74-dc5f-433d-bd93-328e0511f478 could not be found. Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c05b8d74-dc5f-433d-bd93-328e0511f478 could not be found. Oct 17 15:35:46.631948 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.636448 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:46.636448 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.636448 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:46.636448 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:46.636448 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:46.636448 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:46.636448 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:46.636448 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c05b8d74-dc5f-433d-bd93-328e0511f478 could not be found. Oct 17 15:35:46.636448 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.637526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Returning 404 to user: Instance c05b8d74-dc5f-433d-bd93-328e0511f478 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:46.640955 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-66c0f8f5-41a6-4cd9-a493-195d6c821ed8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478" status: 404 len: 111 microversion: 2.25 time: 0.103193 Oct 17 15:35:46.645789 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1483/3195] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:46 2022] GET /compute/v2.1/servers/c05b8d74-dc5f-433d-bd93-328e0511f478 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:35:46.654100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:46.668369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:46.670962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:46.672596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:46.673583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:46.674081 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58f322dc-e4d4-41d3-bb3f-ca88203d12d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2958 microversion: 2.32 time: 1.050878 Oct 17 15:35:46.679688 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1713/3196] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:45 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2958 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:46.699927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:46.700613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] [instance: faca81c2-979f-4b9e-bc24-0ef9e7a9b418] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:46.702567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:46.703715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:46.708472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:46.709582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:46.710742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:46.712142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:46.712651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:46.713110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:46.713815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:46.714350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:46.714819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:46.718410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:46.738301 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] HTTP exception thrown: Instance faca81c2-979f-4b9e-bc24-0ef9e7a9b418 could not be found. Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Request method failure captured: Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 HTTP/1.1 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXXIzVWZ5a_ZGvPFxliXwuUbLyWNsSmzs6XLHlmW8M9M0WBaOBpuiy0C-o9DXAfu7luPxknj0X7ZiIon8w8AhxpymgL9b7_eWiWwrZXSt19SmM0rCgsFyRblPPn3zrNN_HpoOQLvDAk6Yl5IjP4UCtYGKIF-aPz8iFkPu4g_eFt9cK8 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 66fbb247e57942cf8c6e76c9c6a2f499 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueTestJSON-2031144191 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/66fbb247e57942cf8c6e76c9c6a2f499"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/66fbb247e57942cf8c6e76c9c6a2f499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_66fbb247e57942cf8c6e76c9c6a2f499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/66fbb247e57942cf8c6e76c9c6a2f499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueTestJSON-2031144191 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 66fbb247e57942cf8c6e76c9c6a2f499 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueTestJSON-2031144191 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerRescueTestJSON-2031144191-project Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: d72b67f070cb43f69c568a3d38f02463 Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueTestJSON-2031144191-project Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance faca81c2-979f-4b9e-bc24-0ef9e7a9b418 could not be found. Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'faca81c2-979f-4b9e-bc24-0ef9e7a9b418'} Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faca81c2-979f-4b9e-bc24-0ef9e7a9b418 could not be found. Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faca81c2-979f-4b9e-bc24-0ef9e7a9b418 could not be found. Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:46.740685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faca81c2-979f-4b9e-bc24-0ef9e7a9b418 could not be found. Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] Returning 404 to user: Instance faca81c2-979f-4b9e-bc24-0ef9e7a9b418 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c9f99d6-0735-42d8-80f1-38556f175393 tempest-ServerRescueTestJSON-2031144191 tempest-ServerRescueTestJSON-2031144191-project] 10.222.0.87 "GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418" status: 404 len: 111 microversion: 2.1 time: 0.061419 Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1714/3197] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:46 2022] GET /compute/v2.1/servers/faca81c2-979f-4b9e-bc24-0ef9e7a9b418 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:46.749309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1c128a3-b09a-42fc-bd9b-8dacba5e6159 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be99cca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:46.813502 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1c128a3-b09a-42fc-bd9b-8dacba5e6159 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.068955 Oct 17 15:35:46.822203 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1715/3198] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:46 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:47.561572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:47.562876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:47.604742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:47.605546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:47.611471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:47.613875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:47.619717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:47.620508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:48.075401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:48.130887 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1efb0c5d-b401-4ad9-bc31-548fd95a6482 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1498 microversion: 2.1 time: 1.479689 Oct 17 15:35:48.169621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1484/3199] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:46 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1498 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:48.193351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:48.197264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:48.233930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:48.237703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:48.243430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:48.247780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:48.248617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:48.252856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:49.353526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:49.418063 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-730ca200-1d15-482f-8380-5423c92d65af tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1558 microversion: 2.1 time: 1.857748 Oct 17 15:35:49.463965 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1716/3200] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:47 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1558 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:49.509998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d23e898-8e0e-4f39-a22b-a8aae41dd0e8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be4148b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:49.717067 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d23e898-8e0e-4f39-a22b-a8aae41dd0e8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.251078 Oct 17 15:35:49.726180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:49.731439 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1717/3201] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:49 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:49.763685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d4e4e52a-c953-408f-a831-8c921c8072ea req-7daf6959-e780-417a-bdc9-dcbea0b2125f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-unplugged", "status": "completed", "tag": "28f4ade6-9249-408e-bddf-227f23b2d6f1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:49.792792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:49.800181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:49.822063 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad1d4b4e-77c1-458f-a059-e6986f3de7f2 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2937 microversion: 2.32 time: 1.643041 Oct 17 15:35:49.829714 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1485/3202] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:48 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2937 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:49.853460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d4e4e52a-c953-408f-a831-8c921c8072ea req-7daf6959-e780-417a-bdc9-dcbea0b2125f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:49.854276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d4e4e52a-c953-408f-a831-8c921c8072ea req-7daf6959-e780-417a-bdc9-dcbea0b2125f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:49.854909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d4e4e52a-c953-408f-a831-8c921c8072ea req-7daf6959-e780-417a-bdc9-dcbea0b2125f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:49.857217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5a3e5faa-6040-4c46-ab73-c2889f8030bd req-9f215418-6acf-4256-b81d-4eea030eb9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32", "name": "network-vif-deleted", "tag": "5f9d6d3c-e50e-4240-a11d-1cd02eabfeaf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:49.864165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:35:49.892430 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d4e4e52a-c953-408f-a831-8c921c8072ea req-7daf6959-e780-417a-bdc9-dcbea0b2125f service nova] Creating event network-vif-unplugged:28f4ade6-9249-408e-bddf-227f23b2d6f1 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:35:49.921793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5a3e5faa-6040-4c46-ab73-c2889f8030bd req-9f215418-6acf-4256-b81d-4eea030eb9c5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:49.933626 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d4e4e52a-c953-408f-a831-8c921c8072ea req-7daf6959-e780-417a-bdc9-dcbea0b2125f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.191468 Oct 17 15:35:49.934538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5a3e5faa-6040-4c46-ab73-c2889f8030bd req-9f215418-6acf-4256-b81d-4eea030eb9c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:49.935514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5a3e5faa-6040-4c46-ab73-c2889f8030bd req-9f215418-6acf-4256-b81d-4eea030eb9c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:49.936763 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1718/3203] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:49.965896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:49.966776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:50.002749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:50.008549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:50.014425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:50.017685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:50.021555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:50.023337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:50.026584 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5a3e5faa-6040-4c46-ab73-c2889f8030bd req-9f215418-6acf-4256-b81d-4eea030eb9c5 service nova] Creating event network-vif-deleted:5f9d6d3c-e50e-4240-a11d-1cd02eabfeaf for instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 on n-h2-854441-12 Oct 17 15:35:50.053805 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5a3e5faa-6040-4c46-ab73-c2889f8030bd req-9f215418-6acf-4256-b81d-4eea030eb9c5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214070 Oct 17 15:35:50.062767 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1486/3204] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:50.090379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f1b72980-4134-4e6b-8405-706b78ecc9c3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:50.092905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f1b72980-4134-4e6b-8405-706b78ecc9c3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:50.127512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1b72980-4134-4e6b-8405-706b78ecc9c3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:50.132480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1b72980-4134-4e6b-8405-706b78ecc9c3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:50.133649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1b72980-4134-4e6b-8405-706b78ecc9c3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:50.136001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1b72980-4134-4e6b-8405-706b78ecc9c3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:50.143772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1b72980-4134-4e6b-8405-706b78ecc9c3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:50.144989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1b72980-4134-4e6b-8405-706b78ecc9c3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:50.210358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:50.210982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:50.215470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:50.218085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lazy-loading 'fault' on Instance uuid 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:35:50.633097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745a483a369e4e83849cee037f5b67ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ace059be046f4bf77aa4419fec590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:50.646554 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b258b39-4ed5-4aad-afcf-80862336f664 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 200 len: 1304 microversion: 2.1 time: 0.705543 Oct 17 15:35:50.651224 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1719/3205] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:49 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 1304 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:50.710905 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f1b72980-4134-4e6b-8405-706b78ecc9c3 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.644786 Oct 17 15:35:50.711968 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1487/3206] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:35:50 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-interface => generated 285 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:50.747241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f0205df-b2cd-43ca-91e6-68657f117ce3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2bba60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:50.856600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:50.858063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:50.867707 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f0205df-b2cd-43ca-91e6-68657f117ce3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.123138 Oct 17 15:35:50.869547 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1720/3207] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:50 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:50.878240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:50.878976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:50.888287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:50.889542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:50.890271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:50.891090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:51.675666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:51.677485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:51.703993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:51.708046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:51.711937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:51.714637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:51.719678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:51.724459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:51.819896 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 HTTP/1.1 Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32'} Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:51.823200 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.827542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:51.827542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:51.827542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:51.827542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:51.827542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:51.827542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.827542 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.831088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:51.836341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be61bfd1-5a03-4ec1-85d5-8a6c444356f6 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 404 len: 111 microversion: 2.1 time: 0.165385 Oct 17 15:35:51.845982 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1721/3208] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:51 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:51.867311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:51.872495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:51.897282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:51.902315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:51.906829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:51.908203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:51.909028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:51.913735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:51.977436 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 HTTP/1.1 Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32'} Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:51.980529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:51.984307 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af51f7b9-c436-449f-9b61-ffcb34004564 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 404 len: 111 microversion: 2.1 time: 0.126755 Oct 17 15:35:51.985257 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1722/3209] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:51 2022] DELETE /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:52.003118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-017f56c8-bf47-4347-bbd3-e084ed36b6c3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be993940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:52.132177 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-017f56c8-bf47-4347-bbd3-e084ed36b6c3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.145496 Oct 17 15:35:52.133095 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1723/3210] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:51 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:52.156255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5bf817da-6efd-433e-81f6-e6532ffda13e req-8ccf298d-7fde-45cb-970d-6d6d32bcd56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-unplugged", "status": "completed", "tag": "6d195a6f-05bb-41b8-9a6a-e8ec5eb28188"}, {"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-unplugged", "status": "completed", "tag": "15d6381f-175a-4753-8720-a7363204b9d6"}, {"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-unplugged", "status": "completed", "tag": "939b9377-081a-4450-baf8-394f3055e596"}, {"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-unplugged", "status": "completed", "tag": "82b2b4fa-2b93-4223-9b70-a4bef4b4a357"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:52.233826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5bf817da-6efd-433e-81f6-e6532ffda13e req-8ccf298d-7fde-45cb-970d-6d6d32bcd56b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:52.234700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5bf817da-6efd-433e-81f6-e6532ffda13e req-8ccf298d-7fde-45cb-970d-6d6d32bcd56b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:52.236411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5bf817da-6efd-433e-81f6-e6532ffda13e req-8ccf298d-7fde-45cb-970d-6d6d32bcd56b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:52.279276 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5bf817da-6efd-433e-81f6-e6532ffda13e req-8ccf298d-7fde-45cb-970d-6d6d32bcd56b service nova] Creating event network-vif-unplugged:6d195a6f-05bb-41b8-9a6a-e8ec5eb28188 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:35:52.291933 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5bf817da-6efd-433e-81f6-e6532ffda13e req-8ccf298d-7fde-45cb-970d-6d6d32bcd56b service nova] Creating event network-vif-unplugged:15d6381f-175a-4753-8720-a7363204b9d6 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:35:52.293353 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5bf817da-6efd-433e-81f6-e6532ffda13e req-8ccf298d-7fde-45cb-970d-6d6d32bcd56b service nova] Creating event network-vif-unplugged:939b9377-081a-4450-baf8-394f3055e596 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:35:52.294564 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5bf817da-6efd-433e-81f6-e6532ffda13e req-8ccf298d-7fde-45cb-970d-6d6d32bcd56b service nova] Creating event network-vif-unplugged:82b2b4fa-2b93-4223-9b70-a4bef4b4a357 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:35:52.313793 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5bf817da-6efd-433e-81f6-e6532ffda13e req-8ccf298d-7fde-45cb-970d-6d6d32bcd56b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.178541 Oct 17 15:35:52.315391 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1724/3211] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:52.331217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:52.345084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:52.384457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:52.385349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:52.386133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:52.387436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:52.388276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:52.389060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:52.437983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:52.455306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:52.463942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:52.465320 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-275de8db-70c6-419a-8c48-a2965d75ae40 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2916 microversion: 2.32 time: 1.613961 Oct 17 15:35:52.479677 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1488/3212] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:50 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2916 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:52.503888 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 HTTP/1.1 Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32'} Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:52.505661 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c69493b-8056-4938-86df-38728f216f28 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32" status: 404 len: 111 microversion: 2.1 time: 0.187457 Oct 17 15:35:52.511357 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1725/3213] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:52 2022] GET /compute/v2.1/servers/9dfd7495-9ccd-4f6c-a52b-3efe47ce5e32 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:52.522036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:52.523367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:52.535559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:52.536072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:52.536566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:52.537310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:52.537782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:52.538221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:52.581929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 HTTP/1.1 Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '66796bdf-a914-42c2-b4cb-576f956f5bd7'} Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:52.585745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.595800 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.600439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:52.602390 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5f89d73a-c413-4b97-b9f9-5313de02fe80 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 404 len: 111 microversion: 2.1 time: 0.087448 Oct 17 15:35:52.609742 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1489/3214] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:52 2022] DELETE /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:52.626240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:52.631845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 66796bdf-a914-42c2-b4cb-576f956f5bd7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:52.663960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:52.665063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:52.667035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:52.670891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:52.671947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:52.675201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:52.743571 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 HTTP/1.1 Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '66796bdf-a914-42c2-b4cb-576f956f5bd7'} Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:52.749236 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.762535 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.762535 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:52.762535 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:52.762535 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:52.762535 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:52.762535 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. Oct 17 15:35:52.762535 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.763873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 66796bdf-a914-42c2-b4cb-576f956f5bd7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:52.766059 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9dac42e-1063-4e47-af24-8c2aad14388b tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7" status: 404 len: 111 microversion: 2.1 time: 0.147868 Oct 17 15:35:52.774518 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1726/3215] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:52 2022] GET /compute/v2.1/servers/66796bdf-a914-42c2-b4cb-576f956f5bd7 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:52.782859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:52.785632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:52.825187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:52.840343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:52.842679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:52.844340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:52.850842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:52.860831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:52.942356 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 HTTP/1.1 Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'cf163cb1-81b4-4969-a6d2-5caa98ae4525'} Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:52.964269 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:52.972181 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:52.979233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:52.980493 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2789fae-78de-4b3b-a989-9d2e03935a41 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 404 len: 111 microversion: 2.1 time: 0.206239 Oct 17 15:35:52.989691 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1490/3216] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:52 2022] DELETE /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:35:53.001227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:53.002352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: cf163cb1-81b4-4969-a6d2-5caa98ae4525] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:53.021940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.023312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.024557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.038115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.039366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.040440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.117880 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 HTTP/1.1 Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'cf163cb1-81b4-4969-a6d2-5caa98ae4525'} Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.125696 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance cf163cb1-81b4-4969-a6d2-5caa98ae4525 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0168cc17-fbef-4f20-82ab-164bb3a61ef9 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525" status: 404 len: 111 microversion: 2.1 time: 0.135282 Oct 17 15:35:53.139116 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1727/3217] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:52 2022] GET /compute/v2.1/servers/cf163cb1-81b4-4969-a6d2-5caa98ae4525 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:53.149819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:53.151117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:53.159356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-65651587-c3f6-46fe-99b3-4a8f5378bd4e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be360a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:53.183762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.184941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.185907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.187479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.188519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.189520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.244121 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 HTTP/1.1 Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '10e9df62-80cd-443d-b507-9f6177caec29'} Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:53.247303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.252958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.261235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:53.263054 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f7cf12d3-1eba-4f48-816c-9fc8b48d94c3 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 404 len: 111 microversion: 2.1 time: 0.120388 Oct 17 15:35:53.268980 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1491/3218] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:53 2022] DELETE /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:53.274799 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-65651587-c3f6-46fe-99b3-4a8f5378bd4e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.121071 Oct 17 15:35:53.278000 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1728/3219] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:53 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:53.285374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:53.286553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 10e9df62-80cd-443d-b507-9f6177caec29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:53.321811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.323072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.324091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.325718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.326837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.327870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.381333 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 HTTP/1.1 Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '10e9df62-80cd-443d-b507-9f6177caec29'} Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.384626 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.392876 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.392876 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.392876 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.392876 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:53.392876 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:53.392876 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. Oct 17 15:35:53.392876 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.392876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 10e9df62-80cd-443d-b507-9f6177caec29 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:53.399751 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e2fa4acd-ab88-46fb-9333-5d1f4793610c tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29" status: 404 len: 111 microversion: 2.1 time: 0.125659 Oct 17 15:35:53.400834 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1492/3220] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:53 2022] GET /compute/v2.1/servers/10e9df62-80cd-443d-b507-9f6177caec29 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:53.413869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:53.414600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 6cdaacde-1d92-4613-9434-fc02bb1a88ee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:53.438248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.439633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.440564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.441723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.442333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.443240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.523438 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.527514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:53.534271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee HTTP/1.1 Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6cdaacde-1d92-4613-9434-fc02bb1a88ee'} Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:53.551431 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e639519-4871-40f0-af91-3162ea57d523 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee" status: 404 len: 111 microversion: 2.1 time: 0.146319 Oct 17 15:35:53.565336 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1729/3221] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:35:53 2022] DELETE /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:53.576480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:53.578004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 6cdaacde-1d92-4613-9434-fc02bb1a88ee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:53.587669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.588203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.588666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.589437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.589904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.590338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.606220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.606937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.608280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.609873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.610479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.611222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.652407 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee HTTP/1.1 Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6cdaacde-1d92-4613-9434-fc02bb1a88ee'} Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:35:53.662685 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.671440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:35:53.671440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:35:53.671440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:35:53.671440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:35:53.671440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:35:53.671440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. Oct 17 15:35:53.671440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:35:53.671440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 6cdaacde-1d92-4613-9434-fc02bb1a88ee could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:35:53.671440 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-247a1187-dc31-4832-bb3d-c78701a517af tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee" status: 404 len: 111 microversion: 2.1 time: 0.097428 Oct 17 15:35:53.678777 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1730/3222] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:35:53 2022] GET /compute/v2.1/servers/6cdaacde-1d92-4613-9434-fc02bb1a88ee => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:35:53.805543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-99d2d9ef-2225-417b-83b1-5b281331ad32 req-b32f431b-7231-4bb6-83fe-a8786ff93e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:53.826542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-99d2d9ef-2225-417b-83b1-5b281331ad32 req-b32f431b-7231-4bb6-83fe-a8786ff93e54 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:53.829825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-99d2d9ef-2225-417b-83b1-5b281331ad32 req-b32f431b-7231-4bb6-83fe-a8786ff93e54 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:53.830713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-99d2d9ef-2225-417b-83b1-5b281331ad32 req-b32f431b-7231-4bb6-83fe-a8786ff93e54 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:53.869466 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-99d2d9ef-2225-417b-83b1-5b281331ad32 req-b32f431b-7231-4bb6-83fe-a8786ff93e54 service nova] Creating event network-changed:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:35:53.883750 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-99d2d9ef-2225-417b-83b1-5b281331ad32 req-b32f431b-7231-4bb6-83fe-a8786ff93e54 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094204 Oct 17 15:35:53.902174 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1731/3223] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:35:54.330857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5274ee1b-bd66-44f5-8fef-d8db5ce8a09b tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bea1bb80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:54.517536 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5274ee1b-bd66-44f5-8fef-d8db5ce8a09b tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.210265 Oct 17 15:35:54.526454 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1732/3224] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:54 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:35:55.551335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9bf46025-0927-48c3-aca0-620a9143cdac tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be354ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:55.677793 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9bf46025-0927-48c3-aca0-620a9143cdac tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.132693 Oct 17 15:35:55.680829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1733/3225] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:55 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:35:56.572221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:56.592163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:56.597989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:56.604782 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c246a5c-ad9d-46f8-9a1f-540359a41496 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2916 microversion: 2.32 time: 3.085983 Oct 17 15:35:56.609559 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1493/3226] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:53 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2916 bytes in 3092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:56.698452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-931ccccc-3285-40e8-b436-7b983690c64f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be993820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:56.732053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b146bc60-7122-4d30-a2a6-095b1ea9b967 req-f9d02342-1212-4818-a693-3fd35052be9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-deleted", "tag": "939b9377-081a-4450-baf8-394f3055e596"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:56.773172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b146bc60-7122-4d30-a2a6-095b1ea9b967 req-f9d02342-1212-4818-a693-3fd35052be9d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:56.778471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b146bc60-7122-4d30-a2a6-095b1ea9b967 req-f9d02342-1212-4818-a693-3fd35052be9d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:56.779949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b146bc60-7122-4d30-a2a6-095b1ea9b967 req-f9d02342-1212-4818-a693-3fd35052be9d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:56.817382 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b146bc60-7122-4d30-a2a6-095b1ea9b967 req-f9d02342-1212-4818-a693-3fd35052be9d service nova] Creating event network-vif-deleted:939b9377-081a-4450-baf8-394f3055e596 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:35:56.836384 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b146bc60-7122-4d30-a2a6-095b1ea9b967 req-f9d02342-1212-4818-a693-3fd35052be9d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109319 Oct 17 15:35:56.840399 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1494/3227] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:56.855056 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-931ccccc-3285-40e8-b436-7b983690c64f tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.161233 Oct 17 15:35:56.857258 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1734/3228] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:56 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:57.667174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:57.668512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:57.722912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:57.724054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:57.762010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:57.773186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:57.775627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:57.778145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:57.788640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:57.793856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:57.798440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:57.799269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:57.821216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:57.826855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:57.831222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:57.833913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:58.004467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:35:58.322731 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4bb5145-0c61-40f9-ad37-1bdfc8643305 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 204 len: 0 microversion: 2.25 time: 0.607619 Oct 17 15:35:58.325961 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1735/3229] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:35:57 2022] DELETE /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:35:58.339757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd7f496e-64ee-475a-82b3-b32720679dcf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be993310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:58.543422 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd7f496e-64ee-475a-82b3-b32720679dcf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.215269 Oct 17 15:35:58.544103 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1736/3230] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:58 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:35:58.560612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:58.575664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:58.608593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:58.611656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:58.612374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:58.613500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:58.615855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:58.616589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:58.630573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:58.643195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:58.652084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:35:58.656224 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4e35aa2f-d9ea-4c4d-8278-b1c072f3f632 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2755 microversion: 2.32 time: 0.998006 Oct 17 15:35:58.675246 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1495/3231] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:57 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2755 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:35:58.921824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2c0194e4-e757-4909-a0b7-a5189eacc474 req-877d7afb-0e4e-48cf-b809-2b6f287d1874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40d53c0-6353-460c-ade7-186346f19950", "tag": "0c2e3201-6294-48eb-a5cf-b63c7654f569"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:35:58.976778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2c0194e4-e757-4909-a0b7-a5189eacc474 req-877d7afb-0e4e-48cf-b809-2b6f287d1874 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:58.981190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2c0194e4-e757-4909-a0b7-a5189eacc474 req-877d7afb-0e4e-48cf-b809-2b6f287d1874 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:58.984718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2c0194e4-e757-4909-a0b7-a5189eacc474 req-877d7afb-0e4e-48cf-b809-2b6f287d1874 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:59.039564 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2c0194e4-e757-4909-a0b7-a5189eacc474 req-877d7afb-0e4e-48cf-b809-2b6f287d1874 service nova] Creating event network-changed:0c2e3201-6294-48eb-a5cf-b63c7654f569 for instance c40d53c0-6353-460c-ade7-186346f19950 on n-h1-854441-12 Oct 17 15:35:59.083055 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2c0194e4-e757-4909-a0b7-a5189eacc474 req-877d7afb-0e4e-48cf-b809-2b6f287d1874 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165580 Oct 17 15:35:59.089744 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1496/3232] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:35:59.561012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c66f5e81-23f8-4460-a9d8-abd759f44d95 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3979d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:59.814543 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c66f5e81-23f8-4460-a9d8-abd759f44d95 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.258514 Oct 17 15:35:59.816682 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1497/3233] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:35:59 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:35:59.830544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:35:59.842537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:35:59.870744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:59.873050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:59.873717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:35:59.877730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:35:59.878479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:35:59.883302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:00.111025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:00.128270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:00.129847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:00.131202 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b219b83-1483-44a2-8201-1e402deb29bc tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1730 microversion: 2.25 time: 1.585167 Oct 17 15:36:00.132106 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1737/3234] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:58 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1730 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:00.833976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bc0c837-d7c9-41a9-a533-e445073f1971 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be99c820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:01.045386 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bc0c837-d7c9-41a9-a533-e445073f1971 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.215473 Oct 17 15:36:01.051753 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1738/3235] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:00 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:01.177009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:01.178967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:01.197771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:01.204217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:01.204881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:01.206373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:01.207096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:01.210549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:02.313990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:02.344906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:02.359411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:02.365509 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a0cbe69e-6240-425b-b747-cb4173dc5569 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2708 microversion: 2.32 time: 2.545439 Oct 17 15:36:02.376440 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1498/3236] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:35:59 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2708 bytes in 2559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:02.392371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-80bff64b-6afa-40ae-babc-8cf061d32826 req-1fb92e1c-ef56-4ca8-adf7-a6cba0b23ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-deleted", "tag": "82b2b4fa-2b93-4223-9b70-a4bef4b4a357"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:02.455210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=90 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:02.459816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-80bff64b-6afa-40ae-babc-8cf061d32826 req-1fb92e1c-ef56-4ca8-adf7-a6cba0b23ad1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:02.461074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-80bff64b-6afa-40ae-babc-8cf061d32826 req-1fb92e1c-ef56-4ca8-adf7-a6cba0b23ad1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:02.488369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-80bff64b-6afa-40ae-babc-8cf061d32826 req-1fb92e1c-ef56-4ca8-adf7-a6cba0b23ad1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:02.561997 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-80bff64b-6afa-40ae-babc-8cf061d32826 req-1fb92e1c-ef56-4ca8-adf7-a6cba0b23ad1 service nova] Creating event network-vif-deleted:82b2b4fa-2b93-4223-9b70-a4bef4b4a357 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:36:02.587767 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-80bff64b-6afa-40ae-babc-8cf061d32826 req-1fb92e1c-ef56-4ca8-adf7-a6cba0b23ad1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201971 Oct 17 15:36:02.589416 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1499/3237] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:02.648794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fef06ad0-590e-4de1-8383-21c6a101401c tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2e06430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:02.849906 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fef06ad0-590e-4de1-8383-21c6a101401c tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.254601 Oct 17 15:36:02.869005 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1500/3238] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:02 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:02.980462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:03.012283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:03.014851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:03.016717 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb554f56-2191-4d05-9ad9-58b7131fc7e6 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1730 microversion: 2.25 time: 1.844892 Oct 17 15:36:03.018158 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1739/3239] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:01 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1730 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:36:03.440145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:03.443709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:03.466374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:03.467231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:03.468999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:03.471183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:03.473343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:03.474325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:03.877409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-432edf9c-8c8e-4cfd-9596-5a9f5705a828 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bea99280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:04.018187 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-432edf9c-8c8e-4cfd-9596-5a9f5705a828 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.147427 Oct 17 15:36:04.021798 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1740/3240] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:03 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:36:04.042573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:04.048373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:04.092749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:04.099559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:04.103548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:04.105027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:04.106086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:04.109175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:04.148440 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba HTTP/1.1 Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '0f40ea7d-a231-4b2e-a119-3213a97b26ba'} Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:36:04.155879 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:04.161734 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:04.166036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:36:04.168439 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb65794f-d4c7-4028-85c4-caed48832cc4 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 404 len: 111 microversion: 2.1 time: 0.142150 Oct 17 15:36:04.169686 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1741/3241] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:36:04 2022] DELETE /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:36:04.185505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:04.189952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:04.208929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:04.209753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:04.210445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:04.212157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:04.215632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:04.219063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:04.919969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:04.931069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:04.933051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:04.934658 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8058e331-94af-488c-ade3-0805da2ff81d tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1730 microversion: 2.25 time: 0.761148 Oct 17 15:36:04.935267 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1742/3242] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:04 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1730 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:04.950746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:04.952554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: 0f40ea7d-a231-4b2e-a119-3213a97b26ba] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:04.974982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:04.975846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:04.979341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:04.981934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:04.983666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:04.993875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:05.032837 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba HTTP/1.1 Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '0f40ea7d-a231-4b2e-a119-3213a97b26ba'} Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:05.035744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.040317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:05.040317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:05.040317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:05.040317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:36:05.040317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:36:05.040317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. Oct 17 15:36:05.040317 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.043291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance 0f40ea7d-a231-4b2e-a119-3213a97b26ba could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:36:05.044723 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5260d897-d0b9-454c-bb8c-132a5cf41998 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba" status: 404 len: 111 microversion: 2.1 time: 0.108083 Oct 17 15:36:05.045869 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1743/3243] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:04 2022] GET /compute/v2.1/servers/0f40ea7d-a231-4b2e-a119-3213a97b26ba => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:36:05.051158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a52768e0-b4b7-4369-88b4-5d9c7725408a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2bb670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:05.132115 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a52768e0-b4b7-4369-88b4-5d9c7725408a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.084399 Oct 17 15:36:05.133143 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1744/3244] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:05 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:05.154487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:05.156606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:05.165076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:05.166875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:05.167675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:05.168678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:05.169407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:05.170077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:05.172973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:05.184931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:05.186469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:05.194075 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec HTTP/1.1 Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'd66521d3-f3e0-4388-b5ae-f39088b065ec'} Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:36:05.197343 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.201166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.201826 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1d235db1-1e57-4cb4-8bab-c3678bba14cc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2594 microversion: 2.32 time: 1.759478 Oct 17 15:36:05.201826 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1501/3245] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:03 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2594 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:36:05.206922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:36:05.208517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d7e6ba4-14b1-4ddc-8b40-eb5210ced81f tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 404 len: 111 microversion: 2.1 time: 0.074082 Oct 17 15:36:05.209674 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1745/3246] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:36:05 2022] DELETE /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:36:05.237844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:05.239147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] [instance: d66521d3-f3e0-4388-b5ae-f39088b065ec] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:05.246306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:05.247152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:05.247793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:05.248755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:05.249397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:05.249988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:05.268369 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] HTTP exception thrown: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Request method failure captured: Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec HTTP/1.1 Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXS-JoSxI15dGkA3U7kl345yrhMKy0u1EyuSvZ5JlZotAlFiPA8mlRo6_wAm1P3e_wWQEPB0vElKegfNJX9xG9vRmB_MKn9V-q90ippVGN8bCP2hlnVeMhKmjwNzQvUsxn8ZTmWmv_UgKKZEkzNfH577OkX1XYrDjLsEVErY1jb9K3o Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e0ace059be046f4bf77aa4419fec590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e0ace059be046f4bf77aa4419fec590 Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676840344 Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 745a483a369e4e83849cee037f5b67ab Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersTestJSON-1676840344-project Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd66521d3-f3e0-4388-b5ae-f39088b065ec'} Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:05.271053 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.276592 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:05.276592 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:05.276592 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:05.276592 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:36:05.276592 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:36:05.276592 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. Oct 17 15:36:05.276592 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:05.280048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] Returning 404 to user: Instance d66521d3-f3e0-4388-b5ae-f39088b065ec could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:36:05.281103 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-49f5d4d8-6da7-45ce-820e-04b13ca86042 tempest-DeleteServersTestJSON-1676840344 tempest-DeleteServersTestJSON-1676840344-project] 10.222.0.87 "GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec" status: 404 len: 111 microversion: 2.1 time: 0.065525 Oct 17 15:36:05.282151 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1502/3247] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:05 2022] GET /compute/v2.1/servers/d66521d3-f3e0-4388-b5ae-f39088b065ec => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:36:05.969819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:05.970489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:05.990138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:05.996873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:05.997656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:05.998673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:06.001234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:06.002221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:06.149717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f9a1897e-daa9-43b6-af80-a893b14dc223 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be373550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:06.242349 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f9a1897e-daa9-43b6-af80-a893b14dc223 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.097188 Oct 17 15:36:06.248797 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1503/3248] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:06 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:36:06.284573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:06.285848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:06.314017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:06.319670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:06.321555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:06.323784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:06.335810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:06.336807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:06.416283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:06.438374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:06.441160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:06.443076 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d23a1fc-586e-4c2a-b7c8-1322a39b0117 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1662 microversion: 2.25 time: 0.479871 Oct 17 15:36:06.456409 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1746/3249] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:05 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1662 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:07.264971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a300ee01-25d8-4e02-aeac-2293e25ed9a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bea1b3a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:07.401774 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a300ee01-25d8-4e02-aeac-2293e25ed9a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.137413 Oct 17 15:36:07.405769 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1747/3250] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:07 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:07.427737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b9490761-25b5-4cef-903b-5fe8d5b5c18f req-0bf7b503-dac7-4b04-a510-5e9c78c72ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-deleted", "tag": "15d6381f-175a-4753-8720-a7363204b9d6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:07.514126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b9490761-25b5-4cef-903b-5fe8d5b5c18f req-0bf7b503-dac7-4b04-a510-5e9c78c72ecd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:07.515052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b9490761-25b5-4cef-903b-5fe8d5b5c18f req-0bf7b503-dac7-4b04-a510-5e9c78c72ecd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:07.525094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b9490761-25b5-4cef-903b-5fe8d5b5c18f req-0bf7b503-dac7-4b04-a510-5e9c78c72ecd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:07.623386 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b9490761-25b5-4cef-903b-5fe8d5b5c18f req-0bf7b503-dac7-4b04-a510-5e9c78c72ecd service nova] Creating event network-vif-deleted:15d6381f-175a-4753-8720-a7363204b9d6 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:36:07.643988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b9490761-25b5-4cef-903b-5fe8d5b5c18f req-0bf7b503-dac7-4b04-a510-5e9c78c72ecd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236419 Oct 17 15:36:07.662242 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1748/3251] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:07.697386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:07.699110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:07.734421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:07.738364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:07.739621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:07.743297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:07.750069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:07.754634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:07.894363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:07.902138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:07.904778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:07.905443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:07.906252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lazy-loading 'fault' on Instance uuid 8b7223bf-635f-444f-98a9-f4764b4cd42c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:36:08.055977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:08.089084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:08.092409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:08.097459 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c59b6ed7-3b83-4da7-9460-4c10468c95c2 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 200 len: 1374 microversion: 2.25 time: 0.432452 Oct 17 15:36:08.103439 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1749/3252] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:07 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 1374 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:08.423298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c6ca6ca-6576-4781-a099-ad9b94974d90 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2e0f8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:08.663317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:08.686048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:08.691424 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c6ca6ca-6576-4781-a099-ad9b94974d90 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.274761 Oct 17 15:36:08.698890 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1750/3253] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:08 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:36:08.716703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:08.724807 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f469a970-f5f0-4ea2-979d-57e39785e153 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2547 microversion: 2.32 time: 2.468223 Oct 17 15:36:08.732598 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1504/3254] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:06 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2547 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:09.146194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:09.147931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 8b7223bf-635f-444f-98a9-f4764b4cd42c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:09.194765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:09.196194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:09.197348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:09.203101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:09.204723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:09.205896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:09.284328 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] HTTP exception thrown: Instance 8b7223bf-635f-444f-98a9-f4764b4cd42c could not be found. Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Request method failure captured: Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c HTTP/1.1 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXRk3lxhSzaIedWLrfscY-HNfx03spIsrZD38End5rw-61WfZFCkknyT-_71OiL6lrqXSUFqYiaIi4BqWQJHzmJHbabpl77EA7S3eCkOtsUQ8zOwoiVYZGUGUWUq0rMXVyJvcqdb_nnzXPJ27iZHKtnJjT97MQZCHOP865Z7-cRluL8 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 02edcfcf47504f30a7d6770b945a1cf7 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 02edcfcf47504f30a7d6770b945a1cf7 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-LiveAutoBlockMigrationV225Test-734225104-project Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 54134ad155cf45d19f6a551710c84a9e Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-734225104-project Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 8b7223bf-635f-444f-98a9-f4764b4cd42c could not be found. Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8b7223bf-635f-444f-98a9-f4764b4cd42c'} Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7223bf-635f-444f-98a9-f4764b4cd42c could not be found. Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7223bf-635f-444f-98a9-f4764b4cd42c could not be found. Oct 17 15:36:09.288643 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:09.297605 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:09.297605 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:09.297605 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:09.297605 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:09.297605 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:09.297605 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:36:09.297605 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:36:09.297605 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7223bf-635f-444f-98a9-f4764b4cd42c could not be found. Oct 17 15:36:09.297605 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:09.303158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Returning 404 to user: Instance 8b7223bf-635f-444f-98a9-f4764b4cd42c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:36:09.305718 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ccb1d94-2547-44b2-aacb-186fba598761 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c" status: 404 len: 111 microversion: 2.25 time: 0.167879 Oct 17 15:36:09.308710 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1751/3255] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:09 2022] GET /compute/v2.1/servers/8b7223bf-635f-444f-98a9-f4764b4cd42c => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:36:09.379868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f9b838ee-d3a6-49a1-bdae-a7e713d616f7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '.version_select at 0x7f28c2e06700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:09.438712 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f9b838ee-d3a6-49a1-bdae-a7e713d616f7 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-708831637" status: 204 len: 0 microversion: 2.25 time: 0.119426 Oct 17 15:36:09.439621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1505/3256] 10.222.0.87 () {60 vars in 1259 bytes} [Mon Oct 17 15:36:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-708831637 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:36:09.714617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01c43af4-35d9-4f43-b8e4-dcf7a428c720 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be4144c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:09.784897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:09.786230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:09.790042 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01c43af4-35d9-4f43-b8e4-dcf7a428c720 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.079911 Oct 17 15:36:09.790689 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1752/3257] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:09 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:09.796411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:09.812914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:09.813695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:09.815917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:09.820272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:09.820955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:09.934650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-563081dc-b5a5-4a81-9753-282be7ff7d09 req-15402fcc-552d-4151-bf1c-0e4e498cb5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7223bf-635f-444f-98a9-f4764b4cd42c", "name": "network-vif-deleted", "tag": "b7b29889-5c2f-436a-b1af-d8cf33437c18"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:09.958117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-563081dc-b5a5-4a81-9753-282be7ff7d09 req-15402fcc-552d-4151-bf1c-0e4e498cb5c0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:09.958722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-563081dc-b5a5-4a81-9753-282be7ff7d09 req-15402fcc-552d-4151-bf1c-0e4e498cb5c0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:09.962413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-563081dc-b5a5-4a81-9753-282be7ff7d09 req-15402fcc-552d-4151-bf1c-0e4e498cb5c0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:09.987373 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-563081dc-b5a5-4a81-9753-282be7ff7d09 req-15402fcc-552d-4151-bf1c-0e4e498cb5c0 service nova] Creating event network-vif-deleted:b7b29889-5c2f-436a-b1af-d8cf33437c18 for instance 8b7223bf-635f-444f-98a9-f4764b4cd42c on n-h2-854441-12 Oct 17 15:36:10.003942 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-563081dc-b5a5-4a81-9753-282be7ff7d09 req-15402fcc-552d-4151-bf1c-0e4e498cb5c0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083823 Oct 17 15:36:10.005474 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1753/3258] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:36:10.632086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:10.664161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:10.683789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:10.696387 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a7537855-1f89-4668-9dcc-952a6de420ba tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2261 microversion: 2.32 time: 0.915326 Oct 17 15:36:10.708269 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1506/3259] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:09 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2261 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:10.807769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29c1fec8-6f1a-422d-b41e-a33201370f14 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2bb790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:10.964752 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29c1fec8-6f1a-422d-b41e-a33201370f14 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.161490 Oct 17 15:36:10.969527 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1754/3260] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:10 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:11.374720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:11.376418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:11.383820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:11.384597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:11.385330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:11.386284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:11.386927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:11.387517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:11.448639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:36:11.495988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:11.692405 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7db4b86a-8cfc-4ead-9f80-ecf8a00f2070 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "DELETE /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 204 len: 0 microversion: 2.25 time: 0.321120 Oct 17 15:36:11.693843 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1507/3261] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:36:11 2022] DELETE /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 15:36:11.727225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:11.728756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:11.729749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:11.732751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:11.747730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:11.748732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:11.749428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:11.750769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:11.754901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:11.755872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:11.764205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:11.771741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:11.776569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:11.778227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:11.781535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:11.784455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:12.266442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:12.286604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:12.290436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:12.293881 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c6d62b8-fc03-4284-a8e4-539ebcbfd93f tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1547 microversion: 2.25 time: 0.592936 Oct 17 15:36:12.297630 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1755/3262] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:11 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1547 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:12.308861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42529482-0cbd-499f-8f75-c638d4111f91 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bea1bb80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:12.464989 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42529482-0cbd-499f-8f75-c638d4111f91 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.164728 Oct 17 15:36:12.475525 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1756/3263] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:12 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:12.483122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1cbb2628-9b44-4ce5-9b08-de42adb60596 req-fe3008e6-1349-4027-b7ba-05a845a7bfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-deleted", "tag": "28f4ade6-9249-408e-bddf-227f23b2d6f1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:12.497775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1cbb2628-9b44-4ce5-9b08-de42adb60596 req-fe3008e6-1349-4027-b7ba-05a845a7bfa0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:12.498700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1cbb2628-9b44-4ce5-9b08-de42adb60596 req-fe3008e6-1349-4027-b7ba-05a845a7bfa0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:12.499542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1cbb2628-9b44-4ce5-9b08-de42adb60596 req-fe3008e6-1349-4027-b7ba-05a845a7bfa0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:12.517463 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1cbb2628-9b44-4ce5-9b08-de42adb60596 req-fe3008e6-1349-4027-b7ba-05a845a7bfa0 service nova] Creating event network-vif-deleted:28f4ade6-9249-408e-bddf-227f23b2d6f1 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:36:12.524547 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1cbb2628-9b44-4ce5-9b08-de42adb60596 req-fe3008e6-1349-4027-b7ba-05a845a7bfa0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046625 Oct 17 15:36:12.526357 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1757/3264] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:13.216646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:13.250163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:13.253412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:13.266228 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-84f4989d-6deb-4c69-a331-a1be1a7ac91d tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2214 microversion: 2.32 time: 1.543362 Oct 17 15:36:13.283954 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1508/3265] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:11 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2214 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:13.345038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:13.345952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:13.375932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:13.377271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:13.380136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:13.382067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:13.391710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:13.392444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:13.482520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38f4f8e3-719a-48c6-8242-f3b24e3697c2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3c98b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:13.615661 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-38f4f8e3-719a-48c6-8242-f3b24e3697c2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.133083 Oct 17 15:36:13.616202 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1509/3266] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:13 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:36:14.111046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:14.115551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:14.137083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:14.142095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:14.146019 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-157247e9-f8f3-456c-8249-99d369fdb7ae tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1547 microversion: 2.25 time: 0.805497 Oct 17 15:36:14.153299 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1758/3267] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:13 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1547 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:14.316009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:14.321417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:14.336595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:14.337863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:14.339049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:14.351370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:14.352393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:14.353241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:14.645952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a61de22-5b70-4097-a71f-ec9d14de5c72 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2e82820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:14.752201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:14.781343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:14.783573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:14.806612 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-94971c83-ee8d-424c-b502-64525b38f14e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 2032 microversion: 2.32 time: 0.475846 Oct 17 15:36:14.809141 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1510/3268] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:14 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 2032 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:36:14.819247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-412135ff-ad04-4201-95ee-309e36d0da14 req-4e344055-4c3f-44de-8041-0902222e13c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e14b99d-f8bb-4388-aa94-ecbbbf047f68", "name": "network-vif-deleted", "tag": "6d195a6f-05bb-41b8-9a6a-e8ec5eb28188"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:14.848582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-412135ff-ad04-4201-95ee-309e36d0da14 req-4e344055-4c3f-44de-8041-0902222e13c4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:14.849085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-412135ff-ad04-4201-95ee-309e36d0da14 req-4e344055-4c3f-44de-8041-0902222e13c4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:14.849722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-412135ff-ad04-4201-95ee-309e36d0da14 req-4e344055-4c3f-44de-8041-0902222e13c4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:14.859079 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a61de22-5b70-4097-a71f-ec9d14de5c72 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.218123 Oct 17 15:36:14.860065 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1759/3269] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:14 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:14.905708 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-412135ff-ad04-4201-95ee-309e36d0da14 req-4e344055-4c3f-44de-8041-0902222e13c4 service nova] Creating event network-vif-deleted:6d195a6f-05bb-41b8-9a6a-e8ec5eb28188 for instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 on n-h1-854441-12 Oct 17 15:36:14.928253 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-412135ff-ad04-4201-95ee-309e36d0da14 req-4e344055-4c3f-44de-8041-0902222e13c4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117298 Oct 17 15:36:14.932876 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1511/3270] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:15.186702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:15.187654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:15.211324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:15.212888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:15.214432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:15.217509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:15.223224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:15.226384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:15.620758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:15.639884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:15.647824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:15.657369 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2c203f2-4bdd-4ce3-9166-d7d6c35ca2a8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1505 microversion: 2.25 time: 0.471878 Oct 17 15:36:15.657369 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1760/3271] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:15 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:15.867838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:15.891620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:15.924311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:15.927794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:15.933980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:15.936041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:15.941155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:15.946664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:16.147711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2ac2fd38-c6ba-4024-bbc4-e713b45e8510 tempest-FlavorsV2NegativeTest-1703705446 tempest-FlavorsV2NegativeTest-1703705446-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:16.160204 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2ac2fd38-c6ba-4024-bbc4-e713b45e8510 tempest-FlavorsV2NegativeTest-1703705446 tempest-FlavorsV2NegativeTest-1703705446-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.499206 Oct 17 15:36:16.184059 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1512/3272] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:36:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:16.192467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eed328f7-c235-48c6-8ad3-e59e91e7982d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be38b430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:16.448430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:16.468431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:16.515165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:16.530758 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b7131de0-64cc-4460-a4bb-633ef0bc482a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.678322 Oct 17 15:36:16.536545 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1761/3273] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:15 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:36:16.732921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:16.733957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:16.761139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:16.775269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:16.777783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:16.780365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:16.780365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:16.780365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:16.965179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:16.977380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:16.978574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:16.983592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lazy-loading 'fault' on Instance uuid 2515b31b-3d10-40b2-a11a-e89640d4c8d6 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:36:17.170191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:17.223429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:17.227993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:17.240802 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-608e23e6-6ff0-4b52-9914-fb06baabd073 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 200 len: 1351 microversion: 2.25 time: 0.506176 Oct 17 15:36:17.242225 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1762/3274] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:16 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 1351 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:36:17.273917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4e81f746-7cec-4972-823b-955d47b896e7 req-4c71730b-b9a1-4f36-aa84-c9070d5325aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2515b31b-3d10-40b2-a11a-e89640d4c8d6", "name": "network-vif-deleted", "tag": "161227d2-c2ea-4581-a464-7d890b9c52af"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:17.347859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4e81f746-7cec-4972-823b-955d47b896e7 req-4c71730b-b9a1-4f36-aa84-c9070d5325aa service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:17.349434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4e81f746-7cec-4972-823b-955d47b896e7 req-4c71730b-b9a1-4f36-aa84-c9070d5325aa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:17.354175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4e81f746-7cec-4972-823b-955d47b896e7 req-4c71730b-b9a1-4f36-aa84-c9070d5325aa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:17.409968 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4e81f746-7cec-4972-823b-955d47b896e7 req-4c71730b-b9a1-4f36-aa84-c9070d5325aa service nova] Creating event network-vif-deleted:161227d2-c2ea-4581-a464-7d890b9c52af for instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 on n-h2-854441-12 Oct 17 15:36:17.446810 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4e81f746-7cec-4972-823b-955d47b896e7 req-4c71730b-b9a1-4f36-aa84-c9070d5325aa service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200569 Oct 17 15:36:17.449688 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1763/3275] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:17.596033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:17.604338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:17.644441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:17.645318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:17.646055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:17.648225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:17.649782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:17.650409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:17.886153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:17.903436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:17.905304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:17.919949 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-edc32069-cdc3-4561-86e0-121ac83f448e tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.319458 Oct 17 15:36:17.920730 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1764/3276] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:17 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:18.099380 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eed328f7-c235-48c6-8ad3-e59e91e7982d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 1.910574 Oct 17 15:36:18.102581 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1513/3277] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:16 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:18.194150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6def696e-83cf-4e73-8029-304a99ed498b tempest-FlavorsV2NegativeTest-1703705446 tempest-FlavorsV2NegativeTest-1703705446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-160955451", "imageRef": "ec4e5b5e-43cc-4b22-801c-cb2d34da908f", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:18.311785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:18.315405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 2515b31b-3d10-40b2-a11a-e89640d4c8d6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:18.346016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-6def696e-83cf-4e73-8029-304a99ed498b tempest-FlavorsV2NegativeTest-1703705446 tempest-FlavorsV2NegativeTest-1703705446-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:36:18.368970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:18.371925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:18.375278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:18.379710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:18.383190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:18.388579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:18.456171 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] HTTP exception thrown: Instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 could not be found. Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Request method failure captured: Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 HTTP/1.1 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRk3lxhSzaIedWLrfscY-HNfx03spIsrZD38End5rw-61WfZFCkknyT-_71OiL6lrqXSUFqYiaIi4BqWQJHzmJHbabpl77EA7S3eCkOtsUQ8zOwoiVYZGUGUWUq0rMXVyJvcqdb_nnzXPJ27iZHKtnJjT97MQZCHOP865Z7-cRluL8 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 02edcfcf47504f30a7d6770b945a1cf7 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 02edcfcf47504f30a7d6770b945a1cf7 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-LiveAutoBlockMigrationV225Test-734225104-project Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 54134ad155cf45d19f6a551710c84a9e Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-734225104-project Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 could not be found. Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '2515b31b-3d10-40b2-a11a-e89640d4c8d6'} Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 could not be found. Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 could not be found. Oct 17 15:36:18.467331 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 could not be found. Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:18.471702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Returning 404 to user: Instance 2515b31b-3d10-40b2-a11a-e89640d4c8d6 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:36:18.472402 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02dd180c-f1f2-4a12-8dde-d35c5bce05ee tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6" status: 404 len: 111 microversion: 2.25 time: 0.180920 Oct 17 15:36:18.477168 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1514/3278] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:18 2022] GET /compute/v2.1/servers/2515b31b-3d10-40b2-a11a-e89640d4c8d6 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 15:36:18.499983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:18.524788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:18.564623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:18.566058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:18.569634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:18.574177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:18.575785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:18.580740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:18.725912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:36:19.031978 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c64901c2-bd39-4674-97e0-eb49476fefc8 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 204 len: 0 microversion: 2.25 time: 0.547018 Oct 17 15:36:19.033004 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1515/3279] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:36:18 2022] DELETE /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:36:19.039497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:19.051268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:19.053086 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6def696e-83cf-4e73-8029-304a99ed498b tempest-FlavorsV2NegativeTest-1703705446 tempest-FlavorsV2NegativeTest-1703705446-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6def696e-83cf-4e73-8029-304a99ed498b tempest-FlavorsV2NegativeTest-1703705446 tempest-FlavorsV2NegativeTest-1703705446-project] Request method failure captured: Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 142 Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXZvtdKz1EgoEXVjbvH-otyfq7VFWnx-Ib8t_cvH-8E8bxeGhpH95d4ct_bLxdoeuExMQDPRAhOCacvn_n2UIfAS-tlrbXN3_wqApwT0ggEPxQ54gsjAn663Waa7buOe6wkIFPD7TEzYNxiSCKFotwypFog-f4TwPJu8EY0wwvCrM1A Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ff5214ba44b4d5f8d1b2b2071f3abc8 Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-FlavorsV2NegativeTest-1703705446 Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ff5214ba44b4d5f8d1b2b2071f3abc8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ff5214ba44b4d5f8d1b2b2071f3abc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ff5214ba44b4d5f8d1b2b2071f3abc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ff5214ba44b4d5f8d1b2b2071f3abc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-FlavorsV2NegativeTest-1703705446 Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ff5214ba44b4d5f8d1b2b2071f3abc8 Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1703705446 Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-FlavorsV2NegativeTest-1703705446-project Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 82e975fd6a1047cdaeb7c5e1a98b492a Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-FlavorsV2NegativeTest-1703705446-project Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-160955451", "imageRef": "ec4e5b5e-43cc-4b22-801c-cb2d34da908f", "flavorRef": "452"}} Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: exception: Flavor's memory is too small for requested image. Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-160955451', 'imageRef': 'ec4e5b5e-43cc-4b22-801c-cb2d34da908f', 'flavorRef': '452'}}} Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:36:19.055099 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6def696e-83cf-4e73-8029-304a99ed498b tempest-FlavorsV2NegativeTest-1703705446 tempest-FlavorsV2NegativeTest-1703705446-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6def696e-83cf-4e73-8029-304a99ed498b tempest-FlavorsV2NegativeTest-1703705446 tempest-FlavorsV2NegativeTest-1703705446-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.869150 Oct 17 15:36:19.059801 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1765/3280] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:36:18 2022] POST /compute/v2.1/servers => generated 93 bytes in 871 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:36:19.071645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:19.072176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:19.072815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:19.085844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:19.090198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:19.091059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:19.091617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:19.092577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:19.106896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:19.107403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:19.107855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:19.108594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:19.109064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:19.109499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:19.309050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:19.330440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:19.333971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:19.341308 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee3b27c5-823f-4bac-a190-6cca52be6701 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.306274 Oct 17 15:36:19.344077 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1516/3281] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:19 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:19.367414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ce861ea-e31f-42ed-82e5-089e6ce74bf8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2e06dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:19.865775 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1ce861ea-e31f-42ed-82e5-089e6ce74bf8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1453 microversion: 2.1 time: 0.512698 Oct 17 15:36:19.891764 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1517/3282] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:19 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1453 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:20.161873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:20.213461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:20.222491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:20.228659 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a6f7a4e-d11c-4de9-b64b-e7a7bc8e074e tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1563 microversion: 2.25 time: 1.166631 Oct 17 15:36:20.232326 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1766/3283] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:19 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1563 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:20.392569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:20.396577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:20.428885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:20.429402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:20.429850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:20.438057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:20.438876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:20.439493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:20.663400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:20.681926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:20.683467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:20.689387 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92cc74c1-ab50-4126-ba40-b568ba0ba4d0 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.317078 Oct 17 15:36:20.690705 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1518/3284] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:20 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:20.932931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c21dd37-5386-4263-8e75-44298d1e0465 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28beb53700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:21.093534 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c21dd37-5386-4263-8e75-44298d1e0465 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1462 microversion: 2.1 time: 0.181245 Oct 17 15:36:21.094966 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1767/3285] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:20 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1462 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:21.109774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2903a60-ab88-44e9-bdd4-6515d8f23b59 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c2e06dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:21.228679 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e2903a60-ab88-44e9-bdd4-6515d8f23b59 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 200 len: 1462 microversion: 2.1 time: 0.122757 Oct 17 15:36:21.239408 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1519/3286] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:21 2022] GET /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 1462 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:21.252797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:21.266634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:21.277191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:21.283182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:21.289509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:21.290181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:21.290807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:21.292299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:21.292953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:21.293485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:21.311423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:21.326193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:21.326722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:21.327522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:21.336556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:21.337030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:21.683642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:21.710955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:21.716499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54134ad155cf45d19f6a551710c84a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02edcfcf47504f30a7d6770b945a1cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:21.720796 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8189e7a-95d7-40c7-8409-147d93667178 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 200 len: 1347 microversion: 2.25 time: 0.463641 Oct 17 15:36:21.724557 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1520/3287] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:21 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 1347 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:21.741785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8ac3f697-da4a-4022-831e-554bc7698ae8 req-0ae1cbf7-ce51-45ad-8319-514c5922e76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acc0bfb-5006-48b8-a9dd-e292ff22ab29", "name": "network-vif-deleted", "tag": "ee63535c-2ff3-4d96-89e6-4bd9db2a0f65"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:21.774549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8ac3f697-da4a-4022-831e-554bc7698ae8 req-0ae1cbf7-ce51-45ad-8319-514c5922e76d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:21.775132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8ac3f697-da4a-4022-831e-554bc7698ae8 req-0ae1cbf7-ce51-45ad-8319-514c5922e76d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:21.777175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8ac3f697-da4a-4022-831e-554bc7698ae8 req-0ae1cbf7-ce51-45ad-8319-514c5922e76d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:21.849826 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8ac3f697-da4a-4022-831e-554bc7698ae8 req-0ae1cbf7-ce51-45ad-8319-514c5922e76d service nova] Creating event network-vif-deleted:ee63535c-2ff3-4d96-89e6-4bd9db2a0f65 for instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 on n-h2-854441-12 Oct 17 15:36:21.865009 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8ac3f697-da4a-4022-831e-554bc7698ae8 req-0ae1cbf7-ce51-45ad-8319-514c5922e76d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137588 Oct 17 15:36:21.867761 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1521/3288] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:21.885530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:21.886252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:21.912710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:21.913363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:21.916767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:21.917649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:21.918159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:21.918687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:22.243012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:22.290442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:22.314033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:22.316526 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80310b5b-fbcc-4d5f-9940-6ae020f153c1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.444492 Oct 17 15:36:22.317667 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1522/3289] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:21 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:22.779292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:22.784356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] [instance: 5acc0bfb-5006-48b8-a9dd-e292ff22ab29] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:22.838214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:22.847285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:22.848288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:22.849600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:22.850417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:22.851166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:22.882333 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] HTTP exception thrown: Instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 could not be found. Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Request method failure captured: Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 HTTP/1.1 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXRk3lxhSzaIedWLrfscY-HNfx03spIsrZD38End5rw-61WfZFCkknyT-_71OiL6lrqXSUFqYiaIi4BqWQJHzmJHbabpl77EA7S3eCkOtsUQ8zOwoiVYZGUGUWUq0rMXVyJvcqdb_nnzXPJ27iZHKtnJjT97MQZCHOP865Z7-cRluL8 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 02edcfcf47504f30a7d6770b945a1cf7 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/02edcfcf47504f30a7d6770b945a1cf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 02edcfcf47504f30a7d6770b945a1cf7 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-734225104 Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-LiveAutoBlockMigrationV225Test-734225104-project Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 54134ad155cf45d19f6a551710c84a9e Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-734225104-project Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 could not be found. Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '5acc0bfb-5006-48b8-a9dd-e292ff22ab29'} Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 could not be found. Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 could not be found. Oct 17 15:36:22.887993 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 could not be found. Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] Returning 404 to user: Instance 5acc0bfb-5006-48b8-a9dd-e292ff22ab29 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61e840ff-a052-4531-90fb-59c2403f1746 tempest-LiveAutoBlockMigrationV225Test-734225104 tempest-LiveAutoBlockMigrationV225Test-734225104-project] 10.222.0.87 "GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29" status: 404 len: 111 microversion: 2.25 time: 0.118891 Oct 17 15:36:22.893345 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1523/3290] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:22 2022] GET /compute/v2.1/servers/5acc0bfb-5006-48b8-a9dd-e292ff22ab29 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:36:23.089384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:23.105074 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9c1e9ca-b318-470c-8d36-98577b78393e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1467 microversion: 2.1 time: 1.863807 Oct 17 15:36:23.106282 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1768/3291] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:21 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1467 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:23.139011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3f7d8e9-f656-47d5-b2fe-3f3b08f93197 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-284062625"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:23.141993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b3f7d8e9-f656-47d5-b2fe-3f3b08f93197 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:23.155934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:23.156924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:23.168096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:23.171732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3f7d8e9-f656-47d5-b2fe-3f3b08f93197 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:23.172830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:23.173585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:23.174674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:23.175584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3f7d8e9-f656-47d5-b2fe-3f3b08f93197 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:23.176380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:23.177277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3f7d8e9-f656-47d5-b2fe-3f3b08f93197 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:23.178044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:23.179308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3f7d8e9-f656-47d5-b2fe-3f3b08f93197 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:23.184462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3f7d8e9-f656-47d5-b2fe-3f3b08f93197 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:23.185325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3f7d8e9-f656-47d5-b2fe-3f3b08f93197 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:23.873104 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3f7d8e9-f656-47d5-b2fe-3f3b08f93197 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "POST /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381/action" status: 202 len: 0 microversion: 2.1 time: 0.735495 Oct 17 15:36:23.885151 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1524/3292] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:36:23 2022] POST /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:36:23.925310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:23.929033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:23.932324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:23.946845 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87cf5e2e-7aff-4c3a-823e-66c121dbb29c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.795093 Oct 17 15:36:23.950899 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1769/3293] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:23 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:23.966815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7be50b8e-9de8-457b-ab8a-128ee5f1c573 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2bb670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:24.043258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:24.044223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:24.044965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:24.059987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:24.064110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:24.064865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:24.101308 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7be50b8e-9de8-457b-ab8a-128ee5f1c573 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f" status: 200 len: 1454 microversion: 2.1 time: 0.148526 Oct 17 15:36:24.101932 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1770/3294] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:23 2022] GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:24.123989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:24.126621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:24.149464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:24.151832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:24.153677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:24.156571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:24.157427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:24.159748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:24.593505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:24.614673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:24.622536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:24.632538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d558e77c-e2eb-47ed-a161-3e9af265dd74 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.743292 Oct 17 15:36:24.639006 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1525/3295] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:23 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:24.913144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:24.926576 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbf17d39-a211-4a3d-8f7d-abdf91c01405 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.813473 Oct 17 15:36:24.927198 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1771/3296] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:24 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:24.977297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:24.977950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:24.999295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:24.999834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:25.000293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:25.001064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:25.001536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:25.001976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:25.119710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45df3b73-72b5-47fa-8e64-85ce5bde2a71 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28beb98940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:25.195196 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45df3b73-72b5-47fa-8e64-85ce5bde2a71 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f" status: 200 len: 1454 microversion: 2.1 time: 0.081222 Oct 17 15:36:25.208187 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1772/3297] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:25 2022] GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:25.730370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:25.733077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:25.774438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:25.782281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:25.783839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:25.800211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:25.801563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:25.802834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:26.145402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:26.195057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:26.200298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:26.213663 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e45c4fa-415b-4f58-ac9d-95c6d0497130 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.508401 Oct 17 15:36:26.216692 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1773/3298] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:25 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:36:26.240021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c947db8c-cd8f-4d2d-9fe5-9b53fcf6edca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e9d4027-db63-435b-8656-3f5afbcf79a4"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:26.249159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c947db8c-cd8f-4d2d-9fe5-9b53fcf6edca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:26.287354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c947db8c-cd8f-4d2d-9fe5-9b53fcf6edca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:26.291199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c947db8c-cd8f-4d2d-9fe5-9b53fcf6edca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:26.298737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c947db8c-cd8f-4d2d-9fe5-9b53fcf6edca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:26.304971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c947db8c-cd8f-4d2d-9fe5-9b53fcf6edca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:26.305839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c947db8c-cd8f-4d2d-9fe5-9b53fcf6edca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:26.306615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c947db8c-cd8f-4d2d-9fe5-9b53fcf6edca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:26.422076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:26.453034 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b64f6f42-2c85-4b44-88b2-c2b54b588690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.483387 Oct 17 15:36:26.460933 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1526/3299] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:24 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:26.474642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c7d08347-0fb0-4460-849c-4c4bcdfeefa9 req-1dba3c89-3b17-48c8-ae38-25e7e902e6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43cdafe-be87-49e3-be6d-d64b0f3b45f4", "name": "network-vif-unplugged", "status": "completed", "tag": "2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:26.519223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c7d08347-0fb0-4460-849c-4c4bcdfeefa9 req-1dba3c89-3b17-48c8-ae38-25e7e902e6ce service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:26.524064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c7d08347-0fb0-4460-849c-4c4bcdfeefa9 req-1dba3c89-3b17-48c8-ae38-25e7e902e6ce service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:26.530943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c7d08347-0fb0-4460-849c-4c4bcdfeefa9 req-1dba3c89-3b17-48c8-ae38-25e7e902e6ce service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:26.594931 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c7d08347-0fb0-4460-849c-4c4bcdfeefa9 req-1dba3c89-3b17-48c8-ae38-25e7e902e6ce service nova] Creating event network-vif-unplugged:2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43 for instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 on n-h2-854441-12 Oct 17 15:36:26.608181 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c7d08347-0fb0-4460-849c-4c4bcdfeefa9 req-1dba3c89-3b17-48c8-ae38-25e7e902e6ce service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145455 Oct 17 15:36:26.611446 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1527/3300] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:26.620527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9405674a-3487-4b58-a420-f71cb9064f9e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be373040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:26.767637 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9405674a-3487-4b58-a420-f71cb9064f9e tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f" status: 200 len: 1454 microversion: 2.1 time: 0.154621 Oct 17 15:36:26.770858 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1528/3301] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:26 2022] GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:26.785244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4630a37-f582-4697-89de-6567332d2140 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1220226457"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:26.794493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d4630a37-f582-4697-89de-6567332d2140 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:26.815017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4630a37-f582-4697-89de-6567332d2140 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:26.816101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4630a37-f582-4697-89de-6567332d2140 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:26.817146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4630a37-f582-4697-89de-6567332d2140 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:26.819098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4630a37-f582-4697-89de-6567332d2140 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:26.820440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4630a37-f582-4697-89de-6567332d2140 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:26.820440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4630a37-f582-4697-89de-6567332d2140 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:26.864683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:27.240298 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c947db8c-cd8f-4d2d-9fe5-9b53fcf6edca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "POST /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.022101 Oct 17 15:36:27.244158 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1774/3302] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:36:26 2022] POST /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments => generated 194 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:27.592675 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d4630a37-f582-4697-89de-6567332d2140 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.819817 Oct 17 15:36:27.610715 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1529/3303] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:36:26 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 15:36:27.639922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-279019660", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": "none"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:27.641005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:27.646709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:27.665994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:27.671602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:27.676086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:27.701527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:27.702547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:27.703388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:27.835237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:36:27.835941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:36:27.836619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:36:27.837286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:36:27.837904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:36:27.883062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:27.883062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:27.883062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:27.885071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:27.885889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:27.886912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:27.923825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Getting quotas for project d0766acfeadb44b89b59328848a09c0a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:36:27.949092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Getting quotas for user 4957a1fca34a4520ab42a0dc50e43b5a and project d0766acfeadb44b89b59328848a09c0a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:36:27.988443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:36:27.996824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:36:28.148169 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-001bbbec-dd8c-4f33-885b-5f4874aa6256 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.899591 Oct 17 15:36:28.155256 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1775/3304] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:36:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:36:28.169266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62d30ee5-dc80-41b0-91ad-cd17ce8a6f47 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Calling method '.version_select at 0x7f28be99a700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:28.194721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:28.264725 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62d30ee5-dc80-41b0-91ad-cd17ce8a6f47 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98" status: 200 len: 637 microversion: 2.1 time: 0.114055 Oct 17 15:36:28.266159 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1776/3305] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:28 2022] GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98 => generated 637 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:28.276522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:28.284684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:28.285503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99651bfd-9ffd-4fe6-84b0-1df5a77bcb12 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be99a040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:28.297943 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b6d3a82-e821-43df-8395-459a4077b445 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.678331 Oct 17 15:36:28.299208 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1530/3306] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:27 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:28.319435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-da6ea9af-1d97-4ce8-a5ff-e0b3a7955bc2 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:28.321940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-da6ea9af-1d97-4ce8-a5ff-e0b3a7955bc2 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:28.392156 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99651bfd-9ffd-4fe6-84b0-1df5a77bcb12 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f" status: 200 len: 1454 microversion: 2.1 time: 0.124274 Oct 17 15:36:28.402886 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1777/3307] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:28 2022] GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:28.424947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ec77158-40bc-494b-b3df-d5ad39fe8554 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Action: 'update_all', calling method: .version_select at 0x7f28beb98dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:28.540419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5ec77158-40bc-494b-b3df-d5ad39fe8554 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:36:28.560953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5ec77158-40bc-494b-b3df-d5ad39fe8554 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for user 319d035b08764fe6b626dfc284521b15 and project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:36:28.762209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-da6ea9af-1d97-4ce8-a5ff-e0b3a7955bc2 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:28.780432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-da6ea9af-1d97-4ce8-a5ff-e0b3a7955bc2 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:28.789932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-da6ea9af-1d97-4ce8-a5ff-e0b3a7955bc2 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:28.792282 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-da6ea9af-1d97-4ce8-a5ff-e0b3a7955bc2 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359" status: 200 len: 1280 microversion: 2.47 time: 0.491662 Oct 17 15:36:28.795980 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1531/3308] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:28 2022] GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 => generated 1280 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:29.361681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1896216064", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:29.799468 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ec77158-40bc-494b-b3df-d5ad39fe8554 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 61 microversion: 2.1 time: 1.395098 Oct 17 15:36:29.800387 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1778/3309] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:36:28 2022] PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 61 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:36:29.806263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:29.811319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] validate_networks() for [('66a5d3ce-6dcc-4cfc-8194-b93cb9418a57', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:36:29.819482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:29.832714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:29.833816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:29.834449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:29.835533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:29.836265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:29.836994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:30.053862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:30.079974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:30.093056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:30.094368 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e04698cb-54e0-4042-85da-ccd2e8bafaea tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.292969 Oct 17 15:36:30.095323 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1779/3310] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:29 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:30.101375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7fa33756-ad6d-4a3a-84eb-478558c4dc2a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bf2599d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:30.215494 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7fa33756-ad6d-4a3a-84eb-478558c4dc2a tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f" status: 200 len: 1454 microversion: 2.1 time: 0.118788 Oct 17 15:36:30.216123 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1780/3311] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:30 2022] GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:30.232683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7b3383b-42e0-42c4-8599-648fc52448ac tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Calling method '.version_select at 0x7f28be99cee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:30.804645 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7b3383b-42e0-42c4-8599-648fc52448ac tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "DELETE /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.587406 Oct 17 15:36:30.806150 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1781/3312] 10.222.0.87 () {58 vars in 1296 bytes} [Mon Oct 17 15:36:30 2022] DELETE /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata/os_version => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:36:30.812219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:30.813217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:30.826249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:30.827182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:30.827855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:30.832911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:30.833687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:30.834542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:31.119219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:31.144221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:31.146605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:31.151547 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d459766e-815c-4657-9d71-29a012f88be8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359" status: 200 len: 1332 microversion: 2.47 time: 0.340839 Oct 17 15:36:31.152635 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1782/3313] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:30 2022] GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 => generated 1332 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:31.165722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6080ef9f-fb6e-4ee3-9299-4a203624b232 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Calling method '.version_select at 0x7f28becdc3a0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:31.380839 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6080ef9f-fb6e-4ee3-9299-4a203624b232 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 37 microversion: 2.1 time: 0.219412 Oct 17 15:36:31.382156 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1783/3314] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:36:31 2022] GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 37 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:36:31.406987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:31.407655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:31.443392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:31.444251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:31.445022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:31.467383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:31.468669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:31.470143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:31.628579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:36:31.629168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:36:31.629555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:36:31.629977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:36:31.630408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:36:31.650088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:31.656733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:31.665914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:31.666962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:31.667468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:31.667922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:31.709336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Getting quotas for project 2e096fd0bb744b2e90cf090b2172662e. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:36:31.722217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Getting quotas for user ea396576a90246cb8b821cb2afec9170 and project 2e096fd0bb744b2e90cf090b2172662e. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:36:31.759563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:36:31.764759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:36:31.821047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:31.853698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:31.860098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:31.869718 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe580546-2596-4531-a981-be5fa0e12f5f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.732011 Oct 17 15:36:31.871088 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1532/3315] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:36:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:36:31.884517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bfd393a9-d706-4726-9f7a-124f940959d4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3738b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:31.889956 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a90f1731-e5f6-48a5-b676-72ef083336e1 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.506446 Oct 17 15:36:31.890606 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1784/3316] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:31 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:31.915974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25a6be10-0b35-49c3-a508-10c6af79de61 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Action: 'update_all', calling method: .version_select at 0x7f28bedda9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:32.137777 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bfd393a9-d706-4726-9f7a-124f940959d4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f" status: 200 len: 1454 microversion: 2.1 time: 0.265102 Oct 17 15:36:32.141919 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1533/3317] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:31 2022] GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f => generated 1454 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:32.160060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-69bdcf75-27da-4d77-bd5e-d25eb9c8cd36 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:32.161175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-69bdcf75-27da-4d77-bd5e-d25eb9c8cd36 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:32.293825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-25a6be10-0b35-49c3-a508-10c6af79de61 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:36:32.311514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-69bdcf75-27da-4d77-bd5e-d25eb9c8cd36 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:32.323008 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-69bdcf75-27da-4d77-bd5e-d25eb9c8cd36 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1222 microversion: 2.1 time: 0.177258 Oct 17 15:36:32.324475 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1534/3318] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:32 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:32.345260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-25a6be10-0b35-49c3-a508-10c6af79de61 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for user 319d035b08764fe6b626dfc284521b15 and project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:36:32.357761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:32.358803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:32.388045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:32.388990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:32.390889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:32.401237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:32.402326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:32.403484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:32.567850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:32.593589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:32.601530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:32.603519 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e8fe5ae7-e1fc-4a6e-a394-ef8f1f45d85e tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359" status: 200 len: 1338 microversion: 2.47 time: 0.262645 Oct 17 15:36:32.633321 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1535/3319] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:32 2022] GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 => generated 1338 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:32.643154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1691272648", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:32.710188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:37.899634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:41.682111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:41.829729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:42.319888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:42.382344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:42.403268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:42.575438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:42.747052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:36:54.800011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] validate_networks() for [('66a5d3ce-6dcc-4cfc-8194-b93cb9418a57', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:36:55.085118 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25a6be10-0b35-49c3-a508-10c6af79de61 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 61 microversion: 2.1 time: 23.187103 Oct 17 15:36:55.087963 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1785/3320] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:36:31 2022] PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 61 bytes in 23189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:36:55.091544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:55.092178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:55.101047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.101621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.102010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.102789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.103262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.103693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.206825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:55.229050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:55.233462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:55.239446 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03f5b680-699b-4cf5-8a6e-e2a9cc64832a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1604 microversion: 2.32 time: 0.151549 Oct 17 15:36:55.252434 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1786/3321] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:55 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1604 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:55.287811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-431de3b6-43bc-4057-89aa-ebe3b3dd0526 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28beb53d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:55.367552 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-431de3b6-43bc-4057-89aa-ebe3b3dd0526 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f" status: 200 len: 1463 microversion: 2.1 time: 0.099943 Oct 17 15:36:55.368088 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1787/3322] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:55 2022] GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f => generated 1463 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:55.393740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:55.394377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:55.401468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.401985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.402428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.403268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.403735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.404169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.445144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:36:55.446214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:36:55.447282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:36:55.448352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:36:55.450408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:36:55.466951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.467822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.468615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.469960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.470846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.471614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.503224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Getting quotas for project 2e096fd0bb744b2e90cf090b2172662e. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:36:55.507675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:55.510443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Getting quotas for user ea396576a90246cb8b821cb2afec9170 and project 2e096fd0bb744b2e90cf090b2172662e. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:36:55.524439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:55.526185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:36:55.527710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:55.529105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:36:55.530017 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-626b94e5-b7e4-4c12-9a23-4654cc5dc36f tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359" status: 200 len: 1359 microversion: 2.47 time: 0.147736 Oct 17 15:36:55.531348 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1788/3323] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:55 2022] GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:55.541139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bdce3b0f-1451-4b42-a0a3-3236396f65e5 req-be1dec57-f3d2-4c11-86f0-6d5f6a176873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa21afee-1c0c-49b3-b91c-bf7fa5438381", "name": "network-vif-plugged", "status": "completed", "tag": "8a3944bf-786e-467e-8893-ff95b6e28ff0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:55.577429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bdce3b0f-1451-4b42-a0a3-3236396f65e5 req-be1dec57-f3d2-4c11-86f0-6d5f6a176873 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.578241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bdce3b0f-1451-4b42-a0a3-3236396f65e5 req-be1dec57-f3d2-4c11-86f0-6d5f6a176873 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.579041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bdce3b0f-1451-4b42-a0a3-3236396f65e5 req-be1dec57-f3d2-4c11-86f0-6d5f6a176873 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.587138 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-675068d8-ddc2-44c4-be23-56f80fa47cbb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 22.952196 Oct 17 15:36:55.588625 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1536/3324] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:36:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 22955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:36:55.595057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8c409452-af02-4fda-9948-f0d34f467bbd req-d7859e82-a165-4dcb-a078-a6975ba6a563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c54ae4a0-4fdc-4128-85a3-f39fdb907468", "tag": "6cb9c2b8-706c-4da3-ba6a-336a239ce626"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:55.613016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8c409452-af02-4fda-9948-f0d34f467bbd req-d7859e82-a165-4dcb-a078-a6975ba6a563 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.613873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8c409452-af02-4fda-9948-f0d34f467bbd req-d7859e82-a165-4dcb-a078-a6975ba6a563 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.615303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8c409452-af02-4fda-9948-f0d34f467bbd req-d7859e82-a165-4dcb-a078-a6975ba6a563 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.621612 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bdce3b0f-1451-4b42-a0a3-3236396f65e5 req-be1dec57-f3d2-4c11-86f0-6d5f6a176873 service nova] Creating event network-vif-plugged:8a3944bf-786e-467e-8893-ff95b6e28ff0 for instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 on n-h2-854441-12 Oct 17 15:36:55.634991 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8c409452-af02-4fda-9948-f0d34f467bbd req-d7859e82-a165-4dcb-a078-a6975ba6a563 service nova] Creating event network-changed:6cb9c2b8-706c-4da3-ba6a-336a239ce626 for instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 on n-h1-854441-12 Oct 17 15:36:55.637571 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bdce3b0f-1451-4b42-a0a3-3236396f65e5 req-be1dec57-f3d2-4c11-86f0-6d5f6a176873 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103413 Oct 17 15:36:55.639222 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1789/3325] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:55.646202 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8c409452-af02-4fda-9948-f0d34f467bbd req-d7859e82-a165-4dcb-a078-a6975ba6a563 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055822 Oct 17 15:36:55.652328 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1537/3326] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:55.658838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:55.659831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:55.670116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.671203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.671910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.674101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:55.675270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:55.675986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:55.944001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-812071827", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:56.061923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:36:56.093928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:56.134025 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ed9b72f-e6d5-47b2-8459-3069318018dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.479713 Oct 17 15:36:56.142703 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1538/3327] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:55 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:56.156866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-720016cc-7b04-4b0f-8fc6-81ded7978947 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Calling method '.version_select at 0x7f28c2e2d790>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:56.251961 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-720016cc-7b04-4b0f-8fc6-81ded7978947 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.107366 Oct 17 15:36:56.259869 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1539/3328] 10.222.0.87 () {58 vars in 1290 bytes} [Mon Oct 17 15:36:56 2022] GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata/os_distro => generated 33 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:36:56.267770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b6f831f9-dfd3-42c3-961a-1b8a8cf081f2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bf485700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:56.338566 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b6f831f9-dfd3-42c3-961a-1b8a8cf081f2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f" status: 200 len: 1463 microversion: 2.1 time: 0.076742 Oct 17 15:36:56.340083 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1540/3329] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:36:56 2022] GET /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f => generated 1463 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:56.352379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31601b54-8b85-4766-a980-d12ffac5da9c tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1622668723"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:56.357625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31601b54-8b85-4766-a980-d12ffac5da9c tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:56.374708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31601b54-8b85-4766-a980-d12ffac5da9c tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:56.376102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31601b54-8b85-4766-a980-d12ffac5da9c tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:56.377257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31601b54-8b85-4766-a980-d12ffac5da9c tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:56.380145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31601b54-8b85-4766-a980-d12ffac5da9c tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:56.383496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31601b54-8b85-4766-a980-d12ffac5da9c tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:56.385254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31601b54-8b85-4766-a980-d12ffac5da9c tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:56.476019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:36:56.479924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:36:56.481073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:36:56.487721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:36:56.488453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:36:56.513175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:56.513988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:56.514841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:56.516369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:56.517314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:56.517994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:56.556566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Getting quotas for project 3e312b32190a41ee84947b87f0f75026. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:36:56.600292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Getting quotas for user addc1f19b42f47d199887d51c196012a and project 3e312b32190a41ee84947b87f0f75026. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:36:56.629275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:36:56.636575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:36:56.735852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42c31956-a5bb-4ac1-9656-5c53d791f97d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092075 Oct 17 15:36:56.752619 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1790/3330] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:36:56.774455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:56.778211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:56.798234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:56.800179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:56.801369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:56.803047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:56.804157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:56.805384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:56.807192 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31601b54-8b85-4766-a980-d12ffac5da9c tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "POST /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359/action" status: 202 len: 52 microversion: 2.47 time: 0.463344 Oct 17 15:36:56.808437 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1541/3331] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:36:56 2022] POST /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359/action => generated 52 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 17 15:36:56.842962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe380a33-a530-4c18-9090-05ff40210002 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-293797297"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:56.848806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe380a33-a530-4c18-9090-05ff40210002 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:56.883524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe380a33-a530-4c18-9090-05ff40210002 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:56.884090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe380a33-a530-4c18-9090-05ff40210002 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:56.884871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe380a33-a530-4c18-9090-05ff40210002 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:56.886171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe380a33-a530-4c18-9090-05ff40210002 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:56.887133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe380a33-a530-4c18-9090-05ff40210002 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:56.887831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe380a33-a530-4c18-9090-05ff40210002 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:56.971398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:56.990319 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9362df51-62f2-4fc3-b928-0f1d6945e947 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1274 microversion: 2.1 time: 0.235688 Oct 17 15:36:56.992023 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1791/3332] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:56 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:57.000853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e9f7d96-8553-4612-840a-f193ec0a143d tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Action: 'update_all', calling method: .version_select at 0x7f28be240790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:57.153752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1e9f7d96-8553-4612-840a-f193ec0a143d tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:36:57.177327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1e9f7d96-8553-4612-840a-f193ec0a143d tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for user 319d035b08764fe6b626dfc284521b15 and project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:36:57.353136 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe380a33-a530-4c18-9090-05ff40210002 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.541074 Oct 17 15:36:57.359895 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1542/3333] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:36:56 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 15:36:57.368402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:57.372673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:57.407733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:57.408469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:57.410368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:57.412287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:57.413044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:57.414875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:57.477984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:57.478892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:57.479539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:57.480202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lazy-loading 'fault' on Instance uuid 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:36:57.566851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:57.590319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:57.593870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30eeba6526d5434eaa0e8c1ddf728270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3bc4988604cee968194ee80fbbd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:57.595302 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81becec6-ac83-4470-90f5-5d75bc6da0dc tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 200 len: 1609 microversion: 2.32 time: 0.233503 Oct 17 15:36:57.606597 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1543/3334] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:57 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 1609 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:57.616518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:57.621121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:57.643530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:57.643530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:57.650448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:57.651758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:57.652144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:57.652846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:57.676661 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e9f7d96-8553-4612-840a-f193ec0a143d tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 61 microversion: 2.1 time: 0.682509 Oct 17 15:36:57.677702 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1792/3335] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:36:56 2022] PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 61 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:36:57.699275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:57.700311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:57.725659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:57.726642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:57.727545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:57.728627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:57.729170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:57.729660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:57.764341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:36:57.892818 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d7fa609-2374-4283-828d-bfab92f73f57 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359" status: 204 len: 0 microversion: 2.47 time: 0.212869 Oct 17 15:36:57.902300 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1793/3336] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:36:57 2022] DELETE /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:36:57.910340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1759106463", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:57.956729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:57.973562 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23ea3f90-db83-4e86-9975-59bc91483dfe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 200 len: 1468 microversion: 2.1 time: 0.364601 Oct 17 15:36:57.989245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] validate_networks() for None {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:36:57.996084 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1544/3337] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:57 2022] GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 1468 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:58.009393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-eaabd821-4bc8-47a7-9892-131a83b893ef req-7162ed48-0366-47db-8264-e1ff2e603867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "name": "network-vif-plugged", "status": "completed", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}, {"server_uuid": "c54ae4a0-4fdc-4128-85a3-f39fdb907468", "name": "network-vif-plugged", "status": "completed", "tag": "6cb9c2b8-706c-4da3-ba6a-336a239ce626"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:58.038801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-eaabd821-4bc8-47a7-9892-131a83b893ef req-7162ed48-0366-47db-8264-e1ff2e603867 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:58.047867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-eaabd821-4bc8-47a7-9892-131a83b893ef req-7162ed48-0366-47db-8264-e1ff2e603867 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:58.048501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-eaabd821-4bc8-47a7-9892-131a83b893ef req-7162ed48-0366-47db-8264-e1ff2e603867 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:58.096516 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-eaabd821-4bc8-47a7-9892-131a83b893ef req-7162ed48-0366-47db-8264-e1ff2e603867 service nova] Creating event network-vif-plugged:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:36:58.097212 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-eaabd821-4bc8-47a7-9892-131a83b893ef req-7162ed48-0366-47db-8264-e1ff2e603867 service nova] Creating event network-vif-plugged:6cb9c2b8-706c-4da3-ba6a-336a239ce626 for instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 on n-h1-854441-12 Oct 17 15:36:58.104484 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-eaabd821-4bc8-47a7-9892-131a83b893ef req-7162ed48-0366-47db-8264-e1ff2e603867 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.106732 Oct 17 15:36:58.105583 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1545/3338] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:58.113076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-751a20a6-b436-41e5-be6a-9f56995115a4 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Calling method '.version_select at 0x7f28c2e2de50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:58.176622 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-751a20a6-b436-41e5-be6a-9f56995115a4 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 61 microversion: 2.1 time: 0.069267 Oct 17 15:36:58.181314 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1546/3339] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:36:58 2022] GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 61 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:36:58.192368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:58.196316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:58.204026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:58.204683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:58.205558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:58.206458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:58.207044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:58.207875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:58.336251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:58.354741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:58.360829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:58.364065 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-60ad16b1-5971-4e22-a72c-20e5ea7c6cf9 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359" status: 200 len: 1365 microversion: 2.47 time: 0.181549 Oct 17 15:36:58.383599 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1547/3340] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:58 2022] GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:36:58.383599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-40f5bab9-ccec-4456-914c-4e33378499d2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3c9e50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:58.638010 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-40f5bab9-ccec-4456-914c-4e33378499d2 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images?changes-since=2022-10-17T15%3A34%3A18Z" status: 200 len: 1901 microversion: 2.1 time: 0.264547 Oct 17 15:36:58.653950 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1548/3341] 10.222.0.87 () {58 vars in 1199 bytes} [Mon Oct 17 15:36:58 2022] GET /compute/v2.1/images?changes-since=2022-10-17T15%3A34%3A18Z => generated 1901 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:58.669837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:58.672228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:58.702752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:58.703835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:58.704997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:58.706015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:58.706716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:58.707587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:58.738472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:36:58.741044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:36:58.742211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:36:58.742860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:36:58.743618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:36:58.762270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:58.763720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:58.764431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:58.765840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:58.778852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:58.779928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:58.807339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Getting quotas for project 3e312b32190a41ee84947b87f0f75026. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:36:58.816221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Getting quotas for user addc1f19b42f47d199887d51c196012a and project 3e312b32190a41ee84947b87f0f75026. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:36:58.835458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:36:58.838834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:36:58.894833 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cfde405f-2b66-409f-a5e4-8d8dd3f215f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989034 Oct 17 15:36:58.895900 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1794/3342] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:36:58.900951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2bbd97b3-2b92-4ae2-bfd8-1e027efd47f3 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Action: 'update_all', calling method: .version_select at 0x7f28bea1b9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:58.928534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:58.979733 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e88ce292-38fa-4bee-a644-dee1fbb026bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1280 microversion: 2.1 time: 0.319157 Oct 17 15:36:58.981298 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1549/3343] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:58 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:59.001861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2bbd97b3-2b92-4ae2-bfd8-1e027efd47f3 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:36:59.013525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2bbd97b3-2b92-4ae2-bfd8-1e027efd47f3 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for user 319d035b08764fe6b626dfc284521b15 and project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:36:59.014538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:59.019767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:59.027681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:59.028197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:59.028654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:59.029449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:59.029907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:59.030347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:59.069489 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] HTTP exception thrown: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Request method failure captured: Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 HTTP/1.1 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXTONjE-RTOPrkk2zjXY-wa_dX9E-4DHG3PqQzjY_HAJFdEqQvflOo_ACJLcByV_6Q4nX_Aq_VUsNdH2WieVpBDszN-toFDkq2oq9L1zs1HemU_JQ-vuRWHGqLNgbJ05MT0FvX-fV6aQFatUx4eVwIcIjoymkrdJW1x5-jNybFUdvR8 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3df3bc4988604cee968194ee80fbbd82 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TaggedBootDevicesTest-1358735602 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TaggedBootDevicesTest-1358735602 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3df3bc4988604cee968194ee80fbbd82 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1358735602 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TaggedBootDevicesTest-1358735602-project Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 30eeba6526d5434eaa0e8c1ddf728270 Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TaggedBootDevicesTest-1358735602-project Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '3e14b99d-f8bb-4388-aa94-ecbbbf047f68'} Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:59.071354 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Returning 404 to user: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1b05f6cc-3e09-49c6-ad4b-3f89f175e568 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 404 len: 111 microversion: 2.32 time: 0.087531 Oct 17 15:36:59.083245 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1550/3344] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:58 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:36:59.090689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8da48432-7be3-48e9-afcd-65e909920047 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be373310>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:59.268437 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8da48432-7be3-48e9-afcd-65e909920047 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-762304136" status: 200 len: 484 microversion: 2.1 time: 0.193758 Oct 17 15:36:59.269082 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1551/3345] 10.222.0.87 () {58 vars in 1229 bytes} [Mon Oct 17 15:36:59 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-762304136 => generated 484 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:59.285894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-467e3936-bb54-4068-a62f-163b0fa6bf5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:59.286820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-467e3936-bb54-4068-a62f-163b0fa6bf5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:59.438804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-467e3936-bb54-4068-a62f-163b0fa6bf5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:36:59.455790 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-467e3936-bb54-4068-a62f-163b0fa6bf5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1214 microversion: 2.1 time: 0.184287 Oct 17 15:36:59.456392 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1552/3346] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:36:59 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:36:59.475381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a3f0e10-052e-42e2-95ed-34fcdf3a7e7a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '.version_select at 0x7f28c2e2d280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:59.536174 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2bbd97b3-2b92-4ae2-bfd8-1e027efd47f3 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 61 microversion: 2.1 time: 0.638631 Oct 17 15:36:59.544549 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1795/3347] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:36:58 2022] PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 61 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:36:59.547785 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a3f0e10-052e-42e2-95ed-34fcdf3a7e7a tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398717733" status: 204 len: 0 microversion: 2.32 time: 0.085680 Oct 17 15:36:59.558714 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1553/3348] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398717733 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:36:59.592705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:59.596568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d2f8459-6aca-43ef-94dd-65950f52a085 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bedda790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:36:59.598385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:36:59.625812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:59.626310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:59.631289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:59.635070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:36:59.638735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:36:59.640635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:36:59.800080 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d2f8459-6aca-43ef-94dd-65950f52a085 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images?server=aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 200 len: 957 microversion: 2.1 time: 0.251508 Oct 17 15:36:59.802006 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1796/3349] 10.222.0.87 () {58 vars in 1209 bytes} [Mon Oct 17 15:36:59 2022] GET /compute/v2.1/images?server=aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 957 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:36:59.826752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ae9ca83-abe0-4cb1-9754-0640f8725e46 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Action: 'update_all', calling method: .version_select at 0x7f28c2eb81f0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:36:59.996600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6ae9ca83-abe0-4cb1-9754-0640f8725e46 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:00.023408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6ae9ca83-abe0-4cb1-9754-0640f8725e46 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for user 319d035b08764fe6b626dfc284521b15 and project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:00.057161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:00.079416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:00.085903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:00.088624 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-582565fc-5369-4152-8441-16126b5df0bd tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359" status: 200 len: 1365 microversion: 2.47 time: 0.530717 Oct 17 15:37:00.093102 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1554/3350] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:36:59 2022] GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 => generated 1365 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:37:00.110982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-88543352-e3cf-4c10-9016-5c35b5133581 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3e3940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:00.286414 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-88543352-e3cf-4c10-9016-5c35b5133581 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.87%2Fcompute%2Fv2.1%2Fservers%2Ff43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 483 microversion: 2.1 time: 0.187314 Oct 17 15:37:00.287927 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1555/3351] 10.222.0.87 () {58 vars in 1317 bytes} [Mon Oct 17 15:37:00 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.87%2Fcompute%2Fv2.1%2Fservers%2Ff43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 483 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:00.303184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:00.305925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:00.355548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:00.360061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:00.362432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:00.365187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:00.366752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:00.368660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:00.914126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:00.928009 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-621bfbad-e7a4-4878-9059-971bbc2d615e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1322 microversion: 2.1 time: 0.638148 Oct 17 15:37:00.950887 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1556/3352] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:00 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1322 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:00.967862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-dfce78ef-3ba8-4630-ab79-9ea49d61c4a5 req-e309fdad-6078-4d04-a294-32bd9d689388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "name": "network-vif-unplugged", "status": "completed", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:01.004687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dfce78ef-3ba8-4630-ab79-9ea49d61c4a5 req-e309fdad-6078-4d04-a294-32bd9d689388 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:01.005797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dfce78ef-3ba8-4630-ab79-9ea49d61c4a5 req-e309fdad-6078-4d04-a294-32bd9d689388 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:01.014003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dfce78ef-3ba8-4630-ab79-9ea49d61c4a5 req-e309fdad-6078-4d04-a294-32bd9d689388 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:01.054385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-dfce78ef-3ba8-4630-ab79-9ea49d61c4a5 req-e309fdad-6078-4d04-a294-32bd9d689388 service nova] Creating event network-vif-unplugged:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:37:01.069552 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-dfce78ef-3ba8-4630-ab79-9ea49d61c4a5 req-e309fdad-6078-4d04-a294-32bd9d689388 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113173 Oct 17 15:37:01.073393 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1557/3353] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:01.084501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73c2fcdb-90ce-4b5f-aa89-6706ba3b068d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bec660d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:01.118681 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ae9ca83-abe0-4cb1-9754-0640f8725e46 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 64 microversion: 2.1 time: 1.302393 Oct 17 15:37:01.120447 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1797/3354] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:36:59 2022] PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 64 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:01.126610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:01.131126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:01.147864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:01.151436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:01.152825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:01.153900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:01.158199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:01.158959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:01.197218 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-73c2fcdb-90ce-4b5f-aa89-6706ba3b068d tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.87%2Fcompute%2Fservers%2Ff43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 483 microversion: 2.1 time: 0.120205 Oct 17 15:37:01.200455 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1558/3355] 10.222.0.87 () {58 vars in 1303 bytes} [Mon Oct 17 15:37:01 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.87%2Fcompute%2Fservers%2Ff43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 483 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:01.214540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95df7ccf-da2d-4e45-9161-6a4eed5ff4ba tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Calling method '.version_select at 0x7f28c2e395e0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:01.292065 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95df7ccf-da2d-4e45-9161-6a4eed5ff4ba tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 64 microversion: 2.1 time: 0.088772 Oct 17 15:37:01.295037 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1559/3356] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:37:01 2022] GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 64 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:01.303324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:01.321898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:01.322706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:01.324038 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7f4b17a-6b89-427d-81cc-05d1964337ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1210 microversion: 2.1 time: 0.202238 Oct 17 15:37:01.324930 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1798/3357] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:01 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1210 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:01.345704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6957899e-6994-446b-ac88-38dbef2f4974 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be240790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:01.351708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:01.352264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:01.355086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:01.360163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:01.360757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:01.361168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:01.573259 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6957899e-6994-446b-ac88-38dbef2f4974 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.246808 Oct 17 15:37:01.574554 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1799/3358] 10.222.0.87 () {58 vars in 1149 bytes} [Mon Oct 17 15:37:01 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:01.608474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47697f87-9496-44b6-ac7d-eca4c881bbd5 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Action: 'update_all', calling method: .version_select at 0x7f28be3df700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:01.718672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:01.734294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:01.737161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4957a1fca34a4520ab42a0dc50e43b5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0766acfeadb44b89b59328848a09c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:01.739105 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e15966ca-a912-43ae-b752-2844bba3ce25 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359" status: 200 len: 1365 microversion: 2.47 time: 0.439897 Oct 17 15:37:01.740308 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1560/3359] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:37:01 2022] GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 => generated 1365 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:37:01.753265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-47697f87-9496-44b6-ac7d-eca4c881bbd5 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:01.755064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-32861565-ceef-494d-a1a1-b1e7cfe934a0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3c90d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:01.767140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-47697f87-9496-44b6-ac7d-eca4c881bbd5 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for user 319d035b08764fe6b626dfc284521b15 and project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:01.875467 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-32861565-ceef-494d-a1a1-b1e7cfe934a0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.133793 Oct 17 15:37:01.876377 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1561/3360] 10.222.0.87 () {58 vars in 1149 bytes} [Mon Oct 17 15:37:01 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:01.897654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-810b0bd6-6521-4c00-8def-86f2ca734dce tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bec66b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:02.087022 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-810b0bd6-6521-4c00-8def-86f2ca734dce tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.193302 Oct 17 15:37:02.095848 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1562/3361] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:37:01 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:37:02.135302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:02.137299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:02.155644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:02.157138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:02.158536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:02.160970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:02.163928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:02.165066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:02.514686 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47697f87-9496-44b6-ac7d-eca4c881bbd5 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 61 microversion: 2.1 time: 0.938703 Oct 17 15:37:02.515404 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1800/3362] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:37:01 2022] PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 61 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:02.528022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b11867e4-53bd-42b9-895a-c1822e7adbfc tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be2bb8b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:03.042742 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b11867e4-53bd-42b9-895a-c1822e7adbfc tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/detail?changes-since=2022-10-17T15%3A34%3A12Z" status: 200 len: 6332 microversion: 2.1 time: 0.526197 Oct 17 15:37:03.045296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1801/3363] 10.222.0.87 () {58 vars in 1220 bytes} [Mon Oct 17 15:37:02 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-17T15%3A34%3A12Z => generated 6332 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:03.053803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:03.054851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:03.075596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:03.076999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:03.080971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:03.082093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:03.082852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:03.083555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:03.203988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:03.234456 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b7cf087f-ba9d-405c-ac38-cc0efd1fd1c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1322 microversion: 2.1 time: 1.117669 Oct 17 15:37:03.235550 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1563/3364] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:02 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1322 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:03.258896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0771b860-7c16-4001-8898-76165dee8714 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Action: 'update', calling method: .version_select at 0x7f28be373160>, body: {"meta": {"os_version": "alt"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:03.368410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:03.375156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-0771b860-7c16-4001-8898-76165dee8714 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:03.379815 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e188a97f-08ec-4856-ac7f-0325b3cea402 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1272 microversion: 2.1 time: 0.332190 Oct 17 15:37:03.381539 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1802/3365] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:03 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:03.388053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:03.389076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] [instance: cb9058c4-2633-4c87-adc8-e8634b04f359] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:03.392927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-0771b860-7c16-4001-8898-76165dee8714 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for user 319d035b08764fe6b626dfc284521b15 and project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:03.399930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:03.400949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:03.401945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:03.402947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:03.403604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:03.404469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:03.428273 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] HTTP exception thrown: Instance cb9058c4-2633-4c87-adc8-e8634b04f359 could not be found. Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Request method failure captured: Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 HTTP/1.1 Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXZ6uH6pF6NTSpMuKkn0-pjhfCimTNjDeIiyrkslwVHqiv8qdKsktyHAO8U8AfdpCfi_iv49k-Kl1jTPcm8BTmTDDu2L_Ad0lwVMhAdf8OVmiRoRBfIaH9FrwAlCt_IsVDjxsAWqfUXQ7cEqRG2ioM8pP00dNpz4ECA2vgjknyfI57U Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: d0766acfeadb44b89b59328848a09c0a Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAaction247Test-1532711406 Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d0766acfeadb44b89b59328848a09c0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/d0766acfeadb44b89b59328848a09c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_d0766acfeadb44b89b59328848a09c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d0766acfeadb44b89b59328848a09c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAaction247Test-1532711406 Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: d0766acfeadb44b89b59328848a09c0a Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAaction247Test-1532711406 Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersAaction247Test-1532711406-project Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 4957a1fca34a4520ab42a0dc50e43b5a Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAaction247Test-1532711406-project Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance cb9058c4-2633-4c87-adc8-e8634b04f359 could not be found. Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'cb9058c4-2633-4c87-adc8-e8634b04f359'} Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb9058c4-2633-4c87-adc8-e8634b04f359 could not be found. Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb9058c4-2633-4c87-adc8-e8634b04f359 could not be found. Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:03.430875 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb9058c4-2633-4c87-adc8-e8634b04f359 could not be found. Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] Returning 404 to user: Instance cb9058c4-2633-4c87-adc8-e8634b04f359 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3549356a-6287-426a-be8c-7424726106b8 tempest-ServersAaction247Test-1532711406 tempest-ServersAaction247Test-1532711406-project] 10.222.0.87 "GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359" status: 404 len: 111 microversion: 2.47 time: 0.050567 Oct 17 15:37:03.437378 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1803/3366] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:37:03 2022] GET /compute/v2.1/servers/cb9058c4-2633-4c87-adc8-e8634b04f359 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:37:03.493394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94403a99-55d5-4280-8f19-955337d2c205 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28c0f95ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:03.894822 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94403a99-55d5-4280-8f19-955337d2c205 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-762304136" status: 200 len: 664 microversion: 2.1 time: 0.459113 Oct 17 15:37:03.895853 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1804/3367] 10.222.0.87 () {58 vars in 1250 bytes} [Mon Oct 17 15:37:03 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-762304136 => generated 664 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:03.931321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-590bb13d-9bad-4fa0-b191-1b2acb57eed4 req-0b733c4a-b896-4d38-a577-62308949b0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa21afee-1c0c-49b3-b91c-bf7fa5438381", "name": "network-vif-unplugged", "status": "completed", "tag": "8a3944bf-786e-467e-8893-ff95b6e28ff0"}, {"server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "name": "network-vif-plugged", "status": "completed", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:03.984137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-590bb13d-9bad-4fa0-b191-1b2acb57eed4 req-0b733c4a-b896-4d38-a577-62308949b0ce service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:03.984640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-590bb13d-9bad-4fa0-b191-1b2acb57eed4 req-0b733c4a-b896-4d38-a577-62308949b0ce service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:03.992361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-590bb13d-9bad-4fa0-b191-1b2acb57eed4 req-0b733c4a-b896-4d38-a577-62308949b0ce service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:04.021828 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-590bb13d-9bad-4fa0-b191-1b2acb57eed4 req-0b733c4a-b896-4d38-a577-62308949b0ce service nova] Creating event network-vif-unplugged:8a3944bf-786e-467e-8893-ff95b6e28ff0 for instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 on n-h2-854441-12 Oct 17 15:37:04.023250 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-590bb13d-9bad-4fa0-b191-1b2acb57eed4 req-0b733c4a-b896-4d38-a577-62308949b0ce service nova] Creating event network-vif-plugged:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:37:04.059898 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-590bb13d-9bad-4fa0-b191-1b2acb57eed4 req-0b733c4a-b896-4d38-a577-62308949b0ce service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.142774 Oct 17 15:37:04.061623 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1805/3368] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:04.099684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8b34d9a-f4c5-4b2a-9eea-9e0f770f24e0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bea99ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:04.589791 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0771b860-7c16-4001-8898-76165dee8714 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.352700 Oct 17 15:37:04.590994 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1564/3369] 10.222.0.87 () {60 vars in 1313 bytes} [Mon Oct 17 15:37:03 2022] PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata/os_version => generated 31 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:04.603343 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8b34d9a-f4c5-4b2a-9eea-9e0f770f24e0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.87%2Fcompute%2Fv2.1%2Fservers%2Ff43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1465 microversion: 2.1 time: 0.533610 Oct 17 15:37:04.603665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:04.604535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:04.612741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:04.613627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:04.614195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:04.614818 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1806/3370] 10.222.0.87 () {58 vars in 1338 bytes} [Mon Oct 17 15:37:04 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.87%2Fcompute%2Fv2.1%2Fservers%2Ff43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1465 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:04.615241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:04.616084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:04.616868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:04.631124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:04.632208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:04.655245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:04.658283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:04.662092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:04.663414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:04.664147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:04.664843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:04.866957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:04.880531 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5036792-9972-4f64-b7e3-a34ba21cfb8f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1272 microversion: 2.1 time: 0.263604 Oct 17 15:37:04.883635 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1807/3371] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:04 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:04.900362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-517a4d10-0a77-4f47-8eff-91b6c52a60ad tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Calling method '.version_select at 0x7f28be3548b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:05.490984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:05.527370 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-517a4d10-0a77-4f47-8eff-91b6c52a60ad tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 58 microversion: 2.1 time: 0.640664 Oct 17 15:37:05.528499 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1808/3372] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:37:04 2022] GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 58 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:05.548568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-444212c0-6a1b-47b3-98db-7cbcb8068aaf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28beb535e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:05.678289 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-444212c0-6a1b-47b3-98db-7cbcb8068aaf tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.87%2Fcompute%2Fservers%2Ff43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1465 microversion: 2.1 time: 0.138893 Oct 17 15:37:05.679259 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1809/3373] 10.222.0.87 () {58 vars in 1324 bytes} [Mon Oct 17 15:37:05 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.87%2Fcompute%2Fservers%2Ff43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1465 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:05.705126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-114eb64a-c693-4167-bef2-f29674d05c57 req-60281fb4-d07c-4bda-a073-c2d6d24d1cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52f0fd6d-17f3-412d-9bb7-b40d8272d982", "tag": "61ce5642-45d8-419e-b0ec-592665f1d61b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:05.758955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-114eb64a-c693-4167-bef2-f29674d05c57 req-60281fb4-d07c-4bda-a073-c2d6d24d1cf3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:05.761331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-114eb64a-c693-4167-bef2-f29674d05c57 req-60281fb4-d07c-4bda-a073-c2d6d24d1cf3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:05.768069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-114eb64a-c693-4167-bef2-f29674d05c57 req-60281fb4-d07c-4bda-a073-c2d6d24d1cf3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:05.845134 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-114eb64a-c693-4167-bef2-f29674d05c57 req-60281fb4-d07c-4bda-a073-c2d6d24d1cf3 service nova] Creating event network-changed:61ce5642-45d8-419e-b0ec-592665f1d61b for instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 on n-h2-854441-12 Oct 17 15:37:05.867175 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-114eb64a-c693-4167-bef2-f29674d05c57 req-60281fb4-d07c-4bda-a073-c2d6d24d1cf3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172327 Oct 17 15:37:05.868813 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1810/3374] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:05.885152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72bd2ece-27a9-40c1-8db2-5cd2054a2bf2 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Action: 'update_all', calling method: .version_select at 0x7f28bea99ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:05.924199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:05.929140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:05.942814 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a2e323cc-c0c5-4b3b-9113-21850ea8d801 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1322 microversion: 2.1 time: 1.346917 Oct 17 15:37:05.944279 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1565/3375] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:04 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1322 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:05.970841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cba74227-91e2-4528-adec-1f95fac70f73 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3c9ee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:06.016675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-72bd2ece-27a9-40c1-8db2-5cd2054a2bf2 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:06.037669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-72bd2ece-27a9-40c1-8db2-5cd2054a2bf2 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for user 319d035b08764fe6b626dfc284521b15 and project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:06.066740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:06.220856 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cba74227-91e2-4528-adec-1f95fac70f73 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.271952 Oct 17 15:37:06.234749 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1566/3376] 10.222.0.87 () {58 vars in 1170 bytes} [Mon Oct 17 15:37:05 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:06.240095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:06.241019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:06.302914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:06.306463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:06.308160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:06.309267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:06.312257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:06.313025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:06.627735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:06.640983 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d84246cc-c07f-429f-8f7c-a4dcfd953064 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1272 microversion: 2.1 time: 0.407060 Oct 17 15:37:06.646274 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1567/3377] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:06 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1272 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:06.671546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-763fc486-e358-4de1-ba9d-d3719a469a00 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3735e0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:07.767080 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72bd2ece-27a9-40c1-8db2-5cd2054a2bf2 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 61 microversion: 2.1 time: 1.892723 Oct 17 15:37:07.768042 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1811/3378] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:37:05 2022] PUT /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 61 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:07.775560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:07.776421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:07.809820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:07.833250 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-763fc486-e358-4de1-ba9d-d3719a469a00 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 1.184587 Oct 17 15:37:07.833854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:07.834419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:07.836937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:07.838096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:07.842765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:07.846850 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1568/3379] 10.222.0.87 () {58 vars in 1170 bytes} [Mon Oct 17 15:37:06 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:07.868416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:07.874187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:07.911729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:07.912257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:07.912713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:07.913455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:07.919690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:07.923802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:08.677257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:08.701603 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-817cb700-7116-480c-afd3-6698608fd9bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1322 microversion: 2.1 time: 0.931929 Oct 17 15:37:08.713742 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1812/3380] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:07 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1322 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:08.723286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14116643-4e57-4841-8757-2957856017c2 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Action: 'create', calling method: .version_select at 0x7f28bee25550>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:08.793106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:08.876781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-14116643-4e57-4841-8757-2957856017c2 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:08.903220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-14116643-4e57-4841-8757-2957856017c2 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Getting quotas for user 319d035b08764fe6b626dfc284521b15 and project 1a5cb663fe734c62a5792979c545cf86. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:08.914420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:08.949211 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-af3eeae9-65ea-46bc-9de9-64d9c4ac067a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 1.089128 Oct 17 15:37:08.958761 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1569/3381] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:07 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:08.981636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02e003ef-beb4-4162-a5c5-ee25b50fc1b3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bfadb1f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:09.173649 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02e003ef-beb4-4162-a5c5-ee25b50fc1b3 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/c489ef08-d3af-4c49-859b-7a55ed37ba8d" status: 200 len: 784 microversion: 2.1 time: 0.196599 Oct 17 15:37:09.188250 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1570/3382] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:37:08 2022] GET /compute/v2.1/images/c489ef08-d3af-4c49-859b-7a55ed37ba8d => generated 784 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:09.720092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e2b3d227-adb4-45e2-b847-9d4905f440e5"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:09.723218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:09.738528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:09.739600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:09.740314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:09.741291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:09.742769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:09.743497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:09.920545 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14116643-4e57-4841-8757-2957856017c2 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "POST /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 85 microversion: 2.1 time: 1.204552 Oct 17 15:37:09.922369 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1813/3383] 10.222.0.87 () {60 vars in 1281 bytes} [Mon Oct 17 15:37:08 2022] POST /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 85 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:09.930431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e631729c-0a35-4cc7-8ec0-cab7449bdab9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be3548b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:09.969953 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] HTTP exception thrown: Volume e2b3d227-adb4-45e2-b847-9d4905f440e5 could not be found. Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Request method failure captured: Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: request: PUT /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments/7e9d4027-db63-435b-8656-3f5afbcf79a4 HTTP/1.1 Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 74 Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXY4MQzKK3RS52-B-FYR7P-_stZ0vfkzVikxU92ZqlMjly--snFhq4b92l3QRcIVGrUVK_uBk9ro64a3WxGTfucUBPeWbbTQV4xtr7bS4toVI0LBS5GCPoxqi_37esrcTqbETBBM6bXPM5PP2707nD_uJ0kIaKXPelIxOH_sNlruYug Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: dc2b57457f0d44069996fac6bab4c8fd Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesAdminNegativeTest-767208564 Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dc2b57457f0d44069996fac6bab4c8fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/dc2b57457f0d44069996fac6bab4c8fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_dc2b57457f0d44069996fac6bab4c8fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dc2b57457f0d44069996fac6bab4c8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesAdminNegativeTest-767208564 Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: dc2b57457f0d44069996fac6bab4c8fd Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-767208564 Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesAdminNegativeTest-767208564-project-admin Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 4d8285310cfe4b13a7b68954a95fa0f8 Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesAdminNegativeTest-767208564-project-admin Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: {"volumeAttachment": {"volumeId": "e2b3d227-adb4-45e2-b847-9d4905f440e5"}} Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: exception: Volume e2b3d227-adb4-45e2-b847-9d4905f440e5 could not be found. Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'server_id': 'c40d53c0-6353-460c-ade7-186346f19950', 'id': '7e9d4027-db63-435b-8656-3f5afbcf79a4', 'body': {'volumeAttachment': {'volumeId': 'e2b3d227-adb4-45e2-b847-9d4905f440e5'}}} Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2b3d227-adb4-45e2-b847-9d4905f440e5 could not be found. (HTTP 404) (Request-ID: req-5d767973-0da1-42d1-ba10-eac427ba64ef) Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 15:37:10.000921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2b3d227-adb4-45e2-b847-9d4905f440e5 could not be found. Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e2b3d227-adb4-45e2-b847-9d4905f440e5 could not be found. Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2b3d227-adb4-45e2-b847-9d4905f440e5 could not be found. Oct 17 15:37:10.008880 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:10.017636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Returning 400 to user: Volume e2b3d227-adb4-45e2-b847-9d4905f440e5 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:10.018268 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-47c569b1-a7dd-45f4-8b20-478fbc4fe51c tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] 10.222.0.87 "PUT /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments/7e9d4027-db63-435b-8656-3f5afbcf79a4" status: 400 len: 107 microversion: 2.1 time: 0.838246 Oct 17 15:37:10.020231 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1571/3384] 10.222.0.87 () {60 vars in 1433 bytes} [Mon Oct 17 15:37:09 2022] PUT /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments/7e9d4027-db63-435b-8656-3f5afbcf79a4 => generated 107 bytes in 845 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:37:10.036415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:10.043367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:10.076621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:10.077933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:10.079195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:10.080779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:10.082406 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e631729c-0a35-4cc7-8ec0-cab7449bdab9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.158642 Oct 17 15:37:10.083340 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1814/3385] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:37:09 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:10.083678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:10.084603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:10.092060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34bad67a-dedf-472a-bd5d-61171a8fd609 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] Calling method '.version_select at 0x7f28bee25e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:10.187152 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34bad67a-dedf-472a-bd5d-61171a8fd609 tempest-ImagesMetadataTestJSON-197843629 tempest-ImagesMetadataTestJSON-197843629-project] 10.222.0.87 "GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata" status: 200 len: 85 microversion: 2.1 time: 0.102010 Oct 17 15:37:10.187771 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1815/3386] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:37:10 2022] GET /compute/v2.1/images/32add088-7da6-4105-a2f8-304d0153cd98/metadata => generated 85 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:10.203028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:10.203931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:10.216358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:10.216970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:10.217866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:10.218733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:10.219286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:10.219806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:10.701485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:10.718294 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-433094b9-7501-49a7-9f41-76cde709f5b7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 0.529158 Oct 17 15:37:10.719221 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1816/3387] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:10 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:10.737208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f228a7e-1bf0-48c7-9f40-ca6e4ece9709 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28becdc160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:11.135685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:11.156834 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6226ef74-ed25-487b-acbc-e81bb7db0bc5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1322 microversion: 2.1 time: 1.133623 Oct 17 15:37:11.158669 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1572/3388] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:10 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1322 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:11.171588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:11.175316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:11.199127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:11.200142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:11.200835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:11.201900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:11.202699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:11.203364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:11.358492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lazy-loading 'services' on Instance uuid c40d53c0-6353-460c-ade7-186346f19950 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:37:11.522518 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad60b3fa-b8db-43c4-b007-5b6e65b06880 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments/7e9d4027-db63-435b-8656-3f5afbcf79a4" status: 202 len: 0 microversion: 2.1 time: 0.362098 Oct 17 15:37:11.523134 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1573/3389] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:37:11 2022] DELETE /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments/7e9d4027-db63-435b-8656-3f5afbcf79a4 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:37:11.549248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:11.556740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:11.611584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:11.627567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:11.632388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:11.636256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:11.640229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:11.641131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:11.696052 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] HTTP exception thrown: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Request method failure captured: Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 HTTP/1.1 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXTONjE-RTOPrkk2zjXY-wa_dX9E-4DHG3PqQzjY_HAJFdEqQvflOo_ACJLcByV_6Q4nX_Aq_VUsNdH2WieVpBDszN-toFDkq2oq9L1zs1HemU_JQ-vuRWHGqLNgbJ05MT0FvX-fV6aQFatUx4eVwIcIjoymkrdJW1x5-jNybFUdvR8 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3df3bc4988604cee968194ee80fbbd82 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TaggedBootDevicesTest-1358735602 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TaggedBootDevicesTest-1358735602 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3df3bc4988604cee968194ee80fbbd82 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1358735602 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TaggedBootDevicesTest-1358735602-project Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 30eeba6526d5434eaa0e8c1ddf728270 Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TaggedBootDevicesTest-1358735602-project Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '3e14b99d-f8bb-4388-aa94-ecbbbf047f68'} Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:37:11.716278 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:11.733012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Returning 404 to user: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:11.742639 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0ac2cc0a-677f-4ee0-8836-1cd5e3c217b9 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 404 len: 111 microversion: 2.32 time: 0.200404 Oct 17 15:37:11.744390 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1574/3390] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:37:11 2022] DELETE /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:37:11.769897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a3f72e4-e40f-4fb9-b6e0-a72cebd62629 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:11.781044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a3f72e4-e40f-4fb9-b6e0-a72cebd62629 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:11.798185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3f72e4-e40f-4fb9-b6e0-a72cebd62629 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:11.801322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3f72e4-e40f-4fb9-b6e0-a72cebd62629 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:11.802597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3f72e4-e40f-4fb9-b6e0-a72cebd62629 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:11.803838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3f72e4-e40f-4fb9-b6e0-a72cebd62629 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:11.804642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3f72e4-e40f-4fb9-b6e0-a72cebd62629 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:11.805750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a3f72e4-e40f-4fb9-b6e0-a72cebd62629 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:11.921819 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a3f72e4-e40f-4fb9-b6e0-a72cebd62629 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174888 Oct 17 15:37:11.923531 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1575/3391] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:37:11 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:11.938364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:11.948282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] [instance: 3e14b99d-f8bb-4388-aa94-ecbbbf047f68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:11.965355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:11.965355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:11.965355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:11.966217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:11.966528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:11.967871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:11.992741 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] HTTP exception thrown: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Request method failure captured: Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 HTTP/1.1 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXTONjE-RTOPrkk2zjXY-wa_dX9E-4DHG3PqQzjY_HAJFdEqQvflOo_ACJLcByV_6Q4nX_Aq_VUsNdH2WieVpBDszN-toFDkq2oq9L1zs1HemU_JQ-vuRWHGqLNgbJ05MT0FvX-fV6aQFatUx4eVwIcIjoymkrdJW1x5-jNybFUdvR8 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3df3bc4988604cee968194ee80fbbd82 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TaggedBootDevicesTest-1358735602 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3df3bc4988604cee968194ee80fbbd82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TaggedBootDevicesTest-1358735602 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3df3bc4988604cee968194ee80fbbd82 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1358735602 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TaggedBootDevicesTest-1358735602-project Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 30eeba6526d5434eaa0e8c1ddf728270 Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TaggedBootDevicesTest-1358735602-project Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '3e14b99d-f8bb-4388-aa94-ecbbbf047f68'} Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:11.995074 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] Returning 404 to user: Instance 3e14b99d-f8bb-4388-aa94-ecbbbf047f68 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6ddf8448-a32a-49eb-8813-7ef73da35c78 tempest-TaggedBootDevicesTest-1358735602 tempest-TaggedBootDevicesTest-1358735602-project] 10.222.0.87 "GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68" status: 404 len: 111 microversion: 2.32 time: 0.071415 Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1576/3392] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:37:11 2022] GET /compute/v2.1/servers/3e14b99d-f8bb-4388-aa94-ecbbbf047f68 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:12.007564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:12.013609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:12.014616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:12.015621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:12.016857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:12.018699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:12.019563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:12.358912 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f228a7e-1bf0-48c7-9f40-ca6e4ece9709 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "DELETE /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f" status: 204 len: 0 microversion: 2.1 time: 1.637606 Oct 17 15:37:12.365226 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1817/3393] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:10 2022] DELETE /compute/v2.1/images/e175b161-630f-4986-9474-ac6648d3e48f => generated 0 bytes in 1645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:37:12.401045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:12.408050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:12.470764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:12.471582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:12.472447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:12.479838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:12.480745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:12.485276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:13.151485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:13.164234 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7951cbb8-881e-4459-9671-46d385b56483 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1322 microversion: 2.1 time: 0.796698 Oct 17 15:37:13.169751 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1818/3394] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:12 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1322 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:13.181845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-faf5e74c-8352-437b-b430-772dd7ebc276 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bead0dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:13.407744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=12 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:14.419324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:14.453375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4490e5c2-9d30-49ab-8707-25b236541c03 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 2.454041 Oct 17 15:37:14.454482 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1577/3395] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:11 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:14.486978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9c6d00fc-1bf1-4b72-b96f-620f1a36b623 req-de8deccd-7405-48bc-959f-8541f5345db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe71f2c-d675-4eea-b163-bfde7044748c", "tag": "cf177eb8-02ed-4072-a83e-13a1cbfa5a85"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:14.524111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9c6d00fc-1bf1-4b72-b96f-620f1a36b623 req-de8deccd-7405-48bc-959f-8541f5345db2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:14.524614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9c6d00fc-1bf1-4b72-b96f-620f1a36b623 req-de8deccd-7405-48bc-959f-8541f5345db2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:14.539433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9c6d00fc-1bf1-4b72-b96f-620f1a36b623 req-de8deccd-7405-48bc-959f-8541f5345db2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:14.566775 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9c6d00fc-1bf1-4b72-b96f-620f1a36b623 req-de8deccd-7405-48bc-959f-8541f5345db2 service nova] Creating event network-changed:cf177eb8-02ed-4072-a83e-13a1cbfa5a85 for instance 9fe71f2c-d675-4eea-b163-bfde7044748c on n-h1-854441-12 Oct 17 15:37:14.586696 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9c6d00fc-1bf1-4b72-b96f-620f1a36b623 req-de8deccd-7405-48bc-959f-8541f5345db2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130155 Oct 17 15:37:14.588007 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1578/3396] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:14.608803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc650713-49bf-4ba6-83d7-a7255a179405 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:14.612967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bc650713-49bf-4ba6-83d7-a7255a179405 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:14.657894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc650713-49bf-4ba6-83d7-a7255a179405 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:14.658564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc650713-49bf-4ba6-83d7-a7255a179405 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:14.659031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc650713-49bf-4ba6-83d7-a7255a179405 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:14.659972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc650713-49bf-4ba6-83d7-a7255a179405 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:14.660456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc650713-49bf-4ba6-83d7-a7255a179405 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:14.669440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc650713-49bf-4ba6-83d7-a7255a179405 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:14.749924 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc650713-49bf-4ba6-83d7-a7255a179405 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159126 Oct 17 15:37:14.750596 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1579/3397] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:37:14 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:14.762257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:14.772924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:14.782441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:14.785339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:14.787897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:14.789002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:14.791406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:14.793977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:15.259213 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-faf5e74c-8352-437b-b430-772dd7ebc276 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "DELETE /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b" status: 204 len: 0 microversion: 2.1 time: 2.086260 Oct 17 15:37:15.259962 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1819/3398] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:13 2022] DELETE /compute/v2.1/images/008d280e-fb7a-4b22-a65f-69105fefb78b => generated 0 bytes in 2088 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:37:15.264819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4f2634b3-981e-48a1-9eec-57e40034fb46 req-d9af4def-3fa9-4945-8197-fa923e9daf39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f0fd6d-17f3-412d-9bb7-b40d8272d982", "name": "network-vif-plugged", "status": "completed", "tag": "61ce5642-45d8-419e-b0ec-592665f1d61b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:15.291959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4f2634b3-981e-48a1-9eec-57e40034fb46 req-d9af4def-3fa9-4945-8197-fa923e9daf39 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:15.299167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4f2634b3-981e-48a1-9eec-57e40034fb46 req-d9af4def-3fa9-4945-8197-fa923e9daf39 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:15.300777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4f2634b3-981e-48a1-9eec-57e40034fb46 req-d9af4def-3fa9-4945-8197-fa923e9daf39 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:15.318705 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4f2634b3-981e-48a1-9eec-57e40034fb46 req-d9af4def-3fa9-4945-8197-fa923e9daf39 service nova] Creating event network-vif-plugged:61ce5642-45d8-419e-b0ec-592665f1d61b for instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 on n-h2-854441-12 Oct 17 15:37:15.327464 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4f2634b3-981e-48a1-9eec-57e40034fb46 req-d9af4def-3fa9-4945-8197-fa923e9daf39 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066134 Oct 17 15:37:15.330911 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1820/3399] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:15.345393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56429fe4-d459-4f90-9bc3-0012da0607fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28becbbca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:16.408722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:16.422185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-842d56f3-b86b-4e5d-95f3-68039961b0ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1322 microversion: 2.1 time: 1.661444 Oct 17 15:37:16.424763 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1580/3400] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:14 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1322 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:16.436672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:16.442019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:16.456672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:16.459915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:16.460677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:16.465485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:16.466178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:16.472461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:17.512192 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56429fe4-d459-4f90-9bc3-0012da0607fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "DELETE /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a" status: 204 len: 0 microversion: 2.1 time: 2.177057 Oct 17 15:37:17.518594 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1821/3401] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:15 2022] DELETE /compute/v2.1/images/e8692e45-d76a-4332-b3d7-51ee062bdf9a => generated 0 bytes in 2183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:37:17.528082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae56303a-61da-478e-a0f7-437b9d71430a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:17.536588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae56303a-61da-478e-a0f7-437b9d71430a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:17.565556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae56303a-61da-478e-a0f7-437b9d71430a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:17.566573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae56303a-61da-478e-a0f7-437b9d71430a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:17.568873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae56303a-61da-478e-a0f7-437b9d71430a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:17.574396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae56303a-61da-478e-a0f7-437b9d71430a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:17.576512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae56303a-61da-478e-a0f7-437b9d71430a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:17.578130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae56303a-61da-478e-a0f7-437b9d71430a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:17.713489 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae56303a-61da-478e-a0f7-437b9d71430a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192760 Oct 17 15:37:17.718150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:17.720118 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1822/3402] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:37:17 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:17.726220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7968eae0-006c-4c27-af81-b4a94c371080 req-543f2702-5b38-49b2-b173-c7f79929fa14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5bd75eb-4c68-4e49-8276-dc76c5d09d01", "tag": "78fdf66f-958a-4ebb-8391-c05f8eef6e51"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:17.727574 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36b4c7b9-824e-4697-8901-1ccdc9cfc71a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 1.301314 Oct 17 15:37:17.728181 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1581/3403] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:16 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:17.744968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:17.758376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:17.775628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:17.778915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7968eae0-006c-4c27-af81-b4a94c371080 req-543f2702-5b38-49b2-b173-c7f79929fa14 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:17.781527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7968eae0-006c-4c27-af81-b4a94c371080 req-543f2702-5b38-49b2-b173-c7f79929fa14 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:17.784254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7968eae0-006c-4c27-af81-b4a94c371080 req-543f2702-5b38-49b2-b173-c7f79929fa14 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:17.789283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:17.789879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:17.790688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:17.791162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:17.797383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:17.813544 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7968eae0-006c-4c27-af81-b4a94c371080 req-543f2702-5b38-49b2-b173-c7f79929fa14 service nova] Creating event network-changed:78fdf66f-958a-4ebb-8391-c05f8eef6e51 for instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 on n-h1-854441-12 Oct 17 15:37:17.820329 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7968eae0-006c-4c27-af81-b4a94c371080 req-543f2702-5b38-49b2-b173-c7f79929fa14 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098157 Oct 17 15:37:17.821706 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1823/3404] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:17.828147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:17.829244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:17.837715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:17.838565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:17.839342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:17.840328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:17.840972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:17.841624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:17.880888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:37:17.897687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:18.036297 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4f90daf-526c-4320-8e46-958190432e80 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 204 len: 0 microversion: 2.1 time: 0.212246 Oct 17 15:37:18.037958 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1824/3405] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:37:17 2022] DELETE /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:37:18.093283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:18.097101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:18.161060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:18.164631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:18.166316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:18.168272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:18.169636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:18.170281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:18.687242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:18.705525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-396c1e00-4e89-49aa-aa48-074b73711d11 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1516 microversion: 2.1 time: 0.966641 Oct 17 15:37:18.706140 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1582/3406] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:17 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1516 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:18.727937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23fc9327-957d-4e83-bd6a-1a768b2939ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:18.733886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23fc9327-957d-4e83-bd6a-1a768b2939ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:18.772907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23fc9327-957d-4e83-bd6a-1a768b2939ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:18.773531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23fc9327-957d-4e83-bd6a-1a768b2939ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:18.774051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23fc9327-957d-4e83-bd6a-1a768b2939ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:18.775120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23fc9327-957d-4e83-bd6a-1a768b2939ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:18.775818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23fc9327-957d-4e83-bd6a-1a768b2939ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:18.776475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23fc9327-957d-4e83-bd6a-1a768b2939ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:18.886531 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23fc9327-957d-4e83-bd6a-1a768b2939ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162714 Oct 17 15:37:18.893528 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1583/3407] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:37:18 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:37:18.919545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:18.926423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:18.943118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:18.951549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:18.952217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:18.953315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:18.962896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:18.965361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:18.966222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:19.067532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lazy-loading 'flavor' on Instance uuid 52f0fd6d-17f3-412d-9bb7-b40d8272d982 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:37:19.296394 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e361759a-fe45-457b-b605-1b94b5ce95bf tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982/action" status: 200 len: 32 microversion: 2.1 time: 0.390855 Oct 17 15:37:19.297039 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1584/3408] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:37:18 2022] POST /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982/action => generated 32 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:19.321188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:19.324535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:19.341076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:19.341701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:19.342015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:19.342772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:19.347598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:19.348079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:19.358489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:19.676997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:19.700244 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9abd1a3e-d734-4a81-8d05-adb6918942a4 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1473 microversion: 2.1 time: 1.652945 Oct 17 15:37:19.703851 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1825/3409] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:18 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1473 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:19.720414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:19.732824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:19.748194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:19.748703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:19.749147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:19.749884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:19.750344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:19.750804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:20.418492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:20.444550 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-09e66d58-7440-4f43-8fde-e54be4282866 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 1.139296 Oct 17 15:37:20.445892 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1585/3410] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:19 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:20.472382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6e181710-4819-465b-a2ce-0cd8db0e4ec9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:20.477282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6e181710-4819-465b-a2ce-0cd8db0e4ec9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:20.501448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:20.510900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e181710-4819-465b-a2ce-0cd8db0e4ec9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:20.511411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e181710-4819-465b-a2ce-0cd8db0e4ec9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:20.511868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e181710-4819-465b-a2ce-0cd8db0e4ec9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:20.512591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e181710-4819-465b-a2ce-0cd8db0e4ec9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:20.526436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e181710-4819-465b-a2ce-0cd8db0e4ec9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:20.527052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e181710-4819-465b-a2ce-0cd8db0e4ec9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:20.622271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:20.648308 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a711a2f-d47e-483d-9da6-be5517c44fe1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.943069 Oct 17 15:37:20.656350 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1826/3411] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:19 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:20.683491 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6e181710-4819-465b-a2ce-0cd8db0e4ec9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.230369 Oct 17 15:37:20.684809 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1586/3412] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:37:20 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:20.731729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:20.732576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:20.748519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:20.749428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:20.750094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:20.751120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:20.752563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:20.763189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:21.469647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:21.471883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:21.495747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:21.496266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:21.496717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:21.503421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:21.503973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:21.504441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:21.684173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:21.695780 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c81bd6d-3b2d-4046-9a22-6c3f0c5d3cc5 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1473 microversion: 2.1 time: 0.969527 Oct 17 15:37:21.696559 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1827/3413] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:20 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1473 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:21.713212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:21.714031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:21.728484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:21.729457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:21.729999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:21.733783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:21.743255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:21.745531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:22.393947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:22.405581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-758f6257-5ce4-40be-a225-48a94d078bf3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.705926 Oct 17 15:37:22.410216 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1828/3414] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:21 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:22.433611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-782770e2-fd1f-4d06-ad6c-5cef3b7d53ec tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:22.437226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-782770e2-fd1f-4d06-ad6c-5cef3b7d53ec tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:22.454128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-782770e2-fd1f-4d06-ad6c-5cef3b7d53ec tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:22.460435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-782770e2-fd1f-4d06-ad6c-5cef3b7d53ec tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:22.461286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-782770e2-fd1f-4d06-ad6c-5cef3b7d53ec tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:22.462445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-782770e2-fd1f-4d06-ad6c-5cef3b7d53ec tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:22.463217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-782770e2-fd1f-4d06-ad6c-5cef3b7d53ec tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:22.463881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-782770e2-fd1f-4d06-ad6c-5cef3b7d53ec tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:22.550092 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-782770e2-fd1f-4d06-ad6c-5cef3b7d53ec tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133834 Oct 17 15:37:22.552654 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1829/3415] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:37:22 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:22.754342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:22.755336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:22.774545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:22.775352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:22.779177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:22.780162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:22.784112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:22.784812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:23.189275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:23.198363 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-680ad343-4295-42eb-b6d5-80d07a915213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1431 microversion: 2.1 time: 0.448156 Oct 17 15:37:23.207860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1830/3416] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:22 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1431 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:37:23.283646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5df22590-8feb-4ced-8a9a-5bbe66a8a0a3 req-fcba1a25-4ecf-42f6-8ac9-72746602a9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43cdafe-be87-49e3-be6d-d64b0f3b45f4", "name": "network-vif-deleted", "tag": "2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:23.325460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5df22590-8feb-4ced-8a9a-5bbe66a8a0a3 req-fcba1a25-4ecf-42f6-8ac9-72746602a9a2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:23.326910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5df22590-8feb-4ced-8a9a-5bbe66a8a0a3 req-fcba1a25-4ecf-42f6-8ac9-72746602a9a2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:23.327958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5df22590-8feb-4ced-8a9a-5bbe66a8a0a3 req-fcba1a25-4ecf-42f6-8ac9-72746602a9a2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:23.374798 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5df22590-8feb-4ced-8a9a-5bbe66a8a0a3 req-fcba1a25-4ecf-42f6-8ac9-72746602a9a2 service nova] Creating event network-vif-deleted:2a0f0ff5-3051-4d76-9cdd-3ddfd589eb43 for instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 on n-h2-854441-12 Oct 17 15:37:23.415987 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5df22590-8feb-4ced-8a9a-5bbe66a8a0a3 req-fcba1a25-4ecf-42f6-8ac9-72746602a9a2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139704 Oct 17 15:37:23.424891 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1831/3417] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:23.495609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:23.497276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:23.514590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:23.515511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:23.518981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:23.520050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:23.520572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:23.524654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:23.924844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:23.944684 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5cd046e6-57b1-482c-ac0b-33435d99f0ee tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 2.479088 Oct 17 15:37:23.951386 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1587/3418] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:21 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 2486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:23.956960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99c40a14-b23b-4475-b674-a707a9db0c1b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:23.976694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-99c40a14-b23b-4475-b674-a707a9db0c1b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:24.002822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99c40a14-b23b-4475-b674-a707a9db0c1b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:24.004902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99c40a14-b23b-4475-b674-a707a9db0c1b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:24.006000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99c40a14-b23b-4475-b674-a707a9db0c1b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:24.007311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99c40a14-b23b-4475-b674-a707a9db0c1b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:24.012190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99c40a14-b23b-4475-b674-a707a9db0c1b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:24.012877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99c40a14-b23b-4475-b674-a707a9db0c1b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:24.100727 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99c40a14-b23b-4475-b674-a707a9db0c1b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146255 Oct 17 15:37:24.101687 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1588/3419] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:37:23 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:24.233271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:24.233892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:24.245510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:24.246470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:24.253513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:24.254634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:24.255282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:24.255886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:24.332485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:24.332988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:24.337712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:24.338663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lazy-loading 'fault' on Instance uuid f43cdafe-be87-49e3-be6d-d64b0f3b45f4 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:37:24.424485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:24.453943 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8658651f-6817-49cd-b2a7-b667c7b9ff33 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.991486 Oct 17 15:37:24.459208 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1832/3420] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:23 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:24.808330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:24.820934 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c3d6a490-063a-4910-a6eb-0b62689ef9fe tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 200 len: 1307 microversion: 2.1 time: 0.592288 Oct 17 15:37:24.822362 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1589/3421] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:24 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 1307 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:24.977461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:24.978871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:25.017264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:25.021484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:25.025762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:25.030175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:25.031457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:25.036237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:25.124605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-17cffaee-95a8-484f-b7d0-7ad1cb7ab92b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:25.145844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-17cffaee-95a8-484f-b7d0-7ad1cb7ab92b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:25.178628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17cffaee-95a8-484f-b7d0-7ad1cb7ab92b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:25.179563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17cffaee-95a8-484f-b7d0-7ad1cb7ab92b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:25.182919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17cffaee-95a8-484f-b7d0-7ad1cb7ab92b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:25.183968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17cffaee-95a8-484f-b7d0-7ad1cb7ab92b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:25.184620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17cffaee-95a8-484f-b7d0-7ad1cb7ab92b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:25.187106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17cffaee-95a8-484f-b7d0-7ad1cb7ab92b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:25.343031 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-17cffaee-95a8-484f-b7d0-7ad1cb7ab92b tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.225775 Oct 17 15:37:25.367018 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1590/3422] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:37:25 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950/os-volume_attachments => generated 25 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:37:25.486875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:25.493940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:25.571029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:25.582189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:25.588435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:25.589215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:25.590927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:25.591397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:25.592177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:25.599959 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-118d848d-b489-4acd-b5f7-bd1d5d19b598 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 0.629803 Oct 17 15:37:25.602273 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1833/3423] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:24 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:25.847339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:25.847861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: f43cdafe-be87-49e3-be6d-d64b0f3b45f4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:25.865848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:25.866362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:25.885215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:25.886065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:25.897774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:25.898342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:25.973867 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] HTTP exception thrown: Instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 could not be found. Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Request method failure captured: Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 HTTP/1.1 Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXXzxya9LiQJiRD5kT818fXwPxFupQec7Etecdout8oPc1icFniOlKGGu8M__hvrJPy5LyfpMPW0pxVICI1g57huQxDGtpzBG3QF02N0mzCEtLJ107bGOy7d4Ox63MYTuvg1ll9qRr6crcDGgdthz3-xgc7bYnwCOtoKxGgleNLppLQ Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 84785781b05d481f84a9c3106647123e Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ListImageFiltersTestJSON-1557690222 Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/84785781b05d481f84a9c3106647123e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/84785781b05d481f84a9c3106647123e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_84785781b05d481f84a9c3106647123e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/84785781b05d481f84a9c3106647123e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ListImageFiltersTestJSON-1557690222 Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 84785781b05d481f84a9c3106647123e Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1557690222 Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ListImageFiltersTestJSON-1557690222-project Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 760daef1285a42ce8b52668549f9d7e9 Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ListImageFiltersTestJSON-1557690222-project Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 could not be found. Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'f43cdafe-be87-49e3-be6d-d64b0f3b45f4'} Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 could not be found. Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 could not be found. Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:25.975664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:25.981944 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:25.981944 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:25.981944 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:25.981944 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:37:25.981944 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:37:25.981944 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 could not be found. Oct 17 15:37:25.981944 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:25.987117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Returning 404 to user: Instance f43cdafe-be87-49e3-be6d-d64b0f3b45f4 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:25.988383 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d523486-12b9-40d0-a41c-af8d9fb698f9 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4" status: 404 len: 111 microversion: 2.1 time: 0.145258 Oct 17 15:37:25.996146 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1834/3424] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:25 2022] GET /compute/v2.1/servers/f43cdafe-be87-49e3-be6d-d64b0f3b45f4 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:37:26.001315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:26.001841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:26.030202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:26.038069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:26.038880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:26.039834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:26.043725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:26.048557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:26.168594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:37:26.183632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:26.205766 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-88163629-8905-40f8-b3b1-7a32eb161ea4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.727822 Oct 17 15:37:26.206474 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1591/3425] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:25 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:37:26.242763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1703737898", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "b12d676c-c73e-4753-981d-9ad4331d0511"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:26.390930 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28d838fd-cc57-46b9-af03-ba3c01c14ce0 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "DELETE /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 204 len: 0 microversion: 2.1 time: 0.393321 Oct 17 15:37:26.392438 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1835/3426] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:37:25 2022] DELETE /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:37:26.400486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:26.408854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] validate_networks() for [('b12d676c-c73e-4753-981d-9ad4331d0511', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:37:26.410320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:26.420474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:26.422639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:26.423309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:26.427427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:26.428225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:26.428883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:27.392281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:27.408888 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4ee0250-13dd-4fb5-8531-845085680dd7 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 200 len: 1474 microversion: 2.1 time: 1.005952 Oct 17 15:37:27.423419 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1836/3427] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:26 2022] GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 1474 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:27.436080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:27.436994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:27.455384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:27.456208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:27.456861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:27.457796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:27.458434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:27.459047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:27.522683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:37:27.523244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:37:27.523600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:37:27.524017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:37:27.524434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:37:27.557471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:27.562230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:27.566178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:27.567668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:27.572315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:27.573167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:27.628764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Getting quotas for project 2455cda838ea4befb6a3702d07b7b1ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:27.644311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Getting quotas for user 1a75d59cdb6f45df9fc90e515601a4be and project 2455cda838ea4befb6a3702d07b7b1ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:27.688074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:37:27.690959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:37:27.887095 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-acbc8495-44c2-4185-a671-40b78261bffc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667459 Oct 17 15:37:27.892506 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1592/3428] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:37:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:37:27.898640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:27.909480 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-269dfe7a-3ffc-412c-b4f7-0c6a93e69af5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 0.484390 Oct 17 15:37:27.913771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:27.914720 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1837/3429] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:27 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:27.915980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:27.946850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:27.947798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34d5ad4a-6eac-4153-8fbb-6512a755a263 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:27.947947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:27.948643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:27.953714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34d5ad4a-6eac-4153-8fbb-6512a755a263 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:27.954133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:27.957192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:27.958030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:28.392128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:28.403666 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-891e91af-38f9-4637-bc97-cba5e3d5619c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.507469 Oct 17 15:37:28.404588 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1593/3430] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:27 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:28.409847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2e8b10e4-8020-4ff2-8d8f-06e7bcb4aeb7 req-4b5d9aff-ecbb-41c6-9b57-95d718ca7156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bd75eb-4c68-4e49-8276-dc76c5d09d01", "name": "network-vif-plugged", "status": "completed", "tag": "78fdf66f-958a-4ebb-8391-c05f8eef6e51"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:28.428963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2e8b10e4-8020-4ff2-8d8f-06e7bcb4aeb7 req-4b5d9aff-ecbb-41c6-9b57-95d718ca7156 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:28.430360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2e8b10e4-8020-4ff2-8d8f-06e7bcb4aeb7 req-4b5d9aff-ecbb-41c6-9b57-95d718ca7156 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:28.431350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2e8b10e4-8020-4ff2-8d8f-06e7bcb4aeb7 req-4b5d9aff-ecbb-41c6-9b57-95d718ca7156 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:28.462889 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2e8b10e4-8020-4ff2-8d8f-06e7bcb4aeb7 req-4b5d9aff-ecbb-41c6-9b57-95d718ca7156 service nova] Creating event network-vif-plugged:78fdf66f-958a-4ebb-8391-c05f8eef6e51 for instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 on n-h1-854441-12 Oct 17 15:37:28.471795 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2e8b10e4-8020-4ff2-8d8f-06e7bcb4aeb7 req-4b5d9aff-ecbb-41c6-9b57-95d718ca7156 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063652 Oct 17 15:37:28.483994 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1594/3431] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:28.502328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:28.511915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:28.542207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:28.551896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:28.555453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:28.557415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:28.571011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:28.571704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:29.200460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34d5ad4a-6eac-4153-8fbb-6512a755a263 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:29.220169 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34d5ad4a-6eac-4153-8fbb-6512a755a263 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1218 microversion: 2.1 time: 1.301986 Oct 17 15:37:29.227946 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1838/3432] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:27 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1218 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:29.246568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:29.254102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:29.282786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:29.286784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:29.293499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:29.298993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:29.303776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:29.304696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:29.722649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:29.791093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d50e760b-2c4a-49f9-957e-9ccb64d994ba tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 200 len: 1474 microversion: 2.1 time: 1.303595 Oct 17 15:37:29.797667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:29.811082 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1595/3433] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:28 2022] GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 1474 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:29.835072 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-781396b2-691d-43ab-a918-d36e5408a92d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 0.596110 Oct 17 15:37:29.839181 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1839/3434] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:29 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:29.864722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:29.869512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:29.936653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:29.937851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:29.939051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:29.951563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:29.954066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:29.956818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:30.248305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:30.250271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:30.270041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:30.286608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:30.289461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:30.292022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:30.295837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:30.299077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:30.650746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:30.660413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:30.677303 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-278a0a19-55dd-4502-a6e5-fdf2449ea686 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1214 microversion: 2.1 time: 0.433212 Oct 17 15:37:30.693067 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1840/3435] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:30 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1214 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:37:30.838492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:30.839948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:30.855047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:30.856076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:30.856713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:30.858330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:30.859106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:30.859702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:31.387395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:31.449212 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-de7bbbd9-da6e-4cd1-8ea3-8829e3efee43 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 1.633381 Oct 17 15:37:31.451192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1596/3436] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:29 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:31.462130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:31.464042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:31.477736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:31.479289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:31.480462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:31.482203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:31.483431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:31.485268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:32.035061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:32.086185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-921e6c01-7836-455c-b2f9-eb658eb0c742 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 0.632753 Oct 17 15:37:32.088102 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1597/3437] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:31 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:32.122548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-33fddd35-6c6a-4da0-b61d-b28d04ca712e req-e85f451c-0446-4134-bd02-4f0f9e73866b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe71f2c-d675-4eea-b163-bfde7044748c", "name": "network-vif-plugged", "status": "completed", "tag": "cf177eb8-02ed-4072-a83e-13a1cbfa5a85"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:32.161254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-33fddd35-6c6a-4da0-b61d-b28d04ca712e req-e85f451c-0446-4134-bd02-4f0f9e73866b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:32.170544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-33fddd35-6c6a-4da0-b61d-b28d04ca712e req-e85f451c-0446-4134-bd02-4f0f9e73866b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:32.171497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-33fddd35-6c6a-4da0-b61d-b28d04ca712e req-e85f451c-0446-4134-bd02-4f0f9e73866b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:32.232047 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-33fddd35-6c6a-4da0-b61d-b28d04ca712e req-e85f451c-0446-4134-bd02-4f0f9e73866b service nova] Creating event network-vif-plugged:cf177eb8-02ed-4072-a83e-13a1cbfa5a85 for instance 9fe71f2c-d675-4eea-b163-bfde7044748c on n-h1-854441-12 Oct 17 15:37:32.263144 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-33fddd35-6c6a-4da0-b61d-b28d04ca712e req-e85f451c-0446-4134-bd02-4f0f9e73866b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172961 Oct 17 15:37:32.274176 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1598/3438] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:32.311300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ebb3f332-83d3-4c36-8436-77e3aed2b841 req-20b983fd-5588-4207-b060-ee5ecf0c3fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa21afee-1c0c-49b3-b91c-bf7fa5438381", "name": "network-vif-deleted", "tag": "8a3944bf-786e-467e-8893-ff95b6e28ff0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:32.340824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ebb3f332-83d3-4c36-8436-77e3aed2b841 req-20b983fd-5588-4207-b060-ee5ecf0c3fa3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:32.341687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ebb3f332-83d3-4c36-8436-77e3aed2b841 req-20b983fd-5588-4207-b060-ee5ecf0c3fa3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:32.342480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ebb3f332-83d3-4c36-8436-77e3aed2b841 req-20b983fd-5588-4207-b060-ee5ecf0c3fa3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:32.410074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760daef1285a42ce8b52668549f9d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84785781b05d481f84a9c3106647123e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:32.415247 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ebb3f332-83d3-4c36-8436-77e3aed2b841 req-20b983fd-5588-4207-b060-ee5ecf0c3fa3 service nova] Creating event network-vif-deleted:8a3944bf-786e-467e-8893-ff95b6e28ff0 for instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 on n-h2-854441-12 Oct 17 15:37:32.422966 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad4fb572-6400-412c-be48-1a9e3e1d92a8 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 200 len: 1474 microversion: 2.1 time: 1.588867 Oct 17 15:37:32.451104 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1841/3439] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:30 2022] GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 1474 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:37:32.456498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:32.457430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:32.460876 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ebb3f332-83d3-4c36-8436-77e3aed2b841 req-20b983fd-5588-4207-b060-ee5ecf0c3fa3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183775 Oct 17 15:37:32.465663 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1599/3440] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:32.476610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:32.477118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:32.477569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:32.478293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:32.478778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:32.479391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:32.501691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:32.502424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:32.527247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:32.528268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:32.530899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:32.533808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:32.536931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:32.543290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:32.904576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:32.930533 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0931bc65-7a82-4590-b1ba-564e44b1b717 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1276 microversion: 2.1 time: 0.477699 Oct 17 15:37:32.937045 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1842/3441] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:32 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1276 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:33.117339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:33.118791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:33.136167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:33.137500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:33.141248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:33.142306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:33.143100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:33.144051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:33.240129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:33.252678 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2e5cd8f2-c67f-4750-b927-92bda57a25ef tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.763596 Oct 17 15:37:33.254918 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1600/3442] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:32 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:33.452385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:33.457088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] [instance: aa21afee-1c0c-49b3-b91c-bf7fa5438381] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:33.475454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:33.475965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:33.476417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:33.487970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:33.488570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:33.491951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:33.570653 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] HTTP exception thrown: Instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 could not be found. Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Request method failure captured: Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 HTTP/1.1 Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXXzxya9LiQJiRD5kT818fXwPxFupQec7Etecdout8oPc1icFniOlKGGu8M__hvrJPy5LyfpMPW0pxVICI1g57huQxDGtpzBG3QF02N0mzCEtLJ107bGOy7d4Ox63MYTuvg1ll9qRr6crcDGgdthz3-xgc7bYnwCOtoKxGgleNLppLQ Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 84785781b05d481f84a9c3106647123e Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ListImageFiltersTestJSON-1557690222 Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/84785781b05d481f84a9c3106647123e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/84785781b05d481f84a9c3106647123e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_84785781b05d481f84a9c3106647123e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/84785781b05d481f84a9c3106647123e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ListImageFiltersTestJSON-1557690222 Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 84785781b05d481f84a9c3106647123e Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1557690222 Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ListImageFiltersTestJSON-1557690222-project Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 760daef1285a42ce8b52668549f9d7e9 Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ListImageFiltersTestJSON-1557690222-project Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 could not be found. Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'aa21afee-1c0c-49b3-b91c-bf7fa5438381'} Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 could not be found. Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 could not be found. Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:33.577408 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:33.582127 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:33.582127 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:33.582127 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:33.582127 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:37:33.582127 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:37:33.582127 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 could not be found. Oct 17 15:37:33.582127 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:33.585221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Returning 404 to user: Instance aa21afee-1c0c-49b3-b91c-bf7fa5438381 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:33.589890 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7fb715bf-3701-4466-9ec8-1827fc147227 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381" status: 404 len: 111 microversion: 2.1 time: 0.143632 Oct 17 15:37:33.596786 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1601/3443] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:33 2022] GET /compute/v2.1/servers/aa21afee-1c0c-49b3-b91c-bf7fa5438381 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:37:33.621932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f53966e-2f56-4a68-b698-1d3dec96a813 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bf11eb80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:34.675762 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f53966e-2f56-4a68-b698-1d3dec96a813 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "DELETE /compute/v2.1/images/f54f171b-f57b-422f-b1a3-e10e7ddc04ad" status: 204 len: 0 microversion: 2.1 time: 1.073855 Oct 17 15:37:34.685534 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1602/3444] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:33 2022] DELETE /compute/v2.1/images/f54f171b-f57b-422f-b1a3-e10e7ddc04ad => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:37:34.735346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:34.737034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:34.782436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:34.787599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:34.788861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:34.790782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:34.792185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:34.793244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:34.817468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:34.893349 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8095493-387d-4885-8a2e-44a192a2a43c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1314 microversion: 2.1 time: 1.783860 Oct 17 15:37:34.900870 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1843/3445] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:33 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1314 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:34.934446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:34.935725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:35.011379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:35.019029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:35.025261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:35.035484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:35.039257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:35.041602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:35.448754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:35.475802 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1b7cb4de-e648-4fde-ba03-5614185f5ed4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 0.788137 Oct 17 15:37:35.476891 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1603/3446] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:34 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:35.521889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b7972ec-fc1d-4148-9c9f-db3498560d4c tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28bea4b820>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:36.169914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b7972ec-fc1d-4148-9c9f-db3498560d4c tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "DELETE /compute/v2.1/images/b7f4e6f8-bcea-4c42-8998-b605a3217ebd" status: 204 len: 0 microversion: 2.1 time: 0.675187 Oct 17 15:37:36.171667 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1604/3447] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:35 2022] DELETE /compute/v2.1/images/b7f4e6f8-bcea-4c42-8998-b605a3217ebd => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:37:36.178612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:36.180060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:36.207865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:36.209939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:36.210700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:36.212007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:36.216747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:36.218326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:36.273670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:36.339583 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4cde7d11-5167-499a-8982-04067a3aa4db tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 1.436806 Oct 17 15:37:36.342432 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1844/3448] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:34 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:36.358883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf8d8e3f-d8bd-48e7-8d1f-36b6b779b213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] Calling method '.version_select at 0x7f28be993a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:36.514813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:36.530140 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-69dd2c72-a4bf-4ac7-ad6d-c5891b95df9b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1464 microversion: 2.1 time: 0.356965 Oct 17 15:37:36.533509 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1605/3449] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:36 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1464 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:36.543467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:36.548131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:36.562092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:36.563912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:36.564614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:36.566183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:36.567162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:36.567840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:36.867797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:36.872527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:36.884019 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99aef9a1-246f-4842-b449-43a12e19acb1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 0.346997 Oct 17 15:37:36.884844 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1606/3450] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:36 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:36.900854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:36.903981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:36.932771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:36.933672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:36.934445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:36.935782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:36.936816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:36.937796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:37.150228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf8d8e3f-d8bd-48e7-8d1f-36b6b779b213 tempest-ListImageFiltersTestJSON-1557690222 tempest-ListImageFiltersTestJSON-1557690222-project] 10.222.0.87 "DELETE /compute/v2.1/images/0ceef9d3-6c43-4b2a-905c-522c6c9e6d20" status: 204 len: 0 microversion: 2.1 time: 0.801311 Oct 17 15:37:37.154713 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1845/3451] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:36 2022] DELETE /compute/v2.1/images/0ceef9d3-6c43-4b2a-905c-522c6c9e6d20 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:37:37.305248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:37.328823 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-004b841b-79f9-462b-8cda-ee53fde8e6af tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1462 microversion: 2.1 time: 0.440344 Oct 17 15:37:37.346868 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1607/3452] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:36 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1462 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:37.383949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:37.388572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:37.393870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:37.402462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:37.403372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:37.404320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:37.405565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:37.409746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:37.413009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:37.739738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1002300344", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a5bd75eb-4c68-4e49-8276-dc76c5d09d01"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:37.812406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:37.813855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:37.953984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:37.954344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:37:37.969790 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb2f838d-b643-4b30-b766-1b72b2543001 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.591800 Oct 17 15:37:37.972389 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1846/3453] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:37 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:37.984160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:37.985164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:37.996818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:37.997592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:37.998219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:38.001035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:38.001782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:38.002373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:38.699502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:37:38.700134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:37:38.700663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:37:38.701890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:37:38.702454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:37:38.730664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:38.731341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:38.731898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:38.732831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:38.734576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:38.734576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:38.758407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Getting quotas for project 3e312b32190a41ee84947b87f0f75026. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:38.765574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Getting quotas for user addc1f19b42f47d199887d51c196012a and project 3e312b32190a41ee84947b87f0f75026. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:38.797478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:37:38.806754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:37:38.916070 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f6c98919-f54f-4663-b601-56e5700d679e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183585 Oct 17 15:37:38.917946 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1608/3454] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:37:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:37:39.194955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:39.241422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f6cb293-d3a8-4bc7-aaeb-3b998f2e7742 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Action: 'create', calling method: .version_select at 0x7f28bf1f8b80>, body: {"keypair": {"name": "tempest-keypair-631784103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBebhImsO7KCncSCklT/wlMxK7k9qZMb4XwWjSK/f7qtcTMYyY/n3EsErv0gZb5LniMqsrkay1/hYKr6q3jVT+tzwm3E1mgQZrB67xjcoI86ME/YED7td6Ay5U/ZZT+6WQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:39.248520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:39.314899 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d17235b0-eaf6-4c9b-b29c-d54b020f5143 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 1.334675 Oct 17 15:37:39.347602 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1847/3455] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:37 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:39.398470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:39.399684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:39.431092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:39.440109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8f6cb293-d3a8-4bc7-aaeb-3b998f2e7742 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Getting quotas for project 984609b6197c4e03bbec26cfd3df0a9b. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:39.443262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:39.444284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:39.447814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:39.451809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:39.452670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:39.497152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8f6cb293-d3a8-4bc7-aaeb-3b998f2e7742 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Getting quotas for user 4401a49e458149b7b6885663d488d2cc and project 984609b6197c4e03bbec26cfd3df0a9b. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:39.583794 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f6cb293-d3a8-4bc7-aaeb-3b998f2e7742 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.663312 Oct 17 15:37:39.585914 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1609/3456] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:37:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:39.611995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a48ba55-1be1-4d0d-bc22-07a13ea6ff4d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:39.613647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a48ba55-1be1-4d0d-bc22-07a13ea6ff4d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:39.811883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1a48ba55-1be1-4d0d-bc22-07a13ea6ff4d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:39.853950 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a48ba55-1be1-4d0d-bc22-07a13ea6ff4d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1214 microversion: 2.1 time: 0.259909 Oct 17 15:37:39.869950 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1610/3457] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:39 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:39.903599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:39.904823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:39.919406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:39.933247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:39.936683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:39.939581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:39.946163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:39.947866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:40.639658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:40.674900 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac12f6ab-90e8-4c19-9528-7c868caecc48 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.306032 Oct 17 15:37:40.694854 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1848/3458] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:39 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:40.711257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bd59a059-924c-4e4f-a852-70be06392cd8 req-c37f9b35-2322-4065-95b9-7c9983b53d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd14a0a-9efd-4417-9e37-147e3721bf15", "tag": "cf1b76f6-fa42-4e61-bd1e-9c9a3d09ed43"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:40.776027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bd59a059-924c-4e4f-a852-70be06392cd8 req-c37f9b35-2322-4065-95b9-7c9983b53d27 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:40.776027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bd59a059-924c-4e4f-a852-70be06392cd8 req-c37f9b35-2322-4065-95b9-7c9983b53d27 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:40.781141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bd59a059-924c-4e4f-a852-70be06392cd8 req-c37f9b35-2322-4065-95b9-7c9983b53d27 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:40.785662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:40.797890 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b9d5166f-dac7-4796-9152-d57df886de5b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.914965 Oct 17 15:37:40.815495 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1611/3459] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:39 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:40.827874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:40.830697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:40.849706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:40.850615 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bd59a059-924c-4e4f-a852-70be06392cd8 req-c37f9b35-2322-4065-95b9-7c9983b53d27 service nova] Creating event network-changed:cf1b76f6-fa42-4e61-bd1e-9c9a3d09ed43 for instance edd14a0a-9efd-4417-9e37-147e3721bf15 on n-h2-854441-12 Oct 17 15:37:40.852570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:40.853293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:40.857994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:40.858880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:40.860027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:40.874046 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bd59a059-924c-4e4f-a852-70be06392cd8 req-c37f9b35-2322-4065-95b9-7c9983b53d27 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182114 Oct 17 15:37:40.880897 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1849/3460] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:40.910138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df2595d4-8ca3-4fec-9816-e15663aa5262 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-655722881"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:40.916679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df2595d4-8ca3-4fec-9816-e15663aa5262 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:40.941824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df2595d4-8ca3-4fec-9816-e15663aa5262 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:40.942329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df2595d4-8ca3-4fec-9816-e15663aa5262 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:40.942836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df2595d4-8ca3-4fec-9816-e15663aa5262 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:40.943573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df2595d4-8ca3-4fec-9816-e15663aa5262 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:40.944033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df2595d4-8ca3-4fec-9816-e15663aa5262 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:40.944542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df2595d4-8ca3-4fec-9816-e15663aa5262 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:41.218147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:41.231075 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22a3ae9a-3049-4d9b-9ef6-d207c220891c tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 0.413900 Oct 17 15:37:41.232182 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1612/3461] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:40 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:41.675993 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df2595d4-8ca3-4fec-9816-e15663aa5262 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.789122 Oct 17 15:37:41.682000 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1850/3462] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:37:40 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 15:37:41.714689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:41.715602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:41.739254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:41.741585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:41.743410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:41.746565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:41.751236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:41.753822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:41.943966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:41.958646 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8c2a787-a45a-4155-b27e-bb68534aaf5a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1266 microversion: 2.1 time: 0.273665 Oct 17 15:37:41.959378 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1851/3463] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:41 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:41.983998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-58b6aca0-b8cb-4fb6-ae0b-d6793de03b59 req-f7e77aa4-b5fd-44f3-b9bb-210d7468fbfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "name": "network-vif-unplugged", "status": "completed", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:42.033989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-58b6aca0-b8cb-4fb6-ae0b-d6793de03b59 req-f7e77aa4-b5fd-44f3-b9bb-210d7468fbfe service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:42.035684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-58b6aca0-b8cb-4fb6-ae0b-d6793de03b59 req-f7e77aa4-b5fd-44f3-b9bb-210d7468fbfe service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:42.036139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-58b6aca0-b8cb-4fb6-ae0b-d6793de03b59 req-f7e77aa4-b5fd-44f3-b9bb-210d7468fbfe service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:42.096128 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-58b6aca0-b8cb-4fb6-ae0b-d6793de03b59 req-f7e77aa4-b5fd-44f3-b9bb-210d7468fbfe service nova] Creating event network-vif-unplugged:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:37:42.126253 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-58b6aca0-b8cb-4fb6-ae0b-d6793de03b59 req-f7e77aa4-b5fd-44f3-b9bb-210d7468fbfe service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161925 Oct 17 15:37:42.128160 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1852/3464] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:42.145365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:42.146449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:42.185517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:42.187121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:42.188625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:42.190064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-377745604", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:42.191888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:42.194334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:42.195515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:42.357861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] validate_networks() for [('983d2c13-544a-45ae-bf2a-b899ba8809c9', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:37:42.535529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:42.546787 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29d14c1a-53ba-4d45-98b0-dd0900830438 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.415562 Oct 17 15:37:42.548601 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1853/3465] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:42 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:42.554856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:42.555887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:42.565428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:42.566475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:42.568219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:42.571681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:42.572475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:42.573138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:42.920081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:42.964338 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2e8dd15-e39f-45af-90dc-8d163a4588f7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.414256 Oct 17 15:37:42.965506 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1854/3466] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:42 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:43.094202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a77a0659-caeb-4d25-a600-6e4dfb6493ee tempest-ListImagesTestJSON-934373389 tempest-ListImagesTestJSON-934373389-project] Calling method '.version_select at 0x7f28c2f0e700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:43.172741 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a77a0659-caeb-4d25-a600-6e4dfb6493ee tempest-ListImagesTestJSON-934373389 tempest-ListImagesTestJSON-934373389-project] 10.222.0.87 "GET /compute/v2.1/images/c489ef08-d3af-4c49-859b-7a55ed37ba8d" status: 200 len: 784 microversion: 2.1 time: 0.205931 Oct 17 15:37:43.184254 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1855/3467] 10.222.0.87 () {58 vars in 1233 bytes} [Mon Oct 17 15:37:42 2022] GET /compute/v2.1/images/c489ef08-d3af-4c49-859b-7a55ed37ba8d => generated 784 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:43.191108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:43.194161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:43.204686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:43.205298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:43.205825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:43.206758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:43.207973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:43.208657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:43.609809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:43.628864 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f89b1c5e-5f3c-4cb8-8e46-87df33fd87f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 0.443166 Oct 17 15:37:43.634729 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1856/3468] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:43 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:43.647746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:43.661715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:43.692277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:43.697840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:43.698628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:43.700043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:43.705357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:43.708762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:43.992921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:44.016125 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51ac55b1-64ca-48f0-8f3e-e2859ecbeb5e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1272 microversion: 2.1 time: 0.378275 Oct 17 15:37:44.017093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1857/3469] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:43 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1272 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:44.034655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-711c83c7-d340-4518-b74d-9c6613643811 tempest-ListImagesTestJSON-934373389 tempest-ListImagesTestJSON-934373389-project] Calling method '.version_select at 0x7f28bf11ac10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:44.168183 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-711c83c7-d340-4518-b74d-9c6613643811 tempest-ListImagesTestJSON-934373389 tempest-ListImagesTestJSON-934373389-project] 10.222.0.87 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.148714 Oct 17 15:37:44.169447 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1858/3470] 10.222.0.87 () {58 vars in 1122 bytes} [Mon Oct 17 15:37:44 2022] GET /compute/v2.1/images => generated 445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:44.175366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:44.176276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:44.187825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:44.188597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:44.190413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:44.191442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:44.192095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:44.192685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:44.586838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:44.599352 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2d12083-bde1-47c6-a724-37ada55b65cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1687 microversion: 2.1 time: 0.425161 Oct 17 15:37:44.606610 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1859/3471] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:44 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1687 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:44.611290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:44.616947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:44.631559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:44.632724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:44.633218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:44.633990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:44.634466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:44.634931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:44.730601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:45.076485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:45.116978 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8bcc6694-88c4-472f-8c87-fefbba73e825 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.507285 Oct 17 15:37:45.118368 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1860/3472] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:44 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:45.137224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16b87e3a-f66a-4e7b-9bf1-1b6dd0ce276f tempest-ListImagesTestJSON-934373389 tempest-ListImagesTestJSON-934373389-project] Calling method '.version_select at 0x7f28be2bba60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:45.274197 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16b87e3a-f66a-4e7b-9bf1-1b6dd0ce276f tempest-ListImagesTestJSON-934373389 tempest-ListImagesTestJSON-934373389-project] 10.222.0.87 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.153622 Oct 17 15:37:45.281887 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1861/3473] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 15:37:45 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:45.295345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:45.296159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:45.325303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:45.326303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:45.327120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:45.328414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:45.329253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:45.329969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:45.348439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:37:45.350665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:37:45.351521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:37:45.352221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:37:45.363604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:37:45.399872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:45.405527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:45.406170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:45.407383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:45.408073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:45.409350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:45.463563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Getting quotas for project c103cb8ac79d495c8e0358c26554f619. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:45.494545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Getting quotas for user 1cf3fcf647674f03a1d463d9d4dc129a and project c103cb8ac79d495c8e0358c26554f619. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:45.498472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:45.538001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:37:45.560277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:37:45.677576 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b41069e6-93d8-4dde-8880-938a7931d015 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.443611 Oct 17 15:37:45.679318 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1613/3474] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:37:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:37:45.691106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:45.694571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:45.725762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:45.731419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:45.733855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:45.734833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:45.735789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:45.739379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:45.762219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:45.777535 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c07e7b7-8856-411c-b71c-9ed8e4ac1eb8 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 0.490470 Oct 17 15:37:45.778761 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1862/3475] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:45 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:45.786716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:45.788199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:45.797495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:45.798434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:45.799437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:45.800783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:45.801512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:45.806211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:46.308868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:46.322402 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16dd6364-1af7-4a40-b7a8-1baa8538d901 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1687 microversion: 2.1 time: 0.538527 Oct 17 15:37:46.323302 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1863/3476] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:45 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1687 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:46.347308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b4531fa1-6392-42fa-8686-74dd15382b0b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:46.348306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b4531fa1-6392-42fa-8686-74dd15382b0b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:46.583148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4531fa1-6392-42fa-8686-74dd15382b0b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:46.601160 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b4531fa1-6392-42fa-8686-74dd15382b0b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1223 microversion: 2.1 time: 0.271324 Oct 17 15:37:46.603318 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1864/3477] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:46 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1223 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:46.613223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:46.615102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:46.629842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:46.631236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:46.632609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:46.634406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:46.635503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:46.636890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:46.889278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:46.947733 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e57f59e-ac9c-422a-a800-5da1495e816f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1272 microversion: 2.1 time: 1.249397 Oct 17 15:37:46.951077 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1614/3478] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:45 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1272 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:46.986306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:46.991069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:47.053491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:47.054180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:47.054838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:47.062003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:47.062689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:47.068515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:47.105897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:47.121287 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9f6ac0f-4945-433c-bfdc-e5c8ccf2a0bb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.516069 Oct 17 15:37:47.125765 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1865/3479] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:46 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:47.355051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:47.356202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:47.392869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:47.398812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:47.399320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:47.400170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:47.408810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:47.409756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:48.062352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:48.085938 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c52ba177-c911-4c01-9dbf-37111c94afe0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.735494 Oct 17 15:37:48.096053 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1866/3480] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:47 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:37:48.139293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:48.141319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:48.155377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:48.156126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:48.156822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:48.157792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:48.158600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:48.159355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:48.198828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:48.208488 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-732b8476-4ee3-4383-a9e1-64f75a071881 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 1.255399 Oct 17 15:37:48.238081 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1615/3481] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:46 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:48.243636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:48.255501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:48.268926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:48.269890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:48.270661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:48.271676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:48.272372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:48.274029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:48.282625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:48.297778 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74d01432-300f-4d98-8470-554d734816b9 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1275 microversion: 2.1 time: 0.185479 Oct 17 15:37:48.317002 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1867/3482] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:48 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:48.332339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:48.333287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:48.343065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:48.347452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:48.348252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:48.356788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:48.358171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:48.358942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:48.810860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:48.838126 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e42f9c7c-a111-42a7-b422-197ba9e3237d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1522 microversion: 2.1 time: 0.517890 Oct 17 15:37:48.840508 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1868/3483] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:48 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:48.858552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e680a285-194d-4429-aa51-b71e9a6c7d96"}], "security_groups": [{"name": "tempest-securitygroup--136138507"}], "key_name": "tempest-keypair-631784103", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:49.259890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] validate_networks() for [('e680a285-194d-4429-aa51-b71e9a6c7d96', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:37:50.097365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:50.124183 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2adb1c2f-13d1-4c26-80ad-a19c8ff84b39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1314 microversion: 2.1 time: 1.883976 Oct 17 15:37:50.151749 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1616/3484] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:48 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1314 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:50.180445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:50.181931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:50.195757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:50.197081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:50.198758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:50.200199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:50.201319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:50.202356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:51.138842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:51.157606 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a92be904-d351-4a2e-925e-e839065ecfb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.988611 Oct 17 15:37:51.158855 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1617/3485] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:50 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:51.169195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:51.170672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:51.186777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:51.188030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:51.189210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:51.191171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:51.192396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:51.193402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:51.654260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:51.663252 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9ffee3ea-1d01-4a0b-af6d-17426cab67cc tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 0.502261 Oct 17 15:37:51.679769 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1618/3486] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:51 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:51.686032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:51.686988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:51.702896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:51.703713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:51.704346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:51.705249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:51.705948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:51.706596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:51.859448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:51.870281 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d757e48c-25dc-4a26-880f-633e8f16e207 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1281 microversion: 2.1 time: 0.189026 Oct 17 15:37:51.891073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1619/3487] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:51 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1281 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:51.898086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:51.904751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:51.910607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:37:51.913353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:37:51.915115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:37:51.916040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:37:51.916863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:37:51.928344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:51.929207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:51.929860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:51.930894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:51.932435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:51.933117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:51.979161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:51.984379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:51.989686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:51.991772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:51.994706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:51.997061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:52.092144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Getting quotas for project 984609b6197c4e03bbec26cfd3df0a9b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:52.122839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Getting quotas for user 4401a49e458149b7b6885663d488d2cc and project 984609b6197c4e03bbec26cfd3df0a9b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:52.196348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:37:52.207224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:37:52.448771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d7d60208-9769-43e2-92bf-42c3c3396131 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.606266 Oct 17 15:37:52.456834 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1869/3488] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:37:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 3615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:37:52.466302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:52.476049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:52.518200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:52.520585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:52.522916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:52.524408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:52.525407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:52.526776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:52.856848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:52.884482 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-84d62a2b-322e-40d3-a018-167ed595c4a3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1502 microversion: 2.1 time: 0.991578 Oct 17 15:37:52.885505 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1620/3489] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:51 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1502 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:52.899927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:52.912737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:52.956015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:52.964906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:52.971945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:52.988044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:52.990383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:52.992137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:53.698759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:53.750816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dab5dc3c-d082-49d3-bf62-e11b038cf1e1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1314 microversion: 2.1 time: 1.288674 Oct 17 15:37:53.751821 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1870/3490] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:52 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1314 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:53.776193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:53.790450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1295fec-f8f2-4719-98a3-3c2f2d31fbb4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:53.795972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1295fec-f8f2-4719-98a3-3c2f2d31fbb4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:53.804576 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-35783b2e-5164-4c00-808e-d3e4c4c5ebcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.914440 Oct 17 15:37:53.806093 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1621/3491] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:52 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:53.820270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:53.823774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:53.844725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:53.846460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:53.849245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:53.851634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:53.852408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:53.854573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:54.763691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1295fec-f8f2-4719-98a3-3c2f2d31fbb4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:54.781012 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1295fec-f8f2-4719-98a3-3c2f2d31fbb4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1225 microversion: 2.1 time: 1.015177 Oct 17 15:37:54.784149 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1871/3492] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:53 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1225 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:54.819693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:54.833685 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3c7a3187-8503-44b4-a44a-7d60ed4b930d tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 1.025201 Oct 17 15:37:54.839428 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1622/3493] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:53 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:54.845580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:54.857350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:54.868810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:54.869328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:54.869776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:54.872691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:54.873311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:54.873769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:55.134744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:55.144568 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ec2c63bd-34ba-46db-ac5a-c9d17048b8da tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1323 microversion: 2.1 time: 0.303542 Oct 17 15:37:55.145534 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1623/3494] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:54 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:55.252073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6e0beb8-d021-4d88-81da-af13f2ebf2a2 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Action: 'create', calling method: .version_select at 0x7f28c2eb8700>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4TF9DiXJD5onjRCcTEv5t5A/NExXa1JF+qqR4oQX+DlpAjybiUZ8yCgCZN0i847EdVDghrYZ5ZSqdE/pnAdKUtY0BpxhSezJt1FW4QIjCyNbB4ZilPklCt6uwXpLMzYw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6e0beb8-d021-4d88-81da-af13f2ebf2a2 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Request method failure captured: Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 257 Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbQHZff_FtT7iv9xOUlkdYgcGQprJcls3kWJDUDKw7opR5U6OCj69dY09Sy4WVtD_xYSKtXoGQa5jAOJu2_842fForH40ApJiQjuafiyYe9CbEkkK-i0Wc_7dncm_ryBtg5Jc9GqUz1_ZKS4JvkVWbNoAFRSOr4fjPDaWw9ihURdEY Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4TF9DiXJD5onjRCcTEv5t5A/NExXa1JF+qqR4oQX+DlpAjybiUZ8yCgCZN0i847EdVDghrYZ5ZSqdE/pnAdKUtY0BpxhSezJt1FW4QIjCyNbB4ZilPklCt6uwXpLMzYw=="}} Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4TF9DiXJD5onjRCcTEv5t5A/NExXa1JF+qqR4oQX+DlpAjybiUZ8yCgCZN0i847EdVDghrYZ5ZSqdE/pnAdKUtY0BpxhSezJt1FW4QIjCyNbB4ZilPklCt6uwXpLMzYw=='}}} Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 17 15:37:55.261249 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 15:37:55.265421 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:37:55.270439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6e0beb8-d021-4d88-81da-af13f2ebf2a2 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:55.271754 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6e0beb8-d021-4d88-81da-af13f2ebf2a2 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.484953 Oct 17 15:37:55.272453 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1872/3495] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:37:54 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 487 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:37:55.278888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:55.279936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:55.290616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:55.291707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:55.292397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:55.293527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:55.294257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:55.295047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:55.410703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-243fad00-bf83-47d7-a695-af4e4306b3aa req-1e0d602f-7aa6-47a0-9d96-d446fff1c4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "name": "network-vif-plugged", "status": "completed", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:55.433041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-243fad00-bf83-47d7-a695-af4e4306b3aa req-1e0d602f-7aa6-47a0-9d96-d446fff1c4b9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:55.433555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-243fad00-bf83-47d7-a695-af4e4306b3aa req-1e0d602f-7aa6-47a0-9d96-d446fff1c4b9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:55.434032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-243fad00-bf83-47d7-a695-af4e4306b3aa req-1e0d602f-7aa6-47a0-9d96-d446fff1c4b9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:55.466795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:55.473191 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-243fad00-bf83-47d7-a695-af4e4306b3aa req-1e0d602f-7aa6-47a0-9d96-d446fff1c4b9 service nova] Creating event network-vif-plugged:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:37:55.486854 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-243fad00-bf83-47d7-a695-af4e4306b3aa req-1e0d602f-7aa6-47a0-9d96-d446fff1c4b9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.339713 Oct 17 15:37:55.487600 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1624/3496] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:55.506221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-32203dda-7653-4c8a-b816-ded8ead0dd2b req-09304a28-3586-4a81-acb2-a69e52d13530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c", "tag": "25a9919e-b581-48d8-bce0-fd4089193597"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:55.537064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=18 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:55.541056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-32203dda-7653-4c8a-b816-ded8ead0dd2b req-09304a28-3586-4a81-acb2-a69e52d13530 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:55.541925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-32203dda-7653-4c8a-b816-ded8ead0dd2b req-09304a28-3586-4a81-acb2-a69e52d13530 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:55.542741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-32203dda-7653-4c8a-b816-ded8ead0dd2b req-09304a28-3586-4a81-acb2-a69e52d13530 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:55.561385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-32203dda-7653-4c8a-b816-ded8ead0dd2b req-09304a28-3586-4a81-acb2-a69e52d13530 service nova] Creating event network-changed:25a9919e-b581-48d8-bce0-fd4089193597 for instance 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c on n-h1-854441-12 Oct 17 15:37:55.569137 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-32203dda-7653-4c8a-b816-ded8ead0dd2b req-09304a28-3586-4a81-acb2-a69e52d13530 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075003 Oct 17 15:37:55.570379 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1625/3497] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:55.576938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:55.578186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:55.586552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:55.587575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:55.588303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:55.589460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:55.590250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:55.590999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:56.072056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:56.089939 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a06a4e7c-b6d6-4125-b942-30f379f00e86 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1516 microversion: 2.1 time: 0.814799 Oct 17 15:37:56.092324 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1873/3498] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:55 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1516 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:56.109613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:56.111558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:56.129055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:56.131155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:56.131820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:56.137694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:56.139903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:56.142084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:56.498780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:56.531251 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4a4d4cd6-554d-4263-912c-a1ba72c9c0b9 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1314 microversion: 2.1 time: 0.958660 Oct 17 15:37:56.547141 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1626/3499] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:55 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:56.574733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2069446-e3f7-4996-a5ed-b3a88f32ac73 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Action: 'create', calling method: .version_select at 0x7f28beb1a700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1971583096", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:56.628747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e2069446-e3f7-4996-a5ed-b3a88f32ac73 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:56.649937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e2069446-e3f7-4996-a5ed-b3a88f32ac73 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for user 83ed66285ab540b69c6dafee5da78f59 and project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:56.701758 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e2069446-e3f7-4996-a5ed-b3a88f32ac73 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2069446-e3f7-4996-a5ed-b3a88f32ac73 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Request method failure captured: Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 2167 Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXbQHZff_FtT7iv9xOUlkdYgcGQprJcls3kWJDUDKw7opR5U6OCj69dY09Sy4WVtD_xYSKtXoGQa5jAOJu2_842fForH40ApJiQjuafiyYe9CbEkkK-i0Wc_7dncm_ryBtg5Jc9GqUz1_ZKS4JvkVWbNoAFRSOr4fjPDaWw9ihURdEY Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1971583096", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:37:56.728082 n-d-854441-12 devstack@n-api.service[120407]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1971583096', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:56.732957 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 15:37:56.745982 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:56.753048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2069446-e3f7-4996-a5ed-b3a88f32ac73 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:56.756101 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e2069446-e3f7-4996-a5ed-b3a88f32ac73 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.206668 Oct 17 15:37:56.773336 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1627/3500] 10.222.0.87 () {60 vars in 1160 bytes} [Mon Oct 17 15:37:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:37:56.782760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:56.784354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:56.798432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:56.799839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:56.800979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:56.802699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:56.803802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:56.804655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:56.869601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:56.884736 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95597da3-ee92-42b4-83a8-2c6d334c0be1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.790358 Oct 17 15:37:56.885675 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1874/3501] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:56 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:56.899137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:56.900110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:56.913919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:56.914775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:56.915390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:56.916350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:56.919229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:56.919918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:57.144783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:57.165614 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-361df7a9-d75f-4c77-ba50-2b2a34a80e08 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1283 microversion: 2.1 time: 0.389856 Oct 17 15:37:57.179727 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1628/3502] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:56 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1283 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:57.217923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a65f3bd-df29-445d-8ff4-2bdd99443c77 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:57.224373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a65f3bd-df29-445d-8ff4-2bdd99443c77 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: a86fda88-5083-4047-8000-e4e3fa948e42] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:57.238739 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1a65f3bd-df29-445d-8ff4-2bdd99443c77 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] HTTP exception thrown: Instance a86fda88-5083-4047-8000-e4e3fa948e42 could not be found. Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a65f3bd-df29-445d-8ff4-2bdd99443c77 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Request method failure captured: Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/a86fda88-5083-4047-8000-e4e3fa948e42/action HTTP/1.1 Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 14 Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXZ8kmtUPZWb3G0RLc0tH4XVjR5C-7gTVa04Om70uUY0S3ObDBITuVYe9LE38K5_JYHog2FWX-dPJIO8BZMjXqs1lpG_ioDhvbA748hUDdgAKK6oZjLCKHY9A2JeDwuSv8UPAoiN-E1QRQdYcKH6OumXVNNcIN16WkTnV4IzILKrXLw Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ea396576a90246cb8b821cb2afec9170 Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: {"rescue": {}} Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance a86fda88-5083-4047-8000-e4e3fa948e42 could not be found. Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'a86fda88-5083-4047-8000-e4e3fa948e42', 'body': {'rescue': {}}} Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86fda88-5083-4047-8000-e4e3fa948e42 could not be found. Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86fda88-5083-4047-8000-e4e3fa948e42 could not be found. Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:57.248085 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:57.253608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:57.253608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:57.253608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:37:57.253608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:37:57.253608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86fda88-5083-4047-8000-e4e3fa948e42 could not be found. Oct 17 15:37:57.253608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:57.253608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a65f3bd-df29-445d-8ff4-2bdd99443c77 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Returning 404 to user: Instance a86fda88-5083-4047-8000-e4e3fa948e42 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:57.258663 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a65f3bd-df29-445d-8ff4-2bdd99443c77 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/a86fda88-5083-4047-8000-e4e3fa948e42/action" status: 404 len: 111 microversion: 2.1 time: 0.047128 Oct 17 15:37:57.267155 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1629/3503] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:37:57 2022] POST /compute/v2.1/servers/a86fda88-5083-4047-8000-e4e3fa948e42/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:37:57.295603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:57.299985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:57.344249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:57.374908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:57.376054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:57.377779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:57.378778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:57.379636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:57.433291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:37:57.761294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:57.775840 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2622fd2e-501f-49d2-8ef3-b67c3e23f96e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 0.888787 Oct 17 15:37:57.776453 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1875/3504] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:56 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:57.801419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97c68cf5-8981-4945-bb08-4d040c76a264 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Action: 'create', calling method: .version_select at 0x7f28c0f95550>, body: {"keypair": {"name": "tempest-keypair-88865665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCW4p2do1y9TZpkL2J6AqOiWFzYaiuEiFZwY4MR0guHp4JX7xZvaYi1b4J41/O125m5oaQSQiLqSbRttuhxFuDzxr+CjI3Tbp88h9NgeKGPUsvDgQdNVOySYl7ygr/MQJg=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:57.833728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-97c68cf5-8981-4945-bb08-4d040c76a264 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:57.840879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-97c68cf5-8981-4945-bb08-4d040c76a264 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for user 83ed66285ab540b69c6dafee5da78f59 and project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:57.873787 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97c68cf5-8981-4945-bb08-4d040c76a264 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.081952 Oct 17 15:37:57.884615 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1876/3505] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:37:57 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:57.891923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16d1f43e-af9b-482c-9764-a4fce2f04912 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:57.892766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16d1f43e-af9b-482c-9764-a4fce2f04912 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:57.900303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d1f43e-af9b-482c-9764-a4fce2f04912 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:57.901007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d1f43e-af9b-482c-9764-a4fce2f04912 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:57.901758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d1f43e-af9b-482c-9764-a4fce2f04912 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:57.902751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d1f43e-af9b-482c-9764-a4fce2f04912 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:57.903405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d1f43e-af9b-482c-9764-a4fce2f04912 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:57.904083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16d1f43e-af9b-482c-9764-a4fce2f04912 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:57.945068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:57.993264 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a042ab5-7815-45d0-9686-8393920bba58 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1323 microversion: 2.1 time: 0.722040 Oct 17 15:37:58.000229 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1630/3506] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:57 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1323 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:58.036174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1f6819ca-39e1-4432-9e1f-3b0e6b3b5a49 req-1e619e4e-aff0-4c72-8f71-7a8c94176d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd14a0a-9efd-4417-9e37-147e3721bf15", "name": "network-vif-plugged", "status": "completed", "tag": "cf1b76f6-fa42-4e61-bd1e-9c9a3d09ed43"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:58.105808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1f6819ca-39e1-4432-9e1f-3b0e6b3b5a49 req-1e619e4e-aff0-4c72-8f71-7a8c94176d3e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:58.112697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1f6819ca-39e1-4432-9e1f-3b0e6b3b5a49 req-1e619e4e-aff0-4c72-8f71-7a8c94176d3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:58.115724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1f6819ca-39e1-4432-9e1f-3b0e6b3b5a49 req-1e619e4e-aff0-4c72-8f71-7a8c94176d3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:58.266759 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1f6819ca-39e1-4432-9e1f-3b0e6b3b5a49 req-1e619e4e-aff0-4c72-8f71-7a8c94176d3e service nova] Creating event network-vif-plugged:cf1b76f6-fa42-4e61-bd1e-9c9a3d09ed43 for instance edd14a0a-9efd-4417-9e37-147e3721bf15 on n-h2-854441-12 Oct 17 15:37:58.288027 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16d1f43e-af9b-482c-9764-a4fce2f04912 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action" status: 202 len: 0 microversion: 2.1 time: 0.393795 Oct 17 15:37:58.303623 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1877/3507] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:37:57 2022] POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:37:58.333975 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1f6819ca-39e1-4432-9e1f-3b0e6b3b5a49 req-1e619e4e-aff0-4c72-8f71-7a8c94176d3e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319046 Oct 17 15:37:58.343308 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1631/3508] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:37:58.390091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:58.391648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:58.431957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-33efaa55-4128-4b7f-b436-e8b33f3aab3d tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Action: 'create', calling method: .version_select at 0x7f28be3c93a0>, body: {"keypair": {"name": "tempest-keypair-88865665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw6kHrFmxvaP1bVO/8n2DkTCOp39YQD0udoRq2sdSBf+XmIGqXyEySbOqr9kNxpyzjHZJLTxFYxDgm5FHz8kIQWmdrlVqhZllS0X9URHGmCk8l/yfX/mJF78D/t9ySacw=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:37:58.461718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:58.462230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:58.465680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:58.465680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:58.465680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:58.468294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:58.491808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-33efaa55-4128-4b7f-b436-e8b33f3aab3d tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:37:58.516244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-33efaa55-4128-4b7f-b436-e8b33f3aab3d tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for user 83ed66285ab540b69c6dafee5da78f59 and project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:37:58.607506 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-33efaa55-4128-4b7f-b436-e8b33f3aab3d tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] HTTP exception thrown: Key pair 'tempest-keypair-88865665' already exists. Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-33efaa55-4128-4b7f-b436-e8b33f3aab3d tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Request method failure captured: Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 271 Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXbQHZff_FtT7iv9xOUlkdYgcGQprJcls3kWJDUDKw7opR5U6OCj69dY09Sy4WVtD_xYSKtXoGQa5jAOJu2_842fForH40ApJiQjuafiyYe9CbEkkK-i0Wc_7dncm_ryBtg5Jc9GqUz1_ZKS4JvkVWbNoAFRSOr4fjPDaWw9ihURdEY Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: {"keypair": {"name": "tempest-keypair-88865665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw6kHrFmxvaP1bVO/8n2DkTCOp39YQD0udoRq2sdSBf+XmIGqXyEySbOqr9kNxpyzjHZJLTxFYxDgm5FHz8kIQWmdrlVqhZllS0X9URHGmCk8l/yfX/mJF78D/t9ySacw=="}} Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: exception: Key pair 'tempest-keypair-88865665' already exists. Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-88865665', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw6kHrFmxvaP1bVO/8n2DkTCOp39YQD0udoRq2sdSBf+XmIGqXyEySbOqr9kNxpyzjHZJLTxFYxDgm5FHz8kIQWmdrlVqhZllS0X9URHGmCk8l/yfX/mJF78D/t9ySacw=='}}} Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result.read() Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '83ed66285ab540b69c6dafee5da78f59-tempest-keypair-88865665' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 17 15:37:58.652404 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result.read() Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 15:37:58.660647 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '83ed66285ab540b69c6dafee5da78f59-tempest-keypair-88865665' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 15, 37, 58, 582921), 'updated_at': None, 'name': 'tempest-keypair-88865665', 'user_id': '83ed66285ab540b69c6dafee5da78f59', 'fingerprint': 'c9:d6:98:63:2a:f9:70:85:b9:51:fa:ce:4d:b6:78:ba', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw6kHrFmxvaP1bVO/8n2DkTCOp39YQD0udoRq2sdSBf+XmIGqXyEySbOqr9kNxpyzjHZJLTxFYxDgm5FHz8kIQWmdrlVqhZllS0X9URHGmCk8l/yfX/mJF78D/t9ySacw==', 'type': 'ssh'}] Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi keypair.create() Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._create() Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-88865665' already exists. Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 17 15:37:58.672136 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-88865665' already exists. Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-88865665' already exists. Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-33efaa55-4128-4b7f-b436-e8b33f3aab3d tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Returning 409 to user: Key pair 'tempest-keypair-88865665' already exists. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:37:58.680548 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-33efaa55-4128-4b7f-b436-e8b33f3aab3d tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.315971 Oct 17 15:37:58.690739 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1632/3509] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:37:58 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 342 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:37:58.702153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:37:58.713996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:37:58.738559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:58.739973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:58.750956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:58.763935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:37:58.765129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:37:58.766090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:37:59.662631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:37:59.707191 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6531906b-731f-4635-982f-79aad00e9a23 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1314 microversion: 2.1 time: 1.381395 Oct 17 15:37:59.708439 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1878/3510] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:58 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1314 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:37:59.967761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-630f4c4b-3217-4442-a54f-1aeb03c3b13a req-05f0c668-4b5e-4e6e-8f14-000a4a2b353d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebd3ad5-adb6-4e86-87fb-348e03f91f8b", "tag": "87af1e61-fab5-458d-8b8c-a0719fce1a7b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:00.011262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-630f4c4b-3217-4442-a54f-1aeb03c3b13a req-05f0c668-4b5e-4e6e-8f14-000a4a2b353d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:00.012338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-630f4c4b-3217-4442-a54f-1aeb03c3b13a req-05f0c668-4b5e-4e6e-8f14-000a4a2b353d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:00.013715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-630f4c4b-3217-4442-a54f-1aeb03c3b13a req-05f0c668-4b5e-4e6e-8f14-000a4a2b353d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:00.102926 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-630f4c4b-3217-4442-a54f-1aeb03c3b13a req-05f0c668-4b5e-4e6e-8f14-000a4a2b353d service nova] Creating event network-changed:87af1e61-fab5-458d-8b8c-a0719fce1a7b for instance 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b on n-h2-854441-12 Oct 17 15:38:00.129832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:00.142255 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-630f4c4b-3217-4442-a54f-1aeb03c3b13a req-05f0c668-4b5e-4e6e-8f14-000a4a2b353d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.396474 Oct 17 15:38:00.151881 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1879/3511] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:00.174687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:00.175439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:00.179124 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a829517-7330-43a4-9f77-fd34243564b4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 1.486345 Oct 17 15:38:00.187186 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1633/3512] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:37:58 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:00.211816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:00.217178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:00.226549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:00.227145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:00.227645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:00.228467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:00.228938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:00.229375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:00.245241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:00.245763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:00.246223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:00.251744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:00.252807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:00.259074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:00.817495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:00.832919 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-709cd6af-af8a-4a31-9c80-bb26bdb02580 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1350 microversion: 2.1 time: 0.678675 Oct 17 15:38:00.839257 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1880/3513] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:00 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1350 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:00.851978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1c8159e-4e44-4641-bf95-c50bf1b9ccd3 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Calling method '.version_select at 0x7f28c2eb84c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:00.896455 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1c8159e-4e44-4641-bf95-c50bf1b9ccd3 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-88865665" status: 202 len: 0 microversion: 2.1 time: 0.055401 Oct 17 15:38:00.898104 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1881/3514] 10.222.0.87 () {58 vars in 1215 bytes} [Mon Oct 17 15:38:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-88865665 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:38:00.920303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:00.927274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:00.980853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:00.982007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:00.986282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:00.987650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:00.994807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:00.995325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:01.855941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:01.872857 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b7c7999-f514-4d46-ab94-9391da1df669 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1318 microversion: 2.1 time: 0.971988 Oct 17 15:38:01.898123 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1882/3515] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:00 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1318 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:01.912391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:01.928504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:01.954119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:01.956588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:01.961509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:01.969096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:01.970691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:01.971496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:02.037131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:02.038247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:02.379657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:02.400238 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f248c54-81fe-4939-8542-6a470c77207a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1323 microversion: 2.1 time: 0.498383 Oct 17 15:38:02.403830 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1883/3516] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:01 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:02.429098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:02.431050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:02.437611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:02.463183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:02.492441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:02.493891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:02.506447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:02.510248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:02.514609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:02.736510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:02.751193 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-079262d2-bdb8-419c-b7c5-139e25e9ef41 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1501 microversion: 2.1 time: 2.562681 Oct 17 15:38:02.751816 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1634/3517] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:00 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1501 bytes in 2564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:02.771549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-469ade77-d657-4d91-b8dc-ab06e09e8025 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Action: 'create', calling method: .version_select at 0x7f28bf3c6b80>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5Rc588cT4k/wLUbqbwt5Nc+/P44uv8+Gq1v+M6bR4+RcZl1u8cjxJ2sL2wMqtuqaIRNUeXFKqKQP+tl+6Ux542eABIAPi5pO6QmOwD7eFHRkPrqhTB+rc5UJ2k/EtmVQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-469ade77-d657-4d91-b8dc-ab06e09e8025 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Request method failure captured: Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 247 Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXbQHZff_FtT7iv9xOUlkdYgcGQprJcls3kWJDUDKw7opR5U6OCj69dY09Sy4WVtD_xYSKtXoGQa5jAOJu2_842fForH40ApJiQjuafiyYe9CbEkkK-i0Wc_7dncm_ryBtg5Jc9GqUz1_ZKS4JvkVWbNoAFRSOr4fjPDaWw9ihURdEY Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5Rc588cT4k/wLUbqbwt5Nc+/P44uv8+Gq1v+M6bR4+RcZl1u8cjxJ2sL2wMqtuqaIRNUeXFKqKQP+tl+6Ux542eABIAPi5pO6QmOwD7eFHRkPrqhTB+rc5UJ2k/EtmVQ=="}} Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5Rc588cT4k/wLUbqbwt5Nc+/P44uv8+Gq1v+M6bR4+RcZl1u8cjxJ2sL2wMqtuqaIRNUeXFKqKQP+tl+6Ux542eABIAPi5pO6QmOwD7eFHRkPrqhTB+rc5UJ2k/EtmVQ=='}}} Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '' Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:38:02.788904 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:38:02.793669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:02.798932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-469ade77-d657-4d91-b8dc-ab06e09e8025 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:02.800958 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-469ade77-d657-4d91-b8dc-ab06e09e8025 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.043858 Oct 17 15:38:02.801808 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1635/3518] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:38:02 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:38:02.809745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:02.816296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:02.827572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:02.828215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:02.833474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:02.834787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:02.835764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:02.836420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:03.270385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:03.303784 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4bbab723-ae8f-43d6-84d8-4d98ba7037b5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.499875 Oct 17 15:38:03.304702 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1636/3519] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:02 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:03.312529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:03.313528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:03.322572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:03.323607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:03.324251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:03.325213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:03.325861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:03.326598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:03.692207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:03.723514 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-604100ad-5fe8-4d61-88fe-dee2f6bb757f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1314 microversion: 2.1 time: 1.306961 Oct 17 15:38:03.729060 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1884/3520] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:02 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1314 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:03.748506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-abfc01f2-37ac-4228-a906-419d49082a3d req-9295be6a-461c-4ef3-9bd0-1fa54526f76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c", "name": "network-vif-plugged", "status": "completed", "tag": "25a9919e-b581-48d8-bce0-fd4089193597"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:03.776049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-abfc01f2-37ac-4228-a906-419d49082a3d req-9295be6a-461c-4ef3-9bd0-1fa54526f76e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:03.778114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-abfc01f2-37ac-4228-a906-419d49082a3d req-9295be6a-461c-4ef3-9bd0-1fa54526f76e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:03.780101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-abfc01f2-37ac-4228-a906-419d49082a3d req-9295be6a-461c-4ef3-9bd0-1fa54526f76e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:03.786419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:03.804064 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-229b8cd8-9152-474a-8fc5-857323bbba6c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1350 microversion: 2.1 time: 0.497501 Oct 17 15:38:03.805978 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-abfc01f2-37ac-4228-a906-419d49082a3d req-9295be6a-461c-4ef3-9bd0-1fa54526f76e service nova] Creating event network-vif-plugged:25a9919e-b581-48d8-bce0-fd4089193597 for instance 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c on n-h1-854441-12 Oct 17 15:38:03.812427 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-abfc01f2-37ac-4228-a906-419d49082a3d req-9295be6a-461c-4ef3-9bd0-1fa54526f76e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080318 Oct 17 15:38:03.813088 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1885/3521] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:03.816342 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1637/3522] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:03 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1350 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:03.819410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:03.822469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b38de774-6983-4597-aa65-39b7ab5f08bf tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Action: 'create', calling method: .version_select at 0x7f28bea87280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-105595094", "public_key": " "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:03.823259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:03.830673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:03.831774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:03.832399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:03.833841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:03.834637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:03.835254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:03.869402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lazy-loading 'flavor' on Instance uuid c54ae4a0-4fdc-4128-85a3-f39fdb907468 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:38:03.884297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b38de774-6983-4597-aa65-39b7ab5f08bf tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:03.891171 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] HTTP exception thrown: Cannot 'rescue' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state paused Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Request method failure captured: Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action HTTP/1.1 Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 14 Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXZ8kmtUPZWb3G0RLc0tH4XVjR5C-7gTVa04Om70uUY0S3ObDBITuVYe9LE38K5_JYHog2FWX-dPJIO8BZMjXqs1lpG_ioDhvbA748hUDdgAKK6oZjLCKHY9A2JeDwuSv8UPAoiN-E1QRQdYcKH6OumXVNNcIN16WkTnV4IzILKrXLw Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ea396576a90246cb8b821cb2afec9170 Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: {"rescue": {}} Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'rescue' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state paused Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'c54ae4a0-4fdc-4128-85a3-f39fdb907468', 'body': {'rescue': {}}} Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 in vm_state paused. Cannot rescue while the instance is in this state. Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state paused Oct 17 15:38:03.894287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.898557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:03.898557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.898557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:03.898557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:03.898557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:03.898557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:03.898557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:03.898557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state paused Oct 17 15:38:03.898557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.901891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Returning 409 to user: Cannot 'rescue' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state paused {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:03.903966 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00f7ae4e-f5ca-44c4-a459-b4003e5f73d9 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action" status: 409 len: 144 microversion: 2.1 time: 0.089198 Oct 17 15:38:03.905480 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1886/3523] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:03 2022] POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action => generated 144 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:38:03.911714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:03.912349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:03.914371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b38de774-6983-4597-aa65-39b7ab5f08bf tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for user 83ed66285ab540b69c6dafee5da78f59 and project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:03.927524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:03.928259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:03.928740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:03.932966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:03.933550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:03.934880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:03.958612 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b38de774-6983-4597-aa65-39b7ab5f08bf tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b38de774-6983-4597-aa65-39b7ab5f08bf tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Request method failure captured: Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 94 Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXbQHZff_FtT7iv9xOUlkdYgcGQprJcls3kWJDUDKw7opR5U6OCj69dY09Sy4WVtD_xYSKtXoGQa5jAOJu2_842fForH40ApJiQjuafiyYe9CbEkkK-i0Wc_7dncm_ryBtg5Jc9GqUz1_ZKS4JvkVWbNoAFRSOr4fjPDaWw9ihURdEY Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-105595094", "public_key": " "}} Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-105595094', 'public_key': ' '}}} Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:03.963412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:03.968001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:03.970034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b38de774-6983-4597-aa65-39b7ab5f08bf tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:03.970119 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b38de774-6983-4597-aa65-39b7ab5f08bf tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.151791 Oct 17 15:38:03.984803 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1638/3524] 10.222.0.87 () {60 vars in 1158 bytes} [Mon Oct 17 15:38:03 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:38:03.996560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:03.998214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:04.020899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:04.022274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:04.023477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:04.025093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:04.026433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:04.028113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:04.301954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:04.330894 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c613e88-24ea-40e2-92af-baf370b0324c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1323 microversion: 2.1 time: 0.341831 Oct 17 15:38:04.335816 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1639/3525] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:03 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1323 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:04.344687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:04.347063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cea07938-b8c2-465c-a33d-f49a98432319 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:04.352212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cea07938-b8c2-465c-a33d-f49a98432319 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:04.359360 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c8922a2-cc57-4514-9fed-d66bfa29f6d6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1508 microversion: 2.1 time: 0.451923 Oct 17 15:38:04.363084 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1887/3526] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:03 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1508 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:04.377551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-754d95c9-0652-4764-b21c-f3fb0ebccdd3 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Action: 'create', calling method: .version_select at 0x7f28be2bb8b0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2ZTI2qcivVs8qrQofTt9aV9wPBNrxjVmbvWjW5xD2zDMbRnHzTF/9iziiJNgj1j+/lNYxbYw/789Nt/Qaw6rXh7Pnqw8D9VheY4CAUOhtXaGGo2aSglg35LY03Rmj39A=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-754d95c9-0652-4764-b21c-f3fb0ebccdd3 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Request method failure captured: Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 507 Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbQHZff_FtT7iv9xOUlkdYgcGQprJcls3kWJDUDKw7opR5U6OCj69dY09Sy4WVtD_xYSKtXoGQa5jAOJu2_842fForH40ApJiQjuafiyYe9CbEkkK-i0Wc_7dncm_ryBtg5Jc9GqUz1_ZKS4JvkVWbNoAFRSOr4fjPDaWw9ihURdEY Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2ZTI2qcivVs8qrQofTt9aV9wPBNrxjVmbvWjW5xD2zDMbRnHzTF/9iziiJNgj1j+/lNYxbYw/789Nt/Qaw6rXh7Pnqw8D9VheY4CAUOhtXaGGo2aSglg35LY03Rmj39A=="}} Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2ZTI2qcivVs8qrQofTt9aV9wPBNrxjVmbvWjW5xD2zDMbRnHzTF/9iziiJNgj1j+/lNYxbYw/789Nt/Qaw6rXh7Pnqw8D9VheY4CAUOhtXaGGo2aSglg35LY03Rmj39A=='}}} Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 17 15:38:04.388413 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 15:38:04.391858 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.397596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-754d95c9-0652-4764-b21c-f3fb0ebccdd3 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:04.400931 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-754d95c9-0652-4764-b21c-f3fb0ebccdd3 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.036193 Oct 17 15:38:04.403087 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1888/3527] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:38:04 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:38:04.404244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cea07938-b8c2-465c-a33d-f49a98432319 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:04.405129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cea07938-b8c2-465c-a33d-f49a98432319 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:04.405950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cea07938-b8c2-465c-a33d-f49a98432319 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:04.409074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e190397c-97cf-4fd0-a743-aa51ffd9aead req-f0564984-233c-4f81-957b-4dea9ba1529a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c85e2a-7d17-4fd4-b273-161a7cf90dbe", "tag": "94333ecc-4a6c-4e40-b248-a1300c3ac6b6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:04.415026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cea07938-b8c2-465c-a33d-f49a98432319 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:04.416027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cea07938-b8c2-465c-a33d-f49a98432319 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:04.416587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cea07938-b8c2-465c-a33d-f49a98432319 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:04.483186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e190397c-97cf-4fd0-a743-aa51ffd9aead req-f0564984-233c-4f81-957b-4dea9ba1529a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:04.488820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e190397c-97cf-4fd0-a743-aa51ffd9aead req-f0564984-233c-4f81-957b-4dea9ba1529a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:04.493143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e190397c-97cf-4fd0-a743-aa51ffd9aead req-f0564984-233c-4f81-957b-4dea9ba1529a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:04.543617 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e190397c-97cf-4fd0-a743-aa51ffd9aead req-f0564984-233c-4f81-957b-4dea9ba1529a service nova] Creating event network-changed:94333ecc-4a6c-4e40-b248-a1300c3ac6b6 for instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe on n-h2-854441-12 Oct 17 15:38:04.573686 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e190397c-97cf-4fd0-a743-aa51ffd9aead req-f0564984-233c-4f81-957b-4dea9ba1529a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164504 Oct 17 15:38:04.578802 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1889/3528] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:04.629397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:04.635290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:04.670119 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cea07938-b8c2-465c-a33d-f49a98432319 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action" status: 202 len: 0 microversion: 2.1 time: 0.331438 Oct 17 15:38:04.671548 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1640/3529] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:04 2022] POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:38:04.675009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:04.675541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:04.682838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df945bf0-bab7-44bd-94b9-0cbb5f8d5436 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Action: 'create', calling method: .version_select at 0x7f28bec1c940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1242863088", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:04.683882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:04.690343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:04.690973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:04.693180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:04.759348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-df945bf0-bab7-44bd-94b9-0cbb5f8d5436 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:04.802917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-df945bf0-bab7-44bd-94b9-0cbb5f8d5436 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Getting quotas for user 83ed66285ab540b69c6dafee5da78f59 and project ac48e7417c5145379c5a06a61e9f230d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:04.921556 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-df945bf0-bab7-44bd-94b9-0cbb5f8d5436 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df945bf0-bab7-44bd-94b9-0cbb5f8d5436 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Request method failure captured: Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 118 Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXbQHZff_FtT7iv9xOUlkdYgcGQprJcls3kWJDUDKw7opR5U6OCj69dY09Sy4WVtD_xYSKtXoGQa5jAOJu2_842fForH40ApJiQjuafiyYe9CbEkkK-i0Wc_7dncm_ryBtg5Jc9GqUz1_ZKS4JvkVWbNoAFRSOr4fjPDaWw9ihURdEY Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1242863088", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1242863088', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 15:38:04.935779 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 15:38:04.940999 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:04.944026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df945bf0-bab7-44bd-94b9-0cbb5f8d5436 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:04.946475 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-df945bf0-bab7-44bd-94b9-0cbb5f8d5436 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.269965 Oct 17 15:38:04.959849 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1641/3530] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:38:04 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:38:04.991973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:04.996035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:05.032197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:05.033364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:05.038802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:05.044132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:05.045337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:05.046117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:05.804543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:05.848156 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ff83538-5828-4860-b8c4-c39b224f9cae tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 1.264752 Oct 17 15:38:05.870694 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1890/3531] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:04 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:05.882968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:05.884517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:05.900627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:05.901308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:05.901774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:05.904926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:05.906777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:05.907326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:06.219013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:06.254195 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-484d08be-ab11-457e-b74b-7015d091eeb6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1508 microversion: 2.1 time: 1.290661 Oct 17 15:38:06.267435 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1642/3532] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:04 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1508 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:06.298636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:06.299894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:06.328340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:06.331797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:06.332060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:06.336288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:06.339290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:06.340188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:06.673860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:06.747752 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ee76351-0895-4737-aa38-64a5ba75bc39 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1463 microversion: 2.1 time: 0.866111 Oct 17 15:38:06.753844 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1891/3533] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:05 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1463 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:06.761644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76c4618b-c13e-401b-b0c9-dc982e4f3619 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Calling method '.version_select at 0x7f28bf820d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:06.800880 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-76c4618b-c13e-401b-b0c9-dc982e4f3619 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-110671272 not found for user 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76c4618b-c13e-401b-b0c9-dc982e4f3619 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Request method failure captured: Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-110671272 HTTP/1.1 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbQHZff_FtT7iv9xOUlkdYgcGQprJcls3kWJDUDKw7opR5U6OCj69dY09Sy4WVtD_xYSKtXoGQa5jAOJu2_842fForH40ApJiQjuafiyYe9CbEkkK-i0Wc_7dncm_ryBtg5Jc9GqUz1_ZKS4JvkVWbNoAFRSOr4fjPDaWw9ihURdEY Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ac48e7417c5145379c5a06a61e9f230d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: ac48e7417c5145379c5a06a61e9f230d Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-158953149 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-KeyPairsNegativeTestJSON-158953149-project Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: exception: Keypair tempest-keypair-non-existent-110671272 not found for user 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'tempest-keypair-non-existent-110671272'} Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-110671272 not found for user 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:06.807653 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-110671272 not found for user 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-110671272 not found for user 83ed66285ab540b69c6dafee5da78f59 Oct 17 15:38:06.813069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:06.817464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76c4618b-c13e-401b-b0c9-dc982e4f3619 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] Returning 404 to user: Keypair tempest-keypair-non-existent-110671272 not found for user 83ed66285ab540b69c6dafee5da78f59 {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:06.820294 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76c4618b-c13e-401b-b0c9-dc982e4f3619 tempest-KeyPairsNegativeTestJSON-158953149 tempest-KeyPairsNegativeTestJSON-158953149-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-110671272" status: 404 len: 144 microversion: 2.1 time: 0.064925 Oct 17 15:38:06.831035 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1892/3534] 10.222.0.87 () {58 vars in 1257 bytes} [Mon Oct 17 15:38:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-110671272 => generated 144 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:38:06.848060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:06.849022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:06.869312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:06.873538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:06.874326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:06.877557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:06.880673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:06.881340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:06.945445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:06.957892 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bd9ae7fb-170c-4488-8f48-7507858725fa tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1350 microversion: 2.1 time: 0.688305 Oct 17 15:38:06.960210 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1643/3535] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:06 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1350 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:07.439319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-134134c1-5572-4af4-a932-3afcb9909398 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:07.498110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-134134c1-5572-4af4-a932-3afcb9909398 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Searching by: {'deleted': False, 'project_id': '9f21610432bc40a58f3eb6dde3e7136f'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:38:07.546822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:07.570693 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-890495d2-8886-4270-9de2-e2bf7b10b473 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1323 microversion: 2.1 time: 0.735364 Oct 17 15:38:07.571959 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1893/3536] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:06 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1323 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:07.590035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:07.590997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:07.608562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:07.618364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:07.619596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:07.620313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:07.621660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:07.622362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:07.623018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:07.655806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134134c1-5572-4af4-a932-3afcb9909398 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:07.656700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134134c1-5572-4af4-a932-3afcb9909398 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:07.660678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134134c1-5572-4af4-a932-3afcb9909398 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:07.666294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134134c1-5572-4af4-a932-3afcb9909398 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:07.667260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134134c1-5572-4af4-a932-3afcb9909398 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:07.670192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134134c1-5572-4af4-a932-3afcb9909398 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:07.789741 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-134134c1-5572-4af4-a932-3afcb9909398 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.826867 Oct 17 15:38:07.792752 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1644/3537] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:38:06 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:38:07.822910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:07.828343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:07.849825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:07.852190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:07.853364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:07.854522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:07.881172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:07.881172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:07.881172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:07.993234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:08.008910 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f51f6d7-2e81-4b5c-8304-ab4207e60ed1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.423070 Oct 17 15:38:08.010920 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1894/3538] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:07 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:08.026804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:08.049986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Searching by: {'deleted': False} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:38:08.073709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:08.077854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:08.079525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:08.084454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:08.086604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:08.088635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:08.358456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:38:08.387972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:08.429551 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5459bf96-2698-442c-b9a1-166e05192ef8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1516 microversion: 2.1 time: 0.631519 Oct 17 15:38:08.435233 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1645/3539] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:07 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1516 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:08.478112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:08.483663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:08.501334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:08.502159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:08.502796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:08.529654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:08.531004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:08.534215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:08.536842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:08.548486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:08.549707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:09.193146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:09.215878 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ebcad8c7-97cd-4912-8107-7533334dec6a tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1350 microversion: 2.1 time: 0.778139 Oct 17 15:38:09.235209 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1646/3540] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:08 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1350 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:09.267025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5f4808d3-0f75-483d-a324-89b7c6ab6765 req-2bc4bec6-0e42-4d06-93db-86c0d317062f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebd3ad5-adb6-4e86-87fb-348e03f91f8b", "name": "network-vif-plugged", "status": "completed", "tag": "87af1e61-fab5-458d-8b8c-a0719fce1a7b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:09.287063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5f4808d3-0f75-483d-a324-89b7c6ab6765 req-2bc4bec6-0e42-4d06-93db-86c0d317062f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:09.288534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5f4808d3-0f75-483d-a324-89b7c6ab6765 req-2bc4bec6-0e42-4d06-93db-86c0d317062f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:09.289654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5f4808d3-0f75-483d-a324-89b7c6ab6765 req-2bc4bec6-0e42-4d06-93db-86c0d317062f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:09.323161 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5f4808d3-0f75-483d-a324-89b7c6ab6765 req-2bc4bec6-0e42-4d06-93db-86c0d317062f service nova] Creating event network-vif-plugged:87af1e61-fab5-458d-8b8c-a0719fce1a7b for instance 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b on n-h2-854441-12 Oct 17 15:38:09.344607 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5f4808d3-0f75-483d-a324-89b7c6ab6765 req-2bc4bec6-0e42-4d06-93db-86c0d317062f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106312 Oct 17 15:38:09.350048 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1647/3541] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:09.366032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:09.374617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:09.401772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:09.408645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:09.412709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:09.415686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:09.422801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:09.424369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:10.498462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7be62c24-8808-4efb-86f4-82fd40432f65 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16390 microversion: 2.1 time: 2.486326 Oct 17 15:38:10.500240 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1895/3542] 10.222.0.87 () {58 vars in 1171 bytes} [Mon Oct 17 15:38:08 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16390 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:38:10.513331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:10.514429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:10.531144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:10.532086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:10.532786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:10.533793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:10.537836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:10.538677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:10.787296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:10.811028 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf6efd67-6ce2-4382-8f66-96a18da6bb67 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1323 microversion: 2.1 time: 1.458529 Oct 17 15:38:10.813536 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1648/3543] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:09 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1323 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:10.839387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e0496443-f6f0-40c7-a8a8-5974c8debb27"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:10.844056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:10.894688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:10.895535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:10.896300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:10.897526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:10.914624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:10.920298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:11.198311 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] HTTP exception thrown: Volume 307901c5-e50c-488c-81dc-dc2db509d67b could not be found. Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Request method failure captured: Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: request: PUT /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15/os-volume_attachments/307901c5-e50c-488c-81dc-dc2db509d67b HTTP/1.1 Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 74 Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXY4MQzKK3RS52-B-FYR7P-_stZ0vfkzVikxU92ZqlMjly--snFhq4b92l3QRcIVGrUVK_uBk9ro64a3WxGTfucUBPeWbbTQV4xtr7bS4toVI0LBS5GCPoxqi_37esrcTqbETBBM6bXPM5PP2707nD_uJ0kIaKXPelIxOH_sNlruYug Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: dc2b57457f0d44069996fac6bab4c8fd Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesAdminNegativeTest-767208564 Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dc2b57457f0d44069996fac6bab4c8fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/dc2b57457f0d44069996fac6bab4c8fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_dc2b57457f0d44069996fac6bab4c8fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/dc2b57457f0d44069996fac6bab4c8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesAdminNegativeTest-767208564 Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: dc2b57457f0d44069996fac6bab4c8fd Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-767208564 Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesAdminNegativeTest-767208564-project-admin Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 4d8285310cfe4b13a7b68954a95fa0f8 Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesAdminNegativeTest-767208564-project-admin Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: {"volumeAttachment": {"volumeId": "e0496443-f6f0-40c7-a8a8-5974c8debb27"}} Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: exception: Volume 307901c5-e50c-488c-81dc-dc2db509d67b could not be found. Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'server_id': 'edd14a0a-9efd-4417-9e37-147e3721bf15', 'id': '307901c5-e50c-488c-81dc-dc2db509d67b', 'body': {'volumeAttachment': {'volumeId': 'e0496443-f6f0-40c7-a8a8-5974c8debb27'}}} Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 307901c5-e50c-488c-81dc-dc2db509d67b could not be found. (HTTP 404) (Request-ID: req-375fbf53-c6b8-4273-aa3c-b61c7be604da) Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 15:38:11.203678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 307901c5-e50c-488c-81dc-dc2db509d67b could not be found. Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 307901c5-e50c-488c-81dc-dc2db509d67b could not be found. Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 307901c5-e50c-488c-81dc-dc2db509d67b could not be found. Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] Returning 404 to user: Volume 307901c5-e50c-488c-81dc-dc2db509d67b could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:11.213526 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d8aab11c-7844-4bbd-9916-e13e2de52781 tempest-VolumesAdminNegativeTest-767208564 tempest-VolumesAdminNegativeTest-767208564-project-admin] 10.222.0.87 "PUT /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15/os-volume_attachments/307901c5-e50c-488c-81dc-dc2db509d67b" status: 404 len: 109 microversion: 2.1 time: 0.391005 Oct 17 15:38:11.229284 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1649/3544] 10.222.0.87 () {60 vars in 1433 bytes} [Mon Oct 17 15:38:10 2022] PUT /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15/os-volume_attachments/307901c5-e50c-488c-81dc-dc2db509d67b => generated 109 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:38:11.249137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:11.251213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:11.292587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:11.293411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:11.294387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:11.295954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:11.298435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:11.303712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:11.518329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:11.554702 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c509cfcb-b9bf-4156-8aa0-8a812374d8e9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 1.051823 Oct 17 15:38:11.565905 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1896/3545] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:10 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:11.643716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07af8ecd-1538-4873-ba79-b109273b2305 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:11.697468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-07af8ecd-1538-4873-ba79-b109273b2305 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Searching by: {'deleted': False, 'project_id': '9f21610432bc40a58f3eb6dde3e7136f'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:38:11.727265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af8ecd-1538-4873-ba79-b109273b2305 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:11.728102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af8ecd-1538-4873-ba79-b109273b2305 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:11.728805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af8ecd-1538-4873-ba79-b109273b2305 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:11.730071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af8ecd-1538-4873-ba79-b109273b2305 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:11.731223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af8ecd-1538-4873-ba79-b109273b2305 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:11.732201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07af8ecd-1538-4873-ba79-b109273b2305 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:12.043854 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07af8ecd-1538-4873-ba79-b109273b2305 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/detail?tenant_id=3e312b32190a41ee84947b87f0f75026" status: 200 len: 15 microversion: 2.1 time: 0.475829 Oct 17 15:38:12.079013 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1897/3546] 10.222.0.87 () {58 vars in 1231 bytes} [Mon Oct 17 15:38:11 2022] GET /compute/v2.1/servers/detail?tenant_id=3e312b32190a41ee84947b87f0f75026 => generated 15 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:38:12.093546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:12.106728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:12.128950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:12.137558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:12.139504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:12.143885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:12.145134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:12.146734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:12.483491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:12.488474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:12.502449 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-25388807-765a-46b7-bf25-ca8809202a65 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1350 microversion: 2.1 time: 1.272811 Oct 17 15:38:12.503473 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1650/3547] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:11 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1350 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:12.508873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:12.521809 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5cdb6050-90ce-4f63-8e6b-6f3f5f41aa1c tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1323 microversion: 2.1 time: 0.440857 Oct 17 15:38:12.529098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Searching by: {'tenant_id': '3e312b32190a41ee84947b87f0f75026', 'deleted': False} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:38:12.537420 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1898/3548] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:12 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1323 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:12.541428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:12.547508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:12.548036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:12.551392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:12.552008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:12.554908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:12.609877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:12.612691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:12.629943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:12.631458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:12.633299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:12.639380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:12.640877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:12.651639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:12.687927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:38:12.816637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:12.951255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:12.961890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:12.964218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:13.182413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:13.201521 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8103b090-cbc0-4710-aee3-6c7e5f824d8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.597774 Oct 17 15:38:13.215604 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1899/3549] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:12 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:13.234941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:13.240566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:13.271034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:13.272644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:13.273477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:13.279238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:13.283579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:13.284451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:13.440794 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c6426f8b-62a0-43c4-b3c3-2fe9df7a1e8c tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3e312b32190a41ee84947b87f0f75026" status: 200 len: 4831 microversion: 2.1 time: 0.935570 Oct 17 15:38:13.454326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lazy-loading 'flavor' on Instance uuid c54ae4a0-4fdc-4128-85a3-f39fdb907468 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:38:13.455020 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1651/3550] 10.222.0.87 () {58 vars in 1257 bytes} [Mon Oct 17 15:38:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3e312b32190a41ee84947b87f0f75026 => generated 4831 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:13.495278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5235c6de-b979-49d0-8caa-5896442240fc tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:13.511368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5235c6de-b979-49d0-8caa-5896442240fc tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Searching by: {'tenant_id': '9f21610432bc40a58f3eb6dde3e7136f', 'deleted': False} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:38:13.539622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5235c6de-b979-49d0-8caa-5896442240fc tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:13.539622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5235c6de-b979-49d0-8caa-5896442240fc tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:13.546307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5235c6de-b979-49d0-8caa-5896442240fc tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:13.548130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5235c6de-b979-49d0-8caa-5896442240fc tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:13.551719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5235c6de-b979-49d0-8caa-5896442240fc tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:13.552186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5235c6de-b979-49d0-8caa-5896442240fc tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:13.719388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5235c6de-b979-49d0-8caa-5896442240fc tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9f21610432bc40a58f3eb6dde3e7136f" status: 200 len: 15 microversion: 2.1 time: 0.228355 Oct 17 15:38:13.727892 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1652/3551] 10.222.0.87 () {58 vars in 1257 bytes} [Mon Oct 17 15:38:13 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9f21610432bc40a58f3eb6dde3e7136f => generated 15 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:38:13.762318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:13.784091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:13.794901 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4433468-7392-4101-b6f4-77f905b70a1b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action" status: 200 len: 32 microversion: 2.1 time: 0.560022 Oct 17 15:38:13.807107 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1900/3552] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:13 2022] POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action => generated 32 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:38:13.811981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:13.815908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:13.826027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:13.828021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:13.829308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:13.830530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:13.847813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:13.852400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:13.882581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:13.883383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:13.884171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:13.898002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:13.899038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:13.899819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:14.045070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:14.385986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:14.402576 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4037078-3657-4657-8052-c0866a7a182d tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1519 microversion: 2.1 time: 0.586483 Oct 17 15:38:14.413101 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1901/3553] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:13 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1519 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:14.413348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c57a1693-eb54-4d57-9031-cdf587ca2978 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:14.424313 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c57a1693-eb54-4d57-9031-cdf587ca2978 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.017839 Oct 17 15:38:14.425353 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1902/3554] 10.222.0.87 () {58 vars in 1189 bytes} [Mon Oct 17 15:38:14 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:38:14.450997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:14.451844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:14.501365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:14.505924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:14.509218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:14.511939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:14.514387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:14.515252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:14.924548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:14.933914 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-969c3aa1-98d1-4958-8285-f0a618d01f2f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.506945 Oct 17 15:38:14.947407 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1903/3555] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:14 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:14.962919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9f4c7c58-e837-4c26-b82a-cd1727c7fc3d req-4de98e9e-02b8-4b4b-9a6c-e4d3b94aa4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c85e2a-7d17-4fd4-b273-161a7cf90dbe", "name": "network-vif-plugged", "status": "completed", "tag": "94333ecc-4a6c-4e40-b248-a1300c3ac6b6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:14.985205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f4c7c58-e837-4c26-b82a-cd1727c7fc3d req-4de98e9e-02b8-4b4b-9a6c-e4d3b94aa4de service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:14.987039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f4c7c58-e837-4c26-b82a-cd1727c7fc3d req-4de98e9e-02b8-4b4b-9a6c-e4d3b94aa4de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:14.988059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f4c7c58-e837-4c26-b82a-cd1727c7fc3d req-4de98e9e-02b8-4b4b-9a6c-e4d3b94aa4de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:15.020261 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9f4c7c58-e837-4c26-b82a-cd1727c7fc3d req-4de98e9e-02b8-4b4b-9a6c-e4d3b94aa4de service nova] Creating event network-vif-plugged:94333ecc-4a6c-4e40-b248-a1300c3ac6b6 for instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe on n-h2-854441-12 Oct 17 15:38:15.032386 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9f4c7c58-e837-4c26-b82a-cd1727c7fc3d req-4de98e9e-02b8-4b4b-9a6c-e4d3b94aa4de service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082462 Oct 17 15:38:15.032792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:15.035094 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1904/3556] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:15.045657 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-989700aa-1dca-418d-ae38-1ae80cd30b5d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1350 microversion: 2.1 time: 1.315158 Oct 17 15:38:15.058560 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1653/3557] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:13 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1350 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:15.062434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4e3d5141-d625-44f6-a94e-80567e9704f3 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:15.072483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4e3d5141-d625-44f6-a94e-80567e9704f3 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:15.082152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:15.085734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:15.098755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e3d5141-d625-44f6-a94e-80567e9704f3 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:15.099835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e3d5141-d625-44f6-a94e-80567e9704f3 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:15.100570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e3d5141-d625-44f6-a94e-80567e9704f3 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:15.101567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e3d5141-d625-44f6-a94e-80567e9704f3 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:15.102312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e3d5141-d625-44f6-a94e-80567e9704f3 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:15.107202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e3d5141-d625-44f6-a94e-80567e9704f3 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:15.132643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:15.134419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:15.135227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:15.136539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:15.137420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:15.139517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:15.361093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4e3d5141-d625-44f6-a94e-80567e9704f3 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action" status: 202 len: 0 microversion: 2.1 time: 0.305432 Oct 17 15:38:15.363628 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1654/3558] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:15 2022] POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:38:15.383499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f43dfe7-8b13-451c-a8ab-df583213a321 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1946958124", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f43dfe7-8b13-451c-a8ab-df583213a321 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Request method failure captured: Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 243 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXbEhBDh7bfSpgKa3ehtlH-4FXYNhERkhydByZRsUgYHHCkRSnTKNWjtxGm3WSGPnUuZ-I09NE66DQRKWScaoVTWsO4Y8O__CjSAYVLEoIOdUjepMyafzbd8ZUG7Uq9pafAEf6a0DSRoQGjh3WojEbv4zCb8EJ-JWwplMPS2aUzJ4z8 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 1cf3fcf647674f03a1d463d9d4dc129a Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1946958124", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1946958124', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '983d2c13-544a-45ae-bf2a-b899ba8809c9'}]}}} Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:15.391614 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f43dfe7-8b13-451c-a8ab-df583213a321 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:15.408944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f43dfe7-8b13-451c-a8ab-df583213a321 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.040672 Oct 17 15:38:15.412655 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1655/3559] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:38:15 2022] POST /compute/v2.1/servers => generated 175 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:38:15.423252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:15.435277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:15.438473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '3e312b32190a41ee84947b87f0f75026'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:38:15.469314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:15.476483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:15.477195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:15.478015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:15.479393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:15.483563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:15.808585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:38:15.827023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:15.872270 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc8278bb-ca9c-4f5e-95ff-532d3140d560 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.834166 Oct 17 15:38:15.874456 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1905/3560] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:15 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:15.927906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a40c6c37-8760-4093-b967-576362ef01ce tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:15.928933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a40c6c37-8760-4093-b967-576362ef01ce tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: e3deea4f-595d-48a8-bebb-c84eca3ebd4e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:15.947691 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a40c6c37-8760-4093-b967-576362ef01ce tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] HTTP exception thrown: Instance e3deea4f-595d-48a8-bebb-c84eca3ebd4e could not be found. Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a40c6c37-8760-4093-b967-576362ef01ce tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Request method failure captured: Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/e3deea4f-595d-48a8-bebb-c84eca3ebd4e/metadata HTTP/1.1 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbEhBDh7bfSpgKa3ehtlH-4FXYNhERkhydByZRsUgYHHCkRSnTKNWjtxGm3WSGPnUuZ-I09NE66DQRKWScaoVTWsO4Y8O__CjSAYVLEoIOdUjepMyafzbd8ZUG7Uq9pafAEf6a0DSRoQGjh3WojEbv4zCb8EJ-JWwplMPS2aUzJ4z8 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1cf3fcf647674f03a1d463d9d4dc129a Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e3deea4f-595d-48a8-bebb-c84eca3ebd4e could not be found. Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': 'e3deea4f-595d-48a8-bebb-c84eca3ebd4e'} Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3deea4f-595d-48a8-bebb-c84eca3ebd4e could not be found. Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3deea4f-595d-48a8-bebb-c84eca3ebd4e could not be found. Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:15.957772 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:15.962704 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:15.962704 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:15.962704 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3deea4f-595d-48a8-bebb-c84eca3ebd4e could not be found. Oct 17 15:38:15.962704 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:15.968692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a40c6c37-8760-4093-b967-576362ef01ce tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Returning 404 to user: Instance e3deea4f-595d-48a8-bebb-c84eca3ebd4e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:15.970623 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a40c6c37-8760-4093-b967-576362ef01ce tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/e3deea4f-595d-48a8-bebb-c84eca3ebd4e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.062124 Oct 17 15:38:15.971794 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1906/3561] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:38:15 2022] GET /compute/v2.1/servers/e3deea4f-595d-48a8-bebb-c84eca3ebd4e/metadata => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:38:15.988196 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f40d208a-dc24-4d89-8559-b0454be92b85 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.575577 Oct 17 15:38:15.992673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:16.000750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:16.015163 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1656/3562] 10.222.0.87 () {58 vars in 1150 bytes} [Mon Oct 17 15:38:15 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:16.032753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:16.034264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:16.035467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:16.039068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f60414fe-c3fd-4054-ba19-e7c601f7e591 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:16.041572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f60414fe-c3fd-4054-ba19-e7c601f7e591 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:16.042053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:16.043283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:16.046049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:16.067269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f60414fe-c3fd-4054-ba19-e7c601f7e591 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:16.070914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f60414fe-c3fd-4054-ba19-e7c601f7e591 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:16.071731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f60414fe-c3fd-4054-ba19-e7c601f7e591 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:16.078626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f60414fe-c3fd-4054-ba19-e7c601f7e591 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:16.087458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f60414fe-c3fd-4054-ba19-e7c601f7e591 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:16.088337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f60414fe-c3fd-4054-ba19-e7c601f7e591 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:16.269610 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f60414fe-c3fd-4054-ba19-e7c601f7e591 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action" status: 202 len: 0 microversion: 2.1 time: 0.250062 Oct 17 15:38:16.270544 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1657/3563] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:16 2022] POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:38:16.298462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:16.299986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:16.312981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:16.317006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:16.317625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:16.319732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:16.320511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:16.323945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:16.521717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:16.541953 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23ae5b71-b71d-40cd-8f15-0a75aaa4efeb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.567370 Oct 17 15:38:16.554123 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1907/3564] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:15 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:16.563947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb2a9593-a6f1-4ffc-8e4f-75e94240204b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-343759205", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb2a9593-a6f1-4ffc-8e4f-75e94240204b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Request method failure captured: Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 498 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbEhBDh7bfSpgKa3ehtlH-4FXYNhERkhydByZRsUgYHHCkRSnTKNWjtxGm3WSGPnUuZ-I09NE66DQRKWScaoVTWsO4Y8O__CjSAYVLEoIOdUjepMyafzbd8ZUG7Uq9pafAEf6a0DSRoQGjh3WojEbv4zCb8EJ-JWwplMPS2aUzJ4z8 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1cf3fcf647674f03a1d463d9d4dc129a Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-343759205", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-343759205', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '983d2c13-544a-45ae-bf2a-b899ba8809c9'}]}}} Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 15:38:16.572098 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb2a9593-a6f1-4ffc-8e4f-75e94240204b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:16.578404 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb2a9593-a6f1-4ffc-8e4f-75e94240204b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.014806 Oct 17 15:38:16.586272 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1908/3565] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:38:16 2022] POST /compute/v2.1/servers => generated 687 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:38:16.609196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29fcb403-26b3-4879-b5cd-acd4e091b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:16.609830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29fcb403-26b3-4879-b5cd-acd4e091b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:16.634274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29fcb403-26b3-4879-b5cd-acd4e091b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:16.639917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29fcb403-26b3-4879-b5cd-acd4e091b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:16.640528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29fcb403-26b3-4879-b5cd-acd4e091b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:16.641315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29fcb403-26b3-4879-b5cd-acd4e091b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:16.641809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29fcb403-26b3-4879-b5cd-acd4e091b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:16.642255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29fcb403-26b3-4879-b5cd-acd4e091b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:16.976538 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29fcb403-26b3-4879-b5cd-acd4e091b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1615 microversion: 2.1 time: 0.373554 Oct 17 15:38:16.984327 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1909/3566] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:16 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1615 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:17.000586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:17.001936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:17.021400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:17.023603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:17.025564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:17.028070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:17.029868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:17.030689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:17.077400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:38:17.237884 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-136ccf29-a4de-4721-8691-641f00e46fd6 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "DELETE /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 204 len: 0 microversion: 2.1 time: 0.251626 Oct 17 15:38:17.244685 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1910/3567] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:38:16 2022] DELETE /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:38:17.255106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eceb3576-2313-4859-a487-a5ac9025c8f3 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1029789636", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eceb3576-2313-4859-a487-a5ac9025c8f3 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Request method failure captured: Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 500 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbEhBDh7bfSpgKa3ehtlH-4FXYNhERkhydByZRsUgYHHCkRSnTKNWjtxGm3WSGPnUuZ-I09NE66DQRKWScaoVTWsO4Y8O__CjSAYVLEoIOdUjepMyafzbd8ZUG7Uq9pafAEf6a0DSRoQGjh3WojEbv4zCb8EJ-JWwplMPS2aUzJ4z8 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1cf3fcf647674f03a1d463d9d4dc129a Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1029789636", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1029789636', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '983d2c13-544a-45ae-bf2a-b899ba8809c9'}]}}} Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 15:38:17.277815 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:17.280867 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:17.286825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eceb3576-2313-4859-a487-a5ac9025c8f3 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:17.288120 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eceb3576-2313-4859-a487-a5ac9025c8f3 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.041949 Oct 17 15:38:17.289039 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1911/3568] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:38:17 2022] POST /compute/v2.1/servers => generated 689 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:38:17.318671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:17.327769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:17.338969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:17.347699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:17.357529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:17.359531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:17.360125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:17.360571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:17.701887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:17.722962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:17.736240 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e02b40d-4254-4494-b7e7-0e46f0cb6057 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.442427 Oct 17 15:38:17.737511 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1912/3569] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:17 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:17.755124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-198027e0-de84-4ada-b1f1-744a3b9f71ff tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:17.755875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-198027e0-de84-4ada-b1f1-744a3b9f71ff tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:17.761689 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a62c5c36-856f-41cb-8ea3-e87824470d17 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1350 microversion: 2.1 time: 1.487690 Oct 17 15:38:17.776878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198027e0-de84-4ada-b1f1-744a3b9f71ff tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:17.777516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198027e0-de84-4ada-b1f1-744a3b9f71ff tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:17.778072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198027e0-de84-4ada-b1f1-744a3b9f71ff tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:17.778954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198027e0-de84-4ada-b1f1-744a3b9f71ff tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:17.779612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198027e0-de84-4ada-b1f1-744a3b9f71ff tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:17.780075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-198027e0-de84-4ada-b1f1-744a3b9f71ff tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:17.785794 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1658/3570] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:16 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1350 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:17.798173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:17.812418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:17.832008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:17.835181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:17.838948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:17.841680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:17.845920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:17.852448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:18.269608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:18.283295 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-198027e0-de84-4ada-b1f1-744a3b9f71ff tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1615 microversion: 2.1 time: 0.543573 Oct 17 15:38:18.284027 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1913/3571] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:17 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1615 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:18.284976 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d7248839-dcbe-4d40-92f2-6598e31395f0 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1514 microversion: 2.1 time: 0.490526 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4dc6cd5c-aacd-4091-a093-d9ae3c8d6e7b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1893724405", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4dc6cd5c-aacd-4091-a093-d9ae3c8d6e7b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Request method failure captured: Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 754 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbEhBDh7bfSpgKa3ehtlH-4FXYNhERkhydByZRsUgYHHCkRSnTKNWjtxGm3WSGPnUuZ-I09NE66DQRKWScaoVTWsO4Y8O__CjSAYVLEoIOdUjepMyafzbd8ZUG7Uq9pafAEf6a0DSRoQGjh3WojEbv4zCb8EJ-JWwplMPS2aUzJ4z8 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1cf3fcf647674f03a1d463d9d4dc129a Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1893724405", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:18.301312 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1893724405', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '983d2c13-544a-45ae-bf2a-b899ba8809c9'}]}}} Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:38:18.304187 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4dc6cd5c-aacd-4091-a093-d9ae3c8d6e7b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4dc6cd5c-aacd-4091-a093-d9ae3c8d6e7b tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.014354 Oct 17 15:38:18.311138 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1914/3572] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:38:18 2022] POST /compute/v2.1/servers => generated 1197 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 17 15:38:18.319612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:18.319612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:18.322047 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1659/3573] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:17 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1514 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:18.353833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:18.355445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:18.355650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:18.356353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:18.357133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:18.357619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:18.358053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:18.376928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Searching by: {'host': 'n-h1-854441-12', 'deleted': False} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:38:18.406036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:18.406886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:18.417655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:18.419233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:18.420057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:18.420887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:18.477655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:18.820439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:18.833702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:38:18.855150 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a37a8845-2618-40b5-81e7-5f31fb1ac9fe tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.553690 Oct 17 15:38:18.863783 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1915/3574] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:18 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:18.895781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66bf37e1-ec54-444e-8ca1-9bd764dc8c8f tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1719183327", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66bf37e1-ec54-444e-8ca1-9bd764dc8c8f tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Request method failure captured: Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 1266 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbEhBDh7bfSpgKa3ehtlH-4FXYNhERkhydByZRsUgYHHCkRSnTKNWjtxGm3WSGPnUuZ-I09NE66DQRKWScaoVTWsO4Y8O__CjSAYVLEoIOdUjepMyafzbd8ZUG7Uq9pafAEf6a0DSRoQGjh3WojEbv4zCb8EJ-JWwplMPS2aUzJ4z8 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1cf3fcf647674f03a1d463d9d4dc129a Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1719183327", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "983d2c13-544a-45ae-bf2a-b899ba8809c9"}]}} Oct 17 15:38:18.930462 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1719183327', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '983d2c13-544a-45ae-bf2a-b899ba8809c9'}]}}} Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.934708 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:38:18.936800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:38:18.945679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 15:38:18.945679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:18.945679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66bf37e1-ec54-444e-8ca1-9bd764dc8c8f tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:18.945679 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66bf37e1-ec54-444e-8ca1-9bd764dc8c8f tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.075268 Oct 17 15:38:18.946974 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1916/3575] 10.222.0.87 () {60 vars in 1148 bytes} [Mon Oct 17 15:38:18 2022] POST /compute/v2.1/servers => generated 2221 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 17 15:38:18.982891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:18.985646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:19.038000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:19.038289 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-906c9171-1967-4498-a56d-f09722ca938d tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers?host=n-h1-854441-12&all_tenants=1" status: 200 len: 1981 microversion: 2.1 time: 0.705307 Oct 17 15:38:19.050580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:19.050580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:19.051033 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1660/3576] 10.222.0.87 () {58 vars in 1192 bytes} [Mon Oct 17 15:38:18 2022] GET /compute/v2.1/servers?host=n-h1-854441-12&all_tenants=1 => generated 1981 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:19.053549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:19.058357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:19.062005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:19.070009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:19.071207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:19.128209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:19.129032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:19.129731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:19.145262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:19.146175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:19.160715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:20.012318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:20.031142 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc42950f-c709-447e-931e-34d86bae4dc6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 1.073945 Oct 17 15:38:20.031804 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1917/3577] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:18 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:20.042443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-803124d9-1030-4718-bb64-58c817ec72ee tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:20.047911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-803124d9-1030-4718-bb64-58c817ec72ee tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 154af868-2a5b-4b07-bbc1-01f5078ddb18] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:20.058417 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-803124d9-1030-4718-bb64-58c817ec72ee tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] HTTP exception thrown: Instance 154af868-2a5b-4b07-bbc1-01f5078ddb18 could not be found. Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-803124d9-1030-4718-bb64-58c817ec72ee tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Request method failure captured: Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/154af868-2a5b-4b07-bbc1-01f5078ddb18/metadata/test2 HTTP/1.1 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbEhBDh7bfSpgKa3ehtlH-4FXYNhERkhydByZRsUgYHHCkRSnTKNWjtxGm3WSGPnUuZ-I09NE66DQRKWScaoVTWsO4Y8O__CjSAYVLEoIOdUjepMyafzbd8ZUG7Uq9pafAEf6a0DSRoQGjh3WojEbv4zCb8EJ-JWwplMPS2aUzJ4z8 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1cf3fcf647674f03a1d463d9d4dc129a Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 154af868-2a5b-4b07-bbc1-01f5078ddb18 could not be found. Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': '154af868-2a5b-4b07-bbc1-01f5078ddb18', 'id': 'test2'} Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154af868-2a5b-4b07-bbc1-01f5078ddb18 could not be found. Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154af868-2a5b-4b07-bbc1-01f5078ddb18 could not be found. Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:20.064440 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:20.068530 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:20.068530 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:20.068530 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154af868-2a5b-4b07-bbc1-01f5078ddb18 could not be found. Oct 17 15:38:20.068530 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:20.069836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-803124d9-1030-4718-bb64-58c817ec72ee tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Returning 404 to user: Instance 154af868-2a5b-4b07-bbc1-01f5078ddb18 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:20.070990 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-803124d9-1030-4718-bb64-58c817ec72ee tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/154af868-2a5b-4b07-bbc1-01f5078ddb18/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.038216 Oct 17 15:38:20.086394 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1918/3578] 10.222.0.87 () {58 vars in 1281 bytes} [Mon Oct 17 15:38:20 2022] GET /compute/v2.1/servers/154af868-2a5b-4b07-bbc1-01f5078ddb18/metadata/test2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:38:20.094350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db54db09-02a4-4e6f-825e-f0c51cf41f81 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:20.105496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db54db09-02a4-4e6f-825e-f0c51cf41f81 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:38:20.126640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db54db09-02a4-4e6f-825e-f0c51cf41f81 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:20.133784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db54db09-02a4-4e6f-825e-f0c51cf41f81 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:20.134420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db54db09-02a4-4e6f-825e-f0c51cf41f81 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:20.135477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db54db09-02a4-4e6f-825e-f0c51cf41f81 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:20.136210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db54db09-02a4-4e6f-825e-f0c51cf41f81 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:20.136824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db54db09-02a4-4e6f-825e-f0c51cf41f81 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:20.485110 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db54db09-02a4-4e6f-825e-f0c51cf41f81 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.395398 Oct 17 15:38:20.490806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1919/3579] 10.222.0.87 () {58 vars in 1196 bytes} [Mon Oct 17 15:38:20 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:38:20.521225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:20.522280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:20.545695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:20.551013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:20.551963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:20.555283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:20.556227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:20.557021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:20.732430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:20.748595 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2bab0960-91e4-4af9-9ce5-88477132979c tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1350 microversion: 2.1 time: 1.696745 Oct 17 15:38:20.755461 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1661/3580] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:19 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1350 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:20.768553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:20.769836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:20.784525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:20.787179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:20.790120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:20.791300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:20.792096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:20.792745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:21.225294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:21.254863 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5a9f00c-e753-4855-8918-7d99a353e5e5 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1514 microversion: 2.1 time: 0.761110 Oct 17 15:38:21.272313 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1920/3581] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:20 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1514 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:21.302141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:21.317625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:21.344030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:21.346901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:21.348988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:21.352132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:21.353332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:21.354886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:21.441261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:38:21.496511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:21.506021 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-55122590-9aff-45ec-93e5-d3c3a1195461 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.748947 Oct 17 15:38:21.511309 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1662/3582] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:20 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:21.543962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-82829a53-9307-4f87-b3c0-b4fd6e32b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:21.555379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-82829a53-9307-4f87-b3c0-b4fd6e32b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:21.582122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82829a53-9307-4f87-b3c0-b4fd6e32b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:21.584816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82829a53-9307-4f87-b3c0-b4fd6e32b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:21.590165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82829a53-9307-4f87-b3c0-b4fd6e32b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:21.595049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82829a53-9307-4f87-b3c0-b4fd6e32b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:21.602080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82829a53-9307-4f87-b3c0-b4fd6e32b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:21.602733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82829a53-9307-4f87-b3c0-b4fd6e32b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:21.798955 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-82829a53-9307-4f87-b3c0-b4fd6e32b06a tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action" status: 202 len: 0 microversion: 2.1 time: 0.285801 Oct 17 15:38:21.800555 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1663/3583] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:21 2022] POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:38:21.820405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:21.823940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:21.842308 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-542a8591-3cd2-4bf1-8851-82ae73420e8a tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 204 len: 0 microversion: 2.1 time: 0.557680 Oct 17 15:38:21.846479 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1921/3584] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:38:21 2022] DELETE /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:38:21.851594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-489195aa-0fd9-47eb-92b9-8cac276e9705 req-0876b75a-4623-4cf5-920b-8d12d49476ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd14a0a-9efd-4417-9e37-147e3721bf15", "name": "network-vif-deleted", "tag": "cf1b76f6-fa42-4e61-bd1e-9c9a3d09ed43"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:21.854837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:21.856953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:21.857723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:21.861678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:21.863026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:21.863845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-489195aa-0fd9-47eb-92b9-8cac276e9705 req-0876b75a-4623-4cf5-920b-8d12d49476ed service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:21.864335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-489195aa-0fd9-47eb-92b9-8cac276e9705 req-0876b75a-4623-4cf5-920b-8d12d49476ed service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:21.865033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-489195aa-0fd9-47eb-92b9-8cac276e9705 req-0876b75a-4623-4cf5-920b-8d12d49476ed service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:21.866658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:21.882600 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-489195aa-0fd9-47eb-92b9-8cac276e9705 req-0876b75a-4623-4cf5-920b-8d12d49476ed service nova] Creating event network-vif-deleted:cf1b76f6-fa42-4e61-bd1e-9c9a3d09ed43 for instance edd14a0a-9efd-4417-9e37-147e3721bf15 on n-h2-854441-12 Oct 17 15:38:21.895401 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-489195aa-0fd9-47eb-92b9-8cac276e9705 req-0876b75a-4623-4cf5-920b-8d12d49476ed service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045041 Oct 17 15:38:21.900133 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1922/3585] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:21.916774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:21.918828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:21.952086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:21.953716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:21.957415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:21.958976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:21.959991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:21.960829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:22.356291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:22.371005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:22.402880 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5aee2822-298c-49b7-996a-c8b3f6e2b5d6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1682 microversion: 2.1 time: 0.598375 Oct 17 15:38:22.422656 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1664/3586] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:21 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1682 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:22.438469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:22.442725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:22.452267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:22.453116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:22.453719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:22.454714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:22.455652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:22.456266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:22.683701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:22.704393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:22.738609 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-069ef8de-24ae-46b1-bc8c-d33f26820103 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1539 microversion: 2.1 time: 0.831164 Oct 17 15:38:22.744131 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1923/3587] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:21 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1539 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:22.773209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:38:22.773642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:22.773896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:38:22.774873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:22.782539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:38:22.783919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:38:22.790458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:38:22.803690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:22.804554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:22.805279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:22.806467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:22.809854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:22.810620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:22.914324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=18 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:22.936625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:22.944907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:22.945792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:22.946445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:22.947679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:22.948483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:22.949189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:22.983351 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-671cfd0f-8f46-4548-a22f-3caa9eb0f188 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action" status: 202 len: 1066 microversion: 2.1 time: 0.559003 Oct 17 15:38:22.984427 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1665/3588] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:22 2022] POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action => generated 1066 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 15:38:22.990602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:22.991743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:23.011981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:23.015684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:23.016375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:23.021184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:23.022326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:23.024045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:23.113770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:23.117072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:23.118374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:23.119257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lazy-loading 'fault' on Instance uuid edd14a0a-9efd-4417-9e37-147e3721bf15 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:38:23.223360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:23.239590 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4fdf30b9-deb6-4e41-a93f-577ec93f02c4 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1308 microversion: 2.1 time: 0.253565 Oct 17 15:38:23.240524 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1666/3589] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:22 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:23.253212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:23.253841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:23.266761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:23.267265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:23.267878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:23.268629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:23.269092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:23.269522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:23.777736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:23.791856 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d394de2-e411-4834-91ca-b0560f2db3a6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.550102 Oct 17 15:38:23.799530 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1667/3590] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:23 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:23.805754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cb85f873-0d33-42c7-b2d8-1770d1c2b692 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:23.812217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cb85f873-0d33-42c7-b2d8-1770d1c2b692 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:23.824346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:23.833480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb85f873-0d33-42c7-b2d8-1770d1c2b692 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:23.834123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb85f873-0d33-42c7-b2d8-1770d1c2b692 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:23.834730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb85f873-0d33-42c7-b2d8-1770d1c2b692 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:23.836326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb85f873-0d33-42c7-b2d8-1770d1c2b692 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:23.839421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb85f873-0d33-42c7-b2d8-1770d1c2b692 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:23.840295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb85f873-0d33-42c7-b2d8-1770d1c2b692 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:23.842467 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-552261ab-12e5-4f0c-935b-6ad036e48c9e tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1525 microversion: 2.1 time: 1.096760 Oct 17 15:38:23.843128 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1924/3591] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:22 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1525 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:23.867927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:23.868702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:23.888053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:23.888579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:23.889011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:23.899482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:23.908194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:23.909207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:24.148868 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cb85f873-0d33-42c7-b2d8-1770d1c2b692 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.348096 Oct 17 15:38:24.150088 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1668/3592] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:38:23 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe/os-interface => generated 284 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:24.156357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:24.157189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:24.180161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:24.183203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:24.183793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:24.187220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:24.188767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:24.190907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:24.265640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:24.275433 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e62567a-7a76-4145-b612-74169a99df5c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1470 microversion: 2.1 time: 0.431205 Oct 17 15:38:24.294245 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1925/3593] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:23 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1470 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:24.314858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:24.317169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:24.343933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:24.344737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:24.345219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:24.346072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:24.346576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:24.347010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:24.479126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:24.481404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:24.482401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:24.483224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lazy-loading 'fault' on Instance uuid edd14a0a-9efd-4417-9e37-147e3721bf15 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:38:24.622983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:24.635457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-463279c2-ca60-40cb-8739-5a004bf7231e tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 200 len: 1308 microversion: 2.1 time: 0.339921 Oct 17 15:38:24.637105 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1926/3594] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:24 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:24.776223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:24.784591 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-42e94d5f-ec8e-446c-9a2d-f9bdaef8f7e4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.633335 Oct 17 15:38:24.796050 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1669/3595] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:24 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:24.817444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:24.818355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:24.828407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:24.829611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:24.830336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:24.831461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:24.832253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:24.832845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:24.866440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:24.867087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:24.880112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:24.880537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:24.880979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:24.881705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:24.882481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:24.882947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:25.196470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:25.212562 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f63e11bf-5bb2-4928-9a48-a45026df500f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.398757 Oct 17 15:38:25.213772 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1927/3596] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:24 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:25.223473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:25.225331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:25.237588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:25.239100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:25.239954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:25.241351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:25.242277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:25.243186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:25.620549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:25.681232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee11ed59-1f17-434d-be82-619f1f6fdb90 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.465007 Oct 17 15:38:25.707844 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1928/3597] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:25 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:25.716694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:25.723569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:25.739816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:25.740739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:25.741354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:25.742352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:25.743079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:25.743682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:25.749833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:25.764384 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cef3cc3f-d64c-4f5f-a76a-e6b86d698ae5 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1525 microversion: 2.1 time: 0.902026 Oct 17 15:38:25.765844 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1670/3598] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:24 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1525 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:25.784738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-31ece287-1cd8-494e-b41c-ef78dfceb8ac req-543661af-4276-4adf-964a-a4894a9a118b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebd3ad5-adb6-4e86-87fb-348e03f91f8b", "name": "network-vif-deleted", "tag": "87af1e61-fab5-458d-8b8c-a0719fce1a7b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:25.838876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-31ece287-1cd8-494e-b41c-ef78dfceb8ac req-543661af-4276-4adf-964a-a4894a9a118b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:25.843272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-31ece287-1cd8-494e-b41c-ef78dfceb8ac req-543661af-4276-4adf-964a-a4894a9a118b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:25.848684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-31ece287-1cd8-494e-b41c-ef78dfceb8ac req-543661af-4276-4adf-964a-a4894a9a118b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:25.869335 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-31ece287-1cd8-494e-b41c-ef78dfceb8ac req-543661af-4276-4adf-964a-a4894a9a118b service nova] Creating event network-vif-deleted:87af1e61-fab5-458d-8b8c-a0719fce1a7b for instance 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b on n-h2-854441-12 Oct 17 15:38:25.882203 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-31ece287-1cd8-494e-b41c-ef78dfceb8ac req-543661af-4276-4adf-964a-a4894a9a118b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108625 Oct 17 15:38:25.892991 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1671/3599] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:25.898675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:25.901604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: edd14a0a-9efd-4417-9e37-147e3721bf15] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:25.926034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:25.926888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:25.927513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:25.932063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:25.932758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:25.933377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:25.955347 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] HTTP exception thrown: Instance edd14a0a-9efd-4417-9e37-147e3721bf15 could not be found. Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Request method failure captured: Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 HTTP/1.1 Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYcs06JRwA8m7iWHMOFbjib1395PTm1-kPGhd3iAngcD4SFDHFIrCLQqTO_vua340rg5Rn2WwCsBt_tpYIL0edOuw_irMCsimnKO9rIMpAqkafABN0tEfCg6isLqdXUvEzXUzOVWG181wDAHQx28gsmZ-rMT9zMFBlb8LoSarnnbdI Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2455cda838ea4befb6a3702d07b7b1ca Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesAdminNegativeTest-1583779408 Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2455cda838ea4befb6a3702d07b7b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2455cda838ea4befb6a3702d07b7b1ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2455cda838ea4befb6a3702d07b7b1ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2455cda838ea4befb6a3702d07b7b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesAdminNegativeTest-1583779408 Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2455cda838ea4befb6a3702d07b7b1ca Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1583779408 Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesAdminNegativeTest-1583779408-project Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 1a75d59cdb6f45df9fc90e515601a4be Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesAdminNegativeTest-1583779408-project Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance edd14a0a-9efd-4417-9e37-147e3721bf15 could not be found. Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'edd14a0a-9efd-4417-9e37-147e3721bf15'} Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd14a0a-9efd-4417-9e37-147e3721bf15 could not be found. Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd14a0a-9efd-4417-9e37-147e3721bf15 could not be found. Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:25.961834 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:25.966366 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:25.966366 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:25.966366 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:25.966366 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:25.966366 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:25.966366 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd14a0a-9efd-4417-9e37-147e3721bf15 could not be found. Oct 17 15:38:25.966366 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:25.979252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Returning 404 to user: Instance edd14a0a-9efd-4417-9e37-147e3721bf15 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:25.980534 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab2dddf8-95d1-4f59-a072-29b835ee0807 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15" status: 404 len: 111 microversion: 2.1 time: 0.086336 Oct 17 15:38:25.992670 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1672/3600] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:25 2022] GET /compute/v2.1/servers/edd14a0a-9efd-4417-9e37-147e3721bf15 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:38:26.239979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:26.240751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:26.256067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:26.256802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:26.257592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:26.258465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:26.258970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:26.259408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:26.514440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:26.523258 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f492b387-dd97-46d6-938c-07af96d0d7bd tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1470 microversion: 2.1 time: 0.811954 Oct 17 15:38:26.523875 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1929/3601] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:25 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1470 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:26.806739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:26.807660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:26.827806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:26.831274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:26.834842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:26.837297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:26.842899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:26.845928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:26.959115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:26.984184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:26.987784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:26.988467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:26.989122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lazy-loading 'fault' on Instance uuid 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:38:27.235032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3fcf647674f03a1d463d9d4dc129a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c103cb8ac79d495c8e0358c26554f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:27.249187 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24779ef3-ba06-4f7b-bd07-db79e36d0798 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 200 len: 1313 microversion: 2.1 time: 0.446457 Oct 17 15:38:27.250011 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1930/3602] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:26 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:27.448266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:27.485111 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-978e6d65-fa9e-46c0-b3ec-fbd5b09b367d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 1.246404 Oct 17 15:38:27.488454 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1673/3603] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:26 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:27.551217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:27.553008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:27.597860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:27.601693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:27.609624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:27.620186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:27.621653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:27.622750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:27.834527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-aa3e5136-4e9d-4aa9-8aef-6f1f9b71a4ce req-aeec6c7a-b41d-458a-91f7-c14586bf2d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "name": "network-vif-unplugged", "status": "completed", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:27.855508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-aa3e5136-4e9d-4aa9-8aef-6f1f9b71a4ce req-aeec6c7a-b41d-458a-91f7-c14586bf2d90 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:27.856133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-aa3e5136-4e9d-4aa9-8aef-6f1f9b71a4ce req-aeec6c7a-b41d-458a-91f7-c14586bf2d90 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:27.856462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-aa3e5136-4e9d-4aa9-8aef-6f1f9b71a4ce req-aeec6c7a-b41d-458a-91f7-c14586bf2d90 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:27.886077 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-aa3e5136-4e9d-4aa9-8aef-6f1f9b71a4ce req-aeec6c7a-b41d-458a-91f7-c14586bf2d90 service nova] Creating event network-vif-unplugged:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:38:27.900578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-aa3e5136-4e9d-4aa9-8aef-6f1f9b71a4ce req-aeec6c7a-b41d-458a-91f7-c14586bf2d90 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070488 Oct 17 15:38:27.901766 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1674/3604] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:38:28.383457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:28.399584 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2355f0b-ce9f-4b81-b0a8-4b22491853f5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1470 microversion: 2.1 time: 0.852963 Oct 17 15:38:28.416480 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1931/3605] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:27 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1470 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:28.422896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:28.423973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] [instance: 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:28.431269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:28.432024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:28.432692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:28.434030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:28.434722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:28.435450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:28.463312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] HTTP exception thrown: Instance 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b could not be found. Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Request method failure captured: Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b HTTP/1.1 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXbEhBDh7bfSpgKa3ehtlH-4FXYNhERkhydByZRsUgYHHCkRSnTKNWjtxGm3WSGPnUuZ-I09NE66DQRKWScaoVTWsO4Y8O__CjSAYVLEoIOdUjepMyafzbd8ZUG7Uq9pafAEf6a0DSRoQGjh3WojEbv4zCb8EJ-JWwplMPS2aUzJ4z8 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c103cb8ac79d495c8e0358c26554f619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: c103cb8ac79d495c8e0358c26554f619 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-498029377 Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1cf3fcf647674f03a1d463d9d4dc129a Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-498029377-project Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b could not be found. Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '7ebd3ad5-adb6-4e86-87fb-348e03f91f8b'} Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b could not be found. Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b could not be found. Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:28.466541 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:28.471367 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:28.471367 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:28.471367 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:28.471367 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:28.471367 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:28.471367 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:28.471367 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b could not be found. Oct 17 15:38:28.471367 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:28.475210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] Returning 404 to user: Instance 7ebd3ad5-adb6-4e86-87fb-348e03f91f8b could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:28.477724 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a93c7fb0-5c6f-41cf-9edc-9488724f43a7 tempest-ServerMetadataNegativeTestJSON-498029377 tempest-ServerMetadataNegativeTestJSON-498029377-project] 10.222.0.87 "GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b" status: 404 len: 111 microversion: 2.1 time: 0.059635 Oct 17 15:38:28.492060 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1932/3606] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:28 2022] GET /compute/v2.1/servers/7ebd3ad5-adb6-4e86-87fb-348e03f91f8b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:38:28.528563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:28.546183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:28.547447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:28.577186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:28.579017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:28.581849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:28.584042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:28.585151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:28.585993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:28.710950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e1358b1e-577d-4427-893b-0bab46453083 req-ae088aa7-d8a2-4aaf-8f3e-b3b02b8a710b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c85e2a-7d17-4fd4-b273-161a7cf90dbe", "tag": "94333ecc-4a6c-4e40-b248-a1300c3ac6b6"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:28.740442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e1358b1e-577d-4427-893b-0bab46453083 req-ae088aa7-d8a2-4aaf-8f3e-b3b02b8a710b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:28.747212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e1358b1e-577d-4427-893b-0bab46453083 req-ae088aa7-d8a2-4aaf-8f3e-b3b02b8a710b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:28.748819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e1358b1e-577d-4427-893b-0bab46453083 req-ae088aa7-d8a2-4aaf-8f3e-b3b02b8a710b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:28.802749 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e1358b1e-577d-4427-893b-0bab46453083 req-ae088aa7-d8a2-4aaf-8f3e-b3b02b8a710b service nova] Creating event network-changed:94333ecc-4a6c-4e40-b248-a1300c3ac6b6 for instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe on n-h2-854441-12 Oct 17 15:38:28.829744 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e1358b1e-577d-4427-893b-0bab46453083 req-ae088aa7-d8a2-4aaf-8f3e-b3b02b8a710b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.709604 Oct 17 15:38:28.831941 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1675/3607] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:38:29.432085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:29.435733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:29.469478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:29.470756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:29.471522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:29.474728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:29.475562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:29.479420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:30.292845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:30.334605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:30.380423 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c62e59ad-479c-43ca-8223-94fb86e30a3c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1470 microversion: 2.1 time: 0.959065 Oct 17 15:38:30.411019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1676/3608] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:29 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1470 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:30.444738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:30.446118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:30.473110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:30.475148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:30.476201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:30.478613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:30.479695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:30.480932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:31.001139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:31.065146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2a1231c-ea00-441a-9301-ade6ee76c234 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 2.520702 Oct 17 15:38:31.079442 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1933/3609] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:28 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 2538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:31.092498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:31.141271 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bffe1335-aa81-438f-ade5-416515be6c4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.728460 Oct 17 15:38:31.149566 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1677/3610] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:30 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:31.167615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:31.168252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:31.175294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:31.175813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:31.176252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:31.177272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:31.177747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:31.178289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:31.432504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:31.439406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:31.480566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:31.481384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:31.482109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:31.488771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:31.494474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:31.495495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:32.190757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:32.202748 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-70b37a00-62d8-4d9d-a868-c927e6fe5a88 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1470 microversion: 2.1 time: 0.777621 Oct 17 15:38:32.209737 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1678/3611] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:31 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1470 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:32.227919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:32.230989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:32.259008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:32.261301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:32.263899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:32.266860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:32.267561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:32.271814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:32.952272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:32.965957 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2e337ca5-df95-4d3a-86c6-a750796dcac1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.754622 Oct 17 15:38:32.983390 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1679/3612] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:32 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:33.253061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:33.253734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:33.269724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:33.270567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:33.271194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:33.272236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:33.272906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:33.273550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:33.484526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:33.507573 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1050089a-26c9-4ed3-9e7b-da1f849c1f73 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 2.342204 Oct 17 15:38:33.509642 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1934/3613] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:31 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:33.552886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:33.553798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:33.573552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:33.574268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:33.574760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:33.575557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:33.576036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:33.576548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:33.972548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:33.991552 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d9c82fd7-9d55-41c0-b77e-0c196440bacd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.444411 Oct 17 15:38:33.992594 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1935/3614] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:33 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:34.033606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:34.041217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:34.065219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.065650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.066113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:34.067559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.068242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.068977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:34.125372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:34.137593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-15c20b5c-78d5-4e40-b221-c73077493607 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1470 microversion: 2.1 time: 0.888415 Oct 17 15:38:34.141668 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1680/3615] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:33 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1470 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:34.164553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cff2c1d8-36ec-475f-8216-f75f8244d0aa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:34.170677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cff2c1d8-36ec-475f-8216-f75f8244d0aa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:34.193263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff2c1d8-36ec-475f-8216-f75f8244d0aa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.194163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff2c1d8-36ec-475f-8216-f75f8244d0aa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.194993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff2c1d8-36ec-475f-8216-f75f8244d0aa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:34.196751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff2c1d8-36ec-475f-8216-f75f8244d0aa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.197641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff2c1d8-36ec-475f-8216-f75f8244d0aa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.198445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cff2c1d8-36ec-475f-8216-f75f8244d0aa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:34.302096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:34.355039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cff2c1d8-36ec-475f-8216-f75f8244d0aa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.211177 Oct 17 15:38:34.357189 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1681/3616] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:34 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:38:34.401397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:34.407547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:34.429345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.434374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.435334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:34.436355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.450072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.451857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:34.626263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:34.640677 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3c46f2c-ad69-492c-8614-bf8603743b13 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.646487 Oct 17 15:38:34.643369 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1936/3617] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:33 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:34.660180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:34.661081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:34.682659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.685874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.688280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:34.689957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.692375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.693053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:34.735503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:38:34.862613 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ea6e24a-7751-44ad-8cc1-469da5290ec2 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 204 len: 0 microversion: 2.1 time: 0.208984 Oct 17 15:38:34.865072 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1937/3618] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:38:34 2022] DELETE /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:38:34.891765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:34.893320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:34.908215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.910754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.911578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:34.913264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:34.914271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:34.915174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:35.281795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:35.289227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:35.295153 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a9ffd6c-882e-4763-b242-3347c7fa5a4a tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1683 microversion: 2.1 time: 0.421963 Oct 17 15:38:35.295906 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1938/3619] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:34 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1683 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:35.461653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ff55bc7-48d5-47f8-b56c-e4b838491a70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Action: 'create', calling method: .version_select at 0x7f28be0fa940>, body: {"keypair": {"name": "tempest-keypair-1359816970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKtFzwvmaDOMoclK0bvdXI5Kkscmju7xPbekJtMJd1INSkYHNWrCpsNL4d6d5UWSaSJ3GZETvVWBW7SLEcT4qYek8XWXU8RoW8yigN9DCr23unvkvfmbewRf2HVohFFxQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:35.485697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3ff55bc7-48d5-47f8-b56c-e4b838491a70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Getting quotas for project 22cbf1b0a6144426a471e575780008d0. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:35.495874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3ff55bc7-48d5-47f8-b56c-e4b838491a70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Getting quotas for user 2efb895f046347a6914397c323e21d1b and project 22cbf1b0a6144426a471e575780008d0. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:35.547914 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ff55bc7-48d5-47f8-b56c-e4b838491a70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.243706 Oct 17 15:38:35.547914 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1939/3620] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:38:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:35.570009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:35.571608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:35.574291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:35.600068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:35.602188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:35.603332 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-148a1882-a689-4ae0-941e-b6896ba9898e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1671 microversion: 2.1 time: 1.211593 Oct 17 15:38:35.604330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:35.607937 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1682/3621] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:34 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1671 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:35.619907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:35.620901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:35.628842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:35.671587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:35.672484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:35.684981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:35.688003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:35.689708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:35.694079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:35.696736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:35.697929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:36.202912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:36.230419 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7df0674a-93e4-45d8-b0b6-1c2099917edd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.564761 Oct 17 15:38:36.232476 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1683/3622] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:35 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:36.332974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:36.334839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:36.345907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:36.363618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:36.364778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:36.365754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:36.367221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:36.368475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:36.369234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:36.390854 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d877a47d-61a1-46f6-bcc9-f6e614fb13bf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1470 microversion: 2.1 time: 0.846312 Oct 17 15:38:36.398704 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1940/3623] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:35 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1470 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:36.651101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:36.651801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:36.669590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:36.670443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:36.671224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:36.672449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:36.673658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:36.675798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:37.538489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:37.561665 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7cc12c55-c1d7-4a20-a50f-e0ffdfcbbc04 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1683 microversion: 2.1 time: 1.241725 Oct 17 15:38:37.585079 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1684/3624] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:36 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1683 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:37.611914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:37.613082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:37.633428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:37.635215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:37.636083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:37.637348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:37.638162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:37.639137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:37.753116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:37.771614 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e949ab0c-23e3-4391-88b4-40cb03d98a7b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1671 microversion: 2.1 time: 1.125321 Oct 17 15:38:37.773616 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1941/3625] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:36 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1671 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:37.783708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:37.785275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:37.798307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:37.800781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:37.801894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:37.803561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:37.804688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:37.805744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:38.041985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:38.051659 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef4f8b5c-1a7b-4b9a-90fa-f5dccd5c7ef2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.461784 Oct 17 15:38:38.059106 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1685/3626] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:37 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:38.513567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:38.531583 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2452251-a43d-4980-a627-2a4d96f5ee7d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1470 microversion: 2.1 time: 0.756001 Oct 17 15:38:38.532109 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1942/3627] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:37 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1470 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:38.603299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:38.605514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:38.617620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=93 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:38.620753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:38.621927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:38.622898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:38.624647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:38.625776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:38.626880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:38.821240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:38.822558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:38.833737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:38.834722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:38.835380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:38.836296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:38.836928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:38.837634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:39.066228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:39.088948 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2cad07fb-392f-433f-a560-ce8cad6ba0aa tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1683 microversion: 2.1 time: 0.493957 Oct 17 15:38:39.090111 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1686/3628] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:38 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1683 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:39.100733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:39.101568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:39.109026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:39.109914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:39.111429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:39.112532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:39.113331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:39.114200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:39.642720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:39.660668 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f2a92418-8702-43bf-aa26-0af11d030b30 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1502 microversion: 2.1 time: 0.568116 Oct 17 15:38:39.662669 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1687/3629] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:39 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1502 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:39.674441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:39.675608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:39.685713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:39.686385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:39.687150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:39.690211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:39.692069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:39.692769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:39.925451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:39.944048 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e640104-3e90-4c74-b9f8-6393b7f2bcc7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1676 microversion: 2.1 time: 1.118968 Oct 17 15:38:39.945623 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1943/3630] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:38 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1676 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:39.953825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36b4c702-bf9e-4db2-83fe-b1ba58b02d59"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:39.967346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:39.979373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:39.980025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:39.980709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:39.981686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:39.985866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:39.986481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:40.039300 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] HTTP exception thrown: Cannot 'attach_volume' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state rescued Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Request method failure captured: Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/os-volume_attachments HTTP/1.1 Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 74 Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXZ8kmtUPZWb3G0RLc0tH4XVjR5C-7gTVa04Om70uUY0S3ObDBITuVYe9LE38K5_JYHog2FWX-dPJIO8BZMjXqs1lpG_ioDhvbA748hUDdgAKK6oZjLCKHY9A2JeDwuSv8UPAoiN-E1QRQdYcKH6OumXVNNcIN16WkTnV4IzILKrXLw Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ea396576a90246cb8b821cb2afec9170 Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: {"volumeAttachment": {"volumeId": "36b4c702-bf9e-4db2-83fe-b1ba58b02d59"}} Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'attach_volume' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state rescued Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': 'c54ae4a0-4fdc-4128-85a3-f39fdb907468', 'body': {'volumeAttachment': {'volumeId': '36b4c702-bf9e-4db2-83fe-b1ba58b02d59'}}} Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 15:38:40.041744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state rescued Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state rescued Oct 17 15:38:40.046743 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:40.054018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Returning 409 to user: Cannot 'attach_volume' instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 while it is in vm_state rescued {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:40.055634 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd2ac7aa-f4be-4253-8d24-7a899b962a21 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.108679 Oct 17 15:38:40.059251 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1944/3631] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:38:39 2022] POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/os-volume_attachments => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:38:40.069807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e6e2197-dcbd-4c6c-a526-03ed22300db7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:40.080875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e6e2197-dcbd-4c6c-a526-03ed22300db7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:40.099008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e6e2197-dcbd-4c6c-a526-03ed22300db7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:40.102763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e6e2197-dcbd-4c6c-a526-03ed22300db7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:40.107007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e6e2197-dcbd-4c6c-a526-03ed22300db7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:40.108248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e6e2197-dcbd-4c6c-a526-03ed22300db7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:40.108959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e6e2197-dcbd-4c6c-a526-03ed22300db7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:40.109637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e6e2197-dcbd-4c6c-a526-03ed22300db7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:40.394787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:40.404295 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e6e2197-dcbd-4c6c-a526-03ed22300db7 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action" status: 202 len: 0 microversion: 2.1 time: 0.323551 Oct 17 15:38:40.405057 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1945/3632] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:40 2022] POST /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:38:40.420265 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-77d8776b-f625-4d49-9c6c-82fa15e920d5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1470 microversion: 2.1 time: 0.755756 Oct 17 15:38:40.420881 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1688/3633] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:39 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1470 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:40.425443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:40.430329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:40.436299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-933578878", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "13900165-1d6e-4307-97f0-3c55f46cd016"}], "security_groups": [{"name": "tempest-securitygroup--52450500"}], "key_name": "tempest-keypair-1359816970", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:40.448281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:40.450085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:40.451528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:40.454313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:40.458111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:40.459122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:40.703647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] validate_networks() for [('13900165-1d6e-4307-97f0-3c55f46cd016', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:38:41.305139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:41.333697 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6405a02d-40ba-4bfb-8a39-07cc06f365ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1683 microversion: 2.1 time: 0.915511 Oct 17 15:38:41.335684 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1946/3634] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:40 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1683 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:41.379761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:41.383374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:41.400125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:41.400725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:41.401580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:41.402995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:41.408513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:41.409340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:42.013711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Getting quotas for project 22cbf1b0a6144426a471e575780008d0. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:42.046279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Getting quotas for user 2efb895f046347a6914397c323e21d1b and project 22cbf1b0a6144426a471e575780008d0. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:42.095757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:38:42.096485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:38:42.097138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:38:42.097887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:38:42.098600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:38:42.111380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:42.112158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:42.120717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:42.122158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:42.123368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:42.124071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:42.151840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Getting quotas for project 22cbf1b0a6144426a471e575780008d0. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:42.173431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Getting quotas for user 2efb895f046347a6914397c323e21d1b and project 22cbf1b0a6144426a471e575780008d0. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:42.203303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:38:42.206745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:38:42.311253 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-748f10f2-e8c2-4730-8d13-566a1ab95af6 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.888838 Oct 17 15:38:42.337400 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1689/3635] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:38:40 2022] POST /compute/v2.1/servers => generated 407 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:38:42.345624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:42.346588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:42.355317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:42.356215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:42.357121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:42.357812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:42.358758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:42.359522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:42.361894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:42.394041 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-377bd909-657b-4570-a755-b163c6f3a98b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1510 microversion: 2.1 time: 1.043901 Oct 17 15:38:42.411051 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1947/3636] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:41 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1510 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:42.435080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:42.436177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:42.447698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:42.448661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:42.449866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:42.451429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:42.452501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:42.453576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:42.646055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:42.664133 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1b259b9e-09e0-485a-b277-0b82d19ed2fe tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.323527 Oct 17 15:38:42.681585 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1690/3637] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:42 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:42.720083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-968f04fa-6996-4480-89e6-2cc1d68ea2c5 req-f6707e01-0611-4329-9c98-27310b37b333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bd75eb-4c68-4e49-8276-dc76c5d09d01", "name": "network-vif-unplugged", "status": "completed", "tag": "78fdf66f-958a-4ebb-8391-c05f8eef6e51"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:42.779233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-968f04fa-6996-4480-89e6-2cc1d68ea2c5 req-f6707e01-0611-4329-9c98-27310b37b333 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:42.779751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-968f04fa-6996-4480-89e6-2cc1d68ea2c5 req-f6707e01-0611-4329-9c98-27310b37b333 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:42.783556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-968f04fa-6996-4480-89e6-2cc1d68ea2c5 req-f6707e01-0611-4329-9c98-27310b37b333 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:42.832910 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-968f04fa-6996-4480-89e6-2cc1d68ea2c5 req-f6707e01-0611-4329-9c98-27310b37b333 service nova] Creating event network-vif-unplugged:78fdf66f-958a-4ebb-8391-c05f8eef6e51 for instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 on n-h1-854441-12 Oct 17 15:38:42.856137 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-968f04fa-6996-4480-89e6-2cc1d68ea2c5 req-f6707e01-0611-4329-9c98-27310b37b333 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171197 Oct 17 15:38:42.860061 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1691/3638] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:42.870911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-27665df3-0aa0-45ff-a228-d054f30702c8 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:42.878114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-27665df3-0aa0-45ff-a228-d054f30702c8 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:43.059117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-27665df3-0aa0-45ff-a228-d054f30702c8 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:43.069591 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-27665df3-0aa0-45ff-a228-d054f30702c8 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1277 microversion: 2.1 time: 0.202783 Oct 17 15:38:43.071338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1692/3639] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:42 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:43.098574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:43.100449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:43.134803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:43.137367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:43.139615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:43.141010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:43.146209 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-098b95f6-7ea6-404b-aaec-545333a71aab tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1476 microversion: 2.1 time: 0.733499 Oct 17 15:38:43.146850 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1948/3640] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:42 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1476 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:43.147627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:43.152935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:43.154733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:43.163215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed75458b-9f24-4f1d-9002-b155594fc440 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:43.174627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed75458b-9f24-4f1d-9002-b155594fc440 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:43.199684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed75458b-9f24-4f1d-9002-b155594fc440 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:43.200546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed75458b-9f24-4f1d-9002-b155594fc440 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:43.202729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed75458b-9f24-4f1d-9002-b155594fc440 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:43.203821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed75458b-9f24-4f1d-9002-b155594fc440 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:43.208824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed75458b-9f24-4f1d-9002-b155594fc440 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:43.211236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed75458b-9f24-4f1d-9002-b155594fc440 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:43.325744 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed75458b-9f24-4f1d-9002-b155594fc440 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 200 len: 322 microversion: 2.1 time: 0.169035 Oct 17 15:38:43.333920 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1949/3641] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:43 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:43.339782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7701e3b7-bc0b-41e8-88db-418258a1e952 req-93e7d889-d019-446a-8956-c2c18ff6492f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40d53c0-6353-460c-ade7-186346f19950", "name": "network-vif-deleted", "tag": "0c2e3201-6294-48eb-a5cf-b63c7654f569"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:43.392970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7701e3b7-bc0b-41e8-88db-418258a1e952 req-93e7d889-d019-446a-8956-c2c18ff6492f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:43.394038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7701e3b7-bc0b-41e8-88db-418258a1e952 req-93e7d889-d019-446a-8956-c2c18ff6492f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:43.394038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7701e3b7-bc0b-41e8-88db-418258a1e952 req-93e7d889-d019-446a-8956-c2c18ff6492f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:43.461270 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7701e3b7-bc0b-41e8-88db-418258a1e952 req-93e7d889-d019-446a-8956-c2c18ff6492f service nova] Creating event network-vif-deleted:0c2e3201-6294-48eb-a5cf-b63c7654f569 for instance c40d53c0-6353-460c-ade7-186346f19950 on n-h1-854441-12 Oct 17 15:38:43.470114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a75d59cdb6f45df9fc90e515601a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2455cda838ea4befb6a3702d07b7b1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:43.479065 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7701e3b7-bc0b-41e8-88db-418258a1e952 req-93e7d889-d019-446a-8956-c2c18ff6492f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143224 Oct 17 15:38:43.482892 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1950/3642] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:43.490110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:43.494779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:43.504686 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b9924881-3fbd-4051-ad96-6c6c712516ca tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 200 len: 1615 microversion: 2.1 time: 0.429250 Oct 17 15:38:43.506857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:43.523185 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1693/3643] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:43 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 1615 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:43.525093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:43.532427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:43.532627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:43.533143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:43.533338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:43.533691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:43.537000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:43.596668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:43.598008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:43.600113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:43.610800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:43.618400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:43.620349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:44.207305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:44.237953 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-908b8bc1-7939-4b68-9e29-be9644a3be36 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.752843 Oct 17 15:38:44.240080 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1951/3644] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:43 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:44.251197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:44.261661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:44.283384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:44.284852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:44.286140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:44.294803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:44.296393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:44.297553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:44.554756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:44.569137 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d7fa864e-9b8f-4e9c-ac40-4e3c001ad331 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1510 microversion: 2.1 time: 1.056798 Oct 17 15:38:44.586565 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1694/3645] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:43 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1510 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:44.586565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:44.586565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:44.608014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:44.608014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:44.608014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:44.608691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:44.615659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:44.616905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:44.755191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:44.788323 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92a56f59-cbb3-440e-9c5e-c32dc69d965e tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1273 microversion: 2.1 time: 0.545854 Oct 17 15:38:44.792091 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1952/3646] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:44 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1273 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:44.820932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:44.828075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:44.855336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:44.865075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:44.866286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:44.867930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:44.869087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:44.870119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:45.507841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:45.610937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:45.630016 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8ab102a4-d351-4f72-9e2e-546d4aae9f90 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1476 microversion: 2.1 time: 1.052764 Oct 17 15:38:45.633621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1695/3647] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:44 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1476 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:45.647483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:45.649135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] [instance: c40d53c0-6353-460c-ade7-186346f19950] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:45.666293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:45.672133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:45.672617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:45.676000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:45.683171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:45.684214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:45.714534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:45.737419 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] HTTP exception thrown: Instance c40d53c0-6353-460c-ade7-186346f19950 could not be found. Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Request method failure captured: Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 HTTP/1.1 Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYcs06JRwA8m7iWHMOFbjib1395PTm1-kPGhd3iAngcD4SFDHFIrCLQqTO_vua340rg5Rn2WwCsBt_tpYIL0edOuw_irMCsimnKO9rIMpAqkafABN0tEfCg6isLqdXUvEzXUzOVWG181wDAHQx28gsmZ-rMT9zMFBlb8LoSarnnbdI Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2455cda838ea4befb6a3702d07b7b1ca Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesAdminNegativeTest-1583779408 Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2455cda838ea4befb6a3702d07b7b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2455cda838ea4befb6a3702d07b7b1ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2455cda838ea4befb6a3702d07b7b1ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2455cda838ea4befb6a3702d07b7b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesAdminNegativeTest-1583779408 Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2455cda838ea4befb6a3702d07b7b1ca Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1583779408 Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesAdminNegativeTest-1583779408-project Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 1a75d59cdb6f45df9fc90e515601a4be Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesAdminNegativeTest-1583779408-project Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance c40d53c0-6353-460c-ade7-186346f19950 could not be found. Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'c40d53c0-6353-460c-ade7-186346f19950'} Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40d53c0-6353-460c-ade7-186346f19950 could not be found. Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40d53c0-6353-460c-ade7-186346f19950 could not be found. Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:45.741801 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:45.747329 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:45.747329 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:45.747329 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:45.747329 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:45.747329 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:45.747329 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40d53c0-6353-460c-ade7-186346f19950 could not be found. Oct 17 15:38:45.747329 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:38:45.751546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Returning 404 to user: Instance c40d53c0-6353-460c-ade7-186346f19950 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:45.755565 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e6336585-bc95-4778-b19d-49e36793ecf9 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950" status: 404 len: 111 microversion: 2.1 time: 0.120073 Oct 17 15:38:45.759369 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1696/3648] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:45 2022] GET /compute/v2.1/servers/c40d53c0-6353-460c-ade7-186346f19950 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:38:45.771541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:45.774462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:45.776505 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9fe243c7-70a4-46a4-9891-286f2b1a3022 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.982359 Oct 17 15:38:45.777288 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1953/3649] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:44 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:45.812275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6401a69f-c0d5-4b58-b960-4211821ed0f1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] Calling method '.version_select at 0x7f28be0d7dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:45.832587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:45.834987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:45.837247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:45.839796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:45.841450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:45.842891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:45.885982 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6401a69f-c0d5-4b58-b960-4211821ed0f1 tempest-VolumesAdminNegativeTest-1583779408 tempest-VolumesAdminNegativeTest-1583779408-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382506872" status: 202 len: 0 microversion: 2.1 time: 0.097652 Oct 17 15:38:45.894786 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1954/3650] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382506872 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:38:45.911707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:45.912328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:45.937085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:45.937584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:45.938025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:45.938781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:45.948058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:45.948612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:46.119257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:46.172475 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6423dee9-3997-48be-bc2a-ed1dcc8c8353 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1335 microversion: 2.1 time: 0.273952 Oct 17 15:38:46.206576 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1955/3651] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:45 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1335 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:46.228556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:46.233576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:46.241205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:46.242884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:46.243621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:46.244687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:46.245456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:46.246137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:46.340775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:46.378093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6753c5b5-7f12-4868-b205-aa2d64a7f405 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1510 microversion: 2.1 time: 0.616399 Oct 17 15:38:46.399303 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1697/3652] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:45 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1510 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:46.681116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:46.683804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:46.696497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:46.697786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:46.698991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:46.700649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:46.701826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:46.703283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:46.999961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:47.038220 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88059075-455d-4084-ba55-6a1c0de7b35c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.818638 Oct 17 15:38:47.041263 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1956/3653] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:46 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:47.088739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:47.090519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:47.156265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:47.164482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:47.167730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:47.171095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:47.177136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:47.178400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:47.320968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:47.364201 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1928b3e4-9e1c-4638-997f-ae7bf342d913 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1476 microversion: 2.1 time: 0.689968 Oct 17 15:38:47.365288 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1698/3654] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:46 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1476 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:47.410938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:47.413201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:47.427086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:47.429079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:47.430435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:47.432359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:47.433628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:47.434883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:47.749459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:47.764559 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99aefe5e-7e67-436d-bdf9-643c4fa5b02b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1335 microversion: 2.1 time: 0.383630 Oct 17 15:38:47.766138 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1699/3655] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:47 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1335 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:47.773531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:47.775112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:47.792778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:47.796171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:47.799579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:47.801791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:47.804304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:47.807861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:48.244506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:48.250124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:48.270898 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee0b1eca-3f26-4f32-8dcc-69ac6735ccfb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.185348 Oct 17 15:38:48.275667 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1957/3656] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:47 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:38:48.419306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:48.421796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:48.441252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:48.444997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:48.448587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:48.451810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:48.453588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:48.454407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:48.859808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:48.873332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:48.931215 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2e71fade-b6dd-49d1-9c84-7ea1153293c4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1516 microversion: 2.1 time: 1.162561 Oct 17 15:38:48.941618 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1700/3657] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:47 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1516 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:48.958474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2058492051", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "dd932f3b-36f3-4be3-9d4c-cbbd034c0114"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:49.172282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] validate_networks() for [('dd932f3b-36f3-4be3-9d4c-cbbd034c0114', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:38:49.261146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:49.314356 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92716e68-0b9c-44fd-9fdf-0a39537584ba tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1476 microversion: 2.1 time: 0.900733 Oct 17 15:38:49.318882 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1958/3658] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:48 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1476 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:49.387169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:49.388793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:49.413024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:49.420703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:49.425424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:49.431098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:49.436603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:49.441920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:50.125212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:50.151777 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e74a6425-b5ad-4e2f-8d67-a80735bdbedc tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1401 microversion: 2.1 time: 0.819161 Oct 17 15:38:50.186810 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1959/3659] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:49 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1401 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:50.195580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fd8f3928-d2bf-4d2a-8e87-a312650a68b3 req-c7377566-2da9-46bf-afce-a3fc8d50fd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bd75eb-4c68-4e49-8276-dc76c5d09d01", "name": "network-vif-plugged", "status": "completed", "tag": "78fdf66f-958a-4ebb-8391-c05f8eef6e51"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:50.213219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fd8f3928-d2bf-4d2a-8e87-a312650a68b3 req-c7377566-2da9-46bf-afce-a3fc8d50fd26 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:50.214069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fd8f3928-d2bf-4d2a-8e87-a312650a68b3 req-c7377566-2da9-46bf-afce-a3fc8d50fd26 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:50.214821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fd8f3928-d2bf-4d2a-8e87-a312650a68b3 req-c7377566-2da9-46bf-afce-a3fc8d50fd26 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:50.238449 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fd8f3928-d2bf-4d2a-8e87-a312650a68b3 req-c7377566-2da9-46bf-afce-a3fc8d50fd26 service nova] Creating event network-vif-plugged:78fdf66f-958a-4ebb-8391-c05f8eef6e51 for instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 on n-h1-854441-12 Oct 17 15:38:50.247651 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fd8f3928-d2bf-4d2a-8e87-a312650a68b3 req-c7377566-2da9-46bf-afce-a3fc8d50fd26 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058459 Oct 17 15:38:50.249475 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1960/3660] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:50.576369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-769613625", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": "none"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:50.830169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:38:50.830978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:38:50.831866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:38:50.832600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:38:50.844063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:38:50.872355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:50.873616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:50.874417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:50.876147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:50.877790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:50.878880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:50.930988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Getting quotas for project cdd40a71d8364c768f8dee27f233a4cc. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:50.947736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Getting quotas for user 3d230f7054ba46aba748b62714318077 and project cdd40a71d8364c768f8dee27f233a4cc. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:51.015359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:38:51.024253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: b3271e00-3d59-485f-914a-c9deace9980c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:38:51.149999 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f745a6aa-9bc8-4b81-aa2e-bc74059b95d4 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.898197 Oct 17 15:38:51.163465 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1961/3661] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:38:51.175185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:51.180734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:51.196221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:51.198855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:51.199511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:51.200667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:51.201315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:51.201929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:51.799665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:51.854778 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-490de488-ccf9-438c-b852-49677e219ebf tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1476 microversion: 2.1 time: 0.682882 Oct 17 15:38:51.860711 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1962/3662] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:51 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1476 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:51.892299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e165698c-f739-4f4b-93ea-f5f5f12e3392 req-80a15783-99cd-4394-b394-f6071c3f5f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6864c875-afb5-4502-be38-1da8e1baacc3", "tag": "dc497bfd-be52-44e2-9f3c-02366b9399b1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:51.932044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e165698c-f739-4f4b-93ea-f5f5f12e3392 req-80a15783-99cd-4394-b394-f6071c3f5f77 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:51.943748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e165698c-f739-4f4b-93ea-f5f5f12e3392 req-80a15783-99cd-4394-b394-f6071c3f5f77 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:51.944833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e165698c-f739-4f4b-93ea-f5f5f12e3392 req-80a15783-99cd-4394-b394-f6071c3f5f77 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:51.976802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:38:51.977365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:38:51.977710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:38:51.978174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:38:51.978709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:38:51.988698 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e165698c-f739-4f4b-93ea-f5f5f12e3392 req-80a15783-99cd-4394-b394-f6071c3f5f77 service nova] Creating event network-changed:dc497bfd-be52-44e2-9f3c-02366b9399b1 for instance 6864c875-afb5-4502-be38-1da8e1baacc3 on n-h2-854441-12 Oct 17 15:38:51.999026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:52.000042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:52.000810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:52.006368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:52.007500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:52.008126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:52.013478 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e165698c-f739-4f4b-93ea-f5f5f12e3392 req-80a15783-99cd-4394-b394-f6071c3f5f77 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147232 Oct 17 15:38:52.018189 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1963/3663] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:52.039614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-109d0d51-a86d-448c-a459-f306912bf93c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:52.040715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:52.042236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-109d0d51-a86d-448c-a459-f306912bf93c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: b3271e00-3d59-485f-914a-c9deace9980c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:52.048448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for user 15cc78a142a148398dc438b5ff2a25e9 and project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:52.061831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:52.088499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:38:52.096459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:38:52.235337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-109d0d51-a86d-448c-a459-f306912bf93c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:52.261902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-109d0d51-a86d-448c-a459-f306912bf93c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:52.276761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-109d0d51-a86d-448c-a459-f306912bf93c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:52.282837 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-109d0d51-a86d-448c-a459-f306912bf93c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c" status: 200 len: 1277 microversion: 2.47 time: 0.260872 Oct 17 15:38:52.287904 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1964/3664] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:38:52 2022] GET /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:38:52.323530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:52.325965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:52.402574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:52.402957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:52.403428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:52.408893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:52.410267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:52.411973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:52.454741 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-05ec12e1-f8db-4531-aeec-ab0bd30567f1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.505348 Oct 17 15:38:52.456207 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1701/3665] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:38:52.528159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5b4a6bb-1558-4d68-bed2-4b797434982d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'create', calling method: .version_select at 0x7f28c2ee9040>, body: {"keypair": {"name": "tempest-keypair-36891197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa4SG+M/mkE+9478uwZF9fg4Q1nQcRabf0a2zaP4WbaqMHJ04ypKQ2ZLbMZf//U6j0ZI5Afd+4gMToUDxP63MoTRmkvOgBkWzFuZUoK1H2SlQoYGwDyjkHjfalkXTNPKQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:52.600649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c5b4a6bb-1558-4d68-bed2-4b797434982d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Getting quotas for project 2e096fd0bb744b2e90cf090b2172662e. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:52.617136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c5b4a6bb-1558-4d68-bed2-4b797434982d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Getting quotas for user ea396576a90246cb8b821cb2afec9170 and project 2e096fd0bb744b2e90cf090b2172662e. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:52.708510 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5b4a6bb-1558-4d68-bed2-4b797434982d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.236867 Oct 17 15:38:52.722628 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1702/3666] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:38:52 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:52.760912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-115842295", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": "none"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:52.892948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:52.909211 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-703de8ca-8378-4acc-86ac-b7ada4bfc645 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1401 microversion: 2.1 time: 0.618303 Oct 17 15:38:52.910354 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1965/3667] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:52 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1401 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:52.950968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-252e9d49-47ec-4db2-87c8-20d437af4fa9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:52.953217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-252e9d49-47ec-4db2-87c8-20d437af4fa9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:52.993916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:38:52.995247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:38:52.995914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:38:52.996492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:38:52.997076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:38:53.057196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:53.058171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:53.062331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:53.063729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:53.064524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:53.065444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:53.104324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Getting quotas for project cdd40a71d8364c768f8dee27f233a4cc. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:53.115716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Getting quotas for user 3d230f7054ba46aba748b62714318077 and project cdd40a71d8364c768f8dee27f233a4cc. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:53.130854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-252e9d49-47ec-4db2-87c8-20d437af4fa9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:53.138593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:38:53.142027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:38:53.183024 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-252e9d49-47ec-4db2-87c8-20d437af4fa9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1215 microversion: 2.1 time: 0.252147 Oct 17 15:38:53.187916 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1966/3668] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:52 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:53.204907 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9abf17ee-6d14-4f15-a70b-9f86fce2421b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.483630 Oct 17 15:38:53.206332 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1703/3669] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:38:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:38:53.215458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:53.221687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:53.231015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3d56a17a-d854-4ace-8424-d36d98381981 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:53.243014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3d56a17a-d854-4ace-8424-d36d98381981 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:53.248955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:38:53.266225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:53.267671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:53.271325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:53.275661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:53.278546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:53.281864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:53.518180 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3d56a17a-d854-4ace-8424-d36d98381981 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "PUT /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 991 microversion: 2.47 time: 0.295322 Oct 17 15:38:53.522593 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1704/3670] 10.222.0.87 () {62 vars in 1297 bytes} [Mon Oct 17 15:38:53 2022] PUT /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 991 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:38:53.545837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80f808f7-bff1-4aac-8e9f-10469d1f6a24 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:53.549079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-80f808f7-bff1-4aac-8e9f-10469d1f6a24 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:54.198645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:54.218904 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-061e366c-b2b8-4ff0-80e4-1577e28f136a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1462 microversion: 2.1 time: 1.028313 Oct 17 15:38:54.226989 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1967/3671] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:53 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1462 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:54.382992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff1a7c4a-9c1f-431b-864d-4c36949614b3 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Action: 'create', calling method: .version_select at 0x7f28beb84310>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:54.449978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ff1a7c4a-9c1f-431b-864d-4c36949614b3 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Getting quotas for project e075c56886d74f13a93572c9751cc33f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:54.474853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ff1a7c4a-9c1f-431b-864d-4c36949614b3 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Getting quotas for user a8ed5c1972ff4173b3a54fe94b93c730 and project e075c56886d74f13a93572c9751cc33f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:54.720260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ff1a7c4a-9c1f-431b-864d-4c36949614b3 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Getting quotas for project e075c56886d74f13a93572c9751cc33f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:54.733700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ff1a7c4a-9c1f-431b-864d-4c36949614b3 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Getting quotas for user a8ed5c1972ff4173b3a54fe94b93c730 and project e075c56886d74f13a93572c9751cc33f. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:54.765160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80f808f7-bff1-4aac-8e9f-10469d1f6a24 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:54.772721 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff1a7c4a-9c1f-431b-864d-4c36949614b3 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] 10.222.0.87 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.538312 Oct 17 15:38:54.777124 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1968/3672] 10.222.0.87 () {62 vars in 1214 bytes} [Mon Oct 17 15:38:54 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:38:54.785873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80f808f7-bff1-4aac-8e9f-10469d1f6a24 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:54.791272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:54.795268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80f808f7-bff1-4aac-8e9f-10469d1f6a24 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:54.798230 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80f808f7-bff1-4aac-8e9f-10469d1f6a24 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1277 microversion: 2.47 time: 1.261783 Oct 17 15:38:54.800152 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1705/3673] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:38:53 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1277 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:38:54.801261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:54.810647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:54.820051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:54.825700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:54.826213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:54.827642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:54.833078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:54.833078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:54.840282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:54.868924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:54.871403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:54.872797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:54.874414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:54.875640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:54.878191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:55.235613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:55.258439 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-576956cb-5c9c-43c8-abd3-aa1b2f6e6b0c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1267 microversion: 2.1 time: 0.455618 Oct 17 15:38:55.259946 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1706/3674] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:54 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1267 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:55.268874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:55.270286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:55.289154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:55.290430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:55.296727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:55.298560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:55.299700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:55.300742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:55.395822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:55.417547 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8dd959d1-fe57-4929-aff9-be32bd57d05b tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1401 microversion: 2.1 time: 0.638546 Oct 17 15:38:55.423240 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1969/3675] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:54 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1401 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:55.430825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f07fbaf4-c4ec-4c25-9bcd-f016000405b3 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:55.469612 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f07fbaf4-c4ec-4c25-9bcd-f016000405b3 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.032547 Oct 17 15:38:55.470828 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1970/3676] 10.222.0.87 () {60 vars in 1193 bytes} [Mon Oct 17 15:38:55 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:38:55.483900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27ed7738-d4ce-47c7-82a1-57747993e075 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:55.498475 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27ed7738-d4ce-47c7-82a1-57747993e075 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups/216a302b-97da-4096-a0a8-a370cf0befb3" status: 200 len: 235 microversion: 2.64 time: 0.018786 Oct 17 15:38:55.500272 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1971/3677] 10.222.0.87 () {60 vars in 1304 bytes} [Mon Oct 17 15:38:55 2022] GET /compute/v2.1/os-server-groups/216a302b-97da-4096-a0a8-a370cf0befb3 => generated 235 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:38:55.519238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c79cb58-7b1e-48c5-b1f0-f8f8a770b8a4 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:55.567812 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c79cb58-7b1e-48c5-b1f0-f8f8a770b8a4 tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/216a302b-97da-4096-a0a8-a370cf0befb3" status: 204 len: 0 microversion: 2.64 time: 0.058723 Oct 17 15:38:55.569531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1972/3678] 10.222.0.87 () {60 vars in 1307 bytes} [Mon Oct 17 15:38:55 2022] DELETE /compute/v2.1/os-server-groups/216a302b-97da-4096-a0a8-a370cf0befb3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:38:55.581089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eea15b22-0b79-49ee-a3b1-25450752cccb tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:55.605510 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-eea15b22-0b79-49ee-a3b1-25450752cccb tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] HTTP exception thrown: Instance group 216a302b-97da-4096-a0a8-a370cf0befb3 could not be found. Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eea15b22-0b79-49ee-a3b1-25450752cccb tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Request method failure captured: Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-server-groups/216a302b-97da-4096-a0a8-a370cf0befb3 HTTP/1.1 Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXcNOuz-sIFSflE8yxyQivgRAymL11Q5uWMX_YuSZZvW1zIRWiDrLpPe-coaQIgd3umA7qvmM8z2dpvkakU5QsIZox5oURSdulDIyxSp4T0Kqe-VzjpQ8dQ1-Idg3sMjYagxsLsezZrERS9Tu4s41tS4c6U6lT_RJZdF8YX5S64JlAc Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.64 Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: e075c56886d74f13a93572c9751cc33f Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerGroup264TestJSON-673224716 Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e075c56886d74f13a93572c9751cc33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e075c56886d74f13a93572c9751cc33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e075c56886d74f13a93572c9751cc33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e075c56886d74f13a93572c9751cc33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerGroup264TestJSON-673224716 Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: e075c56886d74f13a93572c9751cc33f Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerGroup264TestJSON-673224716 Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerGroup264TestJSON-673224716-project Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a8ed5c1972ff4173b3a54fe94b93c730 Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerGroup264TestJSON-673224716-project Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance group 216a302b-97da-4096-a0a8-a370cf0befb3 could not be found. Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '216a302b-97da-4096-a0a8-a370cf0befb3'} Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 216a302b-97da-4096-a0a8-a370cf0befb3 could not be found. Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 216a302b-97da-4096-a0a8-a370cf0befb3 could not be found. Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:55.621646 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:38:55.625940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:38:55.625940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:38:55.625940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:38:55.625940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:38:55.625940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 216a302b-97da-4096-a0a8-a370cf0befb3 could not be found. Oct 17 15:38:55.625940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:38:55.625940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eea15b22-0b79-49ee-a3b1-25450752cccb tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] Returning 404 to user: Instance group 216a302b-97da-4096-a0a8-a370cf0befb3 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:38:55.627023 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eea15b22-0b79-49ee-a3b1-25450752cccb tempest-ServerGroup264TestJSON-673224716 tempest-ServerGroup264TestJSON-673224716-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/216a302b-97da-4096-a0a8-a370cf0befb3" status: 404 len: 117 microversion: 2.64 time: 0.050782 Oct 17 15:38:55.631659 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1973/3679] 10.222.0.87 () {60 vars in 1307 bytes} [Mon Oct 17 15:38:55 2022] DELETE /compute/v2.1/os-server-groups/216a302b-97da-4096-a0a8-a370cf0befb3 => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:38:55.789434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:55.800767 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1b774274-bb1e-4c19-8632-4135bf2845a8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1462 microversion: 2.1 time: 0.539270 Oct 17 15:38:55.807064 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1707/3680] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:55 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1462 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:55.841915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:55.845973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:55.856046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:55.865064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:55.866295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:55.866592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:55.868354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:55.869816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:55.870748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:55.871581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:55.897947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:55.898951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:55.900032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:55.901628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:55.906057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:55.910267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:56.213239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:56.227085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:56.229913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:56.233547 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-daec407d-f2ec-4bc0-b607-ab66f16f8069 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1329 microversion: 2.47 time: 0.406128 Oct 17 15:38:56.236279 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1974/3681] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:38:55 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1329 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:38:56.291579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:56.293734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:56.305577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:56.316600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:56.317178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:56.318054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:56.318731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:56.321387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:56.437222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:38:56.437699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:38:56.438152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:38:56.438596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:38:56.439088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:38:56.574821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:56.592086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:56.612621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:56.615733 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ace92d71-f89a-4679-9940-01c3f5b0ce68 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1267 microversion: 2.1 time: 0.327668 Oct 17 15:38:56.616486 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1975/3682] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:56 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1267 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:56.627281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:56.635654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:56.637290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:56.638350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:56.638916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:56.639342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:56.639908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:56.648191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:56.649252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:56.650689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:56.652118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:56.653439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:56.654112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:56.820597 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1b5884c1-897c-4b78-82f4-30c535064019 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action" status: 202 len: 1066 microversion: 2.1 time: 0.972958 Oct 17 15:38:56.858540 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1708/3683] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:38:55 2022] POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action => generated 1066 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 15:38:56.858540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cdb41d48-b941-4263-b904-d2f2d8954589 req-d025e77b-8a62-4249-96f9-555610fc4a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6864c875-afb5-4502-be38-1da8e1baacc3", "name": "network-vif-plugged", "status": "completed", "tag": "dc497bfd-be52-44e2-9f3c-02366b9399b1"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:56.890412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cdb41d48-b941-4263-b904-d2f2d8954589 req-d025e77b-8a62-4249-96f9-555610fc4a0f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:56.893488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cdb41d48-b941-4263-b904-d2f2d8954589 req-d025e77b-8a62-4249-96f9-555610fc4a0f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:56.894313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cdb41d48-b941-4263-b904-d2f2d8954589 req-d025e77b-8a62-4249-96f9-555610fc4a0f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:56.909085 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cdb41d48-b941-4263-b904-d2f2d8954589 req-d025e77b-8a62-4249-96f9-555610fc4a0f service nova] Creating event network-vif-plugged:dc497bfd-be52-44e2-9f3c-02366b9399b1 for instance 6864c875-afb5-4502-be38-1da8e1baacc3 on n-h2-854441-12 Oct 17 15:38:56.921294 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cdb41d48-b941-4263-b904-d2f2d8954589 req-d025e77b-8a62-4249-96f9-555610fc4a0f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079904 Oct 17 15:38:56.922604 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1709/3684] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:38:56.936539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:56.937300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:56.959847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:56.960231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:56.977090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:56.978360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:56.979527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:56.980197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:57.240812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:57.253551 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30d5d35d-4aa3-4f06-87d3-66a13c2e15e4 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1401 microversion: 2.1 time: 0.630126 Oct 17 15:38:57.270990 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1976/3685] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:56 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1401 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:57.290276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:57.291272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:57.302155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:57.305739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:57.309829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:57.312464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:57.313236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:57.317187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:57.473288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:57.500842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:57.509947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:57.522581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1076d3e7-68be-4a57-b0b0-dd5c6873037d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1335 microversion: 2.47 time: 0.225643 Oct 17 15:38:57.523922 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1977/3686] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:38:57 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1335 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:38:57.597606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:57.613189 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-67b22fff-ebef-4059-af33-6cf4c7c5d53e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.683050 Oct 17 15:38:57.616689 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1710/3687] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:56 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:57.641528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:57.642230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:57.664919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:57.665441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:57.665971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:57.668896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:57.687814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:57.688846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:57.945043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:57.963810 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1434ea43-dba8-4497-9b68-960f93099420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1275 microversion: 2.1 time: 0.326137 Oct 17 15:38:57.979072 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1978/3688] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:57 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1275 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:58.284748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:58.286269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:58.297604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:58.297604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:58.298212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:58.299106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:58.313775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:58.314414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:58.554073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:58.554738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:58.568171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:58.568916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:58.569543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:58.571495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:58.576966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:58.579395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:58.728519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:58.737919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:58.752207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:58.755507 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8d5be8ca-9c9e-47c0-85f0-85444f370c7c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1335 microversion: 2.47 time: 0.204408 Oct 17 15:38:58.757248 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1979/3689] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:38:58 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1335 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:38:58.779044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:58.779044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:58.785651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:58.786249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:58.799635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:58.800500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:58.801069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:58.801589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:59.068000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:59.078059 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-644e0c1d-8f5c-4a60-b8a3-82e3054828ea tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.306253 Oct 17 15:38:59.079141 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1980/3690] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:58 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:59.084818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1477667824", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66a5d3ce-6dcc-4cfc-8194-b93cb9418a57"}], "security_groups": [{"name": "tempest-securitygroup--1817614621"}], "key_name": "tempest-keypair-36891197", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:38:59.211673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] validate_networks() for [('66a5d3ce-6dcc-4cfc-8194-b93cb9418a57', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:38:59.377157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:59.386432 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b3a331c-4163-4ef0-98c2-184d20e4010a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1401 microversion: 2.1 time: 1.105779 Oct 17 15:38:59.387074 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1711/3691] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:58 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1401 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:59.407816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:59.411088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:59.431844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:59.433144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:59.434240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:59.436250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:59.442726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:59.444415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:59.607710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:38:59.626543 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dccaabdc-1298-4b35-b293-c48840493690 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1273 microversion: 2.1 time: 0.237127 Oct 17 15:38:59.628924 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1712/3692] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:38:59 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:38:59.788121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:38:59.789136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:38:59.797132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:59.797957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:59.798843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:59.799780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:59.800276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:59.800714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:59.869577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:38:59.870412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:38:59.870999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:38:59.871623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:38:59.872207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:38:59.886210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:59.887033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:59.887719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:59.889002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:38:59.889714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:38:59.890363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:38:59.926757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Getting quotas for project 2e096fd0bb744b2e90cf090b2172662e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:38:59.937143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Getting quotas for user ea396576a90246cb8b821cb2afec9170 and project 2e096fd0bb744b2e90cf090b2172662e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:38:59.964512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:38:59.969200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:39:00.032108 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da26f7b9-e6b6-4840-916d-95eed538c7a8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.951492 Oct 17 15:39:00.033167 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1981/3693] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:38:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:39:00.045291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ce09157-fc9e-4d9c-9013-35727539d0cd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:00.046602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ce09157-fc9e-4d9c-9013-35727539d0cd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:00.136873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ce09157-fc9e-4d9c-9013-35727539d0cd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:00.156498 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ce09157-fc9e-4d9c-9013-35727539d0cd tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1244 microversion: 2.1 time: 0.115155 Oct 17 15:39:00.157499 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1982/3694] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:00 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1244 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:00.167595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:00.169324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:00.189541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:00.190326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:00.191093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:00.192315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:00.197507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:00.198484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:00.271766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:00.281888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:00.307677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:00.309208 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5cb3eb88-d790-4106-97d6-d17ec4822b45 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1335 microversion: 2.47 time: 0.526425 Oct 17 15:39:00.310189 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1713/3695] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:38:59 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1335 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:39:00.424647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:00.425643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:00.448064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:00.449891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:00.452476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:00.454939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:00.456060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:00.458123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:00.538644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:00.570674 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-750c6a07-fc4b-4942-966e-c9a8aa40680b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.411397 Oct 17 15:39:00.582008 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1983/3696] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:00 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:00.657589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:00.661024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:00.686126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:00.686674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:00.690135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:00.691692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:00.692182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:00.692626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.039729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:01.057687 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0453c2dc-de16-4d7c-8cca-fe78b7809fcc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.405354 Oct 17 15:39:01.059729 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1984/3697] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:00 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:01.188620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:01.190699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:01.201937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.202638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.203081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.203791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.204285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.204704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.210412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:01.277364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:01.297312 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6028b59-cb69-4ae1-80a0-82d0f71125a9 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1588 microversion: 2.1 time: 0.869205 Oct 17 15:39:01.300751 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1714/3698] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:00 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1588 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:01.332643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46d19ea5-b647-4ba2-aa0f-e6cda1ff1384 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:01.334997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-46d19ea5-b647-4ba2-aa0f-e6cda1ff1384 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:01.361114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46d19ea5-b647-4ba2-aa0f-e6cda1ff1384 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.361623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46d19ea5-b647-4ba2-aa0f-e6cda1ff1384 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.362077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46d19ea5-b647-4ba2-aa0f-e6cda1ff1384 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.363038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46d19ea5-b647-4ba2-aa0f-e6cda1ff1384 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.363557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46d19ea5-b647-4ba2-aa0f-e6cda1ff1384 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.367856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46d19ea5-b647-4ba2-aa0f-e6cda1ff1384 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.377618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:01.395048 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ac99168-a001-461b-90ed-bfa3484d148d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1240 microversion: 2.1 time: 0.212238 Oct 17 15:39:01.419377 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1985/3699] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:01 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1240 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:01.436591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:01.437362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:01.449420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.450034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.453875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.455176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.455686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.456135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.591313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:01.608271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:01.612281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:01.614075 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50f1408c-6b50-490e-abd2-6864e6937e8c tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1356 microversion: 2.47 time: 0.192580 Oct 17 15:39:01.614904 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1986/3700] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:01 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1356 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:01.626021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:01.628490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:01.640508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:01.643757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.647539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.648225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.649665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.650554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.651511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.669101 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-46d19ea5-b647-4ba2-aa0f-e6cda1ff1384 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.358256 Oct 17 15:39:01.670921 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1715/3701] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:39:01 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3/os-interface => generated 284 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:01.691117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:01.703666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:01.711223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.711986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.712614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.713675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.714448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.715287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.831715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:39:01.832123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:39:01.832799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:39:01.833380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:39:01.833949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:39:01.951613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:01.965512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.967431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.972462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:01.974261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:01.975707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:01.977150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:02.060805 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8c0ac6ac-362d-40ed-a1df-4e1e3bfc2e5b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "POST /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a/action" status: 202 len: 1078 microversion: 2.47 time: 0.386268 Oct 17 15:39:02.063213 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1716/3702] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:39:01 2022] POST /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a/action => generated 1078 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 15:39:02.119942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:02.121708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:02.153452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:02.154408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:02.155407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:02.156467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:02.157197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:02.157924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:02.255548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:02.271312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10b73798-070b-4e39-8ed9-3e2679e59585 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.650244 Oct 17 15:39:02.272540 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1987/3703] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:01 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:02.277825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:02.279192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:02.287420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:02.288320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:02.289027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:02.290041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:02.290816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:02.291573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:02.545398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:02.562827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:02.564460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:02.568961 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba9b4073-4f03-4b86-b347-e3191fde6e70 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.294963 Oct 17 15:39:02.571444 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1988/3704] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:02 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:02.585615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:02.586733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:02.614850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:02.617295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:02.618036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:02.628017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:02.628730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:02.629158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:03.074650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:03.234334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:03.249885 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3bd19f42-5bbe-4fc0-99dd-71272eb8163a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 1.167986 Oct 17 15:39:03.254987 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1717/3705] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:02 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:03.267320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:03.269184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:03.280988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:03.282076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:03.283178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:03.284796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:03.287011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:03.290193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:03.316662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:03.330068 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cef9df82-eaa8-4c22-82ff-bfcb557006f2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1314 microversion: 2.1 time: 0.757117 Oct 17 15:39:03.350732 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1989/3706] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:02 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:03.371082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:03.372021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:03.378901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:03.379409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:03.379858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:03.380606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:03.381099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:03.381508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:03.389289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:39:03.393572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:03.560322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9c70d539-ddb1-47a0-8117-8692d361e581 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 204 len: 0 microversion: 2.1 time: 0.302188 Oct 17 15:39:03.564654 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1718/3707] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:39:03 2022] DELETE /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:39:03.577679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:03.581009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:03.595359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:03.595876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:03.596347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:03.597112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:03.597585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:03.598019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:04.072763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:04.086378 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8da21a9-a517-48c0-8745-f96054c5fb4a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.728106 Oct 17 15:39:04.088348 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1990/3708] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:03 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:04.094843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:04.095733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:04.108406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:04.109277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:04.110340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:04.111372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:04.112004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:04.112721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:04.292294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:04.310724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:04.314709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:04.317182 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29266e7d-da49-43b4-9859-8f91dd9af3b0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.227113 Oct 17 15:39:04.319820 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1991/3709] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:04 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:04.328406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:04.329965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:04.355548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:04.356223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:04.357065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:04.359064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:04.359871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:04.361608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:04.450348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:04.464184 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a67d23a8-b1c8-4651-91c4-a4bf01979f64 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1664 microversion: 2.1 time: 0.895676 Oct 17 15:39:04.465153 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1719/3710] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:03 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1664 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:04.481090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:04.482006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:04.494226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:04.510585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:04.512279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:04.515109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:04.516101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:04.517026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:04.775271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=30 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:04.802113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:04.812760 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-651124ff-56d0-404c-a1e7-3b4b77e26213 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1302 microversion: 2.1 time: 0.346147 Oct 17 15:39:04.813811 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1720/3711] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:04 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1302 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:05.105977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:05.127176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:05.127813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:05.141139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:05.141913 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-437aae09-0904-46f0-be8c-9b0a5fc09e7e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.818212 Oct 17 15:39:05.143584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:05.144888 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1992/3712] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:04 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:05.145662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:05.146751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:05.149130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:05.152981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:05.358102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:05.364833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:05.382690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:05.384141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:05.386157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:05.388444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:05.389720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:05.390877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:05.668986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:05.687664 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d0fbce0-276c-4964-91b2-a5884e130b58 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.566423 Oct 17 15:39:05.688330 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1721/3713] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:05 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:05.720549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:05.720765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:05.721560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:05.730744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:05.732249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:05.732924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:05.733498 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4bb4529-2401-47dd-b399-162e3ab1d03e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.386312 Oct 17 15:39:05.733799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:05.734406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:05.735452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:05.736105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:05.736697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:05.740766 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1993/3714] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:05 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:39:05.845442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:05.846539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:05.863616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:05.871218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:05.872249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:05.876265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:05.877146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:05.879088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:06.693204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:06.736306 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7cc7f96a-495c-4e07-96b6-5eeeff003755 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1370 microversion: 2.1 time: 0.894405 Oct 17 15:39:06.737927 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1994/3715] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:05 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1370 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:06.760104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d1602a5f-8788-465c-a5da-d00bf0d93cc9 req-f84f82bc-d82e-428f-8481-ab03d03b1b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca852351-f3fe-4fd2-a14e-8bcdbb864d7b", "tag": "e8ac8dc0-ee12-4bb4-b629-306272355f01"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:06.800356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d1602a5f-8788-465c-a5da-d00bf0d93cc9 req-f84f82bc-d82e-428f-8481-ab03d03b1b50 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:06.801642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d1602a5f-8788-465c-a5da-d00bf0d93cc9 req-f84f82bc-d82e-428f-8481-ab03d03b1b50 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:06.803250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d1602a5f-8788-465c-a5da-d00bf0d93cc9 req-f84f82bc-d82e-428f-8481-ab03d03b1b50 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:06.819710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:06.851494 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d1602a5f-8788-465c-a5da-d00bf0d93cc9 req-f84f82bc-d82e-428f-8481-ab03d03b1b50 service nova] Creating event network-changed:e8ac8dc0-ee12-4bb4-b629-306272355f01 for instance ca852351-f3fe-4fd2-a14e-8bcdbb864d7b on n-h1-854441-12 Oct 17 15:39:06.865483 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d1602a5f-8788-465c-a5da-d00bf0d93cc9 req-f84f82bc-d82e-428f-8481-ab03d03b1b50 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121053 Oct 17 15:39:06.867266 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3747013a-db65-4d6c-bf99-cbf8dbe39de4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1664 microversion: 2.1 time: 1.162717 Oct 17 15:39:06.870927 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1995/3716] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:06.873612 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1722/3717] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:05 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1664 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:06.895256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:06.896653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:06.909715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-750d72d4-daa6-4123-b8d4-d3896e8e1ceb req-df629c80-8d68-44f7-afad-2ff812bc82b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6864c875-afb5-4502-be38-1da8e1baacc3", "tag": "dc497bfd-be52-44e2-9f3c-02366b9399b1"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:06.921885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:06.924051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:06.929320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:06.930911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:06.935758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:06.936885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:06.968858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-750d72d4-daa6-4123-b8d4-d3896e8e1ceb req-df629c80-8d68-44f7-afad-2ff812bc82b4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:06.970072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-750d72d4-daa6-4123-b8d4-d3896e8e1ceb req-df629c80-8d68-44f7-afad-2ff812bc82b4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:06.971505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-750d72d4-daa6-4123-b8d4-d3896e8e1ceb req-df629c80-8d68-44f7-afad-2ff812bc82b4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:07.020547 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-750d72d4-daa6-4123-b8d4-d3896e8e1ceb req-df629c80-8d68-44f7-afad-2ff812bc82b4 service nova] Creating event network-changed:dc497bfd-be52-44e2-9f3c-02366b9399b1 for instance 6864c875-afb5-4502-be38-1da8e1baacc3 on n-h2-854441-12 Oct 17 15:39:07.029721 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-750d72d4-daa6-4123-b8d4-d3896e8e1ceb req-df629c80-8d68-44f7-afad-2ff812bc82b4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152566 Oct 17 15:39:07.031110 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1723/3718] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:07.043768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:07.047389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:07.070423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:07.071107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:07.072397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:07.074185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:07.075989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:07.080012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:07.717865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:07.727277 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-71c8d91f-2091-47ea-884e-25807d7a8004 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.688548 Oct 17 15:39:07.739042 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1724/3719] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:07 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:07.749704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:07.750701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:07.766688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:07.774033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:07.775248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:07.777493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:07.778371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:07.779036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:08.064882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:08.076895 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71fd031e-98b4-4120-8d51-c340e3a8f61a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1588 microversion: 2.1 time: 1.204007 Oct 17 15:39:08.082918 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1996/3720] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:06 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1588 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:08.092619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:08.094420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:08.109189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:08.110988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:08.112231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:08.114599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:08.115915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:08.117291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:08.264737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:08.288638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:08.292446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:08.295736 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-19bd3d4e-e4e3-4360-a333-c92c66202ab1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.210486 Oct 17 15:39:08.298152 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1997/3721] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:08 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:08.309912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:08.312968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:08.342969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:08.343851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:08.344637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:08.346175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:08.347085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:08.348192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:09.022337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:09.066615 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ac9d72f1-1263-41e6-a065-c59a91b7b86a tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 1.325551 Oct 17 15:39:09.068794 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1725/3722] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:07 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:09.082294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:09.085145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:09.099159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:09.101733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:09.106261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:09.110444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:09.111796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:09.113205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:09.344910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:09.386281 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-256f5692-4a3a-4886-969b-7596f205e15a tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1370 microversion: 2.1 time: 1.085486 Oct 17 15:39:09.387867 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1998/3723] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:08 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1370 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:09.396552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:09.399083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:09.429517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:09.430932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:09.431962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:09.433508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:09.434608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:09.435654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:09.634142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:09.667410 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc6a5ecd-d764-4c95-aeb7-847767ac137d tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1664 microversion: 2.1 time: 0.596182 Oct 17 15:39:09.668621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1726/3724] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:09 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1664 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:09.699736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:09.701131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:09.714979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:09.715918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:09.717179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:09.719127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:09.723126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:09.724337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:09.911520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:10.029076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:10.040142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:10.049639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:10.051217 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-252174f7-d7ee-494e-9629-26135061975b tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.368815 Oct 17 15:39:10.063722 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1727/3725] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:09 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:10.066563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0ee78578-bcb2-461b-948f-2516c6c2b6ec req-d6525bac-b63a-4cd2-b501-284f04e4e363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b793d7-d5e4-4688-9805-2d0997a9b2a1", "tag": "4d3a8932-7c9b-456c-afb4-5ea7006d3595"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:10.089569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:10.095901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ee78578-bcb2-461b-948f-2516c6c2b6ec req-d6525bac-b63a-4cd2-b501-284f04e4e363 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:10.101119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ee78578-bcb2-461b-948f-2516c6c2b6ec req-d6525bac-b63a-4cd2-b501-284f04e4e363 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:10.103608 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c62455ea-70c4-423c-be34-0e808f997a8f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.713818 Oct 17 15:39:10.104512 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 1999/3726] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:09 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:10.107661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0ee78578-bcb2-461b-948f-2516c6c2b6ec req-d6525bac-b63a-4cd2-b501-284f04e4e363 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:10.117816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:10.118459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:10.140629 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0ee78578-bcb2-461b-948f-2516c6c2b6ec req-d6525bac-b63a-4cd2-b501-284f04e4e363 service nova] Creating event network-changed:4d3a8932-7c9b-456c-afb4-5ea7006d3595 for instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 on n-h2-854441-12 Oct 17 15:39:10.144723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:10.145259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:10.145712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:10.146861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:10.148684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:10.149215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:10.149726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=26 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:10.156385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0ee78578-bcb2-461b-948f-2516c6c2b6ec req-d6525bac-b63a-4cd2-b501-284f04e4e363 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094185 Oct 17 15:39:10.157979 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1728/3727] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:39:10.429863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:10.438574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:10.453528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:10.454603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:10.456281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:10.457601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:10.458460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:10.459276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:10.703726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:10.744306 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc701a6a-fa91-491c-82d5-29feb07817df tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.636960 Oct 17 15:39:10.746723 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2000/3728] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:10 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:10.762778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:10.764312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:10.782598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:10.784101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:10.785271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:10.786961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:10.788173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:10.790488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:10.903792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:10.946067 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d754b43f-1abe-4c19-afe7-307abe18af5e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1370 microversion: 2.1 time: 0.534812 Oct 17 15:39:10.948792 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1729/3729] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:10 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1370 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:10.968248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-56fcfd05-55c9-438a-9ee0-6bf2e0a18f70 req-c9d2e807-1146-4a4d-8af2-9a1af3cb54b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c85e2a-7d17-4fd4-b273-161a7cf90dbe", "name": "network-vif-deleted", "tag": "94333ecc-4a6c-4e40-b248-a1300c3ac6b6"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:10.968608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:11.000403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-56fcfd05-55c9-438a-9ee0-6bf2e0a18f70 req-c9d2e807-1146-4a4d-8af2-9a1af3cb54b4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:11.001819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-56fcfd05-55c9-438a-9ee0-6bf2e0a18f70 req-c9d2e807-1146-4a4d-8af2-9a1af3cb54b4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:11.002728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-56fcfd05-55c9-438a-9ee0-6bf2e0a18f70 req-c9d2e807-1146-4a4d-8af2-9a1af3cb54b4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:11.047739 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f293c7a-ce9f-4cb1-a05b-7c55d87737b4 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1597 microversion: 2.1 time: 0.279593 Oct 17 15:39:11.060207 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2001/3730] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:10 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1597 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:11.061693 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-56fcfd05-55c9-438a-9ee0-6bf2e0a18f70 req-c9d2e807-1146-4a4d-8af2-9a1af3cb54b4 service nova] Creating event network-vif-deleted:94333ecc-4a6c-4e40-b248-a1300c3ac6b6 for instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe on n-h2-854441-12 Oct 17 15:39:11.087564 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-56fcfd05-55c9-438a-9ee0-6bf2e0a18f70 req-c9d2e807-1146-4a4d-8af2-9a1af3cb54b4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136364 Oct 17 15:39:11.088789 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1730/3731] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:11.110925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:11.112090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:11.139577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:11.145640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:11.146789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:11.147038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:11.147784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:11.148144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:11.151007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:11.161880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:11.167324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:11.168875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:11.169620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:11.170697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:11.171438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:11.172127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:11.218982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:11.339033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:11.361743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:11.363692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:11.364988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aeac085d-0faa-4fed-b9c6-c57caa8af2ee tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.263199 Oct 17 15:39:11.386283 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2002/3732] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:11 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:11.703277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:11.720637 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a26b79d-6c8b-4cac-a3c6-817cab9fced6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.577881 Oct 17 15:39:11.721603 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1731/3733] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:11 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:11.774173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:11.775030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:11.790708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:11.798009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:11.798769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:11.799560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:11.800038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:11.800598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:11.981865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:11.982849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:11.991979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:11.993861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:11.994682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:11.999985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:12.000873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:12.001799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:12.112965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:12.122749 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8928e32-0f86-438f-88ad-f4e877e72198 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.353464 Oct 17 15:39:12.141570 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2003/3734] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:11 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:12.157426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:12.159109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:12.172966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:12.173769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:12.174377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:12.175345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:12.175981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:12.176572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:12.271014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:12.272246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:12.273447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:12.274535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lazy-loading 'fault' on Instance uuid d0c85e2a-7d17-4fd4-b273-161a7cf90dbe {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:39:12.372981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4401a49e458149b7b6885663d488d2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984609b6197c4e03bbec26cfd3df0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:12.413301 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f4facf8-bc93-4831-9179-1f54c0cd3c7e tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 200 len: 1315 microversion: 2.1 time: 0.268900 Oct 17 15:39:12.419071 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2004/3735] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:12 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:12.438086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:12.440350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:12.459770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:12.461124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:12.462196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:12.467447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:12.469055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:12.471371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:12.583564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:12.593954 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d21a609b-488e-43ca-9b8f-a1b2b8bfcffb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1370 microversion: 2.1 time: 0.620717 Oct 17 15:39:12.594822 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1732/3736] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:11 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1370 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:12.639026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:12.660561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:12.663288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:12.670617 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-647862d3-e47d-44ff-844f-42ca84ebf455 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.247550 Oct 17 15:39:12.671968 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2005/3737] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:12 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:12.765252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:12.765887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:12.775768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:12.776272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:12.776732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:12.777447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:12.777907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:12.778337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:13.052645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:13.065088 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c7e59f3-8a7e-49bb-bf8f-8bed3b4fe7c4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.302411 Oct 17 15:39:13.078553 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1733/3738] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:12 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:13.155981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:13.156817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:13.174435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:13.181737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:13.182573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:13.186240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:13.187221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:13.198049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:13.457884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:13.459330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] [instance: d0c85e2a-7d17-4fd4-b273-161a7cf90dbe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:13.472784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:13.477304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:13.478066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:13.483105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:13.483620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:13.484074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:13.574476 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] HTTP exception thrown: Instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe could not be found. Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Request method failure captured: Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe HTTP/1.1 Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXbBcaP3UklZPRhjkhjPb-KZp9b5J8HJM17IICccbWmP3kNtYOpfB8Ud3KlFtFrnYprI6ivVCP0AoPbOty83rb0f4IElkFl8umxKg4csZOt-Z3_ENpe6yeCKzUg71xIGWYU2mGGhffDYFl-8V1f32HTdwICQW5-xjyyz4dDLhTwpMHs Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 984609b6197c4e03bbec26cfd3df0a9b Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestFqdnHostnames-467672332 Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/984609b6197c4e03bbec26cfd3df0a9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/984609b6197c4e03bbec26cfd3df0a9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_984609b6197c4e03bbec26cfd3df0a9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/984609b6197c4e03bbec26cfd3df0a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestFqdnHostnames-467672332 Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 984609b6197c4e03bbec26cfd3df0a9b Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-467672332 Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestFqdnHostnames-467672332-project Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 4401a49e458149b7b6885663d488d2cc Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestFqdnHostnames-467672332-project Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe could not be found. Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd0c85e2a-7d17-4fd4-b273-161a7cf90dbe'} Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe could not be found. Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe could not be found. Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:13.578893 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:13.594462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:13.594462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:13.594462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:13.594462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:39:13.594462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:39:13.594462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe could not be found. Oct 17 15:39:13.594462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:13.598406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Returning 404 to user: Instance d0c85e2a-7d17-4fd4-b273-161a7cf90dbe could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:39:13.599152 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2d5b3f7f-f8ab-4602-bbd8-bfa06a609494 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe" status: 404 len: 111 microversion: 2.1 time: 0.145477 Oct 17 15:39:13.600206 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1734/3739] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:13 2022] GET /compute/v2.1/servers/d0c85e2a-7d17-4fd4-b273-161a7cf90dbe => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:39:13.613775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a55c604-93ca-4f6d-b4ac-98c584b0a695 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] Calling method '.version_select at 0x7f28beb0bca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:13.655376 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a55c604-93ca-4f6d-b4ac-98c584b0a695 tempest-ServersTestFqdnHostnames-467672332 tempest-ServersTestFqdnHostnames-467672332-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631784103" status: 202 len: 0 microversion: 2.1 time: 0.048862 Oct 17 15:39:13.656522 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1735/3740] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631784103 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:39:13.664663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:13.665481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:13.675698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:13.676374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:13.676935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:13.678130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:13.679021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:13.679605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:14.076846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:14.087818 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6e03ba8-0b6d-4b94-bbf2-56e49d7b5253 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1370 microversion: 2.1 time: 0.429517 Oct 17 15:39:14.094798 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1736/3741] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:13 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1370 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:14.100225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:14.105368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:14.127370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:14.137752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:14.138465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:14.141568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:14.149767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:14.150468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:14.235536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:14.440211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:14.456754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:14.459433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:14.464350 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ddf0c49b-0594-44b3-ae20-cdb144ac0922 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.368311 Oct 17 15:39:14.492922 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1737/3742] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:14 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:14.498133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:14.506853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:14.507842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:14.518745 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-834fc439-a1e6-4cba-a561-8cfd562f8bc5 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 1.362826 Oct 17 15:39:14.520811 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2006/3743] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:13 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:14.527233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:14.527755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:14.528207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:14.528956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:14.529420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:14.529851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:14.862891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:14.878103 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-013a00e6-54ad-4e39-b73d-a8a470607f5a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.383503 Oct 17 15:39:14.879221 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1738/3744] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:14 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:14.962865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-180fd22c-67b8-4616-a14a-b6455ae5f8a5 tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] Calling method '.version_select at 0x7f28bee25dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:15.060383 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-180fd22c-67b8-4616-a14a-b6455ae5f8a5 tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.289708 Oct 17 15:39:15.061272 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2007/3745] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:39:14 2022] GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6/defaults => generated 371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:15.074018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8e4378a-026d-4170-bbcd-3cccd7e0500b tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] Calling method '.version_select at 0x7f28c2df6790>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:15.117677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:15.118299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:15.128207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:15.129774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:15.131441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:15.133219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:15.135057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:15.137309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:15.249282 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a8e4378a-026d-4170-bbcd-3cccd7e0500b tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6" status: 200 len: 371 microversion: 2.1 time: 0.178851 Oct 17 15:39:15.250523 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1739/3746] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 15:39:15 2022] GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6 => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:39:15.268592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d62f8c40-e1ce-44c0-8a06-f03c0d9c776f tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] Calling method '.version_select at 0x7f28bea48430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:15.352208 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d62f8c40-e1ce-44c0-8a06-f03c0d9c776f tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.088037 Oct 17 15:39:15.352817 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1740/3747] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:39:15 2022] GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6/defaults => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:39:15.376029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2a1a337-cd8f-4ca9-8c02-56116e3c8caa tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] Calling method '.version_select at 0x7f28be2f2940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:15.471449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:15.496671 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e2a1a337-cd8f-4ca9-8c02-56116e3c8caa tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6" status: 200 len: 371 microversion: 2.1 time: 0.124833 Oct 17 15:39:15.499261 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1741/3748] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 15:39:15 2022] GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6 => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:39:15.513731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:15.521211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:15.522660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:15.530661 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a6ce2b1-3705-4756-a17b-d1363cfdf278 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1370 microversion: 2.1 time: 0.416355 Oct 17 15:39:15.532180 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2008/3749] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:15 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1370 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:15.553017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:15.554144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:15.555459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:15.557413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:15.558707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20fb2250-6d5e-44a8-9189-c3e965a09c53 tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] Calling method '.version_select at 0x7f28be056790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:15.563688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:15.564458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:15.701860 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20fb2250-6d5e-44a8-9189-c3e965a09c53 tempest-QuotasTestJSON-58576802 tempest-QuotasTestJSON-58576802-project] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6?user_id=f1509708b7f1409faef30fe770234da0" status: 200 len: 371 microversion: 2.1 time: 0.167546 Oct 17 15:39:15.702479 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2009/3750] 10.222.0.87 () {58 vars in 1323 bytes} [Mon Oct 17 15:39:15 2022] GET /compute/v2.1/os-quota-sets/27727155d8c242d395eef017db6c65d6?user_id=f1509708b7f1409faef30fe770234da0 => generated 371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:15.707492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:15.708332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:15.726727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:15.727238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:15.727682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:15.728429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:15.728895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:15.729328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:15.739875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:15.752350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:15.763106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:15.764427 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cfb725ec-c45d-41e0-badc-47b545755643 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.254489 Oct 17 15:39:15.765030 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1742/3751] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:15 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:15.912637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:15.913535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:15.927027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:15.931569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:15.935296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:15.941217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:15.942636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:15.943663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:16.192343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:16.205813 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25360b54-cd46-4ecf-b87b-3718f19dd4c1 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.502180 Oct 17 15:39:16.212028 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2010/3752] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:15 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:16.234426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:16.252910 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fcf8f9e7-e288-4753-becf-5c16f09106d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.345120 Oct 17 15:39:16.268495 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1743/3753] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:15 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:16.563177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:16.563990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:16.578649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:16.579412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:16.580581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:16.580761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:16.581062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:16.587375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:16.806798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:16.807725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:16.826594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:16.827116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:16.827570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:16.828301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:16.829014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:16.829621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:16.982700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:17.011830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:17.015187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:17.018081 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4ae8bffe-3d4f-4d83-b53c-e790f59a06a6 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.229517 Oct 17 15:39:17.020021 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1744/3754] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:16 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:17.101288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:17.128807 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a62f1e60-db81-40e6-9880-992b8374cca3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1370 microversion: 2.1 time: 0.569467 Oct 17 15:39:17.130164 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2011/3755] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:16 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1370 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:17.178429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-6049bdc2-b7c0-4ceb-9dc0-a42070bd2776 req-826b9381-3665-4517-8b3b-e4cbb1735da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca852351-f3fe-4fd2-a14e-8bcdbb864d7b", "name": "network-vif-plugged", "status": "completed", "tag": "e8ac8dc0-ee12-4bb4-b629-306272355f01"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:17.203425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6049bdc2-b7c0-4ceb-9dc0-a42070bd2776 req-826b9381-3665-4517-8b3b-e4cbb1735da2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:17.208935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6049bdc2-b7c0-4ceb-9dc0-a42070bd2776 req-826b9381-3665-4517-8b3b-e4cbb1735da2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:17.209715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6049bdc2-b7c0-4ceb-9dc0-a42070bd2776 req-826b9381-3665-4517-8b3b-e4cbb1735da2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:17.225082 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-6049bdc2-b7c0-4ceb-9dc0-a42070bd2776 req-826b9381-3665-4517-8b3b-e4cbb1735da2 service nova] Creating event network-vif-plugged:e8ac8dc0-ee12-4bb4-b629-306272355f01 for instance ca852351-f3fe-4fd2-a14e-8bcdbb864d7b on n-h1-854441-12 Oct 17 15:39:17.245433 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-6049bdc2-b7c0-4ceb-9dc0-a42070bd2776 req-826b9381-3665-4517-8b3b-e4cbb1735da2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073784 Oct 17 15:39:17.246931 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1745/3756] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:17.253432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:17.255095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:17.277331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:17.279184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:17.280381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:17.282062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:17.283056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:17.283955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:17.296721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:17.298359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:17.313854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:17.322715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:17.323216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:17.324530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:17.325218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:17.325818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:17.603937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:17.614294 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-557ff182-e0fa-419a-921d-c891566bcfe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.323030 Oct 17 15:39:17.615461 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1746/3757] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:17 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:17.697177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:17.714919 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c17d824-d4aa-4b03-a4ba-95e13f49cae6 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.468316 Oct 17 15:39:17.717009 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2012/3758] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:17 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:18.049537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:18.051458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:18.095376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:18.095902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:18.097373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:18.099068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:18.101429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:18.102240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:18.153379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:18.153997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:18.163090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:18.167065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:18.170875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:18.172080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:18.173581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:18.174365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:18.340043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:18.369270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:18.372480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:18.381218 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc82ec7a-9e79-4954-a6fe-735aa6b27b1e tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.338260 Oct 17 15:39:18.385023 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1747/3759] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:18 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:39:18.654765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:18.661079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:18.682615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:18.683914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:18.684685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:18.685809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:18.686441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:18.687024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:18.786149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:18.813594 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-090974d8-239a-475e-b27f-3543bbe4eb2d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1370 microversion: 2.1 time: 0.663670 Oct 17 15:39:18.822802 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2013/3760] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:18 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1370 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:18.843229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:18.849458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:18.893446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:18.894356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:18.895230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:18.896550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:18.897393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:18.905345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:19.223344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:19.255536 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-518208de-c953-4a8f-823d-064d34aacf4e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1315 microversion: 2.1 time: 0.608482 Oct 17 15:39:19.259652 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1748/3761] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:18 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:19.294230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-3610fe8f-3d28-4f1b-a5b0-08467917b70c req-64f4622c-5245-411a-8d19-096c3c11ddd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b793d7-d5e4-4688-9805-2d0997a9b2a1", "name": "network-vif-plugged", "status": "completed", "tag": "4d3a8932-7c9b-456c-afb4-5ea7006d3595"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:19.326707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3610fe8f-3d28-4f1b-a5b0-08467917b70c req-64f4622c-5245-411a-8d19-096c3c11ddd1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:19.329425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3610fe8f-3d28-4f1b-a5b0-08467917b70c req-64f4622c-5245-411a-8d19-096c3c11ddd1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:19.331977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3610fe8f-3d28-4f1b-a5b0-08467917b70c req-64f4622c-5245-411a-8d19-096c3c11ddd1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:19.371732 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-3610fe8f-3d28-4f1b-a5b0-08467917b70c req-64f4622c-5245-411a-8d19-096c3c11ddd1 service nova] Creating event network-vif-plugged:4d3a8932-7c9b-456c-afb4-5ea7006d3595 for instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 on n-h2-854441-12 Oct 17 15:39:19.387121 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-3610fe8f-3d28-4f1b-a5b0-08467917b70c req-64f4622c-5245-411a-8d19-096c3c11ddd1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104141 Oct 17 15:39:19.388933 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1749/3762] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:19.420787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:19.480264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:19.487820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:19.489589 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe68ff63-ecd3-422b-972c-2b8f0f677667 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.652684 Oct 17 15:39:19.491884 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2014/3763] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:18 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:19.517635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:19.518836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:19.519978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:19.522242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:19.523586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:19.524727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:19.665628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:19.677856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:19.679685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:19.681100 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2e39b5c2-ff77-4d8a-bc26-30a6e71458a1 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.246639 Oct 17 15:39:19.681846 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1750/3764] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:19 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:39:19.892413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:19.893479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:19.929415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:19.932458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:19.933522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:19.935905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:19.937550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:19.939921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:20.282533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:20.283413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:20.304509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:20.305016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:20.305457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:20.306550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:20.307298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:20.307898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:20.312248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:20.321503 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09ae58e7-3dcf-4b41-9142-854c29624f4b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1370 microversion: 2.1 time: 0.463934 Oct 17 15:39:20.343877 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2015/3765] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:19 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1370 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:20.541827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:20.543756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:20.557180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:20.572284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:20.574751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:20.578133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:20.580099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:20.584843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:21.395900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:21.412846 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2e970f45-558e-47f2-a2e8-f661bbbccd2a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1501 microversion: 2.1 time: 1.133078 Oct 17 15:39:21.414288 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1751/3766] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:20 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1501 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:21.427206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:21.429724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:21.450541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:21.454202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:21.454969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:21.461081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:21.462493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:21.463215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:21.718695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:21.734937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:21.736746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:21.737965 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-01fc78fa-bafa-4701-af51-5fe10ffc1c29 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.321126 Oct 17 15:39:21.744964 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1752/3767] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:21 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:21.750555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:21.751493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:21.766853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:21.769863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:21.770737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:21.771690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:21.772333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:21.772937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:21.883670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:21.900268 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-869361b1-9c99-44fa-9b25-adbbe96d7823 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 1.363872 Oct 17 15:39:21.903200 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2016/3768] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:20 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:21.919143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdaa7653-b608-4960-a7a6-f8d57f9fdf46 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:21.938585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaa7653-b608-4960-a7a6-f8d57f9fdf46 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:21.943197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaa7653-b608-4960-a7a6-f8d57f9fdf46 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:21.945117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaa7653-b608-4960-a7a6-f8d57f9fdf46 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:22.016962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fdaa7653-b608-4960-a7a6-f8d57f9fdf46 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Going to try to stop instance {{(pid=120406) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 15:39:22.149074 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdaa7653-b608-4960-a7a6-f8d57f9fdf46 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b/action" status: 202 len: 0 microversion: 2.1 time: 0.243308 Oct 17 15:39:22.152132 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2017/3769] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:39:21 2022] POST /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:39:22.197141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:22.198863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:22.235971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:22.238720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:22.239615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:22.242519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:22.244730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:22.246153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:22.541841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:22.569634 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-325b6e63-64df-4587-8373-a9a8cf3e63b2 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1564 microversion: 2.1 time: 0.823043 Oct 17 15:39:22.607752 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1753/3770] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:21 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1564 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:22.617724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a5025e15-2df6-4daa-af87-8899d6adcb8c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:22.626095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a5025e15-2df6-4daa-af87-8899d6adcb8c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:22.638250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5025e15-2df6-4daa-af87-8899d6adcb8c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:22.640608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5025e15-2df6-4daa-af87-8899d6adcb8c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:22.641442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5025e15-2df6-4daa-af87-8899d6adcb8c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:22.642398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5025e15-2df6-4daa-af87-8899d6adcb8c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:22.643171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5025e15-2df6-4daa-af87-8899d6adcb8c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:22.644198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a5025e15-2df6-4daa-af87-8899d6adcb8c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:22.947413 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a5025e15-2df6-4daa-af87-8899d6adcb8c tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.336645 Oct 17 15:39:22.966694 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1754/3771] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:39:22 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-interface => generated 284 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:22.966694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:22.979005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:22.992954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:22.997802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:22.998817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:22.999896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:23.000751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:23.001467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:23.189243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:23.199319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:23.220738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:23.225357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:23.228125 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-496fd0ce-c7d5-4e7d-9703-9ab25959eb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 1.061568 Oct 17 15:39:23.230605 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-90d8e1b6-5905-4ad9-a685-88a356e6f08f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.275858 Oct 17 15:39:23.231944 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1755/3772] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:22 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:23.232339 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2018/3773] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:22 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:23.242477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:23.244383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:23.256367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:23.257912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:23.259167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:23.260836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:23.261896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:23.262919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:23.851357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:23.884341 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-066cb2a3-a434-4a5a-96ab-ffe752a9a560 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.649925 Oct 17 15:39:23.886566 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1756/3774] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:23 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:24.262726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:24.264031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:24.273185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:24.274001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:24.275426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:24.276594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:24.277223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:24.277803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:24.302857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:24.303855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:24.326800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:24.327806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:24.329074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:24.330390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:24.331165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:24.332161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:24.484037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:24.488023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:24.494537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:24.503222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:24.513708 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-727bd460-3e17-4f06-9c16-37b54a85c0c5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.255157 Oct 17 15:39:24.514861 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2019/3775] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:24 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:24.917917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:24.918575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:24.930623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:24.931142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:24.931597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:24.932354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:24.932820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:24.933244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:25.006833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:25.046895 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d5b2935-b036-429c-9e2c-7a1eab6af2c3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.748333 Oct 17 15:39:25.061116 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1757/3776] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:24 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:25.578221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:25.580352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:25.601091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:25.612364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:25.613616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:25.614661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:25.616582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:25.617767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:25.618797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:25.683451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:25.710160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:25.737015 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56ff1661-ccfc-4edc-b45b-2d5962c7e41b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.820194 Oct 17 15:39:25.746560 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2020/3777] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:24 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:25.864824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:25.889641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:25.922952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:25.928882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:25.933561 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-27fc4dda-3a97-415e-8ca2-6d6245f136c0 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.361105 Oct 17 15:39:25.934432 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1758/3778] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:25 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:26.109764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:26.111333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:26.123035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:26.124319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:26.125320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:26.126923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:26.128062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:26.129075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:26.379770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-145f7f14-588a-46de-a3b1-aaa3211796f5 req-d8a4ed2c-9716-40f8-9a4f-4ca2e67f7e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b793d7-d5e4-4688-9805-2d0997a9b2a1", "tag": "4d3a8932-7c9b-456c-afb4-5ea7006d3595"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:26.392568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-145f7f14-588a-46de-a3b1-aaa3211796f5 req-d8a4ed2c-9716-40f8-9a4f-4ca2e67f7e06 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:26.393368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-145f7f14-588a-46de-a3b1-aaa3211796f5 req-d8a4ed2c-9716-40f8-9a4f-4ca2e67f7e06 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:26.394163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-145f7f14-588a-46de-a3b1-aaa3211796f5 req-d8a4ed2c-9716-40f8-9a4f-4ca2e67f7e06 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:26.410808 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-145f7f14-588a-46de-a3b1-aaa3211796f5 req-d8a4ed2c-9716-40f8-9a4f-4ca2e67f7e06 service nova] Creating event network-changed:4d3a8932-7c9b-456c-afb4-5ea7006d3595 for instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 on n-h2-854441-12 Oct 17 15:39:26.417680 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-145f7f14-588a-46de-a3b1-aaa3211796f5 req-d8a4ed2c-9716-40f8-9a4f-4ca2e67f7e06 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044980 Oct 17 15:39:26.424582 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1759/3779] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:39:26.695176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:26.708806 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f5421a6-51ec-4461-a07d-56fcc767ce8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.606746 Oct 17 15:39:26.710099 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2021/3780] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:26 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:26.787216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:26.788046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:26.805058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:26.805584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:26.811662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:26.813307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:26.813871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:26.814539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:26.976314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:26.977328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:26.994321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:26.995351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:26.996979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:26.997995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:26.999878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:27.007749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:27.514150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:27.550110 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-47fcda7f-1a0b-4d55-ac0e-8fffac0d5ab4 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 0.768979 Oct 17 15:39:27.554322 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1760/3781] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:26 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:27.595598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:27.609133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:27.610803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:27.619401 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a632b31f-0abe-401f-b3c6-fa48b96e2c19 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.642970 Oct 17 15:39:27.648502 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2022/3782] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:26 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:39:27.759445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:27.760384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:27.775395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:27.776202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:27.776897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:27.777660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:27.778134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:27.778611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:28.244406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:28.257593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bbed00cb-0403-42f5-b6da-baead20b2874 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.502194 Oct 17 15:39:28.261495 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1761/3783] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:27 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:28.606255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:28.607991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:28.631394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:28.632872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:28.636948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:28.643287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:28.644202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:28.644874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:28.657557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:28.659504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:28.685900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:28.688871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:28.694937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:28.700173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:28.701045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:28.702568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:28.880108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:28.895959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:28.898356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:28.900470 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c898518b-b4e7-4346-a742-583dc1ef6fab tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.248704 Oct 17 15:39:28.917485 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1762/3784] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:28 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:39:29.290870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:29.301641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:29.325635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:29.329522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:29.335783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:29.342831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:29.343991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:29.344869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:30.047140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:30.061948 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a2c1a09-0958-432f-bd88-02b930418393 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1471 microversion: 2.1 time: 1.460918 Oct 17 15:39:30.062701 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2023/3785] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:28 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1471 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:30.078466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:30.088811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:30.117812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:30.118427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:30.120308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:30.122082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:30.124051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:30.124977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:30.374973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:30.386038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:30.408915 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f3a5378-48f6-425a-832d-29ae184e3143 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 1.124981 Oct 17 15:39:30.409816 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1763/3786] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:29 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:30.442278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:30.444393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:30.445837 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ed22669-0b04-4676-98c8-1537d2583202 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.381649 Oct 17 15:39:30.446629 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2024/3787] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:30 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:31.107486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:31.119921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:31.150905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:31.152021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:31.158277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:31.161880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:31.163317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:31.164590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:31.471526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:31.484377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:31.499618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:31.500530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:31.501982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:31.503110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:31.503846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:31.504492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:31.712543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:31.725136 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca39f1db-f32c-4cf9-852b-dfc411c1d6c8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1477 microversion: 2.1 time: 0.636953 Oct 17 15:39:31.729936 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1764/3788] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:31 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1477 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:31.756040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:31.756651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:31.773612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:31.775323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:31.777251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:31.779197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:31.780796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:31.783038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:32.013322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:32.026436 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72176f9a-81ce-4994-997f-fd8bf2b32671 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.568781 Oct 17 15:39:32.029877 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2025/3789] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:31 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:32.114908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:32.135733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:32.137569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:32.142725 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-822c3c5b-0a1c-4c10-a6e7-872a6cfd8bbb tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.410830 Oct 17 15:39:32.166685 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1765/3790] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:31 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:32.760547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:32.761950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:32.784604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:32.787947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:32.793198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:32.795771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:32.796602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:32.798190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:32.817269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f4b59a9-7bd9-43a0-be24-e4a81a845e04 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'create', calling method: .version_select at 0x7f28be098e50>, body: {"keypair": {"name": "tempest-keypair-1353973669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUU9D4Lbl5yjbLVsjpmtFzVWheksX18eohJvZ3zw+8F/1NwTrpNa7DasBKhT51qRfZxPZTsFOKavx1Yq70aZggX+B2HYZhEbR52NIg8uzieDaV8kb1tFSgadGsnv681xQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:32.824690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=83 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:32.883340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0f4b59a9-7bd9-43a0-be24-e4a81a845e04 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Getting quotas for project 8081c4b357e0404fb26842274162d055. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:39:32.914017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0f4b59a9-7bd9-43a0-be24-e4a81a845e04 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Getting quotas for user 60b5d6c1fa7c40c4876495acf7476732 and project 8081c4b357e0404fb26842274162d055. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:39:32.991333 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f4b59a9-7bd9-43a0-be24-e4a81a845e04 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.488222 Oct 17 15:39:32.995542 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2026/3791] 10.222.0.87 () {62 vars in 1200 bytes} [Mon Oct 17 15:39:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 493 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 15:39:33.082163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:33.082968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:33.095506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:33.096020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:33.096465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:33.097196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:33.097651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:33.098078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:33.657020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:33.698139 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc7de9cb-8f03-43a2-91b7-72e8ab6c60c7 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1477 microversion: 2.1 time: 0.940845 Oct 17 15:39:33.704139 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1766/3792] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:32 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1477 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:33.730398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:33.734356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:33.765903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:33.772146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:33.773998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:33.779127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:33.781682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:33.783309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:33.866233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:33.900427 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f64c8b62-d5d0-4acf-8f1e-65ad8bd8c8e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.822153 Oct 17 15:39:33.910541 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2027/3793] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:33 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:34.145829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:34.185859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:34.199616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:34.208097 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7f08041d-fbd7-435b-893a-5ee45956b698 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.498065 Oct 17 15:39:34.210416 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1767/3794] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:33 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:34.748681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:34.752362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:34.779645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:34.784985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:34.786130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:34.791516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:34.794104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:34.795168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:34.943620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:34.944534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:34.968773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:34.969350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:34.970290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:34.975597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:34.977211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:34.977886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:35.436762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:35.459376 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-720aac26-4a96-4647-a839-dd6e06965413 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.520580 Oct 17 15:39:35.466823 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1768/3795] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:34 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:39:35.485581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:35.489188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:35.515375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:35.516861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:35.517493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:35.518771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:35.521716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:35.522556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:35.729683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:35.744042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:35.746047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:35.754482 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed74b81f-1e5f-476f-9343-0aa2dc6685c9 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1365 microversion: 2.47 time: 0.285708 Oct 17 15:39:35.756696 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1769/3796] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:35 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:35.839929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-43326a51-1992-41da-b0ce-67898bace0bc req-bacb38d6-d62c-4120-9b64-409f8ca920b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bd75eb-4c68-4e49-8276-dc76c5d09d01", "name": "network-vif-unplugged", "status": "completed", "tag": "78fdf66f-958a-4ebb-8391-c05f8eef6e51"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:35.863158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-43326a51-1992-41da-b0ce-67898bace0bc req-bacb38d6-d62c-4120-9b64-409f8ca920b1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:35.866543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-43326a51-1992-41da-b0ce-67898bace0bc req-bacb38d6-d62c-4120-9b64-409f8ca920b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:35.867205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-43326a51-1992-41da-b0ce-67898bace0bc req-bacb38d6-d62c-4120-9b64-409f8ca920b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:35.913554 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-43326a51-1992-41da-b0ce-67898bace0bc req-bacb38d6-d62c-4120-9b64-409f8ca920b1 service nova] Creating event network-vif-unplugged:78fdf66f-958a-4ebb-8391-c05f8eef6e51 for instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 on n-h1-854441-12 Oct 17 15:39:35.924987 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-43326a51-1992-41da-b0ce-67898bace0bc req-bacb38d6-d62c-4120-9b64-409f8ca920b1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089775 Oct 17 15:39:35.926998 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1770/3797] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:35.998006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:36.039981 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c1bcd8b-2151-4c93-8403-f9b9362bb591 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1477 microversion: 2.1 time: 1.298503 Oct 17 15:39:36.051837 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2028/3798] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:34 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1477 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:36.485215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d93bd370-44f1-4384-897f-d81c26a1fe66 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28c2e309d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-198763401", "description": "tempest-description-1940749582"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:36.495190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:36.497880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:36.517024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:36.519255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:36.520374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:36.522372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:36.523520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:36.524749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:36.836819 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d93bd370-44f1-4384-897f-d81c26a1fe66 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.454701 Oct 17 15:39:36.840368 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1771/3799] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:39:36 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:36.863946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:36.867366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:36.889732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:36.890603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:36.891350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:36.892525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:36.893340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:36.893992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:36.917590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:36.955540 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-681862d6-6a90-4f25-ae0a-1d1419948ee0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.469057 Oct 17 15:39:36.957678 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2029/3800] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:36 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:36.982019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-267f480a-a2ac-420a-bb62-92cc27c48a48 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28c2f6c790>, body: {"security_group_rule": {"parent_group_id": "aba937a0-c199-47fe-8e3a-338060a91e66", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:37.063939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:37.095896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:37.099800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:37.104241 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a000d74-d484-466d-af62-8934aa4f424f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1371 microversion: 2.47 time: 0.258933 Oct 17 15:39:37.106205 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1772/3801] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:36 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:37.118020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:37.119597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:37.134009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:37.135397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:37.136606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:37.138267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:37.139101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:37.140105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:37.864430 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-267f480a-a2ac-420a-bb62-92cc27c48a48 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.903762 Oct 17 15:39:37.882537 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2030/3802] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:39:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:37.913039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30278b0b-89f9-4b19-b0db-a0f05e257850 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28be00af70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-294642676", "description": "tempest-description-1819677164"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:38.649150 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30278b0b-89f9-4b19-b0db-a0f05e257850 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.755104 Oct 17 15:39:38.652521 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2031/3803] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:39:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:39:38.664775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:38.673414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:38.692990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:38.696920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:38.698301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:38.699995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:38.701128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:38.704051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:38.827474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:38.862567 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dee6f6d6-bb3c-4683-951e-a9f963292822 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1477 microversion: 2.1 time: 1.753862 Oct 17 15:39:38.863720 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1773/3804] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:37 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1477 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:38.887054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:38.888223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:38.932670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:38.933594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:38.934419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:38.935739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:38.936601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:38.937364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:39.027529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:39.061263 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de0351e3-e924-464f-a803-b7290cc4b87c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.404348 Oct 17 15:39:39.062373 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2032/3805] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:38 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:39.095053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1232870566", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45b953ae-39a0-4880-adcf-507411759ef0"}], "security_groups": [{"name": "tempest-securitygroup--963798792"}], "key_name": "tempest-keypair-1353973669", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:39.350689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] validate_networks() for [('45b953ae-39a0-4880-adcf-507411759ef0', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:39:39.500351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:39.521090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:39.523581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:39.525075 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6196a889-6c5a-4238-8bac-600fe1e44a59 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1371 microversion: 2.47 time: 0.659940 Oct 17 15:39:39.526966 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1774/3806] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:38 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1371 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:39.539867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bef1e0cb-6dfc-4bd5-853a-687de073a4a9 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28be03d4c0>, body: {"security_group_rule": {"parent_group_id": "c89b2d46-989c-423b-be0b-8c2608f9697b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:40.360214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:39:40.363550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:39:40.365124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:39:40.366183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:39:40.367418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:39:40.384507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:40.385276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:40.386012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:40.387146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:40.387987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:40.388700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:40.413622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Getting quotas for project 8081c4b357e0404fb26842274162d055. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:39:40.424326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Getting quotas for user 60b5d6c1fa7c40c4876495acf7476732 and project 8081c4b357e0404fb26842274162d055. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:39:40.451922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:39:40.457990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:39:40.545287 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-930818f2-b98a-4791-8e1f-3d665f802ed3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.476031 Oct 17 15:39:40.556985 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2033/3807] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:39:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:39:40.578903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:40.587967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:40.617516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:40.618752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:40.619394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:40.621951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:40.623184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:40.624145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:40.897417 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bef1e0cb-6dfc-4bd5-853a-687de073a4a9 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.365001 Oct 17 15:39:40.901616 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1775/3808] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:39:39 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:40.920015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:40.920659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:40.934322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:40.934859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:40.936016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:40.936789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:40.937257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:40.937744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:41.024605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:41.053342 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a5028b8-7b01-4098-a68c-bbb3ea4f3e95 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1477 microversion: 2.1 time: 0.494168 Oct 17 15:39:41.067360 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2034/3809] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:40 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1477 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:41.084315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5ac2d67-5e1f-415c-8c67-651f1f4fe58d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:41.085711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5ac2d67-5e1f-415c-8c67-651f1f4fe58d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:41.212649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5ac2d67-5e1f-415c-8c67-651f1f4fe58d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:41.254475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5ac2d67-5e1f-415c-8c67-651f1f4fe58d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:41.258702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5ac2d67-5e1f-415c-8c67-651f1f4fe58d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:41.261776 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5ac2d67-5e1f-415c-8c67-651f1f4fe58d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1282 microversion: 2.20 time: 0.190551 Oct 17 15:39:41.263424 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2035/3810] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:41 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:41.281049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:41.283394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:41.313288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:41.314530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:41.315546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:41.317480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:41.318867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:41.319956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:41.408737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:41.422303 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c72f3e6b-0fd6-4e3a-b808-273575581b14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.519264 Oct 17 15:39:41.422938 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1776/3811] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:40 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:41.431101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-adc01c09-f78a-4b99-b696-81034c363428 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28c2efcd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1593161602", "description": "tempest-description-6028186"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:41.520113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:41.550558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:41.562975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:41.565690 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ecdda261-fc54-423b-8a4a-c749939acb9f tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1356 microversion: 2.47 time: 0.299687 Oct 17 15:39:41.568208 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2036/3812] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:41 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1356 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:41.625590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:41.637034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:41.638926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Searching by: {'deleted': False, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:39:41.652098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:41.653179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:41.654064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:41.655484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:41.657367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:41.658455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:42.060361 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-adc01c09-f78a-4b99-b696-81034c363428 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.632924 Oct 17 15:39:42.065789 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1777/3813] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:39:41 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:42.085618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:39:42.095699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d24880e3-dee9-4a81-8c81-f6f6c04ec035 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28c2f65550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1511091446", "description": "tempest-description-238628730"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:42.361194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:42.391980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:42.397058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:42.397598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:42.438264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:42.441734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:42.555559 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5564ead2-d869-4984-854e-e8b0029d5c18 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.938793 Oct 17 15:39:42.557428 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2037/3814] 10.222.0.87 () {60 vars in 1187 bytes} [Mon Oct 17 15:39:41 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:42.585755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:42.586380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:42.600744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:42.602189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:42.603612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:42.606191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:42.622620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:42.623902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:42.887513 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d24880e3-dee9-4a81-8c81-f6f6c04ec035 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.807700 Oct 17 15:39:42.888581 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1778/3815] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:39:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:42.894269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:42.898256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:42.915611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:42.917685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:42.918297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:42.919111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:42.924927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:42.925398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:43.084103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:43.097868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:43.100388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:43.102060 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5cfd534f-5f66-4736-98ce-8048fa9634ba tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1334 microversion: 2.20 time: 0.212286 Oct 17 15:39:43.102911 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1779/3816] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:42 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1334 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:43.108458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:43.109785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:43.119389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:43.120440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:43.121064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:43.122020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:43.122710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:43.123295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:43.642861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:43.678285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:43.683724 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4497ea42-e654-4829-9d7d-d29501a311de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.578492 Oct 17 15:39:43.685484 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1780/3817] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:43 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:43.694116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:43.695614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:43.705573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:43.706630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:43.707315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:43.708712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:43.709453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:43.710152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:43.764860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:39:43.854813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:43.868958 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0d15d39-5436-467e-9f80-4f7b4a86adaa tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1477 microversion: 2.1 time: 1.286857 Oct 17 15:39:43.870424 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2038/3818] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:42 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1477 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:43.884650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e33aa49-f000-421a-a8ca-79993b5d6871 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28bdfefd30>, body: {"security_group_rule": {"parent_group_id": "0c04adb3-efec-49b0-b394-a0437b637886", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3da2ed84-774d-4ddf-b1f6-b037ffcbf876"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:43.970077 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e8ce6d49-3db7-4b25-b791-1aca6975dc07 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 204 len: 0 microversion: 2.47 time: 0.280158 Oct 17 15:39:43.977262 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1781/3819] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:39:43 2022] DELETE /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:39:43.989387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5875347d-9a6b-4dcd-aafc-b478f3f63608 req-f7a1965c-3cc9-4f56-8ed1-4f2d716c2c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bd75eb-4c68-4e49-8276-dc76c5d09d01", "name": "network-vif-plugged", "status": "completed", "tag": "78fdf66f-958a-4ebb-8391-c05f8eef6e51"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:44.027648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5875347d-9a6b-4dcd-aafc-b478f3f63608 req-f7a1965c-3cc9-4f56-8ed1-4f2d716c2c7f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:44.028392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5875347d-9a6b-4dcd-aafc-b478f3f63608 req-f7a1965c-3cc9-4f56-8ed1-4f2d716c2c7f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:44.029419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5875347d-9a6b-4dcd-aafc-b478f3f63608 req-f7a1965c-3cc9-4f56-8ed1-4f2d716c2c7f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:44.080257 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5875347d-9a6b-4dcd-aafc-b478f3f63608 req-f7a1965c-3cc9-4f56-8ed1-4f2d716c2c7f service nova] Creating event network-vif-plugged:78fdf66f-958a-4ebb-8391-c05f8eef6e51 for instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 on n-h1-854441-12 Oct 17 15:39:44.095926 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5875347d-9a6b-4dcd-aafc-b478f3f63608 req-f7a1965c-3cc9-4f56-8ed1-4f2d716c2c7f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115407 Oct 17 15:39:44.100016 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1782/3820] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:44.118121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:44.121734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:44.137111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:44.137545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:44.138136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:44.143898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:44.147163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:44.150902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:44.364730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:44.378079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:44.384794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:44.386538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-65b8df72-1b2a-42f7-8d12-de6d16c5ccf5 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1362 microversion: 2.47 time: 0.282772 Oct 17 15:39:44.391644 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1783/3821] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:44 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:44.399636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:44.403213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:44.423590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:44.424117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:44.424572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:44.425615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:44.427012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:44.431269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:44.711315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:44.748149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:44.753911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:44.757723 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f7fbfa71-50a3-4643-8c91-cefd6ddf615b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1340 microversion: 2.20 time: 0.363704 Oct 17 15:39:44.770859 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1784/3822] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:44 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1340 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:44.782313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:44.784280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:44.807711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:44.808719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:44.809359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:44.810314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:44.811042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:44.811689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:44.932367 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e33aa49-f000-421a-a8ca-79993b5d6871 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.059954 Oct 17 15:39:44.933440 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2039/3823] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:39:43 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:44.938845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:44.939633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:44.960492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:44.963390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:44.965323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:44.967117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:44.967719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:44.968184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:45.062841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:45.074048 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d06dade9-2be7-4fe6-8385-7671d5667e8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.300301 Oct 17 15:39:45.075058 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1785/3824] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:44 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:45.080385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31102c1d-9e6a-436c-9699-74ed3baa6d61 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28bee36940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1334934773", "description": "tempest-description-295704010"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:45.388310 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31102c1d-9e6a-436c-9699-74ed3baa6d61 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.312088 Oct 17 15:39:45.397286 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1786/3825] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:39:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:45.402657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6fe22549-8599-45be-a355-878ac0c926c5 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28be32d280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-743690803", "description": "tempest-description-1352676282"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:45.475008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:45.494921 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e279584-c382-4bb5-84b0-55760b377d5d tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1477 microversion: 2.1 time: 0.557500 Oct 17 15:39:45.513124 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2040/3826] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:44 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1477 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:45.524676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:45.525471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:45.535237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:45.536002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:45.536654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:45.537770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:45.538926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:45.539756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:45.723613 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6fe22549-8599-45be-a355-878ac0c926c5 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.325129 Oct 17 15:39:45.724370 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1787/3827] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:39:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:39:45.749169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e538b7f5-9bc3-4aa1-8a82-c9ab3a29601a tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28be0311f0>, body: {"security_group_rule": {"parent_group_id": "81f9c0a2-7cb4-4972-ba1a-0dd6949a7009", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d0b50502-53d7-41e2-aca0-d38f50ab9d2a"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:46.182603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:46.377422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:46.417537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:46.420676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:46.449164 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5a9e0a8-7a1e-4d75-93c0-614e53c1bc62 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1362 microversion: 2.47 time: 0.932530 Oct 17 15:39:46.460692 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2041/3828] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:45 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1362 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:46.490743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:46.491885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:46.531305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:46.532183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:46.539230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:46.541050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:46.541820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:46.542567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:47.133313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:47.197597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:47.202920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:47.205618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-369ac051-6b1d-4ec2-b13b-4e4275517aa3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1340 microversion: 2.20 time: 0.743093 Oct 17 15:39:47.230378 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2042/3829] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:46 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1340 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:47.267128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:47.269457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:47.281889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:47.283283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:47.284366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:47.286045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:47.287172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:47.288271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:47.870983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:47.935129 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-952b4ee0-6509-4426-b3e6-b1b768c0cd4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1511 microversion: 2.1 time: 0.678311 Oct 17 15:39:47.948991 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2043/3830] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:47 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1511 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:47.955616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:47.956750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:47.976602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:47.977523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:47.978723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:47.980729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:47.984004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:48.000637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:48.107023 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e538b7f5-9bc3-4aa1-8a82-c9ab3a29601a tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.361789 Oct 17 15:39:48.108382 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1788/3831] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:39:45 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:48.116210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:48.123023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:48.144717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:48.153721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:48.155865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:48.163302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:48.170707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:48.171995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:48.174693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:48.319198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:48.320813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:48.321999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:48.323552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lazy-loading 'fault' on Instance uuid e573d688-ffbf-44a9-b98a-db0688ec836a {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:39:48.337525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:48.361813 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ca7819a-5a2e-42c4-b1df-5c539a7007c0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1462 microversion: 2.1 time: 0.409471 Oct 17 15:39:48.362805 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2044/3832] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:47 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1462 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:48.378205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-38a0ae52-e7b6-4e6d-b251-d89d989be793 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be009310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:48.566113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:48.603869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:48.610899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:48.615399 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ccbd8b68-c9a9-4f5d-b7e0-29f51359a4d3 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 200 len: 1367 microversion: 2.47 time: 0.505178 Oct 17 15:39:48.636102 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1789/3833] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:48 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 1367 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:48.678535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:48.679844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:48.712939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:48.732384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:48.733722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:48.737237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:48.747695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:48.748107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:48.859380 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-38a0ae52-e7b6-4e6d-b251-d89d989be793 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/d0b50502-53d7-41e2-aca0-d38f50ab9d2a" status: 202 len: 0 microversion: 2.1 time: 0.492628 Oct 17 15:39:48.859994 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2045/3834] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:39:48 2022] DELETE /compute/v2.1/os-security-groups/d0b50502-53d7-41e2-aca0-d38f50ab9d2a => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:39:48.865937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f95566aa-5b39-45a1-9a17-e9799a18decf tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:48.877857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f95566aa-5b39-45a1-9a17-e9799a18decf tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:48.893635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95566aa-5b39-45a1-9a17-e9799a18decf tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:48.897079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95566aa-5b39-45a1-9a17-e9799a18decf tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:48.897695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95566aa-5b39-45a1-9a17-e9799a18decf tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:48.898477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95566aa-5b39-45a1-9a17-e9799a18decf tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:48.898983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95566aa-5b39-45a1-9a17-e9799a18decf tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:48.901059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f95566aa-5b39-45a1-9a17-e9799a18decf tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:48.987922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:49.022110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:49.034846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:49.045391 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-10757a5a-80cc-48a4-bb54-f9d47fb02cdc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1340 microversion: 2.20 time: 0.392858 Oct 17 15:39:49.048550 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1790/3835] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:48 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1340 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:49.083805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-624026df-fa61-4fec-b590-67421397f877 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be051b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:49.093467 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f95566aa-5b39-45a1-9a17-e9799a18decf tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action" status: 202 len: 0 microversion: 2.1 time: 0.231784 Oct 17 15:39:49.095370 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2046/3836] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:39:48 2022] POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:39:49.101560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:49.102647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:49.109853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.110410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.110925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.111685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.112159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.112661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.314652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:49.338299 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a008daaa-5ac4-462f-a3e2-941fab940e01 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1488 microversion: 2.1 time: 0.241206 Oct 17 15:39:49.339851 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2047/3837] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:49 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1488 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:49.346377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:49.348903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:49.357754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.358726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.359616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.360802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.362649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.363431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.421763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.422707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.423357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.424055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lazy-loading 'fault' on Instance uuid a5bd75eb-4c68-4e49-8276-dc76c5d09d01 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:39:49.512320 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-624026df-fa61-4fec-b590-67421397f877 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups/81f9c0a2-7cb4-4972-ba1a-0dd6949a7009" status: 200 len: 247 microversion: 2.1 time: 0.459120 Oct 17 15:39:49.516075 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1791/3838] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:39:49 2022] GET /compute/v2.1/os-security-groups/81f9c0a2-7cb4-4972-ba1a-0dd6949a7009 => generated 247 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:49.538060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-506f0bd6-33eb-4d3b-8d00-8097fa34b5de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:49.548188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-506f0bd6-33eb-4d3b-8d00-8097fa34b5de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:49.576447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506f0bd6-33eb-4d3b-8d00-8097fa34b5de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.576876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506f0bd6-33eb-4d3b-8d00-8097fa34b5de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.577714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506f0bd6-33eb-4d3b-8d00-8097fa34b5de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.579792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506f0bd6-33eb-4d3b-8d00-8097fa34b5de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.580303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506f0bd6-33eb-4d3b-8d00-8097fa34b5de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.580720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-506f0bd6-33eb-4d3b-8d00-8097fa34b5de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.667404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-506f0bd6-33eb-4d3b-8d00-8097fa34b5de tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 200 len: 149 microversion: 2.1 time: 0.148934 Oct 17 15:39:49.677717 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1792/3839] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:39:49 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 149 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:49.710341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8e073815-e648-4109-af7e-c523a473f358 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28be037280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-54508942", "description": "tempest-description-1260466782"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:49.718466 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c89a490d-a2cf-44b5-b61e-59ee7a66c5b7 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1598 microversion: 2.1 time: 0.376860 Oct 17 15:39:49.737005 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2048/3840] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:49 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1598 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:49.737005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:49.737005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: e573d688-ffbf-44a9-b98a-db0688ec836a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:49.748787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.748787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.748787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.748787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.749710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.750378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.793103 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] HTTP exception thrown: Instance e573d688-ffbf-44a9-b98a-db0688ec836a could not be found. Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Request method failure captured: Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a HTTP/1.1 Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXcJqXB1HTxyUVYtpBys8J6533eJyJfn5jv_kAjkjPjgaZErXc3OK9tzgEvcQB1MHVyfvLULrXaI3uUcJ9arsvPPP_5xRZhUBPkLDEa2EkPYmnGyf9i-QEqgGAAMeKEhwKNYSjG8j8aetq1T1SSiCsgXhHK0zp5nJ4TgT5nmnFh4BTU Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: cdd40a71d8364c768f8dee27f233a4cc Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerShowV247Test-1988804129 Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cdd40a71d8364c768f8dee27f233a4cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cdd40a71d8364c768f8dee27f233a4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cdd40a71d8364c768f8dee27f233a4cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cdd40a71d8364c768f8dee27f233a4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerShowV247Test-1988804129 Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: cdd40a71d8364c768f8dee27f233a4cc Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerShowV247Test-1988804129 Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerShowV247Test-1988804129-project Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 3d230f7054ba46aba748b62714318077 Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerShowV247Test-1988804129-project Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e573d688-ffbf-44a9-b98a-db0688ec836a could not be found. Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e573d688-ffbf-44a9-b98a-db0688ec836a'} Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e573d688-ffbf-44a9-b98a-db0688ec836a could not be found. Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e573d688-ffbf-44a9-b98a-db0688ec836a could not be found. Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:49.794896 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:49.799498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:49.799498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:49.799498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:49.799498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:39:49.799498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:39:49.799498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e573d688-ffbf-44a9-b98a-db0688ec836a could not be found. Oct 17 15:39:49.799498 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:49.799498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Returning 404 to user: Instance e573d688-ffbf-44a9-b98a-db0688ec836a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:39:49.799498 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-101ebd56-82d1-4a5e-951e-3f0d3f1c6751 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a" status: 404 len: 111 microversion: 2.47 time: 0.071435 Oct 17 15:39:49.800128 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2049/3841] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:49 2022] GET /compute/v2.1/servers/e573d688-ffbf-44a9-b98a-db0688ec836a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:39:49.804770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:49.805401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:49.813571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.814083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.814568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:49.815347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:49.815823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:49.816327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:50.165783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:50.178025 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b57e2c9d-6f48-4b65-a3d7-3cffd208bafa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.376829 Oct 17 15:39:50.179238 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2050/3842] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:49 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:50.185230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5116add2-36b2-4fb1-8a98-62d7ff29407b tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:50.188248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5116add2-36b2-4fb1-8a98-62d7ff29407b tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:50.198327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5116add2-36b2-4fb1-8a98-62d7ff29407b tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:50.198900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5116add2-36b2-4fb1-8a98-62d7ff29407b tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:50.199524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5116add2-36b2-4fb1-8a98-62d7ff29407b tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:50.200446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5116add2-36b2-4fb1-8a98-62d7ff29407b tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:50.202045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5116add2-36b2-4fb1-8a98-62d7ff29407b tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:50.202045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5116add2-36b2-4fb1-8a98-62d7ff29407b tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:50.361085 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5116add2-36b2-4fb1-8a98-62d7ff29407b tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action" status: 202 len: 0 microversion: 2.1 time: 0.180348 Oct 17 15:39:50.367406 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2051/3843] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:39:50 2022] POST /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:39:50.368643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:50.370024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: b3271e00-3d59-485f-914a-c9deace9980c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:50.378821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:50.380262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:50.380946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:50.381718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:50.382591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:50.383193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:50.421535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: b3271e00-3d59-485f-914a-c9deace9980c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:39:50.539981 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f84568b7-ff6d-484a-88ab-8f33900cf83d tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c" status: 204 len: 0 microversion: 2.47 time: 0.176002 Oct 17 15:39:50.543904 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2052/3844] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:39:50 2022] DELETE /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:39:50.548658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1456849294", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "81abcf9c-9e78-4af8-ab08-6def5a2e1c51"}, {"uuid": "3de21805-9ff0-4c68-83b7-1dea08ae1816"}, {"uuid": "81abcf9c-9e78-4af8-ab08-6def5a2e1c51"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:50.627566 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8e073815-e648-4109-af7e-c523a473f358 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.946185 Oct 17 15:39:50.642620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] validate_networks() for [('81abcf9c-9e78-4af8-ab08-6def5a2e1c51', None, None, None, None, None), ('3de21805-9ff0-4c68-83b7-1dea08ae1816', None, None, None, None, None), ('81abcf9c-9e78-4af8-ab08-6def5a2e1c51', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:39:50.646040 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1793/3845] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:39:49 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:50.666758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:50.669126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:50.685125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:50.685960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:50.686766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:50.687800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:50.688463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:50.689069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:51.196106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:51.211606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:51.213478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:51.214990 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0711dbba-3910-4116-8e3b-626c85c417e7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1407 microversion: 2.20 time: 0.566091 Oct 17 15:39:51.221650 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1794/3846] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:50 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:51.244761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:51.246935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:51.278930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:51.279738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:51.280367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:51.281560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:51.282411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:51.283097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:51.624886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:51.637418 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-127695cb-9557-4424-a63d-6f7738dc72f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.400916 Oct 17 15:39:51.638404 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1795/3847] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:51 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:51.646811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f122789-8c92-4edb-b4f1-9dc1800d8ff0 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:51.650864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5f122789-8c92-4edb-b4f1-9dc1800d8ff0 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:51.667145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f122789-8c92-4edb-b4f1-9dc1800d8ff0 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:51.667857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f122789-8c92-4edb-b4f1-9dc1800d8ff0 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:51.668508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f122789-8c92-4edb-b4f1-9dc1800d8ff0 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:51.669423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f122789-8c92-4edb-b4f1-9dc1800d8ff0 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:51.670765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f122789-8c92-4edb-b4f1-9dc1800d8ff0 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:51.671393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f122789-8c92-4edb-b4f1-9dc1800d8ff0 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:51.916310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:51.999534 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5f122789-8c92-4edb-b4f1-9dc1800d8ff0 tempest-ServersAdminTestJSON-414362256 tempest-ServersAdminTestJSON-414362256-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1615 microversion: 2.1 time: 0.359394 Oct 17 15:39:52.019235 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1796/3848] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:51 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1615 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:52.034098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:52.035164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: b3271e00-3d59-485f-914a-c9deace9980c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:52.052135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:52.053069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:52.058918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:52.060734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:52.061449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:52.062282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:52.182438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:39:52.183047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:39:52.183546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:39:52.183964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:39:52.184561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:39:52.195809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:52.196647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:52.197267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:52.198360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:52.199182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:52.199816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:52.225056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Getting quotas for project 99b699ae886f4742a317cff0aa265510. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:39:52.232316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Getting quotas for user 3e9f8900f5164afdaf9deac86f6b4e28 and project 99b699ae886f4742a317cff0aa265510. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:39:52.243295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:52.251529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:39:52.254751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:52.255049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:39:52.257275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:52.258896 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-65d3ee73-ea66-4cc6-bf32-8a3a928b1051 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c" status: 200 len: 1362 microversion: 2.47 time: 0.238168 Oct 17 15:39:52.260166 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1797/3849] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:52 2022] GET /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:52.267400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad04e15e-9c9e-4687-adf0-6a100ba586a9 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28c2e30f70>, body: {"security_group_rule": {"parent_group_id": "0bd1faed-9662-40f1-a472-443be1ae0675", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:52.326205 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3624fab-5613-42cb-bcdf-8a07dc63275c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.783554 Oct 17 15:39:52.326900 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2053/3850] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:39:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:39:52.332100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:52.332800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:52.335306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:52.348330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:52.349231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:52.349912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:52.351203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:52.351870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:52.352853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:52.660774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:52.673847 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc5ad5b3-3055-460a-8f74-37283f290169 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.345017 Oct 17 15:39:52.687266 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2054/3851] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:52 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:52.700717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:52.701729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:52.720815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:52.726246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:52.728502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:52.729575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:52.730294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:52.731379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:52.787734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:52.806392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:39:53.001710 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e62f10dd-f7d2-4292-90ab-30f087141e7f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "DELETE /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 204 len: 0 microversion: 2.1 time: 0.311341 Oct 17 15:39:53.003297 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2055/3852] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:39:52 2022] DELETE /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:39:53.016408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:53.018166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:53.042592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.045634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.050491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.052624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.054699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.074592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.439357 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad04e15e-9c9e-4687-adf0-6a100ba586a9 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.177569 Oct 17 15:39:53.440702 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1798/3853] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:39:52 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:53.446435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:53.448084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:53.466251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.467108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.467626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.470697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.471682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.472816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.556540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:53.572700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:53.575725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:53.588498 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-617d0fec-73d2-4774-9beb-4b655ed27bb2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1407 microversion: 2.20 time: 0.572848 Oct 17 15:39:53.589673 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2056/3854] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:53 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:53.596406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-de673aac-15bd-4d5c-a053-302815b98e54 req-deba2c85-1134-4b9b-a28f-b0e8fca8029d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f53954-5109-4fb4-8634-490b9664c7d8", "tag": "c4a74e76-9816-486b-854c-027fd5b61d05"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:53.639241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-de673aac-15bd-4d5c-a053-302815b98e54 req-deba2c85-1134-4b9b-a28f-b0e8fca8029d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.639733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-de673aac-15bd-4d5c-a053-302815b98e54 req-deba2c85-1134-4b9b-a28f-b0e8fca8029d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.640172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-de673aac-15bd-4d5c-a053-302815b98e54 req-deba2c85-1134-4b9b-a28f-b0e8fca8029d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.670975 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-de673aac-15bd-4d5c-a053-302815b98e54 req-deba2c85-1134-4b9b-a28f-b0e8fca8029d service nova] Creating event network-changed:c4a74e76-9816-486b-854c-027fd5b61d05 for instance 45f53954-5109-4fb4-8634-490b9664c7d8 on n-h2-854441-12 Oct 17 15:39:53.676994 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-de673aac-15bd-4d5c-a053-302815b98e54 req-deba2c85-1134-4b9b-a28f-b0e8fca8029d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085590 Oct 17 15:39:53.682071 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2057/3855] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:53.694019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:53.694827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:53.707078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.709566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.710039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.713440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:53.722823 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1dc2c2c-c44a-4265-a86b-c4ce47d5c65c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1217 microversion: 2.1 time: 0.280871 Oct 17 15:39:53.723446 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1799/3856] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:53 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:53.725005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.725496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.726213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.733199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:53.741788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:53.742990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Searching by: {'deleted': False, 'project_id': '22cbf1b0a6144426a471e575780008d0'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:39:53.750356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.751235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.751719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.752533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.753007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.753442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.782262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:39:53.833864 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc09556f-4444-4cd0-97de-57f3a1d6b823 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.100197 Oct 17 15:39:53.843988 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1800/3857] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:39:53 2022] GET /compute/v2.1/servers => generated 339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:53.851178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:53.852300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:53.861929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.863596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.864418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:53.865919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:53.866664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:53.867508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:54.016720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:54.030195 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed646137-6226-464b-8b57-a0e235930162 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.346108 Oct 17 15:39:54.050541 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2058/3858] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:53 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:54.050541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:54.050541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: b3271e00-3d59-485f-914a-c9deace9980c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:54.052109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:54.052338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:54.053067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:54.054628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:54.055422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:54.056026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:54.146646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:54.151789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:54.155296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:54.155769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lazy-loading 'fault' on Instance uuid b3271e00-3d59-485f-914a-c9deace9980c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:39:54.203239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:54.231945 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-edd8ce4e-a9aa-4b26-926a-d34848bd7bc0 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1469 microversion: 2.1 time: 0.386345 Oct 17 15:39:54.233294 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1801/3859] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:53 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1469 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:54.233994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:54.244700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:54.246208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d230f7054ba46aba748b62714318077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd40a71d8364c768f8dee27f233a4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:54.247569 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-20a1622d-990f-45a6-b285-708203de7511 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c" status: 200 len: 1367 microversion: 2.47 time: 0.212647 Oct 17 15:39:54.248669 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2059/3860] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:54 2022] GET /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:54.250786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-60b1e0ca-bae3-4ba7-8c28-9c2431824740 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Action: 'create', calling method: .version_select at 0x7f28be03d820>, body: {"security_group_rule": {"parent_group_id": "0bd1faed-9662-40f1-a472-443be1ae0675", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:54.269831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:54.292088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:54.293456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Searching by: {'deleted': False, 'project_id': '22cbf1b0a6144426a471e575780008d0'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:39:54.308110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:54.308815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:54.309456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:54.310489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:54.311174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:54.311603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:54.352428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:39:54.507742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:54.530922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:54.532594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:54.532751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:54.742274 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7763bf0c-914d-426f-8312-c2ca477c1a68 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.492126 Oct 17 15:39:54.759145 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2060/3861] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:39:54 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:54.770759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1830422239", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "dd932f3b-36f3-4be3-9d4c-cbbd034c0114"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:54.836881 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-60b1e0ca-bae3-4ba7-8c28-9c2431824740 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.601566 Oct 17 15:39:54.839922 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1802/3862] 10.222.0.87 () {60 vars in 1195 bytes} [Mon Oct 17 15:39:54 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:54.851849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] validate_networks() for [('dd932f3b-36f3-4be3-9d4c-cbbd034c0114', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:39:54.860909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:54.861550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:54.873868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:54.874374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:54.874923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:54.878019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:54.878753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:54.879403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:54.888055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:39:55.605907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:39:55.606764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:39:55.606955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:39:55.607347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:39:55.607768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:39:55.619161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:55.619825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:55.620390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:55.621276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:55.621970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:55.622573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:55.652851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:39:55.660243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for user 15cc78a142a148398dc438b5ff2a25e9 and project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:39:55.677711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:39:55.680791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:39:55.740866 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c16bccbc-c3bc-41a4-aa29-ea04495084c9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980144 Oct 17 15:39:55.741964 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2061/3863] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:39:55.752661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:55.753293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:55.770196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:55.771624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:55.772606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:55.778196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:55.779986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:55.780918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:55.848391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:55.889772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:55.896135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:55.901734 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-98d7621b-84a1-4d2d-82b6-41a022c72261 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1407 microversion: 2.20 time: 1.060236 Oct 17 15:39:55.906713 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1803/3864] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:54 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1407 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:55.939894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bdb923c1-9061-4509-b965-6454b8e10f3a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:55.975310 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bdb923c1-9061-4509-b965-6454b8e10f3a tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.064204 Oct 17 15:39:55.981229 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1804/3865] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:39:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:56.005291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a1ed4958-3955-42c3-8049-45a51d238ee7 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be04eee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:56.024790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:56.044958 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85fefae7-7fd6-4a51-8dfa-3da715e59844 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1265 microversion: 2.1 time: 0.301410 Oct 17 15:39:56.071677 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2062/3866] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:55 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:56.085258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:56.086435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:56.097720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:56.099290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:56.100006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:56.102250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:56.103189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:56.105495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:56.391722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:56.427708 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eef7c5fc-9084-4784-9ffc-28c69e3d3183 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 200 len: 1427 microversion: 2.1 time: 0.353997 Oct 17 15:39:56.431637 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2063/3867] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:56 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 1427 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:56.469547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:56.476184 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a1ed4958-3955-42c3-8049-45a51d238ee7 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "GET /compute/v2.1/os-security-groups/0bd1faed-9662-40f1-a472-443be1ae0675" status: 200 len: 663 microversion: 2.1 time: 0.493087 Oct 17 15:39:56.479128 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1805/3868] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:39:55 2022] GET /compute/v2.1/os-security-groups/0bd1faed-9662-40f1-a472-443be1ae0675 => generated 663 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:56.485302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b41b867f-2fc0-4c77-8667-3fb04241d22f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:56.489273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b41b867f-2fc0-4c77-8667-3fb04241d22f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:56.490307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] [instance: b3271e00-3d59-485f-914a-c9deace9980c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:56.527148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:56.529914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:56.530811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:56.536371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:56.537536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:56.538225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:56.642138 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] HTTP exception thrown: Instance b3271e00-3d59-485f-914a-c9deace9980c could not be found. Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Request method failure captured: Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c HTTP/1.1 Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXcJqXB1HTxyUVYtpBys8J6533eJyJfn5jv_kAjkjPjgaZErXc3OK9tzgEvcQB1MHVyfvLULrXaI3uUcJ9arsvPPP_5xRZhUBPkLDEa2EkPYmnGyf9i-QEqgGAAMeKEhwKNYSjG8j8aetq1T1SSiCsgXhHK0zp5nJ4TgT5nmnFh4BTU Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: cdd40a71d8364c768f8dee27f233a4cc Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerShowV247Test-1988804129 Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cdd40a71d8364c768f8dee27f233a4cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cdd40a71d8364c768f8dee27f233a4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cdd40a71d8364c768f8dee27f233a4cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cdd40a71d8364c768f8dee27f233a4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerShowV247Test-1988804129 Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: cdd40a71d8364c768f8dee27f233a4cc Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerShowV247Test-1988804129 Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerShowV247Test-1988804129-project Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 3d230f7054ba46aba748b62714318077 Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerShowV247Test-1988804129-project Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance b3271e00-3d59-485f-914a-c9deace9980c could not be found. Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'b3271e00-3d59-485f-914a-c9deace9980c'} Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3271e00-3d59-485f-914a-c9deace9980c could not be found. Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3271e00-3d59-485f-914a-c9deace9980c could not be found. Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:56.645786 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:56.650558 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:56.650558 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:56.650558 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:56.650558 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:39:56.650558 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:39:56.650558 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3271e00-3d59-485f-914a-c9deace9980c could not be found. Oct 17 15:39:56.650558 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:56.664868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] Returning 404 to user: Instance b3271e00-3d59-485f-914a-c9deace9980c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:39:56.666313 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ffb085d-d590-40b3-abea-92a8af32bbd7 tempest-ServerShowV247Test-1988804129 tempest-ServerShowV247Test-1988804129-project] 10.222.0.87 "GET /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c" status: 404 len: 111 microversion: 2.47 time: 0.222335 Oct 17 15:39:56.668393 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2064/3869] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:56 2022] GET /compute/v2.1/servers/b3271e00-3d59-485f-914a-c9deace9980c => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:39:56.699206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9f2697e6-d84d-430b-aaa3-aa6534aead80 req-b2f2f65a-aec6-42f1-9700-b52dc7b378de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c", "name": "network-vif-deleted", "tag": "25a9919e-b581-48d8-bce0-fd4089193597"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:39:56.740626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f2697e6-d84d-430b-aaa3-aa6534aead80 req-b2f2f65a-aec6-42f1-9700-b52dc7b378de service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:56.745617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f2697e6-d84d-430b-aaa3-aa6534aead80 req-b2f2f65a-aec6-42f1-9700-b52dc7b378de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:56.753554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9f2697e6-d84d-430b-aaa3-aa6534aead80 req-b2f2f65a-aec6-42f1-9700-b52dc7b378de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:56.803081 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9f2697e6-d84d-430b-aaa3-aa6534aead80 req-b2f2f65a-aec6-42f1-9700-b52dc7b378de service nova] Creating event network-vif-deleted:25a9919e-b581-48d8-bce0-fd4089193597 for instance 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c on n-h1-854441-12 Oct 17 15:39:56.825511 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9f2697e6-d84d-430b-aaa3-aa6534aead80 req-b2f2f65a-aec6-42f1-9700-b52dc7b378de service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155406 Oct 17 15:39:56.833817 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2065/3870] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:39:56.865637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:56.875703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:56.890303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b41b867f-2fc0-4c77-8667-3fb04241d22f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:56.907648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:56.909790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:56.910264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:56.914986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:56.915604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:56.916068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:56.933041 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b41b867f-2fc0-4c77-8667-3fb04241d22f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1215 microversion: 2.1 time: 0.445614 Oct 17 15:39:56.937681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1806/3871] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:56 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1215 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:56.957241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95e301ef-a899-4be4-9098-8c0521c9315e tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28beb0b3a0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:56.995077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:39:57.228249 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7e96b59-6ed7-4198-bc10-cdbe5d10e057 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 204 len: 0 microversion: 2.1 time: 0.391484 Oct 17 15:39:57.233590 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2066/3872] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:39:56 2022] DELETE /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:39:57.252199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:57.255475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:57.279768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:57.281894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:57.283220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:57.287794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:57.289076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:57.290548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:57.691807 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95e301ef-a899-4be4-9098-8c0521c9315e tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-group-rules/beea9791-016b-44ae-93a1-3d92553e5164" status: 202 len: 0 microversion: 2.1 time: 0.751636 Oct 17 15:39:57.693026 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1807/3873] 10.222.0.87 () {58 vars in 1287 bytes} [Mon Oct 17 15:39:56 2022] DELETE /compute/v2.1/os-security-group-rules/beea9791-016b-44ae-93a1-3d92553e5164 => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:39:57.710617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:57.713078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:57.726311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:57.727420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:57.728210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:57.729515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:57.731374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:57.732243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:57.860174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:57.871786 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1570445a-cd29-4611-8075-c3c43c18947b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1271 microversion: 2.1 time: 0.176857 Oct 17 15:39:57.873338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1808/3874] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:57 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:57.879071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:57.880113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:57.893625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:57.895203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:57.895896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:57.897054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:57.897753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:57.898482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:58.018636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:58.045948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:58.050139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:58.056756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-575b1e5c-0844-4f56-ab4d-d8f0b23418af tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1407 microversion: 2.20 time: 0.820519 Oct 17 15:39:58.058939 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2067/3875] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:57 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1407 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:58.080403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:58.081568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:58.091164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:58.091674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:58.092119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:58.092849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:58.093536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:58.094459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:58.121735 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] HTTP exception thrown: Instance 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c could not be found. Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Request method failure captured: Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c HTTP/1.1 Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXaV9vYlZYpzKB0EOZzgOmf5zKA4xMmLQZ2ydKoamKzQBmakJdyJO-PnN04J3SsoztmlmCNc8z-oX7iwqW3exruoTLU_zCtFHkjKZGnj0lPSVc47_yKz-LuKYMLIaNPuqIHl-V454GJ1vYESrX8UJL4KrDBSJUpAaUKpRGdQDXYeMNQ Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 3e312b32190a41ee84947b87f0f75026 Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminTestJSON-526471107 Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3e312b32190a41ee84947b87f0f75026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3e312b32190a41ee84947b87f0f75026"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3e312b32190a41ee84947b87f0f75026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3e312b32190a41ee84947b87f0f75026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminTestJSON-526471107 Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 3e312b32190a41ee84947b87f0f75026 Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminTestJSON-526471107 Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersAdminTestJSON-526471107-project Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: addc1f19b42f47d199887d51c196012a Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminTestJSON-526471107-project Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c could not be found. Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c'} Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c could not be found. Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c could not be found. Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:58.125104 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c could not be found. Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Returning 404 to user: Instance 43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d660c265-573e-4b90-951c-11547aaa6529 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c" status: 404 len: 111 microversion: 2.1 time: 0.066280 Oct 17 15:39:58.130263 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2068/3876] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:58 2022] GET /compute/v2.1/servers/43e72aaf-f2fe-4dae-a7d8-6aa844dfea7c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:39:58.143749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-746c3878-d572-4298-aca0-2201b13e32bc tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be0fa5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:58.220603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:58.233347 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6445c61-70c3-42e8-8d93-d4f8517d29c1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1713 microversion: 2.1 time: 0.358626 Oct 17 15:39:58.234186 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1809/3877] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:57 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1713 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:58.240966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:58.241767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:58.250804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:58.251734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:58.253694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:58.254759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:58.255467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:58.256136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:58.357045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:58.371168 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8e2acba3-a22a-441d-8a8d-1eab55017ecf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1267 microversion: 2.1 time: 0.135025 Oct 17 15:39:58.372185 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1810/3878] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:58 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:58.382610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:58.383527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:58.396319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:58.397328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:58.398166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:58.401430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:58.403063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:58.403948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:58.456797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:39:58.676112 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-50dc3d80-e134-4487-b12f-21913256a345 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 204 len: 0 microversion: 2.1 time: 0.301268 Oct 17 15:39:58.681103 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1811/3879] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:39:58 2022] DELETE /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:39:58.701862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:58.704650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:58.725111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:58.728565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:58.730124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:58.733089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:58.735407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:58.736261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:59.110001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:59.128279 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-392dd857-bf22-44d4-8f27-c91e661f317c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1470 microversion: 2.1 time: 0.436513 Oct 17 15:39:59.130355 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1812/3880] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:58 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1470 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:59.150261 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-746c3878-d572-4298-aca0-2201b13e32bc tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/0bd1faed-9662-40f1-a472-443be1ae0675" status: 202 len: 0 microversion: 2.1 time: 1.018864 Oct 17 15:39:59.151136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:59.151871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:59.153136 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2069/3881] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:39:58 2022] DELETE /compute/v2.1/os-security-groups/0bd1faed-9662-40f1-a472-443be1ae0675 => generated 0 bytes in 1023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:39:59.169997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:59.171850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:59.182105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:59.182647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:59.183103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:59.183858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:59.184320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:59.194119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:59.205503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:59.211338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:59.217596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:59.219632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:59.227723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:59.228499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:59.688821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:59.689113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:59.705565 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f8afd8f-2d76-4011-8c8c-99f996f62e8a tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1313 microversion: 2.1 time: 0.571096 Oct 17 15:39:59.708574 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1813/3882] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:59 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:39:59.733858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:59.737774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fec4d3dc-91a2-4ab4-9cb2-e76ecb6ee5b5 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be09f310>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:59.746830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:39:59.749600 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6688b8b2-680f-4293-84a3-02f1d9cf8cc5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1407 microversion: 2.20 time: 0.594331 Oct 17 15:39:59.766531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2070/3883] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:39:59 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1407 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:39:59.769026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:39:59.770403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:39:59.783967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:59.784809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:59.786643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:59.788665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:39:59.789816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:39:59.791113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:39:59.917075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-fec4d3dc-91a2-4ab4-9cb2-e76ecb6ee5b5 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0b50502-53d7-41e2-aca0-d38f50ab9d2a does not exist", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:39:59.918137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.security_group_api [None req-fec4d3dc-91a2-4ab4-9cb2-e76ecb6ee5b5 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Neutron security group d0b50502-53d7-41e2-aca0-d38f50ab9d2a not found {{(pid=120407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 15:39:59.919302 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-fec4d3dc-91a2-4ab4-9cb2-e76ecb6ee5b5 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] HTTP exception thrown: Security group d0b50502-53d7-41e2-aca0-d38f50ab9d2a does not exist Oct 17 15:39:59.919302 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-78148561-2bb9-4fbb-9617-90caa8211f1c'] Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fec4d3dc-91a2-4ab4-9cb2-e76ecb6ee5b5 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Request method failure captured: Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-security-groups/d0b50502-53d7-41e2-aca0-d38f50ab9d2a HTTP/1.1 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXc4H2pX-kYrcISniwC_6Zlm-JiQHP1MJf-oddv8Rhi8YIqvVhkKkqT5IEY4ngkoS_tOxkTgzgimYR3FeXFKG8wEFtgkrhlod9vgr2wQGuROAg3ougXH-QmRoDJxYbhulCZDkvZb-OaXhkISe2Kpw8tFmswKenuFpUqq0xBkUSGQCU4 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: ad261764d685440f8eb2f8755c6fcc66 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1824601676 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad261764d685440f8eb2f8755c6fcc66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ad261764d685440f8eb2f8755c6fcc66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ad261764d685440f8eb2f8755c6fcc66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad261764d685440f8eb2f8755c6fcc66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1824601676 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: ad261764d685440f8eb2f8755c6fcc66 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1824601676 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-SecurityGroupRulesTestJSON-1824601676-project Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 42373ad55e2f4de092dbd93213404014 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1824601676-project Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: exception: Security group d0b50502-53d7-41e2-aca0-d38f50ab9d2a does not exist Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-78148561-2bb9-4fbb-9617-90caa8211f1c'] Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd0b50502-53d7-41e2-aca0-d38f50ab9d2a'} Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:39:59.923829 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d0b50502-53d7-41e2-aca0-d38f50ab9d2a does not exist Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78148561-2bb9-4fbb-9617-90caa8211f1c'] Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d0b50502-53d7-41e2-aca0-d38f50ab9d2a does not exist Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78148561-2bb9-4fbb-9617-90caa8211f1c'] Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d0b50502-53d7-41e2-aca0-d38f50ab9d2a does not exist Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78148561-2bb9-4fbb-9617-90caa8211f1c'] Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d0b50502-53d7-41e2-aca0-d38f50ab9d2a does not exist Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78148561-2bb9-4fbb-9617-90caa8211f1c'] Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fec4d3dc-91a2-4ab4-9cb2-e76ecb6ee5b5 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Returning 404 to user: Security group d0b50502-53d7-41e2-aca0-d38f50ab9d2a does not exist Oct 17 15:39:59.929499 n-d-854441-12 devstack@n-api.service[120407]: Neutron server returns request_ids: ['req-78148561-2bb9-4fbb-9617-90caa8211f1c'] {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:39:59.935791 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fec4d3dc-91a2-4ab4-9cb2-e76ecb6ee5b5 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/d0b50502-53d7-41e2-aca0-d38f50ab9d2a" status: 404 len: 194 microversion: 2.1 time: 0.222245 Oct 17 15:39:59.936984 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1814/3884] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:39:59 2022] DELETE /compute/v2.1/os-security-groups/d0b50502-53d7-41e2-aca0-d38f50ab9d2a => generated 194 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:39:59.975489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-7e01c663-211a-493c-b99c-47f641fd9126 req-9731e9a1-2a60-4f57-931d-bdca952c5cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f53954-5109-4fb4-8634-490b9664c7d8", "name": "network-vif-plugged", "status": "completed", "tag": "c4a74e76-9816-486b-854c-027fd5b61d05"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:00.049867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7e01c663-211a-493c-b99c-47f641fd9126 req-9731e9a1-2a60-4f57-931d-bdca952c5cfa service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:00.051270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7e01c663-211a-493c-b99c-47f641fd9126 req-9731e9a1-2a60-4f57-931d-bdca952c5cfa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:00.052129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7e01c663-211a-493c-b99c-47f641fd9126 req-9731e9a1-2a60-4f57-931d-bdca952c5cfa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:00.084204 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-7e01c663-211a-493c-b99c-47f641fd9126 req-9731e9a1-2a60-4f57-931d-bdca952c5cfa service nova] Creating event network-vif-plugged:c4a74e76-9816-486b-854c-027fd5b61d05 for instance 45f53954-5109-4fb4-8634-490b9664c7d8 on n-h2-854441-12 Oct 17 15:40:00.096316 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-7e01c663-211a-493c-b99c-47f641fd9126 req-9731e9a1-2a60-4f57-931d-bdca952c5cfa service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152259 Oct 17 15:40:00.097426 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1815/3885] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:00.109151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:00.110390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:00.139999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:00.148196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:00.148929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:00.150196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:00.151142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:00.151745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:00.447649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:00.460588 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b05f0ac-93ff-4490-a6a4-c526758f1868 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1273 microversion: 2.1 time: 0.360219 Oct 17 15:40:00.462264 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1816/3886] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:00 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1273 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:00.467844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ef2729a-5ec8-4ce7-ad55-b8b991ac148c tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be037dc0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:00.744117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:00.756773 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90a728cf-cc83-4f14-8c4a-6c3eac92afec tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1713 microversion: 2.1 time: 1.001131 Oct 17 15:40:00.758062 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2071/3887] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:39:59 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1713 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:00.777515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:00.779817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:00.794484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:00.796662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:00.797589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:00.800173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:00.801020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:00.802345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:00.811721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:01.282918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:01.325015 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d43a24c2-27d8-4e2f-9edb-0899392f0af8 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1470 microversion: 2.1 time: 0.551410 Oct 17 15:40:01.336546 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2072/3888] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:00 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1470 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:01.341853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:01.342581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:01.352205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:01.362982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:01.365300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:01.375036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:01.375036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:01.377785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:01.635937 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ef2729a-5ec8-4ce7-ad55-b8b991ac148c tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/81f9c0a2-7cb4-4972-ba1a-0dd6949a7009" status: 202 len: 0 microversion: 2.1 time: 1.171786 Oct 17 15:40:01.638707 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1817/3889] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:40:00 2022] DELETE /compute/v2.1/os-security-groups/81f9c0a2-7cb4-4972-ba1a-0dd6949a7009 => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:01.647208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:01.649453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:01.660858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:01.662191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:01.663007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:01.664458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:01.665094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:01.670163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:02.091092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:02.103741 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7f3f9e0-fe2c-4f51-9a77-8b73a276acc0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1334 microversion: 2.1 time: 0.776423 Oct 17 15:40:02.104260 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2073/3890] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:01 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1334 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:02.383041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:02.436531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:02.445916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:02.455754 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9fd4d86a-1a88-4320-84f0-ff7dfd9363d9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1407 microversion: 2.20 time: 0.806821 Oct 17 15:40:02.461936 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1818/3891] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:40:01 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1407 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:40:02.479952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-06451124-4964-4c25-9717-b2507411cd26 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be057ee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:02.755066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:02.756214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:02.782461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:02.784741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:02.785525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:02.789277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:02.794684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:02.795712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.167901 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-06451124-4964-4c25-9717-b2507411cd26 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/3da2ed84-774d-4ddf-b1f6-b037ffcbf876" status: 202 len: 0 microversion: 2.1 time: 0.701546 Oct 17 15:40:03.168681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1819/3892] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:40:02 2022] DELETE /compute/v2.1/os-security-groups/3da2ed84-774d-4ddf-b1f6-b037ffcbf876 => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:03.178637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:03.180115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:03.198594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:03.200385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:03.202783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.204902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:03.207392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:03.208362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.331516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:03.336054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:03.339960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.344157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lazy-loading 'fault' on Instance uuid 6864c875-afb5-4502-be38-1da8e1baacc3 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:40:03.450224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:03.473559 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-034f3e20-3a96-4f03-9e83-1fc5a3caf5b3 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1367 microversion: 2.1 time: 0.302622 Oct 17 15:40:03.474825 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1820/3893] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:03 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:03.502780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:03.504588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:03.518156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:03.519711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:03.521257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.524707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:03.526543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:03.527677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.631038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:03.632173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:03.632930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.633758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lazy-loading 'fault' on Instance uuid 9fe71f2c-d675-4eea-b163-bfde7044748c {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:40:03.737831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:03.754404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e756bd65-b86f-4780-bd84-ab00cd69d4eb tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 200 len: 1304 microversion: 2.1 time: 0.262860 Oct 17 15:40:03.757227 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1821/3894] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:03 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 1304 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:03.766084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-42188d0b-6f11-45e9-ab80-fd0a78becfa2 req-dc8a3dbe-8ab6-4421-8021-3946a20c0f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6864c875-afb5-4502-be38-1da8e1baacc3", "name": "network-vif-deleted", "tag": "dc497bfd-be52-44e2-9f3c-02366b9399b1"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:03.777665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:03.781029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-42188d0b-6f11-45e9-ab80-fd0a78becfa2 req-dc8a3dbe-8ab6-4421-8021-3946a20c0f67 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:03.783389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-42188d0b-6f11-45e9-ab80-fd0a78becfa2 req-dc8a3dbe-8ab6-4421-8021-3946a20c0f67 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:03.784135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-42188d0b-6f11-45e9-ab80-fd0a78becfa2 req-dc8a3dbe-8ab6-4421-8021-3946a20c0f67 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.818224 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-42188d0b-6f11-45e9-ab80-fd0a78becfa2 req-dc8a3dbe-8ab6-4421-8021-3946a20c0f67 service nova] Creating event network-vif-deleted:dc497bfd-be52-44e2-9f3c-02366b9399b1 for instance 6864c875-afb5-4502-be38-1da8e1baacc3 on n-h2-854441-12 Oct 17 15:40:03.834674 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-42188d0b-6f11-45e9-ab80-fd0a78becfa2 req-dc8a3dbe-8ab6-4421-8021-3946a20c0f67 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075266 Oct 17 15:40:03.837150 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1822/3895] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:03.846745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:03.849582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:03.854086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:03.867605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:03.868371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:03.869052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.869996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:03.880823 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9975434c-8fd9-4563-83e2-dd5103c06d20 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1315 microversion: 2.1 time: 1.774772 Oct 17 15:40:03.881046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:03.881462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:03.889922 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2074/3896] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:02 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1315 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:03.921057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e10ee3d8-9a5c-4914-ad5b-00e46eb85e12 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be045c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:04.233860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:04.246772 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f3bf9fbb-8cfd-4e6d-b870-6c42e945b47f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1334 microversion: 2.1 time: 0.407819 Oct 17 15:40:04.262539 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1823/3897] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:03 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1334 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:04.262539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:04.262539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:04.262539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:04.263928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:04.264589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:04.265776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:04.266439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:04.267152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:04.508255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:04.521888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:04.523939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:04.525409 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e7fd26d9-b6dd-4d88-9995-3f46c47d3c20 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1599 microversion: 2.20 time: 0.276377 Oct 17 15:40:04.526729 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1824/3898] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:40:04 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1599 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:40:04.533214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:04.534292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:04.544313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:04.545134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:04.546067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:04.547503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:04.548319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:04.549097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:04.613446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:04.614382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:04.615198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:04.616008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lazy-loading 'fault' on Instance uuid 6864c875-afb5-4502-be38-1da8e1baacc3 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:40:04.623674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:04.679872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efb895f046347a6914397c323e21d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cbf1b0a6144426a471e575780008d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:04.692085 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-21046a81-6d18-4395-acbb-73dbea6aedb1 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 200 len: 1367 microversion: 2.1 time: 0.161168 Oct 17 15:40:04.693358 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1825/3899] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:04 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:04.701487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c8e9c9d1-9725-4c15-983b-194eb19467e5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:04.702380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c8e9c9d1-9725-4c15-983b-194eb19467e5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:04.720086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e9c9d1-9725-4c15-983b-194eb19467e5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:04.724055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e9c9d1-9725-4c15-983b-194eb19467e5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:04.724619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e9c9d1-9725-4c15-983b-194eb19467e5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:04.725702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e9c9d1-9725-4c15-983b-194eb19467e5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:04.729318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e9c9d1-9725-4c15-983b-194eb19467e5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:04.729931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e9c9d1-9725-4c15-983b-194eb19467e5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:04.934613 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c8e9c9d1-9725-4c15-983b-194eb19467e5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.239757 Oct 17 15:40:04.935234 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1826/3900] 10.222.0.87 () {60 vars in 1316 bytes} [Mon Oct 17 15:40:04 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:40:04.944345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:04.944345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: 9fe71f2c-d675-4eea-b163-bfde7044748c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:04.959328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:04.969380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:04.970524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:04.971382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:04.972010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:04.972454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:05.006015 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] HTTP exception thrown: Instance 9fe71f2c-d675-4eea-b163-bfde7044748c could not be found. Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Request method failure captured: Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c HTTP/1.1 Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXaV9vYlZYpzKB0EOZzgOmf5zKA4xMmLQZ2ydKoamKzQBmakJdyJO-PnN04J3SsoztmlmCNc8z-oX7iwqW3exruoTLU_zCtFHkjKZGnj0lPSVc47_yKz-LuKYMLIaNPuqIHl-V454GJ1vYESrX8UJL4KrDBSJUpAaUKpRGdQDXYeMNQ Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3e312b32190a41ee84947b87f0f75026 Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersAdminTestJSON-526471107 Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3e312b32190a41ee84947b87f0f75026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3e312b32190a41ee84947b87f0f75026"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3e312b32190a41ee84947b87f0f75026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3e312b32190a41ee84947b87f0f75026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersAdminTestJSON-526471107 Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3e312b32190a41ee84947b87f0f75026 Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersAdminTestJSON-526471107 Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersAdminTestJSON-526471107-project Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: addc1f19b42f47d199887d51c196012a Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersAdminTestJSON-526471107-project Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 9fe71f2c-d675-4eea-b163-bfde7044748c could not be found. Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '9fe71f2c-d675-4eea-b163-bfde7044748c'} Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe71f2c-d675-4eea-b163-bfde7044748c could not be found. Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe71f2c-d675-4eea-b163-bfde7044748c could not be found. Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:40:05.008287 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:05.013445 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:05.013445 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:40:05.013445 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:40:05.013445 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:40:05.013445 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:40:05.013445 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe71f2c-d675-4eea-b163-bfde7044748c could not be found. Oct 17 15:40:05.013445 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:05.013445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Returning 404 to user: Instance 9fe71f2c-d675-4eea-b163-bfde7044748c could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:40:05.013445 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4dd2bccf-2661-41e4-8d0a-4e11b40fe42b tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c" status: 404 len: 111 microversion: 2.1 time: 0.073576 Oct 17 15:40:05.018969 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1827/3901] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:04 2022] GET /compute/v2.1/servers/9fe71f2c-d675-4eea-b163-bfde7044748c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:40:05.027166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:05.031189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:05.043811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:05.045637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:05.047239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:05.048515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:05.049758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:05.050574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:05.221811 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e10ee3d8-9a5c-4914-ad5b-00e46eb85e12 tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/0c04adb3-efec-49b0-b394-a0437b637886" status: 202 len: 0 microversion: 2.1 time: 1.329078 Oct 17 15:40:05.222931 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2075/3902] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:40:03 2022] DELETE /compute/v2.1/os-security-groups/0c04adb3-efec-49b0-b394-a0437b637886 => generated 0 bytes in 1332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:05.240176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:05.241004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:05.273916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:05.275516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:05.276366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:05.277514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:05.278432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:05.279213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:05.336337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:40:05.517751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:05.532133 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7cec87d-9955-440f-88a7-19ac4d9fa22f tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "DELETE /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 204 len: 0 microversion: 2.1 time: 0.305985 Oct 17 15:40:05.533129 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2076/3903] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:40:05 2022] DELETE /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:40:05.533514 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-399d5952-ce7d-4616-8dd0-e47f0403e64c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1315 microversion: 2.1 time: 0.512415 Oct 17 15:40:05.548127 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1828/3904] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:05 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:05.554360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0d0fec2-0c9a-4876-b70b-ee627c40c89f tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be0450d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:05.564035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:05.565030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:05.573909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:05.574754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:05.575438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:05.576491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:05.578004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:05.578877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:05.637193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:05.668793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=28 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:06.350240 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0d0fec2-0c9a-4876-b70b-ee627c40c89f tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/c89b2d46-989c-423b-be0b-8c2608f9697b" status: 202 len: 0 microversion: 2.1 time: 0.814891 Oct 17 15:40:06.351253 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2077/3905] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:40:05 2022] DELETE /compute/v2.1/os-security-groups/c89b2d46-989c-423b-be0b-8c2608f9697b => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:06.359742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:06.360795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:06.378634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:06.379793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:06.382558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:06.385629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:06.388298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:06.389747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:06.923404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:07.013375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:07.038999 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7dcbe15a-f28e-4e0d-98d0-7ec3e3d6f676 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 1.489137 Oct 17 15:40:07.050993 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1829/3906] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:05 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:07.062789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:07.063755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] [instance: 6864c875-afb5-4502-be38-1da8e1baacc3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:07.071953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:07.075046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:07.076030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:07.077106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:07.077812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:07.087145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:07.105040 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] HTTP exception thrown: Instance 6864c875-afb5-4502-be38-1da8e1baacc3 could not be found. Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Request method failure captured: Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 HTTP/1.1 Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXb6VVw9OJgoVdLjBr46g4WkpkWICYlcJ-x3ji8eK4myiaCyjFufVT0qupm9KD0r8_x4br1tSsR_weuJGX8z0TJMKZcNWyEJEVZb1yn8aMZwH71cOEXeKVVP2MpNgRw95r5ylHh25xlua-jSmdg0zEIOWxkBrP02_2ng1oU7THI7wUo Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 22cbf1b0a6144426a471e575780008d0 Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestManualDisk-2037218440 Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/22cbf1b0a6144426a471e575780008d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/22cbf1b0a6144426a471e575780008d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_22cbf1b0a6144426a471e575780008d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/22cbf1b0a6144426a471e575780008d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestManualDisk-2037218440 Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 22cbf1b0a6144426a471e575780008d0 Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestManualDisk-2037218440 Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestManualDisk-2037218440-project Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 2efb895f046347a6914397c323e21d1b Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestManualDisk-2037218440-project Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 6864c875-afb5-4502-be38-1da8e1baacc3 could not be found. Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6864c875-afb5-4502-be38-1da8e1baacc3'} Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6864c875-afb5-4502-be38-1da8e1baacc3 could not be found. Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6864c875-afb5-4502-be38-1da8e1baacc3 could not be found. Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:40:07.107032 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:07.111731 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:07.111731 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:40:07.111731 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:40:07.111731 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:40:07.111731 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:40:07.111731 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6864c875-afb5-4502-be38-1da8e1baacc3 could not be found. Oct 17 15:40:07.111731 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:07.113240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Returning 404 to user: Instance 6864c875-afb5-4502-be38-1da8e1baacc3 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:40:07.115462 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f3537a0a-fe48-4fd4-8891-daa7bf8aba70 tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3" status: 404 len: 111 microversion: 2.1 time: 0.063115 Oct 17 15:40:07.116941 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1830/3907] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:07 2022] GET /compute/v2.1/servers/6864c875-afb5-4502-be38-1da8e1baacc3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:40:07.122467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6dfda971-a49f-4dcc-82cf-6c984a10b5bb tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] Calling method '.version_select at 0x7f28be0669d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:07.795994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:07.827265 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bfa88a12-bd17-48eb-a0cf-8b82ccb01b06 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1468 microversion: 2.1 time: 1.471525 Oct 17 15:40:07.849362 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2078/3908] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:06 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1468 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:07.859094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-16e3d1ce-9ffe-4835-93f8-58e4966a4e01 req-95bb81ff-d066-4933-a7dd-7023a5d98163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe71f2c-d675-4eea-b163-bfde7044748c", "name": "network-vif-deleted", "tag": "cf177eb8-02ed-4072-a83e-13a1cbfa5a85"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:07.884837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-16e3d1ce-9ffe-4835-93f8-58e4966a4e01 req-95bb81ff-d066-4933-a7dd-7023a5d98163 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:07.886141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-16e3d1ce-9ffe-4835-93f8-58e4966a4e01 req-95bb81ff-d066-4933-a7dd-7023a5d98163 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:07.887220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-16e3d1ce-9ffe-4835-93f8-58e4966a4e01 req-95bb81ff-d066-4933-a7dd-7023a5d98163 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:07.914836 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-16e3d1ce-9ffe-4835-93f8-58e4966a4e01 req-95bb81ff-d066-4933-a7dd-7023a5d98163 service nova] Creating event network-vif-deleted:cf177eb8-02ed-4072-a83e-13a1cbfa5a85 for instance 9fe71f2c-d675-4eea-b163-bfde7044748c on n-h1-854441-12 Oct 17 15:40:07.938127 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-16e3d1ce-9ffe-4835-93f8-58e4966a4e01 req-95bb81ff-d066-4933-a7dd-7023a5d98163 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085845 Oct 17 15:40:07.939454 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2079/3909] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:07.952287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-837bad45-91be-4ffd-a584-15b30746d296 req-d1deb9d2-1d81-4410-8144-0f779d09f126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3ca424-5f81-44ae-9bf0-100ae0e9cac8", "tag": "7b21dc57-e897-499f-a722-5dabb23f1848"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:07.995510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-837bad45-91be-4ffd-a584-15b30746d296 req-d1deb9d2-1d81-4410-8144-0f779d09f126 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:07.996518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-837bad45-91be-4ffd-a584-15b30746d296 req-d1deb9d2-1d81-4410-8144-0f779d09f126 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:07.997243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-837bad45-91be-4ffd-a584-15b30746d296 req-d1deb9d2-1d81-4410-8144-0f779d09f126 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:08.017556 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-837bad45-91be-4ffd-a584-15b30746d296 req-d1deb9d2-1d81-4410-8144-0f779d09f126 service nova] Creating event network-changed:7b21dc57-e897-499f-a722-5dabb23f1848 for instance 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 on n-h1-854441-12 Oct 17 15:40:08.024792 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-837bad45-91be-4ffd-a584-15b30746d296 req-d1deb9d2-1d81-4410-8144-0f779d09f126 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083226 Oct 17 15:40:08.025873 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2080/3910] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:08.034148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:08.039089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:08.047540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:08.048443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:08.049286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:08.050303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:08.051238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:08.051911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:08.587663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:08.617442 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e40d928a-26ef-41ae-a246-d4164e4e89f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1315 microversion: 2.1 time: 0.588805 Oct 17 15:40:08.619959 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2081/3911] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:08 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:08.629229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12ec31c0-5d31-4e1c-9d21-cb8e28cfc30c tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] Calling method '.version_select at 0x7f28c2fc2700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:08.677045 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-12ec31c0-5d31-4e1c-9d21-cb8e28cfc30c tempest-ServersTestManualDisk-2037218440 tempest-ServersTestManualDisk-2037218440-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359816970" status: 202 len: 0 microversion: 2.1 time: 0.054796 Oct 17 15:40:08.680797 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2082/3912] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 15:40:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359816970 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:08.697861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:08.698816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:08.710065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:08.710842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:08.711387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:08.712224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:08.712806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:08.713384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:08.836612 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6dfda971-a49f-4dcc-82cf-6c984a10b5bb tempest-SecurityGroupRulesTestJSON-1824601676 tempest-SecurityGroupRulesTestJSON-1824601676-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/aba937a0-c199-47fe-8e3a-338060a91e66" status: 202 len: 0 microversion: 2.1 time: 1.717954 Oct 17 15:40:08.848103 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1831/3913] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:40:07 2022] DELETE /compute/v2.1/os-security-groups/aba937a0-c199-47fe-8e3a-338060a91e66 => generated 0 bytes in 1730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:08.855135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:08.857574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:08.879341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:08.880362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:08.881026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:08.887072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:08.887744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:08.888598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:09.162802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:09.175732 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c4542e6-cc8b-48ee-a9cf-dd3edb2659ad tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 0.490740 Oct 17 15:40:09.187330 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2083/3914] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:08 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:09.274541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:09.290642 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1feaedb1-4887-4a2d-9dc6-42e12051f71e tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1426 microversion: 2.1 time: 0.441179 Oct 17 15:40:09.291282 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1832/3915] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:08 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1426 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:09.646359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:09.647018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:09.654551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:09.655402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:09.655892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:09.656647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:09.657107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:09.657527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:10.109252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-451a8503-8c51-491c-a37b-2965fb558d55 req-2d676a7d-1723-4784-8128-28c4c0ef6c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "tag": "e48a4e5e-5cd6-4e23-bcca-930d69a1e5c5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:10.136224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-451a8503-8c51-491c-a37b-2965fb558d55 req-2d676a7d-1723-4784-8128-28c4c0ef6c6c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:10.137279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-451a8503-8c51-491c-a37b-2965fb558d55 req-2d676a7d-1723-4784-8128-28c4c0ef6c6c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:10.137986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-451a8503-8c51-491c-a37b-2965fb558d55 req-2d676a7d-1723-4784-8128-28c4c0ef6c6c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:10.149159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:10.157575 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-451a8503-8c51-491c-a37b-2965fb558d55 req-2d676a7d-1723-4784-8128-28c4c0ef6c6c service nova] Creating event network-changed:e48a4e5e-5cd6-4e23-bcca-930d69a1e5c5 for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:40:10.165929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-451a8503-8c51-491c-a37b-2965fb558d55 req-2d676a7d-1723-4784-8128-28c4c0ef6c6c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061751 Oct 17 15:40:10.167839 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1833/3916] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:10.178319 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee53cf66-d57b-4a13-9e49-3af74787e4a9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1315 microversion: 2.1 time: 0.535526 Oct 17 15:40:10.188765 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2084/3917] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:09 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:10.206539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:10.211862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:10.247498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:10.249428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:10.250870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:10.253133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:10.254466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:10.255551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:10.318415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:10.319657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:10.339044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:10.340461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:10.341852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:10.343935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:10.345908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:10.349162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:10.433401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:10.435023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:10.436466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:10.440495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lazy-loading 'fault' on Instance uuid a5bd75eb-4c68-4e49-8276-dc76c5d09d01 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:40:10.543695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addc1f19b42f47d199887d51c196012a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e312b32190a41ee84947b87f0f75026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:10.560267 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d52dc905-1299-4d8f-b653-a30695896ec3 tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 200 len: 1303 microversion: 2.1 time: 0.249932 Oct 17 15:40:10.561696 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2085/3918] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:10 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 1303 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:10.614150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ddcbfbe6-e118-43bd-8651-5360d032eca0 req-3e35785e-5dc7-473d-baf6-551e18bb2fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bd75eb-4c68-4e49-8276-dc76c5d09d01", "name": "network-vif-deleted", "tag": "78fdf66f-958a-4ebb-8391-c05f8eef6e51"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:10.632925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ddcbfbe6-e118-43bd-8651-5360d032eca0 req-3e35785e-5dc7-473d-baf6-551e18bb2fb6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:10.634187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ddcbfbe6-e118-43bd-8651-5360d032eca0 req-3e35785e-5dc7-473d-baf6-551e18bb2fb6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:10.634962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ddcbfbe6-e118-43bd-8651-5360d032eca0 req-3e35785e-5dc7-473d-baf6-551e18bb2fb6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:10.663869 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ddcbfbe6-e118-43bd-8651-5360d032eca0 req-3e35785e-5dc7-473d-baf6-551e18bb2fb6 service nova] Creating event network-vif-deleted:78fdf66f-958a-4ebb-8391-c05f8eef6e51 for instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 on n-h1-854441-12 Oct 17 15:40:10.698246 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ddcbfbe6-e118-43bd-8651-5360d032eca0 req-3e35785e-5dc7-473d-baf6-551e18bb2fb6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090779 Oct 17 15:40:10.704844 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2086/3919] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:11.222651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:11.225557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:11.230567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:11.238352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:11.243430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:11.243937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:11.244709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:11.252141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:11.252141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:11.482370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:11.492614 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-44d93ac4-7c1c-447c-83d8-770d2dad290f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 1.292236 Oct 17 15:40:11.497694 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1834/3920] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:10 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:11.590017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:11.591223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] [instance: a5bd75eb-4c68-4e49-8276-dc76c5d09d01] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:11.603297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:11.604563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:11.605579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:11.607169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:11.608365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:11.610317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:11.644621 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] HTTP exception thrown: Instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 could not be found. Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Request method failure captured: Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 HTTP/1.1 Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXaV9vYlZYpzKB0EOZzgOmf5zKA4xMmLQZ2ydKoamKzQBmakJdyJO-PnN04J3SsoztmlmCNc8z-oX7iwqW3exruoTLU_zCtFHkjKZGnj0lPSVc47_yKz-LuKYMLIaNPuqIHl-V454GJ1vYESrX8UJL4KrDBSJUpAaUKpRGdQDXYeMNQ Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3e312b32190a41ee84947b87f0f75026 Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersAdminTestJSON-526471107 Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3e312b32190a41ee84947b87f0f75026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3e312b32190a41ee84947b87f0f75026"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3e312b32190a41ee84947b87f0f75026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3e312b32190a41ee84947b87f0f75026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersAdminTestJSON-526471107 Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3e312b32190a41ee84947b87f0f75026 Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersAdminTestJSON-526471107 Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersAdminTestJSON-526471107-project Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: addc1f19b42f47d199887d51c196012a Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersAdminTestJSON-526471107-project Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 could not be found. Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'a5bd75eb-4c68-4e49-8276-dc76c5d09d01'} Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 could not be found. Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 could not be found. Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:40:11.648921 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:11.658476 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:11.658476 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:40:11.658476 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:40:11.658476 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:40:11.658476 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:40:11.658476 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 could not be found. Oct 17 15:40:11.658476 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:11.663339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] Returning 404 to user: Instance a5bd75eb-4c68-4e49-8276-dc76c5d09d01 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:40:11.665385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-835fc6ef-27a7-41d6-b0ee-71bf32edb12c tempest-ServersAdminTestJSON-526471107 tempest-ServersAdminTestJSON-526471107-project] 10.222.0.87 "GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01" status: 404 len: 111 microversion: 2.1 time: 0.083632 Oct 17 15:40:11.667231 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1835/3921] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:11 2022] GET /compute/v2.1/servers/a5bd75eb-4c68-4e49-8276-dc76c5d09d01 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:40:11.773811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:11.791398 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ed1b379-7d4b-4490-8858-2894874bb178 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1315 microversion: 2.1 time: 0.577263 Oct 17 15:40:11.792093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2087/3922] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:11 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:12.187444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0031e534-5c27-4adb-931a-187de8d273e6 req-bad1d04d-1865-4f27-95d7-59c780191f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "tag": "9b09d026-3f54-4a98-bddc-b2e5cae1ea77"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:12.205728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0031e534-5c27-4adb-931a-187de8d273e6 req-bad1d04d-1865-4f27-95d7-59c780191f2e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:12.211144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0031e534-5c27-4adb-931a-187de8d273e6 req-bad1d04d-1865-4f27-95d7-59c780191f2e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:12.212392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0031e534-5c27-4adb-931a-187de8d273e6 req-bad1d04d-1865-4f27-95d7-59c780191f2e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:12.226650 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0031e534-5c27-4adb-931a-187de8d273e6 req-bad1d04d-1865-4f27-95d7-59c780191f2e service nova] Creating event network-changed:9b09d026-3f54-4a98-bddc-b2e5cae1ea77 for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:40:12.232988 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0031e534-5c27-4adb-931a-187de8d273e6 req-bad1d04d-1865-4f27-95d7-59c780191f2e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049365 Oct 17 15:40:12.234330 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1836/3923] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:12.283933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-371758c6-c5b7-463b-8cc4-723f11db6d20 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7c9f16d-e5d5-4aa6-90ba-64c83bafcc97"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:12.286447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-371758c6-c5b7-463b-8cc4-723f11db6d20 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:12.305313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371758c6-c5b7-463b-8cc4-723f11db6d20 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:12.306197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371758c6-c5b7-463b-8cc4-723f11db6d20 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:12.307469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371758c6-c5b7-463b-8cc4-723f11db6d20 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:12.310228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371758c6-c5b7-463b-8cc4-723f11db6d20 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:12.312340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371758c6-c5b7-463b-8cc4-723f11db6d20 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:12.314981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371758c6-c5b7-463b-8cc4-723f11db6d20 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:12.528937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:12.534596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:12.550975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:12.553238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:12.554709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:12.556747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:12.558888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:12.560099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:12.901816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-371758c6-c5b7-463b-8cc4-723f11db6d20 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619871 Oct 17 15:40:12.929740 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2088/3924] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:40:12 2022] POST /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:40:12.979181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:12.992034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:13.028473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:13.028984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:13.029428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:13.030160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:13.030731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:13.031167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:14.181592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:14.220099 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bfbbe949-9489-4012-898d-07a3fda83135 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 1.701452 Oct 17 15:40:14.222761 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1837/3925] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:12 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:14.237753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ad9c11ad-e7dc-4057-905c-77d8b4eb5e23 req-f837d9ee-ff49-4aeb-9fda-906f8bd1f6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f53954-5109-4fb4-8634-490b9664c7d8", "tag": "c4a74e76-9816-486b-854c-027fd5b61d05"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:14.271107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ad9c11ad-e7dc-4057-905c-77d8b4eb5e23 req-f837d9ee-ff49-4aeb-9fda-906f8bd1f6a3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:14.275251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ad9c11ad-e7dc-4057-905c-77d8b4eb5e23 req-f837d9ee-ff49-4aeb-9fda-906f8bd1f6a3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:14.282691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ad9c11ad-e7dc-4057-905c-77d8b4eb5e23 req-f837d9ee-ff49-4aeb-9fda-906f8bd1f6a3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:14.379680 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ad9c11ad-e7dc-4057-905c-77d8b4eb5e23 req-f837d9ee-ff49-4aeb-9fda-906f8bd1f6a3 service nova] Creating event network-changed:c4a74e76-9816-486b-854c-027fd5b61d05 for instance 45f53954-5109-4fb4-8634-490b9664c7d8 on n-h2-854441-12 Oct 17 15:40:14.400101 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ad9c11ad-e7dc-4057-905c-77d8b4eb5e23 req-f837d9ee-ff49-4aeb-9fda-906f8bd1f6a3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174981 Oct 17 15:40:14.408429 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1838/3926] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:14.423615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e27901d5-c4cf-419f-87ff-ec4741832ef6 req-8fc8bac8-a917-4c48-a444-52618dff9ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "tag": "0204f3e1-e654-4651-8e4c-c4694d89060d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:14.471194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e27901d5-c4cf-419f-87ff-ec4741832ef6 req-8fc8bac8-a917-4c48-a444-52618dff9ad8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:14.472607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e27901d5-c4cf-419f-87ff-ec4741832ef6 req-8fc8bac8-a917-4c48-a444-52618dff9ad8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:14.473887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e27901d5-c4cf-419f-87ff-ec4741832ef6 req-8fc8bac8-a917-4c48-a444-52618dff9ad8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:14.509039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e27901d5-c4cf-419f-87ff-ec4741832ef6 req-8fc8bac8-a917-4c48-a444-52618dff9ad8 service nova] Creating event network-changed:0204f3e1-e654-4651-8e4c-c4694d89060d for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:40:14.518790 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e27901d5-c4cf-419f-87ff-ec4741832ef6 req-8fc8bac8-a917-4c48-a444-52618dff9ad8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106582 Oct 17 15:40:14.520315 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1839/3927] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:14.570367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:14.600335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df79ed6e-4df5-4dde-be66-dfd16dad27e3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1315 microversion: 2.1 time: 1.665295 Oct 17 15:40:14.601412 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2089/3928] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:12 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1315 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:15.265320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:15.266815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:15.309825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:15.311215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:15.312379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:15.313888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:15.314989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:15.316039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:15.641465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:15.642331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:15.659883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:15.660394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:15.660837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:15.661562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:15.662017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:15.662443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:15.717073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:16.777513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:16.797646 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81079bc7-86fe-472f-994e-a434c9630c87 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 1.542325 Oct 17 15:40:16.798676 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1840/3929] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:15 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:16.813224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:16.824664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-57bd912b-8aba-4da3-bac1-2666e581f795 req-b22174e2-3229-419d-b04c-4933468f82dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3ca424-5f81-44ae-9bf0-100ae0e9cac8", "name": "network-vif-plugged", "status": "completed", "tag": "7b21dc57-e897-499f-a722-5dabb23f1848"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:16.828270 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da807b6c-57cc-4f25-9e3b-936ac7c09b3f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1315 microversion: 2.1 time: 1.191736 Oct 17 15:40:16.844756 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2090/3930] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:15 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1315 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:40:16.859356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:16.865714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-57bd912b-8aba-4da3-bac1-2666e581f795 req-b22174e2-3229-419d-b04c-4933468f82dc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:16.866978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-57bd912b-8aba-4da3-bac1-2666e581f795 req-b22174e2-3229-419d-b04c-4933468f82dc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:16.868040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-57bd912b-8aba-4da3-bac1-2666e581f795 req-b22174e2-3229-419d-b04c-4933468f82dc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:16.895136 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-57bd912b-8aba-4da3-bac1-2666e581f795 req-b22174e2-3229-419d-b04c-4933468f82dc service nova] Creating event network-vif-plugged:7b21dc57-e897-499f-a722-5dabb23f1848 for instance 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 on n-h1-854441-12 Oct 17 15:40:16.914824 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-57bd912b-8aba-4da3-bac1-2666e581f795 req-b22174e2-3229-419d-b04c-4933468f82dc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112897 Oct 17 15:40:16.917920 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1841/3931] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:17.851620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:17.854342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:17.886197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:17.887586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:17.888833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:17.891514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:17.892721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:17.901631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:17.903958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:17.904991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:17.984011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:17.998394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:17.999470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:18.000893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:18.007208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:18.008694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:18.855094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:18.903328 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c41eafa-b822-447f-88cf-59cd6c2d14f0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1315 microversion: 2.1 time: 1.025515 Oct 17 15:40:18.946635 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1842/3932] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:17 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1315 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:18.968884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:18.997514 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86d58aae-d1a7-4b1e-84a5-7215339f6bba tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 1.154235 Oct 17 15:40:19.043885 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2091/3933] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:17 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:19.959027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:19.960276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:19.994774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:19.997191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:19.998004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:20.002060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:20.002982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:20.003739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:20.049449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:20.051858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:20.081738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:20.087431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:20.089524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:20.095739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:20.097183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:20.100400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:20.625909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:20.688698 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b85e6b92-9792-4566-b22e-4e3afafc25c6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 0.646193 Oct 17 15:40:20.702561 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2092/3934] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:20 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:40:21.742674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:21.743650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:21.786828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:21.787382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:21.787868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:21.792360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:21.796396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:21.796736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:21.923152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:21.964274 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-03e18872-5da2-4f23-9886-14862ab3e301 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1502 microversion: 2.1 time: 1.996746 Oct 17 15:40:21.970851 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1843/3935] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:19 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1502 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:21.999518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-add54c6b-5103-41dd-8efd-b3f44c779f87 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:22.005866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-add54c6b-5103-41dd-8efd-b3f44c779f87 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:22.041328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add54c6b-5103-41dd-8efd-b3f44c779f87 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:22.050912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add54c6b-5103-41dd-8efd-b3f44c779f87 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:22.051952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add54c6b-5103-41dd-8efd-b3f44c779f87 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:22.053600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add54c6b-5103-41dd-8efd-b3f44c779f87 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:22.054819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add54c6b-5103-41dd-8efd-b3f44c779f87 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:22.055648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add54c6b-5103-41dd-8efd-b3f44c779f87 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:22.178441 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-add54c6b-5103-41dd-8efd-b3f44c779f87 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action" status: 200 len: 14 microversion: 2.1 time: 0.187774 Oct 17 15:40:22.182699 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1844/3936] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:21 2022] POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 15:40:22.800077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:22.825106 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ac544ed-33c7-47e7-a9bf-bb3cd5dbdfe2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 1.098225 Oct 17 15:40:22.826157 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2093/3937] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:21 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:40:23.199124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-30116583-136b-488f-8704-cbb283091b07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:23.207739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-30116583-136b-488f-8704-cbb283091b07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:23.225117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30116583-136b-488f-8704-cbb283091b07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:23.226131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30116583-136b-488f-8704-cbb283091b07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:23.226903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30116583-136b-488f-8704-cbb283091b07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:23.228082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30116583-136b-488f-8704-cbb283091b07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:23.228803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30116583-136b-488f-8704-cbb283091b07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:23.229451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30116583-136b-488f-8704-cbb283091b07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:23.321700 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-30116583-136b-488f-8704-cbb283091b07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action" status: 200 len: 14 microversion: 2.1 time: 0.129226 Oct 17 15:40:23.327564 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1845/3938] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:23 2022] POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:40:23.869476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:23.871688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:23.911998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:23.946874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:23.949112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:23.950341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:23.951216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:23.959056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:24.344663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-90d8d6d5-2635-479e-8702-c0e733950768 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:24.347927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-90d8d6d5-2635-479e-8702-c0e733950768 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:24.410336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8d6d5-2635-479e-8702-c0e733950768 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:24.411452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8d6d5-2635-479e-8702-c0e733950768 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:24.412245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8d6d5-2635-479e-8702-c0e733950768 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:24.413537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8d6d5-2635-479e-8702-c0e733950768 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:24.414368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8d6d5-2635-479e-8702-c0e733950768 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:24.421015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90d8d6d5-2635-479e-8702-c0e733950768 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:24.597525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-90d8d6d5-2635-479e-8702-c0e733950768 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action" status: 200 len: 14 microversion: 2.1 time: 0.250270 Oct 17 15:40:24.600010 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1846/3939] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:24 2022] POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action => generated 14 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:40:24.733101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:24.753770 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4172168f-a1d0-4290-bf45-ba8338e4dc93 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 0.888243 Oct 17 15:40:24.758698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2094/3940] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:23 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:25.626752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-830a8598-4d9b-4231-ac02-a516901631d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:25.638916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-830a8598-4d9b-4231-ac02-a516901631d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:25.679066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-830a8598-4d9b-4231-ac02-a516901631d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:25.684472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-830a8598-4d9b-4231-ac02-a516901631d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:25.686142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-830a8598-4d9b-4231-ac02-a516901631d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:25.687978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-830a8598-4d9b-4231-ac02-a516901631d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:25.694567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-830a8598-4d9b-4231-ac02-a516901631d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:25.695738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-830a8598-4d9b-4231-ac02-a516901631d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:25.800724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:25.801737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:25.833884 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-830a8598-4d9b-4231-ac02-a516901631d4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action" status: 200 len: 14 microversion: 2.1 time: 0.222853 Oct 17 15:40:25.834635 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1847/3941] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:25 2022] POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action => generated 14 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:40:25.836803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:25.837323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:25.846984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:25.851973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:25.854978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:25.859081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:26.536196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:26.549853 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f3d21dd-30de-4ce4-b01e-74ff2cd38859 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 0.753412 Oct 17 15:40:26.554482 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2095/3942] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:25 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:26.848711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-90e58b8a-2ab1-4884-abbf-94480119dd62 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:26.851317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-90e58b8a-2ab1-4884-abbf-94480119dd62 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:26.875381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90e58b8a-2ab1-4884-abbf-94480119dd62 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:26.875823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90e58b8a-2ab1-4884-abbf-94480119dd62 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:26.876524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90e58b8a-2ab1-4884-abbf-94480119dd62 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:26.877593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90e58b8a-2ab1-4884-abbf-94480119dd62 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:26.878284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90e58b8a-2ab1-4884-abbf-94480119dd62 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:26.878956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90e58b8a-2ab1-4884-abbf-94480119dd62 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:26.969053 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-90e58b8a-2ab1-4884-abbf-94480119dd62 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action" status: 200 len: 14 microversion: 2.1 time: 0.124862 Oct 17 15:40:26.970522 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1848/3943] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:26 2022] POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 15:40:27.600470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:27.601979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:27.637970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:27.642698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:27.644383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:27.646062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:27.651510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:27.660097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:27.986322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8e4e018a-c063-4de9-9b53-301a148728dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:27.988970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8e4e018a-c063-4de9-9b53-301a148728dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:28.021311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e4e018a-c063-4de9-9b53-301a148728dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:28.021824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e4e018a-c063-4de9-9b53-301a148728dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:28.022286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e4e018a-c063-4de9-9b53-301a148728dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:28.023103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e4e018a-c063-4de9-9b53-301a148728dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:28.023565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e4e018a-c063-4de9-9b53-301a148728dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:28.023999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e4e018a-c063-4de9-9b53-301a148728dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:28.122379 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8e4e018a-c063-4de9-9b53-301a148728dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action" status: 200 len: 14 microversion: 2.1 time: 0.141545 Oct 17 15:40:28.123243 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1849/3944] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:27 2022] POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 15:40:29.139284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-155257b2-820c-4b5a-80ba-f30bf6cdee67 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:29.145534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-155257b2-820c-4b5a-80ba-f30bf6cdee67 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:29.181580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155257b2-820c-4b5a-80ba-f30bf6cdee67 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:29.182100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155257b2-820c-4b5a-80ba-f30bf6cdee67 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:29.185990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155257b2-820c-4b5a-80ba-f30bf6cdee67 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:29.185990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155257b2-820c-4b5a-80ba-f30bf6cdee67 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:29.185990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155257b2-820c-4b5a-80ba-f30bf6cdee67 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:29.185990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155257b2-820c-4b5a-80ba-f30bf6cdee67 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:29.289778 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-155257b2-820c-4b5a-80ba-f30bf6cdee67 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action" status: 200 len: 14 microversion: 2.1 time: 0.155784 Oct 17 15:40:29.296412 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1850/3945] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:29 2022] POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 15:40:30.054450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:30.067897 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b94954ca-a875-453f-8e34-d3f79b8ba26f tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 2.474729 Oct 17 15:40:30.073170 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2096/3946] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:27 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 2480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:30.307074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad489d4d-79ea-4c5a-ae92-f6822af77538 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:30.309726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad489d4d-79ea-4c5a-ae92-f6822af77538 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:30.343146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad489d4d-79ea-4c5a-ae92-f6822af77538 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:30.343959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad489d4d-79ea-4c5a-ae92-f6822af77538 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:30.344639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad489d4d-79ea-4c5a-ae92-f6822af77538 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:30.345621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad489d4d-79ea-4c5a-ae92-f6822af77538 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:30.348226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad489d4d-79ea-4c5a-ae92-f6822af77538 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:30.349022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad489d4d-79ea-4c5a-ae92-f6822af77538 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:30.431603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:30.476757 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad489d4d-79ea-4c5a-ae92-f6822af77538 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action" status: 200 len: 14 microversion: 2.1 time: 0.174687 Oct 17 15:40:30.487736 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1851/3947] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:30 2022] POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:40:31.122188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:31.123742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:31.135538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:31.136595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:31.137404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:31.138588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:31.139343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:31.140053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:31.503146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c1963a70-9743-41b2-89b7-db33083a7c45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:31.515844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c1963a70-9743-41b2-89b7-db33083a7c45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:31.597668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1963a70-9743-41b2-89b7-db33083a7c45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:31.598464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1963a70-9743-41b2-89b7-db33083a7c45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:31.607667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1963a70-9743-41b2-89b7-db33083a7c45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:31.609123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1963a70-9743-41b2-89b7-db33083a7c45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:31.609782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1963a70-9743-41b2-89b7-db33083a7c45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:31.610259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1963a70-9743-41b2-89b7-db33083a7c45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:31.688580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:31.710372 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d6ab419-6504-4567-b8ca-d6a516a7c5c2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 0.591776 Oct 17 15:40:31.716809 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2097/3948] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:31 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:31.739018 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c1963a70-9743-41b2-89b7-db33083a7c45 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action" status: 200 len: 8204 microversion: 2.1 time: 0.244124 Oct 17 15:40:31.754331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:31.755169 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1852/3949] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:31 2022] POST /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8/action => generated 8204 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:40:31.755639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:31.764925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:31.765752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:31.766432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:31.767482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:31.768171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:31.768880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:32.007839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:32.020608 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f99f8926-c9a4-43e7-b6a9-04265b2affa4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.270613 Oct 17 15:40:32.021869 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2098/3950] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:31 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:40:32.081420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:32.083385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:32.098898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:32.100278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:32.102542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:32.104463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:32.105811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:32.107056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:32.523533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:32.551746 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97bb66bf-2e5d-4023-a50f-a3f8ed6bf5b9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.476746 Oct 17 15:40:32.614661 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1853/3951] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:32 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:32.615840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:32.617816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:32.642844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:32.644232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:32.645470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:32.647530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:32.649419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:32.653434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:32.654745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:32.664651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:32.686964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:32.687790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:32.688612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:32.689939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:32.690874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:32.691689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:32.781546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lazy-loading 'flavor' on Instance uuid 65b793d7-d5e4-4688-9805-2d0997a9b2a1 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:40:33.129724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:33.144958 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b0bcdfb-4da9-4301-aa67-13df0f8c7075 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.541868 Oct 17 15:40:33.146448 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2099/3952] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:32 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:33.156501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:33.157314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:33.166660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:33.167261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:33.167732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:33.168796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:33.169356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:33.170647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:33.258138 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4e648c09-eeae-44a3-a41b-4d632097bede tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/action" status: 200 len: 32 microversion: 2.1 time: 0.624997 Oct 17 15:40:33.258871 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1854/3953] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:32 2022] POST /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/action => generated 32 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 15:40:33.267384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:33.267384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:33.284465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:33.285003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:33.285566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:33.286099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:33.286578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:33.287237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:33.545062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:33.561098 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00ec48ca-55b3-42da-92c9-83bb9281bef4 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 0.412603 Oct 17 15:40:33.567550 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2100/3954] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:33 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:33.581646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:33.590229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:33.606172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:33.606744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:33.622359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:33.627971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:33.628665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:33.629105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:34.020878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:34.031786 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2f5578f2-6220-4136-96ca-872b8ae7684b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.771573 Oct 17 15:40:34.035698 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1855/3955] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:33 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:34.066272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:34.069561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:34.085177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:34.087303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:34.087892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:34.088598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:34.089087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:34.089532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:34.200621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Locking {{(pid=120407) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 17 15:40:34.268189 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-de44c450-4fc4-467a-92a1-a23c5584cd1d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.209347 Oct 17 15:40:34.273098 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1856/3956] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:34 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:34.279687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:34.280986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:34.290848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:34.291873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:34.292589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:34.293704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:34.294873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:34.296131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:34.858921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:34.943955 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84ec6fa8-555d-4536-bd41-d06000551a78 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 1.367978 Oct 17 15:40:34.946860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2101/3957] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:33 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:34.977313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:34.981185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:35.013157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:35.014630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:35.019812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:35.024907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:35.027714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:35.028839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:35.173689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:35.185366 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-04e1b777-ec2e-46c8-badc-7f6ae6cdb44c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.910512 Oct 17 15:40:35.185962 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1857/3958] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:34 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:35.217142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a72e5b77-7134-47bc-8097-94cf4948f9b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:35.234150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a72e5b77-7134-47bc-8097-94cf4948f9b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:35.237081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a72e5b77-7134-47bc-8097-94cf4948f9b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:35.237633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a72e5b77-7134-47bc-8097-94cf4948f9b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:35.491610 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-a72e5b77-7134-47bc-8097-94cf4948f9b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] HTTP exception thrown: Instance ff35e7aa-0374-467e-8034-d2fee905517a is locked Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a72e5b77-7134-47bc-8097-94cf4948f9b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Request method failure captured: Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action HTTP/1.1 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 15 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYjSZ_nlru-opsxre1_6o4maYJvszrSTfo5F1ZOmWvD2nvbavpGSPdcHZuHvhBBMJvJzDYKZ1CLYYmwcJEA0FxbZ2rDVbTjFujhByDDlZdgHa8WyAzJo1bPL8yj75lvGz1GIXDkBbnfrdh1y59UsxGhyOBvzL-Yq-36NgYBv7Q1Aq8 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 15cc78a142a148398dc438b5ff2a25e9 Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: {"os-stop": {}} Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ff35e7aa-0374-467e-8034-d2fee905517a is locked Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ff35e7aa-0374-467e-8034-d2fee905517a', 'body': {'os-stop': {}}} Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance ff35e7aa-0374-467e-8034-d2fee905517a is locked Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance ff35e7aa-0374-467e-8034-d2fee905517a is locked Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff35e7aa-0374-467e-8034-d2fee905517a is locked Oct 17 15:40:35.498818 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:40:35.505772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a72e5b77-7134-47bc-8097-94cf4948f9b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Returning 409 to user: Instance ff35e7aa-0374-467e-8034-d2fee905517a is locked {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:40:35.508849 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a72e5b77-7134-47bc-8097-94cf4948f9b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 409 len: 107 microversion: 2.1 time: 0.296065 Oct 17 15:40:35.516957 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1858/3959] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:35 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 107 bytes in 305 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 15:40:35.529376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:35.529960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:35.549323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:35.550434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:35.550969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:35.551732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:35.552203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:35.552633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:35.702424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Unlocking {{(pid=120407) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 17 15:40:35.840111 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57d5c0db-71dd-45e2-b512-328985f8118b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.321431 Oct 17 15:40:35.841017 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1859/3960] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:35 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:35.850296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c35592cc-5f3f-48e7-ba0e-f4f863ab77d8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:35.871659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c35592cc-5f3f-48e7-ba0e-f4f863ab77d8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:35.874920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c35592cc-5f3f-48e7-ba0e-f4f863ab77d8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:35.875298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:35.875794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c35592cc-5f3f-48e7-ba0e-f4f863ab77d8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:35.887757 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df63d7c1-dd67-4fb7-9b6a-30c46ebe8ffd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 0.937809 Oct 17 15:40:35.889299 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2102/3961] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:34 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:35.942662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c35592cc-5f3f-48e7-ba0e-f4f863ab77d8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Going to try to stop instance {{(pid=120407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 15:40:35.990855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:35.991938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:35.993483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=11,nova_cell1:INSERT=5 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:36.015262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:36.015767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:36.016420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:36.017436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:36.018044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:36.018578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:36.026103 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c35592cc-5f3f-48e7-ba0e-f4f863ab77d8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.164724 Oct 17 15:40:36.029683 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1860/3962] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:35 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:40:36.043629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:36.048708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:36.064877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:36.066013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:36.067039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:36.068067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:36.068926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:36.070301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:36.416943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:36.447124 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ec67588-5161-4f4e-bc9f-5493b27e407b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 0.459872 Oct 17 15:40:36.448083 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2103/3963] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:35 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:40:36.566654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:36.596192 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee1d1e8a-65eb-43b3-add2-9e7e04fb772d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.548495 Oct 17 15:40:36.596192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1861/3964] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:36 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:36.921053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:36.921962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:36.939645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:36.940304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:36.940844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:36.942246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:36.942246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:36.945550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:37.491062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:37.491749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:37.524869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:37.528492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:37.529262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:37.530280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:37.530575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:37.530978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:38.020111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:38.030060 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-beafe98f-1e10-4c1e-bfb0-6c06dce394f2 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 1.114822 Oct 17 15:40:38.042971 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2104/3965] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:36 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:38.049470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:38.050273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:38.064917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:38.065827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:38.066433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:38.067402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:38.068265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:38.079418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:38.412964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:38.432796 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c652ead5-b31f-43f1-9a53-3a7edc784816 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 0.946182 Oct 17 15:40:38.434178 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1862/3966] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:37 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:38.647454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-234e309e-a42f-41ed-9b7e-c460e56e9ab3 tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Action: 'create', calling method: .version_select at 0x7f28be010040>, body: {"pool": null} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:39.310100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:39.327702 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d304340a-bc3b-4ec6-a83f-c420f3f831e0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 1.283207 Oct 17 15:40:39.328624 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2105/3967] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:38 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:39.344955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e6b16d7b-98ec-4257-898d-eeb1f98c57c8 req-efd1a7fa-9ddc-4636-810a-6f495d6bfcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "name": "network-vif-plugged", "status": "completed", "tag": "9b09d026-3f54-4a98-bddc-b2e5cae1ea77"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:39.378671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e6b16d7b-98ec-4257-898d-eeb1f98c57c8 req-efd1a7fa-9ddc-4636-810a-6f495d6bfcbc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:39.381065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e6b16d7b-98ec-4257-898d-eeb1f98c57c8 req-efd1a7fa-9ddc-4636-810a-6f495d6bfcbc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:39.384803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e6b16d7b-98ec-4257-898d-eeb1f98c57c8 req-efd1a7fa-9ddc-4636-810a-6f495d6bfcbc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:39.448726 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e6b16d7b-98ec-4257-898d-eeb1f98c57c8 req-efd1a7fa-9ddc-4636-810a-6f495d6bfcbc service nova] Creating event network-vif-plugged:9b09d026-3f54-4a98-bddc-b2e5cae1ea77 for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:40:39.463275 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e6b16d7b-98ec-4257-898d-eeb1f98c57c8 req-efd1a7fa-9ddc-4636-810a-6f495d6bfcbc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128570 Oct 17 15:40:39.466868 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2106/3968] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:39.478246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:39.480900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:39.496398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:39.497314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:39.498109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:39.499916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:39.500977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:39.501766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:40.164237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:40.168914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:40.179949 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b70c9cb-b5a3-4007-9143-6e12cbbcc918 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 0.705071 Oct 17 15:40:40.181366 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2107/3969] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:39 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:40.190783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:40.203179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:40.215031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:40.216343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:40.218262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:40.219437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:40.220256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:40.220913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:40.773651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:40.793999 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-308ffb9c-c248-4b68-8328-85b82824f1b5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 0.607289 Oct 17 15:40:40.798603 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2108/3970] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:40 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:40.856804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:40.858402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:40.886237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:40.886491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:40.887241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:40.888515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:40.889898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:40.890732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:41.349273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:41.366831 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58507233-fb4e-49fb-8d00-7e25cdea5cb2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.566084 Oct 17 15:40:41.370344 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2109/3971] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:40 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:41.384409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:41.385690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:41.396952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=46 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:41.400494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:41.402719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:41.403624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:41.405037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:41.406463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:41.407347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:41.785817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:41.803514 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4020bc2e-083b-4659-9c55-5db35c6a3ab5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 0.430946 Oct 17 15:40:41.824683 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2110/3972] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:41 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:41.947376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-534896391", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "3d22b08a-79d8-4d33-bcb1-81c36e2d1815"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:42.105933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] validate_networks() for [('3d22b08a-79d8-4d33-bcb1-81c36e2d1815', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:40:43.523509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:40:43.524232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:40:43.525039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:40:43.525460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:40:43.526211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:40:43.560487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:43.567501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:43.568832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:43.572162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:43.573471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:43.574572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:43.637670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Getting quotas for project 32d9e6586f1a439dbe028fbe0f7482d7. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:40:43.680013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Getting quotas for user 387f9adba1644ae6ae01f4ee3f6ac217 and project 32d9e6586f1a439dbe028fbe0f7482d7. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:40:43.736778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:40:43.758668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:40:43.942649 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27525ca7-63f7-4529-a268-2e13301c8fe8 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.115913 Oct 17 15:40:43.944704 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2111/3973] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:40:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:40:43.960563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e07986e7-fb1e-40fa-8829-df88f17dc91d req-5025504c-5ab7-45af-bced-3e6b0935c578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "name": "network-vif-plugged", "status": "completed", "tag": "0204f3e1-e654-4651-8e4c-c4694d89060d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:43.994719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e07986e7-fb1e-40fa-8829-df88f17dc91d req-5025504c-5ab7-45af-bced-3e6b0935c578 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:43.995970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e07986e7-fb1e-40fa-8829-df88f17dc91d req-5025504c-5ab7-45af-bced-3e6b0935c578 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:43.997052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e07986e7-fb1e-40fa-8829-df88f17dc91d req-5025504c-5ab7-45af-bced-3e6b0935c578 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:44.042000 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e07986e7-fb1e-40fa-8829-df88f17dc91d req-5025504c-5ab7-45af-bced-3e6b0935c578 service nova] Creating event network-vif-plugged:0204f3e1-e654-4651-8e4c-c4694d89060d for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:40:44.054062 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e07986e7-fb1e-40fa-8829-df88f17dc91d req-5025504c-5ab7-45af-bced-3e6b0935c578 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106670 Oct 17 15:40:44.055647 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2112/3974] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:44.067325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:44.069319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:44.093238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:44.096713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:44.112702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:44.114031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:44.115176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:44.116225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:44.965533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:44.983193 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfa1286d-5c52-4aa6-8bcf-6b83cab2ab32 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 0.925226 Oct 17 15:40:44.995967 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2113/3975] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:44 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:45.011375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:45.016843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:45.048410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:45.049412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:45.054552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:45.055600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:45.060561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:45.061162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:45.162357 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-234e309e-a42f-41ed-9b7e-c460e56e9ab3 tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.726203 Oct 17 15:40:45.164889 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1863/3976] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:40:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:45.181074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:45.198517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:45.248096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:45.249089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:45.249862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:45.251125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:45.251914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:45.252639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:45.845692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:45.869156 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5edb92ca-ec36-4f7a-9c4f-5e6a6e187fff tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.871186 Oct 17 15:40:45.874058 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2114/3977] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:44 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:45.892233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:45.899648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:45.931465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:45.932803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:45.935778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:45.941309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:45.942270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:45.945179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:46.195871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:46.216046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:46.241359 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c7e89d7-112a-4832-aed0-20458176bfd0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 1.072038 Oct 17 15:40:46.244654 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba21d260-469c-4c08-b65a-89dc8407c972 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1231 microversion: 2.1 time: 0.366168 Oct 17 15:40:46.246187 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1864/3978] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:45 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:46.276219 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2115/3979] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:45 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1231 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:46.304475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-48942412-551e-41f0-912e-89acdcacd838 tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Calling method '.version_select at 0x7f28be51e670>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:46.312802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d98ed77-7a9c-471a-8dae-6ca08ae26bfb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:46.313612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d98ed77-7a9c-471a-8dae-6ca08ae26bfb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:46.333472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d98ed77-7a9c-471a-8dae-6ca08ae26bfb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:46.335121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d98ed77-7a9c-471a-8dae-6ca08ae26bfb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:46.336596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d98ed77-7a9c-471a-8dae-6ca08ae26bfb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:46.338274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d98ed77-7a9c-471a-8dae-6ca08ae26bfb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:46.339498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d98ed77-7a9c-471a-8dae-6ca08ae26bfb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:46.341917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d98ed77-7a9c-471a-8dae-6ca08ae26bfb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:46.490227 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d98ed77-7a9c-471a-8dae-6ca08ae26bfb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/ips" status: 200 len: 152 microversion: 2.20 time: 0.210891 Oct 17 15:40:46.492162 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2116/3980] 10.222.0.87 () {60 vars in 1289 bytes} [Mon Oct 17 15:40:46 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/ips => generated 152 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:40:46.526082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:46.541156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:46.574796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:46.581322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:46.583292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:46.588005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:46.589012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:46.592676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:47.257181 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-48942412-551e-41f0-912e-89acdcacd838 tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] 10.222.0.87 "GET /compute/v2.1/os-floating-ips/c838e5a6-2f06-408e-8e77-d3c0aa7e492c" status: 200 len: 142 microversion: 2.1 time: 1.007552 Oct 17 15:40:47.258857 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1865/3981] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:40:46 2022] GET /compute/v2.1/os-floating-ips/c838e5a6-2f06-408e-8e77-d3c0aa7e492c => generated 142 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:47.269323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1e5cc868-8bbd-4369-b1a7-c35f14275d85 req-33630a8f-8224-4ee4-b679-5ece5d7c813c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "name": "network-vif-plugged", "status": "completed", "tag": "e48a4e5e-5cd6-4e23-bcca-930d69a1e5c5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:47.282533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=46 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:47.328087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e5cc868-8bbd-4369-b1a7-c35f14275d85 req-33630a8f-8224-4ee4-b679-5ece5d7c813c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:47.339049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e5cc868-8bbd-4369-b1a7-c35f14275d85 req-33630a8f-8224-4ee4-b679-5ece5d7c813c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:47.339896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e5cc868-8bbd-4369-b1a7-c35f14275d85 req-33630a8f-8224-4ee4-b679-5ece5d7c813c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:47.383711 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1e5cc868-8bbd-4369-b1a7-c35f14275d85 req-33630a8f-8224-4ee4-b679-5ece5d7c813c service nova] Creating event network-vif-plugged:e48a4e5e-5cd6-4e23-bcca-930d69a1e5c5 for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:40:47.401866 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1e5cc868-8bbd-4369-b1a7-c35f14275d85 req-33630a8f-8224-4ee4-b679-5ece5d7c813c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137233 Oct 17 15:40:47.409179 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1866/3982] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:47.423548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:47.426215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:47.464909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:47.469978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:47.474203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:47.478167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:47.479141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:47.479933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:47.499585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:47.569867 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3d7c4fe-d1ad-4143-a663-f8debb23baf6 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 1.070749 Oct 17 15:40:47.575706 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2117/3983] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:46 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:47.616937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6e443f2-527c-42b5-8abc-171d0ce7ef9a tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Calling method '.version_select at 0x7f28c0f95c10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:48.507713 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6e443f2-527c-42b5-8abc-171d0ce7ef9a tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] 10.222.0.87 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.929545 Oct 17 15:40:48.508674 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2118/3984] 10.222.0.87 () {58 vars in 1149 bytes} [Mon Oct 17 15:40:47 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:48.513825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:48.514987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:48.545394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:48.574097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:48.575300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:48.587537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:48.589718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:48.594565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:48.905237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:48.942176 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4d06c80c-c8e2-471c-b7cb-6a9cebb019a2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1656 microversion: 2.1 time: 1.525736 Oct 17 15:40:48.948139 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1867/3985] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:47 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1656 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:48.976384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:48.978599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:49.005052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:49.006097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:49.007830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:49.011720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:49.022324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:49.030411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:49.588907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:49.592882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:49.610341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f18ef477-a9ab-4831-bd77-2740f817b1b6 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1355 microversion: 2.1 time: 1.099727 Oct 17 15:40:49.610959 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2119/3986] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:48 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1355 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:49.628450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e8e7040-e8e6-4fcc-bcbf-e36249bcf64c tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Calling method '.version_select at 0x7f28c3042550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:49.666079 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-405b36e3-b93f-4bd0-af6b-8220432fa10d tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1285 microversion: 2.1 time: 0.711851 Oct 17 15:40:49.670199 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1868/3987] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:48 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1285 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:49.685059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:49.686592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:49.707165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:49.712912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:49.713594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:49.714401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:49.719245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:49.720173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:51.558077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:51.642295 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23d50a6f-8532-4a6a-bc33-ca21f72fe8ce tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 1.967530 Oct 17 15:40:51.650661 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1869/3988] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:49 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:51.710152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3c3d11e-09d0-4f74-b418-717628d3dd6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:51.740052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3c3d11e-09d0-4f74-b418-717628d3dd6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:51.748662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3c3d11e-09d0-4f74-b418-717628d3dd6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:51.749665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3c3d11e-09d0-4f74-b418-717628d3dd6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:51.887116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3c3d11e-09d0-4f74-b418-717628d3dd6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Going to try to start instance {{(pid=120407) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 15:40:52.055881 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3c3d11e-09d0-4f74-b418-717628d3dd6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.402623 Oct 17 15:40:52.057191 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1870/3989] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:40:51 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:52.072341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:52.074444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:52.093437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:52.094826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:52.095856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:52.098682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:52.100474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:52.101870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:52.791554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:52.807881 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e7d2c76-8986-40f9-9e2b-589de6f0070c tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1806 microversion: 2.1 time: 0.746818 Oct 17 15:40:52.813733 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1871/3990] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:52 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1806 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:52.845430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:52.846776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:52.857263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:52.858657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:52.859452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:52.860495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:52.861307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:52.861986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:53.266540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:53.315940 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c46ac265-3271-44d9-a10c-e6ddabf430d3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1327 microversion: 2.1 time: 0.499650 Oct 17 15:40:53.335857 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1872/3991] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:52 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1327 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:53.361940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:53.363348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:53.377583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:53.378239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:53.379025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:53.380386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:53.381526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:53.383159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:53.603052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:53.716657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:53.836329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:53.891232 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d5f72310-09fe-4534-9252-1158c0783471 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1665 microversion: 2.1 time: 0.553123 Oct 17 15:40:53.892729 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1873/3992] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:53 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1665 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:53.902758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:53.904546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:53.935125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:53.937191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:53.938712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:53.940331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:53.941693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:53.942739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:54.086163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lazy-loading 'flavor' on Instance uuid 45f53954-5109-4fb4-8634-490b9664c7d8 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:40:54.296313 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e8e7040-e8e6-4fcc-bcbf-e36249bcf64c tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/c838e5a6-2f06-408e-8e77-d3c0aa7e492c" status: 202 len: 0 microversion: 2.1 time: 4.683707 Oct 17 15:40:54.298060 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2120/3993] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:40:49 2022] DELETE /compute/v2.1/os-floating-ips/c838e5a6-2f06-408e-8e77-d3c0aa7e492c => generated 0 bytes in 4686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:40:54.317894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:54.319343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:54.341717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:54.346127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:54.348532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:54.350883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:54.358607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:54.360954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:54.775703 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9ee67ace-7396-477e-bdd3-d0c927529756 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/action" status: 202 len: 0 microversion: 2.20 time: 0.865347 Oct 17 15:40:54.777102 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1874/3994] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:40:53 2022] POST /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:40:54.807108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-029d9f68-4161-4586-a068-7af4c96dec48 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:54.809089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-029d9f68-4161-4586-a068-7af4c96dec48 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:54.827859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029d9f68-4161-4586-a068-7af4c96dec48 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:54.829791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029d9f68-4161-4586-a068-7af4c96dec48 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:54.832861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029d9f68-4161-4586-a068-7af4c96dec48 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:54.835092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029d9f68-4161-4586-a068-7af4c96dec48 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:54.836412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029d9f68-4161-4586-a068-7af4c96dec48 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:54.839606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029d9f68-4161-4586-a068-7af4c96dec48 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:55.010946 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-029d9f68-4161-4586-a068-7af4c96dec48 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7/ips" status: 200 len: 219 microversion: 2.1 time: 0.231130 Oct 17 15:40:55.012493 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1875/3995] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:40:54 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7/ips => generated 219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:55.033670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4b23833-2ab1-4456-98bc-e8e1d8ae5ca5 tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Action: 'create', calling method: .version_select at 0x7f28be066dc0>, body: {"pool": null} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:55.116331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:55.131559 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29886f70-b277-4df5-93d3-5a9fa51468d8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 0.831552 Oct 17 15:40:55.132912 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2121/3996] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:54 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:55.156428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:55.157516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:55.185709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:55.189983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:55.190865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:55.205360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:55.206545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:55.207725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:56.273111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:56.282591 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4cd5397b-6a42-4232-86c4-db48dfff62f4 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1327 microversion: 2.1 time: 1.148099 Oct 17 15:40:56.295916 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2122/3997] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:55 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1327 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:56.307516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:56.317264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:56.346922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:56.350460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:56.350964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:56.351778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:56.352343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:56.352901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:57.287484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:57.323398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:57.333131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:57.342370 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e540657f-db19-46e5-8f81-b4a2d6fee6a6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1724 microversion: 2.20 time: 1.042835 Oct 17 15:40:57.344070 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2123/3998] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:40:56 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1724 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:40:57.372586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:57.389363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:57.429810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:57.430745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:57.431531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:57.432946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:57.433830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:57.434591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:57.952149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:57.969988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c44d6166-4a28-4eb3-9489-07db0c12f1a0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.610207 Oct 17 15:40:57.971120 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2124/3999] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:57 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:57.979182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:57.986333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:58.001931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:58.005468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:58.006239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:58.007599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:58.013499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:58.014400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:58.098976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:40:58.314822 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b182758-7ee2-4e82-9555-e6a78cecef84 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 204 len: 0 microversion: 2.1 time: 0.337841 Oct 17 15:40:58.316770 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2125/4000] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:40:57 2022] DELETE /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:40:58.329325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:58.331229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:58.346016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:58.347238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:58.348421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:58.350596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:58.352265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:58.353716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:58.411286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:40:58.762719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:58.788307 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8bc7a815-1315-4b80-8ce6-c66ead7202c5 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 0.468663 Oct 17 15:40:58.789829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2126/4001] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:58 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:58.995216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c228621-6414-4f75-8677-e00136e9102a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Action: 'create', calling method: .version_select at 0x7f28be0fa160>, body: {"keypair": {"name": "tempest-keypair-24271739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOqCYWyKpC33CNworGNlZNzhW4+ta6Gn2YhGIoXFZqI3huUpDS2z1eiOhD18LA1cIvzSVSsz2rM+2J3huJ0gCoHLQ3lCCUkqkEe09wd6B1RpiEWOsfy8kb6FBZ1oCQuFw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:40:59.030637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9c228621-6414-4f75-8677-e00136e9102a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Getting quotas for project 5029749bd7ab4560a06f5f862a2ef22e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:40:59.042813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9c228621-6414-4f75-8677-e00136e9102a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Getting quotas for user abb79e124f6b4ac19bbc5ad9f86da68a and project 5029749bd7ab4560a06f5f862a2ef22e. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:40:59.104232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c228621-6414-4f75-8677-e00136e9102a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.312135 Oct 17 15:40:59.115580 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2127/4002] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:40:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:40:59.135575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:59.138941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:59.155616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:59.157627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:59.159097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:59.162428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:59.163303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:59.163933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:59.509042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:59.522836 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f50110ac-36a7-4470-b154-a33fcb657cc3 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1327 microversion: 2.1 time: 0.416044 Oct 17 15:40:59.523536 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2128/4003] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:59 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1327 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:59.528585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:59.529217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:59.550467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:59.550662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:59.551174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:59.551838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:59.552304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:59.552735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:59.864237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:40:59.874016 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.349442 Oct 17 15:40:59.874772 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2129/4004] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:59 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:40:59.884638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:59.889703 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab7c410b-c3cc-43d9-9d01-5a493fd6d85d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002467 Oct 17 15:40:59.891556 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2130/4005] 10.222.0.87 () {56 vars in 886 bytes} [Mon Oct 17 15:40:59 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 15:40:59.931362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:40:59.935917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:40:59.960417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:59.961727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:59.962356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:40:59.963807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:40:59.965696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:40:59.966669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:00.017568 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4b23833-2ab1-4456-98bc-e8e1d8ae5ca5 tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.003084 Oct 17 15:41:00.033406 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1876/4006] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:40:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:00.045484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:00.048325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:00.060926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:00.062580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:00.066482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:00.067759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:00.068429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:00.069092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:00.396540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:00.397556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:00.417215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:00.418668 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb8e7e7c-f990-40d1-8ac7-8470df8511fc tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1812 microversion: 2.1 time: 0.523794 Oct 17 15:41:00.434918 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2131/4007] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:40:59 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1812 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:00.435338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:00.435338 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0975eac0-a06a-4b56-91a9-836f102b9922 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1724 microversion: 2.20 time: 0.395122 Oct 17 15:41:00.435573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4c75872b-4b62-4b91-b89b-1d84d3754f44 req-aab0e8fd-8075-4dc1-8f4c-c99eaa701860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d95956-c27c-445f-b2e5-ad5d3716e82b", "tag": "2544e67d-a2a1-44ef-ba17-120fb639433a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:00.437167 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1877/4008] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:00 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1724 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:00.452183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:00.458302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:00.461974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c75872b-4b62-4b91-b89b-1d84d3754f44 req-aab0e8fd-8075-4dc1-8f4c-c99eaa701860 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:00.462480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c75872b-4b62-4b91-b89b-1d84d3754f44 req-aab0e8fd-8075-4dc1-8f4c-c99eaa701860 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:00.462979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4c75872b-4b62-4b91-b89b-1d84d3754f44 req-aab0e8fd-8075-4dc1-8f4c-c99eaa701860 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:00.497031 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4c75872b-4b62-4b91-b89b-1d84d3754f44 req-aab0e8fd-8075-4dc1-8f4c-c99eaa701860 service nova] Creating event network-changed:2544e67d-a2a1-44ef-ba17-120fb639433a for instance 88d95956-c27c-445f-b2e5-ad5d3716e82b on n-h1-854441-12 Oct 17 15:41:00.497343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:00.498189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:00.499032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:00.500416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:00.501274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:00.502061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:00.507284 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4c75872b-4b62-4b91-b89b-1d84d3754f44 req-aab0e8fd-8075-4dc1-8f4c-c99eaa701860 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084617 Oct 17 15:41:00.508941 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2132/4009] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:00.527276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:00.528346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:00.540415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:00.540925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:00.541386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:00.542860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:00.543817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:00.544492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:00.580470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:00.659628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Unlocking {{(pid=120406) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 17 15:41:00.784701 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e0a67f7d-11c6-4be8-ac99-71bc803803ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.273880 Oct 17 15:41:00.793631 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2133/4010] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:41:00 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:41:00.803243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1aa733be-778a-42fc-af99-6b4f339c84e2 tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Calling method '.version_select at 0x7f28be121ca0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:02.371209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:02.387450 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02a259c6-aba9-4085-88d8-3912c6497b39 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1735 microversion: 2.1 time: 1.948204 Oct 17 15:41:02.394176 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1878/4011] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:00 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1735 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:02.407289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:02.408198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:02.421740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:02.423632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:02.424293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:02.425913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:02.430539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:02.431312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:03.751012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:03.767786 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-131332d2-c840-4ba8-8853-5edb584f9791 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1327 microversion: 2.1 time: 1.371983 Oct 17 15:41:03.783076 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1879/4012] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:02 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1327 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:03.789392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:03.796170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:03.812996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:03.813817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:03.814760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:03.815818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:03.817282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:03.818087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:03.852263 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1aa733be-778a-42fc-af99-6b4f339c84e2 tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/3719f70d-bda2-4141-ae3e-2f77891b3074" status: 202 len: 0 microversion: 2.1 time: 3.056871 Oct 17 15:41:03.852916 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2134/4013] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:41:00 2022] DELETE /compute/v2.1/os-floating-ips/3719f70d-bda2-4141-ae3e-2f77891b3074 => generated 0 bytes in 3059 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:41:03.858051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:03.859006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:03.876250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:03.876747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:03.879124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:03.879905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:03.890727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:03.891619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:04.667649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:04.681091 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81f6944d-4d76-45b9-982f-37baa76bc529 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1791 microversion: 2.1 time: 0.826857 Oct 17 15:41:04.684306 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2135/4014] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:03 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1791 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:04.696260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:04.697323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:04.712377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:04.714763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:04.716659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:04.717815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:04.725376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:04.726280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:05.207741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:05.231803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:05.235049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:05.259261 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9cc66f5c-e2ce-4cea-81e8-2cf1428b004d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1724 microversion: 2.20 time: 0.562430 Oct 17 15:41:05.263380 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2136/4015] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:04 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1724 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:05.271957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:05.273078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:05.296252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:05.298979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:05.303011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:05.332448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:05.332960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:05.333416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:05.410033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:05.429764 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-17fd5698-03b3-496f-a958-73af0371ece6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.634825 Oct 17 15:41:05.431194 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1880/4016] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:03 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:05.436279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e475833c-c2d1-4ba6-b55c-61254e1c7a7d tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Calling method '.version_select at 0x7f28bdf4b3a0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:05.579804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-e475833c-c2d1-4ba6-b55c-61254e1c7a7d tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3719f70d-bda2-4141-ae3e-2f77891b3074 could not be found", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:41:05.580856 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e475833c-c2d1-4ba6-b55c-61254e1c7a7d tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] HTTP exception thrown: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e475833c-c2d1-4ba6-b55c-61254e1c7a7d tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Request method failure captured: Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-floating-ips/3719f70d-bda2-4141-ae3e-2f77891b3074 HTTP/1.1 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXd1r2rP5St2MFVraFMcZE_3wDf2kC2-tyRizNiyQBmmfpnbJBqYLJPhcZCsDtxbH1PH0yYzTBqGz-eqJb6oCrnxle9ZsJmlOe-LNRF4yF_8Gb1eDwIbts13obpHdrnHBbcDLs6iMbTY2VC4qwRufKIVMiqTt4v2kXDG_b9ral8Q8EE Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: db5dad9e9b1a44cb9014cedc34eb26e9 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPsTestJSON-447874912 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/db5dad9e9b1a44cb9014cedc34eb26e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/db5dad9e9b1a44cb9014cedc34eb26e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_db5dad9e9b1a44cb9014cedc34eb26e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/db5dad9e9b1a44cb9014cedc34eb26e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPsTestJSON-447874912 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: db5dad9e9b1a44cb9014cedc34eb26e9 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPsTestJSON-447874912 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPsTestJSON-447874912-project Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6cafb01dd61b401fba3eb7608f3a3a4b Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPsTestJSON-447874912-project Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: exception: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '3719f70d-bda2-4141-ae3e-2f77891b3074'} Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3719f70d-bda2-4141-ae3e-2f77891b3074 could not be found Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97788392-5599-4bf6-b528-b3ce941f1c4d'] Oct 17 15:41:05.583111 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074. Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 Oct 17 15:41:05.587531 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:05.591799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e475833c-c2d1-4ba6-b55c-61254e1c7a7d tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Returning 404 to user: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:41:05.593375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e475833c-c2d1-4ba6-b55c-61254e1c7a7d tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] 10.222.0.87 "GET /compute/v2.1/os-floating-ips/3719f70d-bda2-4141-ae3e-2f77891b3074" status: 404 len: 111 microversion: 2.1 time: 0.161184 Oct 17 15:41:05.594535 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1881/4017] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:41:05 2022] GET /compute/v2.1/os-floating-ips/3719f70d-bda2-4141-ae3e-2f77891b3074 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:41:05.604312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2ec04d2b-1319-4df9-8146-722585692835 req-39ffabda-ecac-4215-b2d6-4b4088275840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "name": "network-vif-deleted", "tag": "e48a4e5e-5cd6-4e23-bcca-930d69a1e5c5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:05.627809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2ec04d2b-1319-4df9-8146-722585692835 req-39ffabda-ecac-4215-b2d6-4b4088275840 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:05.628058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2ec04d2b-1319-4df9-8146-722585692835 req-39ffabda-ecac-4215-b2d6-4b4088275840 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:05.632585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2ec04d2b-1319-4df9-8146-722585692835 req-39ffabda-ecac-4215-b2d6-4b4088275840 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:05.668912 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2ec04d2b-1319-4df9-8146-722585692835 req-39ffabda-ecac-4215-b2d6-4b4088275840 service nova] Creating event network-vif-deleted:e48a4e5e-5cd6-4e23-bcca-930d69a1e5c5 for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:41:05.683730 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2ec04d2b-1319-4df9-8146-722585692835 req-39ffabda-ecac-4215-b2d6-4b4088275840 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085097 Oct 17 15:41:05.689677 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1882/4018] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:05.700166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:05.703837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:05.727193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:05.728244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:05.728970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:05.729965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:05.730808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:05.734617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:06.280229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:06.295402 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-212b9eac-f0bb-48c5-a909-c8daa03927b4 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1715 microversion: 2.1 time: 1.028569 Oct 17 15:41:06.299233 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2137/4019] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:05 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1715 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:06.342070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:06.342754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:06.355799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:06.356898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:06.357745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:06.358897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:06.359586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:06.365052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:06.514001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:06.546862 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dbe71bd8-9300-4ab6-80ce-fff33924d6ad tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1327 microversion: 2.1 time: 0.854990 Oct 17 15:41:06.574007 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1883/4020] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:05 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1327 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:06.611498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e646068c-7fc2-46f7-9d94-7baa54b5f8ae tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Calling method '.version_select at 0x7f28be0215e0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:06.911059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG neutronclient.v2_0.client [None req-e646068c-7fc2-46f7-9d94-7baa54b5f8ae tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3719f70d-bda2-4141-ae3e-2f77891b3074 could not be found", "detail": ""}} {{(pid=120407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 15:41:06.912370 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e646068c-7fc2-46f7-9d94-7baa54b5f8ae tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] HTTP exception thrown: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e646068c-7fc2-46f7-9d94-7baa54b5f8ae tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Request method failure captured: Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-floating-ips/3719f70d-bda2-4141-ae3e-2f77891b3074 HTTP/1.1 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXd1r2rP5St2MFVraFMcZE_3wDf2kC2-tyRizNiyQBmmfpnbJBqYLJPhcZCsDtxbH1PH0yYzTBqGz-eqJb6oCrnxle9ZsJmlOe-LNRF4yF_8Gb1eDwIbts13obpHdrnHBbcDLs6iMbTY2VC4qwRufKIVMiqTt4v2kXDG_b9ral8Q8EE Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: db5dad9e9b1a44cb9014cedc34eb26e9 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-FloatingIPsTestJSON-447874912 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/db5dad9e9b1a44cb9014cedc34eb26e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/db5dad9e9b1a44cb9014cedc34eb26e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_db5dad9e9b1a44cb9014cedc34eb26e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/db5dad9e9b1a44cb9014cedc34eb26e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-FloatingIPsTestJSON-447874912 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: db5dad9e9b1a44cb9014cedc34eb26e9 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-FloatingIPsTestJSON-447874912 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-FloatingIPsTestJSON-447874912-project Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6cafb01dd61b401fba3eb7608f3a3a4b Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-FloatingIPsTestJSON-447874912-project Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: exception: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '3719f70d-bda2-4141-ae3e-2f77891b3074'} Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3719f70d-bda2-4141-ae3e-2f77891b3074 could not be found Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9acfb5d7-6eb3-4e02-b5e6-030ce5cab85f'] Oct 17 15:41:06.916440 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074. Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:06.921728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e646068c-7fc2-46f7-9d94-7baa54b5f8ae tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] Returning 404 to user: Floating IP not found for ID 3719f70d-bda2-4141-ae3e-2f77891b3074 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:41:06.929796 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e646068c-7fc2-46f7-9d94-7baa54b5f8ae tempest-FloatingIPsTestJSON-447874912 tempest-FloatingIPsTestJSON-447874912-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/3719f70d-bda2-4141-ae3e-2f77891b3074" status: 404 len: 111 microversion: 2.1 time: 0.343150 Oct 17 15:41:06.929910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:06.932475 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1884/4021] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:41:06 2022] DELETE /compute/v2.1/os-floating-ips/3719f70d-bda2-4141-ae3e-2f77891b3074 => generated 111 bytes in 358 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:41:06.955382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:06.956803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:06.964951 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-973e9c57-d87f-44c0-9f74-605f813b4806 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.639793 Oct 17 15:41:06.966413 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2138/4022] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:06 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:06.982830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:06.983599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:06.992616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:06.993562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:06.993834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:06.994704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:06.995189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:06.995678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:06.996697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:06.997209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:06.997650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:06.998565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:07.006961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:07.007460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:07.935147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:07.964543 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-429bb206-2797-4c55-9263-aeae6d134448 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1655 microversion: 2.1 time: 1.028127 Oct 17 15:41:07.967782 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1885/4023] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:06 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1655 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:07.988361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:08.006025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:08.046019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:08.054399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:08.055693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:08.057305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:08.066869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:08.068473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:08.434579 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] HTTP exception thrown: Cannot 'detach_volume' instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 while it is in vm_state rescued Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Request method failure captured: Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments/c7c9f16d-e5d5-4aa6-90ba-64c83bafcc97 HTTP/1.1 Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXZ8kmtUPZWb3G0RLc0tH4XVjR5C-7gTVa04Om70uUY0S3ObDBITuVYe9LE38K5_JYHog2FWX-dPJIO8BZMjXqs1lpG_ioDhvbA748hUDdgAKK6oZjLCKHY9A2JeDwuSv8UPAoiN-E1QRQdYcKH6OumXVNNcIN16WkTnV4IzILKrXLw Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ea396576a90246cb8b821cb2afec9170 Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: exception: Cannot 'detach_volume' instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 while it is in vm_state rescued Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'server_id': '65b793d7-d5e4-4688-9805-2d0997a9b2a1', 'id': 'c7c9f16d-e5d5-4aa6-90ba-64c83bafcc97'} Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 while it is in vm_state rescued Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:08.436286 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:08.456230 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:08.456230 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:08.456230 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:41:08.456230 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:41:08.456230 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 while it is in vm_state rescued Oct 17 15:41:08.456230 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:08.456230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Returning 409 to user: Cannot 'detach_volume' instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 while it is in vm_state rescued {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:41:08.456230 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b123e270-3c7d-4077-8c68-712d4596d153 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "DELETE /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments/c7c9f16d-e5d5-4aa6-90ba-64c83bafcc97" status: 409 len: 152 microversion: 2.1 time: 0.461591 Oct 17 15:41:08.456230 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1886/4024] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:41:07 2022] DELETE /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments/c7c9f16d-e5d5-4aa6-90ba-64c83bafcc97 => generated 152 bytes in 463 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:41:08.457696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c80930d5-dacc-40d7-b9ff-fe61caa4b7a8 req-1eefa21b-82c5-446e-a40e-32dc2d9b6bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d95956-c27c-445f-b2e5-ad5d3716e82b", "name": "network-vif-plugged", "status": "completed", "tag": "2544e67d-a2a1-44ef-ba17-120fb639433a"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:08.474786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:08.512733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c80930d5-dacc-40d7-b9ff-fe61caa4b7a8 req-1eefa21b-82c5-446e-a40e-32dc2d9b6bbb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:08.513345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c80930d5-dacc-40d7-b9ff-fe61caa4b7a8 req-1eefa21b-82c5-446e-a40e-32dc2d9b6bbb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:08.513874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c80930d5-dacc-40d7-b9ff-fe61caa4b7a8 req-1eefa21b-82c5-446e-a40e-32dc2d9b6bbb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:08.545659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:08.562374 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c80930d5-dacc-40d7-b9ff-fe61caa4b7a8 req-1eefa21b-82c5-446e-a40e-32dc2d9b6bbb service nova] Creating event network-vif-plugged:2544e67d-a2a1-44ef-ba17-120fb639433a for instance 88d95956-c27c-445f-b2e5-ad5d3716e82b on n-h1-854441-12 Oct 17 15:41:08.584240 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c80930d5-dacc-40d7-b9ff-fe61caa4b7a8 req-1eefa21b-82c5-446e-a40e-32dc2d9b6bbb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135504 Oct 17 15:41:08.586835 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1887/4025] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:08.598434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:08.605122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:08.612916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:08.622018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:08.625232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:08.626408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:08.627429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:08.628128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:08.628756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:08.630856 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-248e3a77-7877-415b-839b-b62e0f9d56a3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1745 microversion: 2.20 time: 1.647565 Oct 17 15:41:08.632187 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2139/4026] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:06 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1745 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:08.744894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:08.746120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:08.787054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:08.790521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:08.793645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:08.799777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:08.806635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:08.810460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:09.066176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:09.714574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:09.726006 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-945b4776-b8d6-4f48-b949-171d9f1934c5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.137363 Oct 17 15:41:09.732568 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1888/4027] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:08 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:09.755744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-065cf0b6-e1ba-4a85-96c3-fd5718751d9a req-eaa39337-414b-4e78-b2c4-1ccb6d3f1df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "name": "network-vif-deleted", "tag": "9b09d026-3f54-4a98-bddc-b2e5cae1ea77"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:09.816601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-065cf0b6-e1ba-4a85-96c3-fd5718751d9a req-eaa39337-414b-4e78-b2c4-1ccb6d3f1df1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:09.817683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-065cf0b6-e1ba-4a85-96c3-fd5718751d9a req-eaa39337-414b-4e78-b2c4-1ccb6d3f1df1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:09.818362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-065cf0b6-e1ba-4a85-96c3-fd5718751d9a req-eaa39337-414b-4e78-b2c4-1ccb6d3f1df1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:09.848306 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-065cf0b6-e1ba-4a85-96c3-fd5718751d9a req-eaa39337-414b-4e78-b2c4-1ccb6d3f1df1 service nova] Creating event network-vif-deleted:9b09d026-3f54-4a98-bddc-b2e5cae1ea77 for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:41:09.856927 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-065cf0b6-e1ba-4a85-96c3-fd5718751d9a req-eaa39337-414b-4e78-b2c4-1ccb6d3f1df1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122118 Oct 17 15:41:09.862256 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1889/4028] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:09.873413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8211edb3-338b-409c-8590-aa2be52a0640 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:09.877792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8211edb3-338b-409c-8590-aa2be52a0640 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:09.890693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8211edb3-338b-409c-8590-aa2be52a0640 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:09.891436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8211edb3-338b-409c-8590-aa2be52a0640 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:09.892066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8211edb3-338b-409c-8590-aa2be52a0640 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:09.892985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8211edb3-338b-409c-8590-aa2be52a0640 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:09.893625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8211edb3-338b-409c-8590-aa2be52a0640 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:09.894232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8211edb3-338b-409c-8590-aa2be52a0640 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:10.186281 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8211edb3-338b-409c-8590-aa2be52a0640 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/action" status: 202 len: 0 microversion: 2.1 time: 0.320223 Oct 17 15:41:10.187641 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1890/4029] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:41:09 2022] POST /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:41:10.196003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:10.197115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:10.207992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:10.209116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:10.210650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:10.211743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:10.212550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:10.213199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:10.265897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:10.266929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:10.267691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:10.268468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lazy-loading 'fault' on Instance uuid c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:41:10.377595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:10.394006 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d7148a27-0a66-476a-9119-94c37f007bc5 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 200 len: 1303 microversion: 2.1 time: 0.204688 Oct 17 15:41:10.411354 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1891/4030] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:10 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 1303 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:10.423422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:10.424577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:10.433697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:10.434849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:10.435732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:10.437380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:10.438182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:10.438926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:11.021526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:11.062426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:11.076592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:11.085220 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c0bd1b06-e3db-467e-bced-c29ab949115b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.668119 Oct 17 15:41:11.108303 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1892/4031] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:10 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:11.122716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef3a6e9d-cb58-4c1b-9d8d-9504080a7dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:11.124893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef3a6e9d-cb58-4c1b-9d8d-9504080a7dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:11.148666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef3a6e9d-cb58-4c1b-9d8d-9504080a7dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:11.149837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef3a6e9d-cb58-4c1b-9d8d-9504080a7dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:11.150802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef3a6e9d-cb58-4c1b-9d8d-9504080a7dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:11.164949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef3a6e9d-cb58-4c1b-9d8d-9504080a7dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:11.166935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef3a6e9d-cb58-4c1b-9d8d-9504080a7dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:11.171924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef3a6e9d-cb58-4c1b-9d8d-9504080a7dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:11.367327 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef3a6e9d-cb58-4c1b-9d8d-9504080a7dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.256715 Oct 17 15:41:11.370601 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1893/4032] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:41:11 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:41:11.384923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:11.389158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:11.405781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:11.407897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:11.411826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:11.412894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:11.413566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:11.414205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:11.594666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:11.637195 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe8ae372-8db1-4987-ac0a-776072dcaa68 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1327 microversion: 2.1 time: 2.990934 Oct 17 15:41:11.659310 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2140/4033] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:08 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1327 bytes in 3014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:11.666085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7a2e00aa-8be7-4f05-8140-6aefb8661d33 req-b26fbfb9-e67c-45f3-9d5c-b770ea429596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "name": "network-vif-unplugged", "status": "completed", "tag": "0204f3e1-e654-4651-8e4c-c4694d89060d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:11.678195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:11.681569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a2e00aa-8be7-4f05-8140-6aefb8661d33 req-b26fbfb9-e67c-45f3-9d5c-b770ea429596 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:11.682973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a2e00aa-8be7-4f05-8140-6aefb8661d33 req-b26fbfb9-e67c-45f3-9d5c-b770ea429596 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:11.684083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a2e00aa-8be7-4f05-8140-6aefb8661d33 req-b26fbfb9-e67c-45f3-9d5c-b770ea429596 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:11.705445 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7a2e00aa-8be7-4f05-8140-6aefb8661d33 req-b26fbfb9-e67c-45f3-9d5c-b770ea429596 service nova] Creating event network-vif-unplugged:0204f3e1-e654-4651-8e4c-c4694d89060d for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:41:11.712397 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7a2e00aa-8be7-4f05-8140-6aefb8661d33 req-b26fbfb9-e67c-45f3-9d5c-b770ea429596 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051581 Oct 17 15:41:11.716885 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2141/4034] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:11.759056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:11.774308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:11.812007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:11.819062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:11.821120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:11.823397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:11.827006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:11.831553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:12.271505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:12.314318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c375c86-211f-43cb-b79c-d0a8ef45b0fb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1723 microversion: 2.1 time: 0.934235 Oct 17 15:41:12.315432 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1894/4035] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:11 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1723 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:12.338216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:12.347487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:12.371850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:12.380238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:12.389918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:12.393051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:12.397541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:12.398990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:12.465603 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] HTTP exception thrown: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Request method failure captured: Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 HTTP/1.1 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXc_VLxUilec1VEAUSakNJa0rHlu-BhCwMOQjwolccS77XPr9g_THNrcbkHYRL9CHi9UIGfNk481Rqdgv7rThqKHJSQoB_8XkpWSLwOkXCEsSazplZMgnVevu1H5w5gtU5hxyxTusZkU8TqSZ6n9Vhw9FZEPyey54KYSvyDWd6s24-c Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/99b699ae886f4742a317cff0aa265510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_99b699ae886f4742a317cff0aa265510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestMultiNic-406591426 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestMultiNic-406591426-project Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 3e9f8900f5164afdaf9deac86f6b4e28 Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestMultiNic-406591426-project Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'c1bf8ffa-09f1-4048-9abc-63fbd02d45f7'} Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:12.478809 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:12.488855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:12.488855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:12.488855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:12.488855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:41:12.488855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:41:12.488855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:41:12.488855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:12.494480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Returning 404 to user: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:41:12.497267 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a6eb679-4ee5-4379-baa9-ccedc2a88c15 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 404 len: 111 microversion: 2.1 time: 0.177010 Oct 17 15:41:12.501712 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1895/4036] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:12 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:41:12.533620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ce826b61-0833-481c-b072-3051aed76ec7 req-2037f56f-042d-445b-ad25-703052784b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf8ffa-09f1-4048-9abc-63fbd02d45f7", "name": "network-vif-deleted", "tag": "0204f3e1-e654-4651-8e4c-c4694d89060d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:12.608146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ce826b61-0833-481c-b072-3051aed76ec7 req-2037f56f-042d-445b-ad25-703052784b5d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:12.608969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ce826b61-0833-481c-b072-3051aed76ec7 req-2037f56f-042d-445b-ad25-703052784b5d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:12.615449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ce826b61-0833-481c-b072-3051aed76ec7 req-2037f56f-042d-445b-ad25-703052784b5d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:12.676533 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ce826b61-0833-481c-b072-3051aed76ec7 req-2037f56f-042d-445b-ad25-703052784b5d service nova] Creating event network-vif-deleted:0204f3e1-e654-4651-8e4c-c4694d89060d for instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 on n-h2-854441-12 Oct 17 15:41:12.698153 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ce826b61-0833-481c-b072-3051aed76ec7 req-2037f56f-042d-445b-ad25-703052784b5d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193265 Oct 17 15:41:12.699121 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1896/4037] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:12.730450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:12.737326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:12.776003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:12.776329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:12.780587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:12.781796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:12.782668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:12.783450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:13.346574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:13.371578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:13.375413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:13.378407 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e34f2cd5-3992-437d-99d3-1c799576b9a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.677426 Oct 17 15:41:13.379829 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1897/4038] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:12 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:13.432040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:13.433717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:13.445285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:13.446634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:13.447678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:13.449243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:13.450403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:13.451329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:13.460593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:13.607934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:13.624337 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3deb69d-f3c7-474f-be1a-ab06c994f710 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1674 microversion: 2.1 time: 1.899920 Oct 17 15:41:13.642322 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2142/4039] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:11 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1674 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:13.655379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:13.660241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:13.676835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:13.677959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:13.679645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:13.683152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:13.684157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:13.688111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:13.892152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:13.919538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-77ed4148-14d0-4787-b6b7-1d666cd21e67 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1526 microversion: 2.1 time: 0.525118 Oct 17 15:41:13.926097 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1898/4040] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:13 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1526 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:13.947971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:13.949123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:13.976893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:13.981792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:13.983170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:13.988897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:13.995878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:13.997220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:15.407942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:15.434332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f937dc88-637f-4e7e-9802-eb5de4c74828 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1723 microversion: 2.1 time: 1.786033 Oct 17 15:41:15.441167 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2143/4041] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:13 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1723 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:15.461240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-60ef688e-ea0b-470c-8250-0e4624ca5659 req-94f8917e-7a11-48e7-b477-6fd49b90966a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f53954-5109-4fb4-8634-490b9664c7d8", "name": "network-vif-plugged", "status": "completed", "tag": "c4a74e76-9816-486b-854c-027fd5b61d05"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:15.541609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60ef688e-ea0b-470c-8250-0e4624ca5659 req-94f8917e-7a11-48e7-b477-6fd49b90966a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:15.546030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60ef688e-ea0b-470c-8250-0e4624ca5659 req-94f8917e-7a11-48e7-b477-6fd49b90966a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:15.547430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60ef688e-ea0b-470c-8250-0e4624ca5659 req-94f8917e-7a11-48e7-b477-6fd49b90966a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:15.598886 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-60ef688e-ea0b-470c-8250-0e4624ca5659 req-94f8917e-7a11-48e7-b477-6fd49b90966a service nova] Creating event network-vif-plugged:c4a74e76-9816-486b-854c-027fd5b61d05 for instance 45f53954-5109-4fb4-8634-490b9664c7d8 on n-h2-854441-12 Oct 17 15:41:15.622114 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-60ef688e-ea0b-470c-8250-0e4624ca5659 req-94f8917e-7a11-48e7-b477-6fd49b90966a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177640 Oct 17 15:41:15.643701 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2144/4042] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:15.711488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:15.712219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:15.729870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:15.730151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:15.730593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:15.731365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:15.731821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:15.732316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:15.776126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:15.796558 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e840b154-6a49-467c-9f14-6a8af417a527 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1526 microversion: 2.1 time: 1.856289 Oct 17 15:41:15.797224 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1899/4043] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:13 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1526 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:15.825057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:15.825694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:15.845764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:15.851482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:15.854093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:15.857519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:15.858341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:15.863850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:16.448938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:16.502816 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba5f43a5-2093-47e5-ba57-16e0458b3df5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1654 microversion: 2.1 time: 0.697876 Oct 17 15:41:16.508371 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1900/4044] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:15 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1654 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:16.771319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:16.772262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:16.816780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:16.820608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:16.832904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:16.833806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:16.850396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:16.856938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:16.858953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:16.862209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:16.863050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:16.865112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:16.879357 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab38465d-03e5-4b4a-91cd-2d5525841b62 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 1.229892 Oct 17 15:41:16.920755 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2145/4045] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:15 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:16.928515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:16.937063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:16.945612 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] HTTP exception thrown: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Request method failure captured: Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b HTTP/1.1 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXd547lX8LJbBQbd6AHcYf-gzhUBMylA2zjPlTm52yzYrvL9bDTpvSAgwOtfwU60Uxl22btm5l9M7x8kSP14bkbs1d6IFPkJ8M9LpJpgxJAvBq5VyiS5gOWGLrE2aegd6yZ5z77ya8V21csVtK71ri-E1qmmYpPqYThvPvSysw7c2SE Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad7d525ed7a45cf9eb6812b5df773d4 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1853311931 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad7d525ed7a45cf9eb6812b5df773d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad7d525ed7a45cf9eb6812b5df773d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad7d525ed7a45cf9eb6812b5df773d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad7d525ed7a45cf9eb6812b5df773d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1853311931 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad7d525ed7a45cf9eb6812b5df773d4 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1853311931 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1853311931-project Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: c3ef19ff589f4d84bfa466806c8fad16 Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1853311931-project Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '88d95956-c27c-445f-b2e5-ad5d3716e82b'} Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:41:16.956787 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:16.961518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Returning 404 to user: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:41:16.962390 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1ff670b1-b300-41b1-988e-968371db9778 tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] 10.222.0.87 "DELETE /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 404 len: 111 microversion: 2.1 time: 0.443420 Oct 17 15:41:16.970693 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1901/4046] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:41:16 2022] DELETE /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 111 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:41:16.978953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:16.981753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:16.985485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:16.991414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:16.992376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:16.994669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:17.012769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6b7e877-364f-4197-bea7-5a60c319bf9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:17.013963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e6b7e877-364f-4197-bea7-5a60c319bf9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:17.066712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6b7e877-364f-4197-bea7-5a60c319bf9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:17.074263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6b7e877-364f-4197-bea7-5a60c319bf9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:17.075622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6b7e877-364f-4197-bea7-5a60c319bf9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:17.080346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6b7e877-364f-4197-bea7-5a60c319bf9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:17.083870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6b7e877-364f-4197-bea7-5a60c319bf9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:17.087422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6b7e877-364f-4197-bea7-5a60c319bf9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:17.400671 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e6b7e877-364f-4197-bea7-5a60c319bf9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.416275 Oct 17 15:41:17.410623 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1902/4047] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:41:16 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:41:17.447292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:17.450712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:17.473836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=70 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:17.481830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:17.483737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:17.484828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:17.486481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:17.487965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:17.489272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:17.800273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:17.837757 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f1fcbffe-559a-492b-9589-543e04209d4e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1729 microversion: 2.1 time: 0.911882 Oct 17 15:41:17.846460 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2146/4048] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:16 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1729 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:17.867918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:17.869626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:17.900964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:17.906230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:17.910386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:17.912144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:17.918401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:17.919796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:18.321545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:18.341601 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9b8dc01-fe5f-4b90-a9f2-0c375981b9ad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.492277 Oct 17 15:41:18.342851 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2147/4049] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:17 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:18.373536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c46b0a2b-0b7d-4472-a595-0d1e11b591cb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:18.374256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c46b0a2b-0b7d-4472-a595-0d1e11b591cb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:18.383000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46b0a2b-0b7d-4472-a595-0d1e11b591cb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:18.383541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46b0a2b-0b7d-4472-a595-0d1e11b591cb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:18.384015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46b0a2b-0b7d-4472-a595-0d1e11b591cb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:18.384747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46b0a2b-0b7d-4472-a595-0d1e11b591cb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:18.385213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46b0a2b-0b7d-4472-a595-0d1e11b591cb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:18.385642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c46b0a2b-0b7d-4472-a595-0d1e11b591cb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:18.627567 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c46b0a2b-0b7d-4472-a595-0d1e11b591cb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.262903 Oct 17 15:41:18.630452 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2148/4050] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:41:18 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:18.643291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:18.645745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:18.669818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:18.671352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:18.672556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:18.675504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:18.677934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:18.679186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:19.130816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:19.186355 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31f73d5d-1f4e-4d85-93d0-22652165c889 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1526 microversion: 2.1 time: 1.766879 Oct 17 15:41:19.196914 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1903/4051] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:17 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1526 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:19.238375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:19.260081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:19.319369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:19.325114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:19.333914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:19.339676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:19.341592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:19.343982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:20.836329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:20.863494 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-192b764b-bdf6-4bf6-8658-3213cefafc07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.655728 Oct 17 15:41:20.876314 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1904/4052] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:19 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:20.886195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Action: 'update', calling method: >, body: {"server": {"name": "88d95956-c27c-445f-b2e5-ad5d3716e82b_new"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:20.903661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:20.929159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:20.930662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:20.931829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:20.933623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:20.934849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:20.936002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:21.003586 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] HTTP exception thrown: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Request method failure captured: Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: request: PUT /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b HTTP/1.1 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 64 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXd547lX8LJbBQbd6AHcYf-gzhUBMylA2zjPlTm52yzYrvL9bDTpvSAgwOtfwU60Uxl22btm5l9M7x8kSP14bkbs1d6IFPkJ8M9LpJpgxJAvBq5VyiS5gOWGLrE2aegd6yZ5z77ya8V21csVtK71ri-E1qmmYpPqYThvPvSysw7c2SE Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad7d525ed7a45cf9eb6812b5df773d4 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1853311931 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad7d525ed7a45cf9eb6812b5df773d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad7d525ed7a45cf9eb6812b5df773d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad7d525ed7a45cf9eb6812b5df773d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad7d525ed7a45cf9eb6812b5df773d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1853311931 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad7d525ed7a45cf9eb6812b5df773d4 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1853311931 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1853311931-project Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: c3ef19ff589f4d84bfa466806c8fad16 Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1853311931-project Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "88d95956-c27c-445f-b2e5-ad5d3716e82b_new"}} Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '88d95956-c27c-445f-b2e5-ad5d3716e82b', 'body': {'server': {'name': '88d95956-c27c-445f-b2e5-ad5d3716e82b_new'}}} Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:41:21.006066 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:21.010939 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:21.017608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] Returning 404 to user: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:41:21.027914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5d5121db-f0cf-4f10-930f-2a5890c2c92a tempest-ServersNegativeTestMultiTenantJSON-1853311931 tempest-ServersNegativeTestMultiTenantJSON-1853311931-project] 10.222.0.87 "PUT /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 404 len: 111 microversion: 2.1 time: 0.149471 Oct 17 15:41:21.029244 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1905/4053] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 15:41:20 2022] PUT /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:41:21.035361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:21.036362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:21.053405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:21.054405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:21.055161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:21.056192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:21.057027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:21.057682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:21.182884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:21.196369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:21.201469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:21.205028 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-226feb19-eedb-47b0-8c18-706637af4c7c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 2.569914 Oct 17 15:41:21.210030 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2149/4054] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:18 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 2576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:21.224227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:21.225153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:21.237613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:21.238426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:21.239344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:21.240340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:21.242012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:21.244315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:21.308175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:41:21.553137 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c45f30d-ff24-4f3f-ac64-95f17414783b tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "DELETE /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 204 len: 0 microversion: 2.1 time: 0.331265 Oct 17 15:41:21.555179 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2150/4055] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:41:21 2022] DELETE /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:41:21.578391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:21.584539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:21.625630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:21.626181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:21.626691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:21.627521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:21.628027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:21.628507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:23.078424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:23.092630 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc19c816-69c7-4249-8b19-cd7a39000e9f tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1532 microversion: 2.1 time: 1.531472 Oct 17 15:41:23.096451 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2151/4056] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:21 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1532 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:23.103898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:23.108274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:23.147163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:23.163168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:23.164147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:23.165113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:23.165772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:23.166287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:23.687939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:23.735238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:23.741842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:23.754079 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5cb12aa2-b960-43c2-91a6-1b4cee048f28 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.655711 Oct 17 15:41:23.803634 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2152/4057] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:23 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:24.059138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:24.113528 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7f659bb4-96e0-4fe0-9901-9df949d4bfa0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 3.082263 Oct 17 15:41:24.114474 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1906/4058] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:21 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 3084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:24.147975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:24.149513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:24.151611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:24.166762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:24.177617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:24.179954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:24.180808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:24.185693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:24.187733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:24.188652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:24.189506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:24.190262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:24.199137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:24.219914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:24.220714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:24.221179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:24.929221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:24.938269 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba2ad085-1159-4133-890e-9a1fd5a1bd22 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1532 microversion: 2.1 time: 0.801380 Oct 17 15:41:24.938956 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2153/4059] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:24 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1532 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:41:24.956740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:25.004969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:25.040202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:25.041966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:25.042680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:25.047308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:25.048091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:25.050181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:25.522968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:25.536624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:25.539265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:25.540527 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdaef591-2341-4a5c-a15c-9472ba53d6fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.590728 Oct 17 15:41:25.556120 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2154/4060] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:24 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:26.094338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4dd9ab5c-c6a6-4007-9f2c-3f8b116361dd tempest-ExtensionsTest-1681539173 tempest-ExtensionsTest-1681539173-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:26.096457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4dd9ab5c-c6a6-4007-9f2c-3f8b116361dd tempest-ExtensionsTest-1681539173 tempest-ExtensionsTest-1681539173-project] 10.222.0.87 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.539044 Oct 17 15:41:26.097044 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2155/4061] 10.222.0.87 () {58 vars in 1170 bytes} [Mon Oct 17 15:41:25 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:26.116533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1b14223f-8ec7-4a16-a83d-6b661198b54a req-c8471deb-c085-4c35-8d4d-251fc3daf3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d95956-c27c-445f-b2e5-ad5d3716e82b", "name": "network-vif-unplugged", "status": "completed", "tag": "2544e67d-a2a1-44ef-ba17-120fb639433a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:26.171200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1b14223f-8ec7-4a16-a83d-6b661198b54a req-c8471deb-c085-4c35-8d4d-251fc3daf3cc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:26.174811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1b14223f-8ec7-4a16-a83d-6b661198b54a req-c8471deb-c085-4c35-8d4d-251fc3daf3cc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:26.176577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1b14223f-8ec7-4a16-a83d-6b661198b54a req-c8471deb-c085-4c35-8d4d-251fc3daf3cc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:26.219309 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1b14223f-8ec7-4a16-a83d-6b661198b54a req-c8471deb-c085-4c35-8d4d-251fc3daf3cc service nova] Creating event network-vif-unplugged:2544e67d-a2a1-44ef-ba17-120fb639433a for instance 88d95956-c27c-445f-b2e5-ad5d3716e82b on n-h1-854441-12 Oct 17 15:41:26.228182 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1b14223f-8ec7-4a16-a83d-6b661198b54a req-c8471deb-c085-4c35-8d4d-251fc3daf3cc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126865 Oct 17 15:41:26.241329 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2156/4062] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:26.269524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:26.271686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:26.289164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:26.290602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:26.292174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:26.294251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:26.295213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:26.295993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:26.296484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:26.326944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6ab83f0a-c51a-4e9f-99aa-f4acb565b967 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 2.184171 Oct 17 15:41:26.337692 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1907/4063] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:24 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:26.370783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-faa6cca5-8951-4fe4-ac77-31cc9c22954f tempest-ExtensionsTest-1681539173 tempest-ExtensionsTest-1681539173-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:26.375911 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-faa6cca5-8951-4fe4-ac77-31cc9c22954f tempest-ExtensionsTest-1681539173 tempest-ExtensionsTest-1681539173-project] 10.222.0.87 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.027662 Oct 17 15:41:26.403490 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1908/4064] 10.222.0.87 () {58 vars in 1134 bytes} [Mon Oct 17 15:41:26 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:41:26.421172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:26.422789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:26.439654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:26.440882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:26.443557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:26.445282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:26.447021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:26.448978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:26.849966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:26.863500 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dcb5d10e-6d22-4c30-851d-7bc45fb27199 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1532 microversion: 2.1 time: 0.618624 Oct 17 15:41:26.864213 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2157/4065] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:26 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1532 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:26.882128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:26.883306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:26.901334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:26.902290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:26.903027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:26.918107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:26.920494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:26.922436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:27.413838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:27.457263 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c2f81ea-4a72-4d2d-9b15-e8331044eae2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.051426 Oct 17 15:41:27.482651 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1909/4066] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:26 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:27.500497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:27.501553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:27.510906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:27.512544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:27.513487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:27.514976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:27.515713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:27.516436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:27.810817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:27.847644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:27.869206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:27.870566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bea477bd-3243-4ab6-be42-4c9589ff4352 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.993299 Oct 17 15:41:27.871518 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2158/4067] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:26 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:27.876964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d25ba059-80fa-4ec0-b775-42545866cf9b req-8b382399-fe68-4e73-a54b-0958603a0700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b793d7-d5e4-4688-9805-2d0997a9b2a1", "tag": "4d3a8932-7c9b-456c-afb4-5ea7006d3595"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:27.891891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d25ba059-80fa-4ec0-b775-42545866cf9b req-8b382399-fe68-4e73-a54b-0958603a0700 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:27.892380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d25ba059-80fa-4ec0-b775-42545866cf9b req-8b382399-fe68-4e73-a54b-0958603a0700 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:27.892817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d25ba059-80fa-4ec0-b775-42545866cf9b req-8b382399-fe68-4e73-a54b-0958603a0700 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:27.918487 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d25ba059-80fa-4ec0-b775-42545866cf9b req-8b382399-fe68-4e73-a54b-0958603a0700 service nova] Creating event network-changed:4d3a8932-7c9b-456c-afb4-5ea7006d3595 for instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 on n-h2-854441-12 Oct 17 15:41:27.929159 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d25ba059-80fa-4ec0-b775-42545866cf9b req-8b382399-fe68-4e73-a54b-0958603a0700 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056230 Oct 17 15:41:27.931203 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2159/4068] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:27.941854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:27.943340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:27.964429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:27.965007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:27.966174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:27.969244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:27.969926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:27.970555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:28.262700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387f9adba1644ae6ae01f4ee3f6ac217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d9e6586f1a439dbe028fbe0f7482d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:28.277364 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08aef497-0dd5-43d4-b543-3bc285c911ee tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 200 len: 1490 microversion: 2.1 time: 0.344735 Oct 17 15:41:28.290930 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2160/4069] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:27 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 1490 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:28.444674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:28.484295 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-96864c81-a105-4aff-8db2-e76ccee27db5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.992431 Oct 17 15:41:28.489962 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1910/4070] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:27 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:41:28.928374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:28.929044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:28.948216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:28.948728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:28.949179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:28.973125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:28.979185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:28.983864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:29.316457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:29.317702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] [instance: 88d95956-c27c-445f-b2e5-ad5d3716e82b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:29.364316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:29.370900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:29.372666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:29.382760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:29.389208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:29.394840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:29.501364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:29.506899 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] HTTP exception thrown: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Request method failure captured: Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b HTTP/1.1 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXdnikv1MDm6pW7BI8FdfHTGBfmMtZvtGTdpfJLLdE9MVd-l-Z1Mks0rtlEA6X3sumLX0eDZy9L07FVH-HSaMiOlyEORXTWnakwk2Q9_sMv5GB6I-yuM1iEelGbCGi2hD-oZbStZ-HGoRJWrzuKemg7r3diDXrAsp1-S9GyzD0z7uVk Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 32d9e6586f1a439dbe028fbe0f7482d7 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-691144806 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/32d9e6586f1a439dbe028fbe0f7482d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/32d9e6586f1a439dbe028fbe0f7482d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_32d9e6586f1a439dbe028fbe0f7482d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/32d9e6586f1a439dbe028fbe0f7482d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-691144806 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 32d9e6586f1a439dbe028fbe0f7482d7 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-691144806 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestMultiTenantJSON-691144806-project Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 387f9adba1644ae6ae01f4ee3f6ac217 Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-691144806-project Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '88d95956-c27c-445f-b2e5-ad5d3716e82b'} Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:29.513479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:29.519134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:41:29.519134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:29.519134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:41:29.519134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:41:29.519134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:41:29.519134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:41:29.519134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:41:29.519134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. Oct 17 15:41:29.519134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:41:29.528057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:29.533922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] Returning 404 to user: Instance 88d95956-c27c-445f-b2e5-ad5d3716e82b could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:41:29.535407 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f944efbc-1c4b-45d3-b4ad-781d656a3405 tempest-ServersNegativeTestMultiTenantJSON-691144806 tempest-ServersNegativeTestMultiTenantJSON-691144806-project] 10.222.0.87 "GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b" status: 404 len: 111 microversion: 2.1 time: 0.224237 Oct 17 15:41:29.536571 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1911/4071] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:29 2022] GET /compute/v2.1/servers/88d95956-c27c-445f-b2e5-ad5d3716e82b => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:41:29.542204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:29.601368 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c59cd00c-c7bc-4a19-8d5e-4a3bf5d322ea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.677178 Oct 17 15:41:29.602364 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2161/4072] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:28 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:29.973475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c9cee621-a009-4d02-9e35-b4dc952b149b req-7a6029e1-c552-40d0-8823-677bf18f9855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d95956-c27c-445f-b2e5-ad5d3716e82b", "name": "network-vif-deleted", "tag": "2544e67d-a2a1-44ef-ba17-120fb639433a"}, {"name": "network-changed", "server_uuid": "65b793d7-d5e4-4688-9805-2d0997a9b2a1", "tag": "4d3a8932-7c9b-456c-afb4-5ea7006d3595"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:30.021686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c9cee621-a009-4d02-9e35-b4dc952b149b req-7a6029e1-c552-40d0-8823-677bf18f9855 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:30.026241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c9cee621-a009-4d02-9e35-b4dc952b149b req-7a6029e1-c552-40d0-8823-677bf18f9855 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:30.028346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c9cee621-a009-4d02-9e35-b4dc952b149b req-7a6029e1-c552-40d0-8823-677bf18f9855 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:30.061483 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c9cee621-a009-4d02-9e35-b4dc952b149b req-7a6029e1-c552-40d0-8823-677bf18f9855 service nova] Creating event network-vif-deleted:2544e67d-a2a1-44ef-ba17-120fb639433a for instance 88d95956-c27c-445f-b2e5-ad5d3716e82b on n-h1-854441-12 Oct 17 15:41:30.063043 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c9cee621-a009-4d02-9e35-b4dc952b149b req-7a6029e1-c552-40d0-8823-677bf18f9855 service nova] Creating event network-changed:4d3a8932-7c9b-456c-afb4-5ea7006d3595 for instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 on n-h2-854441-12 Oct 17 15:41:30.093326 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c9cee621-a009-4d02-9e35-b4dc952b149b req-7a6029e1-c552-40d0-8823-677bf18f9855 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.125976 Oct 17 15:41:30.098619 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1912/4073] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:30.652823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:30.656666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:30.701688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:30.716067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:30.717208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:30.718537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:30.727874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:30.728650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:31.382858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:31.438195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:31.440075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:31.444415 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66bbdfd6-9142-4835-9706-8c7d36b76366 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.801648 Oct 17 15:41:31.464375 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2162/4074] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:30 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:32.500466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:32.518317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:32.550595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:32.553644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:32.554205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:32.562148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:32.563473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:32.567219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:33.251119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:33.277594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:33.289823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:33.297289 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b526bab2-6e26-4871-8424-34598a07c2ef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.823197 Oct 17 15:41:33.303489 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1913/4075] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:32 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:41:34.288580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-654789462", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "a684c817-264d-4123-854f-db472418ad76"}, {"uuid": "7dbbe338-7804-4447-9362-f8926071bcfc"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:34.358210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:34.359835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:34.378249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:34.380431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:34.387509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:34.389572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:34.390289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:34.391736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:34.914292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] validate_networks() for [('a684c817-264d-4123-854f-db472418ad76', None, None, None, None, None), ('7dbbe338-7804-4447-9362-f8926071bcfc', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:41:35.470158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:35.488734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:35.494577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:35.498193 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-981b90b4-bcce-497b-a74a-677c11419a10 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 1.145632 Oct 17 15:41:35.518730 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1914/4076] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:34 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:41:35.545997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f25df221-9900-467a-bc49-ac06b9e53951 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:35.551287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f25df221-9900-467a-bc49-ac06b9e53951 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:35.565978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f25df221-9900-467a-bc49-ac06b9e53951 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:35.571471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f25df221-9900-467a-bc49-ac06b9e53951 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:35.572866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f25df221-9900-467a-bc49-ac06b9e53951 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:35.575008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f25df221-9900-467a-bc49-ac06b9e53951 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:35.576500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f25df221-9900-467a-bc49-ac06b9e53951 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:35.577480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f25df221-9900-467a-bc49-ac06b9e53951 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:35.845611 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f25df221-9900-467a-bc49-ac06b9e53951 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.307998 Oct 17 15:41:35.848672 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1915/4077] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:41:35 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:41:35.877796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:35.879207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:35.909440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:35.916495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:35.917372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:35.918211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:35.918740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:35.920488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:35.968514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:36.396279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:36.410000 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1488fa56-7529-4253-9e91-6125bb564521 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1671 microversion: 2.1 time: 0.556258 Oct 17 15:41:36.413700 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1916/4078] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:35 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1671 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:36.536790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:36.538526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:36.550399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:36.564612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:36.567261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:36.569581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:36.570274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:36.571979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:38.114227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:38.128674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:38.130552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:38.135947 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61f17ca6-01ff-410f-9e1c-5ba335048100 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 1.604261 Oct 17 15:41:38.136669 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1917/4079] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:36 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:38.147117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:38.155009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:38.162171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:38.164951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:38.165579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:38.166427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:38.171112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:38.171713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:39.350405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:39.366745 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-010381c1-0e1a-4bd2-a9bd-3057e3f05ab0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1671 microversion: 2.1 time: 1.228854 Oct 17 15:41:39.385579 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1918/4080] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:38 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1671 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:39.405720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:39.409260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:39.460558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:39.461527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:39.462193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:39.463187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:39.464003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:39.464603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:40.023271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:41:40.024556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:41:40.025266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:41:40.025904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:41:40.026580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:41:40.028565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:40.059359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:40.072228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:40.072837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:40.076610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:40.081218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:40.082246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:40.082430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:40.101920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:40.112093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-25d00c9c-cbc7-4ae5-9306-69166e4d5e63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.718838 Oct 17 15:41:40.125061 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1919/4081] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:39 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:40.156644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Getting quotas for project 99b699ae886f4742a317cff0aa265510. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:41:40.184543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Getting quotas for user 3e9f8900f5164afdaf9deac86f6b4e28 and project 99b699ae886f4742a317cff0aa265510. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:41:40.244599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:41:40.249801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:41:40.402668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:40.411387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:40.464789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:40.470413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:40.476330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:40.479193 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bf3f3af-ffeb-4cb2-9d93-5e213f6505bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.196970 Oct 17 15:41:40.482087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:40.488375 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2163/4082] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 6207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:41:40.490824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:40.491776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:40.500117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97127d48-cc76-4132-a09a-af19d4547870 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:40.503651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-97127d48-cc76-4132-a09a-af19d4547870 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:41.028343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97127d48-cc76-4132-a09a-af19d4547870 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:41.041913 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97127d48-cc76-4132-a09a-af19d4547870 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1212 microversion: 2.1 time: 0.543421 Oct 17 15:41:41.047537 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2164/4083] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:40 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1212 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:41:41.141701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:41.142689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:41.150630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:41.157460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:41.158245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:41.160868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:41.161592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:41.165725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:41.175920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:42.141402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:42.158610 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3d8a3286-2351-4810-b8a2-b8dfbb2ecbb6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.763879 Oct 17 15:41:42.159276 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1920/4084] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:40 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:41:42.181471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3acf1625-9736-4484-aea3-c60b12ae5349 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:42.182131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3acf1625-9736-4484-aea3-c60b12ae5349 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:42.519369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3acf1625-9736-4484-aea3-c60b12ae5349 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:42.536640 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3acf1625-9736-4484-aea3-c60b12ae5349 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1212 microversion: 2.1 time: 0.376170 Oct 17 15:41:42.543909 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1921/4085] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:42 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1212 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:42.672977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:42.690356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:42.697049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:42.698463 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a36fb5d0-bcc6-48f9-8f1b-011d1563fb2a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 1.560930 Oct 17 15:41:42.712542 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2165/4086] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:41 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:43.586574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:43.587252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:43.614306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:43.615157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:43.617773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:43.645028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:43.646176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:43.655398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:43.735184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:43.736705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:43.747828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:43.761851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:43.788778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:43.788958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:43.789660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:43.790424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:43.791084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:43.953626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:43.976186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b288aa54-d569-4f19-a065-6d25206a82a9 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1264 microversion: 2.1 time: 0.393901 Oct 17 15:41:44.012174 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1922/4087] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:43 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1264 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:44.593412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:44.632314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:44.634366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:44.645794 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c41275ca-f1a1-4c41-8c76-17c0c31828ed tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1740 microversion: 2.20 time: 0.916759 Oct 17 15:41:44.646296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2166/4088] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:43 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1740 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:45.018677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:45.019466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:45.031769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:45.032639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:45.033302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:45.034428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:45.035043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:45.035647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:45.271604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:45.284165 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c8beb72-742c-49d8-a38e-73b78ad6664b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1270 microversion: 2.1 time: 0.270581 Oct 17 15:41:45.287087 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1923/4089] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:45 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1270 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:45.677899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:45.685398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:45.693604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:45.694463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:45.695314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:45.696265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:45.702219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:45.702932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:46.198757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:46.232127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:46.234610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:46.241637 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c8b29a1-11c3-4c9c-8821-2351d57fa50d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1722 microversion: 2.20 time: 0.567663 Oct 17 15:41:46.260796 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2167/4090] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:45 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1722 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:46.310939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:46.311781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:46.327973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:46.331813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:46.332571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:46.333343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:46.334024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:46.334698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:46.463848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:46.484502 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ac23aca1-270f-4f8a-894e-6a09e73531bd tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1270 microversion: 2.1 time: 0.177780 Oct 17 15:41:46.486018 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1924/4091] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:46 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:47.269480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:47.270289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:47.288845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:47.289794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:47.290530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:47.291562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:47.295335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:47.296213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:47.533968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:47.536855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:47.609340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=44 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:47.618019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:47.619702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:47.625108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:47.628428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:47.639781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:47.645394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:47.991386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:48.032640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:48.047934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:48.072089 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2712537-f6d3-4737-97b3-0477b92e3226 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1722 microversion: 2.20 time: 0.800872 Oct 17 15:41:48.074170 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2168/4092] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:47 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1722 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:49.112036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:49.116609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:49.162231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:49.171541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:49.172389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:49.173715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:49.185556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:49.191734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:49.483074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:49.523478 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bd2491f6-4b8e-4995-9804-956ab87acafa tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1312 microversion: 2.1 time: 1.997346 Oct 17 15:41:49.532889 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1925/4093] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:47 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1312 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:49.553870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-fb118698-83c8-4d11-8a58-a43095cd7a41 req-47b07612-eca4-4e17-8c70-07895bafce08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f53954-5109-4fb4-8634-490b9664c7d8", "name": "network-vif-unplugged", "status": "completed", "tag": "c4a74e76-9816-486b-854c-027fd5b61d05"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:49.640830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-fb118698-83c8-4d11-8a58-a43095cd7a41 req-47b07612-eca4-4e17-8c70-07895bafce08 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:49.643337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-fb118698-83c8-4d11-8a58-a43095cd7a41 req-47b07612-eca4-4e17-8c70-07895bafce08 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:49.644485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-fb118698-83c8-4d11-8a58-a43095cd7a41 req-47b07612-eca4-4e17-8c70-07895bafce08 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:49.691408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.compute.server_external_events [req-fb118698-83c8-4d11-8a58-a43095cd7a41 req-47b07612-eca4-4e17-8c70-07895bafce08 service nova] Unable to find a host for instance 45f53954-5109-4fb4-8634-490b9664c7d8. Dropping event network-vif-unplugged {{(pid=120407) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 15:41:49.693441 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-fb118698-83c8-4d11-8a58-a43095cd7a41 req-47b07612-eca4-4e17-8c70-07895bafce08 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.158695 Oct 17 15:41:49.697068 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1926/4094] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 162 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 15:41:49.775308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1081859041", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7a3fbd33-e7b4-4afe-8610-b5a61d4c2d6a"}], "security_groups": [{"name": "tempest-securitygroup--1192878405"}], "key_name": "tempest-keypair-24271739", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "0c6d0383-5cea-4075-b87a-e156aa5865a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:50.009106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:50.023913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:50.030686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:50.032667 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bca5c34f-a8e0-4a07-9802-323f27976556 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1665 microversion: 2.20 time: 0.933011 Oct 17 15:41:50.035289 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2169/4095] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:49 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1665 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:50.067951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3b04f12-ae9e-4081-ab42-411a42a0feb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c724e526-fe21-499f-ab90-bf5cceef7db0"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:50.071115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3b04f12-ae9e-4081-ab42-411a42a0feb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:50.084900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b04f12-ae9e-4081-ab42-411a42a0feb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:50.091813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b04f12-ae9e-4081-ab42-411a42a0feb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:50.092608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b04f12-ae9e-4081-ab42-411a42a0feb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:50.093805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b04f12-ae9e-4081-ab42-411a42a0feb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:50.094905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b04f12-ae9e-4081-ab42-411a42a0feb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:50.095564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3b04f12-ae9e-4081-ab42-411a42a0feb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:50.134255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:50.808721 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3b04f12-ae9e-4081-ab42-411a42a0feb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.744941 Oct 17 15:41:50.837186 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2170/4096] 10.222.0.87 () {62 vars in 1364 bytes} [Mon Oct 17 15:41:50 2022] POST /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 188 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:41:50.856878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:50.860198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:50.885659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:50.886778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:50.887532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:50.888874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:50.889614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:50.890295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:51.002323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] validate_networks() for [('7a3fbd33-e7b4-4afe-8610-b5a61d4c2d6a', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:41:51.034217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:52.178954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:52.195726 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-418f6c1d-0ef8-4ae0-91b2-de134f96af71 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 1.356834 Oct 17 15:41:52.197815 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2171/4097] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:50 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:52.215463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:52.226901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:52.259642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:52.260728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:52.261464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:52.262929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:52.264574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:52.265258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:52.384622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120406) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 15:41:52.526395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:41:52.572234 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a75a1a3-7727-4a65-b859-4ef771138ed5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/action" status: 202 len: 0 microversion: 2.20 time: 0.372367 Oct 17 15:41:52.576693 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2172/4098] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:41:52 2022] POST /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:41:52.589808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:52.596226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:52.612710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:52.613644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:52.614266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:52.615210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:52.619244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:52.619995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:52.701745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Getting quotas for project 5029749bd7ab4560a06f5f862a2ef22e. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:41:52.731427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Getting quotas for user abb79e124f6b4ac19bbc5ad9f86da68a and project 5029749bd7ab4560a06f5f862a2ef22e. Resources: dict_keys(['metadata_items']) {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:41:52.797384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:41:52.800122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:41:52.801589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:41:52.802845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:41:52.804219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:41:52.835362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:52.837040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:52.838337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:52.842352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:52.843909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:52.844928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:52.885085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Getting quotas for project 5029749bd7ab4560a06f5f862a2ef22e. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:41:52.898747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Getting quotas for user abb79e124f6b4ac19bbc5ad9f86da68a and project 5029749bd7ab4560a06f5f862a2ef22e. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:41:53.021771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:41:53.027633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c6d0383-5cea-4075-b87a-e156aa5865a4',volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:41:53.256193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:53.288031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:53.296969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:53.299431 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-809ee0f1-5678-48e5-9ebc-df8ffbaa1769 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1751 microversion: 2.20 time: 0.720828 Oct 17 15:41:53.300219 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2173/4099] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:52 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1751 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:53.322527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:53.323962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:53.340625 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [4fd6b0cd-3ada-40fc-bd24-4899c09ceebe] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 15:41:53.348256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:53.349169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:53.349882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:53.350949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:53.351800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:53.352520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:54.351243 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [4fd6b0cd-3ada-40fc-bd24-4899c09ceebe] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 49702. Oct 17 15:41:54.357781 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cca0f56c-2f50-4336-b5a2-6e7d33b55062 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.598968 Oct 17 15:41:54.359969 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1927/4100] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:41:49 2022] POST /compute/v2.1/servers => generated 407 bytes in 4604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:41:54.367458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:54.373507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:54.394415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:54.396728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:54.398610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:54.403185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:54.405192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:54.406423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:54.431925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:54.528331 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db4f76c7-cd95-4e74-8a0f-6e05bc720180 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 1.218355 Oct 17 15:41:54.541773 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2174/4101] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:53 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:54.589099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-614a7705-cf51-46e6-9ad0-c1f4b97d6757 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:54.595096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-614a7705-cf51-46e6-9ad0-c1f4b97d6757 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:54.766989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-614a7705-cf51-46e6-9ad0-c1f4b97d6757 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:54.780365 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-614a7705-cf51-46e6-9ad0-c1f4b97d6757 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1120 microversion: 2.1 time: 0.230860 Oct 17 15:41:54.782857 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2175/4102] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:54 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1120 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:54.793181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0c98ded3-bd4e-48e1-b147-b6b6f4bdf5d4 req-54a4c8dd-e419-4bcb-a84a-4d359282c0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f604cb7-a80f-465d-84d4-b82c2bb56e5b", "tag": "5bfbd6c8-6493-49c2-9572-209d2b4d28f2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:54.822576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c98ded3-bd4e-48e1-b147-b6b6f4bdf5d4 req-54a4c8dd-e419-4bcb-a84a-4d359282c0a8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:54.823072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c98ded3-bd4e-48e1-b147-b6b6f4bdf5d4 req-54a4c8dd-e419-4bcb-a84a-4d359282c0a8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:54.823521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c98ded3-bd4e-48e1-b147-b6b6f4bdf5d4 req-54a4c8dd-e419-4bcb-a84a-4d359282c0a8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:54.852581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0c98ded3-bd4e-48e1-b147-b6b6f4bdf5d4 req-54a4c8dd-e419-4bcb-a84a-4d359282c0a8 service nova] Creating event network-changed:5bfbd6c8-6493-49c2-9572-209d2b4d28f2 for instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b on n-h2-854441-12 Oct 17 15:41:54.870085 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0c98ded3-bd4e-48e1-b147-b6b6f4bdf5d4 req-54a4c8dd-e419-4bcb-a84a-4d359282c0a8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083569 Oct 17 15:41:54.887325 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2176/4103] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:41:55.218175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e9fedec-3be0-49f0-8ead-b67186e6a5ba tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Action: 'create', calling method: .version_select at 0x7f28bedba430>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:41:55.238657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:55.261181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:55.262736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:55.264028 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23d4deda-f3a6-4179-be4d-87e9814dbe0a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1751 microversion: 2.20 time: 0.902796 Oct 17 15:41:55.264656 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1928/4104] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:54 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1751 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:55.584464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:55.585594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:55.618143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:55.633888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:55.634899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:55.636154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:55.641439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:55.642282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:57.306896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:57.324361 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-53739e22-abeb-4b44-9134-35772e59f44b tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 1.746879 Oct 17 15:41:57.324720 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1929/4105] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:55 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:57.339324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:57.346469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:57.364304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:57.364834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:57.365306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:57.366132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:57.379194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:57.379845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:57.637802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:57.646949 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-34421090-9d67-42dc-b1c5-c4d6096d0c7f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1218 microversion: 2.1 time: 0.320978 Oct 17 15:41:57.669451 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1930/4106] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:57 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1218 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:41:57.676105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:57.677174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:57.684092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:57.685053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:57.685789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:57.686868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:57.687600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:57.688308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:58.550041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:58.570568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:58.579625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:41:58.587887 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a6928e2f-5092-4408-a428-064bab647af4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1753 microversion: 2.20 time: 0.916340 Oct 17 15:41:58.590830 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1931/4107] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:41:57 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1753 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:41:58.602178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:41:58.606332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:41:58.619619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:58.626642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:58.627514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:58.628579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:41:58.629351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:41:58.630027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:41:59.963982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:00.017069 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-86cdf6c8-185d-4f11-935d-997b5c2556f3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 1.424105 Oct 17 15:42:00.024443 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1932/4108] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:41:58 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:00.042446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-32acbbdf-ccd7-4dd8-876c-19e5a6d1d5fd req-c7190552-3c1b-4df4-a37a-4637faa89764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f604cb7-a80f-465d-84d4-b82c2bb56e5b", "tag": "ee8a9a0c-6aad-487a-9c27-7789c26e7baf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:00.099707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-32acbbdf-ccd7-4dd8-876c-19e5a6d1d5fd req-c7190552-3c1b-4df4-a37a-4637faa89764 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:00.100972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-32acbbdf-ccd7-4dd8-876c-19e5a6d1d5fd req-c7190552-3c1b-4df4-a37a-4637faa89764 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:00.102530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-32acbbdf-ccd7-4dd8-876c-19e5a6d1d5fd req-c7190552-3c1b-4df4-a37a-4637faa89764 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:00.151407 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-32acbbdf-ccd7-4dd8-876c-19e5a6d1d5fd req-c7190552-3c1b-4df4-a37a-4637faa89764 service nova] Creating event network-changed:ee8a9a0c-6aad-487a-9c27-7789c26e7baf for instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b on n-h2-854441-12 Oct 17 15:42:00.202182 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-32acbbdf-ccd7-4dd8-876c-19e5a6d1d5fd req-c7190552-3c1b-4df4-a37a-4637faa89764 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174339 Oct 17 15:42:00.209469 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1933/4109] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:00.223371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:00.245240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:00.272537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:00.290985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:00.298635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:00.300046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:00.300947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:00.310535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:00.541981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:00.574226 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9db6adbb-29ea-47a7-b9b5-c7060ef9a103 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1236 microversion: 2.1 time: 0.358615 Oct 17 15:42:00.598315 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1934/4110] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:00 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1236 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:00.782134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b82e32d-b636-47d4-ad33-3e54d2e38844 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'create', calling method: .version_select at 0x7f28bdf9f790>, body: {"keypair": {"name": "tempest-keypair-1633110792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo9a0e17qVxmhGUGZ+ymNdbkmn3YBdKWovs/nhOMPiaocyg25XMTyNBgZVKA1Ji9OOtDwLhWcblwOTlbEeONjHv+CW39NFoj/si23OW/i+P1LnKqEMxEoDQI6Ag2YB5Qg=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:00.852528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-0b82e32d-b636-47d4-ad33-3e54d2e38844 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Getting quotas for project fbc252cb98cc4704ac21c859ac75e121. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:42:00.880687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-0b82e32d-b636-47d4-ad33-3e54d2e38844 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Getting quotas for user b639ed781808456f97784cc215163549 and project fbc252cb98cc4704ac21c859ac75e121. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:42:00.978594 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b82e32d-b636-47d4-ad33-3e54d2e38844 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.366629 Oct 17 15:42:00.993414 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1935/4111] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:42:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:01.014996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:01.020989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:01.048627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:01.049888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:01.053810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:01.055902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:01.061135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:01.062324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:01.149485 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e9fedec-3be0-49f0-8ead-b67186e6a5ba tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.137543 Oct 17 15:42:01.162877 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2177/4112] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:41:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:42:01.175274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:01.177038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:01.189455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:01.190818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:01.191908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:01.193444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:01.194615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:01.195609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:02.838683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:02.884806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:02.889216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:02.894387 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dd250058-3354-4f77-a635-6115cb718ee5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1753 microversion: 2.20 time: 1.895751 Oct 17 15:42:02.916137 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1936/4113] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:00 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1753 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:02.940225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-badf9852-c3c0-43d0-bdea-7e8a45d05ec5 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Action: 'create', calling method: .version_select at 0x7f28bdf15430>, body: {"pool": null} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:02.963786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:03.095587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:03.135579 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-beae4521-f08f-4595-9610-eba0e11cf594 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 1.966813 Oct 17 15:42:03.148434 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2178/4114] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:01 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:03.148434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:03.148891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:03.164017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:03.164528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:03.167285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:03.168342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:03.169115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:03.173255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:04.024256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:04.095379 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-971a48f4-8320-4a59-88e9-1a4069583178 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1304 microversion: 2.1 time: 0.944852 Oct 17 15:42:04.095379 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2179/4115] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:03 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1304 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:04.120204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:04.125222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:04.152168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:04.155448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:04.159747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:04.161462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:04.165795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:04.167049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:04.669442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:04.672820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:04.687765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:04.694125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:04.707241 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5178fccd-41a2-4438-a4c3-117dcfd9f44f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1753 microversion: 2.20 time: 0.607959 Oct 17 15:42:04.723603 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2180/4116] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:04 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1753 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:04.739178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:04.752337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:04.765399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:04.779362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:04.780153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:04.781137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:04.781812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:04.782450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:04.783658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:06.036966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:06.052286 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-841b9d26-5ade-405e-a5e8-0f2e78a0fc85 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 1.322283 Oct 17 15:42:06.053085 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2181/4117] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:04 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:06.058312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:06.063583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:06.078649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:06.079649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:06.080345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:06.083860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:06.084719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:06.085398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:06.865313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:06.877414 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bdf7ad7b-7c4c-4db7-b1c9-6d801451055f tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1304 microversion: 2.1 time: 0.822931 Oct 17 15:42:06.914897 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2182/4118] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:06 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1304 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:06.923744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:06.924704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:06.938086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:06.944612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:06.945514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:06.948976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:06.952050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:06.952853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:07.570926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:07.582003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:07.589571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:07.597176 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bab9bcaf-b55b-4244-a04f-4bce90f34ded tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1753 microversion: 2.20 time: 0.679477 Oct 17 15:42:07.615510 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2183/4119] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:06 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1753 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:07.615510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-972acbeb-5061-4245-ace2-9b3f26f53ec0 req-67f1b0a5-5f60-41bb-9d44-8c9f799df783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "040161bd-ce7c-4d30-a3c7-6b3b44c8ef41", "tag": "be79e1b2-b725-483c-96a7-e0cc9aa52851"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:07.633163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-972acbeb-5061-4245-ace2-9b3f26f53ec0 req-67f1b0a5-5f60-41bb-9d44-8c9f799df783 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:07.638398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-972acbeb-5061-4245-ace2-9b3f26f53ec0 req-67f1b0a5-5f60-41bb-9d44-8c9f799df783 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:07.641062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-972acbeb-5061-4245-ace2-9b3f26f53ec0 req-67f1b0a5-5f60-41bb-9d44-8c9f799df783 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:07.688228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-972acbeb-5061-4245-ace2-9b3f26f53ec0 req-67f1b0a5-5f60-41bb-9d44-8c9f799df783 service nova] Creating event network-changed:be79e1b2-b725-483c-96a7-e0cc9aa52851 for instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 on n-h1-854441-12 Oct 17 15:42:07.720403 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-972acbeb-5061-4245-ace2-9b3f26f53ec0 req-67f1b0a5-5f60-41bb-9d44-8c9f799df783 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120092 Oct 17 15:42:07.734682 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2184/4120] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:07.765650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:07.768493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:07.795734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:07.796277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:07.798872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:07.800135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:07.804015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:07.808284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:08.812643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:08.822022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec3f9be4-0f7d-4dcd-bfc6-540483a19070 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 1.085216 Oct 17 15:42:08.850385 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2185/4121] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:07 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:08.856127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:08.857174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:08.875593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:08.876506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:08.877202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:08.878242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:08.879104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:08.879780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:09.284526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:09.293075 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-953288e5-1a1b-4b1b-bf3b-603cefd8d4ee tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1304 microversion: 2.1 time: 0.440990 Oct 17 15:42:09.299092 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2186/4122] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:08 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1304 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:09.308827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:09.315311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:09.331501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:09.332203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:09.332752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:09.333620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:09.334351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:09.335089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:09.733807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:09.747223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:09.749452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:09.751240 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4996cb23-bfeb-4900-b9ce-db37d7b1c1eb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1753 microversion: 2.20 time: 0.450808 Oct 17 15:42:09.753081 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2187/4123] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:09 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1753 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:09.760042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-842504942", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21e95d6d-87e4-405c-8d39-8206205c7371"}], "security_groups": [{"name": "tempest-securitygroup--894199106"}], "key_name": "tempest-keypair-1633110792", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:09.978550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] validate_networks() for [('21e95d6d-87e4-405c-8d39-8206205c7371', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:42:10.582765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:42:10.583599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:42:10.584304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:42:10.584932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:42:10.585554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:42:10.597305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:10.597867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:10.598693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:10.599676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:10.600619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:10.601449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:10.646366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Getting quotas for project fbc252cb98cc4704ac21c859ac75e121. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:42:10.654613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Getting quotas for user b639ed781808456f97784cc215163549 and project fbc252cb98cc4704ac21c859ac75e121. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:42:10.695197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:42:10.698486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:42:10.790521 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6665e21c-7422-4fb2-8459-67911706a00d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.035674 Oct 17 15:42:10.798540 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2188/4124] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:42:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:42:10.807893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:10.809308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:10.820296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:10.821578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:10.822363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:10.823337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:10.823972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:10.824664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:10.922601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=14 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:10.991407 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-badf9852-c3c0-43d0-bdea-7e8a45d05ec5 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.073544 Oct 17 15:42:11.001621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1937/4125] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:42:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:11.007887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:11.008729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:11.038707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:11.039965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:11.040599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:11.042048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:11.042535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:11.042997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:11.046277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:11.306575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:11.326276 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a0fbcf0-babf-4f8b-91fe-f6b6f9cef0c8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1304 microversion: 2.1 time: 0.321094 Oct 17 15:42:11.328437 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1938/4126] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:11 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1304 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:11.336287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:11.337789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:11.345953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:11.347688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:11.348468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:11.350872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:11.351730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:11.352726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:11.374293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:11.404456 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33eb9250-7612-4975-8ee8-69300ee68463 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 0.602121 Oct 17 15:42:11.407331 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2189/4127] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:10 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:11.429102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d09d645a-8bb6-4a40-9f27-f351fb213fdd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:11.431607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d09d645a-8bb6-4a40-9f27-f351fb213fdd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:11.540966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d09d645a-8bb6-4a40-9f27-f351fb213fdd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:11.557646 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d09d645a-8bb6-4a40-9f27-f351fb213fdd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1237 microversion: 2.1 time: 0.147543 Oct 17 15:42:11.559807 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2190/4128] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:11 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1237 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:11.574251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b097b670-fef8-45ca-9d00-f77935b9ffc6 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Action: 'create', calling method: .version_select at 0x7f28be0faca0>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:11.772324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:11.791380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:11.795290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:11.797664 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e2851c7d-3612-42f6-a2d5-14236ed0f048 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1753 microversion: 2.20 time: 0.467052 Oct 17 15:42:11.799736 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1939/4129] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:11 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1753 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:11.810600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c39d8e5f-dea5-4e72-a1d5-1c68f02c24cf req-dc2bd54e-fa15-482f-926a-75b985e0e6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f604cb7-a80f-465d-84d4-b82c2bb56e5b", "name": "network-vif-plugged", "status": "completed", "tag": "5bfbd6c8-6493-49c2-9572-209d2b4d28f2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:11.832364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c39d8e5f-dea5-4e72-a1d5-1c68f02c24cf req-dc2bd54e-fa15-482f-926a-75b985e0e6da service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:11.833790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c39d8e5f-dea5-4e72-a1d5-1c68f02c24cf req-dc2bd54e-fa15-482f-926a-75b985e0e6da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:11.834638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c39d8e5f-dea5-4e72-a1d5-1c68f02c24cf req-dc2bd54e-fa15-482f-926a-75b985e0e6da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:11.861002 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c39d8e5f-dea5-4e72-a1d5-1c68f02c24cf req-dc2bd54e-fa15-482f-926a-75b985e0e6da service nova] Creating event network-vif-plugged:5bfbd6c8-6493-49c2-9572-209d2b4d28f2 for instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b on n-h2-854441-12 Oct 17 15:42:11.869810 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c39d8e5f-dea5-4e72-a1d5-1c68f02c24cf req-dc2bd54e-fa15-482f-926a-75b985e0e6da service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067206 Oct 17 15:42:11.877265 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1940/4130] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:12.356660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:12.362172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:12.371990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:12.372752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:12.373541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:12.374476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:12.375164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:12.375771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:13.244710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:13.257006 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2f8ae2a4-7a3f-4e1d-8e18-c3d42613195a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1304 microversion: 2.1 time: 0.905570 Oct 17 15:42:13.260352 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1941/4131] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:12 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1304 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:42:13.275916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:13.278307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:13.299283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:13.300428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:13.301129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:13.304269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:13.305036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:13.307902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:13.683514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:13.724096 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-86ca0e1e-dc0a-44e9-9086-4154bd0f5be0 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 0.462110 Oct 17 15:42:13.727506 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1942/4132] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:13 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:13.741546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:13.742401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:13.755665 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b097b670-fef8-45ca-9d00-f77935b9ffc6 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.192942 Oct 17 15:42:13.767860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2191/4133] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:42:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:13.774990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:13.775934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:13.776933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:13.782125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:13.785573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:13.786596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:13.789223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:13.790635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:13.834555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:13.836342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:13.840944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:13.843030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:13.847352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:13.848592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:13.959356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:13.976251 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2243ef8c-798f-4cd5-aaad-db56d12eaa1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1295 microversion: 2.1 time: 0.242311 Oct 17 15:42:13.976921 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1943/4134] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:13 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1295 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:13.990324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:13.990850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:14.018938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:14.020018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:14.020934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:14.033367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:14.034699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:14.040591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:14.308049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lazy-loading 'services' on Instance uuid 65b793d7-d5e4-4688-9805-2d0997a9b2a1 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:42:14.448324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:14.474873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:14.474873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:14.474873 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e04f1695-ea84-456a-ac4b-d11b7f2b59ce tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.698760 Oct 17 15:42:14.474873 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2192/4135] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:13 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:14.506220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-beff6123-f66f-4f8a-99a9-2a5452bae183 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Action: 'create', calling method: .version_select at 0x7f28be99c940>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:14.523197 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23b45110-7bb7-415f-be56-92e4e8d30b53 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "DELETE /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments/c7c9f16d-e5d5-4aa6-90ba-64c83bafcc97" status: 202 len: 0 microversion: 2.1 time: 0.541154 Oct 17 15:42:14.532395 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1944/4136] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:42:13 2022] DELETE /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments/c7c9f16d-e5d5-4aa6-90ba-64c83bafcc97 => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:42:14.556763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-513d7f3d-3424-4637-804e-2d279cca744b req-2cd679fe-dfaa-4732-8d79-60a7570534f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f604cb7-a80f-465d-84d4-b82c2bb56e5b", "name": "network-vif-plugged", "status": "completed", "tag": "ee8a9a0c-6aad-487a-9c27-7789c26e7baf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:14.620068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-513d7f3d-3424-4637-804e-2d279cca744b req-2cd679fe-dfaa-4732-8d79-60a7570534f0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:14.623200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-513d7f3d-3424-4637-804e-2d279cca744b req-2cd679fe-dfaa-4732-8d79-60a7570534f0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:14.624863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-513d7f3d-3424-4637-804e-2d279cca744b req-2cd679fe-dfaa-4732-8d79-60a7570534f0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:14.666240 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-513d7f3d-3424-4637-804e-2d279cca744b req-2cd679fe-dfaa-4732-8d79-60a7570534f0 service nova] Creating event network-vif-plugged:ee8a9a0c-6aad-487a-9c27-7789c26e7baf for instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b on n-h2-854441-12 Oct 17 15:42:14.691506 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-513d7f3d-3424-4637-804e-2d279cca744b req-2cd679fe-dfaa-4732-8d79-60a7570534f0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159455 Oct 17 15:42:14.692524 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1945/4137] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:14.709320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:14.717450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:14.732461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:14.732982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:14.733551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:14.734138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:14.747288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:14.751449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:15.372229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:15.386864 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf94772f-cb69-44e2-a403-971a7799cb24 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.692617 Oct 17 15:42:15.404511 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1946/4138] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:14 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:15.432852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:15.434433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:15.449548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:15.462835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:15.463652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:15.465125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:15.466030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:15.466844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:16.215376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:16.237536 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f1c3a35b-471f-4a11-81e7-ac45abfe8980 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1304 microversion: 2.1 time: 0.830571 Oct 17 15:42:16.256005 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1947/4139] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:15 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1304 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:16.284286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-343600c9-4b64-445a-a1f5-5be8dc0eec45 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:16.290916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-343600c9-4b64-445a-a1f5-5be8dc0eec45 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:16.306084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343600c9-4b64-445a-a1f5-5be8dc0eec45 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:16.307411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343600c9-4b64-445a-a1f5-5be8dc0eec45 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:16.308523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343600c9-4b64-445a-a1f5-5be8dc0eec45 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:16.310278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343600c9-4b64-445a-a1f5-5be8dc0eec45 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:16.311620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343600c9-4b64-445a-a1f5-5be8dc0eec45 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:16.312997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343600c9-4b64-445a-a1f5-5be8dc0eec45 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:16.388360 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-343600c9-4b64-445a-a1f5-5be8dc0eec45 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128836 Oct 17 15:42:16.389851 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1948/4140] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:42:16 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:16.403334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:16.410286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:16.430599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:16.433545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:16.434427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:16.435935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:16.436891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:16.437662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:17.017141 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-beff6123-f66f-4f8a-99a9-2a5452bae183 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.541417 Oct 17 15:42:17.018370 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2193/4141] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:42:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:17.173211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0feadc1-5acb-4d92-b723-b4bae9385ce1 tempest-ComputeTenantNetworksTest-1722894241 tempest-ComputeTenantNetworksTest-1722894241-project] Calling method '.version_select at 0x7f28be99ca60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:17.419737 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0feadc1-5acb-4d92-b723-b4bae9385ce1 tempest-ComputeTenantNetworksTest-1722894241 tempest-ComputeTenantNetworksTest-1722894241-project] 10.222.0.87 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 306 microversion: 2.1 time: 0.399614 Oct 17 15:42:17.421146 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2194/4142] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 15:42:17 2022] GET /compute/v2.1/os-tenant-networks => generated 306 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:17.432699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:17.434174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:17.437743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:17.449310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:17.450543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:17.451518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:17.452314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:17.454067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:17.455185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:17.456166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:17.464304 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-caa125ec-be92-4f13-8ad9-9f018948be88 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1333 microversion: 2.1 time: 1.072131 Oct 17 15:42:17.473261 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1949/4143] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:16 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1333 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:17.487920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:17.490186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:17.505482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:17.506945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:17.508716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:17.511308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:17.512505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:17.513585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:17.653374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:17.663130 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-beb64684-dea9-44ff-9f2c-0e4350640dd0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1362 microversion: 2.1 time: 0.238737 Oct 17 15:42:17.663738 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2195/4144] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:17 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:17.669490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:17.670562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:17.681041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:17.681659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:17.682184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:17.683016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:17.683575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:17.684149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:17.909954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:17.927216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:17.930243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:17.932625 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-346a8394-c988-45f3-a24e-55a8de849b33 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.267286 Oct 17 15:42:17.933752 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2196/4145] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:17 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:17.946319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc8a491a-3725-4f70-a5f3-162fd1eb3c9b tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Calling method '.version_select at 0x7f28be993670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:18.075126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:18.095729 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d4c9929e-2d34-41b0-8b1a-422b5f70eb28 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.615042 Oct 17 15:42:18.097207 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1950/4146] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:17 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:18.107067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:18.108576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:18.120235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:18.126144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:18.128185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:18.129696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:18.131934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:18.133061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:18.134098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:18.341570 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc8a491a-3725-4f70-a5f3-162fd1eb3c9b tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "GET /compute/v2.1/os-floating-ips/7a055b2d-8188-43ea-9a4f-c18f80eef2b8" status: 200 len: 142 microversion: 2.1 time: 0.405555 Oct 17 15:42:18.356547 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2197/4147] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 15:42:17 2022] GET /compute/v2.1/os-floating-ips/7a055b2d-8188-43ea-9a4f-c18f80eef2b8 => generated 142 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:18.356547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ff26175-0dd3-449b-96cf-740dfc491b2b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:18.359001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ff26175-0dd3-449b-96cf-740dfc491b2b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:18.373438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff26175-0dd3-449b-96cf-740dfc491b2b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:18.374602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff26175-0dd3-449b-96cf-740dfc491b2b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:18.375510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff26175-0dd3-449b-96cf-740dfc491b2b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:18.376993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff26175-0dd3-449b-96cf-740dfc491b2b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:18.378018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff26175-0dd3-449b-96cf-740dfc491b2b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:18.379205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff26175-0dd3-449b-96cf-740dfc491b2b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:18.440210 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ff26175-0dd3-449b-96cf-740dfc491b2b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094900 Oct 17 15:42:18.441056 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2198/4148] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:42:18 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:18.450915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a24cf73-d3d4-47fa-8e8d-e2d5749785d4 tempest-ComputeTenantNetworksTest-1722894241 tempest-ComputeTenantNetworksTest-1722894241-project] Calling method '.version_select at 0x7f28beb53b80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:18.599620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:18.610877 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4546442e-e13e-4477-9c5d-426d2fdf860d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1292 microversion: 2.1 time: 0.511624 Oct 17 15:42:18.611872 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1951/4149] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:18 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1292 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:18.617114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:18.618068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:18.636010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:18.637096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:18.637574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:18.638458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:18.638989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:18.639418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:19.003151 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a24cf73-d3d4-47fa-8e8d-e2d5749785d4 tempest-ComputeTenantNetworksTest-1722894241 tempest-ComputeTenantNetworksTest-1722894241-project] 10.222.0.87 "GET /compute/v2.1/os-tenant-networks/0ebb40cf-07f2-4526-bd45-c925450f36fb" status: 200 len: 137 microversion: 2.1 time: 0.560280 Oct 17 15:42:19.003752 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2199/4150] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 15:42:18 2022] GET /compute/v2.1/os-tenant-networks/0ebb40cf-07f2-4526-bd45-c925450f36fb => generated 137 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:19.016595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0997d474-ea5a-4845-a371-544067a8c6d6 req-4e146a0b-1849-4173-8ccc-69ccd1a51449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f53954-5109-4fb4-8634-490b9664c7d8", "tag": "c4a74e76-9816-486b-854c-027fd5b61d05"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:19.051621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0997d474-ea5a-4845-a371-544067a8c6d6 req-4e146a0b-1849-4173-8ccc-69ccd1a51449 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:19.052893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0997d474-ea5a-4845-a371-544067a8c6d6 req-4e146a0b-1849-4173-8ccc-69ccd1a51449 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:19.053625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0997d474-ea5a-4845-a371-544067a8c6d6 req-4e146a0b-1849-4173-8ccc-69ccd1a51449 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:19.075174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:19.075608 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0997d474-ea5a-4845-a371-544067a8c6d6 req-4e146a0b-1849-4173-8ccc-69ccd1a51449 service nova] Creating event network-changed:c4a74e76-9816-486b-854c-027fd5b61d05 for instance 45f53954-5109-4fb4-8634-490b9664c7d8 on n-h1-854441-12 Oct 17 15:42:19.094437 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0997d474-ea5a-4845-a371-544067a8c6d6 req-4e146a0b-1849-4173-8ccc-69ccd1a51449 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089107 Oct 17 15:42:19.095698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2200/4151] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:19.101487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4ad78ce-0801-47c5-adf2-94e4d8776f75 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Calling method '.version_select at 0x7f28becdc820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:19.114815 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b236a32f-f0b9-40fb-b6f3-40732e676a07 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.496971 Oct 17 15:42:19.116622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1952/4152] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:18 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:19.135655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:19.137045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:19.147146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:19.147435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:19.148038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:19.149006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:19.149993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:19.150488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:19.882762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:19.906100 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f9baef63-9b02-41dd-b558-1488e74b31cb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1669 microversion: 2.1 time: 0.787630 Oct 17 15:42:19.910447 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1953/4153] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:19 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1669 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:19.928174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:19.929360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:19.968909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:19.969678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:19.970460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:19.972020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:19.974059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:19.975719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:20.552047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:20.595771 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-98458891-e289-44f6-817a-320a65b2e1fc tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1362 microversion: 2.1 time: 0.676311 Oct 17 15:42:20.621682 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1954/4154] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:19 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1362 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:20.627050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:20.644823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:20.646873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:20.661131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:20.662541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:20.663826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:20.666607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:20.668049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:20.669178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:20.704788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:20.708422 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4ad78ce-0801-47c5-adf2-94e4d8776f75 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/7a055b2d-8188-43ea-9a4f-c18f80eef2b8" status: 202 len: 0 microversion: 2.1 time: 1.610820 Oct 17 15:42:20.709639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2201/4155] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:42:19 2022] DELETE /compute/v2.1/os-floating-ips/7a055b2d-8188-43ea-9a4f-c18f80eef2b8 => generated 0 bytes in 1613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:42:20.723412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:20.726308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:20.746118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:20.747541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:20.750225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:20.752062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:20.753376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:20.754356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:21.110765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:21.149262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:21.161250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:21.164408 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-65f99a98-b2bf-4fb0-96d5-7df7840ab6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.538769 Oct 17 15:42:21.166011 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1955/4156] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:20 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:21.183900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd28f689-8f1f-46d7-9815-b33c08ef1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:21.194911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cd28f689-8f1f-46d7-9815-b33c08ef1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:21.218689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd28f689-8f1f-46d7-9815-b33c08ef1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:21.223321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd28f689-8f1f-46d7-9815-b33c08ef1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:21.230796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:21.237448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd28f689-8f1f-46d7-9815-b33c08ef1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:21.248016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd28f689-8f1f-46d7-9815-b33c08ef1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:21.252632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd28f689-8f1f-46d7-9815-b33c08ef1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:21.254562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd28f689-8f1f-46d7-9815-b33c08ef1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:21.273836 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9db0cee4-a741-40bf-80c0-c02f573f67c7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.561576 Oct 17 15:42:21.279463 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2202/4157] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:20 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:21.312630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:21.314193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:21.355235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:21.366613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:21.367987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:21.369626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:21.370649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:21.378104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:21.448694 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd28f689-8f1f-46d7-9815-b33c08ef1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.280162 Oct 17 15:42:21.451462 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1956/4158] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:42:21 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments => generated 197 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:21.472091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d2ebb8f-6684-4f0a-b3be-8709a866878d tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:21.474782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d2ebb8f-6684-4f0a-b3be-8709a866878d tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:21.502944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2ebb8f-6684-4f0a-b3be-8709a866878d tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:21.507163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2ebb8f-6684-4f0a-b3be-8709a866878d tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:21.510275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2ebb8f-6684-4f0a-b3be-8709a866878d tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:21.512684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2ebb8f-6684-4f0a-b3be-8709a866878d tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:21.514780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2ebb8f-6684-4f0a-b3be-8709a866878d tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:21.515816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2ebb8f-6684-4f0a-b3be-8709a866878d tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:21.558293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:21.685492 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5d2ebb8f-6684-4f0a-b3be-8709a866878d tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b/ips" status: 200 len: 180 microversion: 2.1 time: 0.230096 Oct 17 15:42:21.693423 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1957/4159] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:42:21 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b/ips => generated 180 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:21.711351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7b2f699b-cdb8-4a98-a35e-5f95085011c8 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Calling method '.version_select at 0x7f28c2f630d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:22.059716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:22.095186 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-22eff9d4-1555-412a-82b5-f04a31e49209 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1292 microversion: 2.1 time: 0.811398 Oct 17 15:42:22.096017 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2203/4160] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:21 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1292 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:22.118835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-93da651d-bd46-4fda-a484-73cb51a79d5c req-fab2944d-b7b9-49d3-a6b8-848224d62e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287b7782-35f5-4a0a-ac6e-d803d65080d1", "tag": "0c32b16d-ee61-452d-aa91-9b4ed41d397e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:22.153051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-93da651d-bd46-4fda-a484-73cb51a79d5c req-fab2944d-b7b9-49d3-a6b8-848224d62e55 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:22.156778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-93da651d-bd46-4fda-a484-73cb51a79d5c req-fab2944d-b7b9-49d3-a6b8-848224d62e55 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:22.157350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-93da651d-bd46-4fda-a484-73cb51a79d5c req-fab2944d-b7b9-49d3-a6b8-848224d62e55 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:22.202535 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-93da651d-bd46-4fda-a484-73cb51a79d5c req-fab2944d-b7b9-49d3-a6b8-848224d62e55 service nova] Creating event network-changed:0c32b16d-ee61-452d-aa91-9b4ed41d397e for instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 on n-h2-854441-12 Oct 17 15:42:22.220873 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-93da651d-bd46-4fda-a484-73cb51a79d5c req-fab2944d-b7b9-49d3-a6b8-848224d62e55 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121908 Oct 17 15:42:22.222777 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2204/4161] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:22.235391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-884397121", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "dd932f3b-36f3-4be3-9d4c-cbbd034c0114"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:22.319252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] validate_networks() for [('dd932f3b-36f3-4be3-9d4c-cbbd034c0114', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:42:22.611313 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7b2f699b-cdb8-4a98-a35e-5f95085011c8 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.915652 Oct 17 15:42:22.612743 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1958/4162] 10.222.0.87 () {58 vars in 1164 bytes} [Mon Oct 17 15:42:21 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:42:22.623646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:22.624691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:22.642665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:22.645536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:22.648673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:22.649920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:22.650616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:22.654264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.164462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:42:23.165623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:42:23.166308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:42:23.167422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:42:23.168378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:42:23.186325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.187251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.188388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.189661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:23.190376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.192716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.193668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.208908 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f5ca92c1-042a-4ba5-857a-ff5abdb69b8a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1362 microversion: 2.1 time: 0.594560 Oct 17 15:42:23.209924 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1959/4163] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:22 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:23.217802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:42:23.227309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:23.228097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:23.229533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for user 15cc78a142a148398dc438b5ff2a25e9 and project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:42:23.238951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.239730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.240427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.241421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.242128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.242829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.280251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:42:23.299463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:42:23.301659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:42:23.462420 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07655181-a476-4c8d-b75b-e7ed0cacec27 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235645 Oct 17 15:42:23.465467 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2205/4164] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:42:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:42:23.479467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:23.481528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:23.506123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.511122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.514476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.517169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.519264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.524861 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-08702cd7-6d17-47d9-8721-557c96b86404 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 204 len: 0 microversion: 2.1 time: 0.312916 Oct 17 15:42:23.526661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.531991 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1960/4165] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:42:23 2022] DELETE /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:42:23.608324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8e99b6d0-4164-4dbf-aa20-1a5ae8215feb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:23.621786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8e99b6d0-4164-4dbf-aa20-1a5ae8215feb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:23.649277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e99b6d0-4164-4dbf-aa20-1a5ae8215feb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.650073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e99b6d0-4164-4dbf-aa20-1a5ae8215feb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.659108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e99b6d0-4164-4dbf-aa20-1a5ae8215feb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.660518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e99b6d0-4164-4dbf-aa20-1a5ae8215feb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.661933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e99b6d0-4164-4dbf-aa20-1a5ae8215feb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.662729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e99b6d0-4164-4dbf-aa20-1a5ae8215feb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.767852 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8e99b6d0-4164-4dbf-aa20-1a5ae8215feb tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.228896 Oct 17 15:42:23.773992 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1961/4166] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:42:23 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1/os-volume_attachments => generated 25 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:42:23.794897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc16cf8f-0636-4da8-b0e0-36e48fdf0725 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Calling method '.version_select at 0x7f28bdf19f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:23.818441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:23.874103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:23.878286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:23.879818 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f22605c-07ef-474b-a596-5d0c3682bedf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.411491 Oct 17 15:42:23.886129 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2206/4167] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:23 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:23.920410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:23.921387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:23.937892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.938575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.941280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:23.942212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:23.945340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:23.946887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:24.305751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:24.309925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:24.342898 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ea050f0-0799-40af-afe4-57dc591cb435 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1292 microversion: 2.1 time: 0.452264 Oct 17 15:42:24.349535 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2207/4168] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:23 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1292 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:24.369136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb284757-1987-4c3b-8635-d1e00635d7fb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:24.373416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb284757-1987-4c3b-8635-d1e00635d7fb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:24.562612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb284757-1987-4c3b-8635-d1e00635d7fb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:24.589064 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb284757-1987-4c3b-8635-d1e00635d7fb tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1214 microversion: 2.1 time: 0.234303 Oct 17 15:42:24.591533 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2208/4169] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:24 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:24.603024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:24.605144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:24.626412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:24.628081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:24.654486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:24.662786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:24.665385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:24.667067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:25.225124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:25.253266 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-597b203e-15c4-48c3-a8d5-2ccfbf18a605 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1675 microversion: 2.1 time: 0.659561 Oct 17 15:42:25.274039 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2209/4170] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:24 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1675 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:25.283212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:25.307809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:25.345239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:25.355479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:25.355958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:25.356729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:25.357205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:25.363341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:25.470827 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] HTTP exception thrown: Cannot 'reboot' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Request method failure captured: Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982/action HTTP/1.1 Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 28 Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXZ8kmtUPZWb3G0RLc0tH4XVjR5C-7gTVa04Om70uUY0S3ObDBITuVYe9LE38K5_JYHog2FWX-dPJIO8BZMjXqs1lpG_ioDhvbA748hUDdgAKK6oZjLCKHY9A2JeDwuSv8UPAoiN-E1QRQdYcKH6OumXVNNcIN16WkTnV4IzILKrXLw Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ea396576a90246cb8b821cb2afec9170 Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: {"reboot": {"type": "HARD"}} Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'reboot' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '52f0fd6d-17f3-412d-9bb7-b40d8272d982', 'body': {'reboot': {'type': 'HARD'}}} Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:42:25.474011 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued Oct 17 15:42:25.479287 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:25.481474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Returning 409 to user: Cannot 'reboot' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:42:25.484061 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15bb89f5-0636-404e-88b1-99e5f0543093 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982/action" status: 409 len: 145 microversion: 2.1 time: 0.208601 Oct 17 15:42:25.494995 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2210/4171] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:42:25 2022] POST /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982/action => generated 145 bytes in 220 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:42:25.507704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:25.511645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:25.539835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:25.543709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:25.544860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:25.568121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:25.577903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:25.592665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:25.635886 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc16cf8f-0636-4da8-b0e0-36e48fdf0725 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 1.859422 Oct 17 15:42:25.637183 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1962/4172] 10.222.0.87 () {58 vars in 1149 bytes} [Mon Oct 17 15:42:23 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:25.660633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:25.661961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:25.683770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:25.684472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:25.685164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:25.686108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:25.686867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:25.687548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:26.009517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:26.041973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:26.045353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:26.057301 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1eace37f-655c-4f92-8f97-c936b6bc7689 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.417397 Oct 17 15:42:26.077389 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1963/4173] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:25 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:26.113218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:26.114555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:26.145163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:26.146034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:26.161405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:26.161405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:26.161405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:26.161405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:26.384239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:26.406290 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5f0104a-ee79-4ee3-b5a9-c2b92873349b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1362 microversion: 2.1 time: 0.909698 Oct 17 15:42:26.423807 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2211/4174] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:25 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1362 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:26.440809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:26.444398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:26.458113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:26.467665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:26.468668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:26.471193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:26.475165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:26.475934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:26.642881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:26.663097 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] HTTP exception thrown: Cannot 'rebuild' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Request method failure captured: Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982/action HTTP/1.1 Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 65 Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXZ8kmtUPZWb3G0RLc0tH4XVjR5C-7gTVa04Om70uUY0S3ObDBITuVYe9LE38K5_JYHog2FWX-dPJIO8BZMjXqs1lpG_ioDhvbA748hUDdgAKK6oZjLCKHY9A2JeDwuSv8UPAoiN-E1QRQdYcKH6OumXVNNcIN16WkTnV4IzILKrXLw Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ea396576a90246cb8b821cb2afec9170 Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'rebuild' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '52f0fd6d-17f3-412d-9bb7-b40d8272d982', 'body': {'rebuild': {'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d'}}} Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:42:26.676402 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:26.681039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Returning 409 to user: Cannot 'rebuild' instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 while it is in vm_state rescued {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:42:26.684298 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-86ff7d15-c0ac-4578-9369-c696c36d7a43 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1292 microversion: 2.1 time: 0.575365 Oct 17 15:42:26.684298 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1964/4175] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:26 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1292 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:26.693283 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-993d46d8-1687-4719-b7c0-988c69e7d24f tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "POST /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982/action" status: 409 len: 146 microversion: 2.1 time: 0.256423 Oct 17 15:42:26.694723 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2212/4176] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:42:26 2022] POST /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982/action => generated 146 bytes in 270 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:42:26.717425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:26.717784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4adcc75-60d3-406d-acfc-f4a4e5827a34 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Calling method '.version_select at 0x7f28bedb99d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:26.720869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:26.761312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:26.763107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:26.764166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:26.765973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:26.767303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:26.768423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:27.070242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:27.099501 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92e9fce3-d561-4c5d-bcfc-31ca72c64f26 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1266 microversion: 2.1 time: 0.401483 Oct 17 15:42:27.106039 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1965/4177] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:26 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:27.125420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:27.133500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:27.164488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:27.169399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:27.172002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:27.173532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:27.180773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:27.183329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:27.602601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:27.611702 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a2f8499f-ba15-4204-a6a7-61d2a0a80d66 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1675 microversion: 2.1 time: 0.503890 Oct 17 15:42:27.614077 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1966/4178] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:27 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1675 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:27.640771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:27.641288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:27.660091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:27.660768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:27.661089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:27.661841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:27.667051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:27.667600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:27.720968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:42:27.925861 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-32915718-e15e-41d2-8baf-03d4031f1a44 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "DELETE /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 204 len: 0 microversion: 2.1 time: 0.304709 Oct 17 15:42:27.929663 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1967/4179] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:42:27 2022] DELETE /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:42:27.937370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:27.938423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:27.946921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:27.947571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:27.948136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:27.949456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:27.950135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:27.950994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:29.150978 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4adcc75-60d3-406d-acfc-f4a4e5827a34 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/5bddbc77-9e0c-44e2-9a18-7a3daa47bfa2" status: 202 len: 0 microversion: 2.1 time: 2.452864 Oct 17 15:42:29.152938 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2213/4180] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:42:26 2022] DELETE /compute/v2.1/os-floating-ips/5bddbc77-9e0c-44e2-9a18-7a3daa47bfa2 => generated 0 bytes in 2457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:42:29.159276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-848ec445-dbc8-44e3-a732-9cb089d49dd8 req-d61cf321-5a72-4f25-a761-e36934bc8de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f604cb7-a80f-465d-84d4-b82c2bb56e5b", "name": "network-vif-unplugged", "status": "completed", "tag": "5bfbd6c8-6493-49c2-9572-209d2b4d28f2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:29.176096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-848ec445-dbc8-44e3-a732-9cb089d49dd8 req-d61cf321-5a72-4f25-a761-e36934bc8de0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:29.177071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-848ec445-dbc8-44e3-a732-9cb089d49dd8 req-d61cf321-5a72-4f25-a761-e36934bc8de0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:29.177812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-848ec445-dbc8-44e3-a732-9cb089d49dd8 req-d61cf321-5a72-4f25-a761-e36934bc8de0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:29.195095 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-848ec445-dbc8-44e3-a732-9cb089d49dd8 req-d61cf321-5a72-4f25-a761-e36934bc8de0 service nova] Creating event network-vif-unplugged:5bfbd6c8-6493-49c2-9572-209d2b4d28f2 for instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b on n-h2-854441-12 Oct 17 15:42:29.203239 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-848ec445-dbc8-44e3-a732-9cb089d49dd8 req-d61cf321-5a72-4f25-a761-e36934bc8de0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048303 Oct 17 15:42:29.204648 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2214/4181] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:29.212556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:29.214003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:29.223833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:29.224740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:29.225438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:29.226425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:29.227336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:29.228123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:29.380305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:29.424930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:29.449694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:29.461942 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eec4ec7d-ebd3-4468-a1e4-98f3dddc7c30 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 1.528059 Oct 17 15:42:29.465598 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1968/4182] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:27 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:29.509727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:29.511037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:29.552919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:29.561481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:29.576732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:29.578567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:29.582569 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74891325-0af6-406e-b002-5f9718e3a4d9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1362 microversion: 2.1 time: 0.374556 Oct 17 15:42:29.585108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:29.586113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:29.586996 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2215/4183] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:29 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:29.590070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:29.603986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:29.605739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:29.623645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:29.624488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:29.625208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:29.629772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:29.634600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:29.635408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:29.935231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:29.954089 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3aeff4e-050e-453e-981a-fd24f5d7612e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1689 microversion: 2.1 time: 0.365017 Oct 17 15:42:29.956725 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2216/4184] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:29 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1689 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:29.983892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:29.983892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:30.011982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:30.016259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:30.016259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:30.021885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:30.021885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:30.035528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:30.129171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:30.176766 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe56f760-d2f8-432a-b72b-9cc131f0f4cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1292 microversion: 2.1 time: 0.700828 Oct 17 15:42:30.186758 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1969/4185] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:29 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1292 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:30.209697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ba014b53-d1d1-448e-b0c3-8dc674929277 req-147e3ea3-0493-4948-a442-a6d187e711de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f604cb7-a80f-465d-84d4-b82c2bb56e5b", "name": "network-vif-deleted", "tag": "ee8a9a0c-6aad-487a-9c27-7789c26e7baf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:30.232476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ba014b53-d1d1-448e-b0c3-8dc674929277 req-147e3ea3-0493-4948-a442-a6d187e711de service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:30.261832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ba014b53-d1d1-448e-b0c3-8dc674929277 req-147e3ea3-0493-4948-a442-a6d187e711de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:30.264158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ba014b53-d1d1-448e-b0c3-8dc674929277 req-147e3ea3-0493-4948-a442-a6d187e711de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:30.290081 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ba014b53-d1d1-448e-b0c3-8dc674929277 req-147e3ea3-0493-4948-a442-a6d187e711de service nova] Creating event network-vif-deleted:ee8a9a0c-6aad-487a-9c27-7789c26e7baf for instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b on n-h2-854441-12 Oct 17 15:42:30.291548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:30.312332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9bf4b8dc-1b61-4e50-8215-28c83a9402b0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1272 microversion: 2.1 time: 0.354236 Oct 17 15:42:30.313279 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2217/4186] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:29 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:30.322912 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ba014b53-d1d1-448e-b0c3-8dc674929277 req-147e3ea3-0493-4948-a442-a6d187e711de service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128370 Oct 17 15:42:30.323610 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1970/4187] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:30.326850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:30.329182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:30.350866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20d96931-ae78-4f9f-ba2a-1dd00792c845 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Calling method '.version_select at 0x7f28bdef9280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:30.351236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:30.351958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:30.354353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:30.357377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:30.359205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:30.361739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:30.734339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:30.751381 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0430e9e-d0ef-4160-b3a7-a25c97c4d4b7 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1654 microversion: 2.1 time: 0.435786 Oct 17 15:42:30.753950 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2218/4188] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:30 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1654 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:30.767507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:30.770414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:30.786983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:30.788138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:30.790788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:30.794713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:30.795673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:30.796330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:31.171403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:31.211095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:31.215425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:31.218749 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d1f53ad-ebd9-4d6f-abe5-dc9b76990b29 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.461577 Oct 17 15:42:31.218749 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2219/4189] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:30 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:31.240044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:31.241184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:31.256537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:31.260443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:31.261072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:31.263529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:31.264849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:31.267036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:31.908552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:31.944798 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b52c7a03-8f5a-4cac-a03c-b7403e941271 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1362 microversion: 2.1 time: 0.724460 Oct 17 15:42:31.951274 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2220/4190] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:31 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1362 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:31.977455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:31.981007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:32.029906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:32.032615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:32.035149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:32.036570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:32.037476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:32.051353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:32.998826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:33.032266 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-46f0b804-c2c1-45d3-9e14-51cb1349a65d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1689 microversion: 2.1 time: 1.079285 Oct 17 15:42:33.041982 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2221/4191] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:31 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1689 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:33.057643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:33.060310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:33.099901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:33.106661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:33.108428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:33.117170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:33.119840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:33.120469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:33.230627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:33.676678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:33.698091 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-19ad9fcb-9bfe-4910-a251-46b344a7d449 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1292 microversion: 2.1 time: 0.652954 Oct 17 15:42:33.711048 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2222/4192] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:33 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1292 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:33.746622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-af07880f-7442-41e7-92d9-33d43082b9ca req-3513afe3-1e31-44fd-b18f-e826dfb5a290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287b7782-35f5-4a0a-ac6e-d803d65080d1", "name": "network-vif-plugged", "status": "completed", "tag": "0c32b16d-ee61-452d-aa91-9b4ed41d397e"}, {"server_uuid": "040161bd-ce7c-4d30-a3c7-6b3b44c8ef41", "name": "network-vif-plugged", "status": "completed", "tag": "be79e1b2-b725-483c-96a7-e0cc9aa52851"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:33.769942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af07880f-7442-41e7-92d9-33d43082b9ca req-3513afe3-1e31-44fd-b18f-e826dfb5a290 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:33.771458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af07880f-7442-41e7-92d9-33d43082b9ca req-3513afe3-1e31-44fd-b18f-e826dfb5a290 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:33.772792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af07880f-7442-41e7-92d9-33d43082b9ca req-3513afe3-1e31-44fd-b18f-e826dfb5a290 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:33.800825 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-af07880f-7442-41e7-92d9-33d43082b9ca req-3513afe3-1e31-44fd-b18f-e826dfb5a290 service nova] Creating event network-vif-plugged:0c32b16d-ee61-452d-aa91-9b4ed41d397e for instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 on n-h2-854441-12 Oct 17 15:42:33.801766 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-af07880f-7442-41e7-92d9-33d43082b9ca req-3513afe3-1e31-44fd-b18f-e826dfb5a290 service nova] Creating event network-vif-plugged:be79e1b2-b725-483c-96a7-e0cc9aa52851 for instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 on n-h1-854441-12 Oct 17 15:42:33.825198 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-af07880f-7442-41e7-92d9-33d43082b9ca req-3513afe3-1e31-44fd-b18f-e826dfb5a290 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.109979 Oct 17 15:42:33.827181 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2223/4193] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:33.856896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:33.857724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:33.870738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:33.871529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:33.871988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:33.873126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:33.873610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:33.874046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.129322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20d96931-ae78-4f9f-ba2a-1dd00792c845 tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/bb7b29db-c17d-49db-a124-04ee110d607b" status: 202 len: 0 microversion: 2.1 time: 3.798009 Oct 17 15:42:34.130378 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1971/4194] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:42:30 2022] DELETE /compute/v2.1/os-floating-ips/bb7b29db-c17d-49db-a124-04ee110d607b => generated 0 bytes in 3804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:42:34.139670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:34.140777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:34.156539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.157198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.157755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.158637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.159242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.159786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.238737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.239683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.240388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.241159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lazy-loading 'fault' on Instance uuid 1f604cb7-a80f-465d-84d4-b82c2bb56e5b {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:42:34.247161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:34.328685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:34.347745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9f8900f5164afdaf9deac86f6b4e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b699ae886f4742a317cff0aa265510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:34.349245 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1a44a94-ed4a-43d8-9702-99d46e7d5f1c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 0.515750 Oct 17 15:42:34.351018 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2224/4195] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:33 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:34.357968 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dfc504d9-a505-412c-b3ee-ffa9b1315769 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 200 len: 1302 microversion: 2.1 time: 0.226249 Oct 17 15:42:34.366112 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1972/4196] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:34 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 1302 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:34.374822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:34.377525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:34.386297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0abaa47e-f865-4636-ade3-d210e57cb494 req-54d2710a-b2d0-48b4-835e-69c2ce60706f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f604cb7-a80f-465d-84d4-b82c2bb56e5b", "name": "network-vif-deleted", "tag": "5bfbd6c8-6493-49c2-9572-209d2b4d28f2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:34.399105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.399903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.404315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.410972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.412811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.413822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.416237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0abaa47e-f865-4636-ade3-d210e57cb494 req-54d2710a-b2d0-48b4-835e-69c2ce60706f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.417391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0abaa47e-f865-4636-ade3-d210e57cb494 req-54d2710a-b2d0-48b4-835e-69c2ce60706f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.420091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0abaa47e-f865-4636-ade3-d210e57cb494 req-54d2710a-b2d0-48b4-835e-69c2ce60706f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.458104 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0abaa47e-f865-4636-ade3-d210e57cb494 req-54d2710a-b2d0-48b4-835e-69c2ce60706f service nova] Creating event network-vif-deleted:5bfbd6c8-6493-49c2-9572-209d2b4d28f2 for instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b on n-h2-854441-12 Oct 17 15:42:34.467508 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0abaa47e-f865-4636-ade3-d210e57cb494 req-54d2710a-b2d0-48b4-835e-69c2ce60706f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097925 Oct 17 15:42:34.476448 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1973/4197] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:34.486356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:34.487307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:34.495614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.496732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.497217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.497990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.498459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.498916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.590193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:34.679296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:34.690913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:34.692771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:34.694200 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94215931-e20f-46f4-8237-ac63e0e7edb3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.341467 Oct 17 15:42:34.694984 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2225/4198] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:34 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:34.709857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:34.711972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:34.720854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.721475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.722036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.722912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:34.723487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:34.723969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:34.824367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:34.836949 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e353b4c0-5e77-4563-b22c-0916d43bfd76 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1621 microversion: 2.1 time: 0.131984 Oct 17 15:42:34.838410 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2226/4199] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:34 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1621 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:34.846632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-905590fe-79e2-483e-a267-c44e679b3c1f tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] Calling method '.version_select at 0x7f28bebddd30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:35.398182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:35.417505 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-40802fd6-1cd9-444a-b76a-0c2fc3b5ebd1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1362 microversion: 2.1 time: 0.938909 Oct 17 15:42:35.432163 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1974/4200] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:34 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1362 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:35.462353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:35.463565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:35.478365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:35.481007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:35.481585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:35.483238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:35.484048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:35.484773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.020700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:36.039261 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9e483ba7-b1ae-4017-9ee3-d2b2ca15b88e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1292 microversion: 2.1 time: 0.605287 Oct 17 15:42:36.040489 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1975/4201] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:35 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1292 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:36.049817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:36.054227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:36.069099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.072594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.073124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.074197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.074741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.075213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.346834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:36.348781 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-905590fe-79e2-483e-a267-c44e679b3c1f tempest-FloatingIPDetailsTestJSON-171500126 tempest-FloatingIPDetailsTestJSON-171500126-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/b5708388-d2fe-40d8-94d4-2f9b94eb715f" status: 202 len: 0 microversion: 2.1 time: 1.507301 Oct 17 15:42:36.356366 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2227/4202] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:42:34 2022] DELETE /compute/v2.1/os-floating-ips/b5708388-d2fe-40d8-94d4-2f9b94eb715f => generated 0 bytes in 1510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:42:36.361284 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99d4a362-9b07-459c-a94e-98fb7fac5974 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 0.319076 Oct 17 15:42:36.363449 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1976/4203] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:36 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:36.366676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:36.368198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:36.379216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:36.379729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:36.381509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.382681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.383740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.385218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.386423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.387511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.412791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.413622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.414314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.415228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.415718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.416161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.430738 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] HTTP exception thrown: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Request method failure captured: Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b HTTP/1.1 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXc_VLxUilec1VEAUSakNJa0rHlu-BhCwMOQjwolccS77XPr9g_THNrcbkHYRL9CHi9UIGfNk481Rqdgv7rThqKHJSQoB_8XkpWSLwOkXCEsSazplZMgnVevu1H5w5gtU5hxyxTusZkU8TqSZ6n9Vhw9FZEPyey54KYSvyDWd6s24-c Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/99b699ae886f4742a317cff0aa265510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_99b699ae886f4742a317cff0aa265510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 3e9f8900f5164afdaf9deac86f6b4e28 Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1f604cb7-a80f-465d-84d4-b82c2bb56e5b'} Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:36.435086 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:36.445061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:36.445061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:36.445061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:36.445061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:42:36.445061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:42:36.445061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:36.445061 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:36.447793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Returning 404 to user: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:42:36.449759 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8402f29f-686f-4466-af36-6c198c383343 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 404 len: 111 microversion: 2.1 time: 0.091660 Oct 17 15:42:36.451469 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2228/4204] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:36 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:42:36.467434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-10d33016-2c80-440d-a5ef-d84ddd301e58 req-0f0f17c0-adca-4f8f-8a10-d194d2bb5bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b793d7-d5e4-4688-9805-2d0997a9b2a1", "name": "network-vif-deleted", "tag": "4d3a8932-7c9b-456c-afb4-5ea7006d3595"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:36.492497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-10d33016-2c80-440d-a5ef-d84ddd301e58 req-0f0f17c0-adca-4f8f-8a10-d194d2bb5bef service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.493774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-10d33016-2c80-440d-a5ef-d84ddd301e58 req-0f0f17c0-adca-4f8f-8a10-d194d2bb5bef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.495019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-10d33016-2c80-440d-a5ef-d84ddd301e58 req-0f0f17c0-adca-4f8f-8a10-d194d2bb5bef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.522530 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-10d33016-2c80-440d-a5ef-d84ddd301e58 req-0f0f17c0-adca-4f8f-8a10-d194d2bb5bef service nova] Creating event network-vif-deleted:4d3a8932-7c9b-456c-afb4-5ea7006d3595 for instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 on n-h2-854441-12 Oct 17 15:42:36.532943 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-10d33016-2c80-440d-a5ef-d84ddd301e58 req-0f0f17c0-adca-4f8f-8a10-d194d2bb5bef service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077450 Oct 17 15:42:36.534963 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2229/4205] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:36.545596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:36.548144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:36.569283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.570780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.571644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.572674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.573386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.574135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.632452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.633478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.634232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.635591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lazy-loading 'fault' on Instance uuid 65b793d7-d5e4-4688-9805-2d0997a9b2a1 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:42:36.638492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:36.719652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:36.733526 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51815a4e-cdea-4560-851e-b72b58c21794 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 200 len: 1334 microversion: 2.1 time: 0.196144 Oct 17 15:42:36.736753 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2230/4206] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:36 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 1334 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:36.752660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:36.753345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:36.783288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.783655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.788623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:36.789855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:36.792459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:36.793279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.030278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:37.068727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:37.076251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:37.080521 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0fd5e153-0e90-470e-8173-64ae97c55d15 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.706344 Oct 17 15:42:37.084349 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1977/4207] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:36 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:37.115593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:37.121097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:37.141910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.156081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.158523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.163535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.169130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.170983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.376215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:37.394486 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c0c454f-a9d2-43bc-8419-4bf3795b11ab tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1549 microversion: 2.1 time: 0.655986 Oct 17 15:42:37.395151 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2231/4208] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:36 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1549 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:37.408100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:37.408776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:37.427361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.428043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.428495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.429269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.429756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.430187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.623646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:37.633172 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6525ae57-b169-4b4c-8806-2931e031d1cc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1483 microversion: 2.1 time: 0.542211 Oct 17 15:42:37.650562 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1978/4209] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:37 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1483 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:37.659887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07528994-c788-4e9d-bfe3-d7fb2e31b8ae tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:37.660850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07528994-c788-4e9d-bfe3-d7fb2e31b8ae tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:37.707089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07528994-c788-4e9d-bfe3-d7fb2e31b8ae tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.707988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07528994-c788-4e9d-bfe3-d7fb2e31b8ae tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.711558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07528994-c788-4e9d-bfe3-d7fb2e31b8ae tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.712893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07528994-c788-4e9d-bfe3-d7fb2e31b8ae tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.718680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07528994-c788-4e9d-bfe3-d7fb2e31b8ae tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.719393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07528994-c788-4e9d-bfe3-d7fb2e31b8ae tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.905339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:37.925169 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b395af56-bafd-4882-9260-af18d78da0d3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 0.528512 Oct 17 15:42:37.927208 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2232/4210] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:37 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:37.943550 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07528994-c788-4e9d-bfe3-d7fb2e31b8ae tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.291376 Oct 17 15:42:37.944977 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1979/4211] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:42:37 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/os-interface => generated 285 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:37.954721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:37.959533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d89af792-1b8f-43ab-80fb-d9d4e94921f8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:37.960463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d89af792-1b8f-43ab-80fb-d9d4e94921f8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:37.966161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 65b793d7-d5e4-4688-9805-2d0997a9b2a1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:37.981184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d89af792-1b8f-43ab-80fb-d9d4e94921f8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.981910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d89af792-1b8f-43ab-80fb-d9d4e94921f8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.982728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d89af792-1b8f-43ab-80fb-d9d4e94921f8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.984031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d89af792-1b8f-43ab-80fb-d9d4e94921f8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.984831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d89af792-1b8f-43ab-80fb-d9d4e94921f8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.985586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d89af792-1b8f-43ab-80fb-d9d4e94921f8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.991549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.992985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.993944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:37.995410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:37.996376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:37.997652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:38.044588 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] HTTP exception thrown: Instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 could not be found. Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Request method failure captured: Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 HTTP/1.1 Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXZ8kmtUPZWb3G0RLc0tH4XVjR5C-7gTVa04Om70uUY0S3ObDBITuVYe9LE38K5_JYHog2FWX-dPJIO8BZMjXqs1lpG_ioDhvbA748hUDdgAKK6oZjLCKHY9A2JeDwuSv8UPAoiN-E1QRQdYcKH6OumXVNNcIN16WkTnV4IzILKrXLw Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ea396576a90246cb8b821cb2afec9170 Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 could not be found. Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '65b793d7-d5e4-4688-9805-2d0997a9b2a1'} Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 could not be found. Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 could not be found. Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:38.046570 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 could not be found. Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Returning 404 to user: Instance 65b793d7-d5e4-4688-9805-2d0997a9b2a1 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:42:38.051290 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c308b23-de9c-4c81-bb8b-69da4c9c20ca tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1" status: 404 len: 111 microversion: 2.1 time: 0.102344 Oct 17 15:42:38.052523 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1980/4212] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:37 2022] GET /compute/v2.1/servers/65b793d7-d5e4-4688-9805-2d0997a9b2a1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:42:38.074256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c0ca650-93b5-4d17-aafe-367d171e41ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '.version_select at 0x7f28bdf19e50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:38.122456 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c0ca650-93b5-4d17-aafe-367d171e41ed tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36891197" status: 202 len: 0 microversion: 2.1 time: 0.058518 Oct 17 15:42:38.124117 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1981/4213] 10.222.0.87 () {58 vars in 1215 bytes} [Mon Oct 17 15:42:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36891197 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:42:38.132496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:38.139011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:38.150711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:38.151481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:38.152740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:38.153544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:38.154657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:38.155395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:38.309570 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d89af792-1b8f-43ab-80fb-d9d4e94921f8 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.378372 Oct 17 15:42:38.314474 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2233/4214] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:42:37 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41/os-interface => generated 284 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:38.634186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d1a7bd93-15cd-42d6-ae0f-a7f4a026b3f9 req-959813c8-1b06-4bb6-91a5-ddc3833a77fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357917b7-61bf-43aa-8de0-7577a90c0375", "tag": "81227e07-ca90-4706-a849-46ad027c5be2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:38.651155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d1a7bd93-15cd-42d6-ae0f-a7f4a026b3f9 req-959813c8-1b06-4bb6-91a5-ddc3833a77fc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:38.652536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d1a7bd93-15cd-42d6-ae0f-a7f4a026b3f9 req-959813c8-1b06-4bb6-91a5-ddc3833a77fc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:38.653594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d1a7bd93-15cd-42d6-ae0f-a7f4a026b3f9 req-959813c8-1b06-4bb6-91a5-ddc3833a77fc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:38.675872 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d1a7bd93-15cd-42d6-ae0f-a7f4a026b3f9 req-959813c8-1b06-4bb6-91a5-ddc3833a77fc service nova] Creating event network-changed:81227e07-ca90-4706-a849-46ad027c5be2 for instance 357917b7-61bf-43aa-8de0-7577a90c0375 on n-h1-854441-12 Oct 17 15:42:38.686381 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d1a7bd93-15cd-42d6-ae0f-a7f4a026b3f9 req-959813c8-1b06-4bb6-91a5-ddc3833a77fc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058826 Oct 17 15:42:38.689017 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2234/4215] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:38.766608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:38.778524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:38.780766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:38.782605 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-35009eeb-d56f-4896-b776-70a773db260f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.657068 Oct 17 15:42:38.783866 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1982/4216] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:38 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:38.960652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:38.964073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:38.977083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:38.978907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:38.980132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:38.981773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:38.982995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:38.985738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:39.836048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:39.837592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:39.847329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:39.848247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:39.849093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:39.850088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:39.853795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:39.854734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:40.085706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:40.096865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c43d544a-2e21-463e-8c6b-2a52da9f0e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 1.146404 Oct 17 15:42:40.097793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2235/4217] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:38 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:40.481090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:40.514918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:40.516617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:40.523166 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d07e1be4-206a-4bc1-b1b3-6718098f25ee tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.692994 Oct 17 15:42:40.523820 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1983/4218] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:39 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:41.145093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:41.160980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:41.203991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:41.205325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:41.206703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:41.208495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:41.210225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:41.211879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:41.553948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:41.554749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:41.578655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:41.579165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:41.579829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:41.581960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:41.589352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:41.590169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:41.888758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:41.897573 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8584fdd6-5171-4aeb-9199-f78d1fc5c9ee tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 0.780013 Oct 17 15:42:41.903897 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2236/4219] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:41 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:42.399314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:42.436715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:42.441370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:42.444133 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-951f18a7-01c3-49b7-8d12-01aa68be0c01 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.894342 Oct 17 15:42:42.446203 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1984/4220] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:41 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:42:42.607637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1c302759-baf2-4643-b17c-1bfd95efa107 req-fb6e7c0d-b8de-4e68-8665-9256873173ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287b7782-35f5-4a0a-ac6e-d803d65080d1", "tag": "0c32b16d-ee61-452d-aa91-9b4ed41d397e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:42.638473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1c302759-baf2-4643-b17c-1bfd95efa107 req-fb6e7c0d-b8de-4e68-8665-9256873173ad service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:42.644883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1c302759-baf2-4643-b17c-1bfd95efa107 req-fb6e7c0d-b8de-4e68-8665-9256873173ad service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:42.647141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1c302759-baf2-4643-b17c-1bfd95efa107 req-fb6e7c0d-b8de-4e68-8665-9256873173ad service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:42.690906 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1c302759-baf2-4643-b17c-1bfd95efa107 req-fb6e7c0d-b8de-4e68-8665-9256873173ad service nova] Creating event network-changed:0c32b16d-ee61-452d-aa91-9b4ed41d397e for instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 on n-h2-854441-12 Oct 17 15:42:42.712433 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1c302759-baf2-4643-b17c-1bfd95efa107 req-fb6e7c0d-b8de-4e68-8665-9256873173ad service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108651 Oct 17 15:42:42.713539 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2237/4221] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:42.929903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:42.931541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:42.957348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:42.958314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:42.959056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:42.962540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:42.966763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:42.967342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:43.482752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:43.484004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:43.497306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:43.509268 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-18d4e76a-bd70-4c6c-8550-a796f12fd4f7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 0.583596 Oct 17 15:42:43.515698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:43.524299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:43.527140 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1985/4222] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:42 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:42:43.532002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:43.548302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:43.549881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:43.560058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.090394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:44.091454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:44.121918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.122883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.123677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.131588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.132430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.133212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.177946 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] HTTP exception thrown: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Request method failure captured: Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b HTTP/1.1 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXc_VLxUilec1VEAUSakNJa0rHlu-BhCwMOQjwolccS77XPr9g_THNrcbkHYRL9CHi9UIGfNk481Rqdgv7rThqKHJSQoB_8XkpWSLwOkXCEsSazplZMgnVevu1H5w5gtU5hxyxTusZkU8TqSZ6n9Vhw9FZEPyey54KYSvyDWd6s24-c Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/99b699ae886f4742a317cff0aa265510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_99b699ae886f4742a317cff0aa265510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 3e9f8900f5164afdaf9deac86f6b4e28 Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '1f604cb7-a80f-465d-84d4-b82c2bb56e5b'} Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:42:44.180309 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.185112 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.188124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Returning 404 to user: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:42:44.189552 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bbc17a3f-71aa-46c3-9688-bf22d4cdd061 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 404 len: 111 microversion: 2.1 time: 0.105724 Oct 17 15:42:44.190754 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1986/4223] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:42:44 2022] DELETE /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:42:44.196859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:44.197904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:44.206373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.207321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.208384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.209535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.210415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.211155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.261158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:44.310542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:44.320463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:44.331226 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-501902b8-7d40-4c68-95f9-822d6d039075 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.850789 Oct 17 15:42:44.334040 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2238/4224] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:43 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:42:44.363089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:44.364904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: 1f604cb7-a80f-465d-84d4-b82c2bb56e5b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:44.400937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.406027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.410129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.415787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.418291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.422175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.504429 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] HTTP exception thrown: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Request method failure captured: Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b HTTP/1.1 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXc_VLxUilec1VEAUSakNJa0rHlu-BhCwMOQjwolccS77XPr9g_THNrcbkHYRL9CHi9UIGfNk481Rqdgv7rThqKHJSQoB_8XkpWSLwOkXCEsSazplZMgnVevu1H5w5gtU5hxyxTusZkU8TqSZ6n9Vhw9FZEPyey54KYSvyDWd6s24-c Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/99b699ae886f4742a317cff0aa265510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_99b699ae886f4742a317cff0aa265510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 3e9f8900f5164afdaf9deac86f6b4e28 Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1f604cb7-a80f-465d-84d4-b82c2bb56e5b'} Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:44.514209 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Returning 404 to user: Instance 1f604cb7-a80f-465d-84d4-b82c2bb56e5b could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8920b6da-1bbe-411a-8a06-26e11e573cf3 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b" status: 404 len: 111 microversion: 2.1 time: 0.180219 Oct 17 15:42:44.525488 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2239/4225] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:44 2022] GET /compute/v2.1/servers/1f604cb7-a80f-465d-84d4-b82c2bb56e5b => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:42:44.536019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:44.541630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:44.557115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.560046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.561697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.563721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.566483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.572181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.601406 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] HTTP exception thrown: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Request method failure captured: Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 HTTP/1.1 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXc_VLxUilec1VEAUSakNJa0rHlu-BhCwMOQjwolccS77XPr9g_THNrcbkHYRL9CHi9UIGfNk481Rqdgv7rThqKHJSQoB_8XkpWSLwOkXCEsSazplZMgnVevu1H5w5gtU5hxyxTusZkU8TqSZ6n9Vhw9FZEPyey54KYSvyDWd6s24-c Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/99b699ae886f4742a317cff0aa265510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_99b699ae886f4742a317cff0aa265510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 3e9f8900f5164afdaf9deac86f6b4e28 Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'c1bf8ffa-09f1-4048-9abc-63fbd02d45f7'} Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:42:44.604224 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:44.608913 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:44.611506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Returning 404 to user: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:42:44.612650 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-feb9f26e-aa2f-4439-8ad6-54cfd29d75bb tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 404 len: 111 microversion: 2.1 time: 0.087044 Oct 17 15:42:44.613917 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2240/4226] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:42:44 2022] DELETE /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:42:44.619994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:44.620884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:44.628401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:44.630633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.634228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.635128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:44.636201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:44.636932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:44.638423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:45.091253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:45.122892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf3ffae7-3f29-45d5-b981-933138e81626 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 0.501776 Oct 17 15:42:45.125997 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2241/4227] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:44 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:45.147511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:45.149582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] [instance: c1bf8ffa-09f1-4048-9abc-63fbd02d45f7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:45.166461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:45.168202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:45.170285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:45.172562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:45.175346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:45.176728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:45.217897 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] HTTP exception thrown: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Request method failure captured: Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 HTTP/1.1 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXc_VLxUilec1VEAUSakNJa0rHlu-BhCwMOQjwolccS77XPr9g_THNrcbkHYRL9CHi9UIGfNk481Rqdgv7rThqKHJSQoB_8XkpWSLwOkXCEsSazplZMgnVevu1H5w5gtU5hxyxTusZkU8TqSZ6n9Vhw9FZEPyey54KYSvyDWd6s24-c Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/99b699ae886f4742a317cff0aa265510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_99b699ae886f4742a317cff0aa265510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/99b699ae886f4742a317cff0aa265510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 99b699ae886f4742a317cff0aa265510 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestMultiNic-406591426 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 3e9f8900f5164afdaf9deac86f6b4e28 Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestMultiNic-406591426-project Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'c1bf8ffa-09f1-4048-9abc-63fbd02d45f7'} Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:42:45.224775 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] Returning 404 to user: Instance c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b55f2935-8a11-4870-8f4d-d73ee6265b22 tempest-ServersTestMultiNic-406591426 tempest-ServersTestMultiNic-406591426-project] 10.222.0.87 "GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7" status: 404 len: 111 microversion: 2.1 time: 0.099493 Oct 17 15:42:45.235188 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2242/4228] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:45 2022] GET /compute/v2.1/servers/c1bf8ffa-09f1-4048-9abc-63fbd02d45f7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:42:45.242273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8353f963-3d58-4bee-860a-e33c8903155c req-b37120a4-0431-4a07-b641-14b78635a819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "040161bd-ce7c-4d30-a3c7-6b3b44c8ef41", "tag": "be79e1b2-b725-483c-96a7-e0cc9aa52851"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:45.252510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8353f963-3d58-4bee-860a-e33c8903155c req-b37120a4-0431-4a07-b641-14b78635a819 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:45.263943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8353f963-3d58-4bee-860a-e33c8903155c req-b37120a4-0431-4a07-b641-14b78635a819 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:45.265275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8353f963-3d58-4bee-860a-e33c8903155c req-b37120a4-0431-4a07-b641-14b78635a819 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:45.313874 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8353f963-3d58-4bee-860a-e33c8903155c req-b37120a4-0431-4a07-b641-14b78635a819 service nova] Creating event network-changed:be79e1b2-b725-483c-96a7-e0cc9aa52851 for instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 on n-h1-854441-12 Oct 17 15:42:45.322779 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8353f963-3d58-4bee-860a-e33c8903155c req-b37120a4-0431-4a07-b641-14b78635a819 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086264 Oct 17 15:42:45.324220 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2243/4229] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:45.339311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:45.381500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:45.383147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:45.397706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:45.401430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:45.403181 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-152b6381-e218-48f6-98eb-3f49342a9b0c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1483 microversion: 2.1 time: 1.210583 Oct 17 15:42:45.404098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:45.405291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:45.410131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:45.413228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:45.415108 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1987/4230] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:44 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1483 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:46.001711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:46.027387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:46.033101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:46.035813 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b4d81097-f068-4238-a4c8-13990d32fb1b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.660503 Oct 17 15:42:46.039757 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2244/4231] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:45 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:42:46.152346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:46.152979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:46.175312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:46.179435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:46.180207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:46.184449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:46.185691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:46.187219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:47.091759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:47.093508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:47.115407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:47.118104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:47.118928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:47.121829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:47.122490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:47.124386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:47.447766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:47.469372 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6bba345e-a9ee-4ad7-adfb-9d4e67c019d7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 1.319855 Oct 17 15:42:47.471871 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1988/4232] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:46 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:42:47.688107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:47.709606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:47.716871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:47.720330 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf33d7a0-1286-4b99-9232-82fb742212f6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.635096 Oct 17 15:42:47.731567 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2245/4233] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:47 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:48.488495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b8accc65-2113-4589-8285-1c07c9e0b5dc req-034288dc-fc72-4647-a1fd-b4be63907f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357917b7-61bf-43aa-8de0-7577a90c0375", "name": "network-vif-plugged", "status": "completed", "tag": "81227e07-ca90-4706-a849-46ad027c5be2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:48.500635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:48.509932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:48.574327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:48.586534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:48.587180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:48.588241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:48.588910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:48.590088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:48.623880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:48.640396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b8accc65-2113-4589-8285-1c07c9e0b5dc req-034288dc-fc72-4647-a1fd-b4be63907f7a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:48.660794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b8accc65-2113-4589-8285-1c07c9e0b5dc req-034288dc-fc72-4647-a1fd-b4be63907f7a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:48.667113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b8accc65-2113-4589-8285-1c07c9e0b5dc req-034288dc-fc72-4647-a1fd-b4be63907f7a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:48.739579 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b8accc65-2113-4589-8285-1c07c9e0b5dc req-034288dc-fc72-4647-a1fd-b4be63907f7a service nova] Creating event network-vif-plugged:81227e07-ca90-4706-a849-46ad027c5be2 for instance 357917b7-61bf-43aa-8de0-7577a90c0375 on n-h1-854441-12 Oct 17 15:42:48.755665 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b8accc65-2113-4589-8285-1c07c9e0b5dc req-034288dc-fc72-4647-a1fd-b4be63907f7a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287282 Oct 17 15:42:48.756628 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1989/4234] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:48.804201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:48.821597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:48.865324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:48.883460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:48.883911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:48.884688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:48.885163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:48.885599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:49.560203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:49.618291 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae78d629-bae6-44a7-b155-71c884b53aad tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 1.124277 Oct 17 15:42:49.630843 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2246/4235] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:48 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:49.850271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:49.860787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:49.892927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:49.903446 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02a76d01-3e2f-4393-9e44-41bcceb0fa4f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 1.102992 Oct 17 15:42:49.922544 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1990/4236] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:48 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:50.657832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:50.659321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:50.669213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:50.669877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:50.670585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:50.671575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:50.674157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:50.675711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:50.839973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-573d540c-f3a7-4ec2-83e7-0d89abd1d3d3 req-f0ae8d71-9a26-408c-8b64-d7d8172075d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f53954-5109-4fb4-8634-490b9664c7d8", "name": "network-vif-plugged", "status": "completed", "tag": "c4a74e76-9816-486b-854c-027fd5b61d05"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:50.874653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-573d540c-f3a7-4ec2-83e7-0d89abd1d3d3 req-f0ae8d71-9a26-408c-8b64-d7d8172075d7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:50.875580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-573d540c-f3a7-4ec2-83e7-0d89abd1d3d3 req-f0ae8d71-9a26-408c-8b64-d7d8172075d7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:50.875580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-573d540c-f3a7-4ec2-83e7-0d89abd1d3d3 req-f0ae8d71-9a26-408c-8b64-d7d8172075d7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:50.937847 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-573d540c-f3a7-4ec2-83e7-0d89abd1d3d3 req-f0ae8d71-9a26-408c-8b64-d7d8172075d7 service nova] Creating event network-vif-plugged:c4a74e76-9816-486b-854c-027fd5b61d05 for instance 45f53954-5109-4fb4-8634-490b9664c7d8 on n-h1-854441-12 Oct 17 15:42:50.959847 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-573d540c-f3a7-4ec2-83e7-0d89abd1d3d3 req-f0ae8d71-9a26-408c-8b64-d7d8172075d7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124837 Oct 17 15:42:50.967255 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1991/4237] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:50.993210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:50.993987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:51.033313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:51.033824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:51.043071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:51.047518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:51.048341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:51.050460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:51.111039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:51.133642 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ccb656d5-9e93-4156-ac1a-8b6cd0e51cfa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1314 microversion: 2.1 time: 0.477691 Oct 17 15:42:51.143031 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2247/4238] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:50 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:51.911109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:51.923262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:51.924970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:51.926340 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5a04d266-5b02-4114-b18c-7853e3e036f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 0.957686 Oct 17 15:42:51.935342 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1992/4239] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:50 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:52.172437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:52.173593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:52.245106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:52.246010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:52.252731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:52.254216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:52.255135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:52.255912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:52.608688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:52.618258 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6ebf0cc-c7a4-41a3-a919-f25a58689d8c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1500 microversion: 2.1 time: 0.459536 Oct 17 15:42:52.618918 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2248/4240] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:52 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1500 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:52.657527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:52.658384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:52.700159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:52.703464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:52.705886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:52.708367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:52.719577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:52.720660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:52.987031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:52.993434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:53.018308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:53.019346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:53.020139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:53.021443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:53.022309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:53.023071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:53.526318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.network.security_group_api [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Removing security group c43c449e-f4cb-479c-98f1-7abc1d28cc19 from port 81227e07-ca90-4706-a849-46ad027c5be2 Oct 17 15:42:53.980621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:54.018672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:54.026955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:54.029217 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a71fbaf-add3-4970-b40c-594eff231960 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1809 microversion: 2.20 time: 1.050357 Oct 17 15:42:54.037914 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2249/4241] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:52 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1809 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:54.454871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:54.455749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:54.511517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:54.513386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:54.521423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:54.523505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:54.532639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:54.537004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:54.779242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:42:54.919192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:55.040975 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d89f273e-a19f-42ac-81c1-9d78394678f6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375/action" status: 202 len: 0 microversion: 2.1 time: 2.395861 Oct 17 15:42:55.048565 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1993/4242] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:42:52 2022] POST /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375/action => generated 0 bytes in 2411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:42:55.079985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f1d5ce62-e204-4d21-80c8-b6b071210ead req-53105f43-cd01-4bda-8867-e5ae9d9dac3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357917b7-61bf-43aa-8de0-7577a90c0375", "tag": "81227e07-ca90-4706-a849-46ad027c5be2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:55.149327 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-afe10174-0bf6-4d36-8836-946617ee0020 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "DELETE /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 204 len: 0 microversion: 2.1 time: 0.700646 Oct 17 15:42:55.166288 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2250/4243] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:42:54 2022] DELETE /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:42:55.172901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f1d5ce62-e204-4d21-80c8-b6b071210ead req-53105f43-cd01-4bda-8867-e5ae9d9dac3e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:55.173573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f1d5ce62-e204-4d21-80c8-b6b071210ead req-53105f43-cd01-4bda-8867-e5ae9d9dac3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:55.174031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f1d5ce62-e204-4d21-80c8-b6b071210ead req-53105f43-cd01-4bda-8867-e5ae9d9dac3e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:55.175659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:55.176949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:55.225885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:42:55.226353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:55.227016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:55.227478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:55.233676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:55.235352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:55.236228 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f1d5ce62-e204-4d21-80c8-b6b071210ead req-53105f43-cd01-4bda-8867-e5ae9d9dac3e service nova] Creating event network-changed:81227e07-ca90-4706-a849-46ad027c5be2 for instance 357917b7-61bf-43aa-8de0-7577a90c0375 on n-h1-854441-12 Oct 17 15:42:55.238001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:55.305208 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f1d5ce62-e204-4d21-80c8-b6b071210ead req-53105f43-cd01-4bda-8867-e5ae9d9dac3e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245547 Oct 17 15:42:55.306968 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1994/4244] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:55.320748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:55.331658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:55.360381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:55.361542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:55.363293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:55.369540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:55.372233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:55.374780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:55.521860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:55.555332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1711a9b5-de5d-4da0-837c-3279e677ef03 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1458 microversion: 2.1 time: 0.386306 Oct 17 15:42:55.559527 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2251/4245] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:55 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1458 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:55.587377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:55.593257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:55.617382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:55.618753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:55.619846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:55.621520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:55.622627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:55.623667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:56.007099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:56.042916 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d32bc554-5047-42a5-8d98-249661bd92ad tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1508 microversion: 2.1 time: 0.476990 Oct 17 15:42:56.044409 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2252/4246] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:55 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:56.077419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:56.079744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:56.107912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:56.108643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:56.109199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:56.110198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:56.111202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:56.111754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:56.707702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:56.770949 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7dab7311-87ab-4fb5-bf53-97e6374388cc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.723073 Oct 17 15:42:56.775923 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2253/4247] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:56 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:56.826396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:56.831038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:56.859776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:56.864065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:56.869853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:56.871556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:56.875762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:56.876967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:57.131794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:57.148135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:57.153826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:57.158096 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-213aa4fd-b7d7-4ffa-9c61-4bb265cd0e0f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1796 microversion: 2.20 time: 1.848830 Oct 17 15:42:57.159817 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1995/4248] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:42:55 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1796 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:42:57.167427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:57.168388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:57.178185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:57.179863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:57.180534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:57.181450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:57.182343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:57.183082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:57.555407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:57.621853 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2c68c80-c00b-4ca3-818b-a2fc787585dc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.786887 Oct 17 15:42:57.623084 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2254/4249] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:56 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:42:57.650359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:57.651725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:57.661904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:57.663097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:57.663842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:57.664921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:57.665553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:57.666582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:58.003872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:58.014688 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c608fec6-0189-4480-94d3-d3438c62aba8 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1508 microversion: 2.1 time: 0.852777 Oct 17 15:42:58.015424 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1996/4250] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:57 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1508 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:58.176082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:58.207330 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99c778ba-39c1-4774-beb4-748d5d6d5562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.561764 Oct 17 15:42:58.212048 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2255/4251] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:57 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:42:58.253850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:58.256676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:58.272005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:58.273306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:58.274416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:58.277786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:58.279178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:58.280522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:59.066084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:42:59.067784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:42:59.082978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:59.083880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:59.084938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:59.086242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:59.087300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:59.088248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:59.301690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:59.323476 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-995e6059-c6da-4e59-8a7c-25189feb36ff tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 200 len: 1466 microversion: 2.1 time: 0.273738 Oct 17 15:42:59.324651 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2256/4252] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:59 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 1466 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:42:59.343352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-69966295-70e6-4136-9ed7-8d2e7cf46a2f req-a66460a6-41c7-48b6-862d-83b580ba15dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f0fd6d-17f3-412d-9bb7-b40d8272d982", "name": "network-vif-deleted", "tag": "61ce5642-45d8-419e-b0ec-592665f1d61b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:59.378586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-69966295-70e6-4136-9ed7-8d2e7cf46a2f req-a66460a6-41c7-48b6-862d-83b580ba15dc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:42:59.379677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-69966295-70e6-4136-9ed7-8d2e7cf46a2f req-a66460a6-41c7-48b6-862d-83b580ba15dc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:42:59.380601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-69966295-70e6-4136-9ed7-8d2e7cf46a2f req-a66460a6-41c7-48b6-862d-83b580ba15dc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:42:59.385971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:42:59.416640 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c881a3f1-e0cb-4bc5-8476-538ffce00018 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.170844 Oct 17 15:42:59.417024 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-69966295-70e6-4136-9ed7-8d2e7cf46a2f req-a66460a6-41c7-48b6-862d-83b580ba15dc service nova] Creating event network-vif-deleted:61ce5642-45d8-419e-b0ec-592665f1d61b for instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 on n-h2-854441-12 Oct 17 15:42:59.426047 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1997/4253] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:42:58 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:42:59.434563 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-69966295-70e6-4136-9ed7-8d2e7cf46a2f req-a66460a6-41c7-48b6-862d-83b580ba15dc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107816 Oct 17 15:42:59.435781 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2257/4254] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:42:59.794976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-112017670", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "dd932f3b-36f3-4be3-9d4c-cbbd034c0114"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:42:59.885963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] validate_networks() for [('dd932f3b-36f3-4be3-9d4c-cbbd034c0114', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:43:00.378837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:00.380484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: 52f0fd6d-17f3-412d-9bb7-b40d8272d982] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:00.392955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:00.399372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:00.400535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:00.405210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:00.406993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:00.409938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:00.429093 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] HTTP exception thrown: Instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 could not be found. Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Request method failure captured: Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 HTTP/1.1 Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXZ8kmtUPZWb3G0RLc0tH4XVjR5C-7gTVa04Om70uUY0S3ObDBITuVYe9LE38K5_JYHog2FWX-dPJIO8BZMjXqs1lpG_ioDhvbA748hUDdgAKK6oZjLCKHY9A2JeDwuSv8UPAoiN-E1QRQdYcKH6OumXVNNcIN16WkTnV4IzILKrXLw Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ea396576a90246cb8b821cb2afec9170 Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 could not be found. Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '52f0fd6d-17f3-412d-9bb7-b40d8272d982'} Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 could not be found. Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 could not be found. Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:43:00.431784 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:43:00.436547 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:43:00.436547 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:00.436547 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:43:00.436547 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:43:00.436547 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:43:00.436547 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:43:00.436547 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 could not be found. Oct 17 15:43:00.436547 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:43:00.438393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Returning 404 to user: Instance 52f0fd6d-17f3-412d-9bb7-b40d8272d982 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:43:00.439723 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cfe62940-2c48-4896-aca0-eefde6799330 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982" status: 404 len: 111 microversion: 2.1 time: 0.069777 Oct 17 15:43:00.441144 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2258/4255] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:00 2022] GET /compute/v2.1/servers/52f0fd6d-17f3-412d-9bb7-b40d8272d982 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:43:00.469804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:00.470564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:00.480616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:00.481135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:00.481590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:00.482417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:00.483105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:00.483787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:00.536300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:43:00.789168 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eac213d0-674b-40ef-9f62-c12d6c1c35b3 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 204 len: 0 microversion: 2.1 time: 0.339984 Oct 17 15:43:00.796892 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2259/4256] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:43:00 2022] DELETE /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:43:00.815486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:00.816285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:00.824913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:00.826339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:00.826991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:00.827820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:00.828475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:00.829046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:01.091831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:01.103765 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82ef3a44-0140-409b-ae37-dfb1e3562b75 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.305154 Oct 17 15:43:01.119779 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2260/4257] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:00 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:01.201265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:43:01.201916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:43:01.202271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:43:01.202745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:43:01.203195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:43:01.217463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:01.218318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:01.218857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:01.219763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:01.220329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:01.220778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:01.245828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:43:01.252566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Getting quotas for user 15cc78a142a148398dc438b5ff2a25e9 and project cd4152066a8f430fb2fc99bf60b20203. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:43:01.269418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:43:01.272221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:43:01.356893 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d073b14b-b242-4bb5-9596-3dc6618d3e0d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565645 Oct 17 15:43:01.358469 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1998/4258] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:42:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:43:01.393413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d298781-376d-494b-a006-63ac3708b230 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:01.398765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2d298781-376d-494b-a006-63ac3708b230 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:01.510077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2d298781-376d-494b-a006-63ac3708b230 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:01.519166 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2d298781-376d-494b-a006-63ac3708b230 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1214 microversion: 2.1 time: 0.152494 Oct 17 15:43:01.519944 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 1999/4259] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:01 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:01.600159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1561061362", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "5ba14e83-d3c4-4c1d-8db8-96d1f32bf4c0"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:01.718760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] validate_networks() for [('5ba14e83-d3c4-4c1d-8db8-96d1f32bf4c0', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:43:02.146306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:02.147366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:02.158195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:02.158718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:02.159935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:02.161281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:02.162480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:02.164161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:02.564618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:43:02.565084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:43:02.565950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:43:02.566390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:43:02.566843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:43:02.581572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:02.582325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:02.583012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:02.584394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:02.588310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:02.588689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:02.639368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Getting quotas for project 3346db7d11ef4b1d9b295ec3ea08c65a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:43:02.653730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Getting quotas for user 9dfcc636db574b30abe01e6332b57dfc and project 3346db7d11ef4b1d9b295ec3ea08c65a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:43:02.682087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:43:02.686092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:43:02.735171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:02.764439 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e1cc0e4f-6d54-4258-9836-256c6cd89b3e tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.628539 Oct 17 15:43:02.771118 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2000/4260] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:02 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:02.802946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:02.810734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:02.829484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:02.830007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:02.830835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:02.834007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:02.835290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:02.835967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:02.841837 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a27713c1-630c-43b7-adec-49fed7ff4a5b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720389 Oct 17 15:43:02.846752 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2261/4261] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:43:03.054260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:03.102483 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d498257e-4ae3-49b7-802f-33020e2a2e00 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1218 microversion: 2.1 time: 0.327653 Oct 17 15:43:03.108203 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2001/4262] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:02 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1218 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:03.249664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-889678789", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "5ba14e83-d3c4-4c1d-8db8-96d1f32bf4c0"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:03.412297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] validate_networks() for [('5ba14e83-d3c4-4c1d-8db8-96d1f32bf4c0', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:43:03.816143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:03.823301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:03.889192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:03.892071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:03.895603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:03.897347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:03.900811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:03.903911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:04.726981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:04.757143 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-078c86c3-a308-4126-8976-46b4eb23d25d tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1522 microversion: 2.1 time: 0.949193 Oct 17 15:43:04.799465 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2002/4263] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:03 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1522 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:04.813029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:04.815749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:04.830543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:04.832815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:04.834593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:04.836352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:04.837589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:04.838055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:05.168101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:05.179387 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24b7acd9-9c66-4560-b197-a5b0d910a0f2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1272 microversion: 2.1 time: 0.378222 Oct 17 15:43:05.180030 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2003/4264] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:04 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1272 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:05.418436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:43:05.418951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:43:05.422671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:43:05.423107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:43:05.423683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:43:05.454921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:05.457990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:05.459100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:05.460541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:05.473289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:05.476190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:05.518078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Getting quotas for project 3346db7d11ef4b1d9b295ec3ea08c65a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:43:05.525266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Getting quotas for user 9dfcc636db574b30abe01e6332b57dfc and project 3346db7d11ef4b1d9b295ec3ea08c65a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:43:05.542411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cb5d3593-1bde-4ff6-b365-37d2526b89a9 req-793ac048-81cf-40d7-b9e0-d1f84981ed98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c54ae4a0-4fdc-4128-85a3-f39fdb907468", "name": "network-vif-deleted", "tag": "6cb9c2b8-706c-4da3-ba6a-336a239ce626"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:05.568284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:43:05.583717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:43:05.595287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cb5d3593-1bde-4ff6-b365-37d2526b89a9 req-793ac048-81cf-40d7-b9e0-d1f84981ed98 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:05.597284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cb5d3593-1bde-4ff6-b365-37d2526b89a9 req-793ac048-81cf-40d7-b9e0-d1f84981ed98 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:05.598610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cb5d3593-1bde-4ff6-b365-37d2526b89a9 req-793ac048-81cf-40d7-b9e0-d1f84981ed98 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:05.628474 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cb5d3593-1bde-4ff6-b365-37d2526b89a9 req-793ac048-81cf-40d7-b9e0-d1f84981ed98 service nova] Creating event network-vif-deleted:6cb9c2b8-706c-4da3-ba6a-336a239ce626 for instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 on n-h1-854441-12 Oct 17 15:43:05.651314 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cb5d3593-1bde-4ff6-b365-37d2526b89a9 req-793ac048-81cf-40d7-b9e0-d1f84981ed98 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.418763 Oct 17 15:43:05.655443 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2004/4265] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:43:05.845781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:05.850181 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a11e09de-d8a6-44f2-8c34-2fe91b3da264 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.605058 Oct 17 15:43:05.860313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:05.868480 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2262/4266] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:43:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:43:05.917455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:05.921833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:05.924839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:05.934952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:05.936601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:05.938823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:06.128228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:06.129467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:06.135919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:06.141539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lazy-loading 'fault' on Instance uuid c54ae4a0-4fdc-4128-85a3-f39fdb907468 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:43:06.213369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:06.221219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:06.280306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:06.288764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:06.290981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:06.293214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:06.300128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:06.302619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:06.522299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:06.591332 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ffd0931c-3c77-4002-8789-265138f9c5b1 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1312 microversion: 2.1 time: 0.764705 Oct 17 15:43:06.605511 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2005/4267] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:05 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1312 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:06.629750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-19588729", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "451", "networks": [{"uuid": "5ba14e83-d3c4-4c1d-8db8-96d1f32bf4c0"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:06.884151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:06.899633 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17530e2f-c2b2-4d45-ae8e-c7c66c691420 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1272 microversion: 2.1 time: 0.695740 Oct 17 15:43:06.902465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] validate_networks() for [('5ba14e83-d3c4-4c1d-8db8-96d1f32bf4c0', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:43:06.904320 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2263/4268] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:06 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1272 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:07.644473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:07.646457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:07.691001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:07.692150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:07.692947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:07.698614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:07.704385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:07.705424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:07.822014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:07.823283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:07.823779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:07.826090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lazy-loading 'fault' on Instance uuid c54ae4a0-4fdc-4128-85a3-f39fdb907468 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:43:08.315300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea396576a90246cb8b821cb2afec9170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e096fd0bb744b2e90cf090b2172662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:08.358267 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae733782-c374-495c-b312-92a1392f9a9b tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 200 len: 1312 microversion: 2.1 time: 0.729075 Oct 17 15:43:08.367908 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2264/4269] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:07 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 1312 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:08.408543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:08.410374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:08.422748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:08.424295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:08.425474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:08.427267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:08.428453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:08.429571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:08.711348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:43:08.712589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:43:08.713691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:43:08.714271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:43:08.714843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:43:08.739774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:08.744749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:08.745622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:08.746865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:08.748187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:08.754860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:08.815987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Getting quotas for project 3346db7d11ef4b1d9b295ec3ea08c65a. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:43:08.832867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Getting quotas for user 9dfcc636db574b30abe01e6332b57dfc and project 3346db7d11ef4b1d9b295ec3ea08c65a. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:43:08.869431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:43:08.877104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:43:09.028817 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-298bc407-0d44-4754-a3d5-0872722bede3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419186 Oct 17 15:43:09.036582 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2006/4270] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:43:09.069568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c2e5bdf-6a54-434a-9524-c996495e329a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:09.097638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3c2e5bdf-6a54-434a-9524-c996495e329a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:09.956939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3c2e5bdf-6a54-434a-9524-c996495e329a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:10.010988 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3c2e5bdf-6a54-434a-9524-c996495e329a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1219 microversion: 2.1 time: 0.959051 Oct 17 15:43:10.016694 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2007/4271] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:09 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1219 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:10.068425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:10.070877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] [instance: c54ae4a0-4fdc-4128-85a3-f39fdb907468] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:10.093877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:10.095885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:10.098211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:10.105781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:10.110023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:10.114188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:10.190181 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] HTTP exception thrown: Instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 could not be found. Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Request method failure captured: Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 HTTP/1.1 Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXZ8kmtUPZWb3G0RLc0tH4XVjR5C-7gTVa04Om70uUY0S3ObDBITuVYe9LE38K5_JYHog2FWX-dPJIO8BZMjXqs1lpG_ioDhvbA748hUDdgAKK6oZjLCKHY9A2JeDwuSv8UPAoiN-E1QRQdYcKH6OumXVNNcIN16WkTnV4IzILKrXLw Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/2e096fd0bb744b2e90cf090b2172662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 2e096fd0bb744b2e90cf090b2172662e Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1690220835 Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ea396576a90246cb8b821cb2afec9170 Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1690220835-project Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 could not be found. Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'c54ae4a0-4fdc-4128-85a3-f39fdb907468'} Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 could not be found. Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 could not be found. Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:10.197157 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:43:10.210137 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:10.210137 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:10.210137 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:43:10.210137 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:43:10.210137 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:43:10.210137 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:43:10.210137 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 could not be found. Oct 17 15:43:10.210137 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:10.213190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] Returning 404 to user: Instance c54ae4a0-4fdc-4128-85a3-f39fdb907468 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:43:10.234266 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-173bf8d9-a49c-483d-9736-4bad70efb723 tempest-ServerRescueNegativeTestJSON-1690220835 tempest-ServerRescueNegativeTestJSON-1690220835-project] 10.222.0.87 "GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468" status: 404 len: 111 microversion: 2.1 time: 0.199943 Oct 17 15:43:10.238869 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2008/4272] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:10 2022] GET /compute/v2.1/servers/c54ae4a0-4fdc-4128-85a3-f39fdb907468 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:43:10.782046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:10.804099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e81022c-a266-4413-bfac-198b803369b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1314 microversion: 2.1 time: 2.415613 Oct 17 15:43:10.812019 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2265/4273] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:08 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1314 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:11.074793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:11.077529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:11.112167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:11.114774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:11.117428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:11.118534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:11.121683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:11.124065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:11.538328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:11.558405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-65ab838b-19ef-4a45-8947-927bf57ce89d req-74bd4ab9-4cff-488c-971f-38a327e3b863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb53938-d95a-4f04-a223-2b4f3bffec21", "tag": "ab422ee2-f5d0-4f35-b021-58487235ce01"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:11.568611 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57556118-b39b-4bd7-85de-ab35155f37eb tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1271 microversion: 2.1 time: 0.499579 Oct 17 15:43:11.570129 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2009/4274] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:11 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1271 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:11.604682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-65ab838b-19ef-4a45-8947-927bf57ce89d req-74bd4ab9-4cff-488c-971f-38a327e3b863 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:11.613479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-65ab838b-19ef-4a45-8947-927bf57ce89d req-74bd4ab9-4cff-488c-971f-38a327e3b863 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:11.616489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-65ab838b-19ef-4a45-8947-927bf57ce89d req-74bd4ab9-4cff-488c-971f-38a327e3b863 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:11.676973 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-65ab838b-19ef-4a45-8947-927bf57ce89d req-74bd4ab9-4cff-488c-971f-38a327e3b863 service nova] Creating event network-changed:ab422ee2-f5d0-4f35-b021-58487235ce01 for instance ddb53938-d95a-4f04-a223-2b4f3bffec21 on n-h2-854441-12 Oct 17 15:43:11.687219 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-65ab838b-19ef-4a45-8947-927bf57ce89d req-74bd4ab9-4cff-488c-971f-38a327e3b863 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134295 Oct 17 15:43:11.688981 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2266/4275] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:43:11.860246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:11.861478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:11.877014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:11.883959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:11.883959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:11.883959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:11.883959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:11.883959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:12.607644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:12.610079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:12.639365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:12.640175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:12.640621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:12.641359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:12.641822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:12.642252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:12.936303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:12.950084 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c752cd6b-22eb-4f59-ae23-d8dcc4a93957 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1314 microversion: 2.1 time: 1.095776 Oct 17 15:43:12.968545 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2010/4276] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:11 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1314 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:13.001208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:13.011028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:13.037956 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b2848c1-362a-449f-b0c4-a4e2c8a3b9d9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1289 microversion: 2.1 time: 0.447571 Oct 17 15:43:13.040465 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2267/4277] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:12 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1289 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:13.981647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:13.982874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:14.026422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:14.030025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:14.035053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:14.037532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:14.038876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:14.041817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:14.080426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:14.088314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:14.121637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:14.125756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:14.128730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:14.131894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:14.135930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:14.136817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:14.666041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:14.687829 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-39af3f7c-5418-48dd-8aa3-3c26d2722ee3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1314 microversion: 2.1 time: 0.715174 Oct 17 15:43:14.690393 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2011/4278] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:13 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:14.702142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:14.715682 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f1da2be-3404-4b73-a18b-a0bf181b3223 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1277 microversion: 2.1 time: 0.650522 Oct 17 15:43:14.718264 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2268/4279] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:14 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1277 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:15.747515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:15.767976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:15.769073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:15.784867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:15.805100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:15.811890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:15.825569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:15.834081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:15.835395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:15.838911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:15.842043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:15.844064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:15.844930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:15.845124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:15.846111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:15.849652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:15.852470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:15.854393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:15.855770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:16.754091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:16.770203 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-89dd56ca-17dd-48f5-b457-dd2f6e4f4cab tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1314 microversion: 2.1 time: 1.044887 Oct 17 15:43:16.771805 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2012/4280] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:15 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:16.779111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-91fbfa99-fa23-4e82-a321-a22d871e90ac tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:16.780237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-91fbfa99-fa23-4e82-a321-a22d871e90ac tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:16.791986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91fbfa99-fa23-4e82-a321-a22d871e90ac tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:16.792800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91fbfa99-fa23-4e82-a321-a22d871e90ac tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:16.793551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91fbfa99-fa23-4e82-a321-a22d871e90ac tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:16.794582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91fbfa99-fa23-4e82-a321-a22d871e90ac tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:16.795299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91fbfa99-fa23-4e82-a321-a22d871e90ac tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:16.795932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91fbfa99-fa23-4e82-a321-a22d871e90ac tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:16.843444 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-91fbfa99-fa23-4e82-a321-a22d871e90ac tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/ips" status: 200 len: 146 microversion: 2.1 time: 0.069032 Oct 17 15:43:16.852147 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2013/4281] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:43:16 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/ips => generated 146 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:16.881625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:16.900839 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca78d64e-e844-42ea-9476-d09451493594 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1319 microversion: 2.1 time: 1.146393 Oct 17 15:43:16.902158 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2269/4282] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:15 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1319 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:17.760403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f20c37ba-0d45-41e4-b67a-8503ac92bfb8 req-7e4528f5-71c0-48c8-bb2a-848e9514cf6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0eb3eaa-acf7-4510-898c-87a14936db51", "tag": "e557081b-7164-4824-9c72-3c8fcc75da34"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:17.811246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f20c37ba-0d45-41e4-b67a-8503ac92bfb8 req-7e4528f5-71c0-48c8-bb2a-848e9514cf6c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:17.816190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f20c37ba-0d45-41e4-b67a-8503ac92bfb8 req-7e4528f5-71c0-48c8-bb2a-848e9514cf6c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:17.817290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:17.817414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f20c37ba-0d45-41e4-b67a-8503ac92bfb8 req-7e4528f5-71c0-48c8-bb2a-848e9514cf6c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:17.817923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:17.855223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:17.855632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:17.856089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:17.857197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:17.857794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:17.858247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:17.896423 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f20c37ba-0d45-41e4-b67a-8503ac92bfb8 req-7e4528f5-71c0-48c8-bb2a-848e9514cf6c service nova] Creating event network-changed:e557081b-7164-4824-9c72-3c8fcc75da34 for instance c0eb3eaa-acf7-4510-898c-87a14936db51 on n-h2-854441-12 Oct 17 15:43:17.941976 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f20c37ba-0d45-41e4-b67a-8503ac92bfb8 req-7e4528f5-71c0-48c8-bb2a-848e9514cf6c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182403 Oct 17 15:43:17.948456 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2014/4283] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:17.983932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:17.992597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:18.022788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:18.023493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:18.028638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:18.030146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:18.043015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:18.048294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:18.762990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:18.789375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:18.817996 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9d715e36-d0b7-4655-8271-1ec4880d3211 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1319 microversion: 2.1 time: 0.852969 Oct 17 15:43:18.817996 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2015/4284] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:17 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1319 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:19.396423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:19.410421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:19.419628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Searching by: {'deleted': False, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:19.428876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:19.445182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:19.450141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:19.452146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:19.454127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:19.456868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:19.458781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:19.531636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:19.562258 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31abfe3a-1e25-4ef9-be99-ab096ab87955 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1314 microversion: 2.1 time: 1.750376 Oct 17 15:43:19.565358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:19.583213 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2270/4285] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:17 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1314 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:19.590088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:19.693217 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4cf54984-bd36-4e4a-b02f-19b04a3088fc tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.304720 Oct 17 15:43:19.695637 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2016/4286] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:43:19 2022] GET /compute/v2.1/servers => generated 344 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:19.727933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:19.746859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:19.753347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Searching by: {'deleted': False, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:19.772844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:19.776637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:19.784773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:19.786137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:19.787977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:19.788783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:19.868249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:19.878188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:19.904116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:19.909049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:19.910882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:19.913642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:19.920976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:19.922451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:19.925506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:19.994299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=16 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:20.154577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:20.195018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:20.196762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:20.199134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:20.357947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:20.372275 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f8f5573-6dbb-4397-8710-dfdd4a76bdd8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1319 microversion: 2.1 time: 0.509801 Oct 17 15:43:20.379343 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2017/4287] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:19 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1319 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:20.593107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:20.594296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:20.641037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:20.642405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:20.643614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:20.645247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:20.646389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:20.651403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:21.514176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:21.539533 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8b541c38-9119-4fc3-aecd-086130708de1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1314 microversion: 2.1 time: 0.953752 Oct 17 15:43:21.568801 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2018/4288] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:20 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1314 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:21.582948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-da41d14c-e774-4e8d-a401-759371e968ec req-6b22712b-2e22-446c-a9db-01e8bea48aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b39d17-ff92-4fdc-aaff-6c6249cec45e", "tag": "17bc254d-8ec6-426f-aa21-be2ef71fa710"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:21.616483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-da41d14c-e774-4e8d-a401-759371e968ec req-6b22712b-2e22-446c-a9db-01e8bea48aeb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:21.617927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-da41d14c-e774-4e8d-a401-759371e968ec req-6b22712b-2e22-446c-a9db-01e8bea48aeb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:21.631875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-da41d14c-e774-4e8d-a401-759371e968ec req-6b22712b-2e22-446c-a9db-01e8bea48aeb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:21.666375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-da41d14c-e774-4e8d-a401-759371e968ec req-6b22712b-2e22-446c-a9db-01e8bea48aeb service nova] Creating event network-changed:17bc254d-8ec6-426f-aa21-be2ef71fa710 for instance 16b39d17-ff92-4fdc-aaff-6c6249cec45e on n-h1-854441-12 Oct 17 15:43:21.694585 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-da41d14c-e774-4e8d-a401-759371e968ec req-6b22712b-2e22-446c-a9db-01e8bea48aeb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129087 Oct 17 15:43:21.698680 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2019/4289] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:21.725599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:21.727147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:21.749848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:21.759776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:21.760942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:21.762476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:21.763374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:21.764480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:22.426854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:22.472514 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-727bb5e4-0401-4203-9ff8-217c17d051ad tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1319 microversion: 2.1 time: 0.765910 Oct 17 15:43:22.475889 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2020/4290] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:21 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1319 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:22.704778 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-264596ea-7590-4365-bca1-6438bfd04bcf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 2.984514 Oct 17 15:43:22.717642 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2271/4291] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:43:19 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 2998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:22.728284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ffb0d53d-347d-44e1-bc71-2b366d2e3e51 req-25b69cac-caad-4e54-8215-131533d80276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c607fd33-a4f9-4a9b-994f-f625d2e3ca66", "tag": "80f8a41f-ae57-4657-9919-f0ec8ebe09c3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:22.808507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ffb0d53d-347d-44e1-bc71-2b366d2e3e51 req-25b69cac-caad-4e54-8215-131533d80276 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:22.810414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ffb0d53d-347d-44e1-bc71-2b366d2e3e51 req-25b69cac-caad-4e54-8215-131533d80276 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:22.812441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ffb0d53d-347d-44e1-bc71-2b366d2e3e51 req-25b69cac-caad-4e54-8215-131533d80276 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:22.860755 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ffb0d53d-347d-44e1-bc71-2b366d2e3e51 req-25b69cac-caad-4e54-8215-131533d80276 service nova] Creating event network-changed:80f8a41f-ae57-4657-9919-f0ec8ebe09c3 for instance c607fd33-a4f9-4a9b-994f-f625d2e3ca66 on n-h1-854441-12 Oct 17 15:43:22.898566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ffb0d53d-347d-44e1-bc71-2b366d2e3e51 req-25b69cac-caad-4e54-8215-131533d80276 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163213 Oct 17 15:43:22.901587 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2272/4292] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:22.925866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:22.932824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:22.971099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:22.972123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:22.975102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:22.977930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:22.981480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:22.982387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:23.113672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5c5343af-6beb-435d-a156-e6474f788156 req-ee9c800c-9788-4a0e-9dfb-5d4b2a916491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb53938-d95a-4f04-a223-2b4f3bffec21", "name": "network-vif-plugged", "status": "completed", "tag": "ab422ee2-f5d0-4f35-b021-58487235ce01"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:23.141298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5c5343af-6beb-435d-a156-e6474f788156 req-ee9c800c-9788-4a0e-9dfb-5d4b2a916491 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:23.148074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5c5343af-6beb-435d-a156-e6474f788156 req-ee9c800c-9788-4a0e-9dfb-5d4b2a916491 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:23.148824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5c5343af-6beb-435d-a156-e6474f788156 req-ee9c800c-9788-4a0e-9dfb-5d4b2a916491 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:23.172902 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5c5343af-6beb-435d-a156-e6474f788156 req-ee9c800c-9788-4a0e-9dfb-5d4b2a916491 service nova] Creating event network-vif-plugged:ab422ee2-f5d0-4f35-b021-58487235ce01 for instance ddb53938-d95a-4f04-a223-2b4f3bffec21 on n-h2-854441-12 Oct 17 15:43:23.189353 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5c5343af-6beb-435d-a156-e6474f788156 req-ee9c800c-9788-4a0e-9dfb-5d4b2a916491 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.708840 Oct 17 15:43:23.189968 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2021/4293] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:23.204992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54205fa2-a346-49fd-8cbb-160325cecc1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84d1bc1d-ddde-4649-a752-5130499f200c"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:23.208090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-54205fa2-a346-49fd-8cbb-160325cecc1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:23.216822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54205fa2-a346-49fd-8cbb-160325cecc1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:23.217610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54205fa2-a346-49fd-8cbb-160325cecc1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:23.218308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54205fa2-a346-49fd-8cbb-160325cecc1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:23.221894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54205fa2-a346-49fd-8cbb-160325cecc1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:23.222462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54205fa2-a346-49fd-8cbb-160325cecc1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:23.227138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54205fa2-a346-49fd-8cbb-160325cecc1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:23.559287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:23.575857 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e86a74e9-a0f5-4b9e-8930-bab28ba94dbf tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1314 microversion: 2.1 time: 0.667944 Oct 17 15:43:23.576487 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2273/4294] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:22 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:23.599646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-863e7cf2-b570-43e6-ae0b-16a611a1458a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:23.609091 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-863e7cf2-b570-43e6-ae0b-16a611a1458a tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015267 Oct 17 15:43:23.609891 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2274/4295] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:43:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:23.630929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:23.632584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:23.641034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:23.642049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:23.642833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:23.644154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:23.644908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:23.645566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:24.056021 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-54205fa2-a346-49fd-8cbb-160325cecc1e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856214 Oct 17 15:43:24.056967 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2022/4296] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:43:23 2022] POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:24.064501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:24.065453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:24.073614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:24.074794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:24.075475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:24.076506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:24.077491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:24.078725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:24.179495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:43:24.353463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:24.367511 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3469e69c-5076-4944-82e0-01be52c76bfa tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1319 microversion: 2.1 time: 0.741934 Oct 17 15:43:24.368136 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2275/4297] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:23 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:24.457950 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7ca6254-efc3-4913-b9c8-a6e1e9f8dbfb tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "DELETE /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 204 len: 0 microversion: 2.1 time: 0.398695 Oct 17 15:43:24.461294 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2023/4298] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:43:24 2022] DELETE /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:43:24.471121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:24.471757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:24.495221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:24.498154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:24.501863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:24.512295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:24.516461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:24.520321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:24.605220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:24.607147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:24.627282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:24.628062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:24.628664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:24.634461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:24.634802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:24.644063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:25.045283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:25.057887 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0476ec96-67c5-49d2-8114-28352db6cccf tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1607 microversion: 2.1 time: 0.590625 Oct 17 15:43:25.059746 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2276/4299] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:24 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1607 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:25.409605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:25.411379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:25.438530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:25.442891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:25.443902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:25.449045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:25.450240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:25.475595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:26.072197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:26.082697 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d5796452-4824-4fc3-a7d8-903d2116b658 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1314 microversion: 2.1 time: 1.482174 Oct 17 15:43:26.086983 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2024/4300] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:24 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1314 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:26.107764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:26.111907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:26.138729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:26.139243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:26.140052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:26.141373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:26.142155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:26.142862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:26.219293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:26.270761 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5dc75279-addf-427c-98f5-317e5bf2fb0b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1319 microversion: 2.1 time: 0.877754 Oct 17 15:43:26.271905 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2277/4301] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:25 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1319 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:26.641087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:26.665719 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-df8e01a0-b9f1-444e-8790-b3e38cf1b13d tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1607 microversion: 2.1 time: 0.564665 Oct 17 15:43:26.667373 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2025/4302] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:26 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1607 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:27.112238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:27.113645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:27.130150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:27.133458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:27.136404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:27.137412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:27.142666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:27.148766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:27.302237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:27.304351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:27.337537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:27.338811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:27.339864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:27.341417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:27.361968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:27.364314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:27.922473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:27.946980 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bfa5983-2026-4fcb-90a7-fdb171accabc tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1500 microversion: 2.1 time: 0.838229 Oct 17 15:43:27.949249 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2278/4303] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:27 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1500 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:27.958470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5188db28-501f-4a7a-9b3b-5c6611284efa req-7a933bfb-61f0-4cfc-8aab-3f48416d0483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0eb3eaa-acf7-4510-898c-87a14936db51", "name": "network-vif-plugged", "status": "completed", "tag": "e557081b-7164-4824-9c72-3c8fcc75da34"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:27.987252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5188db28-501f-4a7a-9b3b-5c6611284efa req-7a933bfb-61f0-4cfc-8aab-3f48416d0483 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:27.989002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5188db28-501f-4a7a-9b3b-5c6611284efa req-7a933bfb-61f0-4cfc-8aab-3f48416d0483 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:27.990421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5188db28-501f-4a7a-9b3b-5c6611284efa req-7a933bfb-61f0-4cfc-8aab-3f48416d0483 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:28.026172 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5188db28-501f-4a7a-9b3b-5c6611284efa req-7a933bfb-61f0-4cfc-8aab-3f48416d0483 service nova] Creating event network-vif-plugged:e557081b-7164-4824-9c72-3c8fcc75da34 for instance c0eb3eaa-acf7-4510-898c-87a14936db51 on n-h2-854441-12 Oct 17 15:43:28.038865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5188db28-501f-4a7a-9b3b-5c6611284efa req-7a933bfb-61f0-4cfc-8aab-3f48416d0483 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087180 Oct 17 15:43:28.064272 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2279/4304] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:28.098214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:28.103061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:28.153886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:28.159804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:28.162198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:28.174105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:28.176438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:28.177841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:28.709460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:28.723907 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c0508f99-6c86-46db-880a-6f33b7131422 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1319 microversion: 2.1 time: 1.428357 Oct 17 15:43:28.724747 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2026/4305] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:27 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1319 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:28.736310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf32e735-6d24-43d3-92a4-a2aee56ef17e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:28.737005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf32e735-6d24-43d3-92a4-a2aee56ef17e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:28.753712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf32e735-6d24-43d3-92a4-a2aee56ef17e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:28.753712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf32e735-6d24-43d3-92a4-a2aee56ef17e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:28.753712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf32e735-6d24-43d3-92a4-a2aee56ef17e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:28.753712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf32e735-6d24-43d3-92a4-a2aee56ef17e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:28.753712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf32e735-6d24-43d3-92a4-a2aee56ef17e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:28.754446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf32e735-6d24-43d3-92a4-a2aee56ef17e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:29.085025 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf32e735-6d24-43d3-92a4-a2aee56ef17e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21/action" status: 202 len: 0 microversion: 2.1 time: 0.358777 Oct 17 15:43:29.086936 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2027/4306] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:43:28 2022] POST /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:43:29.130657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:29.185950 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3db6112a-7345-4459-b9f2-e4b5eee0f8b0 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1607 microversion: 2.1 time: 1.107788 Oct 17 15:43:29.210852 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2280/4307] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:28 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1607 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:29.234264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:29.235275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:29.253542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:29.254347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:29.255125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:29.256493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:29.257176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:29.257776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:29.507247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:29.682778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:29.705700 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3042c916-1ba8-4274-b017-43a11a291a3b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1505 microversion: 2.1 time: 0.492746 Oct 17 15:43:29.711672 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2281/4308] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:29 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:29.777674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:29.779494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:29.792501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:29.801031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:29.801489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:29.802247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:29.808866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:29.809446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:29.832648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:29.859039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1394343153", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "faceadf2-3886-4610-91a4-e555303d9351"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:30.053714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] validate_networks() for [('faceadf2-3886-4610-91a4-e555303d9351', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:43:30.133962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:30.416109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:30.436370 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a0d4234-2882-441d-bb92-af87b005c77b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1319 microversion: 2.1 time: 0.661082 Oct 17 15:43:30.437852 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2282/4309] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:29 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:30.481688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30403010-dade-4766-babb-f0c008ee4112 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:30.482532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30403010-dade-4766-babb-f0c008ee4112 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:30.494625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30403010-dade-4766-babb-f0c008ee4112 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:30.495502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30403010-dade-4766-babb-f0c008ee4112 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:30.496348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30403010-dade-4766-babb-f0c008ee4112 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:30.497735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30403010-dade-4766-babb-f0c008ee4112 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:30.499105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30403010-dade-4766-babb-f0c008ee4112 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:30.500230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30403010-dade-4766-babb-f0c008ee4112 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:30.655215 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30403010-dade-4766-babb-f0c008ee4112 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments/c724e526-fe21-499f-ab90-bf5cceef7db0" status: 200 len: 194 microversion: 2.20 time: 0.186318 Oct 17 15:43:30.674309 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2283/4310] 10.222.0.87 () {60 vars in 1454 bytes} [Mon Oct 17 15:43:30 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments/c724e526-fe21-499f-ab90-bf5cceef7db0 => generated 194 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:43:30.688651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-86b176b2-4a45-41d6-a01f-f756c7679f35 req-060e0081-2a8b-4f09-9c91-91bf425f6d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b39d17-ff92-4fdc-aaff-6c6249cec45e", "name": "network-vif-plugged", "status": "completed", "tag": "17bc254d-8ec6-426f-aa21-be2ef71fa710"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:30.732137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-86b176b2-4a45-41d6-a01f-f756c7679f35 req-060e0081-2a8b-4f09-9c91-91bf425f6d5f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:30.732940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-86b176b2-4a45-41d6-a01f-f756c7679f35 req-060e0081-2a8b-4f09-9c91-91bf425f6d5f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:30.733667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-86b176b2-4a45-41d6-a01f-f756c7679f35 req-060e0081-2a8b-4f09-9c91-91bf425f6d5f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:30.786489 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-86b176b2-4a45-41d6-a01f-f756c7679f35 req-060e0081-2a8b-4f09-9c91-91bf425f6d5f service nova] Creating event network-vif-plugged:17bc254d-8ec6-426f-aa21-be2ef71fa710 for instance 16b39d17-ff92-4fdc-aaff-6c6249cec45e on n-h1-854441-12 Oct 17 15:43:30.807136 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-86b176b2-4a45-41d6-a01f-f756c7679f35 req-060e0081-2a8b-4f09-9c91-91bf425f6d5f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127154 Oct 17 15:43:30.810863 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2284/4311] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:30.855112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:30.856325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:30.886859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:30.887775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:30.889358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:30.893090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:30.896400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:30.899791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:31.221868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:31.240433 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9afebe73-ad3b-47d8-b3dd-26934f5ab000 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1539 microversion: 2.1 time: 0.416682 Oct 17 15:43:31.247403 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2285/4312] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:30 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1539 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:31.266984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:31.267788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:31.283461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:31.284193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:31.284757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:31.285990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:31.286617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:31.287526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:31.706009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:31.708958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:31.720343 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21de9e0a-3ea6-49b7-8447-b53f949a135b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1485 microversion: 2.1 time: 0.468441 Oct 17 15:43:31.724908 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2286/4313] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:31 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1485 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:31.741010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:31.741864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:31.757363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:31.760837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:31.761794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:31.765211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:31.766059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:31.768522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:32.374180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:43:32.374985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:43:32.379350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:43:32.380404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:43:32.389596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:43:32.436929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:32.441154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:32.442311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:32.447946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:32.452770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:32.454090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:32.554726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Getting quotas for project f5fa00aa821a42528bda7754b91a80a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:43:32.582899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Getting quotas for user 00416e97e9374b3a850a72569098b258 and project f5fa00aa821a42528bda7754b91a80a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:43:32.684008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:43:32.694297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:43:32.891880 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-83e4ef0c-7117-4fa9-87db-1db6060f7add tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.801644 Oct 17 15:43:32.894322 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2028/4314] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:43:33.497057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ecd21b98-1d16-4cab-8fe1-0346ba313649 req-fda9ecd7-4169-4641-be3f-a4b30bd0a034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "040161bd-ce7c-4d30-a3c7-6b3b44c8ef41", "name": "network-vif-deleted", "tag": "be79e1b2-b725-483c-96a7-e0cc9aa52851"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:33.530124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ecd21b98-1d16-4cab-8fe1-0346ba313649 req-fda9ecd7-4169-4641-be3f-a4b30bd0a034 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:33.535042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ecd21b98-1d16-4cab-8fe1-0346ba313649 req-fda9ecd7-4169-4641-be3f-a4b30bd0a034 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:33.536705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ecd21b98-1d16-4cab-8fe1-0346ba313649 req-fda9ecd7-4169-4641-be3f-a4b30bd0a034 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:33.593078 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ecd21b98-1d16-4cab-8fe1-0346ba313649 req-fda9ecd7-4169-4641-be3f-a4b30bd0a034 service nova] Creating event network-vif-deleted:be79e1b2-b725-483c-96a7-e0cc9aa52851 for instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 on n-h1-854441-12 Oct 17 15:43:33.635364 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ecd21b98-1d16-4cab-8fe1-0346ba313649 req-fda9ecd7-4169-4641-be3f-a4b30bd0a034 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.717034 Oct 17 15:43:33.637810 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2029/4315] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:33.650054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:33.652575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:33.679805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:33.680737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:33.684331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:33.689725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:33.693598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:33.695727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:34.225735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:34.253170 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-469e1850-65c1-4418-89f4-7c164b56b6c9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1509 microversion: 2.1 time: 0.612072 Oct 17 15:43:34.265195 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2030/4316] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:33 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1509 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:34.284916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:34.291848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:34.317141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:34.317625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:34.318368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:34.318889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:34.319376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:34.319825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:34.391824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lazy-loading 'flavor' on Instance uuid ddb53938-d95a-4f04-a223-2b4f3bffec21 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:43:34.419923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:35.220666 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e3a1103-e3a7-4089-87ea-655843ae2800 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21/action" status: 202 len: 0 microversion: 2.1 time: 0.953650 Oct 17 15:43:35.226052 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2031/4317] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:43:34 2022] POST /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21/action => generated 0 bytes in 960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:43:35.233188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:35.234321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:35.246320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:35.249235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:35.250130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:35.251225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:35.251998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:35.252709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:35.546023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:35.570846 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97b38d43-b86a-4506-aa5c-2569095cf18e tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1251 microversion: 2.1 time: 0.342574 Oct 17 15:43:35.573371 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2032/4318] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:35 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1251 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:35.596560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:35.611300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:35.622583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:35.624164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:35.629466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:35.643161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:35.644750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:35.645824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:35.955082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:35.971444 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7897b98d-2b5e-4155-860f-95d12fbe80b5 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1285 microversion: 2.1 time: 0.395752 Oct 17 15:43:35.971444 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2033/4319] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:35 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1285 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:35.995200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:35.995836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:36.038338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:36.045973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:36.056323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:36.057552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:36.064420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:36.066168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:36.922386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:36.937417 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-304dfd35-6f64-499f-bcca-12885555c36d tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1511 microversion: 2.1 time: 0.953549 Oct 17 15:43:36.940191 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2034/4320] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:35 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1511 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:36.946122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:36.952146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:36.980528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:36.981172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:36.981984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:36.982762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:36.983193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:36.983549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:37.761005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:37.794480 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-368da3a9-8c56-4a83-92be-0ea6fcc08417 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1512 microversion: 2.1 time: 0.848720 Oct 17 15:43:37.796189 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2035/4321] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:36 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1512 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:37.816244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-debc6215-6afb-436c-a5ed-ae55fb93728c req-8d15a5dc-bfbc-4c07-9714-a37ed01adcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c607fd33-a4f9-4a9b-994f-f625d2e3ca66", "name": "network-vif-plugged", "status": "completed", "tag": "80f8a41f-ae57-4657-9919-f0ec8ebe09c3"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:37.859775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-debc6215-6afb-436c-a5ed-ae55fb93728c req-8d15a5dc-bfbc-4c07-9714-a37ed01adcd4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:37.862915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-debc6215-6afb-436c-a5ed-ae55fb93728c req-8d15a5dc-bfbc-4c07-9714-a37ed01adcd4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:37.867019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-debc6215-6afb-436c-a5ed-ae55fb93728c req-8d15a5dc-bfbc-4c07-9714-a37ed01adcd4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:37.916601 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-debc6215-6afb-436c-a5ed-ae55fb93728c req-8d15a5dc-bfbc-4c07-9714-a37ed01adcd4 service nova] Creating event network-vif-plugged:80f8a41f-ae57-4657-9919-f0ec8ebe09c3 for instance c607fd33-a4f9-4a9b-994f-f625d2e3ca66 on n-h1-854441-12 Oct 17 15:43:37.935383 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-debc6215-6afb-436c-a5ed-ae55fb93728c req-8d15a5dc-bfbc-4c07-9714-a37ed01adcd4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135519 Oct 17 15:43:37.940235 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2036/4322] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:37.963888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:37.965464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:37.991576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:37.995615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:37.996910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:38.000106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:38.006865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:38.009078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:38.176551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:38.190429 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-09582775-798b-4652-9bd6-07295b9985b1 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1251 microversion: 2.1 time: 0.247641 Oct 17 15:43:38.196482 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2037/4323] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:37 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1251 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:38.207236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:38.210056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:38.229705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:38.232657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:38.235379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:38.236359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:38.246753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:38.247823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:38.529226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:38.557497 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36e53e32-e6ac-495f-a0f4-3e42f8324320 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 200 len: 1320 microversion: 2.1 time: 0.358162 Oct 17 15:43:38.576246 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2038/4324] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:38 2022] GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:38.601574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:38.603280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:38.620600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:38.621982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:38.623071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:38.624607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:38.626978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:38.628127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:39.211917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:39.250325 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-11a619d5-b954-431f-8b53-3936694db954 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1325 microversion: 2.1 time: 0.671449 Oct 17 15:43:39.276111 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2039/4325] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:38 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1325 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:39.290965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:39.295626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:39.311682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:39.313331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:39.314322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:39.316300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:39.317399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:39.318411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:39.645823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:39.713197 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22e4c1d0-c932-416a-bb8f-acf3ad2680ec tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 0.432325 Oct 17 15:43:39.714279 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2040/4326] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:39 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:39.749664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:39.752284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:39.765926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:39.767606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:39.769348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:39.770848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:39.772089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:39.774034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:40.011578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:40.043109 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8cd9e5d-fa3e-4851-a344-0afd8caf7752 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1251 microversion: 2.1 time: 0.320993 Oct 17 15:43:40.044521 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2041/4327] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:39 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1251 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:40.052341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:40.053374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:40.081995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:40.082867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:40.083754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:40.084898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:40.085682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:40.097108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:40.472352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:40.488670 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b6ff12a6-346e-4e69-aef8-4f9cd11600be tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 200 len: 1320 microversion: 2.1 time: 0.442592 Oct 17 15:43:40.489284 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2042/4328] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:40 2022] GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 1320 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:40.497903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:40.504487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:40.515256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:40.518113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:40.520881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:40.521972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:40.526040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:40.528573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:40.805520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:40.815255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-be89c374-342a-4235-a187-35868bb18d59 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1325 microversion: 2.1 time: 0.324688 Oct 17 15:43:40.817283 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2043/4329] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:40 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:40.822654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:40.823643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:40.831018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:40.831909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:40.832570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:40.833649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:40.834411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:40.835095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:41.252104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:41.267519 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a8d0de54-6751-4995-9dfe-eebbc4aadb4c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 0.448741 Oct 17 15:43:41.268160 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2044/4330] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:40 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:41.304842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:41.306013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:41.335340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:41.336184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:41.336836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:41.338137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:41.345011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:41.347601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:41.509045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:41.520624 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e0c36f85-785d-4ea1-b6ee-22a01b6c5032 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1251 microversion: 2.1 time: 0.228206 Oct 17 15:43:41.521231 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2045/4331] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:41 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1251 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:41.571915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:41.586888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:41.621613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:41.631884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:41.633114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:41.634835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:41.636012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:41.637074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:41.755252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=39 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:41.827166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:42.134853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:42.178718 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c57a0dd3-326f-4241-a8a4-a0057a0567dd tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 200 len: 1510 microversion: 2.1 time: 0.629704 Oct 17 15:43:42.179779 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2046/4332] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:41 2022] GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 1510 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:42.235382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:42.236507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:42.262775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:42.263807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:42.264595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:42.265833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:42.266627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:42.267377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:42.289546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:42.500870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:42.633395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:42.796575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:42.829548 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-999f76eb-702a-411b-8452-67e52e7e5dee tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1325 microversion: 2.1 time: 0.617213 Oct 17 15:43:42.830638 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2047/4333] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:42 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1325 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:42.855156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:42.880631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:42.885959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:42.935121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:42.936429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:42.937202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:42.938723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:42.939528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:42.940318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:42.953763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lazy-loading 'services' on Instance uuid 45f53954-5109-4fb4-8634-490b9664c7d8 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:43:43.415535 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-616b78f6-1167-412c-9caa-ebcd539c2ef0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "DELETE /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments/c724e526-fe21-499f-ab90-bf5cceef7db0" status: 202 len: 0 microversion: 2.20 time: 11.688741 Oct 17 15:43:43.418396 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2287/4334] 10.222.0.87 () {60 vars in 1457 bytes} [Mon Oct 17 15:43:31 2022] DELETE /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments/c724e526-fe21-499f-ab90-bf5cceef7db0 => generated 0 bytes in 11692 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:43:43.434710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:43.436905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:43.456869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:43.459144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:43.459990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:43.463184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:43.463788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:43.464251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:43.762148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:44.005040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:44.041215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:44.042178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:44.043060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:44.191689 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:43:44.192358 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 15:43:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 (ip 10.222.0.87) !!! Oct 17 15:43:44.446687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:44.471124 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b976608-960e-4ad6-ad10-1f218a16ea14 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 1.047084 Oct 17 15:43:44.487146 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a06622f3-3788-4c15-b90f-97ca01ac9a02 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1512 microversion: 2.1 time: 1.654557 Oct 17 15:43:44.499436 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2288/4335] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:43 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:44.508507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:44.509155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:44.531622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2048/4336] 10.222.0.87 () {58 vars in 1167 bytes} [Mon Oct 17 15:43:42 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1512 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:44.547818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-14e66142-85a4-4ea7-b0d3-0e12904207f1 req-eae6ef8a-2e85-4108-a48c-ad0b6241ae7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb53938-d95a-4f04-a223-2b4f3bffec21", "name": "network-vif-plugged", "status": "completed", "tag": "ab422ee2-f5d0-4f35-b021-58487235ce01"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:44.574839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:44.575646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:44.582220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:44.583954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:44.587997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:44.592306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:44.596748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-14e66142-85a4-4ea7-b0d3-0e12904207f1 req-eae6ef8a-2e85-4108-a48c-ad0b6241ae7c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:44.598233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-14e66142-85a4-4ea7-b0d3-0e12904207f1 req-eae6ef8a-2e85-4108-a48c-ad0b6241ae7c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:44.599314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-14e66142-85a4-4ea7-b0d3-0e12904207f1 req-eae6ef8a-2e85-4108-a48c-ad0b6241ae7c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:44.672408 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-14e66142-85a4-4ea7-b0d3-0e12904207f1 req-eae6ef8a-2e85-4108-a48c-ad0b6241ae7c service nova] Creating event network-vif-plugged:ab422ee2-f5d0-4f35-b021-58487235ce01 for instance ddb53938-d95a-4f04-a223-2b4f3bffec21 on n-h2-854441-12 Oct 17 15:43:44.720038 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-14e66142-85a4-4ea7-b0d3-0e12904207f1 req-eae6ef8a-2e85-4108-a48c-ad0b6241ae7c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186606 Oct 17 15:43:44.726164 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2049/4337] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:44.732708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7f94a7d-582d-4774-a989-92037cf81e1d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:44.751312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:44.752227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:44.753503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c7f94a7d-582d-4774-a989-92037cf81e1d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:44.753951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:44.754872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lazy-loading 'fault' on Instance uuid 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:43:44.773932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7f94a7d-582d-4774-a989-92037cf81e1d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:44.777274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7f94a7d-582d-4774-a989-92037cf81e1d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:44.779669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7f94a7d-582d-4774-a989-92037cf81e1d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:44.781404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7f94a7d-582d-4774-a989-92037cf81e1d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:44.783085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7f94a7d-582d-4774-a989-92037cf81e1d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:44.783772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7f94a7d-582d-4774-a989-92037cf81e1d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:44.874419 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7f94a7d-582d-4774-a989-92037cf81e1d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146454 Oct 17 15:43:44.882792 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2050/4338] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:43:44 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:43:44.892495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ca47debd-acb5-40ac-a52d-70e6d6f43f34 req-c99caeb0-038b-4d16-a443-fdac14148038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547ce8bf-a340-468f-8b0b-409c53130a9f", "tag": "94e7d254-848f-426b-a459-759e2113cd24"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:44.913255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ca47debd-acb5-40ac-a52d-70e6d6f43f34 req-c99caeb0-038b-4d16-a443-fdac14148038 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:44.914155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ca47debd-acb5-40ac-a52d-70e6d6f43f34 req-c99caeb0-038b-4d16-a443-fdac14148038 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:44.914867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ca47debd-acb5-40ac-a52d-70e6d6f43f34 req-c99caeb0-038b-4d16-a443-fdac14148038 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:44.938008 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ca47debd-acb5-40ac-a52d-70e6d6f43f34 req-c99caeb0-038b-4d16-a443-fdac14148038 service nova] Creating event network-changed:94e7d254-848f-426b-a459-759e2113cd24 for instance 547ce8bf-a340-468f-8b0b-409c53130a9f on n-h2-854441-12 Oct 17 15:43:44.956470 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ca47debd-acb5-40ac-a52d-70e6d6f43f34 req-c99caeb0-038b-4d16-a443-fdac14148038 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071973 Oct 17 15:43:44.957791 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2051/4339] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:44.963787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:44.981684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:45.009138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:45.015357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:45.017909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:45.022196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:45.022747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:45.023211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:45.233081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb79e124f6b4ac19bbc5ad9f86da68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5029749bd7ab4560a06f5f862a2ef22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:45.265482 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6fbd9dcc-0563-4478-b2ad-b8c1ca6dfcab tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 200 len: 1210 microversion: 2.1 time: 0.763948 Oct 17 15:43:45.274539 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2289/4340] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:44 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 1210 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:45.294588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:45.316757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:45.321072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1561061362', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:45.359685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:45.361236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:45.364028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:45.367082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:45.368755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:45.369957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:45.769855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:45.790322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a34b701e-eb75-4c31-ae3d-09d7b19ee792 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1325 microversion: 2.1 time: 0.830872 Oct 17 15:43:45.792624 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2052/4341] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:44 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1325 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:45.806598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:45.807746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:45.823037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:45.825511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:45.829329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:45.831447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:45.833321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:45.834122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:45.898049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:46.094553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:46.102405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:46.103554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:46.104257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:46.367642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:46.404139 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fefe25a7-cfdb-42e5-9152-9b126e735c5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 0.609714 Oct 17 15:43:46.415226 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2053/4342] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:45 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:46.424821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-274c1cd0-fdac-4171-a4c7-e7fc03dd8adf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:46.436298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-274c1cd0-fdac-4171-a4c7-e7fc03dd8adf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:46.446414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:46.449323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-274c1cd0-fdac-4171-a4c7-e7fc03dd8adf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:46.450192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-274c1cd0-fdac-4171-a4c7-e7fc03dd8adf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:46.450922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-274c1cd0-fdac-4171-a4c7-e7fc03dd8adf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:46.468415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-274c1cd0-fdac-4171-a4c7-e7fc03dd8adf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:46.469655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-274c1cd0-fdac-4171-a4c7-e7fc03dd8adf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:46.470326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-274c1cd0-fdac-4171-a4c7-e7fc03dd8adf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:46.577027 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-274c1cd0-fdac-4171-a4c7-e7fc03dd8adf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.167410 Oct 17 15:43:46.579615 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2054/4343] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:43:46 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:43:46.593718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:46.595344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] [instance: 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:46.610900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:46.611688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:46.613989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:46.614825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:46.617019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:46.617792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:46.677345 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] HTTP exception thrown: Instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 could not be found. Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Request method failure captured: Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 HTTP/1.1 Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXeIhdzibaHGMWytHWotOhUW-CjOeMn-2bune47uE-xn-hKxo0_RStRyRuCyAnUyG-z3pt1tQoJHE6pGUOzx4bHVVsngsWdgOMZSSpKDS4EOi99pZfYCIO4Ktd60_pnYOG9D2vy7GihrpJxIF1GVsrreJM9r3sbKKpTIhGgXb3s8C1g Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 5029749bd7ab4560a06f5f862a2ef22e Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestBootFromVolume-1662656480 Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5029749bd7ab4560a06f5f862a2ef22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5029749bd7ab4560a06f5f862a2ef22e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5029749bd7ab4560a06f5f862a2ef22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5029749bd7ab4560a06f5f862a2ef22e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestBootFromVolume-1662656480 Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 5029749bd7ab4560a06f5f862a2ef22e Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1662656480 Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestBootFromVolume-1662656480-project Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: abb79e124f6b4ac19bbc5ad9f86da68a Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestBootFromVolume-1662656480-project Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 could not be found. Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '040161bd-ce7c-4d30-a3c7-6b3b44c8ef41'} Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 could not be found. Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 could not be found. Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:43:46.690405 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:46.694780 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:46.694780 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:43:46.694780 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:43:46.694780 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:43:46.694780 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:43:46.694780 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 could not be found. Oct 17 15:43:46.694780 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:43:46.694780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Returning 404 to user: Instance 040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:43:46.694780 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8be6666b-18b9-4f0a-a6e8-2a9a0a7c0b18 tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41" status: 404 len: 111 microversion: 2.1 time: 0.111900 Oct 17 15:43:46.702043 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2055/4344] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:46 2022] GET /compute/v2.1/servers/040161bd-ce7c-4d30-a3c7-6b3b44c8ef41 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:43:46.717423 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c0c10b79-711b-4687-b9a0-93b636fdaee4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1561061362" status: 200 len: 1514 microversion: 2.1 time: 1.440621 Oct 17 15:43:46.730798 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2290/4345] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:43:45 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1561061362 => generated 1514 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:46.746542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d03d3564-0506-4c08-b2a6-c1d757b7ae9c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] Calling method '.version_select at 0x7f28c2e30ee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:46.763467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:46.774649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:46.775797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:46.782446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:46.783317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:46.783960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:46.784817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:46.785486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:46.786031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:46.834773 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d03d3564-0506-4c08-b2a6-c1d757b7ae9c tempest-ServersTestBootFromVolume-1662656480 tempest-ServersTestBootFromVolume-1662656480-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24271739" status: 202 len: 0 microversion: 2.1 time: 0.121371 Oct 17 15:43:46.860638 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2056/4346] 10.222.0.87 () {58 vars in 1215 bytes} [Mon Oct 17 15:43:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24271739 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:43:46.874968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:46.876407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:46.908626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:46.909533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:46.910369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:46.911820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:46.912754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:46.913542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:46.973028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:47.121306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:47.142448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:47.143409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:47.144002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:47.468519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:47.486578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-606ab4cc-1ed8-4b4f-9b5c-b0397355814e tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1325 microversion: 2.1 time: 0.622765 Oct 17 15:43:47.489687 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2057/4347] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:46 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1325 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:47.502612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:47.509803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:47.524193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:47.527711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:47.529128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:47.530158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:47.532221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:47.534067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:47.678588 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a332d35e-f25d-4d0f-9d60-24744bbcd258 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4513 microversion: 2.1 time: 0.919228 Oct 17 15:43:47.691240 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2291/4348] 10.222.0.87 () {58 vars in 1173 bytes} [Mon Oct 17 15:43:46 2022] GET /compute/v2.1/servers/detail?status=active => generated 4513 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:43:47.720660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d02f735-4837-4d33-a6eb-1fd43f9050f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:47.739680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d02f735-4837-4d33-a6eb-1fd43f9050f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:47.765552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d02f735-4837-4d33-a6eb-1fd43f9050f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:47.766989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d02f735-4837-4d33-a6eb-1fd43f9050f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:47.768104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d02f735-4837-4d33-a6eb-1fd43f9050f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:47.769786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d02f735-4837-4d33-a6eb-1fd43f9050f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:47.770960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d02f735-4837-4d33-a6eb-1fd43f9050f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:47.772077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d02f735-4837-4d33-a6eb-1fd43f9050f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:47.887899 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d02f735-4837-4d33-a6eb-1fd43f9050f2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.194620 Oct 17 15:43:47.898683 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2292/4349] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:43:47 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:43:47.908843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:47.929532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:47.930530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.servers [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Removing options 'limit' from query {{(pid=120406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 15:43:47.932369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:47.954659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:47.958215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:47.959807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:47.962887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:47.967989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:47.969666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:48.102368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:48.126473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:48.127784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:48.130366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:48.729348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:48.749642 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2ea3c987-5d12-48cf-a1b3-d567db3ccf86 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 1.253855 Oct 17 15:43:48.750654 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2058/4350] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:47 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:48.769323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:48.771105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:48.792389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:48.793904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:48.795364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:48.799896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:48.800604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:48.801297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:48.971541 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b013c0a8-6716-4295-9876-23d44ddf1a09 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1658 microversion: 2.1 time: 1.069838 Oct 17 15:43:48.972626 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2293/4351] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 15:43:47 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1658 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:48.989609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-837637dd-bdca-4ff3-86ee-c2e66b43de69 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:48.995070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-837637dd-bdca-4ff3-86ee-c2e66b43de69 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:49.028948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-837637dd-bdca-4ff3-86ee-c2e66b43de69 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:49.029932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-837637dd-bdca-4ff3-86ee-c2e66b43de69 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:49.030739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-837637dd-bdca-4ff3-86ee-c2e66b43de69 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:49.036983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-837637dd-bdca-4ff3-86ee-c2e66b43de69 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:49.037976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-837637dd-bdca-4ff3-86ee-c2e66b43de69 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:49.038798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-837637dd-bdca-4ff3-86ee-c2e66b43de69 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:49.172756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-837637dd-bdca-4ff3-86ee-c2e66b43de69 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.197366 Oct 17 15:43:49.177599 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2294/4352] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:43:48 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:43:49.180034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:49.200474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:49.204862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:49.216138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:49.217947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:49.218391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:49.221042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:49.222299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:49.223801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:49.477343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:49.649578 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8dee5562-59f4-492b-95fc-011658a1af7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.474247 Oct 17 15:43:49.650546 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2295/4353] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:43:49 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:49.724048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:49.736287 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf9c886e-73ce-458d-a396-3fe1d4384754 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1325 microversion: 2.1 time: 0.982051 Oct 17 15:43:49.736940 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2059/4354] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:48 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1325 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:49.754255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:49.770551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:49.776433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.compute.servers [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Removing options 'limit' from query {{(pid=120407) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 15:43:49.778036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:49.792485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:49.793791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:49.797494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:49.798735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:49.799412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:49.800137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:49.887337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:49.983029 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f9301ce-280f-4a91-af4b-97ca2d168eab tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.243066 Oct 17 15:43:49.985302 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2060/4355] 10.222.0.87 () {58 vars in 1150 bytes} [Mon Oct 17 15:43:49 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:50.003357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:50.004504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:50.028344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:50.030476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:50.035546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:50.036914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:50.041325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:50.045549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:50.078541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1021296808", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:50.231552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] validate_networks() for [('3d2dceb7-fa1f-47b7-a54c-dede4194eb86', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:43:50.613710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:50.626446 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ecf7eb6d-b9ff-4520-b93f-5dc83d74efe3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 0.639631 Oct 17 15:43:50.642531 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2061/4356] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:49 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:50.657129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:50.673265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:50.674940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:50.707152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:50.708055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:50.708988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:50.710780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:50.713852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:50.716867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:50.804341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:50.880514 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-693f0584-90a9-4173-bf94-d827096696ba tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.235266 Oct 17 15:43:50.881822 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2062/4357] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:43:50 2022] GET /compute/v2.1/servers => generated 1009 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:50.889154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38f52100-d92e-4a80-8f06-cd28ba9c5cfc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:50.892693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-38f52100-d92e-4a80-8f06-cd28ba9c5cfc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:50.901516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f52100-d92e-4a80-8f06-cd28ba9c5cfc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:50.902546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f52100-d92e-4a80-8f06-cd28ba9c5cfc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:50.903244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f52100-d92e-4a80-8f06-cd28ba9c5cfc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:50.905290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f52100-d92e-4a80-8f06-cd28ba9c5cfc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:50.907327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f52100-d92e-4a80-8f06-cd28ba9c5cfc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:50.908083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38f52100-d92e-4a80-8f06-cd28ba9c5cfc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:50.957406 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-38f52100-d92e-4a80-8f06-cd28ba9c5cfc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073980 Oct 17 15:43:50.958399 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2063/4358] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:43:50 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:43:50.966277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:50.967393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:50.977585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:50.979043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:50.979890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:50.981120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:50.981848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:50.982669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:51.758399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:51.783439 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c20f15ba-e335-408b-8c9b-0834116c0deb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1325 microversion: 2.1 time: 0.823158 Oct 17 15:43:51.784500 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2064/4359] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:50 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1325 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:51.826690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:51.846159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:51.848532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:51.882875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:51.884041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:51.886161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:51.887342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:51.890257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:51.891252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:52.128857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:52.134533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:52.195915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:43:52.196573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:43:52.196852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:43:52.197462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:43:52.198044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:43:52.219222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:52.225759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:52.229136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:52.230211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:52.230887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:52.231513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:52.299770 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-13bdc64a-cbd4-45aa-8ced-f9f1cf86fee7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.484647 Oct 17 15:43:52.305822 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2065/4360] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:43:51 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:52.320144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Getting quotas for project b8e3c8332d724f649611c888b2d5639b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:43:52.326349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:52.327239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:52.342665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Getting quotas for user 867ef1e9bae64d5fb08ea45376f905c8 and project b8e3c8332d724f649611c888b2d5639b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:43:52.356062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:52.356590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:52.357047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:52.357798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:52.358270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:52.364303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:52.398729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:43:52.415884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:43:52.520394 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d414a79f-6150-4d84-8461-c7d5a27ffe78 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.868315 Oct 17 15:43:52.532047 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2296/4361] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:43:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:43:52.537891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afeb6084-a96e-434a-8c91-8c735aa2e5c6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:52.547978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-afeb6084-a96e-434a-8c91-8c735aa2e5c6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:52.560407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afeb6084-a96e-434a-8c91-8c735aa2e5c6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:52.561314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afeb6084-a96e-434a-8c91-8c735aa2e5c6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:52.562156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afeb6084-a96e-434a-8c91-8c735aa2e5c6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:52.563826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afeb6084-a96e-434a-8c91-8c735aa2e5c6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:52.564587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afeb6084-a96e-434a-8c91-8c735aa2e5c6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:52.565245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-afeb6084-a96e-434a-8c91-8c735aa2e5c6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:52.690557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-afeb6084-a96e-434a-8c91-8c735aa2e5c6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.156810 Oct 17 15:43:52.706589 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2297/4362] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:43:52 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:43:52.725400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:52.770084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:52.782231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.servers [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Removing options 'limit' from query {{(pid=120406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 15:43:52.788180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:52.834954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:52.836275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:52.837281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:52.840845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:52.850208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:52.851234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:53.208743 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98a6a08d-9c3e-40b5-a38d-2e70f781df39 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.502649 Oct 17 15:43:53.220594 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2298/4363] 10.222.0.87 () {58 vars in 1140 bytes} [Mon Oct 17 15:43:52 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:53.251385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf54e1d8-404b-424d-a360-a34abc92f686 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:53.259719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf54e1d8-404b-424d-a360-a34abc92f686 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:53.989379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:54.205304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:54.229704 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9701b207-0631-467e-b7a5-c496eb5db995 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 1.921514 Oct 17 15:43:54.230582 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2066/4364] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:52 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:54.270850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:54.271610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:54.292148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:54.295325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:54.296104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:54.301768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:54.302666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:54.303314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:54.624333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf54e1d8-404b-424d-a360-a34abc92f686 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:54.650240 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf54e1d8-404b-424d-a360-a34abc92f686 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1217 microversion: 2.1 time: 1.415839 Oct 17 15:43:54.654938 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2299/4365] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:53 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1217 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:54.671681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:54.688290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:54.693439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1561061362', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:43:54.708625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:54.711269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:54.712528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:54.713817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:54.714481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:54.715098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:54.934779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:43:55.277342 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5593283f-2e45-423e-b1d4-9a9914c1d530 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1561061362" status: 200 len: 346 microversion: 2.1 time: 0.612911 Oct 17 15:43:55.278605 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2300/4366] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 15:43:54 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1561061362 => generated 346 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:55.307194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b06692c-d3ac-4b03-a5c6-92fee4b9d74c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:55.311533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b06692c-d3ac-4b03-a5c6-92fee4b9d74c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:55.328897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b06692c-d3ac-4b03-a5c6-92fee4b9d74c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:55.341229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b06692c-d3ac-4b03-a5c6-92fee4b9d74c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:55.345241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b06692c-d3ac-4b03-a5c6-92fee4b9d74c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:55.347914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b06692c-d3ac-4b03-a5c6-92fee4b9d74c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:55.349033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b06692c-d3ac-4b03-a5c6-92fee4b9d74c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:55.351162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b06692c-d3ac-4b03-a5c6-92fee4b9d74c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:55.481416 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b06692c-d3ac-4b03-a5c6-92fee4b9d74c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.201045 Oct 17 15:43:55.482055 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2301/4367] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:43:55 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:43:55.488182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c7f308bd-fc84-4df8-9b9f-903e638bb54a req-b3071fa2-358b-4341-b9b8-b9532d5b536b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547ce8bf-a340-468f-8b0b-409c53130a9f", "name": "network-vif-plugged", "status": "completed", "tag": "94e7d254-848f-426b-a459-759e2113cd24"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:55.518538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7f308bd-fc84-4df8-9b9f-903e638bb54a req-b3071fa2-358b-4341-b9b8-b9532d5b536b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:55.519031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7f308bd-fc84-4df8-9b9f-903e638bb54a req-b3071fa2-358b-4341-b9b8-b9532d5b536b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:55.519459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7f308bd-fc84-4df8-9b9f-903e638bb54a req-b3071fa2-358b-4341-b9b8-b9532d5b536b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:55.561040 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c7f308bd-fc84-4df8-9b9f-903e638bb54a req-b3071fa2-358b-4341-b9b8-b9532d5b536b service nova] Creating event network-vif-plugged:94e7d254-848f-426b-a459-759e2113cd24 for instance 547ce8bf-a340-468f-8b0b-409c53130a9f on n-h2-854441-12 Oct 17 15:43:55.576628 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c7f308bd-fc84-4df8-9b9f-903e638bb54a req-b3071fa2-358b-4341-b9b8-b9532d5b536b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093225 Oct 17 15:43:55.577563 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2302/4368] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:43:55.583633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebb2787e-debb-49f0-bad5-857f8a840bf4 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:55.591698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebb2787e-debb-49f0-bad5-857f8a840bf4 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:55.592200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebb2787e-debb-49f0-bad5-857f8a840bf4 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:55.592635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebb2787e-debb-49f0-bad5-857f8a840bf4 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:55.676864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebb2787e-debb-49f0-bad5-857f8a840bf4 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Going to try to stop instance {{(pid=120406) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 15:43:55.737227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:43:55.794830 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebb2787e-debb-49f0-bad5-857f8a840bf4 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/action" status: 202 len: 0 microversion: 2.1 time: 0.215621 Oct 17 15:43:55.796280 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2303/4369] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:43:55 2022] POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:43:55.802125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:55.803349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:55.810948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:55.811811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:55.812428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:55.813481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:55.814105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:55.814735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:55.889074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:55.971433 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-50e910c7-bda5-4e41-9952-a1692a4242c6 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1325 microversion: 2.1 time: 1.714847 Oct 17 15:43:55.978342 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2067/4370] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:54 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1325 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:56.022936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a8e6def-c674-4897-8bd6-171a8e95b34a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:43:56.106977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a8e6def-c674-4897-8bd6-171a8e95b34a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:56.108074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a8e6def-c674-4897-8bd6-171a8e95b34a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:56.108883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a8e6def-c674-4897-8bd6-171a8e95b34a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:56.234996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a8e6def-c674-4897-8bd6-171a8e95b34a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Going to try to stop instance {{(pid=120407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 15:43:56.406677 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a8e6def-c674-4897-8bd6-171a8e95b34a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "POST /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51/action" status: 202 len: 0 microversion: 2.1 time: 0.417453 Oct 17 15:43:56.410484 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2068/4371] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:43:55 2022] POST /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:43:56.438176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:56.443449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:56.466423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:56.467575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:56.468283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:56.471154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:56.472896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:56.476237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:56.738210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:56.765743 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bbd159d4-11f1-4c65-9d33-95faf0568c6f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1287 microversion: 2.1 time: 0.350243 Oct 17 15:43:56.766666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:56.774273 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2069/4372] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:56 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1287 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:56.800671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:56.802064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:56.809761 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-086fad51-b4dd-4ba0-8bf7-21942e7b4dd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 1.011467 Oct 17 15:43:56.813392 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2304/4373] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:55 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:56.823256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:56.835347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:56.835762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:56.836484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:56.837554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:56.842843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:56.844167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:56.845942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:56.858688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:56.859199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:56.859650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:56.868806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:56.869085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:56.869534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:57.285211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:57.299988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eefbd032-c79b-4f66-9eca-af42379a7a7a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1521 microversion: 2.1 time: 0.484310 Oct 17 15:43:57.305035 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2305/4374] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:56 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:57.318473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce7b876b-e7d3-4978-a8d0-a4fc945b260b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:57.324543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce7b876b-e7d3-4978-a8d0-a4fc945b260b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:57.343931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7b876b-e7d3-4978-a8d0-a4fc945b260b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:57.344443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7b876b-e7d3-4978-a8d0-a4fc945b260b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:57.346527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7b876b-e7d3-4978-a8d0-a4fc945b260b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:57.347977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7b876b-e7d3-4978-a8d0-a4fc945b260b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:57.348472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7b876b-e7d3-4978-a8d0-a4fc945b260b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:57.348995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce7b876b-e7d3-4978-a8d0-a4fc945b260b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:57.428836 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce7b876b-e7d3-4978-a8d0-a4fc945b260b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122452 Oct 17 15:43:57.432501 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2306/4375] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:43:57 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:43:57.446847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:57.451127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:57.471839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:57.472426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:57.472948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:57.473955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:57.474435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:57.478660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:57.930702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:57.940446 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cc99c430-d28d-4c57-aec4-e349171f3e99 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1325 microversion: 2.1 time: 0.506649 Oct 17 15:43:57.957957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:57.962552 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2307/4376] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:57 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1325 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:57.970396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:57.971055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:57.983061 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7f8e5d26-6a18-4988-8996-26257433ab07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1723 microversion: 2.1 time: 1.206959 Oct 17 15:43:57.987756 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2070/4377] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:56 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1723 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:57.994951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:57.995682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:57.996984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:57.998808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:57.999530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:58.001772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:58.002299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:58.005430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:58.025573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:58.030590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:58.031419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:58.032387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:58.034346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:58.035172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:58.192127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:58.201268 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4c1b1e9-9b23-42c4-84c9-830ca61025b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1275 microversion: 2.1 time: 0.237309 Oct 17 15:43:58.207890 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2308/4378] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:57 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:58.329388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:58.330021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:58.341770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:58.342295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:58.347153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:58.348258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:58.348870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:58.349315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:58.901918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:58.917354 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5c19a2e-c5af-425d-b3f4-1500d73f0f4e tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1521 microversion: 2.1 time: 0.592603 Oct 17 15:43:58.918615 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2309/4379] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:58 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:58.929827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5cd40cb5-ce97-424d-82a7-befe7e095eea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:58.932469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5cd40cb5-ce97-424d-82a7-befe7e095eea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:58.948610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd40cb5-ce97-424d-82a7-befe7e095eea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:58.949127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd40cb5-ce97-424d-82a7-befe7e095eea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:58.955389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd40cb5-ce97-424d-82a7-befe7e095eea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:58.956146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd40cb5-ce97-424d-82a7-befe7e095eea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:58.956645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd40cb5-ce97-424d-82a7-befe7e095eea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:58.957094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd40cb5-ce97-424d-82a7-befe7e095eea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.014812 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5cd40cb5-ce97-424d-82a7-befe7e095eea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092681 Oct 17 15:43:59.015879 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2310/4380] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:43:58 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:59.032865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:59.051439 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b2fee5d-2731-4ef0-83bc-ffa4f5619054 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 1.058752 Oct 17 15:43:59.052130 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2071/4381] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:57 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:59.058597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:59.059874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:59.074903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.075572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:59.076205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:59.078275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.080569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.082644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.083876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.088428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.089531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.090347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.091952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.092661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.093560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.102755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.482136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:59.491283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:43:59.497316 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cb66c3f-c35b-4bd5-b113-d27da3aae59d tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1521 microversion: 2.1 time: 0.454917 Oct 17 15:43:59.518430 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2311/4382] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:59 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:59.518430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:59.518430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:59.531473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.532088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.532580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.533673 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5739c7c8-06ff-46ae-a521-bbf156f80415 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1723 microversion: 2.1 time: 0.463714 Oct 17 15:43:59.535070 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2072/4383] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:59 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:43:59.538938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.539509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.540595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.548881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:59.576809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:59.602940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:43:59.613342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.614667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.615301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.617111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.618413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.622118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.841502 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea543417-7eb4-4404-a91c-35c796f7cba0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "DELETE /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 204 len: 0 microversion: 2.20 time: 0.335057 Oct 17 15:43:59.842561 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2312/4384] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:43:59 2022] DELETE /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:43:59.865893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:43:59.866594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:43:59.889772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.892912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.893633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.896364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:43:59.901319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:43:59.903050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:43:59.986795 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] HTTP exception thrown: Action 999 not found Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Request method failure captured: Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f/os-instance-actions/999 HTTP/1.1 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXggxx-tRMll-tuqvD2Xwz5oV0wCJNFK705K25V5FSSwWbMIRS_GV01-sWtVDuDyNj61zAITrGEKMq1JRJfOVGchOc0iaUzFCAxJO9CjPgX0CgKliFOqA9rDaEYWeCXD4vXJoOWHQ-SPy29eZCsAswmy8VZEhZbImMvxTHZvtDs7ltE Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: f5fa00aa821a42528bda7754b91a80a1 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1446641765 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1446641765 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: f5fa00aa821a42528bda7754b91a80a1 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1446641765 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-InstanceActionsNegativeTestJSON-1446641765-project Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 00416e97e9374b3a850a72569098b258 Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1446641765-project Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: exception: Action 999 not found Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': '547ce8bf-a340-468f-8b0b-409c53130a9f', 'id': '999'} Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 17 15:43:59.994924 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:00.001512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Returning 404 to user: Action 999 not found {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:44:00.001512 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-051d858b-0995-40a8-b4f3-f690085f3b1f tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.152071 Oct 17 15:44:00.002310 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2313/4385] 10.222.0.87 () {58 vars in 1308 bytes} [Mon Oct 17 15:43:59 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f/os-instance-actions/999 => generated 66 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:44:00.047496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:00.048191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:00.080386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:00.084625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:00.091182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:00.092334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:00.096120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:00.099537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:00.377231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:00.394923 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-17d241f6-42c7-4225-9020-db1dc03bb8ce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1317 microversion: 2.1 time: 0.856013 Oct 17 15:44:00.397804 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2073/4386] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:43:59 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1317 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:00.410957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:00.411926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:00.427505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:00.431008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:00.432651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:00.435376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:00.436488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:00.438426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:00.614404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:00.629329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:00.631482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:00.632771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6aef03c-a090-430c-bf0f-e04d4494595b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1724 microversion: 2.20 time: 0.623758 Oct 17 15:44:00.642764 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2314/4387] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:00 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1724 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:00.667655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f3663b5-f6d1-4ee1-8a0a-bf88a1fce89c tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '.version_select at 0x7f28be3d8430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:00.669355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3f3663b5-f6d1-4ee1-8a0a-bf88a1fce89c tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:00.681538 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3f3663b5-f6d1-4ee1-8a0a-bf88a1fce89c tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] HTTP exception thrown: Instance c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0 could not be found. Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f3663b5-f6d1-4ee1-8a0a-bf88a1fce89c tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Request method failure captured: Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0/os-instance-actions HTTP/1.1 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXggxx-tRMll-tuqvD2Xwz5oV0wCJNFK705K25V5FSSwWbMIRS_GV01-sWtVDuDyNj61zAITrGEKMq1JRJfOVGchOc0iaUzFCAxJO9CjPgX0CgKliFOqA9rDaEYWeCXD4vXJoOWHQ-SPy29eZCsAswmy8VZEhZbImMvxTHZvtDs7ltE Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: f5fa00aa821a42528bda7754b91a80a1 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1446641765 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1446641765 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: f5fa00aa821a42528bda7754b91a80a1 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1446641765 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-InstanceActionsNegativeTestJSON-1446641765-project Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 00416e97e9374b3a850a72569098b258 Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1446641765-project Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0 could not be found. Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': 'c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0'} Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0 could not be found. Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:44:00.686057 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0 could not be found. Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0 could not be found. Oct 17 15:44:00.690173 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:00.691048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f3663b5-f6d1-4ee1-8a0a-bf88a1fce89c tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Returning 404 to user: Instance c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:44:00.692704 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f3663b5-f6d1-4ee1-8a0a-bf88a1fce89c tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.044822 Oct 17 15:44:00.694912 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2315/4388] 10.222.0.87 () {58 vars in 1296 bytes} [Mon Oct 17 15:44:00 2022] GET /compute/v2.1/servers/c63e9b8a-9082-4ba6-9b3e-aaf1ea0fbbe0/os-instance-actions => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:44:00.733340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:00.740414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:00.765003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:00.769907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:00.771424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:00.772985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:00.773392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:00.774615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:01.226613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:01.263314 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c5977ebc-7b25-4d15-ba82-62e17a1a4e50 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 0.562825 Oct 17 15:44:01.269235 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2316/4389] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:00 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:01.296689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:01.304301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:01.339779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:01.340960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:01.344536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:01.350791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:01.351960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:01.353521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:01.754016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:01.776764 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e7d813e-0d5c-48fe-8bd7-e1beb6887855 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1723 microversion: 2.1 time: 0.503607 Oct 17 15:44:01.787151 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2317/4390] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:01 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1723 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:01.803329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:01.803909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:01.828732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:01.829235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:01.829690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:01.830416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:01.834024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:01.834541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:01.895438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:44:01.929284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:02.014773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:02.110625 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-12803855-319d-4bcd-9a61-f5789c282701 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "DELETE /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 204 len: 0 microversion: 2.1 time: 0.318132 Oct 17 15:44:02.111699 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2318/4391] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:44:01 2022] DELETE /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:44:02.129796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:02.130409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:02.150307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:02.171863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:02.172423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:02.172837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:02.173617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:02.174082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:02.174551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:02.671530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:02.710417 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0658c192-056c-469d-b18b-5bc5803351ac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1521 microversion: 2.1 time: 2.304195 Oct 17 15:44:02.711577 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2074/4392] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:00 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1521 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:02.758089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:02.759945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:02.792529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:02.793466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:02.797417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:02.798880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:02.799676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:02.800392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:03.268749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:03.320496 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd86432b-f071-477c-a2eb-e15cb99d0bdc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1317 microversion: 2.1 time: 1.184210 Oct 17 15:44:03.324810 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2319/4393] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:02 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1317 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:03.360118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:03.365254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:03.397071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:03.402145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:03.406881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:03.416505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:03.417795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:03.422290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:03.704236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:03.762739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:03.792155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:03.804499 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9dc9306c-0da8-49f7-9912-7075db899be8 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1724 microversion: 2.20 time: 1.073282 Oct 17 15:44:03.851901 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2075/4394] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:02 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1724 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:03.866593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:03.868298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:03.880152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:03.882804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:03.884083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:03.885730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:03.888057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:03.889196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:04.069602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:04.089736 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8599b201-aa21-4d3e-9d09-40a6a817f3eb tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1527 microversion: 2.1 time: 0.762567 Oct 17 15:44:04.107059 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2320/4395] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:03 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1527 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:04.140677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:04.141861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:04.165769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:04.194721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:04.196044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:04.199875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:04.209070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:04.210468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:04.646978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:04.771771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:05.179331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:05.200817 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ba08392-2fbf-4064-adc6-ff65503f06a5 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1723 microversion: 2.1 time: 1.100174 Oct 17 15:44:05.201490 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2321/4396] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:04 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1723 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:05.238071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:05.238469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:05.270841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:05.300409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:05.300866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:05.311308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:05.312456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:05.313753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:05.687830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:05.725557 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2016c05e-093f-45b6-b9f7-cfa86fae4e0b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 1.871542 Oct 17 15:44:05.728627 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2076/4397] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:03 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:05.751041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:05.753485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:05.808891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:05.812778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:05.818325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:05.840880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:05.848584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:05.851095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:06.835109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:06.845709 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4634c470-7838-4271-9a86-299e56fe360c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1317 microversion: 2.1 time: 1.114967 Oct 17 15:44:06.857844 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2077/4398] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:05 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1317 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:06.866197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:06.881909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:06.904528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:06.911407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:06.914440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:06.916802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:06.919995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:06.922888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:07.277831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:07.369489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:07.373524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:07.380220 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d50a0fae-e138-4d98-85d8-c2773a4fbdb4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1657 microversion: 2.20 time: 0.513647 Oct 17 15:44:07.387079 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2078/4399] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:06 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1657 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:07.434923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:07.437471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:07.456519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:07.457772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:07.458880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:07.460292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:07.461412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:07.462462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:07.834309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:07.873640 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-acf77585-69b8-4a6a-a59b-e9e2eb249af2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1521 microversion: 2.1 time: 2.670673 Oct 17 15:44:07.887422 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2322/4400] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:05 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1521 bytes in 2685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:07.912966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0065b9f6-50e6-456b-ae13-378c6d3b9bc0 req-42aea1de-4a91-4d1c-a2bd-aaf97217464a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f53954-5109-4fb4-8634-490b9664c7d8", "name": "network-vif-unplugged", "status": "completed", "tag": "c4a74e76-9816-486b-854c-027fd5b61d05"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:07.948615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0065b9f6-50e6-456b-ae13-378c6d3b9bc0 req-42aea1de-4a91-4d1c-a2bd-aaf97217464a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:07.951936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0065b9f6-50e6-456b-ae13-378c6d3b9bc0 req-42aea1de-4a91-4d1c-a2bd-aaf97217464a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:07.953119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0065b9f6-50e6-456b-ae13-378c6d3b9bc0 req-42aea1de-4a91-4d1c-a2bd-aaf97217464a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:08.020613 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0065b9f6-50e6-456b-ae13-378c6d3b9bc0 req-42aea1de-4a91-4d1c-a2bd-aaf97217464a service nova] Creating event network-vif-unplugged:c4a74e76-9816-486b-854c-027fd5b61d05 for instance 45f53954-5109-4fb4-8634-490b9664c7d8 on n-h1-854441-12 Oct 17 15:44:08.031732 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0065b9f6-50e6-456b-ae13-378c6d3b9bc0 req-42aea1de-4a91-4d1c-a2bd-aaf97217464a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141675 Oct 17 15:44:08.033651 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2323/4401] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:08.045423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f13b6cf4-156a-4e46-8a90-36febd9ebcce req-39b5ed6f-c031-4857-85d8-482396205cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f06aaa4-9003-4c2b-93f2-58dffe88714d", "tag": "266c890a-8733-4318-9e57-c80fb316ccdb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:08.072109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f13b6cf4-156a-4e46-8a90-36febd9ebcce req-39b5ed6f-c031-4857-85d8-482396205cf6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:08.073835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f13b6cf4-156a-4e46-8a90-36febd9ebcce req-39b5ed6f-c031-4857-85d8-482396205cf6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:08.076399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f13b6cf4-156a-4e46-8a90-36febd9ebcce req-39b5ed6f-c031-4857-85d8-482396205cf6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:08.105539 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f13b6cf4-156a-4e46-8a90-36febd9ebcce req-39b5ed6f-c031-4857-85d8-482396205cf6 service nova] Creating event network-changed:266c890a-8733-4318-9e57-c80fb316ccdb for instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d on n-h2-854441-12 Oct 17 15:44:08.115537 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f13b6cf4-156a-4e46-8a90-36febd9ebcce req-39b5ed6f-c031-4857-85d8-482396205cf6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079083 Oct 17 15:44:08.117521 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2324/4402] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:08.129960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:08.133148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:08.146673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:08.148246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:08.149403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:08.151065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:08.153597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:08.154801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:08.920009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00416e97e9374b3a850a72569098b258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fa00aa821a42528bda7754b91a80a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:08.958820 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-44f1084b-59ff-45a2-92cd-3cfaf4a4fc71 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 200 len: 1527 microversion: 2.1 time: 1.556190 Oct 17 15:44:08.968388 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2079/4403] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:07 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 1527 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:08.995694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:08.997554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:09.039714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:09.041084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:09.042094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:09.043668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:09.048349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:09.049706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:10.669778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:10.716111 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f5fbc99-e0bb-40b3-83c9-5c37d1f5c183 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1723 microversion: 2.1 time: 2.596023 Oct 17 15:44:10.742070 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2325/4404] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:08 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1723 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:10.782288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:10.806148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:10.865788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:10.870662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:10.876792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:10.878681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:10.882130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:10.890242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:11.138973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:11.147273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:11.165217 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f8228d1e-27d2-431d-b1e3-16d0b1b37531 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 2.194664 Oct 17 15:44:11.174796 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2080/4405] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:08 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:11.197092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:11.200608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:11.259948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:11.260741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:11.265818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:11.267189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:11.268034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:11.268805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:11.467555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:11.475120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:11.479626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:11.481040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lazy-loading 'fault' on Instance uuid 45f53954-5109-4fb4-8634-490b9664c7d8 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:44:11.747251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:11.760697 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14ca81e6-dd95-436b-bae6-372baff610b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1317 microversion: 2.1 time: 1.016787 Oct 17 15:44:11.769510 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2326/4406] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:10 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1317 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:11.787997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:11.788843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:11.816249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:11.821146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:11.824183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:11.828862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:11.830843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:11.837495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.038480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:12.065350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:12.085913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:12.094456 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-84c0fa10-e8d1-423a-af9d-43dff6c39e23 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 200 len: 1372 microversion: 2.20 time: 0.911896 Oct 17 15:44:12.096672 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2081/4407] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:11 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 1372 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:12.105732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a27b27dd-d363-4cd9-bf85-0ec895487c82 req-727fa060-c932-4df3-8ba0-2db822d347b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547ce8bf-a340-468f-8b0b-409c53130a9f", "name": "network-vif-deleted", "tag": "94e7d254-848f-426b-a459-759e2113cd24"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:12.122233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:12.134212 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed715d99-70aa-4a18-b9be-2b68b9306eac tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1498 microversion: 2.1 time: 0.363196 Oct 17 15:44:12.144888 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2327/4408] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:11 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1498 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:12.144888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:12.149966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] [instance: 547ce8bf-a340-468f-8b0b-409c53130a9f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:12.171270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a27b27dd-d363-4cd9-bf85-0ec895487c82 req-727fa060-c932-4df3-8ba0-2db822d347b6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.172667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.173400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.174056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.175292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.176026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.176623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.186063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a27b27dd-d363-4cd9-bf85-0ec895487c82 req-727fa060-c932-4df3-8ba0-2db822d347b6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.187917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a27b27dd-d363-4cd9-bf85-0ec895487c82 req-727fa060-c932-4df3-8ba0-2db822d347b6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.206443 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] HTTP exception thrown: Instance 547ce8bf-a340-468f-8b0b-409c53130a9f could not be found. Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Request method failure captured: Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f HTTP/1.1 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXggxx-tRMll-tuqvD2Xwz5oV0wCJNFK705K25V5FSSwWbMIRS_GV01-sWtVDuDyNj61zAITrGEKMq1JRJfOVGchOc0iaUzFCAxJO9CjPgX0CgKliFOqA9rDaEYWeCXD4vXJoOWHQ-SPy29eZCsAswmy8VZEhZbImMvxTHZvtDs7ltE Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: f5fa00aa821a42528bda7754b91a80a1 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1446641765 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f5fa00aa821a42528bda7754b91a80a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1446641765 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: f5fa00aa821a42528bda7754b91a80a1 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1446641765 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-InstanceActionsNegativeTestJSON-1446641765-project Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 00416e97e9374b3a850a72569098b258 Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1446641765-project Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 547ce8bf-a340-468f-8b0b-409c53130a9f could not be found. Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '547ce8bf-a340-468f-8b0b-409c53130a9f'} Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547ce8bf-a340-468f-8b0b-409c53130a9f could not be found. Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547ce8bf-a340-468f-8b0b-409c53130a9f could not be found. Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:12.208601 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:12.212873 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:12.212873 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:12.212873 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:12.212873 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:12.212873 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:44:12.212873 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:44:12.212873 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547ce8bf-a340-468f-8b0b-409c53130a9f could not be found. Oct 17 15:44:12.212873 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:12.214280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] Returning 404 to user: Instance 547ce8bf-a340-468f-8b0b-409c53130a9f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:44:12.215396 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c25a5250-9c81-4af5-8bd1-2ac87e621896 tempest-InstanceActionsNegativeTestJSON-1446641765 tempest-InstanceActionsNegativeTestJSON-1446641765-project] 10.222.0.87 "GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f" status: 404 len: 111 microversion: 2.1 time: 0.075952 Oct 17 15:44:12.229938 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2328/4409] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:12 2022] GET /compute/v2.1/servers/547ce8bf-a340-468f-8b0b-409c53130a9f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:44:12.246714 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a27b27dd-d363-4cd9-bf85-0ec895487c82 req-727fa060-c932-4df3-8ba0-2db822d347b6 service nova] Creating event network-vif-deleted:94e7d254-848f-426b-a459-759e2113cd24 for instance 547ce8bf-a340-468f-8b0b-409c53130a9f on n-h2-854441-12 Oct 17 15:44:12.248865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-60229e5d-94b5-4614-90c4-e3ebba3a0907 req-52470a9b-526f-4840-b237-c73377a99b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547ce8bf-a340-468f-8b0b-409c53130a9f", "name": "network-vif-unplugged", "status": "completed", "tag": "94e7d254-848f-426b-a459-759e2113cd24"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:12.269652 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a27b27dd-d363-4cd9-bf85-0ec895487c82 req-727fa060-c932-4df3-8ba0-2db822d347b6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170635 Oct 17 15:44:12.270829 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2082/4410] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:12.272225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60229e5d-94b5-4614-90c4-e3ebba3a0907 req-52470a9b-526f-4840-b237-c73377a99b08 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.272927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60229e5d-94b5-4614-90c4-e3ebba3a0907 req-52470a9b-526f-4840-b237-c73377a99b08 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.273549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60229e5d-94b5-4614-90c4-e3ebba3a0907 req-52470a9b-526f-4840-b237-c73377a99b08 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.299307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a2c5db77-15de-4118-b619-e210487d0539 req-cf0a720c-7eab-4004-8962-2c96dea368c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f53954-5109-4fb4-8634-490b9664c7d8", "name": "network-vif-deleted", "tag": "c4a74e76-9816-486b-854c-027fd5b61d05"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:12.305217 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-60229e5d-94b5-4614-90c4-e3ebba3a0907 req-52470a9b-526f-4840-b237-c73377a99b08 service nova] Creating event network-vif-unplugged:94e7d254-848f-426b-a459-759e2113cd24 for instance 547ce8bf-a340-468f-8b0b-409c53130a9f on n-h2-854441-12 Oct 17 15:44:12.318220 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-60229e5d-94b5-4614-90c4-e3ebba3a0907 req-52470a9b-526f-4840-b237-c73377a99b08 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084775 Oct 17 15:44:12.321625 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2329/4411] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:12.327552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:12.331137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:12.342270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a2c5db77-15de-4118-b619-e210487d0539 req-cf0a720c-7eab-4004-8962-2c96dea368c9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.343190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a2c5db77-15de-4118-b619-e210487d0539 req-cf0a720c-7eab-4004-8962-2c96dea368c9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.343983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a2c5db77-15de-4118-b619-e210487d0539 req-cf0a720c-7eab-4004-8962-2c96dea368c9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.349753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.353056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.353784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.354775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.355448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.358294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.401275 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a2c5db77-15de-4118-b619-e210487d0539 req-cf0a720c-7eab-4004-8962-2c96dea368c9 service nova] Creating event network-vif-deleted:c4a74e76-9816-486b-854c-027fd5b61d05 for instance 45f53954-5109-4fb4-8634-490b9664c7d8 on n-h1-854441-12 Oct 17 15:44:12.421208 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a2c5db77-15de-4118-b619-e210487d0539 req-cf0a720c-7eab-4004-8962-2c96dea368c9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140382 Oct 17 15:44:12.428315 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2083/4412] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:12.449816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:12.467176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:12.478577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:12.496757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.500157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.501343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.505471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.510068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.511291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.658801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:44:12.828773 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2ceafd4c-9eb6-4133-afc7-99320dfd9db9 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.398201 Oct 17 15:44:12.829068 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2084/4413] 10.222.0.87 () {58 vars in 1154 bytes} [Mon Oct 17 15:44:12 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:12.834239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:12.837786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:12.875044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.876675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.878073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:12.880109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:12.881774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:12.884056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:13.389571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:13.415813 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f0fac4c-4e1b-46f4-8cf6-8fb2a6600840 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1700 microversion: 2.1 time: 1.091784 Oct 17 15:44:13.417347 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2330/4414] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:12 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1700 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:13.434536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:13.436238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:13.465660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:13.468127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:13.471341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:13.473910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:13.476864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:13.478171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:13.974339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:14.007067 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-88a47070-3d12-4693-8193-e35ab44e4d92 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 1.170243 Oct 17 15:44:14.008471 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2085/4415] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:12 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:14.022881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0430b3ab-c500-495f-9bb3-632b5cd48f21 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:14.053866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0430b3ab-c500-495f-9bb3-632b5cd48f21 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:14.064018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0430b3ab-c500-495f-9bb3-632b5cd48f21 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:14.065677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0430b3ab-c500-495f-9bb3-632b5cd48f21 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:14.191185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0430b3ab-c500-495f-9bb3-632b5cd48f21 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Going to try to start instance {{(pid=120407) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 15:44:14.191504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:14.219527 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4a15b12-ca7a-4e0a-9fcd-f8f82ec1fc25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1317 microversion: 2.1 time: 0.798056 Oct 17 15:44:14.231624 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2331/4416] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:13 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:14.241533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:14.243528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:14.258300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:14.260079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:14.261041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:14.262656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:14.263818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:14.264761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:14.331908 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] HTTP exception thrown: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Request method failure captured: Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 HTTP/1.1 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXc0Y4M5OfVkLji0-Kod_g_5Orm6D-_QJCAc157CTns0AQxd2F5fpnYAtiRnJuCnExhXNvzz80T8C8K4k3hVyFywkADoDffE8w9njuo-zvpxuBzpb2K8KUlpvqpqfSwczmQCPOiXiFbZ8bNeKU5puQeLuDyyaaV8Hq1TOUay4C2Ni7Q Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8081c4b357e0404fb26842274162d055"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8081c4b357e0404fb26842274162d055"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 60b5d6c1fa7c40c4876495acf7476732 Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '45f53954-5109-4fb4-8634-490b9664c7d8'} Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:14.335451 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Returning 404 to user: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-beab24ff-494e-4de2-83c6-03515e97ce76 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 404 len: 111 microversion: 2.20 time: 0.105250 Oct 17 15:44:14.345464 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2332/4417] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:14 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:44:14.357164 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0430b3ab-c500-495f-9bb3-632b5cd48f21 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "POST /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51/action" status: 202 len: 0 microversion: 2.1 time: 0.346516 Oct 17 15:44:14.358255 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2086/4418] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:44:14 2022] POST /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:44:14.369728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-60f7ad3b-de43-4727-8154-4dafa5322474 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '.version_select at 0x7f28bea87ca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:14.372805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7d76f7d-79d9-4006-a706-ada18ceea735 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:14.382926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7d76f7d-79d9-4006-a706-ada18ceea735 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:14.383492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7d76f7d-79d9-4006-a706-ada18ceea735 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:14.383945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7d76f7d-79d9-4006-a706-ada18ceea735 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:14.426521 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-60f7ad3b-de43-4727-8154-4dafa5322474 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353973669" status: 204 len: 0 microversion: 2.20 time: 0.065779 Oct 17 15:44:14.428301 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2087/4419] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:44:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353973669 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:44:14.442979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:14.446213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:14.463475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:14.465180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:14.466798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:14.470491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7d76f7d-79d9-4006-a706-ada18ceea735 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Going to try to start instance {{(pid=120406) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 15:44:14.472570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:14.474470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:14.475748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:14.658996 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7d76f7d-79d9-4006-a706-ada18ceea735 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/action" status: 202 len: 0 microversion: 2.1 time: 0.308256 Oct 17 15:44:14.660513 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2333/4420] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:44:14 2022] POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:44:14.691239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8a4e0c81-f046-4437-81d8-b8736cc45ade req-52f1052b-53f4-42c2-838b-85081cde79c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f06aaa4-9003-4c2b-93f2-58dffe88714d", "name": "network-vif-plugged", "status": "completed", "tag": "266c890a-8733-4318-9e57-c80fb316ccdb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:14.744228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8a4e0c81-f046-4437-81d8-b8736cc45ade req-52f1052b-53f4-42c2-838b-85081cde79c6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:14.751703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8a4e0c81-f046-4437-81d8-b8736cc45ade req-52f1052b-53f4-42c2-838b-85081cde79c6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:14.752838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8a4e0c81-f046-4437-81d8-b8736cc45ade req-52f1052b-53f4-42c2-838b-85081cde79c6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:14.785905 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8a4e0c81-f046-4437-81d8-b8736cc45ade req-52f1052b-53f4-42c2-838b-85081cde79c6 service nova] Creating event network-vif-plugged:266c890a-8733-4318-9e57-c80fb316ccdb for instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d on n-h2-854441-12 Oct 17 15:44:14.796854 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8a4e0c81-f046-4437-81d8-b8736cc45ade req-52f1052b-53f4-42c2-838b-85081cde79c6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118844 Oct 17 15:44:14.798721 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2334/4421] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:14.812066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:14.813663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:14.826345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:14.827646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:14.832498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:14.834905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:14.836356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:14.837375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:15.542757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:15.553672 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe0d45f8-d864-4d5a-bb26-fd1c6f36de38 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1507 microversion: 2.1 time: 1.123471 Oct 17 15:44:15.554470 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2088/4422] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:14 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1507 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:15.567141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:15.568148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:15.576215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:15.577030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:15.586051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:15.592909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:15.594155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:15.594935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:15.595989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:15.618146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a1fce1e-a238-437d-9531-62368adfa2e3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1709 microversion: 2.1 time: 0.810011 Oct 17 15:44:15.631093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2335/4423] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:14 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1709 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:15.655490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:15.656670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:15.675222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:15.677617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:15.678479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:15.684320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:15.685361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:15.687584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:16.314432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:16.334898 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5151d075-fb9b-4c60-9577-074c6291d99e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1504 microversion: 2.1 time: 0.770686 Oct 17 15:44:16.352800 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2089/4424] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:15 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1504 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:16.464161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:16.479500 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-252b5211-6b7b-4cc0-80fa-db32c4d0e18f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1317 microversion: 2.1 time: 0.846143 Oct 17 15:44:16.498926 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2336/4425] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:15 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:16.610139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:16.611161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:16.617559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:16.649146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:16.651596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:16.656827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:16.658055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:16.659163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:16.660885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:16.662099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:16.663274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:16.671092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:16.671597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:16.674172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:16.676040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:16.676550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:16.681146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:16.699153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:17.377960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:17.390661 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a6c1d1ce-9caf-471e-8faa-a3ae9488ca89 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1507 microversion: 2.1 time: 0.787447 Oct 17 15:44:17.398618 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2090/4426] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:16 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1507 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:44:17.402440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:17.404273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:17.420968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:17.421908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:17.422805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:17.424406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:17.425393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:17.426175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:17.655916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:17.677258 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-986c74d4-a4a1-408c-9bbd-82356e71dcfb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1709 microversion: 2.1 time: 1.024663 Oct 17 15:44:17.680222 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2337/4427] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:16 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1709 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:17.701732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:17.703616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:17.726916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:17.728299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:17.729083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:17.729981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:17.730550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:17.731088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:17.888102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:17.901026 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-abfb0ae7-26f0-479b-9584-e674d9d6e971 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1504 microversion: 2.1 time: 0.506332 Oct 17 15:44:17.902246 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2091/4428] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:17 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1504 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:18.237444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e103ab56-357b-474c-bb9b-d0e6cf258f12 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'create', calling method: .version_select at 0x7f28bea87430>, body: {"keypair": {"name": "tempest-keypair-666418255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb89VV75dRiEKiYrnzghuEkX5Ir4TGPee7eqrwRjxS9WiCla5WZL+1UlgIYjFXEpyjG76zwXfCc3rvVVeaj5ZCp+Z5sxUDDqWVbJAgQoIGz+TdkVC4EstyVW+dYtUPMPA=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:18.266310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e103ab56-357b-474c-bb9b-d0e6cf258f12 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Getting quotas for project 8081c4b357e0404fb26842274162d055. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:18.278269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e103ab56-357b-474c-bb9b-d0e6cf258f12 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Getting quotas for user 60b5d6c1fa7c40c4876495acf7476732 and project 8081c4b357e0404fb26842274162d055. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:18.320477 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e103ab56-357b-474c-bb9b-d0e6cf258f12 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.088343 Oct 17 15:44:18.322187 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2092/4429] 10.222.0.87 () {62 vars in 1200 bytes} [Mon Oct 17 15:44:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 15:44:18.427861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:18.429261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:18.437962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:18.438771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:18.439732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:18.441860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:18.442831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:18.443453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:18.473779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:18.494315 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-548900b2-4427-4400-96b9-8d2fb78b4ecb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.811781 Oct 17 15:44:18.496332 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2338/4430] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:17 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:18.700149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-937250851", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:18.795926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:18.807823 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-74756ff2-ccd9-4b3b-8a66-b78cb2786729 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1507 microversion: 2.1 time: 0.384104 Oct 17 15:44:18.808773 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2093/4431] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:18 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:44:18.819300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] validate_networks() for [('3d2dceb7-fa1f-47b7-a54c-dede4194eb86', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:44:18.827689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:18.828744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:18.842599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:18.845135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:18.846084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:18.847370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:18.848105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:18.848764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:19.405149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:19.424897 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc137de7-5594-4a4c-9d5a-f94a00b89b8d tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1709 microversion: 2.1 time: 0.609117 Oct 17 15:44:19.431996 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2094/4432] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:18 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1709 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:19.441372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:19.442604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:19.453313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:19.453983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:19.455986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:19.462942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:19.472124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:19.472124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:19.945760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:19.963763 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-561d775f-f30d-4961-808f-1eec8e550484 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1504 microversion: 2.1 time: 0.530358 Oct 17 15:44:19.978990 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2095/4433] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:19 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1504 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:19.986352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:19.999536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:20.007717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:20.008733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:20.009355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:20.010274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:20.016986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:20.018198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:20.626849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:44:20.628061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:44:20.628835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:44:20.629652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:44:20.630238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:44:20.649648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:20.650143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:20.650720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:20.652328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:20.653187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:20.653833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:20.678078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Getting quotas for project b8e3c8332d724f649611c888b2d5639b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:20.686088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Getting quotas for user 867ef1e9bae64d5fb08ea45376f905c8 and project b8e3c8332d724f649611c888b2d5639b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:20.702537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:44:20.705407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:44:20.785412 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-05603375-ab1c-49c7-9b14-6bf7fc1f8592 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.091213 Oct 17 15:44:20.794051 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2339/4434] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:44:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:44:20.801181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-576ada69-f31e-49f7-8e67-0a9d21cebe3f req-07b66cad-19e2-4817-9d38-e6a06f6fb724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb53938-d95a-4f04-a223-2b4f3bffec21", "name": "network-vif-unplugged", "status": "completed", "tag": "ab422ee2-f5d0-4f35-b021-58487235ce01"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:20.823376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-576ada69-f31e-49f7-8e67-0a9d21cebe3f req-07b66cad-19e2-4817-9d38-e6a06f6fb724 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:20.824677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-576ada69-f31e-49f7-8e67-0a9d21cebe3f req-07b66cad-19e2-4817-9d38-e6a06f6fb724 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:20.825683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-576ada69-f31e-49f7-8e67-0a9d21cebe3f req-07b66cad-19e2-4817-9d38-e6a06f6fb724 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:20.854162 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-576ada69-f31e-49f7-8e67-0a9d21cebe3f req-07b66cad-19e2-4817-9d38-e6a06f6fb724 service nova] Creating event network-vif-unplugged:ab422ee2-f5d0-4f35-b021-58487235ce01 for instance ddb53938-d95a-4f04-a223-2b4f3bffec21 on n-h2-854441-12 Oct 17 15:44:20.866422 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-576ada69-f31e-49f7-8e67-0a9d21cebe3f req-07b66cad-19e2-4817-9d38-e6a06f6fb724 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069519 Oct 17 15:44:20.868806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2340/4435] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:20.882591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:20.884529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:20.900301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:20.901759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:20.902893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:20.904778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:20.906062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:20.907183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:21.362276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:21.377782 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9254545-78af-4156-8258-59d2dcc42a83 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1709 microversion: 2.1 time: 0.506510 Oct 17 15:44:21.390307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:21.407745 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2341/4436] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:20 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1709 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:21.429765 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e29a162f-41d5-4d86-9522-a9935daf66e3 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1507 microversion: 2.1 time: 1.449093 Oct 17 15:44:21.430463 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2096/4437] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:19 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1507 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:21.432172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09c35a9f-1fbe-428b-a21c-dff663eae0fc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:21.432840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09c35a9f-1fbe-428b-a21c-dff663eae0fc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:21.455336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:21.461531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:21.504958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:21.510924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:21.514401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:21.522149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:21.523143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:21.524022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:22.206193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09c35a9f-1fbe-428b-a21c-dff663eae0fc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:22.225399 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09c35a9f-1fbe-428b-a21c-dff663eae0fc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1216 microversion: 2.1 time: 0.811582 Oct 17 15:44:22.226074 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2342/4438] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:21 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1216 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:22.417836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:22.433318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:22.435214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:22.443740 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31a2fa86-8572-49e4-a501-113ca265d000 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 200 len: 1507 microversion: 2.1 time: 1.005456 Oct 17 15:44:22.453183 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2097/4439] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:21 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 1507 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:22.453319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:22.453961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:22.456054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:22.456890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:22.457393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:22.457798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:22.474194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:22.491894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:22.512080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:22.512983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:22.514038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:22.515078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:22.515933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:22.516903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:22.599966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:22.977310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:22.997685 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a57c591a-64f7-43e5-89e1-d41da52e4691 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1713 microversion: 2.1 time: 0.569761 Oct 17 15:44:23.000260 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2343/4440] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:22 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1713 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:23.032214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:23.032975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:23.048317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.051011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.052443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:23.054288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.056082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.066051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:23.199538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:23.245072 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4f02a428-4899-490d-9dde-441a6b1428b7 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1511 microversion: 2.1 time: 0.778038 Oct 17 15:44:23.264829 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2098/4441] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:22 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1511 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:23.301895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:23.303445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:23.316154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.317560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.318893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:23.321380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.322581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.323645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:23.332516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:23.572092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:23.592284 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b69fecef-0c09-4ad0-9874-dfee66076472 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1276 microversion: 2.1 time: 0.314394 Oct 17 15:44:23.594086 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2099/4442] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:23 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1276 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:23.601184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:23.608947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:23.609715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.compute.servers [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Removing options 'limit' from query {{(pid=120407) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 15:44:23.610872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:23.612343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.613095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.613788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:23.614906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.615690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.616953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:23.622688 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f8093e1-46d4-4a52-b309-47c06cbb03f1 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.026501 Oct 17 15:44:23.626709 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2100/4443] 10.222.0.87 () {58 vars in 1140 bytes} [Mon Oct 17 15:44:23 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:44:23.657412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:23.659435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:23.705066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.706235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.707742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:23.716096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.717356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.727906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:23.835315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:23.851396 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a151b4e-cb13-44cd-a584-bb6d9477323f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.832574 Oct 17 15:44:23.852527 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2344/4444] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:23 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:23.889079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:23.889737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:23.906857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.907368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.907820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:23.908559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:23.909025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:23.909458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:24.274286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:24.299694 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b2836c5-e8b0-4ceb-9b20-35e2e31587c4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1511 microversion: 2.1 time: 0.651366 Oct 17 15:44:24.302072 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2101/4445] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:23 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1511 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:44:24.349637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:24.350360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:24.366652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:24.368313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:24.369026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:24.370330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:24.386452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:24.387562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:24.490360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:24.508588 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3b8306a-1754-47ec-95d5-350dd3139562 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.623583 Oct 17 15:44:24.511289 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2345/4446] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:23 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:24.534889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:24.537484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:24.557339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:24.563899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:24.564681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:24.565739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:24.566467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:24.567173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:25.089394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:25.099375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eaad0c94-d846-4a21-883e-e197ed4709ee tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 200 len: 1510 microversion: 2.1 time: 0.759224 Oct 17 15:44:25.110599 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2102/4447] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:24 2022] GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 1510 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:25.110599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:25.110599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:25.121827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:25.122401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:25.122887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:25.123656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:25.124458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:25.124906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:25.137867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:25.153709 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf09ea71-3477-48a4-984a-2d0a2db718db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.617252 Oct 17 15:44:25.167289 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2346/4448] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:24 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:25.178704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-332547428", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45b953ae-39a0-4880-adcf-507411759ef0"}], "security_groups": [{"name": "tempest-securitygroup--1226795613"}], "key_name": "tempest-keypair-666418255", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:25.627354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:25.643327 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a02ee19-4782-43a7-83a5-8318f9a5af89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 0.541789 Oct 17 15:44:25.644178 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2103/4449] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:25 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:25.649998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:25.657882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:25.681472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:25.682304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:25.682804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:25.683634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:25.686954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:25.687402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:25.777864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] validate_networks() for [('45b953ae-39a0-4880-adcf-507411759ef0', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:44:26.016780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:26.026818 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ce97637d-f0f8-466a-8c8d-fa91b8d0a2dc tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1509 microversion: 2.1 time: 0.380973 Oct 17 15:44:26.030651 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2104/4450] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:25 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:26.045981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:26.048113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:26.060342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:26.061125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:26.061935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:26.062939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:26.063620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:26.064518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:26.370776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:26.401074 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b30d4867-e642-472c-961e-a49fd8d99de8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.368730 Oct 17 15:44:26.401696 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2105/4451] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:26 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:26.407875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:26.424732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:26.425444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:26.615007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:26.615527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:26.615971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:26.616723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:26.617442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:26.618040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:26.714377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:44:26.885007 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc49281d-64cc-447e-b6b3-b8c1f52895b6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 346 microversion: 2.1 time: 0.481253 Oct 17 15:44:26.886344 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2106/4452] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:44:26 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 346 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:26.895605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a0b34e9a-5beb-40e5-81b7-37d28c3f3cd4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:26.909235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0b34e9a-5beb-40e5-81b7-37d28c3f3cd4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:26.910697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0b34e9a-5beb-40e5-81b7-37d28c3f3cd4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:26.911731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0b34e9a-5beb-40e5-81b7-37d28c3f3cd4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:26.965271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a0b34e9a-5beb-40e5-81b7-37d28c3f3cd4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Going to try to stop instance {{(pid=120407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 15:44:27.079301 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a0b34e9a-5beb-40e5-81b7-37d28c3f3cd4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.190228 Oct 17 15:44:27.083150 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2107/4453] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:44:26 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:44:27.094977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:27.096477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:27.113262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:27.114260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:27.115245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:27.116676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:27.117969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:27.119663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:27.524156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:44:27.525121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:44:27.528098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:44:27.529815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:44:27.530492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:44:27.552009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:27.553098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:27.554340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:27.556090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:27.556829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:27.558836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:27.590989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Getting quotas for project 8081c4b357e0404fb26842274162d055. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:27.610669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Getting quotas for user 60b5d6c1fa7c40c4876495acf7476732 and project 8081c4b357e0404fb26842274162d055. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:27.646873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:44:27.652545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:44:27.661257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:27.676680 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4bfcbc74-2ce3-4819-a52c-abea620dbfea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 0.589091 Oct 17 15:44:27.678004 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2108/4454] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:27 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:27.693638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-6867dfd3-19d3-45b5-b33f-062821c6eec6 req-57bcbb95-52f9-49e1-a7e7-aae21e028725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8548020-e957-4428-8e54-c34c68c9b446", "tag": "448433f4-0243-4d4b-b11f-4e68c617941d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:27.714620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6867dfd3-19d3-45b5-b33f-062821c6eec6 req-57bcbb95-52f9-49e1-a7e7-aae21e028725 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:27.716737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6867dfd3-19d3-45b5-b33f-062821c6eec6 req-57bcbb95-52f9-49e1-a7e7-aae21e028725 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:27.719645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-6867dfd3-19d3-45b5-b33f-062821c6eec6 req-57bcbb95-52f9-49e1-a7e7-aae21e028725 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:27.750720 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-6867dfd3-19d3-45b5-b33f-062821c6eec6 req-57bcbb95-52f9-49e1-a7e7-aae21e028725 service nova] Creating event network-changed:448433f4-0243-4d4b-b11f-4e68c617941d for instance f8548020-e957-4428-8e54-c34c68c9b446 on n-h1-854441-12 Oct 17 15:44:27.761736 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-6867dfd3-19d3-45b5-b33f-062821c6eec6 req-57bcbb95-52f9-49e1-a7e7-aae21e028725 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080463 Oct 17 15:44:27.762215 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2109/4455] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:27.785771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:27.796587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:27.809899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:27.810900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:27.811799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:27.813290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:27.814016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:27.814604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:27.838365 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-696fc06a-9078-437c-9364-5bbbe5e39a95 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.668151 Oct 17 15:44:27.840732 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2347/4456] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:44:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:44:27.846461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:27.857636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:27.872089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:27.883173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:27.884028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:27.885073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:27.885798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:27.886451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:28.289631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:28.622853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:28.632476 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb72cae2-c32f-4b8f-a24d-ccb1a21b5fb9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.790219 Oct 17 15:44:28.647070 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2348/4457] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:27 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:28.655383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80357a68-6992-4605-afd2-eb1f7580d754 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:28.656461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80357a68-6992-4605-afd2-eb1f7580d754 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:28.748305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80357a68-6992-4605-afd2-eb1f7580d754 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:28.758534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80357a68-6992-4605-afd2-eb1f7580d754 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:28.766038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80357a68-6992-4605-afd2-eb1f7580d754 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:28.767498 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80357a68-6992-4605-afd2-eb1f7580d754 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1280 microversion: 2.20 time: 0.118904 Oct 17 15:44:28.772537 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2349/4458] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:28 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:28.781927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:28.782593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:28.811096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:28.811915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:28.812521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:28.813420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:28.814046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:28.814667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:29.067833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:29.086407 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9750341-7e20-4736-b07b-0f8681b4d877 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1511 microversion: 2.1 time: 1.321759 Oct 17 15:44:29.087508 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2110/4459] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:27 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1511 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:29.131524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:29.132152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:29.148586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:29.149484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:29.151293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:29.156699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:29.157730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:29.158365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:29.163939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:29.179877 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d57091c-8175-4ebb-b6d3-ac935dcf78b0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 0.405961 Oct 17 15:44:29.180819 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2350/4460] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:28 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:29.662376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:29.668945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:29.674553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:29.686001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:29.688825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:29.691695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:29.693067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:29.694431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:29.695124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:29.713434 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-38a660d9-7508-461c-b3c2-34950e4f92da tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 200 len: 1510 microversion: 2.1 time: 0.586233 Oct 17 15:44:29.747321 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2111/4461] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:29 2022] GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 1510 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:29.766420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:29.769127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:29.782691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:29.783928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:29.785123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:29.786985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:29.788107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:29.789566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:29.955923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:29.975847 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-406b110c-8bfd-47d5-a673-d694ae84ee6e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.318594 Oct 17 15:44:29.977532 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2351/4462] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:29 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:29.987618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:29.989153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:29.999276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:30.003929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:30.006213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:30.007494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:30.009461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:30.010909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:30.012391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:30.118887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:30.129916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:30.132231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:30.135424 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-035220cf-8dd1-4e6f-b906-7e3ed8b1a21b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1332 microversion: 2.20 time: 0.156283 Oct 17 15:44:30.136270 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2352/4463] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:29 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1332 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:30.226146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:30.229343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:30.251880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:30.252962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:30.257640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:30.260398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:30.261668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:30.262862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:30.492389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:30.526025 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3a4397a-a17c-483b-9d87-617480d2e581 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1509 microversion: 2.1 time: 0.771702 Oct 17 15:44:30.551318 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2112/4464] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:29 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1509 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:44:30.567683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:30.573098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:30.574039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:30.588808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:30.603440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:30.604223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:30.605280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:30.605980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:30.613079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:30.644514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:30.661135 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a252624f-dee5-4195-ad24-279eb01050d0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 0.443099 Oct 17 15:44:30.666792 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2353/4465] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:30 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:30.691379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:44:30.731628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:30.741065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:30.741839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:30.742609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:31.012264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:31.013344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:31.047508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:31.048381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:31.049474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:31.051124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:31.052226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:31.055726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:31.510555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:31.527002 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2eaf4401-bd8b-4ff9-8a2f-d67fbedd4fb3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.523787 Oct 17 15:44:31.543494 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2354/4466] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:31 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:31.551167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:31.552275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:31.569866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:31.571188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:31.571869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:31.572932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:31.573756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:31.574422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:31.608941 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3c5423a3-5e72-4c8b-a37e-97759a746ac4 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/detail" status: 200 len: 4513 microversion: 2.1 time: 1.046594 Oct 17 15:44:31.610096 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2113/4467] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:44:30 2022] GET /compute/v2.1/servers/detail => generated 4513 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:31.646670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:31.653950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:31.655705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:31.761363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:31.776645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:31.778699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:31.780646 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4209fa60-9d7b-4645-a022-c98fbb98e6bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1338 microversion: 2.20 time: 0.234815 Oct 17 15:44:31.781289 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2355/4468] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:31 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1338 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:31.809638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:31.810401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:31.834957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:31.835660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:31.836310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:31.837194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:31.837748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:31.838263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:32.133072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:32.133983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:32.135531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:32.138362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:32.139599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:32.140772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:32.262088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:44:32.309094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:32.349653 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee516e51-36cd-45a5-9f94-66897a0ba9c1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 0.550227 Oct 17 15:44:32.370799 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2356/4469] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:31 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:32.371075 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e813fef2-bc36-4d6e-95f5-fe209d6c3135 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.726226 Oct 17 15:44:32.371075 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2114/4470] 10.222.0.87 () {58 vars in 1150 bytes} [Mon Oct 17 15:44:31 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:32.393953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:32.407286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:32.408341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:32.425891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:32.426942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:32.427113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:32.429415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:32.429651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:32.430275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:32.576770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:32.581410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:32.605875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:32.607163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:32.608938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:32.611145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:32.612540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:32.613564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:32.705518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:32.713577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:44:32.888235 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a52a7860-cfa9-49d0-920d-8eeb0df12c49 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.497784 Oct 17 15:44:32.905700 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2115/4471] 10.222.0.87 () {58 vars in 1212 bytes} [Mon Oct 17 15:44:32 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:33.143029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:33.177544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:33.204757 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6683d5e4-6978-48cc-ae53-046c22dcb481 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.647864 Oct 17 15:44:33.224689 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2357/4472] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:32 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:33.254492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:33.275639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:33.285415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:33.305156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:33.312038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:33.319490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:33.324283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:33.343625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:33.344603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:33.508294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:33.515884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:33.577994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:33.608969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:33.610832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:33.613896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:33.615779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:33.619625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:33.840658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:44:34.073816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70051b2a-88f2-4cf9-b54e-3d86483a4f04 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.845286 Oct 17 15:44:34.075457 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2358/4473] 10.222.0.87 () {58 vars in 1196 bytes} [Mon Oct 17 15:44:33 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:34.105159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:34.106367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:34.130141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:34.132915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:34.133682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:34.135371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:34.136191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:34.136841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:34.738626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:34.770381 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36a0583e-bb17-4a1f-8244-4984ae15d1dd tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 0.672633 Oct 17 15:44:34.786591 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2359/4474] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:34 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:34.786591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:34.802855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:34.802855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'name': '1561061362', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:34.806881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:34.808708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:34.810374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:34.812679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:34.814158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:34.815824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:35.078861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:44:35.187076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:35.239117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:35.243498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:35.253692 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-08424f9e-9787-4314-b52c-421512c9b3be tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 2.342769 Oct 17 15:44:35.265931 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2116/4475] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:32 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:35.278991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:35.281215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:35.297426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:35.298716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:35.299811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:35.301724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:35.303131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:35.304198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:35.653565 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b51111d1-5c3e-4548-b459-ebd902119e30 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?name=1561061362" status: 200 len: 346 microversion: 2.1 time: 0.870671 Oct 17 15:44:35.655446 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2360/4476] 10.222.0.87 () {58 vars in 1156 bytes} [Mon Oct 17 15:44:34 2022] GET /compute/v2.1/servers?name=1561061362 => generated 346 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:35.681931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:35.693514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:35.695185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:35.705128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:35.706098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:35.708168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:35.711082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:35.712649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:35.714310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:35.852730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:35.884166 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-26a7cbfb-3276-4542-8e66-1edf1b49f700 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.614782 Oct 17 15:44:35.889345 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2117/4477] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:35 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:35.903421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:35.904484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:44:35.908725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:35.949037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:35.950464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:35.951574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:35.953193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:35.954353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:35.955471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:36.084693 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5135f88e-2d36-4de7-9494-65161b2bf8f2 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.410144 Oct 17 15:44:36.084693 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2361/4478] 10.222.0.87 () {58 vars in 1154 bytes} [Mon Oct 17 15:44:35 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:44:36.107796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:36.118753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:36.119872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-156106136', 'deleted': False, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:44:36.127485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:36.128388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:36.129005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:36.131061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:36.132250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:36.133688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:36.288535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:44:36.375214 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6696d04-9d3b-4d4a-8ff1-aceaa97f1dcf tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-156106136" status: 200 len: 346 microversion: 2.1 time: 0.273624 Oct 17 15:44:36.376130 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2362/4479] 10.222.0.87 () {58 vars in 1228 bytes} [Mon Oct 17 15:44:36 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-156106136 => generated 346 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:36.382423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:36.383163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:36.399880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:36.400744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:36.401737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:36.403332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:36.404210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:36.405005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:36.434955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:36.454223 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-49ab348a-e7d1-4a90-a6c6-5b2d198ae93c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 0.562347 Oct 17 15:44:36.456344 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2118/4480] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:35 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:36.481963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:36.483469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:36.513768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:36.514707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:36.515522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:36.516844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:36.517704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:36.518481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:36.634294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:44:36.925054 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1d39c8dc-67ea-4c01-a6d0-2ce9380c0758 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "DELETE /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 204 len: 0 microversion: 2.1 time: 0.456306 Oct 17 15:44:36.929439 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2119/4481] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:44:36 2022] DELETE /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:44:36.951390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:36.952683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:36.965182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:36.966061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:36.966902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:36.968159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:36.968956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:36.978466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:37.361919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:37.385118 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6aafe5e0-6e62-4e8b-bca7-ae12574320b7 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1679 microversion: 2.1 time: 0.453387 Oct 17 15:44:37.392517 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2120/4482] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:36 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1679 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:37.406972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:37.410397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:37.425377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:37.426647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:37.427831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:37.430925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:37.432212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:37.433227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:37.805536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:37.818127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:37.825677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:37.827327 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea19bfc9-07c6-4d06-8550-0b38d1c3fcdf tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 1.450185 Oct 17 15:44:37.836961 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2363/4483] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:36 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:37.853261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:37.853899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:37.869038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:37.869548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:37.870239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:37.870798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:37.871261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:37.877063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:37.927155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:37.948089 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6e57517b-2334-435a-88d1-f8b3f619e3a6 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1515 microversion: 2.1 time: 0.553527 Oct 17 15:44:37.964311 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2121/4484] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:37 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1515 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:38.437789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:38.438417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:38.454918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:38.460953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:38.461733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:38.468696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:38.469475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:38.471247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:38.756331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:38.967838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:39.009663 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d2d198e-42f7-4bbf-bce1-7e4b36b0d7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 1.170745 Oct 17 15:44:39.011305 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2364/4485] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:37 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:39.033817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:39.035548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:39.062374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:39.063825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:39.070375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:39.072137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:39.073370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:39.074728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:39.479947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:39.496955 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e79f87e8-2fe0-424e-89da-07f8c96f0d5c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1656 microversion: 2.1 time: 1.062931 Oct 17 15:44:39.498928 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2122/4486] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:38 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1656 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:39.532344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:39.539697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:39.581359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:39.585801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:39.591134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:39.592890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:39.596682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:39.597066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:39.923974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:39.970705 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-16c287eb-b3d9-4f6c-b3df-9f1d3277cdc0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1473 microversion: 2.1 time: 0.468315 Oct 17 15:44:39.989829 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2123/4487] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:39 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1473 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:39.997381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-553a61be-c1d3-4983-ae65-edec568c5f1d req-dced3fba-d020-4672-9b31-3265cac8849d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781ce8e0-1ad0-4713-ac95-2abac4f7a1d7", "tag": "e23fd663-fe28-4bf5-ae5b-5433ac887247"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:40.013932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-553a61be-c1d3-4983-ae65-edec568c5f1d req-dced3fba-d020-4672-9b31-3265cac8849d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:40.014919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-553a61be-c1d3-4983-ae65-edec568c5f1d req-dced3fba-d020-4672-9b31-3265cac8849d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:40.015922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-553a61be-c1d3-4983-ae65-edec568c5f1d req-dced3fba-d020-4672-9b31-3265cac8849d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:40.046703 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-553a61be-c1d3-4983-ae65-edec568c5f1d req-dced3fba-d020-4672-9b31-3265cac8849d service nova] Creating event network-changed:e23fd663-fe28-4bf5-ae5b-5433ac887247 for instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 on n-h2-854441-12 Oct 17 15:44:40.060982 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-553a61be-c1d3-4983-ae65-edec568c5f1d req-dced3fba-d020-4672-9b31-3265cac8849d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069161 Oct 17 15:44:40.062697 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2124/4488] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:40.080192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24938dd7-d97d-4397-b964-8d4ded80da82 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:40.097476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24938dd7-d97d-4397-b964-8d4ded80da82 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:40.098299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24938dd7-d97d-4397-b964-8d4ded80da82 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:40.100456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24938dd7-d97d-4397-b964-8d4ded80da82 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:40.217745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:40.229798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:40.244934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:40.245818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-24938dd7-d97d-4397-b964-8d4ded80da82 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Going to try to start instance {{(pid=120407) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 15:44:40.246158 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ca4a6ba-0a45-4417-adac-9c019c88ec5c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 1.233194 Oct 17 15:44:40.259772 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2365/4489] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:39 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:40.265303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2dfc89e6-519a-4917-b0c9-5425eabd5a92 req-4f53b790-1aaa-42e2-83ea-5569912b06f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b39d17-ff92-4fdc-aaff-6c6249cec45e", "name": "network-vif-deleted", "tag": "17bc254d-8ec6-426f-aa21-be2ef71fa710"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:40.281447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2dfc89e6-519a-4917-b0c9-5425eabd5a92 req-4f53b790-1aaa-42e2-83ea-5569912b06f2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:40.287037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2dfc89e6-519a-4917-b0c9-5425eabd5a92 req-4f53b790-1aaa-42e2-83ea-5569912b06f2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:40.287764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2dfc89e6-519a-4917-b0c9-5425eabd5a92 req-4f53b790-1aaa-42e2-83ea-5569912b06f2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:40.315727 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2dfc89e6-519a-4917-b0c9-5425eabd5a92 req-4f53b790-1aaa-42e2-83ea-5569912b06f2 service nova] Creating event network-vif-deleted:17bc254d-8ec6-426f-aa21-be2ef71fa710 for instance 16b39d17-ff92-4fdc-aaff-6c6249cec45e on n-h1-854441-12 Oct 17 15:44:40.329559 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2dfc89e6-519a-4917-b0c9-5425eabd5a92 req-4f53b790-1aaa-42e2-83ea-5569912b06f2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081442 Oct 17 15:44:40.330404 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2366/4490] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:40.339936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:40.348554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:40.375697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:40.376325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:40.376849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:40.377689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:40.379603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:40.381147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:40.517312 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24938dd7-d97d-4397-b964-8d4ded80da82 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.447591 Oct 17 15:44:40.518873 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2125/4491] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:44:40 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:44:40.546582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:40.548192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:40.585198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:40.586031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:40.586938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:40.588211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:40.588914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:40.591511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:40.730545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:41.039713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:41.050944 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d5e9b9d-7ae2-4a78-bdb8-f0e9b8298780 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 0.718850 Oct 17 15:44:41.056088 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2367/4492] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:40 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:41.081755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:41.082918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:41.125858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:41.130169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:41.134974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:41.141890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:41.146561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:41.163353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:41.325328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:41.326207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:41.327071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:41.327910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lazy-loading 'fault' on Instance uuid 16b39d17-ff92-4fdc-aaff-6c6249cec45e {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:44:41.634331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:41.650602 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-94cf6c62-68db-4b61-b1f2-7e259a0e5541 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1665 microversion: 2.1 time: 1.122572 Oct 17 15:44:41.654562 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2126/4493] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:40 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1665 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:41.659863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:41.671598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:41.678476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:41.679034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:41.679816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:41.680608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:41.681305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:41.681754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:41.826281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:41.855854 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-170deb12-a7a1-4579-aa43-6d68e8e6526b tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 200 len: 1309 microversion: 2.1 time: 0.797941 Oct 17 15:44:41.861450 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2368/4494] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:41 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 1309 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:42.088867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:42.103910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:42.105969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:42.110279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:42.112336 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-34a089d5-63eb-4c2d-893f-b0f4f31c0aef tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 0.456275 Oct 17 15:44:42.113714 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2127/4495] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:41 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:42.120009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:42.144986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:42.147823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:42.148813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:42.150055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:42.150946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:42.161965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:42.226415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cd067d48-1e17-4512-91be-35d60192132b req-a8b7b683-c3ef-4633-a407-0719b01fca78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8548020-e957-4428-8e54-c34c68c9b446", "name": "network-vif-plugged", "status": "completed", "tag": "448433f4-0243-4d4b-b11f-4e68c617941d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:42.273510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cd067d48-1e17-4512-91be-35d60192132b req-a8b7b683-c3ef-4633-a407-0719b01fca78 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:42.274346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cd067d48-1e17-4512-91be-35d60192132b req-a8b7b683-c3ef-4633-a407-0719b01fca78 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:42.275193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cd067d48-1e17-4512-91be-35d60192132b req-a8b7b683-c3ef-4633-a407-0719b01fca78 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:42.329244 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cd067d48-1e17-4512-91be-35d60192132b req-a8b7b683-c3ef-4633-a407-0719b01fca78 service nova] Creating event network-vif-plugged:448433f4-0243-4d4b-b11f-4e68c617941d for instance f8548020-e957-4428-8e54-c34c68c9b446 on n-h1-854441-12 Oct 17 15:44:42.349346 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cd067d48-1e17-4512-91be-35d60192132b req-a8b7b683-c3ef-4633-a407-0719b01fca78 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131697 Oct 17 15:44:42.354621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2128/4496] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:44:42.684914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:42.687802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:42.697803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:42.700757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:42.701703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:42.702914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:42.703978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:42.704807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:42.705431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:43.136603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:43.152159 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-caaccb53-9f28-4374-ae86-2f4d5479f4b8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1665 microversion: 2.1 time: 0.473469 Oct 17 15:44:43.154563 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2129/4497] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:42 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1665 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:43.161371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:43.162091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: 16b39d17-ff92-4fdc-aaff-6c6249cec45e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:43.169505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:43.170109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:43.170688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:43.171491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:43.172022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:43.172548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:43.176036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:43.194047 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] HTTP exception thrown: Instance 16b39d17-ff92-4fdc-aaff-6c6249cec45e could not be found. Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Request method failure captured: Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e HTTP/1.1 Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXgEzAo4kU7hkxJlVnaq-RWnNe4_LreGIJMliTb7Qr-uln-Ypyg51SQAUCdXFLwZtSvCs-wYTLeaSqmeKDpZ_YqQ_0VT8Z8U3JSdAiowopBzfHi2qyr9SnM5E_QLT5yByuaxEh-RKu3ypcLvuj3TXQfs8HWDavjTPH2SD6oaWBT6rZ0 Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3346db7d11ef4b1d9b295ec3ea08c65a Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ListServerFiltersTestJSON-86205336 Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ListServerFiltersTestJSON-86205336 Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3346db7d11ef4b1d9b295ec3ea08c65a Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-86205336 Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ListServerFiltersTestJSON-86205336-project Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 9dfcc636db574b30abe01e6332b57dfc Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ListServerFiltersTestJSON-86205336-project Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 16b39d17-ff92-4fdc-aaff-6c6249cec45e could not be found. Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '16b39d17-ff92-4fdc-aaff-6c6249cec45e'} Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b39d17-ff92-4fdc-aaff-6c6249cec45e could not be found. Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b39d17-ff92-4fdc-aaff-6c6249cec45e could not be found. Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:43.196266 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:43.200451 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:43.200451 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:43.200451 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:43.200451 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:44:43.200451 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:44:43.200451 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b39d17-ff92-4fdc-aaff-6c6249cec45e could not be found. Oct 17 15:44:43.200451 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:43.202582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Returning 404 to user: Instance 16b39d17-ff92-4fdc-aaff-6c6249cec45e could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:44:43.204036 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b7a112fd-a401-44a1-a9f3-67435f6d2022 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e" status: 404 len: 111 microversion: 2.1 time: 0.048090 Oct 17 15:44:43.204852 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2130/4498] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:43 2022] GET /compute/v2.1/servers/16b39d17-ff92-4fdc-aaff-6c6249cec45e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:44:43.212653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:43.213863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:43.223749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:43.224252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:43.224692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:43.225422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:43.225882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:43.226370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:43.398154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:43.440715 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14dd8065-37f1-4a6a-a021-dc22c9cc79dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 1.340584 Oct 17 15:44:43.448670 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2369/4499] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:42 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:43.469566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:43.470882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:43.489999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:43.494654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:43.498398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:43.501150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:43.502253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:43.503000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:43.575292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:44:43.735514 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b8cc0b1-2809-4df3-8c66-d2a898fbf61f tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 204 len: 0 microversion: 2.1 time: 0.284947 Oct 17 15:44:43.745474 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2370/4500] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:44:43 2022] DELETE /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:44:43.765814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:43.768215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:43.783964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:43.785393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:43.787429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:43.789255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:43.790363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:43.791598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:43.808413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:43.824265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:43.835837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:43.837375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-43f2045e-56e8-4c5b-9457-5b1e04b0b906 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 0.631295 Oct 17 15:44:43.848014 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2131/4501] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:43 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:44.222405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:44.224806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:44.253144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:44.254580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:44.255789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:44.259132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:44.260363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:44.261682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:44.515755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:44.519924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:44.535893 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-692e7abd-e9bc-4ad6-917a-173f51f6fca0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 200 len: 1516 microversion: 2.1 time: 0.787280 Oct 17 15:44:44.536616 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2371/4502] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:43 2022] GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 1516 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:44.583125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:44.584200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:44.597992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:44.598650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:44.610925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:44.611861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:44.612387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:44.612834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:44.786460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:44.816563 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6e94f100-dd5e-46f6-b12d-c51024f6cec0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1665 microversion: 2.1 time: 0.607548 Oct 17 15:44:44.839347 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2132/4503] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:44 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1665 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:44.876325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:44.881218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:44.899584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:44.900886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:44.902524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:44.904429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:44.906795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:44.908385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:45.991028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:46.022320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:46.025386 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3198cd83-dc83-4e96-9ca2-6690be3beb58 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1316 microversion: 2.1 time: 1.465345 Oct 17 15:44:46.046024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:46.058129 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2372/4504] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:44 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1316 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:46.061090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:46.069093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca7b9d61-5565-4757-9a21-6d8f81f80abb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 1.204595 Oct 17 15:44:46.076036 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2133/4505] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:44 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:46.086230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:46.087471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:46.088349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:46.091128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:46.103872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:46.107318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:46.108643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:46.109776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:46.111334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:46.112203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:46.112700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:46.113685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:46.114674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:46.116455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:46.120320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:46.122173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:46.124842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:46.227063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:46.555378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:46.583858 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22eb2106-c546-4843-a45a-cadcff4ad8d0 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.505559 Oct 17 15:44:46.588452 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2134/4506] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:46 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:46.620673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:46.626069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:46.652012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:46.652811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:46.653409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:46.654293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:46.654992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:46.655586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:46.975027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:46.997134 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61d0acfe-e9ac-4fba-9288-4c669888b29a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 200 len: 1516 microversion: 2.1 time: 0.937073 Oct 17 15:44:47.020708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:47.026182 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2373/4507] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:46 2022] GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 1516 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:47.045754 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a2358019-4367-4cf0-b8b7-b9c7f8e13740 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.433532 Oct 17 15:44:47.048575 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2135/4508] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:46 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:44:47.075908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:47.076547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:47.084251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:47.085057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:47.085729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:47.086827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:47.087476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:47.088192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:47.094486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:47.100806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:47.126039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:47.126959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:47.127749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:47.130836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:47.132190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:47.133339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:47.751648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:47.781485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:47.805462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0de05c1a-9f02-40e2-8a93-cae3164fcaeb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1506 microversion: 2.1 time: 0.733347 Oct 17 15:44:47.805802 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d12a35b9-c34d-4849-92ec-cf9f7bd4b5c8 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.718266 Oct 17 15:44:47.806543 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2136/4509] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:47 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:47.838637 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2374/4510] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:47 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:47.858778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:47.864231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:47.870265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:47.871318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:47.890005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:47.891490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:47.892523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:47.892974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:47.893489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:47.893940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:47.894724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:47.895841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:47.896291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:47.900472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:47.901754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:47.902835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.378816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:48.394004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:48.397818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:48.402557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7d4fcb6-5499-45a6-8edf-4564dda6b8c5 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 0.564990 Oct 17 15:44:48.406628 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2375/4511] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:47 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:48.416543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:48.417868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:48.437460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.438263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.438899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.439841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.440479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.441075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.492573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:48.508571 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d46fb88b-7c29-4cac-b02a-f8d4258092fa tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.664549 Oct 17 15:44:48.521955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:44:48.524279 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2137/4512] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:47 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:48.529430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:48.530058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:48.558853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.559447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.561111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.564728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.565502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.565888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.643631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.644122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.644604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.645081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lazy-loading 'fault' on Instance uuid c607fd33-a4f9-4a9b-994f-f625d2e3ca66 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:44:48.747970 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-859087a5-5e52-4bce-a95c-7534aeaa5a05 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 204 len: 0 microversion: 2.1 time: 0.337333 Oct 17 15:44:48.756994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:48.759093 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2376/4513] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:44:48 2022] DELETE /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:44:48.766317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-14ec58a6-2c42-4de9-800b-4595916ac1d7 req-ad43279c-a18e-45bd-9c94-9f2fee37e844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c607fd33-a4f9-4a9b-994f-f625d2e3ca66", "name": "network-vif-deleted", "tag": "80f8a41f-ae57-4657-9919-f0ec8ebe09c3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:48.771982 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23961b06-4cb8-4ea8-a98e-f0729885e9e8 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 200 len: 1310 microversion: 2.1 time: 0.243908 Oct 17 15:44:48.772677 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2138/4514] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:48 2022] GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 1310 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:48.782276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:48.786519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:48.801023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.802846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.805550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.807607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-14ec58a6-2c42-4de9-800b-4595916ac1d7 req-ad43279c-a18e-45bd-9c94-9f2fee37e844 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.808818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-14ec58a6-2c42-4de9-800b-4595916ac1d7 req-ad43279c-a18e-45bd-9c94-9f2fee37e844 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.809068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.809644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.810101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.810576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-14ec58a6-2c42-4de9-800b-4595916ac1d7 req-ad43279c-a18e-45bd-9c94-9f2fee37e844 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.834699 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-14ec58a6-2c42-4de9-800b-4595916ac1d7 req-ad43279c-a18e-45bd-9c94-9f2fee37e844 service nova] Creating event network-vif-deleted:80f8a41f-ae57-4657-9919-f0ec8ebe09c3 for instance c607fd33-a4f9-4a9b-994f-f625d2e3ca66 on n-h1-854441-12 Oct 17 15:44:48.845624 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-14ec58a6-2c42-4de9-800b-4595916ac1d7 req-ad43279c-a18e-45bd-9c94-9f2fee37e844 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083494 Oct 17 15:44:48.847583 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2377/4515] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:48.859269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:48.861137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:48.874804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.876100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.877278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:48.879191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:48.880283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:48.881584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:49.297295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:49.335755 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a2d7aa52-9698-46b8-bbc6-1d0023268d9c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.559918 Oct 17 15:44:49.341000 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2139/4516] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:48 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:49.382702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:49.384095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:49.400721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:49.401437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:49.405199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:49.406296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:49.407394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:49.408073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:49.502033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lazy-loading 'flavor' on Instance uuid ff35e7aa-0374-467e-8034-d2fee905517a {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:44:49.551748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:49.586592 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc45c4f8-d5de-4c3b-b13e-7dae0105ba0e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1512 microversion: 2.1 time: 0.734005 Oct 17 15:44:49.591425 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2378/4517] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:48 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1512 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:49.607019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:49.619797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:49.645616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:49.646183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:49.648926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:49.652818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:49.653377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:49.653884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:49.687403 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-73959fb0-d3f9-4bd5-92bb-94c82fd7a1e5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.313532 Oct 17 15:44:49.688268 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2140/4518] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:44:49 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:44:49.722849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:49.724284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:49.752118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:49.752634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:49.753074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:49.753823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:49.754281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:49.754741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:50.364422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:50.373964 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e2149995-7ead-46a4-8891-04713e004e1b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1677 microversion: 2.1 time: 0.679374 Oct 17 15:44:50.377766 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2141/4519] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:49 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1677 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:44:50.386259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:50.390683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c607fd33-a4f9-4a9b-994f-f625d2e3ca66] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:50.404461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:50.405260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:50.406138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:50.407347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:50.408321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:50.408960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:50.426929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] HTTP exception thrown: Instance c607fd33-a4f9-4a9b-994f-f625d2e3ca66 could not be found. Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Request method failure captured: Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 HTTP/1.1 Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXgEzAo4kU7hkxJlVnaq-RWnNe4_LreGIJMliTb7Qr-uln-Ypyg51SQAUCdXFLwZtSvCs-wYTLeaSqmeKDpZ_YqQ_0VT8Z8U3JSdAiowopBzfHi2qyr9SnM5E_QLT5yByuaxEh-RKu3ypcLvuj3TXQfs8HWDavjTPH2SD6oaWBT6rZ0 Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3346db7d11ef4b1d9b295ec3ea08c65a Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ListServerFiltersTestJSON-86205336 Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ListServerFiltersTestJSON-86205336 Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3346db7d11ef4b1d9b295ec3ea08c65a Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-86205336 Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ListServerFiltersTestJSON-86205336-project Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 9dfcc636db574b30abe01e6332b57dfc Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ListServerFiltersTestJSON-86205336-project Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance c607fd33-a4f9-4a9b-994f-f625d2e3ca66 could not be found. Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'c607fd33-a4f9-4a9b-994f-f625d2e3ca66'} Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c607fd33-a4f9-4a9b-994f-f625d2e3ca66 could not be found. Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c607fd33-a4f9-4a9b-994f-f625d2e3ca66 could not be found. Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:50.429394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:50.433114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:50.433114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:50.433114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:50.433114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:44:50.433114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:44:50.433114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c607fd33-a4f9-4a9b-994f-f625d2e3ca66 could not be found. Oct 17 15:44:50.433114 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:50.435567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Returning 404 to user: Instance c607fd33-a4f9-4a9b-994f-f625d2e3ca66 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:44:50.440289 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1aad6f26-c71b-45bc-b19b-8b55b12a018c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66" status: 404 len: 111 microversion: 2.1 time: 0.059558 Oct 17 15:44:50.443066 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2142/4520] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:50 2022] GET /compute/v2.1/servers/c607fd33-a4f9-4a9b-994f-f625d2e3ca66 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:44:50.457635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:50.467040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:50.478448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:50.479967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:50.480775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:50.481770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:50.482473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:50.483164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:50.554924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:44:50.766998 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e1fa7a8a-13d1-4bce-a15b-3754dd497cda tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 204 len: 0 microversion: 2.1 time: 0.320899 Oct 17 15:44:50.775152 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2143/4521] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:44:50 2022] DELETE /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:44:50.786310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:50.789801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:50.807630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:50.808550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:50.809937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:50.810801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:50.811263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:50.815279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:50.848719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:51.130306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:51.148278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:51.149824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:51.151101 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad9a84f2-e303-464d-9a16-cacc0304356f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 1.556713 Oct 17 15:44:51.151703 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2379/4522] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:49 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:51.192069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:51.193137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:51.211730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:51.212844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:51.214004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:51.215031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:51.218035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:51.219458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:51.354937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:51.370912 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-efbb9828-a07a-44c6-9f14-39ae642bb6be tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1512 microversion: 2.1 time: 0.593000 Oct 17 15:44:51.384144 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2144/4523] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:50 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1512 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:51.409679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:51.411800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:51.442524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:51.444023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:51.446095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:51.450158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:51.453855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:51.454736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:52.167265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:52.183051 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b669c893-37f9-4089-bc25-2887f2992651 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1517 microversion: 2.1 time: 1.011448 Oct 17 15:44:52.205674 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2380/4524] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:51 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1517 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:52.228160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:52.228862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:52.255216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:52.259880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:52.260739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:52.261772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:52.266123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:52.277849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:52.670546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:52.708784 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ccf8512f-0832-422c-a7d6-311cf582aed4 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1660 microversion: 2.1 time: 1.306401 Oct 17 15:44:52.715373 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2145/4525] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:51 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1660 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:44:52.725763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-82e784d0-d87e-4e90-8c36-44124750bb00 req-f5bd5db9-f0f7-4ae0-9ef2-d2a74180f665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781ce8e0-1ad0-4713-ac95-2abac4f7a1d7", "name": "network-vif-plugged", "status": "completed", "tag": "e23fd663-fe28-4bf5-ae5b-5433ac887247"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:52.786329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82e784d0-d87e-4e90-8c36-44124750bb00 req-f5bd5db9-f0f7-4ae0-9ef2-d2a74180f665 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:52.787520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82e784d0-d87e-4e90-8c36-44124750bb00 req-f5bd5db9-f0f7-4ae0-9ef2-d2a74180f665 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:52.788573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82e784d0-d87e-4e90-8c36-44124750bb00 req-f5bd5db9-f0f7-4ae0-9ef2-d2a74180f665 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:52.816959 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-82e784d0-d87e-4e90-8c36-44124750bb00 req-f5bd5db9-f0f7-4ae0-9ef2-d2a74180f665 service nova] Creating event network-vif-plugged:e23fd663-fe28-4bf5-ae5b-5433ac887247 for instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 on n-h2-854441-12 Oct 17 15:44:52.839591 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-82e784d0-d87e-4e90-8c36-44124750bb00 req-f5bd5db9-f0f7-4ae0-9ef2-d2a74180f665 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110738 Oct 17 15:44:52.846336 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2146/4526] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:52.885493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-3f1786df-ea12-43ae-9b79-7fe4b2341de8 req-7028ff03-02b3-42dd-9a5e-46898c1bec77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8548020-e957-4428-8e54-c34c68c9b446", "name": "network-vif-deleted", "tag": "448433f4-0243-4d4b-b11f-4e68c617941d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:52.966902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3f1786df-ea12-43ae-9b79-7fe4b2341de8 req-7028ff03-02b3-42dd-9a5e-46898c1bec77 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:52.967749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3f1786df-ea12-43ae-9b79-7fe4b2341de8 req-7028ff03-02b3-42dd-9a5e-46898c1bec77 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:52.968554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3f1786df-ea12-43ae-9b79-7fe4b2341de8 req-7028ff03-02b3-42dd-9a5e-46898c1bec77 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:53.034361 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-3f1786df-ea12-43ae-9b79-7fe4b2341de8 req-7028ff03-02b3-42dd-9a5e-46898c1bec77 service nova] Creating event network-vif-deleted:448433f4-0243-4d4b-b11f-4e68c617941d for instance f8548020-e957-4428-8e54-c34c68c9b446 on n-h1-854441-12 Oct 17 15:44:53.092009 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-3f1786df-ea12-43ae-9b79-7fe4b2341de8 req-7028ff03-02b3-42dd-9a5e-46898c1bec77 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237678 Oct 17 15:44:53.093490 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2147/4527] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:53.142085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:53.157401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:53.182239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:53.182775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:53.186220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:53.189794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:53.195705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:53.197493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:53.220763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:53.249411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:53.258935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:53.264056 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97504746-3bf4-49d5-8ce5-f5559fc9ee83 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 1.057128 Oct 17 15:44:53.287808 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2381/4528] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:52 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:53.318442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14d85251-2c55-428f-9dc9-1de5a46a464d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:53.325868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14d85251-2c55-428f-9dc9-1de5a46a464d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:53.357273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d85251-2c55-428f-9dc9-1de5a46a464d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:53.368568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d85251-2c55-428f-9dc9-1de5a46a464d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:53.369427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d85251-2c55-428f-9dc9-1de5a46a464d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:53.370394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d85251-2c55-428f-9dc9-1de5a46a464d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:53.371074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d85251-2c55-428f-9dc9-1de5a46a464d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:53.380302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d85251-2c55-428f-9dc9-1de5a46a464d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:53.392891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:53.393720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:53.394341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:53.396814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lazy-loading 'fault' on Instance uuid f8548020-e957-4428-8e54-c34c68c9b446 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:44:53.685969 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14d85251-2c55-428f-9dc9-1de5a46a464d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action" status: 202 len: 0 microversion: 2.1 time: 0.396106 Oct 17 15:44:53.698019 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2382/4529] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:44:53 2022] POST /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:44:53.747359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:53.756487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:53.790269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:53.794079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:53.804909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:53.806322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:53.808039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:53.814733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:53.816018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:53.837147 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc3c8e15-68ae-4fb2-a22b-1105331b1717 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 200 len: 1306 microversion: 2.1 time: 0.732226 Oct 17 15:44:53.843177 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2148/4530] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:53 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 1306 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:54.475006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-91093b78-2620-470a-b9cf-27bf2ea6b375 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Action: 'create', calling method: .version_select at 0x7f28c2de13a0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-75880988", "policies": ["affinity"]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:54.572576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-91093b78-2620-470a-b9cf-27bf2ea6b375 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:54.589005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-91093b78-2620-470a-b9cf-27bf2ea6b375 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:54.722805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-91093b78-2620-470a-b9cf-27bf2ea6b375 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:54.743873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-91093b78-2620-470a-b9cf-27bf2ea6b375 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:54.782215 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-91093b78-2620-470a-b9cf-27bf2ea6b375 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.934936 Oct 17 15:44:54.790459 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2149/4531] 10.222.0.87 () {60 vars in 1174 bytes} [Mon Oct 17 15:44:53 2022] POST /compute/v2.1/os-server-groups => generated 182 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:54.807445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:54.808266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:54.829024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:54.838522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:54.841738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:54.842889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:54.843942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:54.845819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:55.281344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:55.291352 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc9ec511-3484-40b0-9640-4b905d87e14c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1666 microversion: 2.1 time: 0.499531 Oct 17 15:44:55.294432 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2150/4532] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:54 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1666 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:55.299704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:55.307138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:55.335000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:55.336115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:55.337329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:55.343303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:55.346687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:55.349943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:55.544394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:55.555352 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d3b1bf6-061c-4e56-993d-14429f2f09c0 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1517 microversion: 2.1 time: 1.855185 Oct 17 15:44:55.560359 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2383/4533] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:53 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1517 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:55.580345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6c59a7a-6468-4c0b-968f-b09f5c3241b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Action: 'create', calling method: .version_select at 0x7f28c2e0fb80>, body: {"server_group": {"name": "tempest-server-group-831404413", "policies": ["affinity"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:55.622529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e6c59a7a-6468-4c0b-968f-b09f5c3241b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:55.641924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e6c59a7a-6468-4c0b-968f-b09f5c3241b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:55.701341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:55.734352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:55.745023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e6c59a7a-6468-4c0b-968f-b09f5c3241b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:55.746333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:55.749494 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92826aaf-1037-497f-9e5f-b929d9f372bc tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1406 microversion: 2.20 time: 0.453349 Oct 17 15:44:55.752081 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2151/4534] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:55 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:55.754130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e6c59a7a-6468-4c0b-968f-b09f5c3241b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:55.759938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:55.770690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:55.771917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:55.775748 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6c59a7a-6468-4c0b-968f-b09f5c3241b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.213426 Oct 17 15:44:55.776957 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2384/4535] 10.222.0.87 () {60 vars in 1173 bytes} [Mon Oct 17 15:44:55 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:55.789977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a94abeaf-6ae6-4833-91d4-4a9090002933 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Action: 'create', calling method: .version_select at 0x7f28be280160>, body: {"server_group": {"name": "tempest-server-group-831404413", "policies": ["affinity"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:55.792310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:55.798697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:55.799896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:55.803559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:55.804667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:55.805644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:55.849113 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 HTTP/1.1 Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f8548020-e957-4428-8e54-c34c68c9b446'} Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:55.855494 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:55.859927 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:55.859927 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:55.859927 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:55.859927 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:44:55.859927 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:44:55.859927 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:44:55.859927 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:44:55.862265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:44:55.864744 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4d2159da-325e-425a-99c8-cca272d27bda tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 404 len: 111 microversion: 2.1 time: 0.110950 Oct 17 15:44:55.866328 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2152/4536] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:55 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:44:55.879547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a94abeaf-6ae6-4833-91d4-4a9090002933 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:55.881574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:55.885377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:55.902688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a94abeaf-6ae6-4833-91d4-4a9090002933 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:55.908374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:55.909200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:55.912883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:55.913883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:55.914368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:55.915016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:56.123113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a94abeaf-6ae6-4833-91d4-4a9090002933 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:56.182265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a94abeaf-6ae6-4833-91d4-4a9090002933 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:56.266562 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a94abeaf-6ae6-4833-91d4-4a9090002933 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.441721 Oct 17 15:44:56.269781 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2385/4537] 10.222.0.87 () {60 vars in 1173 bytes} [Mon Oct 17 15:44:55 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:44:56.291414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca3aca13-b437-4c83-95d4-ab94efe8c5c1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:56.329057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca3aca13-b437-4c83-95d4-ab94efe8c5c1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/0e69e73d-c2d7-4480-aae6-26216193e82f" status: 204 len: 0 microversion: 2.1 time: 0.050394 Oct 17 15:44:56.330437 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2386/4538] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:44:56 2022] DELETE /compute/v2.1/os-server-groups/0e69e73d-c2d7-4480-aae6-26216193e82f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:44:56.344341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:56.346216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:56.354426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:56.355268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:56.356057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:56.356980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:56.357641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:56.358423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:56.433827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:56.478971 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-384d30d3-f510-4c8a-8e05-934e5b52106e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.606727 Oct 17 15:44:56.482029 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2153/4539] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:55 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:56.501842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a77046a4-73b9-46c1-a041-f7a8d6f73af9 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:56.560611 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a77046a4-73b9-46c1-a041-f7a8d6f73af9 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.076761 Oct 17 15:44:56.564580 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2154/4540] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:44:56 2022] GET /compute/v2.1/os-server-groups => generated 332 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:56.586958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2776f835-2fa1-47bc-92fb-52120ee98c33 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:56.745761 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2776f835-2fa1-47bc-92fb-52120ee98c33 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/e7e96a71-492c-4774-9e6f-5dfbf0772e0f" status: 204 len: 0 microversion: 2.1 time: 0.172225 Oct 17 15:44:56.756414 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2155/4541] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:44:56 2022] DELETE /compute/v2.1/os-server-groups/e7e96a71-492c-4774-9e6f-5dfbf0772e0f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:44:56.765341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:56.768153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:56.776058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:56.779058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:56.780129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:56.781388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:56.783585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:56.784765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:57.197950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:57.228671 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d3bab132-7441-4b39-bd9d-64bad3a2828c tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1517 microversion: 2.1 time: 0.468558 Oct 17 15:44:57.229561 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2156/4542] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:56 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1517 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:57.249639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4b6ef99-0e75-4184-95fd-96a8c9d0188d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:57.269900 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b4b6ef99-0e75-4184-95fd-96a8c9d0188d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.039163 Oct 17 15:44:57.284808 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2157/4543] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:44:57 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:57.291645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:57.292266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:57.302085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:57.302993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:57.303678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:57.304741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:57.305829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:57.306482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:57.626551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:57.635149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:57.639702 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-530a7ba5-0d3f-44cd-87d2-f7c2395753db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1666 microversion: 2.1 time: 1.307929 Oct 17 15:44:57.640575 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2387/4544] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:56 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1666 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:57.655355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7b10b91-3842-45c3-83bd-a94f9d27b1ad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:57.657016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:57.665635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:57.668241 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0fb1b7fe-d72d-46eb-9ac6-e2e044daf620 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1599 microversion: 2.20 time: 0.381863 Oct 17 15:44:57.670290 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2158/4545] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:44:57 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1599 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7b10b91-3842-45c3-83bd-a94f9d27b1ad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 163 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": 12345, "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 12345 Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:44:57.679846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7b10b91-3842-45c3-83bd-a94f9d27b1ad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:44:57.686812 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7b10b91-3842-45c3-83bd-a94f9d27b1ad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.039549 Oct 17 15:44:57.691711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-85990a89-8a47-4292-9f6e-ee63b831766c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Action: 'create', calling method: .version_select at 0x7f28be3c9550>, body: {"server_group": {"name": "tempest-server-group-839210206", "policies": ["affinity"]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:57.702184 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2388/4546] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:44:57 2022] POST /compute/v2.1/servers => generated 127 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:44:57.722868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ea351eb-52a7-4847-b9c8-f1fd1c05c0f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:57.724106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ea351eb-52a7-4847-b9c8-f1fd1c05c0f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:57.747756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-85990a89-8a47-4292-9f6e-ee63b831766c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:57.751118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea351eb-52a7-4847-b9c8-f1fd1c05c0f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:57.751963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea351eb-52a7-4847-b9c8-f1fd1c05c0f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:57.753122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea351eb-52a7-4847-b9c8-f1fd1c05c0f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:57.754000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea351eb-52a7-4847-b9c8-f1fd1c05c0f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:57.754949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea351eb-52a7-4847-b9c8-f1fd1c05c0f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:57.756001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea351eb-52a7-4847-b9c8-f1fd1c05c0f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:57.778435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-85990a89-8a47-4292-9f6e-ee63b831766c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:57.815142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:57.935175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-85990a89-8a47-4292-9f6e-ee63b831766c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:57.975499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-85990a89-8a47-4292-9f6e-ee63b831766c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:58.040882 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-85990a89-8a47-4292-9f6e-ee63b831766c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.368064 Oct 17 15:44:58.042912 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2159/4547] 10.222.0.87 () {60 vars in 1173 bytes} [Mon Oct 17 15:44:57 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:58.064760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:58.066591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:58.088152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:58.089268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:58.095582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:58.097122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:58.098163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:58.099150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:58.545584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:58.570687 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ea351eb-52a7-4847-b9c8-f1fd1c05c0f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.866794 Oct 17 15:44:58.571322 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2389/4548] 10.222.0.87 () {60 vars in 1316 bytes} [Mon Oct 17 15:44:57 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/os-interface => generated 285 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:44:58.585618 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b60382e0-01e3-4978-933e-2b3dee6fd1e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.528990 Oct 17 15:44:58.587300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a549cdd-56c5-4b8d-a5dc-bcbe09fc4945 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:58.618117 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2160/4549] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:58 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:58.659578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:58.660944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:58.661125 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a549cdd-56c5-4b8d-a5dc-bcbe09fc4945 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/0b8bd776-3f5d-495d-8b05-c9071aea8565" status: 204 len: 0 microversion: 2.1 time: 0.088269 Oct 17 15:44:58.664727 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2390/4550] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:44:58 2022] DELETE /compute/v2.1/os-server-groups/0b8bd776-3f5d-495d-8b05-c9071aea8565 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:44:58.678211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-89184a7b-e707-4d5a-bf37-87ab108c4228 req-156b44a0-4e11-4155-8c93-00b012fa32dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0eb3eaa-acf7-4510-898c-87a14936db51", "name": "network-vif-deleted", "tag": "e557081b-7164-4824-9c72-3c8fcc75da34"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:58.679607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:58.680659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:58.682170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:58.687466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:58.688675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:58.689301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:58.733369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-89184a7b-e707-4d5a-bf37-87ab108c4228 req-156b44a0-4e11-4155-8c93-00b012fa32dd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:58.734858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-89184a7b-e707-4d5a-bf37-87ab108c4228 req-156b44a0-4e11-4155-8c93-00b012fa32dd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:58.735624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-89184a7b-e707-4d5a-bf37-87ab108c4228 req-156b44a0-4e11-4155-8c93-00b012fa32dd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:58.765817 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-89184a7b-e707-4d5a-bf37-87ab108c4228 req-156b44a0-4e11-4155-8c93-00b012fa32dd service nova] Creating event network-vif-deleted:e557081b-7164-4824-9c72-3c8fcc75da34 for instance c0eb3eaa-acf7-4510-898c-87a14936db51 on n-h2-854441-12 Oct 17 15:44:58.785365 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-89184a7b-e707-4d5a-bf37-87ab108c4228 req-156b44a0-4e11-4155-8c93-00b012fa32dd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112412 Oct 17 15:44:58.786785 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2391/4551] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:58.804330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:58.805794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:58.818739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:58.819892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:58.821572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:58.824039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:58.827709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:58.838881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:58.977498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:44:59.198483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfcc636db574b30abe01e6332b57dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3346db7d11ef4b1d9b295ec3ea08c65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:59.233849 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2b0b5b1b-09fc-447e-8f45-cd05c7bd8bb5 tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 200 len: 1306 microversion: 2.1 time: 0.608390 Oct 17 15:44:59.238241 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2161/4552] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:58 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 1306 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:59.262543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:59.263805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:44:59.290699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:59.291650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:59.292269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:59.297944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:44:59.301501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:44:59.308304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:44:59.481444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:44:59.503092 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2da48e0-1405-47b6-b8df-e89b38a0d516 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.714271 Oct 17 15:44:59.505123 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2392/4553] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:58 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:44:59.518440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6bb4e8ef-7eba-4720-873d-c369c11f3e5c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:59.543556 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6bb4e8ef-7eba-4720-873d-c369c11f3e5c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.036216 Oct 17 15:44:59.550210 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2393/4554] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:44:59 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:44:59.567881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-745448e0-1393-4971-aa32-d19bf739349f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Action: 'create', calling method: .version_select at 0x7f28be3603a0>, body: {"server_group": {"name": "tempest-server-group-1953445533", "policies": ["anti-affinity"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:44:59.665730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-745448e0-1393-4971-aa32-d19bf739349f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:59.699698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-745448e0-1393-4971-aa32-d19bf739349f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:59.870691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-745448e0-1393-4971-aa32-d19bf739349f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:44:59.885335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-745448e0-1393-4971-aa32-d19bf739349f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_groups'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:44:59.913704 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-745448e0-1393-4971-aa32-d19bf739349f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.352086 Oct 17 15:44:59.914335 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2394/4555] 10.222.0.87 () {60 vars in 1173 bytes} [Mon Oct 17 15:44:59 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:44:59.931593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0039866f-d08a-4f50-b550-331c75b2a250 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:44:59.965963 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0039866f-d08a-4f50-b550-331c75b2a250 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475" status: 204 len: 0 microversion: 2.1 time: 0.039600 Oct 17 15:44:59.967185 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2395/4556] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:44:59 2022] DELETE /compute/v2.1/os-server-groups/2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:44:59.982784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64542c3a-3be3-48c1-bd5c-ee7115b7a1ea tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:00.019801 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64542c3a-3be3-48c1-bd5c-ee7115b7a1ea tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.045497 Oct 17 15:45:00.044155 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2396/4557] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:44:59 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:00.132993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1994529572", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "db8b093c-d96e-4063-886e-42361542ef88"}]}, "os:scheduler_hints": {"group": "e4d2044f-9b38-4ad9-a4da-c084e014cf8b"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:00.390616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] validate_networks() for [('db8b093c-d96e-4063-886e-42361542ef88', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:45:00.406367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:00.417369 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eff0d5dd-9034-4185-977d-6e81e84c4665 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 1.176275 Oct 17 15:45:00.421309 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2162/4558] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:44:59 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:00.428770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:00.434373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] [instance: c0eb3eaa-acf7-4510-898c-87a14936db51] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:00.450969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:00.451536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:00.451999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:00.454287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:00.455061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:00.455656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:00.485404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] HTTP exception thrown: Instance c0eb3eaa-acf7-4510-898c-87a14936db51 could not be found. Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Request method failure captured: Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 HTTP/1.1 Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXgEzAo4kU7hkxJlVnaq-RWnNe4_LreGIJMliTb7Qr-uln-Ypyg51SQAUCdXFLwZtSvCs-wYTLeaSqmeKDpZ_YqQ_0VT8Z8U3JSdAiowopBzfHi2qyr9SnM5E_QLT5yByuaxEh-RKu3ypcLvuj3TXQfs8HWDavjTPH2SD6oaWBT6rZ0 Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3346db7d11ef4b1d9b295ec3ea08c65a Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ListServerFiltersTestJSON-86205336 Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3346db7d11ef4b1d9b295ec3ea08c65a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ListServerFiltersTestJSON-86205336 Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3346db7d11ef4b1d9b295ec3ea08c65a Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-86205336 Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ListServerFiltersTestJSON-86205336-project Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 9dfcc636db574b30abe01e6332b57dfc Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ListServerFiltersTestJSON-86205336-project Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance c0eb3eaa-acf7-4510-898c-87a14936db51 could not be found. Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'c0eb3eaa-acf7-4510-898c-87a14936db51'} Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0eb3eaa-acf7-4510-898c-87a14936db51 could not be found. Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0eb3eaa-acf7-4510-898c-87a14936db51 could not be found. Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:00.488203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:00.492699 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:00.492699 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:00.492699 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:00.492699 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:00.492699 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:00.492699 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0eb3eaa-acf7-4510-898c-87a14936db51 could not be found. Oct 17 15:45:00.492699 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:00.495101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] Returning 404 to user: Instance c0eb3eaa-acf7-4510-898c-87a14936db51 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:00.496680 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ec9731d-3add-4625-93a8-ba1ade22d50a tempest-ListServerFiltersTestJSON-86205336 tempest-ListServerFiltersTestJSON-86205336-project] 10.222.0.87 "GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51" status: 404 len: 111 microversion: 2.1 time: 0.071763 Oct 17 15:45:00.501881 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2163/4559] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:00 2022] GET /compute/v2.1/servers/c0eb3eaa-acf7-4510-898c-87a14936db51 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:00.508151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:00.509040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:00.516610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:00.517460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:00.518129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:00.519469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:00.520112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:00.520832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:01.063736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:01.081344 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3b2f6a07-8adc-4f08-b5ac-ff5670a43078 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1669 microversion: 2.1 time: 0.577943 Oct 17 15:45:01.082123 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2164/4560] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:00 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1669 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:01.119416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:01.120417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:01.155634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:01.156552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:01.160214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:01.166235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:01.167543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:01.168315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:01.295920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:45:01.326908 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.api [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Working on deleting snapshot af3eed32-7dad-40d6-9255-b4a7a12e64d7 from shelved instance... Oct 17 15:45:03.208214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Doing local delete in cell 4ec06080-01b5-4793-9448-66de7d08c56d(cell1) {{(pid=120407) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 17 15:45:03.211393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:03.212213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:03.212978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:03.213640 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.api [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 17 15:45:03.225348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] deallocate_for_instance() {{(pid=120407) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 17 15:45:03.260757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:45:03.261447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:45:03.262219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:45:03.263272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:45:03.264225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:45:03.350408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:03.351688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:03.357202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:03.359007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:03.360108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:03.361052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:03.421653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:03.445805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:45:03.477881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:45:03.528651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:45:03.533862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:45:03.832244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:45:03.858057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:45:04.094753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:45:04.123894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Getting quotas for user ff94882cf4a24ab6b7fe6c2eabc44212 and project 93a2120f9f2440cf9ae4704ace87b05e. Resources: {'server_group_members'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:45:04.269375 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ad80727-e7c9-4744-adb4-bb9f5d9b979f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.140704 Oct 17 15:45:04.275666 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2397/4561] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:45:04.292735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9bddcd33-9957-4e6b-b378-3648f918df15 req-d0118367-9f3e-4e0c-8369-ee0aa2a009fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781ce8e0-1ad0-4713-ac95-2abac4f7a1d7", "tag": "e23fd663-fe28-4bf5-ae5b-5433ac887247"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:04.361000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9bddcd33-9957-4e6b-b378-3648f918df15 req-d0118367-9f3e-4e0c-8369-ee0aa2a009fa service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:04.369186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9bddcd33-9957-4e6b-b378-3648f918df15 req-d0118367-9f3e-4e0c-8369-ee0aa2a009fa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:04.370097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9bddcd33-9957-4e6b-b378-3648f918df15 req-d0118367-9f3e-4e0c-8369-ee0aa2a009fa service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:04.414055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9bddcd33-9957-4e6b-b378-3648f918df15 req-d0118367-9f3e-4e0c-8369-ee0aa2a009fa service nova] Creating event network-changed:e23fd663-fe28-4bf5-ae5b-5433ac887247 for instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 on n-h2-854441-12 Oct 17 15:45:04.430923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9bddcd33-9957-4e6b-b378-3648f918df15 req-d0118367-9f3e-4e0c-8369-ee0aa2a009fa service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150899 Oct 17 15:45:04.434351 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2398/4562] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:04.443251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d5b9865-e8b0-4ef2-bcf8-2688db1894be tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:04.450622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d5b9865-e8b0-4ef2-bcf8-2688db1894be tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:05.939036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Updating instance_info_cache with network_info: [] {{(pid=120407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:45:05.999259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:06.236441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d5b9865-e8b0-4ef2-bcf8-2688db1894be tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:06.295088 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d5b9865-e8b0-4ef2-bcf8-2688db1894be tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1213 microversion: 2.1 time: 1.859075 Oct 17 15:45:06.295717 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2399/4563] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:04 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1213 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:06.306949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-939df1da-81a2-4429-bbd8-2dcdddc6fd34 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1880503157", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a89fe729-c93f-461a-81c4-7c1475aead56", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:06.549502 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-939df1da-81a2-4429-bbd8-2dcdddc6fd34 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Block Device a89fe729-c93f-461a-81c4-7c1475aead56 is not bootable. Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-939df1da-81a2-4429-bbd8-2dcdddc6fd34 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 358 Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1880503157", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a89fe729-c93f-461a-81c4-7c1475aead56", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: exception: Block Device a89fe729-c93f-461a-81c4-7c1475aead56 is not bootable. Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1880503157', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a89fe729-c93f-461a-81c4-7c1475aead56'}], 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a89fe729-c93f-461a-81c4-7c1475aead56 is not bootable. Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:06.559262 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a89fe729-c93f-461a-81c4-7c1475aead56 is not bootable. Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a89fe729-c93f-461a-81c4-7c1475aead56 is not bootable. Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-939df1da-81a2-4429-bbd8-2dcdddc6fd34 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Block Device a89fe729-c93f-461a-81c4-7c1475aead56 is not bootable. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-939df1da-81a2-4429-bbd8-2dcdddc6fd34 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.258549 Oct 17 15:45:06.565679 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2400/4564] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:06 2022] POST /compute/v2.1/servers => generated 110 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:45:06.582777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:06.584628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:06.626142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:06.626690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:06.627255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:06.644963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:06.645564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:06.651304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:06.919951 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc89421a-56cf-47e2-8304-27997eb8011d tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 204 len: 0 microversion: 2.1 time: 5.809981 Oct 17 15:45:06.930223 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2165/4565] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:45:01 2022] DELETE /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 0 bytes in 5818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:45:06.940867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:06.941641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:06.957167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:06.957943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:06.960268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:06.963850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:06.964692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:06.967339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:07.117699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lazy-loading 'services' on Instance uuid 287b7782-35f5-4a0a-ac6e-d803d65080d1 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:45:07.382393 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-333386f5-05c9-4ce0-9a30-ef8bef4f0890 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "DELETE /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/os-volume_attachments/84d1bc1d-ddde-4649-a752-5130499f200c" status: 202 len: 0 microversion: 2.1 time: 0.806422 Oct 17 15:45:07.383359 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2401/4566] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:45:06 2022] DELETE /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/os-volume_attachments/84d1bc1d-ddde-4649-a752-5130499f200c => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:45:07.406808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-47c1baa8-762b-4e59-98a4-06da6c55b44d req-e720fe61-7e36-4c32-855c-1be360ff1792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb53938-d95a-4f04-a223-2b4f3bffec21", "name": "network-vif-deleted", "tag": "ab422ee2-f5d0-4f35-b021-58487235ce01"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:07.434922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:07.437879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-47c1baa8-762b-4e59-98a4-06da6c55b44d req-e720fe61-7e36-4c32-855c-1be360ff1792 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:07.438939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-47c1baa8-762b-4e59-98a4-06da6c55b44d req-e720fe61-7e36-4c32-855c-1be360ff1792 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:07.440414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-47c1baa8-762b-4e59-98a4-06da6c55b44d req-e720fe61-7e36-4c32-855c-1be360ff1792 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:07.455993 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b0113d8-404e-4eb8-aff8-669503b139f6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.520646 Oct 17 15:45:07.459260 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2166/4567] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:06 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:07.472998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:07.479849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_external_events [req-47c1baa8-762b-4e59-98a4-06da6c55b44d req-e720fe61-7e36-4c32-855c-1be360ff1792 service nova] Unable to find a host for instance ddb53938-d95a-4f04-a223-2b4f3bffec21. Dropping event network-vif-deleted {{(pid=120406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 15:45:07.480440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ddb53938-d95a-4f04-a223-2b4f3bffec21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:07.481563 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-47c1baa8-762b-4e59-98a4-06da6c55b44d req-e720fe61-7e36-4c32-855c-1be360ff1792 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.088755 Oct 17 15:45:07.482403 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2402/4568] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 99 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 15:45:07.500535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:07.501598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:07.514962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:07.515478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:07.515926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:07.516654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:07.517114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:07.517558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:07.523815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:07.526165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:07.528174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:07.529218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:07.530987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:07.531693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:07.593436 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] HTTP exception thrown: Instance ddb53938-d95a-4f04-a223-2b4f3bffec21 could not be found. Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Request method failure captured: Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 HTTP/1.1 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYjSZ_nlru-opsxre1_6o4maYJvszrSTfo5F1ZOmWvD2nvbavpGSPdcHZuHvhBBMJvJzDYKZ1CLYYmwcJEA0FxbZ2rDVbTjFujhByDDlZdgHa8WyAzJo1bPL8yj75lvGz1GIXDkBbnfrdh1y59UsxGhyOBvzL-Yq-36NgYBv7Q1Aq8 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 15cc78a142a148398dc438b5ff2a25e9 Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ddb53938-d95a-4f04-a223-2b4f3bffec21 could not be found. Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ddb53938-d95a-4f04-a223-2b4f3bffec21'} Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb53938-d95a-4f04-a223-2b4f3bffec21 could not be found. Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb53938-d95a-4f04-a223-2b4f3bffec21 could not be found. Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:07.606134 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:07.610625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:07.610625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:07.610625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:07.610625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:07.610625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:07.610625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb53938-d95a-4f04-a223-2b4f3bffec21 could not be found. Oct 17 15:45:07.610625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:07.610625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Returning 404 to user: Instance ddb53938-d95a-4f04-a223-2b4f3bffec21 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:07.610625 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0cbd2697-95e2-4465-a905-018b41cb04bd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21" status: 404 len: 111 microversion: 2.1 time: 0.149828 Oct 17 15:45:07.621518 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2167/4569] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:07 2022] GET /compute/v2.1/servers/ddb53938-d95a-4f04-a223-2b4f3bffec21 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:07.640773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:07.645973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:07.665122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:07.673690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:07.679147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:07.680685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:07.686857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:07.687758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:07.995208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:08.011287 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c8cfe08-c43d-4239-a78d-6b34b58bf986 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1209 microversion: 2.1 time: 0.527351 Oct 17 15:45:08.016109 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2403/4570] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:07 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1209 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:08.017243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=16 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:08.043534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:08.048384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:08.068178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:08.073515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:08.074146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:08.083756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:08.086944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:08.089404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:08.198642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:45:08.255711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:08.284142 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-029c55b2-9f05-4c52-a35c-77d01f5d13b4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.661346 Oct 17 15:45:08.284736 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2168/4571] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:07 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:08.551466 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3374270-d041-4bac-b252-5d0a69312343 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "DELETE /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 204 len: 0 microversion: 2.1 time: 0.521230 Oct 17 15:45:08.552154 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2404/4572] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:45:08 2022] DELETE /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:45:08.561231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:08.562100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:08.575614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:08.579946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:08.585789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:08.587830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:08.588720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:08.591074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:09.059762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:09.063032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:09.092813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:09.093319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:09.105649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:09.108531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:09.111905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:09.113739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:09.390951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:09.414442 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-85ba1670-6954-48f1-8a61-a0f270790147 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1464 microversion: 2.1 time: 0.854745 Oct 17 15:45:09.417005 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2169/4573] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:08 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1464 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:09.501739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:09.584248 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-daa52396-456c-4e68-b3f4-5c3471c57c43 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1209 microversion: 2.1 time: 0.538083 Oct 17 15:45:09.590801 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2405/4574] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:09 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1209 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:10.446093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:10.447478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:10.462730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:10.469595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:10.473458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:10.474467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:10.481025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:10.481846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:10.617884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:10.628571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:10.681044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:10.688189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:10.689074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:10.689881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:10.706722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:10.713504 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9296b28e-4142-424d-a8b8-16f98269aa2c tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1464 microversion: 2.1 time: 0.266939 Oct 17 15:45:10.715189 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2170/4575] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:10 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1464 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:10.720554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:10.721611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:11.227600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:11.259538 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8142cdcc-568b-4d56-b4e4-741422d5059d tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1273 microversion: 2.1 time: 0.650968 Oct 17 15:45:11.272815 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2406/4576] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:10 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1273 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:11.740801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:11.745333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:11.782374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:11.787633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:11.790598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:11.796855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:11.797551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:11.798075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:12.077706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-03ddf5db-945c-44b5-9214-0b4cfc7a9a3f req-4c0fd627-af12-4bc4-b080-936d808a3114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357917b7-61bf-43aa-8de0-7577a90c0375", "name": "network-vif-deleted", "tag": "81227e07-ca90-4706-a849-46ad027c5be2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:12.109210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-03ddf5db-945c-44b5-9214-0b4cfc7a9a3f req-4c0fd627-af12-4bc4-b080-936d808a3114 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:12.110029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-03ddf5db-945c-44b5-9214-0b4cfc7a9a3f req-4c0fd627-af12-4bc4-b080-936d808a3114 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:12.110973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-03ddf5db-945c-44b5-9214-0b4cfc7a9a3f req-4c0fd627-af12-4bc4-b080-936d808a3114 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:12.158780 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-03ddf5db-945c-44b5-9214-0b4cfc7a9a3f req-4c0fd627-af12-4bc4-b080-936d808a3114 service nova] Creating event network-vif-deleted:81227e07-ca90-4706-a849-46ad027c5be2 for instance 357917b7-61bf-43aa-8de0-7577a90c0375 on n-h1-854441-12 Oct 17 15:45:12.177694 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-03ddf5db-945c-44b5-9214-0b4cfc7a9a3f req-4c0fd627-af12-4bc4-b080-936d808a3114 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104397 Oct 17 15:45:12.186741 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2407/4577] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:45:12.233225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:12.280096 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9c5245c-60bf-44dc-b698-c8b56a234eb5 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1464 microversion: 2.1 time: 0.544654 Oct 17 15:45:12.286465 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2171/4578] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:11 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1464 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:12.305758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:12.312331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:12.337720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:12.338771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:12.347141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:12.348677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:12.352889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:12.354485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:12.759354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:12.775267 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-568ed919-e682-40cd-9413-5ccc93f1b752 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1271 microversion: 2.1 time: 0.476350 Oct 17 15:45:12.782133 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2408/4579] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:12 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1271 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:13.321209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:13.344900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:13.390072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:13.398552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:13.399678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:13.402587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:13.404323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:13.406043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:13.554227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:13.557036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:13.558480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:13.560604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lazy-loading 'fault' on Instance uuid 357917b7-61bf-43aa-8de0-7577a90c0375 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:45:13.735720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82ab8c9c-14dc-467c-806d-23207a2dd0f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-22556406", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "destination_type": "local"}, {"source_type": "volume", "uuid": "b8ced7e3-735a-4793-aab8-4f4bd27697ea", "destination_type": "invalid"}], "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82ab8c9c-14dc-467c-806d-23207a2dd0f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 493 Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-22556406", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "destination_type": "local"}, {"source_type": "volume", "uuid": "b8ced7e3-735a-4793-aab8-4f4bd27697ea", "destination_type": "invalid"}], "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-22556406', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'b8ced7e3-735a-4793-aab8-4f4bd27697ea', 'destination_type': 'invalid'}], 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:13.783941 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 15:45:13.795292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:13.810405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82ab8c9c-14dc-467c-806d-23207a2dd0f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:13.812317 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82ab8c9c-14dc-467c-806d-23207a2dd0f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.083974 Oct 17 15:45:13.818934 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2409/4580] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:13 2022] POST /compute/v2.1/servers => generated 155 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 15:45:13.823951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:13.843441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:13.850135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:13.868286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:13.869513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:13.870887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:13.872454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:13.873571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:13.874591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:14.193605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:14.212056 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b2d4213-fcec-4351-9b67-4af3cc7afa76 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 200 len: 1304 microversion: 2.1 time: 0.902733 Oct 17 15:45:14.221631 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2172/4581] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:13 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 1304 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:14.253162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:14.256668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:14.283123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:14.286977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:14.289077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:14.292694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:14.298914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:14.300505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:14.447638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:14.479198 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6fdea41-f05f-4f49-ab8f-5ca83ced3496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.658566 Oct 17 15:45:14.483916 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2410/4582] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:13 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:14.526837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:14.529565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:14.551925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:14.552881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:14.554404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:14.559163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:14.563059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:14.568206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:15.055203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:15.066309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:15.092909 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27ecf5b8-4765-4539-80c2-bbd62f3cecad tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.572188 Oct 17 15:45:15.109395 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f33a6337-0e8e-49c1-95cf-57a72f27bda8 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1313 microversion: 2.1 time: 0.882153 Oct 17 15:45:15.110372 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2173/4583] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:14 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1313 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:15.127071 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2411/4584] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:14 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:15.251729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:15.254534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 357917b7-61bf-43aa-8de0-7577a90c0375] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:15.308176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f498c64a-5d03-4617-90f9-198c748c45fc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1131693083", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:15.312769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:15.327321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:15.328354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:15.336500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:15.337724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:15.338764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f498c64a-5d03-4617-90f9-198c748c45fc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 492 Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1131693083", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1131693083', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.341930 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 15:45:15.344990 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.349037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f498c64a-5d03-4617-90f9-198c748c45fc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:15.358571 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f498c64a-5d03-4617-90f9-198c748c45fc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.059131 Oct 17 15:45:15.366368 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2412/4585] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:15 2022] POST /compute/v2.1/servers => generated 624 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:45:15.396562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:15.398404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:15.421024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:15.437227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:15.439185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] HTTP exception thrown: Instance 357917b7-61bf-43aa-8de0-7577a90c0375 could not be found. Oct 17 15:45:15.443901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:15.447749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Request method failure captured: Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 HTTP/1.1 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYjSZ_nlru-opsxre1_6o4maYJvszrSTfo5F1ZOmWvD2nvbavpGSPdcHZuHvhBBMJvJzDYKZ1CLYYmwcJEA0FxbZ2rDVbTjFujhByDDlZdgHa8WyAzJo1bPL8yj75lvGz1GIXDkBbnfrdh1y59UsxGhyOBvzL-Yq-36NgYBv7Q1Aq8 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 15cc78a142a148398dc438b5ff2a25e9 Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 357917b7-61bf-43aa-8de0-7577a90c0375 could not be found. Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '357917b7-61bf-43aa-8de0-7577a90c0375'} Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357917b7-61bf-43aa-8de0-7577a90c0375 could not be found. Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357917b7-61bf-43aa-8de0-7577a90c0375 could not be found. Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:15.449661 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.456461 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:15.456461 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:15.456461 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:15.456461 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:15.456461 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:15.456461 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357917b7-61bf-43aa-8de0-7577a90c0375 could not be found. Oct 17 15:45:15.456461 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:15.463670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Returning 404 to user: Instance 357917b7-61bf-43aa-8de0-7577a90c0375 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:15.466562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:15.469557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:15.471539 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-405d4fb8-09cb-4e2b-8bc7-ce1efd33cc65 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375" status: 404 len: 111 microversion: 2.1 time: 0.221658 Oct 17 15:45:15.479717 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2174/4586] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:15 2022] GET /compute/v2.1/servers/357917b7-61bf-43aa-8de0-7577a90c0375 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:15.488976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:15.490298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:15.503212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:15.506025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:15.507315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:15.509311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:15.510761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:15.511843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:15.609810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:45:15.850944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-facd2171-49f8-4b2a-8f11-3e77d9b86bf2 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 204 len: 0 microversion: 2.1 time: 0.368443 Oct 17 15:45:15.855616 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2175/4587] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:45:15 2022] DELETE /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:45:15.875375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:15.876629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:15.885942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:15.887676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:15.888510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:15.889729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:15.890545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:15.891794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:15.897768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:15.914123 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39d811e7-b7b1-461d-b46c-2c5352084f7a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.545865 Oct 17 15:45:15.915698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2413/4588] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:15 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:15.961397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:15.970578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:16.033503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:16.034031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:16.040447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:16.046388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:16.046960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:16.047417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:16.261909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=40 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:16.496511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:16.508043 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d57b3317-e23a-4f99-bd12-819982162463 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.568341 Oct 17 15:45:16.523290 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2414/4589] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:15 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:16.527559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:16.534819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:16.548545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:16.549744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:16.550437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:16.551272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:16.551749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:16.552174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:16.565094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:16.585866 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-44501edb-e7e2-45b7-9540-eea273013ac9 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1508 microversion: 2.1 time: 0.727986 Oct 17 15:45:16.596957 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2176/4590] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:15 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1508 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:16.661428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-40163034-9701-41fe-af55-cff5a51d3e0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-40163034-9701-41fe-af55-cff5a51d3e0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 416 Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:16.688719 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:45:16.694422 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:16.701999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-40163034-9701-41fe-af55-cff5a51d3e0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:16.703767 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-40163034-9701-41fe-af55-cff5a51d3e0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.049185 Oct 17 15:45:16.705441 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2177/4591] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:16 2022] POST /compute/v2.1/servers => generated 619 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 15:45:16.735449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:16.744116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:16.772261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:16.779858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:16.781015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:16.782657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:16.783686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:16.798679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:17.282295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:17.318196 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-28c7fcbf-57c3-4d52-8a31-11fb9451616a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.594836 Oct 17 15:45:17.339499 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2178/4592] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:16 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:17.351622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:17.352816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:17.393859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:17.399830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:17.406205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:17.408279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:17.409860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:17.411814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:17.439757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:17.726110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:17.744682 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5cc0746a-7757-420c-a5d2-6c7f8deedf0a tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1313 microversion: 2.1 time: 1.232600 Oct 17 15:45:17.745283 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2415/4593] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:16 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1313 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:17.750566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:17.767355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:17.782197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:17.783892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:17.784805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:17.787541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:17.789076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:17.801274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:18.206679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:18.229619 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aad8e758-2482-4a53-9a69-e1223eeae521 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.885739 Oct 17 15:45:18.235008 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2179/4594] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:17 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:18.344866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d32e966c-d842-4954-95b7-37b852076676 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1634720213", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": -1, "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:18.372075 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d32e966c-d842-4954-95b7-37b852076676 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Flavor -1 could not be found. Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d32e966c-d842-4954-95b7-37b852076676 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 206 Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1634720213", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": -1, "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: exception: Flavor -1 could not be found. Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1634720213', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': -1, 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:18.382235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 17 15:45:18.388836 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:18.398298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d32e966c-d842-4954-95b7-37b852076676 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:18.400837 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d32e966c-d842-4954-95b7-37b852076676 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.067907 Oct 17 15:45:18.402615 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2180/4595] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:18 2022] POST /compute/v2.1/servers => generated 73 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 17 15:45:18.438632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:18.441440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:18.457449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:18.465085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:18.466388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:18.468404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:18.471681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:18.479458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:19.736618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:19.764040 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a21a0c3-71be-4cc0-a612-ad7f982831db tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1508 microversion: 2.1 time: 2.016773 Oct 17 15:45:19.765228 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2416/4596] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:17 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1508 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:19.799737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:19.800547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ae6e9071-997a-4066-bb25-0f48c517e02e req-1b4b5440-ef99-4738-a56b-1b2a9be65c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9344974-fe7c-47ca-9854-c6584ee21588", "tag": "258ad1f0-41c7-465d-8400-449c55449320"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:19.818670 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5e6196ff-bc66-48cf-8cbd-504fe20cae2c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 1.400874 Oct 17 15:45:19.837189 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2181/4597] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:18 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:19.848515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:19.867287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ae6e9071-997a-4066-bb25-0f48c517e02e req-1b4b5440-ef99-4738-a56b-1b2a9be65c54 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:19.870953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ae6e9071-997a-4066-bb25-0f48c517e02e req-1b4b5440-ef99-4738-a56b-1b2a9be65c54 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:19.871649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ae6e9071-997a-4066-bb25-0f48c517e02e req-1b4b5440-ef99-4738-a56b-1b2a9be65c54 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:19.876240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:19.913947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:19.914962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:19.917813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:19.919414 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ae6e9071-997a-4066-bb25-0f48c517e02e req-1b4b5440-ef99-4738-a56b-1b2a9be65c54 service nova] Creating event network-changed:258ad1f0-41c7-465d-8400-449c55449320 for instance b9344974-fe7c-47ca-9854-c6584ee21588 on n-h1-854441-12 Oct 17 15:45:19.919739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:19.920262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:19.926854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:19.934841 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ae6e9071-997a-4066-bb25-0f48c517e02e req-1b4b5440-ef99-4738-a56b-1b2a9be65c54 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158429 Oct 17 15:45:19.940586 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2417/4598] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:19.954473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:19.958724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:19.980560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:19.981361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:19.982734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:19.984496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:19.985334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:19.986256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:20.080933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:20.385846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:20.420500 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2b78b8b4-786d-4733-b2ce-083db7811833 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1313 microversion: 2.1 time: 0.580499 Oct 17 15:45:20.432952 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2182/4599] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:19 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:20.731860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-fd347be7-963a-49de-99cc-cd1d3684c5ec req-dc40c12a-277b-478e-89e7-35730488c756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3ca424-5f81-44ae-9bf0-100ae0e9cac8", "name": "network-vif-deleted", "tag": "7b21dc57-e897-499f-a722-5dabb23f1848"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:20.760840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:20.776577 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9896190a-6d1f-4793-945b-0a24308bad41 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.834260 Oct 17 15:45:20.794535 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2418/4600] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:19 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:20.794936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-fd347be7-963a-49de-99cc-cd1d3684c5ec req-dc40c12a-277b-478e-89e7-35730488c756 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:20.794936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-fd347be7-963a-49de-99cc-cd1d3684c5ec req-dc40c12a-277b-478e-89e7-35730488c756 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:20.795492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-fd347be7-963a-49de-99cc-cd1d3684c5ec req-dc40c12a-277b-478e-89e7-35730488c756 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:20.795678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:20.796552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:20.808734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:20.813074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:20.816559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:20.817881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:20.820892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:20.821542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:20.860304 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-fd347be7-963a-49de-99cc-cd1d3684c5ec req-dc40c12a-277b-478e-89e7-35730488c756 service nova] Creating event network-vif-deleted:7b21dc57-e897-499f-a722-5dabb23f1848 for instance 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 on n-h1-854441-12 Oct 17 15:45:20.873328 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-fd347be7-963a-49de-99cc-cd1d3684c5ec req-dc40c12a-277b-478e-89e7-35730488c756 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144584 Oct 17 15:45:20.876977 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2183/4601] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:20.957672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70bcdce1-5e72-4913-86bf-0dcc1515bc8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290935117", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70bcdce1-5e72-4913-86bf-0dcc1515bc8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 172 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290935117", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-290935117', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi -1 Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:45:20.966153 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 15:45:20.969870 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:20.975691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70bcdce1-5e72-4913-86bf-0dcc1515bc8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:20.977609 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-70bcdce1-5e72-4913-86bf-0dcc1515bc8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.026029 Oct 17 15:45:20.978854 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2184/4602] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:20 2022] POST /compute/v2.1/servers => generated 145 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 15:45:20.988209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:20.989623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:21.009537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:21.015177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:21.016044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:21.017387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:21.018280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:21.018948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:21.145712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:21.161341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63f71be8-89f0-4341-8408-9cbe51da75fd tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1466 microversion: 2.1 time: 0.370036 Oct 17 15:45:21.161975 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2419/4603] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:20 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1466 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:21.457964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:21.458624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:21.470411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:21.486186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b44d60db-6bfc-4597-8359-d8d4a9d572ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.499282 Oct 17 15:45:21.495272 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2185/4604] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:20 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:21.506175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:21.507489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:21.514711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:21.516264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:21.521108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:21.523476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:21.528988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:21.529518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:21.545547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:21.546063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:21.546551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:21.555691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:21.562100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:21.562841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:22.114367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:22.130868 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1c4a51d9-bef6-4601-b7ca-8739948ad6bf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.612142 Oct 17 15:45:22.131635 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2186/4605] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:21 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:22.208427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:22.209037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:22.228185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:22.230706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:22.233220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:22.234948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:22.239296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:22.240879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:22.332194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:22.348949 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca3bea7e-e035-4853-8151-6de69ffdc8d6 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1313 microversion: 2.1 time: 0.892604 Oct 17 15:45:22.395578 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2420/4606] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:21 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1313 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:22.405638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:22.409134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:22.412052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:22.422720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lazy-loading 'fault' on Instance uuid 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:45:22.427279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49bd799d-cca0-4e0f-904e-df9f5a4de278 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-84505525", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:22.463203 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-49bd799d-cca0-4e0f-904e-df9f5a4de278 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49bd799d-cca0-4e0f-904e-df9f5a4de278 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 214 Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-84505525", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-84505525', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:22.473964 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:22.477472 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:22.477472 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:22.477472 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:22.477472 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:22.477472 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:22.477472 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 15:45:22.477472 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:22.484331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49bd799d-cca0-4e0f-904e-df9f5a4de278 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:22.485790 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49bd799d-cca0-4e0f-904e-df9f5a4de278 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.081656 Oct 17 15:45:22.487034 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2421/4607] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:22 2022] POST /compute/v2.1/servers => generated 123 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:45:22.502758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:22.503853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:22.532384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:22.545687 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-60c1481d-6413-4a9f-9ade-60620aa77c11 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 200 len: 1305 microversion: 2.1 time: 0.340930 Oct 17 15:45:22.550890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:22.568527 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2187/4608] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:22 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 1305 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:22.570407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:22.571692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:22.575281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:22.576573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:22.581164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:23.415338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:23.419895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:23.425847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:23.440793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:23.442211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:23.443868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:23.445739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:23.446922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:23.448194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:23.452427 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8342cb5d-debc-44c2-a584-fa628891132f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.960003 Oct 17 15:45:23.453066 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2422/4609] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:22 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:23.501906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:23.508328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:23.523928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:23.524501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:23.527742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:23.528854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:23.529558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:23.530344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:23.914523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:23.974840 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9f91b835-7477-4558-ac14-a88eb0e5dd52 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1313 microversion: 2.1 time: 0.590617 Oct 17 15:45:23.979049 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2188/4610] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:23 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1313 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:23.989432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:23.990920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:24.021323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:24.024913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:24.026018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:24.027578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:24.028665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:24.029725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:24.051384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:24.087663 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e75added-26f4-4b1d-910d-65039eacfe80 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.606599 Oct 17 15:45:24.099100 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] HTTP exception thrown: Instance 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 could not be found. Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Request method failure captured: Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 HTTP/1.1 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYjSZ_nlru-opsxre1_6o4maYJvszrSTfo5F1ZOmWvD2nvbavpGSPdcHZuHvhBBMJvJzDYKZ1CLYYmwcJEA0FxbZ2rDVbTjFujhByDDlZdgHa8WyAzJo1bPL8yj75lvGz1GIXDkBbnfrdh1y59UsxGhyOBvzL-Yq-36NgYBv7Q1Aq8 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 15cc78a142a148398dc438b5ff2a25e9 Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 could not be found. Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '4a3ca424-5f81-44ae-9bf0-100ae0e9cac8'} Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 could not be found. Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 could not be found. Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:24.106749 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:24.115037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:24.115037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:24.115037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:24.115037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:24.115037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:24.115037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 could not be found. Oct 17 15:45:24.115037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:24.116067 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2423/4611] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:23 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:24.119390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Returning 404 to user: Instance 4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:24.121877 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2b25cf97-8130-4d8d-b32d-b93d89f233d1 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8" status: 404 len: 111 microversion: 2.1 time: 0.140652 Oct 17 15:45:24.123215 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2189/4612] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:23 2022] GET /compute/v2.1/servers/4a3ca424-5f81-44ae-9bf0-100ae0e9cac8 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:24.186487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a21b2885-cdf5-4602-b98b-bae0cb4a57c6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:24.199025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:24.200067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:24.232053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a21b2885-cdf5-4602-b98b-bae0cb4a57c6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:24.237431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a21b2885-cdf5-4602-b98b-bae0cb4a57c6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:24.238280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a21b2885-cdf5-4602-b98b-bae0cb4a57c6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:24.249581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:24.250011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:24.250452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:24.251211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:24.251709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:24.252176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:24.290595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:45:24.369135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a21b2885-cdf5-4602-b98b-bae0cb4a57c6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Going to try to stop instance {{(pid=120406) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 15:45:24.514654 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a21b2885-cdf5-4602-b98b-bae0cb4a57c6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/action" status: 202 len: 0 microversion: 2.1 time: 0.397844 Oct 17 15:45:24.517083 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2424/4613] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:24 2022] POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:45:24.528144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9005fe8-0024-4447-a456-a924a5e1f496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-678496614", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "key_name": "tempest-key-1017600611", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:24.541652 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f3d05733-905c-41a8-9d49-a2ee9a89912e tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 204 len: 0 microversion: 2.1 time: 0.400270 Oct 17 15:45:24.547019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2190/4614] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:45:24 2022] DELETE /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:45:24.553825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:24.555063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:24.563681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:24.568641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:24.571363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:24.576158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:24.583654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:24.585582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:24.587061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:24.812908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-d9005fe8-0024-4447-a456-a924a5e1f496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] validate_networks() for [('3d2dceb7-fa1f-47b7-a54c-dede4194eb86', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:45:24.977409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:25.029146 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2bd12ece-819f-4a03-8a0b-6c3e194beafd tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1677 microversion: 2.1 time: 0.477899 Oct 17 15:45:25.039324 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2191/4615] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:24 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1677 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:25.072107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:25.076947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:25.108395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:25.114363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:25.115494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:25.118148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:25.119039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:25.120609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:25.516835 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d9005fe8-0024-4447-a456-a924a5e1f496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Invalid key_name provided. Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9005fe8-0024-4447-a456-a924a5e1f496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 246 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-678496614", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "key_name": "tempest-key-1017600611", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid key_name provided. Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-678496614', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'key_name': 'tempest-key-1017600611', 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1017600611 not found for user 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:25.523292 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 17 15:45:25.530284 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:25.541457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9005fe8-0024-4447-a456-a924a5e1f496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid key_name provided. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:25.541457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d9005fe8-0024-4447-a456-a924a5e1f496 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.017296 Oct 17 15:45:25.543102 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2425/4616] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:24 2022] POST /compute/v2.1/servers => generated 70 bytes in 1025 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 15:45:25.554190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:25.556555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:25.573955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:25.578700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:25.580415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:25.582895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:25.584034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:25.585071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:26.223007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:26.241675 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-70cf34b2-097d-4050-8a1e-988c7890dc6a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1494 microversion: 2.1 time: 1.194487 Oct 17 15:45:26.244535 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2192/4617] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:25 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1494 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:26.264507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:26.265588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:26.278299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:26.281484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:26.285016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:26.291433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:26.292775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:26.295317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:26.429322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:26.464876 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e32ec8ab-f3a5-4154-aeaa-9386a63f6d64 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1313 microversion: 2.1 time: 0.919462 Oct 17 15:45:26.465888 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2426/4618] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:25 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1313 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:26.483024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:26.485890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:26.555828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:26.574271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:26.578700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:26.587643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:26.588976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:26.601091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:26.687980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:26.740298 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fedb28fd-b485-421d-88d7-c340c90047a0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.493592 Oct 17 15:45:26.757869 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2193/4619] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:26 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:26.812237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:26.838522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:26.920654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:26.925559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:26.929956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:26.934962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:26.942090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:26.945084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:27.266208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:27.311604 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4778ebfd-aed5-4aa2-ac72-98b5678f5ee8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1677 microversion: 2.1 time: 0.835391 Oct 17 15:45:27.332923 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2427/4620] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:26 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1677 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:27.361056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6aff44d8-aca3-4cf5-9160-be5aff79c642 req-fd863335-df6b-4bf6-ac11-ddc1dd116577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca852351-f3fe-4fd2-a14e-8bcdbb864d7b", "name": "network-vif-deleted", "tag": "e8ac8dc0-ee12-4bb4-b629-306272355f01"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:27.400667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:27.409625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6aff44d8-aca3-4cf5-9160-be5aff79c642 req-fd863335-df6b-4bf6-ac11-ddc1dd116577 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:27.419328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6aff44d8-aca3-4cf5-9160-be5aff79c642 req-fd863335-df6b-4bf6-ac11-ddc1dd116577 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:27.422327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6aff44d8-aca3-4cf5-9160-be5aff79c642 req-fd863335-df6b-4bf6-ac11-ddc1dd116577 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:27.459364 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6aff44d8-aca3-4cf5-9160-be5aff79c642 req-fd863335-df6b-4bf6-ac11-ddc1dd116577 service nova] Creating event network-vif-deleted:e8ac8dc0-ee12-4bb4-b629-306272355f01 for instance ca852351-f3fe-4fd2-a14e-8bcdbb864d7b on n-h1-854441-12 Oct 17 15:45:27.473361 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6aff44d8-aca3-4cf5-9160-be5aff79c642 req-fd863335-df6b-4bf6-ac11-ddc1dd116577 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135020 Oct 17 15:45:27.474410 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2428/4621] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:27.491176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8c878277-9366-48a8-8bad-b2bd29763293 req-2d7e8238-fcfb-41e5-abb9-1afd2af6e286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9344974-fe7c-47ca-9854-c6584ee21588", "name": "network-vif-plugged", "status": "completed", "tag": "258ad1f0-41c7-465d-8400-449c55449320"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:27.540730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8c878277-9366-48a8-8bad-b2bd29763293 req-2d7e8238-fcfb-41e5-abb9-1afd2af6e286 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:27.541252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8c878277-9366-48a8-8bad-b2bd29763293 req-2d7e8238-fcfb-41e5-abb9-1afd2af6e286 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:27.541682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8c878277-9366-48a8-8bad-b2bd29763293 req-2d7e8238-fcfb-41e5-abb9-1afd2af6e286 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:27.575560 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8c878277-9366-48a8-8bad-b2bd29763293 req-2d7e8238-fcfb-41e5-abb9-1afd2af6e286 service nova] Creating event network-vif-plugged:258ad1f0-41c7-465d-8400-449c55449320 for instance b9344974-fe7c-47ca-9854-c6584ee21588 on n-h1-854441-12 Oct 17 15:45:27.588816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8c878277-9366-48a8-8bad-b2bd29763293 req-2d7e8238-fcfb-41e5-abb9-1afd2af6e286 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111762 Oct 17 15:45:27.590887 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2429/4622] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:27.596081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:27.597202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:27.604953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:27.605825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:27.606470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:27.607480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:27.608152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:27.610118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:27.655490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:27.656694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:27.657417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:27.658324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lazy-loading 'fault' on Instance uuid ca852351-f3fe-4fd2-a14e-8bcdbb864d7b {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:45:27.711518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:27.725826 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-945f766f-5434-4788-9f03-5a025d747bfc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.952352 Oct 17 15:45:27.729604 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2194/4623] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:26 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:27.737809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:27.738867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:27.739038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:27.764384 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2bdba10c-1338-4adf-b647-18f7ea4a6bc3 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 200 len: 1305 microversion: 2.1 time: 0.172819 Oct 17 15:45:27.765498 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2430/4624] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:27 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 1305 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:27.781641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:27.787697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:27.789862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:27.791054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:27.796073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:27.800217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:27.894389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55cae732-6661-429c-8fbb-8100b4f20f7c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1693692923", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:28.086246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:28.101642 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e18a9d1-3392-4aff-a8be-8b7a2f523c53 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1313 microversion: 2.1 time: 0.367612 Oct 17 15:45:28.105417 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2195/4625] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:27 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:28.337875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:28.338997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:28.354679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:28.361463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:28.368032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:28.369210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:28.371825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:28.374048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:28.590387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.security_group_api [None req-55cae732-6661-429c-8fbb-8100b4f20f7c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Neutron security group does_not_exist not found {{(pid=120406) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 17 15:45:28.597604 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-55cae732-6661-429c-8fbb-8100b4f20f7c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55cae732-6661-429c-8fbb-8100b4f20f7c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 258 Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1693692923", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1693692923', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 17 15:45:28.613628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 17 15:45:28.621916 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:28.633726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55cae732-6661-429c-8fbb-8100b4f20f7c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:28.635455 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55cae732-6661-429c-8fbb-8100b4f20f7c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.743435 Oct 17 15:45:28.637418 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2431/4626] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:27 2022] POST /compute/v2.1/servers => generated 106 bytes in 756 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:45:28.662031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:28.663084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:28.693050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:28.694262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:28.697351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:28.701415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:28.702432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:28.705240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.034690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:29.055398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:29.079889 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ac79f815-82bc-42a6-9c14-d8ad0bb785d3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1677 microversion: 2.1 time: 0.746643 Oct 17 15:45:29.084598 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2196/4627] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:28 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1677 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:29.092460 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5cd9187f-14fc-4575-8787-29bed74bf46f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.437842 Oct 17 15:45:29.094801 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2432/4628] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:28 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:29.111228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:29.119782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ca852351-f3fe-4fd2-a14e-8bcdbb864d7b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:29.135075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:29.136394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:29.163001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.163198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.163381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.163381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.163691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.163891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.164029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.164162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.164162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.164432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.167827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.168670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.172201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:29.199126 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] HTTP exception thrown: Instance ca852351-f3fe-4fd2-a14e-8bcdbb864d7b could not be found. Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Request method failure captured: Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b HTTP/1.1 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXYjSZ_nlru-opsxre1_6o4maYJvszrSTfo5F1ZOmWvD2nvbavpGSPdcHZuHvhBBMJvJzDYKZ1CLYYmwcJEA0FxbZ2rDVbTjFujhByDDlZdgHa8WyAzJo1bPL8yj75lvGz1GIXDkBbnfrdh1y59UsxGhyOBvzL-Yq-36NgYBv7Q1Aq8 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 15cc78a142a148398dc438b5ff2a25e9 Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ca852351-f3fe-4fd2-a14e-8bcdbb864d7b could not be found. Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ca852351-f3fe-4fd2-a14e-8bcdbb864d7b'} Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca852351-f3fe-4fd2-a14e-8bcdbb864d7b could not be found. Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca852351-f3fe-4fd2-a14e-8bcdbb864d7b could not be found. Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:29.201833 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.207267 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:29.207267 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:29.207267 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:29.207267 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:29.207267 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:29.207267 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca852351-f3fe-4fd2-a14e-8bcdbb864d7b could not be found. Oct 17 15:45:29.207267 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.209646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Returning 404 to user: Instance ca852351-f3fe-4fd2-a14e-8bcdbb864d7b could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:29.211331 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd0c3a31-7366-4a3e-a242-cf3a23366cd6 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b" status: 404 len: 111 microversion: 2.1 time: 0.124368 Oct 17 15:45:29.216423 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2197/4629] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:29 2022] GET /compute/v2.1/servers/ca852351-f3fe-4fd2-a14e-8bcdbb864d7b => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:29.226295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:29.227827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:29.241756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.243020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.244024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.245366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.246194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.247107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.521873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:29.569522 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-290a4655-4ab5-46ca-b475-487c472da3bc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.445444 Oct 17 15:45:29.586002 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2433/4630] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:29 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:29.600300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:29.601776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:29.611304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.612369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.613083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.614350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.615695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.616661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.662212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:45:29.724443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:29.755951 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1862e325-4f12-4bf4-b36c-aa051b87111b tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1313 microversion: 2.1 time: 0.537178 Oct 17 15:45:29.757370 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2198/4631] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:29 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:29.777730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-63bc3c89-d5fb-4c94-b558-6ec012097eae tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:29.780022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-63bc3c89-d5fb-4c94-b558-6ec012097eae tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: cf883a5e-c5a3-4301-8f22-30c84c92e8bf] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:29.799419 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-63bc3c89-d5fb-4c94-b558-6ec012097eae tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance cf883a5e-c5a3-4301-8f22-30c84c92e8bf could not be found. Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-63bc3c89-d5fb-4c94-b558-6ec012097eae tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/cf883a5e-c5a3-4301-8f22-30c84c92e8bf HTTP/1.1 Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance cf883a5e-c5a3-4301-8f22-30c84c92e8bf could not be found. Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'cf883a5e-c5a3-4301-8f22-30c84c92e8bf'} Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf883a5e-c5a3-4301-8f22-30c84c92e8bf could not be found. Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf883a5e-c5a3-4301-8f22-30c84c92e8bf could not be found. Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.802197 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:29.806929 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.806929 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:29.806929 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:29.806929 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:29.806929 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:29.806929 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:29.806929 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf883a5e-c5a3-4301-8f22-30c84c92e8bf could not be found. Oct 17 15:45:29.806929 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:29.811424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-63bc3c89-d5fb-4c94-b558-6ec012097eae tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance cf883a5e-c5a3-4301-8f22-30c84c92e8bf could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:29.812385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-63bc3c89-d5fb-4c94-b558-6ec012097eae tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf883a5e-c5a3-4301-8f22-30c84c92e8bf" status: 404 len: 111 microversion: 2.1 time: 0.053400 Oct 17 15:45:29.812980 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2199/4632] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:45:29 2022] DELETE /compute/v2.1/servers/cf883a5e-c5a3-4301-8f22-30c84c92e8bf => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:29.823249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:29.831650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:29.846404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.849105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.851213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.852252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:29.853952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:29.854393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:29.985029 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bbddd7cf-310e-4bb9-bfad-4a45228eb12b tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 204 len: 0 microversion: 2.1 time: 0.396065 Oct 17 15:45:29.985997 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2434/4633] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:45:29 2022] DELETE /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:45:30.006807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:30.008220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:30.040552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:30.043592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:30.044681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:30.049050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:30.053687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:30.054954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:30.315310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:30.327519 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13cd04f5-c05e-4918-aadf-a8ee24ad4f8a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1675 microversion: 2.1 time: 0.335824 Oct 17 15:45:30.329801 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2435/4634] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:29 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1675 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:30.338888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:30.340241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:30.353564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:30.354685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:30.356318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:30.357616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:30.359130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:30.360376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:30.367467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:30.390421 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ec9e7a37-27e1-4daf-867b-ddb8d8a87b89 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.570755 Oct 17 15:45:30.391941 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2200/4635] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:29 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:30.398631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:30.425608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:30.430892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:30.466929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:30.468341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:30.471142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:30.472872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:30.473390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:30.473838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:30.674769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:30.691343 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f364d25-eaa9-407a-a04e-0650b836671c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1677 microversion: 2.1 time: 0.357620 Oct 17 15:45:30.692717 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2436/4636] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:30 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1677 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:30.795150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:30.795899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:30.804681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:30.811390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:30.812190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:30.813175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:30.813893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:30.814563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:30.915912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:30.928588 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed417009-b3f3-4d09-8cca-577890b712d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.514153 Oct 17 15:45:30.933228 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2201/4637] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:30 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:30.958783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a3dfced-7d34-4a67-a7e7-95794f616da1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:30.959391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6a3dfced-7d34-4a67-a7e7-95794f616da1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 15:45:30.959912 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-6a3dfced-7d34-4a67-a7e7-95794f616da1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a3dfced-7d34-4a67-a7e7-95794f616da1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 9223372036854775808 could not be found. Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '9223372036854775808'} Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:30.963116 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:30.966855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:30.966855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:30.966855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:30.966855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 17 15:45:30.966855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:30.966855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a3dfced-7d34-4a67-a7e7-95794f616da1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:30.966855 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6a3dfced-7d34-4a67-a7e7-95794f616da1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009959 Oct 17 15:45:30.966855 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2202/4638] 10.222.0.87 () {58 vars in 1188 bytes} [Mon Oct 17 15:45:30 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 15:45:30.978764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:30.979388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:31.003107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.007923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.008684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.009969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.010705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.011365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.232446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:31.251808 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f243aea-31d3-4d7d-87dd-937a583ee667 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1497 microversion: 2.1 time: 0.467125 Oct 17 15:45:31.252498 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2437/4639] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:30 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1497 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:31.281153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d705b2ea-0105-4e8f-8efd-31ec9c1c6d34 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:31.309693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_groups [None req-d705b2ea-0105-4e8f-8efd-31ec9c1c6d34 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Querying cell 4ec06080-01b5-4793-9448-66de7d08c56d(cell1) for 1 instances {{(pid=120406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 15:45:31.310445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d705b2ea-0105-4e8f-8efd-31ec9c1c6d34 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.310969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d705b2ea-0105-4e8f-8efd-31ec9c1c6d34 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.311408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d705b2ea-0105-4e8f-8efd-31ec9c1c6d34 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.384226 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d705b2ea-0105-4e8f-8efd-31ec9c1c6d34 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups/e4d2044f-9b38-4ad9-a4da-c084e014cf8b" status: 200 len: 220 microversion: 2.1 time: 0.111650 Oct 17 15:45:31.392543 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2438/4640] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:45:31 2022] GET /compute/v2.1/os-server-groups/e4d2044f-9b38-4ad9-a4da-c084e014cf8b => generated 220 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:31.399580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:31.400827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:31.425589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.426387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.427020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.429978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.430814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.433600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.543434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:31.558792 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea5b86ad-3851-40af-830a-b2ee1effbcc9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.588155 Oct 17 15:45:31.561876 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2203/4641] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:30 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:31.571361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:31.577189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:31.594361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.599153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.601509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.602784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.606719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.611789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.686072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:45:31.841338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:31.857102 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bdd75960-745e-474e-807f-ed13b8e6bb96 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1675 microversion: 2.1 time: 0.462934 Oct 17 15:45:31.862632 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2439/4642] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:31 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1675 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:31.866586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:31.867277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:31.873953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.874455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.875069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.875836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.878959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.879517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.904967 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f7c80371-913e-4a70-ae5d-817996a59ffe tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 204 len: 0 microversion: 2.1 time: 0.336876 Oct 17 15:45:31.906992 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2204/4643] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:45:31 2022] DELETE /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:45:31.920460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:31.923276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:31.944320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.945246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.946042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:31.948044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:31.948942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:31.950812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:32.215220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:32.230581 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9ae5cc0-71a5-4407-96ff-c212372c9f20 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1677 microversion: 2.1 time: 0.317240 Oct 17 15:45:32.262485 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2205/4644] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:31 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1677 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:32.657061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1954729641", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "863e6c7e-3185-492d-aeed-e12c167fd961"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:32.675742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:32.701638 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-875dbd28-1eee-4855-979c-fc149ccb3d0a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.841539 Oct 17 15:45:32.702727 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2440/4645] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:31 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:32.737612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:32.740253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:32.758775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:32.759284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:32.759740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:32.762730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:32.763323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:32.763778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:32.764187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] validate_networks() for [('863e6c7e-3185-492d-aeed-e12c167fd961', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:45:33.262063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:33.271286 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be112651-f56c-4f12-a082-4871752056d0 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1503 microversion: 2.1 time: 0.563049 Oct 17 15:45:33.288491 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2441/4646] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:32 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1503 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:33.304451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-050f8d63-d4a5-4f69-8d9c-f7f224e94977 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:33.305294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-050f8d63-d4a5-4f69-8d9c-f7f224e94977 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Failed to fetch instance by id -1 {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 15:45:33.309535 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-050f8d63-d4a5-4f69-8d9c-f7f224e94977 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance -1 could not be found. Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-050f8d63-d4a5-4f69-8d9c-f7f224e94977 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance -1 could not be found. Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '-1'} Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:33.311763 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:33.318771 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:33.318771 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:33.318771 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 17 15:45:33.318771 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:33.318771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-050f8d63-d4a5-4f69-8d9c-f7f224e94977 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:33.318771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-050f8d63-d4a5-4f69-8d9c-f7f224e94977 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023487 Oct 17 15:45:33.327751 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2442/4647] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:45:33 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:45:33.333141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:33.333783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:33.347326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:33.347846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:33.348474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:33.353031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:33.353937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:33.354616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:33.602169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:33.622462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e35429f4-07fb-47bb-9973-e696b9a97936 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1607 microversion: 2.1 time: 0.293388 Oct 17 15:45:33.626802 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2443/4648] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:33 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1607 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:33.680676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:33.681327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:33.712186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:33.712707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:33.713162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:33.713916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:33.714395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:33.714854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:34.715837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:34.735447 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dec332e5-600f-4234-abc1-a4a2b5d92d85 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1677 microversion: 2.1 time: 1.084077 Oct 17 15:45:34.744236 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2444/4649] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:33 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1677 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:34.763344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:34.765101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:34.787733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:34.794875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:34.797185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:34.798228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:34.801298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:34.805177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:35.270175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:45:35.273268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:45:35.275205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:45:35.276297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:45:35.280529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:45:35.372812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:35.379089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:35.382066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:35.387818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:35.389661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:35.391509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:35.475132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:35.520817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Getting quotas for project c27c9ec358df4b96b4819570ac75f722. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:45:35.524287 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb16c2c3-6234-4592-bc63-3e20ce57c675 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.769597 Oct 17 15:45:35.525057 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2445/4650] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:34 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:35.563423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Getting quotas for user 8ab805d33d2040ad8bf56bc2702578d4 and project c27c9ec358df4b96b4819570ac75f722. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:45:35.564094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:35.564999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:35.584750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:35.588105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:35.592147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:35.595021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:35.595728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:35.597369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:35.606241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:45:35.612711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:45:35.754221 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-615f4d71-b016-4917-89f4-21832752eaad tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.488758 Oct 17 15:45:35.757548 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2206/4651] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:45:35.766467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:35.769686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:35.815161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:35.837717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:35.843478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:35.845474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:35.850189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:35.856258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:35.926798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff94882cf4a24ab6b7fe6c2eabc44212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2120f9f2440cf9ae4704ace87b05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:35.945461 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51477bdd-2ee5-4573-b2e2-d8bdeae7a8f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 200 len: 1461 microversion: 2.1 time: 0.405087 Oct 17 15:45:35.947130 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2446/4652] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:35 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 1461 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:35.956251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4a2d9e1d-ed92-4176-94ac-174a4c59f7b7 req-af8b0ade-1748-4d5a-a0e9-59b01721febd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff35e7aa-0374-467e-8034-d2fee905517a", "name": "network-vif-deleted", "tag": "c16a32b4-1d9b-4313-aa07-1195046c1e31"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:35.978318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4a2d9e1d-ed92-4176-94ac-174a4c59f7b7 req-af8b0ade-1748-4d5a-a0e9-59b01721febd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:35.981559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4a2d9e1d-ed92-4176-94ac-174a4c59f7b7 req-af8b0ade-1748-4d5a-a0e9-59b01721febd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:35.982768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4a2d9e1d-ed92-4176-94ac-174a4c59f7b7 req-af8b0ade-1748-4d5a-a0e9-59b01721febd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:36.051380 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4a2d9e1d-ed92-4176-94ac-174a4c59f7b7 req-af8b0ade-1748-4d5a-a0e9-59b01721febd service nova] Creating event network-vif-deleted:c16a32b4-1d9b-4313-aa07-1195046c1e31 for instance ff35e7aa-0374-467e-8034-d2fee905517a on n-h1-854441-12 Oct 17 15:45:36.052401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:36.067262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:36.068048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:36.069774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lazy-loading 'fault' on Instance uuid ff35e7aa-0374-467e-8034-d2fee905517a {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:45:36.071348 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4a2d9e1d-ed92-4176-94ac-174a4c59f7b7 req-af8b0ade-1748-4d5a-a0e9-59b01721febd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121950 Oct 17 15:45:36.072847 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2447/4653] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:36.115607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:36.116735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:36.178908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:36.181743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:36.184961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:36.187853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:36.197142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:36.198590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:36.246044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15cc78a142a148398dc438b5ff2a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4152066a8f430fb2fc99bf60b20203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:36.279283 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab356592-6791-4f85-958d-c853e2d0a94f tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 200 len: 1329 microversion: 2.1 time: 0.514854 Oct 17 15:45:36.299595 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2207/4654] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:35 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 1329 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:36.319515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a2a07c57-f26a-4818-b58b-52b43276b111 req-d204ab95-1e53-4b67-b213-26a31b376dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9344974-fe7c-47ca-9854-c6584ee21588", "name": "network-vif-deleted", "tag": "258ad1f0-41c7-465d-8400-449c55449320"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:36.356301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a2a07c57-f26a-4818-b58b-52b43276b111 req-d204ab95-1e53-4b67-b213-26a31b376dde service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:36.359502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a2a07c57-f26a-4818-b58b-52b43276b111 req-d204ab95-1e53-4b67-b213-26a31b376dde service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:36.363311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a2a07c57-f26a-4818-b58b-52b43276b111 req-d204ab95-1e53-4b67-b213-26a31b376dde service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:36.399274 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a2a07c57-f26a-4818-b58b-52b43276b111 req-d204ab95-1e53-4b67-b213-26a31b376dde service nova] Creating event network-vif-deleted:258ad1f0-41c7-465d-8400-449c55449320 for instance b9344974-fe7c-47ca-9854-c6584ee21588 on n-h1-854441-12 Oct 17 15:45:36.417108 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a2a07c57-f26a-4818-b58b-52b43276b111 req-d204ab95-1e53-4b67-b213-26a31b376dde service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115048 Oct 17 15:45:36.420542 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2208/4655] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:36.432527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f937934d-bd17-4979-8e85-476d4004c1c6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:36.433858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f937934d-bd17-4979-8e85-476d4004c1c6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:36.700948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f937934d-bd17-4979-8e85-476d4004c1c6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:36.736919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:36.744041 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f937934d-bd17-4979-8e85-476d4004c1c6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1217 microversion: 2.1 time: 0.319360 Oct 17 15:45:36.745043 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2209/4656] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:36 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1217 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:36.751683 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f97d52b-f885-4c8d-adef-f1fd8d5be10d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.676809 Oct 17 15:45:36.752429 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2448/4657] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:36 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:36.786132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:36.787182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:36.796290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2c8ec0b-0590-4b5e-b7f3-8e023d43a200 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:36.796977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2c8ec0b-0590-4b5e-b7f3-8e023d43a200 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 3a10e32b-519e-4804-8015-c714248e028b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:36.800600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:36.801410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:36.802146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:36.803994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:36.804179 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e2c8ec0b-0590-4b5e-b7f3-8e023d43a200 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 3a10e32b-519e-4804-8015-c714248e028b could not be found. Oct 17 15:45:36.805064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:36.805779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2c8ec0b-0590-4b5e-b7f3-8e023d43a200 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/3a10e32b-519e-4804-8015-c714248e028b/action HTTP/1.1 Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 19 Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: {"forceDelete": {}} Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 3a10e32b-519e-4804-8015-c714248e028b could not be found. Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '3a10e32b-519e-4804-8015-c714248e028b', 'body': {'forceDelete': {}}} Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a10e32b-519e-4804-8015-c714248e028b could not be found. Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a10e32b-519e-4804-8015-c714248e028b could not be found. Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:36.818362 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:36.822280 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:36.822280 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:36.822280 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a10e32b-519e-4804-8015-c714248e028b could not be found. Oct 17 15:45:36.822280 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:36.822280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2c8ec0b-0590-4b5e-b7f3-8e023d43a200 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 3a10e32b-519e-4804-8015-c714248e028b could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:36.823154 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2c8ec0b-0590-4b5e-b7f3-8e023d43a200 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/3a10e32b-519e-4804-8015-c714248e028b/action" status: 404 len: 111 microversion: 2.1 time: 0.029446 Oct 17 15:45:36.825938 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2449/4658] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:36 2022] POST /compute/v2.1/servers/3a10e32b-519e-4804-8015-c714248e028b/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:36.837583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:36.845567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:36.863192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:36.863756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:36.875587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:36.876913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:36.877684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:36.878349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:37.258157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:37.269897 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc0079c3-e44f-4e94-8d2c-33667b5e235f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.439598 Oct 17 15:45:37.286951 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2450/4659] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:36 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:37.298339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:37.301062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:37.324539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:37.325051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:37.325794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:37.326603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:37.327078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:37.327545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:37.369696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:37.379345 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31cbb8d7-0fe8-4742-8433-484264a64b45 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1654 microversion: 2.1 time: 0.631280 Oct 17 15:45:37.379863 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2210/4660] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:36 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1654 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:37.397503 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] HTTP exception thrown: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Request method failure captured: Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 HTTP/1.1 Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXh06Ip_EBZYgWkO0ekCXYqkQbY-aljmpa8hwE2zr_O7_OVhFYL6Yq_FfG_H1ecpfQrRLkceBzjKJOIkJ1chXGXMRFYz4zN-Z9A3UBCV59LLEL9GyuZGgjSIa8Foc7XyXDvyINCeYKJNxluHV7slAmcRCGX6l7k2-VGlPmm4wTQM5BM Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ff94882cf4a24ab6b7fe6c2eabc44212 Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'b9344974-fe7c-47ca-9854-c6584ee21588'} Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:37.399488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.416844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:37.416844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:37.416844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:37.416844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:37.416844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:37.416844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:37.416844 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.416844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Returning 404 to user: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:37.416844 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b0b674f-08f0-462a-b799-757c8b8bf9f4 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 404 len: 111 microversion: 2.1 time: 0.112585 Oct 17 15:45:37.420633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:37.420633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:37.421042 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2451/4661] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:37 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:37.424119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:37.424752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] [instance: ff35e7aa-0374-467e-8034-d2fee905517a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:37.433226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:37.434000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:37.434459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:37.445325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:37.445925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:37.446617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:37.447599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:37.447937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:37.451550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:37.452400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:37.452953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:37.453465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:37.497818 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] HTTP exception thrown: Instance ff35e7aa-0374-467e-8034-d2fee905517a could not be found. Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Request method failure captured: Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a HTTP/1.1 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXYjSZ_nlru-opsxre1_6o4maYJvszrSTfo5F1ZOmWvD2nvbavpGSPdcHZuHvhBBMJvJzDYKZ1CLYYmwcJEA0FxbZ2rDVbTjFujhByDDlZdgHa8WyAzJo1bPL8yj75lvGz1GIXDkBbnfrdh1y59UsxGhyOBvzL-Yq-36NgYBv7Q1Aq8 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/cd4152066a8f430fb2fc99bf60b20203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: cd4152066a8f430fb2fc99bf60b20203 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1079605397 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 15cc78a142a148398dc438b5ff2a25e9 Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1079605397-project Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance ff35e7aa-0374-467e-8034-d2fee905517a could not be found. Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'ff35e7aa-0374-467e-8034-d2fee905517a'} Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff35e7aa-0374-467e-8034-d2fee905517a could not be found. Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff35e7aa-0374-467e-8034-d2fee905517a could not be found. Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:37.502070 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.506877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:37.506877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:37.506877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:37.506877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:37.506877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:37.506877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff35e7aa-0374-467e-8034-d2fee905517a could not be found. Oct 17 15:45:37.506877 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:37.510537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Returning 404 to user: Instance ff35e7aa-0374-467e-8034-d2fee905517a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:37.511944 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-703bebbc-fa03-4e09-973d-51a44fa77255 tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a" status: 404 len: 111 microversion: 2.1 time: 0.091917 Oct 17 15:45:37.516148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2452/4662] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:37 2022] GET /compute/v2.1/servers/ff35e7aa-0374-467e-8034-d2fee905517a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:37.526529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48c6ea98-8364-47b6-ba3d-a7076f7a05ca tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:37.554302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48c6ea98-8364-47b6-ba3d-a7076f7a05ca tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:37.571337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48c6ea98-8364-47b6-ba3d-a7076f7a05ca tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:37.572193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48c6ea98-8364-47b6-ba3d-a7076f7a05ca tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:37.668734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-48c6ea98-8364-47b6-ba3d-a7076f7a05ca tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Going to try to start instance {{(pid=120406) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 15:45:37.870417 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48c6ea98-8364-47b6-ba3d-a7076f7a05ca tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/action" status: 202 len: 0 microversion: 2.1 time: 0.350793 Oct 17 15:45:37.871353 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2453/4663] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:37 2022] POST /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:45:37.888337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:37.913458 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9665ef8a-6605-4bfd-bbb5-81cbe0b7b9ea tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.501569 Oct 17 15:45:37.914355 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2211/4664] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:37 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:37.920450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0bda3f2a-0db7-4012-ab87-57b19eeb788c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:37.929891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a4e650b-5603-4df7-b459-f5f37a243f4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] Calling method '.version_select at 0x7f28bea52f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:37.989774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_groups [None req-0bda3f2a-0db7-4012-ab87-57b19eeb788c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Querying cell 4ec06080-01b5-4793-9448-66de7d08c56d(cell1) for 1 instances {{(pid=120406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 15:45:37.990874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bda3f2a-0db7-4012-ab87-57b19eeb788c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:37.991538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bda3f2a-0db7-4012-ab87-57b19eeb788c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:37.992175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bda3f2a-0db7-4012-ab87-57b19eeb788c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:38.021820 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0bda3f2a-0db7-4012-ab87-57b19eeb788c tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.148434 Oct 17 15:45:38.022760 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2454/4665] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:45:37 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:38.037325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:38.038438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:38.043790 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a4e650b-5603-4df7-b459-f5f37a243f4a tempest-ServerActionsTestJSON-1079605397 tempest-ServerActionsTestJSON-1079605397-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840657135" status: 202 len: 0 microversion: 2.1 time: 0.127555 Oct 17 15:45:38.046067 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2212/4666] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 15:45:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840657135 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:45:38.057996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:38.059904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:38.070800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:38.071271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:38.071895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:38.074152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:38.075388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:38.076372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:38.076989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:38.077493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:38.077943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:38.079199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:38.080585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:38.081577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:38.352572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:38.371341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79202960-3149-42d9-ad80-e5421277931b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1221 microversion: 2.1 time: 0.347261 Oct 17 15:45:38.372474 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2455/4667] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:38 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1221 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:38.377645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d5659a4-941d-43ed-aeb2-119ffbb4d001 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:38.385891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d5659a4-941d-43ed-aeb2-119ffbb4d001 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: cc938588-c379-4b3f-9f94-181b58a120ea] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:38.402955 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3d5659a4-941d-43ed-aeb2-119ffbb4d001 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance cc938588-c379-4b3f-9f94-181b58a120ea could not be found. Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d5659a4-941d-43ed-aeb2-119ffbb4d001 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/cc938588-c379-4b3f-9f94-181b58a120ea/action HTTP/1.1 Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 39 Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: {"os-getConsoleOutput": {"length": 10}} Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance cc938588-c379-4b3f-9f94-181b58a120ea could not be found. Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'cc938588-c379-4b3f-9f94-181b58a120ea', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc938588-c379-4b3f-9f94-181b58a120ea could not be found. Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc938588-c379-4b3f-9f94-181b58a120ea could not be found. Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:38.409996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:38.413742 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:38.413742 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:38.413742 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:38.413742 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:38.413742 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc938588-c379-4b3f-9f94-181b58a120ea could not be found. Oct 17 15:45:38.413742 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:38.419107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d5659a4-941d-43ed-aeb2-119ffbb4d001 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance cc938588-c379-4b3f-9f94-181b58a120ea could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:38.420572 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d5659a4-941d-43ed-aeb2-119ffbb4d001 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/cc938588-c379-4b3f-9f94-181b58a120ea/action" status: 404 len: 111 microversion: 2.1 time: 0.046969 Oct 17 15:45:38.421459 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2456/4668] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:38 2022] POST /compute/v2.1/servers/cc938588-c379-4b3f-9f94-181b58a120ea/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:38.433402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3a357e5-6241-42c9-9433-0ea17aff045f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:38.463755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.server_groups [None req-e3a357e5-6241-42c9-9433-0ea17aff045f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Querying cell 4ec06080-01b5-4793-9448-66de7d08c56d(cell1) for 1 instances {{(pid=120406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 15:45:38.467688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3a357e5-6241-42c9-9433-0ea17aff045f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:38.468314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3a357e5-6241-42c9-9433-0ea17aff045f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:38.468863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3a357e5-6241-42c9-9433-0ea17aff045f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:38.499835 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3a357e5-6241-42c9-9433-0ea17aff045f tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/os-server-groups/e4d2044f-9b38-4ad9-a4da-c084e014cf8b" status: 200 len: 182 microversion: 2.1 time: 0.076972 Oct 17 15:45:38.501642 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2457/4669] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:45:38 2022] GET /compute/v2.1/os-server-groups/e4d2044f-9b38-4ad9-a4da-c084e014cf8b => generated 182 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:38.509646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:38.516648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:38.545585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:38.548876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:38.549712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:38.553081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:38.558400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:38.569726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:38.635702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:38.851495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:38.908901 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1b529fb8-07f6-4432-ad62-284730bebe49 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1663 microversion: 2.1 time: 0.854467 Oct 17 15:45:38.914663 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2213/4670] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:38 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1663 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:38.953783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:38.959440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:38.997735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:39.000216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:39.002227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:39.003434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:39.006956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:39.007820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:39.043667 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] HTTP exception thrown: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Request method failure captured: Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 HTTP/1.1 Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXh06Ip_EBZYgWkO0ekCXYqkQbY-aljmpa8hwE2zr_O7_OVhFYL6Yq_FfG_H1ecpfQrRLkceBzjKJOIkJ1chXGXMRFYz4zN-Z9A3UBCV59LLEL9GyuZGgjSIa8Foc7XyXDvyINCeYKJNxluHV7slAmcRCGX6l7k2-VGlPmm4wTQM5BM Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ff94882cf4a24ab6b7fe6c2eabc44212 Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'b9344974-fe7c-47ca-9854-c6584ee21588'} Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:39.048310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.052177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.057301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Returning 404 to user: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:39.060089 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f4fe685-ba46-4382-a23f-3a6685e2b398 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 404 len: 111 microversion: 2.1 time: 0.122456 Oct 17 15:45:39.064528 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2214/4671] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:45:38 2022] DELETE /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:39.084139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:39.096649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] [instance: b9344974-fe7c-47ca-9854-c6584ee21588] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:39.115097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:39.116127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:39.116831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:39.117881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:39.119089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:39.121381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:39.154410 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] HTTP exception thrown: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Request method failure captured: Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 HTTP/1.1 Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXh06Ip_EBZYgWkO0ekCXYqkQbY-aljmpa8hwE2zr_O7_OVhFYL6Yq_FfG_H1ecpfQrRLkceBzjKJOIkJ1chXGXMRFYz4zN-Z9A3UBCV59LLEL9GyuZGgjSIa8Foc7XyXDvyINCeYKJNxluHV7slAmcRCGX6l7k2-VGlPmm4wTQM5BM Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ff94882cf4a24ab6b7fe6c2eabc44212 Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'b9344974-fe7c-47ca-9854-c6584ee21588'} Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.156464 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.160043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.160043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.160043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.160043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:39.160043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:39.160043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. Oct 17 15:45:39.160043 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.170125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Returning 404 to user: Instance b9344974-fe7c-47ca-9854-c6584ee21588 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:39.180478 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e7a9c88-29bb-4758-96ee-c36a0e034632 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588" status: 404 len: 111 microversion: 2.1 time: 0.100875 Oct 17 15:45:39.182241 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2215/4672] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:39 2022] GET /compute/v2.1/servers/b9344974-fe7c-47ca-9854-c6584ee21588 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:39.198137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3681882-50c6-4f5b-a267-1a53adc5ecbb tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:39.228081 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e3681882-50c6-4f5b-a267-1a53adc5ecbb tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] HTTP exception thrown: Instance group 2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475 could not be found. Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3681882-50c6-4f5b-a267-1a53adc5ecbb tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Request method failure captured: Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-server-groups/2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475 HTTP/1.1 Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXh06Ip_EBZYgWkO0ekCXYqkQbY-aljmpa8hwE2zr_O7_OVhFYL6Yq_FfG_H1ecpfQrRLkceBzjKJOIkJ1chXGXMRFYz4zN-Z9A3UBCV59LLEL9GyuZGgjSIa8Foc7XyXDvyINCeYKJNxluHV7slAmcRCGX6l7k2-VGlPmm4wTQM5BM Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ff94882cf4a24ab6b7fe6c2eabc44212 Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance group 2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475 could not be found. Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475'} Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475 could not be found. Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475 could not be found. Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.232272 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.236695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.236695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.236695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:39.236695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:39.236695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475 could not be found. Oct 17 15:45:39.236695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.241892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3681882-50c6-4f5b-a267-1a53adc5ecbb tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Returning 404 to user: Instance group 2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:39.246024 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3681882-50c6-4f5b-a267-1a53adc5ecbb tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475" status: 404 len: 117 microversion: 2.1 time: 0.059489 Oct 17 15:45:39.250733 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2216/4673] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:45:39 2022] DELETE /compute/v2.1/os-server-groups/2c59f7b5-cef4-4dbb-8cd7-19e23ebb7475 => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:45:39.261938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4be53ff2-042c-4098-99e2-a54c990e1ad3 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:39.292302 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-4be53ff2-042c-4098-99e2-a54c990e1ad3 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] HTTP exception thrown: Instance group 0b8bd776-3f5d-495d-8b05-c9071aea8565 could not be found. Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4be53ff2-042c-4098-99e2-a54c990e1ad3 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Request method failure captured: Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-server-groups/0b8bd776-3f5d-495d-8b05-c9071aea8565 HTTP/1.1 Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXh06Ip_EBZYgWkO0ekCXYqkQbY-aljmpa8hwE2zr_O7_OVhFYL6Yq_FfG_H1ecpfQrRLkceBzjKJOIkJ1chXGXMRFYz4zN-Z9A3UBCV59LLEL9GyuZGgjSIa8Foc7XyXDvyINCeYKJNxluHV7slAmcRCGX6l7k2-VGlPmm4wTQM5BM Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ff94882cf4a24ab6b7fe6c2eabc44212 Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance group 0b8bd776-3f5d-495d-8b05-c9071aea8565 could not be found. Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '0b8bd776-3f5d-495d-8b05-c9071aea8565'} Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0b8bd776-3f5d-495d-8b05-c9071aea8565 could not be found. Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0b8bd776-3f5d-495d-8b05-c9071aea8565 could not be found. Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.302723 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.307407 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.307407 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.307407 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:39.307407 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:39.307407 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0b8bd776-3f5d-495d-8b05-c9071aea8565 could not be found. Oct 17 15:45:39.307407 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.308956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4be53ff2-042c-4098-99e2-a54c990e1ad3 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Returning 404 to user: Instance group 0b8bd776-3f5d-495d-8b05-c9071aea8565 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:39.314900 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4be53ff2-042c-4098-99e2-a54c990e1ad3 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/0b8bd776-3f5d-495d-8b05-c9071aea8565" status: 404 len: 117 microversion: 2.1 time: 0.056870 Oct 17 15:45:39.315668 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2217/4674] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:45:39 2022] DELETE /compute/v2.1/os-server-groups/0b8bd776-3f5d-495d-8b05-c9071aea8565 => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:39.339810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7ae15fe-cec9-46f6-a4b8-5de67ec2f327 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:39.361454 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b7ae15fe-cec9-46f6-a4b8-5de67ec2f327 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] HTTP exception thrown: Instance group e7e96a71-492c-4774-9e6f-5dfbf0772e0f could not be found. Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7ae15fe-cec9-46f6-a4b8-5de67ec2f327 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Request method failure captured: Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-server-groups/e7e96a71-492c-4774-9e6f-5dfbf0772e0f HTTP/1.1 Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXh06Ip_EBZYgWkO0ekCXYqkQbY-aljmpa8hwE2zr_O7_OVhFYL6Yq_FfG_H1ecpfQrRLkceBzjKJOIkJ1chXGXMRFYz4zN-Z9A3UBCV59LLEL9GyuZGgjSIa8Foc7XyXDvyINCeYKJNxluHV7slAmcRCGX6l7k2-VGlPmm4wTQM5BM Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ff94882cf4a24ab6b7fe6c2eabc44212 Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance group e7e96a71-492c-4774-9e6f-5dfbf0772e0f could not be found. Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'e7e96a71-492c-4774-9e6f-5dfbf0772e0f'} Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e7e96a71-492c-4774-9e6f-5dfbf0772e0f could not be found. Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e7e96a71-492c-4774-9e6f-5dfbf0772e0f could not be found. Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.378523 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.383244 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.383244 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.383244 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:39.383244 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:39.383244 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e7e96a71-492c-4774-9e6f-5dfbf0772e0f could not be found. Oct 17 15:45:39.383244 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.384308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7ae15fe-cec9-46f6-a4b8-5de67ec2f327 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Returning 404 to user: Instance group e7e96a71-492c-4774-9e6f-5dfbf0772e0f could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:39.387850 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b7ae15fe-cec9-46f6-a4b8-5de67ec2f327 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/e7e96a71-492c-4774-9e6f-5dfbf0772e0f" status: 404 len: 117 microversion: 2.1 time: 0.066349 Oct 17 15:45:39.399963 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2218/4675] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:45:39 2022] DELETE /compute/v2.1/os-server-groups/e7e96a71-492c-4774-9e6f-5dfbf0772e0f => generated 117 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:39.441666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:39.449738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:39.505986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:39.508709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:39.512406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:39.517996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:39.521553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:39.522791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:39.724926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:39.742738 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7883b90-34ba-4f34-8cfb-a0c7d0e678c0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 1.236657 Oct 17 15:45:39.746830 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2458/4676] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:38 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:39.760823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f4541a1-a399-4879-a256-aa38bc8a27b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:39.780436 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8f4541a1-a399-4879-a256-aa38bc8a27b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] HTTP exception thrown: Instance group 0e69e73d-c2d7-4480-aae6-26216193e82f could not be found. Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f4541a1-a399-4879-a256-aa38bc8a27b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Request method failure captured: Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-server-groups/0e69e73d-c2d7-4480-aae6-26216193e82f HTTP/1.1 Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXh06Ip_EBZYgWkO0ekCXYqkQbY-aljmpa8hwE2zr_O7_OVhFYL6Yq_FfG_H1ecpfQrRLkceBzjKJOIkJ1chXGXMRFYz4zN-Z9A3UBCV59LLEL9GyuZGgjSIa8Foc7XyXDvyINCeYKJNxluHV7slAmcRCGX6l7k2-VGlPmm4wTQM5BM Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/93a2120f9f2440cf9ae4704ace87b05e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 93a2120f9f2440cf9ae4704ace87b05e Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerGroupTestJSON-2110049903 Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ff94882cf4a24ab6b7fe6c2eabc44212 Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerGroupTestJSON-2110049903-project Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance group 0e69e73d-c2d7-4480-aae6-26216193e82f could not be found. Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '0e69e73d-c2d7-4480-aae6-26216193e82f'} Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0e69e73d-c2d7-4480-aae6-26216193e82f could not be found. Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0e69e73d-c2d7-4480-aae6-26216193e82f could not be found. Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.790207 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:39.795855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:39.795855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:39.795855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:39.795855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:39.795855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0e69e73d-c2d7-4480-aae6-26216193e82f could not be found. Oct 17 15:45:39.795855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:39.797929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f4541a1-a399-4879-a256-aa38bc8a27b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Returning 404 to user: Instance group 0e69e73d-c2d7-4480-aae6-26216193e82f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:39.799958 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f4541a1-a399-4879-a256-aa38bc8a27b1 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/0e69e73d-c2d7-4480-aae6-26216193e82f" status: 404 len: 117 microversion: 2.1 time: 0.050992 Oct 17 15:45:39.802894 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2459/4677] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:45:39 2022] DELETE /compute/v2.1/os-server-groups/0e69e73d-c2d7-4480-aae6-26216193e82f => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:39.812377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:39.818946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:39.842059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:39.842954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:39.843640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:39.844709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:39.845494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:39.846108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:40.203273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:40.219255 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2d5ef0a-ea8b-4387-b0c1-22d2d6411238 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.414447 Oct 17 15:45:40.220845 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2460/4678] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:39 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:40.227114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10f52767-b4f3-404e-957f-fa2e566e7dd2 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:40.270683 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10f52767-b4f3-404e-957f-fa2e566e7dd2 tempest-ServerGroupTestJSON-2110049903 tempest-ServerGroupTestJSON-2110049903-project] 10.222.0.87 "DELETE /compute/v2.1/os-server-groups/e4d2044f-9b38-4ad9-a4da-c084e014cf8b" status: 204 len: 0 microversion: 2.1 time: 0.047892 Oct 17 15:45:40.272955 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2461/4679] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 15:45:40 2022] DELETE /compute/v2.1/os-server-groups/e4d2044f-9b38-4ad9-a4da-c084e014cf8b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:45:40.282940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:40.284090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:40.294616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:40.295325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:40.295952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:40.297012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:40.297832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:40.298398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:40.331164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:40.346529 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d3fa18d0-cf4c-4b10-8737-881dbe2a75ce tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1287 microversion: 2.1 time: 0.938455 Oct 17 15:45:40.349972 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2219/4680] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:39 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1287 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:40.361213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b291161-7619-498c-8368-35789ced040b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:40.365005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6b291161-7619-498c-8368-35789ced040b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: fc101ff1-7ddf-4d84-a1b6-e2809f731662] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:40.379787 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-6b291161-7619-498c-8368-35789ced040b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance fc101ff1-7ddf-4d84-a1b6-e2809f731662 could not be found. Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b291161-7619-498c-8368-35789ced040b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/fc101ff1-7ddf-4d84-a1b6-e2809f731662 HTTP/1.1 Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance fc101ff1-7ddf-4d84-a1b6-e2809f731662 could not be found. Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'fc101ff1-7ddf-4d84-a1b6-e2809f731662'} Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc101ff1-7ddf-4d84-a1b6-e2809f731662 could not be found. Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc101ff1-7ddf-4d84-a1b6-e2809f731662 could not be found. Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:40.385715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:40.392855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:40.392855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:40.392855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:40.392855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc101ff1-7ddf-4d84-a1b6-e2809f731662 could not be found. Oct 17 15:45:40.392855 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:40.397092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b291161-7619-498c-8368-35789ced040b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance fc101ff1-7ddf-4d84-a1b6-e2809f731662 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:40.398396 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b291161-7619-498c-8368-35789ced040b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/fc101ff1-7ddf-4d84-a1b6-e2809f731662" status: 404 len: 111 microversion: 2.1 time: 0.046712 Oct 17 15:45:40.399611 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2220/4681] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:40 2022] GET /compute/v2.1/servers/fc101ff1-7ddf-4d84-a1b6-e2809f731662 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:40.416732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:40.426447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:40.450861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:40.452168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:40.454900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:40.456112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:40.463815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:40.465545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:40.962073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:41.004741 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51ebfca1-1dae-49d5-8b49-985dcdcdb932 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1663 microversion: 2.1 time: 0.729381 Oct 17 15:45:41.009173 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2462/4682] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:40 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1663 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:41.025140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:41.035999 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-53cd87a4-21a5-472d-95d4-48a101916671 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.630894 Oct 17 15:45:41.037046 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2221/4683] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:40 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:41.068039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:41.072846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:41.110934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:41.111891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:41.112902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:41.114384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:41.115597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:41.116500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:41.372950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:41.374897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:41.388546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:41.395467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:41.396659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:41.397951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:41.398795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:41.399587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:41.629690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:41.644996 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5726ad4d-52f8-4ef8-bc27-c47fa1e9abdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.586255 Oct 17 15:45:41.654058 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2463/4684] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:41 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:41.770280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e43ebd7c-f5d9-467f-a99a-f9fde58f5310 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089719436", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e43ebd7c-f5d9-467f-a99a-f9fde58f5310 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 238 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089719436", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2089719436', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:41.800153 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e43ebd7c-f5d9-467f-a99a-f9fde58f5310 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e43ebd7c-f5d9-467f-a99a-f9fde58f5310 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.046458 Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2464/4685] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:41.820876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:41.837709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:41.838258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:41.839347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:41.840786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:41.842820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:41.842820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:42.169526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:42.186388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a9938c8-1508-468d-9779-37539cb43b2c tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1275 microversion: 2.1 time: 0.817746 Oct 17 15:45:42.187381 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2222/4686] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:41 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1275 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:42.194560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:42.195220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:42.209809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:42.210327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:42.210809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:42.222489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:42.223037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:42.223693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:42.227293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:42.570632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:42.583928 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d926ffdc-2b35-4c32-b863-ac2fae0971d2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.769741 Oct 17 15:45:42.606957 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2465/4687] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:41 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:42.614477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:42.620733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:42.645207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:42.645986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:42.646693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:42.647789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:42.648441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:42.649062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:43.530534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:43.556679 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-41a8c6f3-5dfd-42fd-85bb-c308fc1181c0 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1667 microversion: 2.1 time: 1.367785 Oct 17 15:45:43.560009 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2223/4688] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:42 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1667 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:43.581815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:43.587756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:43.602781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:43.626933 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f23f8abe-771c-4c0c-953a-dd12a1b2f89a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 1.016188 Oct 17 15:45:43.630422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:43.631888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:43.633084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:43.634798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:43.640589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:43.641952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:43.644795 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2466/4689] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:42 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:43.765116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6dd5814-c2d4-4566-bb87-72e286b1075c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1682696428", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6dd5814-c2d4-4566-bb87-72e286b1075c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 235 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1682696428", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1682696428', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:43.774462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6dd5814-c2d4-4566-bb87-72e286b1075c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:43.783274 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6dd5814-c2d4-4566-bb87-72e286b1075c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.022817 Oct 17 15:45:43.786769 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2467/4690] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:45:43 2022] POST /compute/v2.1/servers => generated 133 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:45:43.799010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:43.800177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:43.822447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:43.823387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:43.824167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:43.825997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:43.827565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:43.828391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:44.095452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:44.117057 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0c537439-bac5-4512-8756-5659d5ac9853 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1317 microversion: 2.1 time: 0.554916 Oct 17 15:45:44.117869 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2224/4691] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:43 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:44.123613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a4e90bf-b166-4ec8-8816-ede363ef4cc1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:44.124565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a4e90bf-b166-4ec8-8816-ede363ef4cc1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:44.135025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a4e90bf-b166-4ec8-8816-ede363ef4cc1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:44.137391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a4e90bf-b166-4ec8-8816-ede363ef4cc1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:44.140456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a4e90bf-b166-4ec8-8816-ede363ef4cc1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:44.141500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a4e90bf-b166-4ec8-8816-ede363ef4cc1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:44.142158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a4e90bf-b166-4ec8-8816-ede363ef4cc1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:44.144716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a4e90bf-b166-4ec8-8816-ede363ef4cc1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:44.198323 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a4e90bf-b166-4ec8-8816-ede363ef4cc1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/ips" status: 200 len: 152 microversion: 2.20 time: 0.078739 Oct 17 15:45:44.206054 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2225/4692] 10.222.0.87 () {60 vars in 1289 bytes} [Mon Oct 17 15:45:44 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/ips => generated 152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:45:44.469614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:44.484732 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a22d6cb8-4104-42e3-b5bc-12bb9e44aff3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.695396 Oct 17 15:45:44.485658 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2468/4693] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:43 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:44.513627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:44.514632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:44.523823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:44.524863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:44.526042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:44.527230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:44.528032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:44.528678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:45.174176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:45.175711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:45.254585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:45.258292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:45.262051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:45.263081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:45.264827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:45.265129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:45.353987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:45.389659 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-17e359a2-8cc4-4a32-a1ff-76e692fd84a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.880037 Oct 17 15:45:45.390293 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2226/4694] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:44 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:45.420283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02a41c98-d78d-4493-9387-e5dd17bb9cbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:45.420872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-02a41c98-d78d-4493-9387-e5dd17bb9cbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 63b784a5-41a7-4fae-b206-26341e3c3d76] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:45.442003 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-02a41c98-d78d-4493-9387-e5dd17bb9cbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 63b784a5-41a7-4fae-b206-26341e3c3d76 could not be found. Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02a41c98-d78d-4493-9387-e5dd17bb9cbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/63b784a5-41a7-4fae-b206-26341e3c3d76/action HTTP/1.1 Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 13 Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: {"pause": {}} Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 63b784a5-41a7-4fae-b206-26341e3c3d76 could not be found. Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '63b784a5-41a7-4fae-b206-26341e3c3d76', 'body': {'pause': {}}} Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b784a5-41a7-4fae-b206-26341e3c3d76 could not be found. Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b784a5-41a7-4fae-b206-26341e3c3d76 could not be found. Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:45.451746 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:45.465412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:45.465412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:45.465412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b784a5-41a7-4fae-b206-26341e3c3d76 could not be found. Oct 17 15:45:45.465412 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:45.465412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02a41c98-d78d-4493-9387-e5dd17bb9cbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 63b784a5-41a7-4fae-b206-26341e3c3d76 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:45.465412 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02a41c98-d78d-4493-9387-e5dd17bb9cbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/63b784a5-41a7-4fae-b206-26341e3c3d76/action" status: 404 len: 111 microversion: 2.1 time: 0.040151 Oct 17 15:45:45.465412 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2227/4695] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:45 2022] POST /compute/v2.1/servers/63b784a5-41a7-4fae-b206-26341e3c3d76/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:45.474650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:45.474650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:45.484885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:45.512726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:45.513235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:45.513893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:45.514877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:45.516733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:45.517182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:45.775226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:45.822930 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6267870f-2256-4ed8-9ce0-7b207b6cafe1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1317 microversion: 2.1 time: 0.648298 Oct 17 15:45:45.830732 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2469/4696] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:45 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:46.075266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:46.146651 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-79b89817-6d23-48ae-90e5-2b99122fdb8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.677834 Oct 17 15:45:46.155563 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2228/4697] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:45 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:46.187269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:46.188094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:46.197804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:46.205077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:46.205685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:46.206830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:46.207560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:46.211253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:46.839160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:46.840529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:46.863018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:46.873144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9197a438-f740-40bc-a58e-b6fd0d6b16eb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.689959 Oct 17 15:45:46.887635 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2470/4698] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:46 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:46.901450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:46.912049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:46.935708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e8f5b6e-f471-4a47-85ad-0703ca31c77e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:46.936568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e8f5b6e-f471-4a47-85ad-0703ca31c77e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:46.938772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:46.959873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:46.970739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:46.971145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e8f5b6e-f471-4a47-85ad-0703ca31c77e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:46.971916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e8f5b6e-f471-4a47-85ad-0703ca31c77e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:46.972645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e8f5b6e-f471-4a47-85ad-0703ca31c77e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:46.975570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e8f5b6e-f471-4a47-85ad-0703ca31c77e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:46.977307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e8f5b6e-f471-4a47-85ad-0703ca31c77e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:46.980566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e8f5b6e-f471-4a47-85ad-0703ca31c77e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:46.989419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:46.991291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:46.995741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:46.998869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:47.252138 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e8f5b6e-f471-4a47-85ad-0703ca31c77e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 202 len: 0 microversion: 2.1 time: 0.320056 Oct 17 15:45:47.261115 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2471/4699] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:46 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:45:47.290684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:47.305010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:47.332621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:47.337894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:47.339024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:47.341738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:47.342732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:47.343431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:47.981632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:48.005810 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18e1cc22-fea6-444b-afc7-98ea3ad8e168 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1512 microversion: 2.1 time: 0.744862 Oct 17 15:45:48.018628 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2472/4700] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:47 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1512 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:48.241370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5eaf2336-31da-4a97-bd89-bb5ff7529385 req-77264c66-0475-4360-82e4-85d069fa27bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada", "tag": "afc8306c-b394-40f8-84af-6cc8d5e9739d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:48.302765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5eaf2336-31da-4a97-bd89-bb5ff7529385 req-77264c66-0475-4360-82e4-85d069fa27bb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:48.312730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5eaf2336-31da-4a97-bd89-bb5ff7529385 req-77264c66-0475-4360-82e4-85d069fa27bb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:48.320266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5eaf2336-31da-4a97-bd89-bb5ff7529385 req-77264c66-0475-4360-82e4-85d069fa27bb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:48.343260 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5eaf2336-31da-4a97-bd89-bb5ff7529385 req-77264c66-0475-4360-82e4-85d069fa27bb service nova] Creating event network-changed:afc8306c-b394-40f8-84af-6cc8d5e9739d for instance 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada on n-h1-854441-12 Oct 17 15:45:48.361005 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5eaf2336-31da-4a97-bd89-bb5ff7529385 req-77264c66-0475-4360-82e4-85d069fa27bb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127130 Oct 17 15:45:48.366975 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2473/4701] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:45:48.830575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:48.876807 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-218ce3c6-c0c9-41ef-971c-a6013c2b54ac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1317 microversion: 2.1 time: 2.046018 Oct 17 15:45:48.910652 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2229/4702] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:46 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1317 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:45:49.058303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:49.059060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:49.074336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:49.074991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:49.075511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:49.077725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:49.081601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:49.082053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:49.573657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:49.574473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:49.627880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:49.631798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:49.636962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:49.639321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:49.640725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:49.649854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:49.758853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:49.789929 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-552841a8-ff2e-4282-aeb5-8fe30b24e8d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1492 microversion: 2.1 time: 0.731683 Oct 17 15:45:49.796289 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2474/4703] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:49 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1492 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:49.843086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:49.843696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:49.860343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lazy-loading 'flavor' on Instance uuid 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:45:49.867540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:49.868149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:49.868601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:49.869355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:49.869832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:49.870275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:49.977132 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Cannot 'pause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state paused Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action HTTP/1.1 Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 13 Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: {"pause": {}} Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'pause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state paused Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d', 'body': {'pause': {}}} Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d in vm_state paused. Cannot pause while the instance is in this state. Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state paused Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:49.985358 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:49.990129 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:49.990129 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:49.990129 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:49.990129 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state paused Oct 17 15:45:49.990129 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:49.997168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 409 to user: Cannot 'pause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state paused {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:49.998399 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e94e7796-1f30-451a-a98b-0d086a0dce31 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 409 len: 143 microversion: 2.1 time: 0.160181 Oct 17 15:45:49.999858 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2475/4704] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:49 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 143 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 15:45:50.021950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:50.023049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:50.042837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:50.044018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:50.046916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:50.049009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:50.054452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:50.055249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:50.709207 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-70abdb0d-fec0-4df9-b8b8-ab08b6881588 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/action" status: 202 len: 0 microversion: 2.20 time: 1.148038 Oct 17 15:45:50.714328 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2230/4705] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:45:49 2022] POST /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/action => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:45:50.720743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f61cf535-9854-4305-8cf4-f1bf7dd89ed4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:50.731385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f61cf535-9854-4305-8cf4-f1bf7dd89ed4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:50.740637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f61cf535-9854-4305-8cf4-f1bf7dd89ed4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:50.751307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f61cf535-9854-4305-8cf4-f1bf7dd89ed4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:50.751898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f61cf535-9854-4305-8cf4-f1bf7dd89ed4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:50.752873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f61cf535-9854-4305-8cf4-f1bf7dd89ed4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:50.753440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f61cf535-9854-4305-8cf4-f1bf7dd89ed4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:50.753963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f61cf535-9854-4305-8cf4-f1bf7dd89ed4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:50.919370 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f61cf535-9854-4305-8cf4-f1bf7dd89ed4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 202 len: 0 microversion: 2.1 time: 0.207499 Oct 17 15:45:50.920392 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2231/4706] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:50 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:45:50.931092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:50.931972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:50.947693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:50.948873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:50.953763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:50.954800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:50.955442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:50.956015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:51.360615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:51.373411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:51.377338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:51.381851 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cde163ed-8996-4edb-b83f-04663c03d50e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.460155 Oct 17 15:45:51.388494 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2232/4707] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:45:50 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:45:51.397009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:51.402157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:51.428034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:51.430437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:51.431234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:51.435313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:51.436648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:51.439915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:52.235110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:52.244051 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c66fa264-0d42-405c-b0e0-b21475ca4b85 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1499 microversion: 2.1 time: 0.853342 Oct 17 15:45:52.244920 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2233/4708] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:51 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1499 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:52.439805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:52.440783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:52.476052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:52.482343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:52.484074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:52.485517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:52.489395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:52.491362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:52.661984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:52.716905 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ab28d60-afa4-41b7-9c90-5bb6ba51cd7d tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1317 microversion: 2.1 time: 2.714816 Oct 17 15:45:52.727253 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2476/4709] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:50 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1317 bytes in 2726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:52.866693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:52.882531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:52.884731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:52.885994 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6fc242c2-8e51-4ff8-8d09-94f7cb7674fb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.450404 Oct 17 15:45:52.886588 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2234/4710] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:45:52 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:45:53.281444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:53.288513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:53.310558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:53.312710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:53.315020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:53.317158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:53.320150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:53.321498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:53.762137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:53.764477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:53.784390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:53.784885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:53.785914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:53.787582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:53.788375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:53.789343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:53.974167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:54.025687 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8564bfc6-e613-4ca2-9875-4b52717b138b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.753658 Oct 17 15:45:54.028538 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2477/4711] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:53 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:54.060389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:54.062061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:54.074006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:54.096691 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc630814-8ec3-416f-af88-5248402abec2 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1317 microversion: 2.1 time: 0.346791 Oct 17 15:45:54.098553 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2235/4712] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:53 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:54.108230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:54.109854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:54.121677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:54.123128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:54.124336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:54.125977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:54.127057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:54.127405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:54.127922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:54.128372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:54.128687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:54.129103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:54.129563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:54.130311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:54.547673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:54.605001 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-64bd8eb1-26c3-44dd-8a2c-0d368b2282cf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.504543 Oct 17 15:45:54.632409 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2236/4713] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:54 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:54.656805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:54.659593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:54.686925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:54.687433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:54.687880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:54.688617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:54.689079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:54.717074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:54.789577 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446/action HTTP/1.1 Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 28 Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: {"reboot": {"type": "SOFT"}} Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f8548020-e957-4428-8e54-c34c68c9b446', 'body': {'reboot': {'type': 'SOFT'}}} Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:54.792403 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef75372d-77a1-4fd5-897b-fdbf45ccefd7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446/action" status: 404 len: 111 microversion: 2.1 time: 0.158870 Oct 17 15:45:54.801046 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2237/4714] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:54 2022] POST /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446/action => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:54.805055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:54.805055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:54.824305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:54.824809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:54.825251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:54.825984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:54.826438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:54.827050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:54.871984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:54.900780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:54.905371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:54.917783 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d145a76e-333d-4c3a-a4de-b976e1109f35 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.884716 Oct 17 15:45:54.918485 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2478/4715] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:45:54 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:45:55.167600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:55.172209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:55.199443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:55.202762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:55.203219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:55.203974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:55.204446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:55.204966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:55.209838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:55.429846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:55.469263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:45:55.476334 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f689891c-43ca-4fc5-81c5-494256c2be70 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.676132 Oct 17 15:45:55.519980 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2238/4716] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:54 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:55.555433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-35c6ab03-aa67-4fd2-bf67-ef3fbc659a7f req-79768777-0c05-468d-a87c-498216b6659f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada", "name": "network-vif-plugged", "status": "completed", "tag": "afc8306c-b394-40f8-84af-6cc8d5e9739d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:55.615246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:55.624116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-35c6ab03-aa67-4fd2-bf67-ef3fbc659a7f req-79768777-0c05-468d-a87c-498216b6659f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:55.627745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-35c6ab03-aa67-4fd2-bf67-ef3fbc659a7f req-79768777-0c05-468d-a87c-498216b6659f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:55.629429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-35c6ab03-aa67-4fd2-bf67-ef3fbc659a7f req-79768777-0c05-468d-a87c-498216b6659f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:55.637362 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50077b3e-f6fc-4793-ae74-1dc4cfa1d776 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1317 microversion: 2.1 time: 0.486024 Oct 17 15:45:55.639572 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2479/4717] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:55 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:55.659004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:55.661542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:55.681347 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-35c6ab03-aa67-4fd2-bf67-ef3fbc659a7f req-79768777-0c05-468d-a87c-498216b6659f service nova] Creating event network-vif-plugged:afc8306c-b394-40f8-84af-6cc8d5e9739d for instance 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada on n-h1-854441-12 Oct 17 15:45:55.692791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:55.694349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:55.701516 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-35c6ab03-aa67-4fd2-bf67-ef3fbc659a7f req-79768777-0c05-468d-a87c-498216b6659f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174075 Oct 17 15:45:55.702577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:55.708969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:55.709639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:55.710091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:55.711279 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2239/4718] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:55.986302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:55.995220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:56.010786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:56.012922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:56.014222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:56.016789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:56.017714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:56.018861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:56.181487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:56.198055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36b1ddfa-b45d-4de5-a52d-12837a3a53d4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.553229 Oct 17 15:45:56.216364 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2480/4719] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:55 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:56.227412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d9bc2a0-fe82-4b65-ab01-3d8225d17d20 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:56.230298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6d9bc2a0-fe82-4b65-ab01-3d8225d17d20 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 39cc882d-34c7-4e07-85c4-8c702d03bb84] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:56.251541 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6d9bc2a0-fe82-4b65-ab01-3d8225d17d20 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 39cc882d-34c7-4e07-85c4-8c702d03bb84 could not be found. Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d9bc2a0-fe82-4b65-ab01-3d8225d17d20 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/39cc882d-34c7-4e07-85c4-8c702d03bb84/action HTTP/1.1 Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 28 Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: {"reboot": {"type": "SOFT"}} Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 39cc882d-34c7-4e07-85c4-8c702d03bb84 could not be found. Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '39cc882d-34c7-4e07-85c4-8c702d03bb84', 'body': {'reboot': {'type': 'SOFT'}}} Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39cc882d-34c7-4e07-85c4-8c702d03bb84 could not be found. Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39cc882d-34c7-4e07-85c4-8c702d03bb84 could not be found. Oct 17 15:45:56.253518 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:56.257611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:56.257611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:56.257611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:56.257611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:56.257611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:56.257611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:56.257611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:56.257611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39cc882d-34c7-4e07-85c4-8c702d03bb84 could not be found. Oct 17 15:45:56.257611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:56.260001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6d9bc2a0-fe82-4b65-ab01-3d8225d17d20 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 39cc882d-34c7-4e07-85c4-8c702d03bb84 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:56.261249 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6d9bc2a0-fe82-4b65-ab01-3d8225d17d20 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/39cc882d-34c7-4e07-85c4-8c702d03bb84/action" status: 404 len: 111 microversion: 2.1 time: 0.043824 Oct 17 15:45:56.266292 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2481/4720] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:56 2022] POST /compute/v2.1/servers/39cc882d-34c7-4e07-85c4-8c702d03bb84/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:56.272675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:56.273737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:56.283663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:56.284469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:56.293400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:56.294635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:56.296629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:56.297610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:56.721791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:56.737855 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc1da282-3252-4ee8-ada8-bef093cf3cc1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.469645 Oct 17 15:45:56.739435 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2482/4721] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:56 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:56.753225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:56.755615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:56.772419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:56.773978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:56.775244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:56.777485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:56.778446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:56.779358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:56.839946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:56.865743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:56.869724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:56.872713 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e93d5c11-0e48-4a37-8e64-5c1e5921412f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.896407 Oct 17 15:45:56.888522 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2240/4722] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:45:55 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:45:56.913845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:56.914630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:56.933083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:56.933904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:56.936923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:56.938116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:56.939844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:56.942641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:57.102398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:57.127873 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-496ed6f1-c6f3-4589-bd5f-cb3793073f20 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1317 microversion: 2.1 time: 0.385866 Oct 17 15:45:57.130863 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2483/4723] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:56 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:57.372072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:57.404346 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4b64acb-9723-40f1-919c-464aaf20c022 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.512588 Oct 17 15:45:57.406055 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2241/4724] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:56 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:57.429811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:57.432806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:57.443220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:57.443724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:57.452128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:57.453128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:57.460626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:57.461438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:57.482266 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446/action HTTP/1.1 Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 65 Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'f8548020-e957-4428-8e54-c34c68c9b446', 'body': {'rebuild': {'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d'}}} Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 15:45:57.484671 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:45:57.488581 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:57.491399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:57.492508 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed2a395d-268a-4ced-94d4-68202636a978 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446/action" status: 404 len: 111 microversion: 2.1 time: 0.066921 Oct 17 15:45:57.493621 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2484/4725] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:57 2022] POST /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:57.508912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:57.509619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:57.525677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:57.528960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:57.530577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:57.531313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:57.531792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:57.535302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:57.923938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:57.924642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:57.943448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:57.944307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:57.945413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:57.946065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:57.946702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:57.948138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:57.962322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:58.004777 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0cf8c689-9ce3-4ccd-ab5d-ee8b29490bb4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.496486 Oct 17 15:45:58.006318 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2242/4726] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:57 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:58.061566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:58.071433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:58.095795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.096818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.097914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.099404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.100489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.102331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.286875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:58.307221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:58.310635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:58.312835 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29a937b6-5c4f-46f8-8021-a82528d6d19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.396100 Oct 17 15:45:58.330534 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2485/4727] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:45:57 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:45:58.330534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:58.330534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:58.336791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.337605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.338864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.339404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.340735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.341504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.408457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:58.418879 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2998f237-0a9c-4854-a478-2be2dc932234 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.366508 Oct 17 15:45:58.419921 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2243/4728] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:58 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:58.462296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6742c05e-c2be-4b51-b1aa-99966e4d5e92 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:58.466468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6742c05e-c2be-4b51-b1aa-99966e4d5e92 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f09d7b01-77f5-4bff-b2c5-a62518d70b90] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:58.478040 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-6742c05e-c2be-4b51-b1aa-99966e4d5e92 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance f09d7b01-77f5-4bff-b2c5-a62518d70b90 could not be found. Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6742c05e-c2be-4b51-b1aa-99966e4d5e92 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/f09d7b01-77f5-4bff-b2c5-a62518d70b90/action HTTP/1.1 Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 65 Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f09d7b01-77f5-4bff-b2c5-a62518d70b90 could not be found. Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f09d7b01-77f5-4bff-b2c5-a62518d70b90', 'body': {'rebuild': {'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d'}}} Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09d7b01-77f5-4bff-b2c5-a62518d70b90 could not be found. Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 15:45:58.481983 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09d7b01-77f5-4bff-b2c5-a62518d70b90 could not be found. Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09d7b01-77f5-4bff-b2c5-a62518d70b90 could not be found. Oct 17 15:45:58.489958 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:58.496654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6742c05e-c2be-4b51-b1aa-99966e4d5e92 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance f09d7b01-77f5-4bff-b2c5-a62518d70b90 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:58.498225 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6742c05e-c2be-4b51-b1aa-99966e4d5e92 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/f09d7b01-77f5-4bff-b2c5-a62518d70b90/action" status: 404 len: 111 microversion: 2.1 time: 0.042946 Oct 17 15:45:58.509802 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2244/4729] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:58 2022] POST /compute/v2.1/servers/f09d7b01-77f5-4bff-b2c5-a62518d70b90/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:45:58.520418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:58.520787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:58.540353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.545282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.547324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.549209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.551029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.553460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.627756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:58.637771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3232e152-3ef8-4f84-9f36-ad1bc332099a tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1505 microversion: 2.1 time: 0.321741 Oct 17 15:45:58.670187 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2486/4730] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:58 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:58.679987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8115ad6b-fcfc-476c-8631-836029e2edf1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:58.680528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8115ad6b-fcfc-476c-8631-836029e2edf1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:58.700110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8115ad6b-fcfc-476c-8631-836029e2edf1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.704282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8115ad6b-fcfc-476c-8631-836029e2edf1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.705492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8115ad6b-fcfc-476c-8631-836029e2edf1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.706851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8115ad6b-fcfc-476c-8631-836029e2edf1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.709764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8115ad6b-fcfc-476c-8631-836029e2edf1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.713230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8115ad6b-fcfc-476c-8631-836029e2edf1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.768098 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8115ad6b-fcfc-476c-8631-836029e2edf1 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada/ips" status: 200 len: 108 microversion: 2.1 time: 0.096384 Oct 17 15:45:58.770541 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2487/4731] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:45:58 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada/ips => generated 108 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:58.794596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3219a1c1-4e53-4b49-8549-1b5b98cc91fc tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:58.797293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3219a1c1-4e53-4b49-8549-1b5b98cc91fc tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:58.807026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3219a1c1-4e53-4b49-8549-1b5b98cc91fc tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.807938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3219a1c1-4e53-4b49-8549-1b5b98cc91fc tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.808781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3219a1c1-4e53-4b49-8549-1b5b98cc91fc tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.809791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3219a1c1-4e53-4b49-8549-1b5b98cc91fc tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.810490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3219a1c1-4e53-4b49-8549-1b5b98cc91fc tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.811253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3219a1c1-4e53-4b49-8549-1b5b98cc91fc tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.874263 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3219a1c1-4e53-4b49-8549-1b5b98cc91fc tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada/ips" status: 200 len: 108 microversion: 2.1 time: 0.090388 Oct 17 15:45:58.883336 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2488/4732] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:45:58 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada/ips => generated 108 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:45:58.904775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26601371-196e-4dd6-8b2b-60cac054732b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:58.905325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26601371-196e-4dd6-8b2b-60cac054732b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:58.938897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26601371-196e-4dd6-8b2b-60cac054732b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.939904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26601371-196e-4dd6-8b2b-60cac054732b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.940527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26601371-196e-4dd6-8b2b-60cac054732b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:58.942666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26601371-196e-4dd6-8b2b-60cac054732b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:58.948164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26601371-196e-4dd6-8b2b-60cac054732b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:58.949021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26601371-196e-4dd6-8b2b-60cac054732b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.036170 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26601371-196e-4dd6-8b2b-60cac054732b tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada/ips/tempest-ServerAddressesTestJSON-565273667-network" status: 200 len: 93 microversion: 2.1 time: 0.126803 Oct 17 15:45:59.038106 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2489/4733] 10.222.0.87 () {58 vars in 1398 bytes} [Mon Oct 17 15:45:58 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada/ips/tempest-ServerAddressesTestJSON-565273667-network => generated 93 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:45:59.053527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:59.056036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:59.069701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.072604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.074367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.080590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.081433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.082129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.143475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:45:59.344897 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00641d46-2472-4ec1-b79e-6742f6f58ce7 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "DELETE /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 204 len: 0 microversion: 2.1 time: 0.294867 Oct 17 15:45:59.346604 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2490/4734] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:45:59 2022] DELETE /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:45:59.350110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:59.357058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:59.357845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:59.361345 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-133648c7-bf1a-4f69-a326-26e8efc16188 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.849520 Oct 17 15:45:59.362916 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2245/4735] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:58 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:59.365264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.365897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.366464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.367313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.367802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.368330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.380184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:59.381161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:59.397598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.398614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.401318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.402413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.403317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.404039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.602247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:59.613484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:59.615086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:59.616343 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80c106a4-eb91-4a9a-9ef7-9583c311378d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.268122 Oct 17 15:45:59.616944 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2491/4736] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:45:59 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:45:59.628863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:59.630582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:59.646661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.648090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.650228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.651956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.653061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.654115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.736874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:59.753002 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-179addd2-4b06-4ef4-8c7e-00e92d61adac tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1511 microversion: 2.1 time: 0.384956 Oct 17 15:45:59.754632 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2246/4737] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:59 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1511 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:59.861226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:45:59.872016 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6363712-05f5-4676-a0ae-c49616f581a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.251297 Oct 17 15:45:59.873180 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2492/4738] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:59 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:45:59.896149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-281f084a-acdd-4507-84ac-ecf56ea0e985 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:59.897558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-281f084a-acdd-4507-84ac-ecf56ea0e985 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 5cea395f-8d3a-4eb0-a9dd-71de1523fc88] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:59.904071 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-281f084a-acdd-4507-84ac-ecf56ea0e985 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 5cea395f-8d3a-4eb0-a9dd-71de1523fc88 could not be found. Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-281f084a-acdd-4507-84ac-ecf56ea0e985 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/5cea395f-8d3a-4eb0-a9dd-71de1523fc88/action HTTP/1.1 Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 15 Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: {"restore": {}} Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5cea395f-8d3a-4eb0-a9dd-71de1523fc88 could not be found. Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5cea395f-8d3a-4eb0-a9dd-71de1523fc88', 'body': {'restore': {}}} Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cea395f-8d3a-4eb0-a9dd-71de1523fc88 could not be found. Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cea395f-8d3a-4eb0-a9dd-71de1523fc88 could not be found. Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:59.906218 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:59.910672 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:45:59.910672 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:45:59.910672 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cea395f-8d3a-4eb0-a9dd-71de1523fc88 could not be found. Oct 17 15:45:59.910672 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.912365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-281f084a-acdd-4507-84ac-ecf56ea0e985 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 5cea395f-8d3a-4eb0-a9dd-71de1523fc88 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:59.913518 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-281f084a-acdd-4507-84ac-ecf56ea0e985 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/5cea395f-8d3a-4eb0-a9dd-71de1523fc88/action" status: 404 len: 111 microversion: 2.1 time: 0.021416 Oct 17 15:45:59.915052 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2493/4739] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:45:59 2022] POST /compute/v2.1/servers/5cea395f-8d3a-4eb0-a9dd-71de1523fc88/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:45:59.923754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:45:59.924385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:45:59.933317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.933827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.934269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.935439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:45:59.935908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:45:59.936514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:45:59.966879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-907903cc-7296-4867-a54c-857952a1b04a tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Action: 'create', calling method: .version_select at 0x7f28be063f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-917570645", "metadata": {"Type": "work"}}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-907903cc-7296-4867-a54c-857952a1b04a tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Request method failure captured: Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 121 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXi3rxgX5peLoqHWdnFbln1U0GXck9iQA3W-OtT6U0lcYk5EU5zCRtZ4cFpSnwGxVHlwYLv_uzNjlsvxpAGVwWkegBqwKB_rWObxG9zmy1aaatiO3fpEHPoIRAZUqxB-IqNtS4Q9o95ObEXEeFbXH6Jer3d9r0ATcTVbSg6OZMDofI8 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesNegativeTest-652488807 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesNegativeTest-652488807-project Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 95dc2a048c2945489464b9a4005490ef Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesNegativeTest-652488807-project Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-917570645", "metadata": {"Type": "work"}}} Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-917570645', 'metadata': {'Type': 'work'}}}} Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:45:59.972500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-907903cc-7296-4867-a54c-857952a1b04a tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-907903cc-7296-4867-a54c-857952a1b04a tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.217355 Oct 17 15:45:59.976831 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2247/4740] 10.222.0.87 () {60 vars in 1156 bytes} [Mon Oct 17 15:45:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:45:59.987142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc878c53-da8b-4779-a893-5d01dd589018 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Action: 'create', calling method: .version_select at 0x7f28bdc18160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1255317929", "metadata": {"Type": "work"}}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc878c53-da8b-4779-a893-5d01dd589018 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Request method failure captured: Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 120 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXi3rxgX5peLoqHWdnFbln1U0GXck9iQA3W-OtT6U0lcYk5EU5zCRtZ4cFpSnwGxVHlwYLv_uzNjlsvxpAGVwWkegBqwKB_rWObxG9zmy1aaatiO3fpEHPoIRAZUqxB-IqNtS4Q9o95ObEXEeFbXH6Jer3d9r0ATcTVbSg6OZMDofI8 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesNegativeTest-652488807 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesNegativeTest-652488807-project Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 95dc2a048c2945489464b9a4005490ef Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesNegativeTest-652488807-project Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1255317929", "metadata": {"Type": "work"}}} Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1255317929', 'metadata': {'Type': 'work'}}}} Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '0' Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:45:59.992103 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc878c53-da8b-4779-a893-5d01dd589018 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc878c53-da8b-4779-a893-5d01dd589018 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012400 Oct 17 15:45:59.996187 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2248/4741] 10.222.0.87 () {60 vars in 1156 bytes} [Mon Oct 17 15:45:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 15:46:00.006938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c4e6804e-9856-448a-ad2d-acbf2840d1d2 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Action: 'create', calling method: .version_select at 0x7f28c2df6f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1745784526", "metadata": {"Type": "work"}}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c4e6804e-9856-448a-ad2d-acbf2840d1d2 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Request method failure captured: Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 119 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXi3rxgX5peLoqHWdnFbln1U0GXck9iQA3W-OtT6U0lcYk5EU5zCRtZ4cFpSnwGxVHlwYLv_uzNjlsvxpAGVwWkegBqwKB_rWObxG9zmy1aaatiO3fpEHPoIRAZUqxB-IqNtS4Q9o95ObEXEeFbXH6Jer3d9r0ATcTVbSg6OZMDofI8 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesNegativeTest-652488807-project Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 95dc2a048c2945489464b9a4005490ef Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesNegativeTest-652488807-project Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1745784526", "metadata": {"Type": "work"}}} Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1745784526', 'metadata': {'Type': 'work'}}}} Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '' Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:46:00.011213 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c4e6804e-9856-448a-ad2d-acbf2840d1d2 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:00.015441 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c4e6804e-9856-448a-ad2d-acbf2840d1d2 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010694 Oct 17 15:46:00.019389 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2249/4742] 10.222.0.87 () {60 vars in 1156 bytes} [Mon Oct 17 15:45:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:46:00.032150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b937503-709d-4d30-9391-43b8dbe8cf84 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Calling method '.version_select at 0x7f28be3c9c10>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:00.087916 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-6b937503-709d-4d30-9391-43b8dbe8cf84 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] HTTP exception thrown: Volume tempest-invalid-443185034 could not be found. Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b937503-709d-4d30-9391-43b8dbe8cf84 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Request method failure captured: Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-443185034 HTTP/1.1 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXi3rxgX5peLoqHWdnFbln1U0GXck9iQA3W-OtT6U0lcYk5EU5zCRtZ4cFpSnwGxVHlwYLv_uzNjlsvxpAGVwWkegBqwKB_rWObxG9zmy1aaatiO3fpEHPoIRAZUqxB-IqNtS4Q9o95ObEXEeFbXH6Jer3d9r0ATcTVbSg6OZMDofI8 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesNegativeTest-652488807-project Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 95dc2a048c2945489464b9a4005490ef Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesNegativeTest-652488807-project Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: exception: Volume tempest-invalid-443185034 could not be found. Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'tempest-invalid-443185034'} Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-443185034 could not be found. (HTTP 404) (Request-ID: req-a760c7e0-f186-496d-904e-b9892b9261e5) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:46:00.095432 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-443185034 could not be found. Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-443185034 could not be found. Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-443185034 could not be found. Oct 17 15:46:00.106877 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.120220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b937503-709d-4d30-9391-43b8dbe8cf84 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Returning 404 to user: Volume tempest-invalid-443185034 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:00.120220 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b937503-709d-4d30-9391-43b8dbe8cf84 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/tempest-invalid-443185034" status: 404 len: 98 microversion: 2.1 time: 0.095346 Oct 17 15:46:00.121869 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2250/4743] 10.222.0.87 () {58 vars in 1215 bytes} [Mon Oct 17 15:46:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-443185034 => generated 98 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:46:00.146650 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3cfb5ad-2c5a-40a3-8f23-041069d252cf tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015930 Oct 17 15:46:00.148616 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2251/4744] 10.222.0.87 () {58 vars in 1140 bytes} [Mon Oct 17 15:46:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 17 15:46:00.174469 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d0b2bfba-124c-4eed-b0f8-24ef1f9faee3 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008256 Oct 17 15:46:00.176338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2252/4745] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:46:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 15:46:00.178287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:00.188265 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-75bddcce-f4ea-4b3d-9c37-dd22a1b20a96 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.268840 Oct 17 15:46:00.191008 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2494/4746] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:45:59 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:00.196572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8474161-bf13-49c1-9abe-6a707da6b55a tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Calling method '.version_select at 0x7f28bdc18790>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:00.219314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:00.219981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:00.234876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.238637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.239482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.240750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.243185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.243776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.280319 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e8474161-bf13-49c1-9abe-6a707da6b55a tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] HTTP exception thrown: Volume 0ba31602-56e7-48a4-9cd2-c53e7e7bfe82 could not be found. Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8474161-bf13-49c1-9abe-6a707da6b55a tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Request method failure captured: Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/os-volumes/0ba31602-56e7-48a4-9cd2-c53e7e7bfe82 HTTP/1.1 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXi3rxgX5peLoqHWdnFbln1U0GXck9iQA3W-OtT6U0lcYk5EU5zCRtZ4cFpSnwGxVHlwYLv_uzNjlsvxpAGVwWkegBqwKB_rWObxG9zmy1aaatiO3fpEHPoIRAZUqxB-IqNtS4Q9o95ObEXEeFbXH6Jer3d9r0ATcTVbSg6OZMDofI8 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesNegativeTest-652488807-project Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 95dc2a048c2945489464b9a4005490ef Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesNegativeTest-652488807-project Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: exception: Volume 0ba31602-56e7-48a4-9cd2-c53e7e7bfe82 could not be found. Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '0ba31602-56e7-48a4-9cd2-c53e7e7bfe82'} Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ba31602-56e7-48a4-9cd2-c53e7e7bfe82 could not be found. (HTTP 404) (Request-ID: req-e96eddc1-2587-402a-8a31-1748ebbef996) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 15:46:00.285611 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ba31602-56e7-48a4-9cd2-c53e7e7bfe82 could not be found. Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ba31602-56e7-48a4-9cd2-c53e7e7bfe82 could not be found. Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ba31602-56e7-48a4-9cd2-c53e7e7bfe82 could not be found. Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8474161-bf13-49c1-9abe-6a707da6b55a tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Returning 404 to user: Volume 0ba31602-56e7-48a4-9cd2-c53e7e7bfe82 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e8474161-bf13-49c1-9abe-6a707da6b55a tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/0ba31602-56e7-48a4-9cd2-c53e7e7bfe82" status: 404 len: 109 microversion: 2.1 time: 0.099638 Oct 17 15:46:00.299563 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2253/4747] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:46:00 2022] DELETE /compute/v2.1/os-volumes/0ba31602-56e7-48a4-9cd2-c53e7e7bfe82 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:46:00.313251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e5057d01-1cc1-49b2-a665-aef22544fe03 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Calling method '.version_select at 0x7f28bdc48af0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:00.385228 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e5057d01-1cc1-49b2-a665-aef22544fe03 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] HTTP exception thrown: Volume 4189301b-2e37-4a0b-a165-d926f6f2a148 could not be found. Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e5057d01-1cc1-49b2-a665-aef22544fe03 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Request method failure captured: Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-volumes/4189301b-2e37-4a0b-a165-d926f6f2a148 HTTP/1.1 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXi3rxgX5peLoqHWdnFbln1U0GXck9iQA3W-OtT6U0lcYk5EU5zCRtZ4cFpSnwGxVHlwYLv_uzNjlsvxpAGVwWkegBqwKB_rWObxG9zmy1aaatiO3fpEHPoIRAZUqxB-IqNtS4Q9o95ObEXEeFbXH6Jer3d9r0ATcTVbSg6OZMDofI8 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0c722ccdfaf744e1a6a26edd39bc0714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 0c722ccdfaf744e1a6a26edd39bc0714 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesNegativeTest-652488807 Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesNegativeTest-652488807-project Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 95dc2a048c2945489464b9a4005490ef Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesNegativeTest-652488807-project Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: exception: Volume 4189301b-2e37-4a0b-a165-d926f6f2a148 could not be found. Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '4189301b-2e37-4a0b-a165-d926f6f2a148'} Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4189301b-2e37-4a0b-a165-d926f6f2a148 could not be found. (HTTP 404) (Request-ID: req-f297a81c-6cb5-4311-90ce-664ae97c13c8) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 15:46:00.389636 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4189301b-2e37-4a0b-a165-d926f6f2a148 could not be found. Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4189301b-2e37-4a0b-a165-d926f6f2a148 could not be found. Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4189301b-2e37-4a0b-a165-d926f6f2a148 could not be found. Oct 17 15:46:00.394313 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.399172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e5057d01-1cc1-49b2-a665-aef22544fe03 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] Returning 404 to user: Volume 4189301b-2e37-4a0b-a165-d926f6f2a148 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:00.400381 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e5057d01-1cc1-49b2-a665-aef22544fe03 tempest-VolumesNegativeTest-652488807 tempest-VolumesNegativeTest-652488807-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/4189301b-2e37-4a0b-a165-d926f6f2a148" status: 404 len: 109 microversion: 2.1 time: 0.092863 Oct 17 15:46:00.409830 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2254/4748] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:46:00 2022] GET /compute/v2.1/os-volumes/4189301b-2e37-4a0b-a165-d926f6f2a148 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:46:00.592949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:00.622686 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ddfb4e2-966b-42bd-a15f-a35a7f132fce tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.407048 Oct 17 15:46:00.625677 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2495/4749] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:00 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:00.659369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:00.660283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:00.666628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:00.667701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:00.668690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.669365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.669978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.670932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.671604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.672261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.675162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.675730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.676305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.677401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.679252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.679875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.712870 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Cannot 'restore' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action HTTP/1.1 Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 15 Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: {"restore": {}} Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'restore' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d', 'body': {'restore': {}}} Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d in vm_state active. Cannot restore while the instance is in this state. Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:00.714779 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:00.719436 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:00.719436 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:46:00.719436 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:46:00.719436 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:46:00.719436 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:00.721246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 409 to user: Cannot 'restore' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:00.722138 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37201e69-9805-4c9d-bfd9-bfa357192ad2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 409 len: 145 microversion: 2.1 time: 0.060017 Oct 17 15:46:00.722767 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2496/4750] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:46:00 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 145 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:46:00.732973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:00.733623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:00.740304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.741131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.741571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.742326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.742865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.743294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.918709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:00.928242 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7964c845-7491-4449-8e39-bf744f8a04dc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.199081 Oct 17 15:46:00.929148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2497/4751] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:00 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:00.953863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:00.955967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:00.967893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.968522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.969048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.969954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:00.970411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:00.970950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:00.975748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:01.280079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:01.295421 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-286c9a32-bfa7-47c1-941a-12576a34af31 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1511 microversion: 2.1 time: 0.352188 Oct 17 15:46:01.296142 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2498/4752] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:00 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:01.301630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:01.302280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:01.317367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:01.325497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:01.326079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:01.327451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:01.328124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:01.328593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:01.329032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:01.332716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:01.341204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:01.342869 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-218f3069-882b-46ef-8325-5ca1fc53e2cb tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.687442 Oct 17 15:46:01.344106 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2255/4753] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:00 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:01.910635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:01.928403 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b9c55b9-1939-47d7-98ad-fee930740813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.630672 Oct 17 15:46:01.942962 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2499/4754] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:01 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:01.968991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-96d62e30-04c4-4fe1-8bba-666a57753d47 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:01.969821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-96d62e30-04c4-4fe1-8bba-666a57753d47 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 5f09efb2-c961-48f1-8631-6cdfd9f3b980] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:01.976968 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-96d62e30-04c4-4fe1-8bba-666a57753d47 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 5f09efb2-c961-48f1-8631-6cdfd9f3b980 could not be found. Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-96d62e30-04c4-4fe1-8bba-666a57753d47 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/5f09efb2-c961-48f1-8631-6cdfd9f3b980/action HTTP/1.1 Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 14 Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: {"resume": {}} Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 5f09efb2-c961-48f1-8631-6cdfd9f3b980 could not be found. Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '5f09efb2-c961-48f1-8631-6cdfd9f3b980', 'body': {'resume': {}}} Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f09efb2-c961-48f1-8631-6cdfd9f3b980 could not be found. Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f09efb2-c961-48f1-8631-6cdfd9f3b980 could not be found. Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:01.981751 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:01.985735 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:46:01.985735 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:46:01.985735 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f09efb2-c961-48f1-8631-6cdfd9f3b980 could not be found. Oct 17 15:46:01.985735 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:01.988057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-96d62e30-04c4-4fe1-8bba-666a57753d47 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 5f09efb2-c961-48f1-8631-6cdfd9f3b980 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:01.989700 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-96d62e30-04c4-4fe1-8bba-666a57753d47 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/5f09efb2-c961-48f1-8631-6cdfd9f3b980/action" status: 404 len: 111 microversion: 2.1 time: 0.024619 Oct 17 15:46:01.990943 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2256/4755] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:46:01 2022] POST /compute/v2.1/servers/5f09efb2-c961-48f1-8631-6cdfd9f3b980/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:46:02.006692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:02.007880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:02.019860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:02.021674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:02.023681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:02.025627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:02.027405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:02.028788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:02.331984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:02.335114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:02.357798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:02.371955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:02.376935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:02.377411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:02.377902 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ed947f2-c518-4f7d-89dd-d56f88d0c6ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.379256 Oct 17 15:46:02.387831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:02.388357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:02.388823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:02.391560 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2500/4756] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:01 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:02.400206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b260c6d8-be37-4367-957c-c8e7205faf90 req-4ce36ccf-bacc-46b7-83a7-804c9c1d0974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada", "name": "network-vif-deleted", "tag": "afc8306c-b394-40f8-84af-6cc8d5e9739d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:02.440556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b260c6d8-be37-4367-957c-c8e7205faf90 req-4ce36ccf-bacc-46b7-83a7-804c9c1d0974 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:02.441542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b260c6d8-be37-4367-957c-c8e7205faf90 req-4ce36ccf-bacc-46b7-83a7-804c9c1d0974 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:02.443700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b260c6d8-be37-4367-957c-c8e7205faf90 req-4ce36ccf-bacc-46b7-83a7-804c9c1d0974 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:02.478030 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b260c6d8-be37-4367-957c-c8e7205faf90 req-4ce36ccf-bacc-46b7-83a7-804c9c1d0974 service nova] Creating event network-vif-deleted:afc8306c-b394-40f8-84af-6cc8d5e9739d for instance 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada on n-h1-854441-12 Oct 17 15:46:02.490964 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b260c6d8-be37-4367-957c-c8e7205faf90 req-4ce36ccf-bacc-46b7-83a7-804c9c1d0974 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096647 Oct 17 15:46:02.493313 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2501/4757] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:46:02.539365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:02.542777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:02.560285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:02.561621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:02.562850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:02.564946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:02.566377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:02.567495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:02.627518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab805d33d2040ad8bf56bc2702578d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27c9ec358df4b96b4819570ac75f722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:02.637304 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a5d5e59-9837-402d-94c4-7809bd0d66b6 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 200 len: 1469 microversion: 2.1 time: 0.320237 Oct 17 15:46:02.651067 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2257/4758] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:02 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 1469 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:02.658886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:02.669921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:02.698551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:02.703339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:02.703806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:02.704573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:02.705044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:02.705485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:03.289521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:03.301731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:03.309998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:03.311941 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df229463-07e5-4909-9f6a-69331228bdae tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.815875 Oct 17 15:46:03.315506 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2502/4759] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:02 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:03.452256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:03.461841 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-871c4858-e5c1-492f-9d68-144e0df46c81 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.809399 Oct 17 15:46:03.468012 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2258/4760] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:02 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:03.516477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:03.518993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:03.552180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:03.553809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:03.577477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:03.587575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:03.590915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:03.595082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:03.680435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:03.681857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] [instance: 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:03.736597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:03.738924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:03.741327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:03.751715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:03.758154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:03.760938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:03.769678 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Cannot 'resume' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action HTTP/1.1 Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 14 Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: {"resume": {}} Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'resume' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d', 'body': {'resume': {}}} Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d in vm_state active. Cannot resume while the instance is in this state. Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:03.778846 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 409 to user: Cannot 'resume' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c376d165-9f3e-42b7-b87a-0d08707a0190 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 409 len: 144 microversion: 2.1 time: 0.277910 Oct 17 15:46:03.789546 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2503/4761] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:46:03 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 144 bytes in 283 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:46:03.801776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:03.802473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:03.817971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:03.818479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:03.818956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:03.823525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:03.824228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:03.827956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:03.854451 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] HTTP exception thrown: Instance 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada could not be found. Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Request method failure captured: Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada HTTP/1.1 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXibRV2SAvqRlKFws8bb7Wof1YEwOZShYuOU6ENdpisWJF4Rch4yEwsAPOVbYWwfgqVkmSgTmqDOAFaNzqytbJl6nE-yT_cb0N-h0LY4MNOGrzvdDRF0LeeeVTgwcaQvtP6f1tzELpbXPXr399oQMp2oyS6zFLNV7-QPSEXRJtRrmmI Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: c27c9ec358df4b96b4819570ac75f722 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerAddressesTestJSON-1501485905 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c27c9ec358df4b96b4819570ac75f722"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/c27c9ec358df4b96b4819570ac75f722"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_c27c9ec358df4b96b4819570ac75f722"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/c27c9ec358df4b96b4819570ac75f722"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerAddressesTestJSON-1501485905 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: c27c9ec358df4b96b4819570ac75f722 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1501485905 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerAddressesTestJSON-1501485905-project Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8ab805d33d2040ad8bf56bc2702578d4 Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerAddressesTestJSON-1501485905-project Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada could not be found. Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada'} Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada could not be found. Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada could not be found. Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:03.858637 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.867462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:03.867462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:03.867462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:03.867462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:46:03.867462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:46:03.867462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada could not be found. Oct 17 15:46:03.867462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:03.880587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] Returning 404 to user: Instance 44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:03.882860 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-057cdf6e-f633-4b58-90d0-c73619f7b512 tempest-ServerAddressesTestJSON-1501485905 tempest-ServerAddressesTestJSON-1501485905-project] 10.222.0.87 "GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada" status: 404 len: 111 microversion: 2.1 time: 0.220668 Oct 17 15:46:03.890442 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2259/4762] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:03 2022] GET /compute/v2.1/servers/44ee7e5f-d54c-4fa3-ac71-723fe9ce3ada => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:46:04.200311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:04.225697 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ed7d10e-bf9c-40b4-9ae1-8ae76c8d7bdb tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.431225 Oct 17 15:46:04.229975 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2504/4763] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:03 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:04.279038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:04.280479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:04.293208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:04.294663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:04.295806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:04.297535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:04.298818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:04.299871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:04.377732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:04.382426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:04.407616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:04.410392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:04.413563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:04.417887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:04.419393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:04.421313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:04.841709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:04.851887 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8cd22244-b151-4c30-880e-841ac1f98b8d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.580549 Oct 17 15:46:04.852490 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2260/4764] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:04 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:05.135522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:05.150476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:05.155156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:05.159478 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-910acf0e-d31e-43d8-af0e-67909fc05e08 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.796754 Oct 17 15:46:05.162323 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2505/4765] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:04 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:46:05.191340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8b8d276-a866-4872-be3a-d15ec5fc6e5c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8b8d276-a866-4872-be3a-d15ec5fc6e5c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 160 Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "3d2dceb7-fa1f-47b7-a54c-dede4194eb86"}]}} Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c489ef08-d3af-4c49-859b-7a55ed37ba8d', 'flavorRef': '452', 'networks': [{'uuid': '3d2dceb7-fa1f-47b7-a54c-dede4194eb86'}]}}} Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '' Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:46:05.204651 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8b8d276-a866-4872-be3a-d15ec5fc6e5c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d8b8d276-a866-4872-be3a-d15ec5fc6e5c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.027632 Oct 17 15:46:05.219376 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2261/4766] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:46:05 2022] POST /compute/v2.1/servers => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:46:05.224808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:05.225488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:05.245875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:05.247958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:05.250922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:05.252038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:05.255842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:05.261254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:06.218015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:06.225697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:06.275182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:06.276470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:06.280057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:06.287447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:06.293986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:06.294812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:07.043274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:07.079062 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c994f7cb-8d01-4898-adf8-8b1f6151fac1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 1.859595 Oct 17 15:46:07.100133 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2506/4767] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:05 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:07.145433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:07.153251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:07.186421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:07.191962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:07.199666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:07.202035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:07.211464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:07.213941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:07.250541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:07.274410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:07.286476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:07.288016 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d7c91ae-3054-4cff-a116-bfa6e9e7e17c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 1.083758 Oct 17 15:46:07.302985 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2262/4768] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:06 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:08.257488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:08.295416 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd0de8eb-e809-4e7c-a6a1-01fe9ac12439 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 1.167730 Oct 17 15:46:08.301933 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2507/4769] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:07 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:08.340317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:08.344950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-13038c91-b3a3-4408-bde0-612933729f43 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:08.346733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:08.349689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-13038c91-b3a3-4408-bde0-612933729f43 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 0cbe740a-c9ad-4bb6-8e1b-98588b050c44] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:08.384664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:08.386737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:08.387508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:08.389715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:08.391680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:08.392494 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-13038c91-b3a3-4408-bde0-612933729f43 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 0cbe740a-c9ad-4bb6-8e1b-98588b050c44 could not be found. Oct 17 15:46:08.396950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-13038c91-b3a3-4408-bde0-612933729f43 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/0cbe740a-c9ad-4bb6-8e1b-98588b050c44/action HTTP/1.1 Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 14 Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: {"shelve": {}} Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 0cbe740a-c9ad-4bb6-8e1b-98588b050c44 could not be found. Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '0cbe740a-c9ad-4bb6-8e1b-98588b050c44', 'body': {'shelve': {}}} Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cbe740a-c9ad-4bb6-8e1b-98588b050c44 could not be found. Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cbe740a-c9ad-4bb6-8e1b-98588b050c44 could not be found. Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:08.421235 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:08.427715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:46:08.427715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:46:08.427715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cbe740a-c9ad-4bb6-8e1b-98588b050c44 could not be found. Oct 17 15:46:08.427715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:46:08.427715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-13038c91-b3a3-4408-bde0-612933729f43 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 0cbe740a-c9ad-4bb6-8e1b-98588b050c44 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:08.434356 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-13038c91-b3a3-4408-bde0-612933729f43 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/0cbe740a-c9ad-4bb6-8e1b-98588b050c44/action" status: 404 len: 111 microversion: 2.1 time: 0.099692 Oct 17 15:46:08.439880 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2263/4770] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:46:08 2022] POST /compute/v2.1/servers/0cbe740a-c9ad-4bb6-8e1b-98588b050c44/action => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:46:08.484722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:08.511262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:08.575522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:08.576413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:08.577188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:08.578480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:08.627385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.045s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:08.634394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:09.486651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:09.504402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:09.514158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:09.520878 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6dcb9e78-ec72-4c2c-aa1a-52a1a8b9f41a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 1.184523 Oct 17 15:46:09.538536 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2508/4771] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:08 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:10.605957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:10.615804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:10.643968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:10.646165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:10.651573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:10.653845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:10.664640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:10.665354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:11.082992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:11.112965 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97f5a3f1-97f4-4845-9a88-3ec05ef95da2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 2.644130 Oct 17 15:46:11.116812 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2264/4772] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:08 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:11.151102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:11.153254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:11.172580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:11.173248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:11.174194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:11.175030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:11.175507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:11.175939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:11.664024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:11.677502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:11.679283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:11.682360 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02570961-1e39-41fc-9f33-0f1a4e6ba32c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 1.112059 Oct 17 15:46:11.683417 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2509/4773] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:10 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:11.692272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8defd45-7a04-42d4-8b52-d52a15bf40a6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Action: 'create', calling method: .version_select at 0x7f28bed1d0d0>, body: {"keypair": {"name": "tempest-keypair-2056605329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP98Yi5PqXP8VtV4sy4ezVIhII2t3LZ8ONuxC3YjBOJj76quT/8rU98kCQhnC0YMejB3vxF9lGxgZV6eEIEkhKDAZ4ZhM2lpRMML5XFrHF1Y7WU8hMXlvJ4lf5/X0AyjSw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:11.722468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a8defd45-7a04-42d4-8b52-d52a15bf40a6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Getting quotas for project 4704af8d692b4d1c8b5c77de7b7a8c5b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:46:11.734417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-a8defd45-7a04-42d4-8b52-d52a15bf40a6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Getting quotas for user a1931a1c3ed04b77ac11e19e74944f4e and project 4704af8d692b4d1c8b5c77de7b7a8c5b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:46:11.775276 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8defd45-7a04-42d4-8b52-d52a15bf40a6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.087752 Oct 17 15:46:11.776508 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2510/4774] 10.222.0.87 () {62 vars in 1200 bytes} [Mon Oct 17 15:46:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 15:46:12.505531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:12.535347 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cfa1e918-aa8e-4a25-ae2d-00e6f4e92492 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 1.391694 Oct 17 15:46:12.536417 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2265/4775] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:11 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:12.564094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:12.576455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:12.590777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:12.592280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:12.594840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:12.597576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:12.598083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:12.598586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:12.687945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lazy-loading 'flavor' on Instance uuid 6f06aaa4-9003-4c2b-93f2-58dffe88714d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:46:12.735887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:12.737039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:12.769945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:12.797396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:12.799639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:12.800461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:12.801064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:12.801649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:13.117831 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e832a735-4566-4660-a63b-c841419d32a4 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 202 len: 0 microversion: 2.1 time: 0.557800 Oct 17 15:46:13.126260 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2511/4776] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:46:12 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:46:13.134262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:13.136710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:13.146957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:13.149507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:13.151031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:13.152568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:13.154980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:13.155763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:13.754548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:13.770118 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c503dd4-ee03-457d-9ad7-97409ef01fe0 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.641991 Oct 17 15:46:13.770961 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2512/4777] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:13 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:13.964834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:13.984801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:13.991343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:13.992937 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9d755914-a577-4f6d-8824-53e7a850fa7a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1744 microversion: 2.20 time: 1.266745 Oct 17 15:46:14.000351 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2266/4778] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:12 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1744 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:14.799339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:14.801206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:14.817382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:14.827080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:14.828093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:14.829621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:14.838793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:14.843190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:14.844244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:15.356016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:15.382609 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7505fa8-6b29-4150-9047-c4223f2c6209 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.588402 Oct 17 15:46:15.395645 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2513/4779] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:14 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:15.424497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:15.430438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:15.468134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1689635725", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:15.472661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:15.477205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:15.479076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:15.483571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:15.484840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:15.489478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:15.782515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] validate_networks() for [('fece443f-d643-4ff2-8212-7b146139b48c', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:46:15.873925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:15.878113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:15.898446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:15.903424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:15.906214 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9278a06d-09f2-462d-bc11-039de4b25330 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.507144 Oct 17 15:46:15.907580 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2514/4780] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:15 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:16.421302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:16.421918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:16.441266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:16.442691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:16.443488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:16.444612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:16.445538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:16.446249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:16.886158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:16.906419 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98ff7e5c-9f03-416f-9e39-1fe51f230128 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.482073 Oct 17 15:46:16.907888 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2515/4781] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:16 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:16.959144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:16.961097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:16.978490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:16.985222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:16.985681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:16.989814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:16.995480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:16.999902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:17.644870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:17.656528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:17.660127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:17.662338 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7192f00a-d396-43fe-a231-6351dd133be6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.711028 Oct 17 15:46:17.683764 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2516/4782] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:16 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:17.954774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:17.955477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:17.972381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:17.972910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:17.973349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:17.974154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:17.974666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:17.984639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:18.319627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:18.329639 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35fa4a67-464e-4da5-ae73-6e775cd67502 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.378818 Oct 17 15:46:18.332844 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2517/4783] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:17 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:18.437101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:46:18.437566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:46:18.439229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:46:18.439960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:46:18.440609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:46:18.452113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=60 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:18.462560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:18.463386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:18.464110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:18.465088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:18.466467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:18.467526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:18.498553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Getting quotas for project 081813733e79419a80f777371c76725d. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:46:18.522307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Getting quotas for user 30d6823a721a4bbe8cde326981d14e3a and project 081813733e79419a80f777371c76725d. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:46:18.590223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:46:18.601153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:46:18.693180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:18.694222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:18.709410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:18.710447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:18.711158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:18.715714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:18.720475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:18.721591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:18.753872 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-241ab897-933a-4151-9f63-87ac51ab8965 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.746735 Oct 17 15:46:18.761279 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2267/4784] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:46:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:46:18.818903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba8bd398-b3af-406a-817b-0d0679b6c0b3 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:18.825050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba8bd398-b3af-406a-817b-0d0679b6c0b3 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:19.095527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:19.108101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:19.110139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:19.112497 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8fa3c09a-18bb-4df1-8eb8-a225f7222827 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.423259 Oct 17 15:46:19.113747 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2518/4785] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:18 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:19.382538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:19.383602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:19.398925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:19.409732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:19.411618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:19.412612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:19.419237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:19.421973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:20.193772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:20.239910 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-673603c7-e9d8-4f43-bcdc-3b77cefc4964 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.862006 Oct 17 15:46:20.260087 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2519/4786] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:19 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:20.320606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:20.330485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:20.358843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:20.359907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:20.360957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:20.362530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:20.366675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:20.367893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:20.401407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba8bd398-b3af-406a-817b-0d0679b6c0b3 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:20.428068 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba8bd398-b3af-406a-817b-0d0679b6c0b3 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1223 microversion: 2.1 time: 1.657741 Oct 17 15:46:20.429017 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2268/4787] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:18 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1223 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:21.052924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:21.070770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:21.078094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:21.081154 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b4bdde13-6897-4479-8108-72d547abceea tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.799119 Oct 17 15:46:21.082779 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2520/4788] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:20 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:21.118714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1389117646", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "90427bc3-1769-45ee-810a-343dd895e5cd"}, {"port": "ced7f9e8-794b-4f8d-96e3-2e670ce44545", "tag": "port-1"}, {"port": "0f279a23-da10-436b-938e-d8af8305e6bd", "tag": "port-2"}, {"uuid": "3750d55f-c74d-41e1-bc93-80744780fb2c", "tag": "net-1"}, {"uuid": "3750d55f-c74d-41e1-bc93-80744780fb2c"}, {"uuid": "9802f6d6-963e-4d0d-864f-5ea49044e0c9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9802f6d6-963e-4d0d-864f-5ea49044e0c9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e0c4f065-3212-41a8-bc94-38d016a329de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "955f5140-7571-4471-8366-846e179aa1c5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e4448148-0383-4d94-b514-64c0b232578e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--596308649"}], "key_name": "tempest-keypair-2056605329", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:21.293086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:21.293086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:21.307463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:21.309076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:21.310844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:21.313387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:21.314414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:21.316900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:21.744526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:21.796512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:21.812553 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac809333-c13b-446c-b47b-e5c64791426d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.524704 Oct 17 15:46:21.815181 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2521/4789] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:21 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:21.825536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:21.831003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:21.852137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:21.861251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:21.862189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:21.863329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:21.864072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:21.868664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:22.031448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:22.043564 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fa179b4-1ecb-4ae9-b52b-25c61cddb156 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1293 microversion: 2.1 time: 0.224739 Oct 17 15:46:22.044479 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2522/4790] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:21 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1293 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:22.075146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] validate_networks() for [('90427bc3-1769-45ee-810a-343dd895e5cd', None, None, None, None, None), (None, None, 'ced7f9e8-794b-4f8d-96e3-2e670ce44545', None, None, None), (None, None, '0f279a23-da10-436b-938e-d8af8305e6bd', None, None, None), ('3750d55f-c74d-41e1-bc93-80744780fb2c', None, None, None, None, None), ('3750d55f-c74d-41e1-bc93-80744780fb2c', None, None, None, None, None), ('9802f6d6-963e-4d0d-864f-5ea49044e0c9', '10.2.2.100', None, None, None, None), ('9802f6d6-963e-4d0d-864f-5ea49044e0c9', '10.2.2.200', None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:46:22.120468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:22.121425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:22.135247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:22.136229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:22.138684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:22.142060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:22.144208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:22.144997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:22.407367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:22.421745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:22.424087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:22.425986 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff82a65a-9284-44fd-8954-19daeacf851f tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.309828 Oct 17 15:46:22.427377 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2523/4791] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:22 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:22.856350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:22.856992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:22.877013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:22.877013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:22.877013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:22.884264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:22.885240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:22.885851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:23.979952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:24.002940 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-870a1018-2719-4592-9b9d-91d0d4e8881d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 1.148720 Oct 17 15:46:24.004552 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2524/4792] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:22 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:24.014002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63571599-767d-4f10-9f1b-2520528bcc91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:24.019398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63571599-767d-4f10-9f1b-2520528bcc91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:24.030141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63571599-767d-4f10-9f1b-2520528bcc91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:24.031961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63571599-767d-4f10-9f1b-2520528bcc91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:24.033309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63571599-767d-4f10-9f1b-2520528bcc91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:24.034590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63571599-767d-4f10-9f1b-2520528bcc91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:24.035571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63571599-767d-4f10-9f1b-2520528bcc91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:24.036331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63571599-767d-4f10-9f1b-2520528bcc91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:24.113028 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63571599-767d-4f10-9f1b-2520528bcc91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106662 Oct 17 15:46:24.121679 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2525/4793] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:46:24 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:46:24.138304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:24.139664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:24.148132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:24.149215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:24.149943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:24.152502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:24.153319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:24.154114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:24.290213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:24.307957 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5983b8a4-d0cb-4718-915e-4185592ac6ca tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1281 microversion: 2.1 time: 0.184732 Oct 17 15:46:24.318303 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2526/4794] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:24 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:24.324685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:24.325679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:24.341900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:24.343043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:24.343830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:24.344893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:24.347946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:24.348799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:25.173663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:25.219573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:25.224063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:25.227680 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ff49f44-e56e-4623-98d3-1e059bbafb7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.907286 Oct 17 15:46:25.229577 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2527/4795] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:24 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:25.238730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c53eb40c-ac68-408e-9872-bf25d75b7637 req-ae28a6d9-c64b-4f89-bac5-e5f4329b0074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781ce8e0-1ad0-4713-ac95-2abac4f7a1d7", "name": "network-vif-plugged", "status": "completed", "tag": "e23fd663-fe28-4bf5-ae5b-5433ac887247"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:25.295928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c53eb40c-ac68-408e-9872-bf25d75b7637 req-ae28a6d9-c64b-4f89-bac5-e5f4329b0074 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:25.301436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c53eb40c-ac68-408e-9872-bf25d75b7637 req-ae28a6d9-c64b-4f89-bac5-e5f4329b0074 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:25.302369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c53eb40c-ac68-408e-9872-bf25d75b7637 req-ae28a6d9-c64b-4f89-bac5-e5f4329b0074 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:25.355346 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c53eb40c-ac68-408e-9872-bf25d75b7637 req-ae28a6d9-c64b-4f89-bac5-e5f4329b0074 service nova] Creating event network-vif-plugged:e23fd663-fe28-4bf5-ae5b-5433ac887247 for instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 on n-h2-854441-12 Oct 17 15:46:25.376542 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c53eb40c-ac68-408e-9872-bf25d75b7637 req-ae28a6d9-c64b-4f89-bac5-e5f4329b0074 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144446 Oct 17 15:46:25.380176 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2528/4796] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:46:25.410560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:25.417966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:25.446801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:25.462126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:25.465099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:25.483628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:25.484839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:25.485850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:25.624856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:46:25.811705 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-465535df-23d1-439c-be6b-4e1a2651faf9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "DELETE /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 204 len: 0 microversion: 2.1 time: 0.424948 Oct 17 15:46:25.815199 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2529/4797] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:46:25 2022] DELETE /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:46:25.834094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:25.837756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:25.858063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:25.859237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:25.861775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:25.867018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:25.868776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:25.870600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:25.974334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:26.713693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:26.756745 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39d041c1-b8d2-4933-9376-f2dda0a2bc00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1534 microversion: 2.1 time: 0.933600 Oct 17 15:46:26.758789 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2530/4798] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:25 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1534 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:26.774125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:26.782617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:26.812751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:26.813597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:26.814368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:26.819495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:26.820359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:26.821183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:27.538688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:27.551107 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34849a12-2156-496e-b2a4-ed6e5337d36c tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1323 microversion: 2.1 time: 0.790344 Oct 17 15:46:27.567298 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2531/4799] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:26 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1323 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:27.605747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:27.606908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:27.646764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:27.648040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:27.651079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:27.652161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:27.652908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:27.660976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:28.063522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:28.105988 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3adaaa55-e805-4025-bcc7-4578d131c79f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1673 microversion: 2.1 time: 0.537262 Oct 17 15:46:28.109776 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2532/4800] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:27 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1673 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:28.129346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:28.136265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:28.163099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:28.169352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:28.170320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:28.178705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:28.180028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:28.181109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:28.483721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:28.486242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=91 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:28.882162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:28.904850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:28.922802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:28.925102 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40dead8b-b2f6-45ec-a201-722672e52573 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.806437 Oct 17 15:46:28.939299 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2533/4801] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:28 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:28.945742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:28.952020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:28.984214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:28.988937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:28.994070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:29.005268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:29.010619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:29.014166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:30.413848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:31.276630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:31.305251 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07b7c399-bf13-4673-a07e-cc160f7c537d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 2.362582 Oct 17 15:46:31.314232 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2534/4802] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:28 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 2374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:31.319581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:31.320254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:31.353300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:31.353792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:31.354242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:31.356024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:31.356511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:31.356938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:32.576989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:32.598096 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eea8c9bc-f401-4d8d-b84a-1d9da29ccfc5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1323 microversion: 2.1 time: 1.282270 Oct 17 15:46:32.604796 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2535/4803] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:31 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1323 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:32.636655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:32.645978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:32.679802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:32.680380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:32.680770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:32.681559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:32.682058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:32.682536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:33.001941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:33.015647 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f5ca841-83f2-4de4-87cc-c726f00d45a1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 200 len: 1606 microversion: 2.1 time: 0.407400 Oct 17 15:46:33.016278 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2536/4804] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:32 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 1606 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:33.055234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-13e61393-7fde-4709-b6a9-3e1fbb854f12 req-ef9aa8d7-c03e-44f6-aaea-106d4f357c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f06aaa4-9003-4c2b-93f2-58dffe88714d", "name": "network-vif-plugged", "status": "completed", "tag": "266c890a-8733-4318-9e57-c80fb316ccdb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:33.090569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-13e61393-7fde-4709-b6a9-3e1fbb854f12 req-ef9aa8d7-c03e-44f6-aaea-106d4f357c37 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:33.091275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-13e61393-7fde-4709-b6a9-3e1fbb854f12 req-ef9aa8d7-c03e-44f6-aaea-106d4f357c37 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:33.093869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-13e61393-7fde-4709-b6a9-3e1fbb854f12 req-ef9aa8d7-c03e-44f6-aaea-106d4f357c37 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:33.121899 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-13e61393-7fde-4709-b6a9-3e1fbb854f12 req-ef9aa8d7-c03e-44f6-aaea-106d4f357c37 service nova] Creating event network-vif-plugged:266c890a-8733-4318-9e57-c80fb316ccdb for instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d on n-h2-854441-12 Oct 17 15:46:33.151423 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-13e61393-7fde-4709-b6a9-3e1fbb854f12 req-ef9aa8d7-c03e-44f6-aaea-106d4f357c37 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108567 Oct 17 15:46:33.154539 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2537/4805] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:46:33.171111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:33.175090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:33.191955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:33.197333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:33.198212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:33.201945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:33.202886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:33.208167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:33.613854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:33.662466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:33.678228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:33.689889 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8c6f4e8-f430-4c01-81d9-0688e0291b24 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.523404 Oct 17 15:46:33.716870 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2538/4806] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:33 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:33.733436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:33.735567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:33.749441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:33.750587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:33.752126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:33.753682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:33.754434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:33.755430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:34.683834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:34.704493 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af96127c-1097-408b-b81b-9b954df3fd5d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 0.981062 Oct 17 15:46:34.708179 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2539/4807] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:33 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:34.755035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f1e5c003-d904-465f-9a90-e8c2ad19ba6a req-b2da2cf2-73eb-4c1e-bbd2-db1a5a8ec65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384c7b-4321-4acd-831e-a1420246c794", "tag": "38a668b2-11af-470e-8ba9-5d4f822fcfd0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:34.797097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f1e5c003-d904-465f-9a90-e8c2ad19ba6a req-b2da2cf2-73eb-4c1e-bbd2-db1a5a8ec65b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:34.813873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f1e5c003-d904-465f-9a90-e8c2ad19ba6a req-b2da2cf2-73eb-4c1e-bbd2-db1a5a8ec65b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:34.815052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f1e5c003-d904-465f-9a90-e8c2ad19ba6a req-b2da2cf2-73eb-4c1e-bbd2-db1a5a8ec65b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:34.848269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:46:34.849751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:46:34.850671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:46:34.851402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:46:34.852061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:46:34.859465 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f1e5c003-d904-465f-9a90-e8c2ad19ba6a req-b2da2cf2-73eb-4c1e-bbd2-db1a5a8ec65b service nova] Creating event network-changed:38a668b2-11af-470e-8ba9-5d4f822fcfd0 for instance 5b384c7b-4321-4acd-831e-a1420246c794 on n-h1-854441-12 Oct 17 15:46:34.885713 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f1e5c003-d904-465f-9a90-e8c2ad19ba6a req-b2da2cf2-73eb-4c1e-bbd2-db1a5a8ec65b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148741 Oct 17 15:46:34.897466 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2540/4808] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:46:34.903172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:34.913291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:34.913966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:34.915567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:34.916063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:34.920992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:34.926487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d70d0f16-1871-47ac-95dc-eb9285b811eb req-b17abe17-d861-4f34-88de-78ac9e9a6927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287b7782-35f5-4a0a-ac6e-d803d65080d1", "name": "network-vif-deleted", "tag": "0c32b16d-ee61-452d-aa91-9b4ed41d397e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:35.012012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d70d0f16-1871-47ac-95dc-eb9285b811eb req-b17abe17-d861-4f34-88de-78ac9e9a6927 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:35.012417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d70d0f16-1871-47ac-95dc-eb9285b811eb req-b17abe17-d861-4f34-88de-78ac9e9a6927 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:35.012883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d70d0f16-1871-47ac-95dc-eb9285b811eb req-b17abe17-d861-4f34-88de-78ac9e9a6927 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:35.060177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Getting quotas for project 4704af8d692b4d1c8b5c77de7b7a8c5b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:46:35.080234 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d70d0f16-1871-47ac-95dc-eb9285b811eb req-b17abe17-d861-4f34-88de-78ac9e9a6927 service nova] Creating event network-vif-deleted:0c32b16d-ee61-452d-aa91-9b4ed41d397e for instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 on n-h2-854441-12 Oct 17 15:46:35.084259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Getting quotas for user a1931a1c3ed04b77ac11e19e74944f4e and project 4704af8d692b4d1c8b5c77de7b7a8c5b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:46:35.099496 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d70d0f16-1871-47ac-95dc-eb9285b811eb req-b17abe17-d861-4f34-88de-78ac9e9a6927 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195699 Oct 17 15:46:35.113988 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2541/4809] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:46:35.146673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:35.148283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:35.178633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:35.179153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:35.193568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:35.196242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:35.205373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:35.210272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:35.836541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:46:35.840413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e0c4f065-3212-41a8-bc94-38d016a329de',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='955f5140-7571-4471-8366-846e179aa1c5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4448148-0383-4d94-b514-64c0b232578e',volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:46:36.042366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:36.055704 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a535f258-deca-449b-a7e2-2184db692830 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1323 microversion: 2.1 time: 0.937871 Oct 17 15:46:36.056704 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2542/4810] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:35 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1323 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:36.063105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:36.064201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:36.079761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:36.081435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:36.082147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:36.083273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:36.084039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:36.085072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:36.119487 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] HTTP exception thrown: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Request method failure captured: Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 HTTP/1.1 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXfHRGsNmbIljC6FDbmFxSE1niSTP4rXJVcyZdQHLk7TeDhFFYTET7eETQsG_ucgc7-1fCvGsMVK9sjP-E6IqP4nDaUlFJli_olEvZxPZpRY9v7dnQvtcQukE8bPZu6IKCZRGn3e9Bc4Q_F1imbWErfoobnUFGK6QLFFhf3A2GoL_Rs Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b639ed781808456f97784cc215163549 Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '287b7782-35f5-4a0a-ac6e-d803d65080d1'} Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:46:36.123744 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:36.127914 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:46:36.127914 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:46:36.127914 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:46:36.127914 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:46:36.127914 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:46:36.127914 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:46:36.127914 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:46:36.136103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Returning 404 to user: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:46:36.139587 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ae2c27d-ef36-47db-a8f8-f77577a07edb tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 404 len: 111 microversion: 2.1 time: 0.079614 Oct 17 15:46:36.144008 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2543/4811] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:36 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:46:36.163989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:36.167753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:36.205823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:36.207775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:36.211946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:36.214975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:36.221272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:36.222596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:36.694884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:36.709828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:36.713222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:36.721858 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd3f934f-6f38-4827-b66a-5fef51966a56 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.575634 Oct 17 15:46:36.725047 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2544/4812] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:36 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:36.781090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:36.788583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:36.837678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:36.843795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:36.846235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:36.851346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:36.856612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:36.859876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:37.304285 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3efc1b63-fe30-4219-bfcb-8d2210925878 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 16.190643 Oct 17 15:46:37.332404 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2269/4813] 10.222.0.87 () {62 vars in 1189 bytes} [Mon Oct 17 15:46:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 16219 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:46:37.372294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80818b10-29cd-4cbc-b7a1-0b72847374c3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '.version_select at 0x7f28bdc05820>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:37.466087 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80818b10-29cd-4cbc-b7a1-0b72847374c3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633110792" status: 202 len: 0 microversion: 2.1 time: 0.123517 Oct 17 15:46:37.472016 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2270/4814] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 15:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633110792 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:46:37.492482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:37.493312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:37.498317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:37.517369 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d0cf918-9da6-44e1-baaf-e4478f94d4a7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 0.763767 Oct 17 15:46:37.518587 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2545/4815] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:36 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:37.523951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:37.524463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:37.524906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:37.525636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:37.528624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:37.529127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:37.539873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a7e20a0-f32c-4607-b4e5-74125531582f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:37.542303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a7e20a0-f32c-4607-b4e5-74125531582f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:37.954827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a7e20a0-f32c-4607-b4e5-74125531582f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:37.969224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a7e20a0-f32c-4607-b4e5-74125531582f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:37.977827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a7e20a0-f32c-4607-b4e5-74125531582f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:37.988778 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a7e20a0-f32c-4607-b4e5-74125531582f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1286 microversion: 2.42 time: 0.463036 Oct 17 15:46:37.995973 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2546/4816] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:37 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1286 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:38.027282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:38.049295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:38.089044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:38.090360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:38.103275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:38.105097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:38.105908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:38.108032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:38.289022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:38.314117 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6bb7e9dc-6751-48b4-99fd-4e6d1de70887 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1323 microversion: 2.1 time: 0.835370 Oct 17 15:46:38.317388 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2271/4817] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:37 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1323 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:38.439110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ed65311e-8d38-4ef0-b8aa-eb0a90e6f4be req-0e8d33a8-7d5c-4de3-9df6-a371b21c254b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b384c7b-4321-4acd-831e-a1420246c794", "name": "network-vif-plugged", "status": "completed", "tag": "38a668b2-11af-470e-8ba9-5d4f822fcfd0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:38.478659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ed65311e-8d38-4ef0-b8aa-eb0a90e6f4be req-0e8d33a8-7d5c-4de3-9df6-a371b21c254b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:38.479684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ed65311e-8d38-4ef0-b8aa-eb0a90e6f4be req-0e8d33a8-7d5c-4de3-9df6-a371b21c254b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:38.482481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ed65311e-8d38-4ef0-b8aa-eb0a90e6f4be req-0e8d33a8-7d5c-4de3-9df6-a371b21c254b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:38.537887 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ed65311e-8d38-4ef0-b8aa-eb0a90e6f4be req-0e8d33a8-7d5c-4de3-9df6-a371b21c254b service nova] Creating event network-vif-plugged:38a668b2-11af-470e-8ba9-5d4f822fcfd0 for instance 5b384c7b-4321-4acd-831e-a1420246c794 on n-h1-854441-12 Oct 17 15:46:38.556434 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ed65311e-8d38-4ef0-b8aa-eb0a90e6f4be req-0e8d33a8-7d5c-4de3-9df6-a371b21c254b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122179 Oct 17 15:46:38.561105 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2272/4818] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:46:38.584734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:38.592131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:38.626568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:38.630585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:38.633986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:38.639216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:38.648547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:38.649510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:38.985946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:39.029304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:39.044172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:39.049599 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d46879d6-ff9f-4296-894c-9abc2c5f3539 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 1.050796 Oct 17 15:46:39.051593 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2547/4819] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:37 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:39.073513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1652e1d9-0fd6-4ba7-bbee-e52be266e34a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:39.076689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1652e1d9-0fd6-4ba7-bbee-e52be266e34a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:39.356676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1652e1d9-0fd6-4ba7-bbee-e52be266e34a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:39.396281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1652e1d9-0fd6-4ba7-bbee-e52be266e34a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:39.419991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1652e1d9-0fd6-4ba7-bbee-e52be266e34a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:39.439609 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1652e1d9-0fd6-4ba7-bbee-e52be266e34a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1286 microversion: 2.42 time: 0.372375 Oct 17 15:46:39.460120 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2548/4820] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:39 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1286 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:39.522151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:39.528503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:39.603799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:39.605511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:39.606288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:39.619126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:39.620059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:39.620904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:40.063904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:40.083931 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9edfafd5-bddf-4f04-b7fe-3c5e4c3edfb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 1.519216 Oct 17 15:46:40.106462 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2273/4821] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:38 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:40.165435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:40.169082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:40.212657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:40.226024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:40.227182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:40.231912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:40.243970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:40.243970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:40.698681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:40.713862 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e15b2ee-59e8-4781-a93f-03fb5acef6a6 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1323 microversion: 2.1 time: 1.251787 Oct 17 15:46:40.733429 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2549/4822] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:39 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1323 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:40.743563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-db5e4c66-6fcc-4c62-a384-aa2775f62d99 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'create', calling method: .version_select at 0x7f28bf4c21f0>, body: {"keypair": {"name": "tempest-keypair-578893038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0PFViujIT6xhZmYvhJ5XIOVU+CtPFPpGNA4SM4nH+IsFiImiyD09ZAUJbVTwx/ZxwtY+FiMJm+A2M9aV49I+5/voKV4wDaTcd2DAQZ0VxW5njJ7G0qecF1RFZ/1sxQVQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:40.798480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-db5e4c66-6fcc-4c62-a384-aa2775f62d99 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Getting quotas for project fbc252cb98cc4704ac21c859ac75e121. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:46:40.823071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-db5e4c66-6fcc-4c62-a384-aa2775f62d99 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Getting quotas for user b639ed781808456f97784cc215163549 and project fbc252cb98cc4704ac21c859ac75e121. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:46:40.908394 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-db5e4c66-6fcc-4c62-a384-aa2775f62d99 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173666 Oct 17 15:46:40.911489 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2550/4823] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:46:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:46:40.947621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:40.950797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:40.983245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:40.986123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:40.993948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:41.020202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:41.022186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:41.025351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:41.035568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:41.046584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:41.063183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:41.065653 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7b1f9187-9ac8-4e91-9bea-c3c789595d0b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.956358 Oct 17 15:46:41.073442 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2274/4824] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:40 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:41.130043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:41.132065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:41.173436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:41.184009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:41.184717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:41.186622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:41.197529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:41.198336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:41.362850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:41.384741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:41.392896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:41.397924 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c401d6e-a131-46f5-bbc0-50b7213fb007 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1528 microversion: 2.42 time: 0.484236 Oct 17 15:46:41.407578 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2551/4825] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:40 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1528 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:41.744971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:41.746383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:41.767327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:41.771625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:41.775307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:41.780772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:41.791422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:41.792550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:42.002257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:42.045455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5a035332-beef-4c38-a8f3-124a693da048 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 0.936609 Oct 17 15:46:42.052739 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2275/4826] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:41 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:42.128056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:42.132702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:42.165021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:42.173009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:42.174045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:42.175562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:42.179405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:42.180564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:42.635419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:42.642377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:42.645505 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3282a5d0-9f91-4875-b90f-49ccbaa16502 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1518 microversion: 2.1 time: 0.904588 Oct 17 15:46:42.646123 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2552/4827] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:41 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1518 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:42.675268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:42.690821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:42.695558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:42.733480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:42.736857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:42.737980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:42.743390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:42.744629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:42.747958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:43.297629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:43.412829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:43.416681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:43.427196 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-30c2dd0b-07e5-4b27-85b7-e195f5b42c25 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 1.308692 Oct 17 15:46:43.459670 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2276/4828] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:42 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:43.497307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:43.515244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:43.522159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:43.528723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:43.531650 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-874d16af-4bdc-4a9e-8056-f5985ed6d7f9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1584 microversion: 2.42 time: 0.869634 Oct 17 15:46:43.532252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:43.537365 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2553/4829] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:42 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1584 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:43.562450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:43.568873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:43.580255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:43.590138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:43.594386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:43.602222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:43.604431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:43.605292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:43.606973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:43.607832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:43.609572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:43.635000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:43.636434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:43.636865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:43.722140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lazy-loading 'flavor' on Instance uuid 5b384c7b-4321-4acd-831e-a1420246c794 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:46:44.007357 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-856a1845-95b4-4aaf-bbb8-8a2972d09806 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action" status: 200 len: 32 microversion: 2.1 time: 0.545366 Oct 17 15:46:44.008978 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2277/4830] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:46:43 2022] POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action => generated 32 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:46:44.028453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:44.031926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:44.048802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:44.054478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:44.054983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:44.057392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:44.057927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:44.058615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:44.244089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:44.258061 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3c90ba5-64ac-4998-a2fa-91bd8092b3b8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 0.717170 Oct 17 15:46:44.261698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2554/4831] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:43 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:44.500353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:44.501299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:44.511466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:44.519900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:44.520539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:44.521448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:44.533195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:44.536550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:44.998738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:45.134012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:45.460644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:45.497842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:45.502019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:45.510787 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2fe52c9c-9486-4133-b100-9085ee08d447 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 1.014919 Oct 17 15:46:45.511442 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2555/4832] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:44 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:46:45.545082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:45.548008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:45.616546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:45.630089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:45.636734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:45.651482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:45.657425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:45.657425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:46.147219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:46.190572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:46.205174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:46.217966 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4edf9804-a4f6-44aa-a13c-6ee242740981 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1594 microversion: 2.42 time: 0.698531 Oct 17 15:46:46.243110 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2556/4833] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:45 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1594 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:46.285331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:46.286631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:46.344463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:46.346760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:46.355697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:46.357521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:46.358779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:46.359905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:47.244915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:47.267308 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-343463ec-2c53-4d56-bb79-0aa96311acd5 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1524 microversion: 2.1 time: 3.241146 Oct 17 15:46:47.280071 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2278/4834] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:44 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1524 bytes in 3259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:47.293334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:47.301126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:47.327317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:47.328113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:47.328740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:47.329881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:47.330996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:47.331667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:47.452371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:47.473022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36fd5293-c7d4-4cd9-9db5-4ebd3a63680d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 1.227616 Oct 17 15:46:47.473656 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2557/4835] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:46 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:47.501006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:47.510094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:47.532916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:47.537154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:47.540513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:47.545566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:47.547116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:47.548707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:48.118543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:48.194215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:48.205489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:48.226166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:48.231465 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0da337c5-52bd-423e-b563-7d1d317d6572 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1594 microversion: 2.42 time: 0.743469 Oct 17 15:46:48.237072 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2558/4836] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:47 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1594 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:48.249864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:48.272469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:48.274766 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-057da552-1343-4153-a3e6-1ab88c3185b3 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.993269 Oct 17 15:46:48.279158 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2279/4837] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:47 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:48.317773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:48.325123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:48.377057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:48.377592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:48.378936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:48.387507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:48.388873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:48.389380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:48.523947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:48.524630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:48.527789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:48.551923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:48.555678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:48.563343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:48.565864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:48.568639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:48.571899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:49.637463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:49.671109 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0e07e9e8-eef1-455e-840d-30f3fdf543d9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 1.147604 Oct 17 15:46:49.675866 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2280/4838] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:48 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:46:49.698052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:49.723945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:49.769691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:49.775217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:49.784632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:49.786431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:49.790155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:49.794578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:50.424065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:50.434245 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a60f9e78-4087-4d8a-a7a1-cb0c4b514f04 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1524 microversion: 2.1 time: 2.142585 Oct 17 15:46:50.445341 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2559/4839] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:48 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1524 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:50.467553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:50.468847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:50.525793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:50.533298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:50.539396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:50.552348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:50.568036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:50.569938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:50.858695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:51.459904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:51.538953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:51.561901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:51.576747 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2078ef4a-db2e-4a8c-b5a2-76d94a177240 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1661 microversion: 2.42 time: 1.893565 Oct 17 15:46:51.598096 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2281/4840] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:49 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1661 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:51.628639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:51.634380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:51.666242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:51.669808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:51.670826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:51.673356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:51.675187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:51.678588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:52.397828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c240fbdf-b821-4476-a08d-3719d1403077 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 0.815558 Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2282/4841] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:51 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:52.470558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:52.614816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:52.656769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:52.676489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:52.684220 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bfdfceaf-9902-41ae-8395-f513236eff7b tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 2.235943 Oct 17 15:46:52.692269 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2560/4842] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:50 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:52.733497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-309569685", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21e95d6d-87e4-405c-8d39-8206205c7371"}], "security_groups": [{"name": "tempest-securitygroup--1429417601"}], "key_name": "tempest-keypair-578893038", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:46:53.100562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:53.127815 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1546371f-91a7-42e5-8e2f-9f6f59994770 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1524 microversion: 2.1 time: 0.707138 Oct 17 15:46:53.142979 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2283/4843] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:52 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1524 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:53.168905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:53.183946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:53.214119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:53.217340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:53.218806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:53.220968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:53.225348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:53.229247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:54.079720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:54.130937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:54.141536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:54.146487 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a3585dfc-23d7-4a3c-a856-92463c47c604 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1707 microversion: 2.42 time: 1.001156 Oct 17 15:46:54.167990 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2284/4844] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:53 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1707 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:54.210368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:54.214217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:54.241013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:54.242299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:54.244661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:54.248655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:54.252500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:54.253805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:54.848952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:54.867247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:46:54.877076 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e7a62856-50fd-4869-9288-4dd4f65a711e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 0.706498 Oct 17 15:46:54.880390 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2285/4845] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:54 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:54.906777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:54.908717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:54.938018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:54.939501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:54.940604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:54.945485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:54.948608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:54.950677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:55.633068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:55.707352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:55.724646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:55.727741 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ec75a7b4-aea5-45fb-834a-42637c9be02e tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1739 microversion: 2.20 time: 0.841586 Oct 17 15:46:55.730374 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2286/4846] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:54 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1739 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:55.745687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:55.746691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:55.763221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:55.765378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:55.766190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:55.768675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:55.772238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:55.772879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:56.173311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] validate_networks() for [('21e95d6d-87e4-405c-8d39-8206205c7371', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:46:56.532435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:56.543554 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-75cb7c9a-d6a4-4371-81be-6e8ad51d71fa tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1524 microversion: 2.1 time: 0.811568 Oct 17 15:46:56.574915 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2287/4847] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:55 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1524 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:46:56.580821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:56.581910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:56.598588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:56.599511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:56.600211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:56.602004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:56.602805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:56.603496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:58.796907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:58.838042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:58.851316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:46:58.855294 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0aa82363-d70c-472c-a41d-dece5ccbcced tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1753 microversion: 2.42 time: 2.278279 Oct 17 15:46:58.895400 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2288/4848] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:46:56 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1753 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:46:58.911641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:46:58.917434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:46:58.951391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:58.957579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:58.964725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:46:58.964725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:46:58.964725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:46:58.971455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:00.005720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:00.018144 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d4741134-0149-48b4-9bb2-df888972da53 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 1.126091 Oct 17 15:47:00.023717 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2289/4849] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:46:58 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:00.034442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:00.042387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:00.060320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:00.060831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:00.067559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:00.072174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:00.072744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:00.073176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:00.716634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:00.728837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:47:00.729979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:47:00.730951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:47:00.731935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:47:00.732727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:47:00.739712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:00.744952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:00.746766 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-979c68f3-8bb7-494d-aebc-ff9a793d19f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1721 microversion: 2.20 time: 0.721709 Oct 17 15:47:00.748508 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2290/4850] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:00 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1721 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:00.765861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:00.766883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:00.785776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:00.787473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:00.789991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:00.791467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:00.798869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:00.799768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:00.821396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:00.822543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:00.823263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:00.825406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:00.827315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:00.829426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:00.887750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Getting quotas for project fbc252cb98cc4704ac21c859ac75e121. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:47:00.913305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Getting quotas for user b639ed781808456f97784cc215163549 and project fbc252cb98cc4704ac21c859ac75e121. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:47:00.958658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:47:00.964913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:47:01.123572 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6b689cf-3beb-4e08-9f20-081ed042cc06 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.428882 Oct 17 15:47:01.151699 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2561/4851] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:46:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 8458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:47:01.184039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:01.188840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:01.211889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:01.212434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:01.217757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:01.218575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:01.223542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:01.224015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:01.359657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:01.405403 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-927c5547-f51e-4d6e-a2f6-287dcec9dc2f tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1524 microversion: 2.1 time: 0.649976 Oct 17 15:47:01.426959 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2291/4852] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:00 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1524 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:01.448491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:01.451904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:01.483827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:01.495415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:01.496224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:01.497613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:01.498470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:01.499287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:02.460291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:02.473660 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-056285b3-4791-4c21-97d3-f165bbbc83f7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 1.052500 Oct 17 15:47:02.476989 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2292/4853] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:01 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:02.884511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:02.958209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:02.962125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:02.968573 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b36b8867-cd9a-4e74-9077-7654536cfa59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1799 microversion: 2.42 time: 1.814780 Oct 17 15:47:02.969946 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2562/4854] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:01 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1799 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:02.989655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0d07747f-2fb5-4f99-a3aa-fff1f7ce0124 req-ad14d8c6-3d5c-4c4e-b4c8-7acf8f46f22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781ce8e0-1ad0-4713-ac95-2abac4f7a1d7", "name": "network-vif-unplugged", "status": "completed", "tag": "e23fd663-fe28-4bf5-ae5b-5433ac887247"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:03.043199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0d07747f-2fb5-4f99-a3aa-fff1f7ce0124 req-ad14d8c6-3d5c-4c4e-b4c8-7acf8f46f22f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:03.047736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0d07747f-2fb5-4f99-a3aa-fff1f7ce0124 req-ad14d8c6-3d5c-4c4e-b4c8-7acf8f46f22f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:03.049554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0d07747f-2fb5-4f99-a3aa-fff1f7ce0124 req-ad14d8c6-3d5c-4c4e-b4c8-7acf8f46f22f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:03.155831 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0d07747f-2fb5-4f99-a3aa-fff1f7ce0124 req-ad14d8c6-3d5c-4c4e-b4c8-7acf8f46f22f service nova] Creating event network-vif-unplugged:e23fd663-fe28-4bf5-ae5b-5433ac887247 for instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 on n-h2-854441-12 Oct 17 15:47:03.181665 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0d07747f-2fb5-4f99-a3aa-fff1f7ce0124 req-ad14d8c6-3d5c-4c4e-b4c8-7acf8f46f22f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209471 Oct 17 15:47:03.198633 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2563/4855] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:03.221165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:03.223155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:03.246951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:03.259636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:03.261045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:03.262831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:03.264405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:03.265786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:03.367112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7201c5b7-fedd-430d-947d-eac6581fdff1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:03.368548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7201c5b7-fedd-430d-947d-eac6581fdff1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:03.715079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7201c5b7-fedd-430d-947d-eac6581fdff1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:03.736037 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7201c5b7-fedd-430d-947d-eac6581fdff1 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1236 microversion: 2.1 time: 1.256629 Oct 17 15:47:03.740118 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2293/4856] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:02 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1236 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:03.758171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:03.763811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:04.275233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:04.291487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:04.293465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:04.310164 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5a34dd3-4b44-4cba-bd8a-f9467dd27503 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1664 microversion: 2.20 time: 1.103272 Oct 17 15:47:04.311219 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2564/4857] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:03 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1664 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:04.333779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:04.336825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:04.368335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:04.375769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:04.376603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:04.377980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:04.387491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:04.388273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:04.680101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:04.681188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:04.682049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:04.683208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:04.683927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:04.684593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:04.976969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:05.010341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f692f3d6-1ec4-4cca-9f48-12fbf66f8ce9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 0.693126 Oct 17 15:47:05.012126 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2565/4858] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:04 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:05.032692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:05.034528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:05.063254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:05.064573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:05.070352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:05.072610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:05.077215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:05.079862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:05.116825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:05.134674 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-165bbfe3-e7b2-4f45-802a-c9a959c4522d tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1504 microversion: 2.1 time: 1.391643 Oct 17 15:47:05.135657 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2294/4859] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:03 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1504 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:05.144474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd4415c2-48e9-4693-86f4-af9269b75157 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e8156bc-1882-4429-bcd6-76227139c67f"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:05.152575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cd4415c2-48e9-4693-86f4-af9269b75157 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:05.171312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd4415c2-48e9-4693-86f4-af9269b75157 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:05.171838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd4415c2-48e9-4693-86f4-af9269b75157 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:05.172287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd4415c2-48e9-4693-86f4-af9269b75157 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:05.173036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd4415c2-48e9-4693-86f4-af9269b75157 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:05.173504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd4415c2-48e9-4693-86f4-af9269b75157 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:05.173939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd4415c2-48e9-4693-86f4-af9269b75157 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:06.562028 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd4415c2-48e9-4693-86f4-af9269b75157 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.419968 Oct 17 15:47:06.567571 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2295/4860] 10.222.0.87 () {62 vars in 1364 bytes} [Mon Oct 17 15:47:05 2022] POST /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/os-volume_attachments => generated 188 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:47:06.620479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:06.626175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:06.671445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:06.677789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:06.682659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:06.686480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:06.690286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:06.693174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:07.276858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:07.308567 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b4eb8ce-5c7f-4909-a58e-30ec379940c9 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1294 microversion: 2.1 time: 0.737747 Oct 17 15:47:07.313349 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2296/4861] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:06 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1294 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:07.356890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-91cb9b6c-063e-40c9-ba6b-68833a0aa831 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Action: 'create', calling method: .version_select at 0x7f28be063ca0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1612805614", "description": "tempest-description-530979479"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:07.411182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:07.487165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:07.505194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:07.526797 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-913e8590-5113-4d85-a370-d456cad07b41 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1845 microversion: 2.42 time: 2.498116 Oct 17 15:47:07.531592 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2566/4862] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:05 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1845 bytes in 2517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:07.575427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:07.579606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:07.630675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:07.638626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:07.639593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:07.645631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:07.646904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:07.649170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:08.807249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:08.825266 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f2797cb-6a5d-4704-8bce-345c22400354 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1529 microversion: 2.1 time: 1.288637 Oct 17 15:47:08.838878 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2567/4863] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:07 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1529 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:08.844924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63ef937a-04bb-4ef3-a3a1-b3945c113df0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:08.847642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63ef937a-04bb-4ef3-a3a1-b3945c113df0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:08.888385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63ef937a-04bb-4ef3-a3a1-b3945c113df0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:08.889107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63ef937a-04bb-4ef3-a3a1-b3945c113df0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:08.889577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63ef937a-04bb-4ef3-a3a1-b3945c113df0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:08.890326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63ef937a-04bb-4ef3-a3a1-b3945c113df0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:08.890833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63ef937a-04bb-4ef3-a3a1-b3945c113df0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:08.891275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63ef937a-04bb-4ef3-a3a1-b3945c113df0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:09.209475 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-91cb9b6c-063e-40c9-ba6b-68833a0aa831 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.894814 Oct 17 15:47:09.211558 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2297/4864] 10.222.0.87 () {60 vars in 1180 bytes} [Mon Oct 17 15:47:07 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:09.225671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-dabed426-ed38-4aa0-b6ef-a83353b4d582 req-453919cf-5d3c-4219-a7e7-1e550bff7a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "tag": "39f10735-71ca-470f-b9b6-7a8e6629500c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:09.273167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dabed426-ed38-4aa0-b6ef-a83353b4d582 req-453919cf-5d3c-4219-a7e7-1e550bff7a67 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:09.283789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dabed426-ed38-4aa0-b6ef-a83353b4d582 req-453919cf-5d3c-4219-a7e7-1e550bff7a67 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:09.285346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dabed426-ed38-4aa0-b6ef-a83353b4d582 req-453919cf-5d3c-4219-a7e7-1e550bff7a67 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:09.360559 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-dabed426-ed38-4aa0-b6ef-a83353b4d582 req-453919cf-5d3c-4219-a7e7-1e550bff7a67 service nova] Creating event network-changed:39f10735-71ca-470f-b9b6-7a8e6629500c for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:47:09.440538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-dabed426-ed38-4aa0-b6ef-a83353b4d582 req-453919cf-5d3c-4219-a7e7-1e550bff7a67 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215216 Oct 17 15:47:09.448326 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2298/4865] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:09.512403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:09.526439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:09.557995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:09.578061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:09.580176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:09.597818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:09.603564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:09.608741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:10.401185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:10.421270 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63ef937a-04bb-4ef3-a3a1-b3945c113df0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "DELETE /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/os-volume_attachments/3e8156bc-1882-4429-bcd6-76227139c67f" status: 202 len: 0 microversion: 2.20 time: 1.573248 Oct 17 15:47:10.437525 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2568/4866] 10.222.0.87 () {60 vars in 1457 bytes} [Mon Oct 17 15:47:08 2022] DELETE /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/os-volume_attachments/3e8156bc-1882-4429-bcd6-76227139c67f => generated 0 bytes in 1598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:47:10.481374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:10.493224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:10.524230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:10.536784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:10.537768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:10.543095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:10.543853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:10.544530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:10.862129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:10.942816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:11.438792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:11.488681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:11.496517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:11.500899 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03db2482-fac9-48ba-9d6a-b962f10b0e85 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1866 microversion: 2.42 time: 1.057038 Oct 17 15:47:11.501709 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2569/4867] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:10 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1866 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:11.522665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1612805614"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:11.523581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:11.547340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:11.548521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:11.549620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:11.550468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:11.551320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:11.551942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:12.171021 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.network.security_group_api [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Adding security group b4020c84-07dc-4ad3-9953-c20802113c4f to port 38a668b2-11af-470e-8ba9-5d4f822fcfd0 Oct 17 15:47:12.565794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:12.586145 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a2e2beb0-f771-4b62-a7a3-338a055119b8 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1362 microversion: 2.1 time: 3.131836 Oct 17 15:47:12.602539 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2299/4868] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:09 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1362 bytes in 3135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:12.611028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:12.612119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:12.635580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:12.636464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:12.637234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:12.638549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:12.639366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:12.640148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:13.729300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:13.897022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85d7a379-f35d-4a61-b932-fa047e06c085 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action" status: 202 len: 0 microversion: 2.1 time: 2.383225 Oct 17 15:47:13.903754 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2570/4869] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:47:11 2022] POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action => generated 0 bytes in 2391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:47:13.913074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:13.935463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:13.947581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:13.989853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:13.997585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:13.998833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:14.003957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:14.008905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:14.014068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:14.229627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120406) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 15:47:14.233729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:14.279437 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-72561354-b832-4645-8f0a-f622e2f2f4da tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1511 microversion: 2.1 time: 1.679568 Oct 17 15:47:14.282019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2300/4870] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:12 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1511 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:14.305087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ea69f347-fc3e-4854-b604-73f5230a71dd req-671d485c-70d1-4256-bd5d-9284c989712f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "tag": "ced7f9e8-794b-4f8d-96e3-2e670ce44545"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:14.351261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ea69f347-fc3e-4854-b604-73f5230a71dd req-671d485c-70d1-4256-bd5d-9284c989712f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:14.352992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ea69f347-fc3e-4854-b604-73f5230a71dd req-671d485c-70d1-4256-bd5d-9284c989712f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:14.356158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ea69f347-fc3e-4854-b604-73f5230a71dd req-671d485c-70d1-4256-bd5d-9284c989712f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:14.416084 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ea69f347-fc3e-4854-b604-73f5230a71dd req-671d485c-70d1-4256-bd5d-9284c989712f service nova] Creating event network-changed:ced7f9e8-794b-4f8d-96e3-2e670ce44545 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:47:14.452696 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ea69f347-fc3e-4854-b604-73f5230a71dd req-671d485c-70d1-4256-bd5d-9284c989712f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164301 Oct 17 15:47:14.454354 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2301/4871] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:14.497784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:14.501773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:14.537057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:14.540218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:14.543017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:14.548426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:14.552735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:14.555804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:14.636327 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-905c2149-bc69-4bb4-8f1e-0ff5277891b0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "POST /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/action" status: 202 len: 0 microversion: 2.20 time: 0.730288 Oct 17 15:47:14.653633 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2571/4872] 10.222.0.87 () {62 vars in 1319 bytes} [Mon Oct 17 15:47:13 2022] POST /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/action => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:47:14.672510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a2b50edc-3c49-43e4-b184-c9b71c30c7ca req-0616ba5d-31ff-493d-94f4-59db4991f13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f06aaa4-9003-4c2b-93f2-58dffe88714d", "name": "network-vif-unplugged", "status": "completed", "tag": "266c890a-8733-4318-9e57-c80fb316ccdb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:14.741159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2b50edc-3c49-43e4-b184-c9b71c30c7ca req-0616ba5d-31ff-493d-94f4-59db4991f13b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:14.743996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2b50edc-3c49-43e4-b184-c9b71c30c7ca req-0616ba5d-31ff-493d-94f4-59db4991f13b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:14.752744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2b50edc-3c49-43e4-b184-c9b71c30c7ca req-0616ba5d-31ff-493d-94f4-59db4991f13b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:14.797948 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a2b50edc-3c49-43e4-b184-c9b71c30c7ca req-0616ba5d-31ff-493d-94f4-59db4991f13b service nova] Creating event network-vif-unplugged:266c890a-8733-4318-9e57-c80fb316ccdb for instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d on n-h2-854441-12 Oct 17 15:47:14.828693 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a2b50edc-3c49-43e4-b184-c9b71c30c7ca req-0616ba5d-31ff-493d-94f4-59db4991f13b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172248 Oct 17 15:47:14.839008 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2572/4873] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:14.861202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:14.873106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:14.895869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:14.899528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:14.902087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:14.907443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:14.911161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:14.912553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:15.135275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:15.149881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:15.151460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:15.161449 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-264e5ed7-f55b-4131-8b22-7a51a96a402c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1887 microversion: 2.42 time: 0.689837 Oct 17 15:47:15.168091 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2302/4874] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:14 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1887 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:15.187374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1612805614"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:15.189324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:15.225560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:15.235849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:15.243234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:15.244309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:15.245255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:15.245935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:15.309535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:15.450743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:15.473832 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-443d4be0-e785-4671-b5a5-9e5698370e6a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1362 microversion: 2.1 time: 0.627572 Oct 17 15:47:15.494793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2573/4875] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:14 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1362 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:15.516526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:15.529309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:15.557529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:15.559043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:15.563332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:15.567441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:15.571481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:15.573348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:15.669981 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.network.security_group_api [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Removing security group b4020c84-07dc-4ad3-9953-c20802113c4f from port 38a668b2-11af-470e-8ba9-5d4f822fcfd0 Oct 17 15:47:15.953231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:15.985316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:15.997319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:15.999521 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a442d7a9-496c-4f31-8104-70e39a9bc502 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1672 microversion: 2.20 time: 0.500657 Oct 17 15:47:16.014655 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2574/4876] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:15 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1672 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:16.024824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:16.024824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:16.039378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:16.039895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:16.040347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:16.045842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:16.046410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:16.047148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:16.445406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:16.458551 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c09a033a-471f-471f-8ebb-c751bd8b145c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1511 microversion: 2.1 time: 0.454075 Oct 17 15:47:16.459167 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2575/4877] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:16 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:16.467312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8741c8ef-879a-4d2f-a8f8-0f07c9122204 req-da06ea27-3f6b-442a-bdad-4eac1ffb6ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7fcd63-035e-4da8-98e7-dd8482ff909e", "tag": "b9e2a5a9-0869-4c99-a9a5-9a99b93deedc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:16.508539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8741c8ef-879a-4d2f-a8f8-0f07c9122204 req-da06ea27-3f6b-442a-bdad-4eac1ffb6ef8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:16.509313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8741c8ef-879a-4d2f-a8f8-0f07c9122204 req-da06ea27-3f6b-442a-bdad-4eac1ffb6ef8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:16.511475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8741c8ef-879a-4d2f-a8f8-0f07c9122204 req-da06ea27-3f6b-442a-bdad-4eac1ffb6ef8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:16.550001 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8741c8ef-879a-4d2f-a8f8-0f07c9122204 req-da06ea27-3f6b-442a-bdad-4eac1ffb6ef8 service nova] Creating event network-changed:b9e2a5a9-0869-4c99-a9a5-9a99b93deedc for instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e on n-h1-854441-12 Oct 17 15:47:16.595203 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8741c8ef-879a-4d2f-a8f8-0f07c9122204 req-da06ea27-3f6b-442a-bdad-4eac1ffb6ef8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130875 Oct 17 15:47:16.598412 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2576/4878] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:16.613659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:16.615453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:16.632586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:16.634105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:16.635144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:16.636872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:16.638381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:16.639752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:17.858370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:17.892498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:17.900421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:17.909876 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b181714d-6464-4f91-aa28-ba5609b15bb3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1887 microversion: 2.42 time: 1.307312 Oct 17 15:47:17.914800 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2577/4879] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:16 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1887 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:17.923786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:17.934653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:17.944060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:17.944898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:17.945514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:17.946443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:17.947201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:17.947807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:18.024505 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c0ff59c1-4c25-49a6-a94b-409b7902079a tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action" status: 202 len: 0 microversion: 2.1 time: 2.854442 Oct 17 15:47:18.033751 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2303/4880] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:47:15 2022] POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action => generated 0 bytes in 2865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:47:18.044324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-66dcc413-50dd-4516-806f-eac59d1b6546 req-5cb44ac6-9b28-458b-be36-87257552d4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384c7b-4321-4acd-831e-a1420246c794", "tag": "38a668b2-11af-470e-8ba9-5d4f822fcfd0"}, {"name": "network-changed", "server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "tag": "0f279a23-da10-436b-938e-d8af8305e6bd"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:18.092325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-66dcc413-50dd-4516-806f-eac59d1b6546 req-5cb44ac6-9b28-458b-be36-87257552d4a0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:18.099546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-66dcc413-50dd-4516-806f-eac59d1b6546 req-5cb44ac6-9b28-458b-be36-87257552d4a0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:18.100638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-66dcc413-50dd-4516-806f-eac59d1b6546 req-5cb44ac6-9b28-458b-be36-87257552d4a0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:18.157592 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-66dcc413-50dd-4516-806f-eac59d1b6546 req-5cb44ac6-9b28-458b-be36-87257552d4a0 service nova] Creating event network-changed:38a668b2-11af-470e-8ba9-5d4f822fcfd0 for instance 5b384c7b-4321-4acd-831e-a1420246c794 on n-h1-854441-12 Oct 17 15:47:18.159145 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-66dcc413-50dd-4516-806f-eac59d1b6546 req-5cb44ac6-9b28-458b-be36-87257552d4a0 service nova] Creating event network-changed:0f279a23-da10-436b-938e-d8af8305e6bd for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:47:18.194327 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-66dcc413-50dd-4516-806f-eac59d1b6546 req-5cb44ac6-9b28-458b-be36-87257552d4a0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.157815 Oct 17 15:47:18.196269 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2304/4881] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:18.209230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:18.220519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:18.241323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:18.249105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:18.250362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:18.252100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:18.261208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:18.262429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:19.381626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:19.413230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:19.416942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:19.423652 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b85795b6-9853-41e6-9b87-cae88a2a5d84 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1672 microversion: 2.20 time: 1.224870 Oct 17 15:47:19.436189 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2305/4882] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:18 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1672 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:19.460005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:19.462007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:19.488527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=52 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:19.491873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:19.493320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:19.494552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:19.496117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:19.497332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:19.499451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:19.872183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:19.888713 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6813b2a8-2877-4541-b173-072a6f18640a tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1362 microversion: 2.1 time: 1.969192 Oct 17 15:47:19.889400 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2578/4883] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:17 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1362 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:19.899688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b12be36-486e-49b0-8db2-e7179fd24914 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Action: 'create', calling method: .version_select at 0x7f28be0453a0>, body: {"pool": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:20.464102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:20.480082 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f30d273-eadb-4b66-8c22-dc8e6ccfd63c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1454 microversion: 2.1 time: 1.038522 Oct 17 15:47:20.482078 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2306/4884] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:19 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1454 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:20.502828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:20.504867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:20.518254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:20.519778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:20.521089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:20.522987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:20.524479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:20.525929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:21.275306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:21.287432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:21.289635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:21.291959 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f2486e41-0002-4539-968d-bddb4aec235b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1887 microversion: 2.42 time: 0.807885 Oct 17 15:47:21.304304 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2307/4885] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:20 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1887 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:21.335302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a80c7cb0-8314-4840-b884-5634f17ce5e0 req-81e0527d-2221-4092-9dc5-9eb5490f4ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384c7b-4321-4acd-831e-a1420246c794", "tag": "38a668b2-11af-470e-8ba9-5d4f822fcfd0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:21.364313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a80c7cb0-8314-4840-b884-5634f17ce5e0 req-81e0527d-2221-4092-9dc5-9eb5490f4ba1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:21.365243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a80c7cb0-8314-4840-b884-5634f17ce5e0 req-81e0527d-2221-4092-9dc5-9eb5490f4ba1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:21.367097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a80c7cb0-8314-4840-b884-5634f17ce5e0 req-81e0527d-2221-4092-9dc5-9eb5490f4ba1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:21.394367 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a80c7cb0-8314-4840-b884-5634f17ce5e0 req-81e0527d-2221-4092-9dc5-9eb5490f4ba1 service nova] Creating event network-changed:38a668b2-11af-470e-8ba9-5d4f822fcfd0 for instance 5b384c7b-4321-4acd-831e-a1420246c794 on n-h1-854441-12 Oct 17 15:47:21.404780 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a80c7cb0-8314-4840-b884-5634f17ce5e0 req-81e0527d-2221-4092-9dc5-9eb5490f4ba1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085674 Oct 17 15:47:21.405898 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2308/4886] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:21.417056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:21.418581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:21.430442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:21.431381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:21.432162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:21.433459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:21.434956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:21.435740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:22.192334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:22.222882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:22.228562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:22.231562 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e3dd0ff-861d-472b-bf51-6262f29768d6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 0.823136 Oct 17 15:47:22.233736 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2309/4887] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:21 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:22.259199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:22.265065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:22.281704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:22.283526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:22.285566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:22.288043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:22.289233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:22.290434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:22.791255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:22.837978 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ce644348-b572-478c-8830-d6336bcd4ecc tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1454 microversion: 2.1 time: 0.601460 Oct 17 15:47:22.867565 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2310/4888] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:22 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1454 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:22.910604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:22.913706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:22.947446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:22.951348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:22.954976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:22.959618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:22.960622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:22.961534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:23.498966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:23.514897 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2e0f5f71-17af-4bed-a47c-ae41892736d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1362 microversion: 2.1 time: 0.644589 Oct 17 15:47:23.518603 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2311/4889] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:22 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1362 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:23.553931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:23.554912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:23.576826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:23.577349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:23.577806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:23.593196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:23.593856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:23.594539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:24.519564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:24.541278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:24.546737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:24.548054 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-048fba65-e35f-4eb6-bed8-e9b889971299 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1887 microversion: 2.42 time: 1.028119 Oct 17 15:47:24.551392 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2312/4890] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:23 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1887 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:24.570234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-28b97281-00fc-4513-ba9f-e764106e1222 req-6dc34fe6-20d9-425e-9acb-570e2e4f56bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "tag": "3c70d92c-4ec6-4149-8343-459bac51739d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:24.591208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-28b97281-00fc-4513-ba9f-e764106e1222 req-6dc34fe6-20d9-425e-9acb-570e2e4f56bc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:24.592081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-28b97281-00fc-4513-ba9f-e764106e1222 req-6dc34fe6-20d9-425e-9acb-570e2e4f56bc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:24.592768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-28b97281-00fc-4513-ba9f-e764106e1222 req-6dc34fe6-20d9-425e-9acb-570e2e4f56bc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:24.613170 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-28b97281-00fc-4513-ba9f-e764106e1222 req-6dc34fe6-20d9-425e-9acb-570e2e4f56bc service nova] Creating event network-changed:3c70d92c-4ec6-4149-8343-459bac51739d for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:47:24.639647 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-28b97281-00fc-4513-ba9f-e764106e1222 req-6dc34fe6-20d9-425e-9acb-570e2e4f56bc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086812 Oct 17 15:47:24.640277 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2313/4891] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:24.649624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:24.650807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:24.660118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:24.661009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:24.662849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:24.663825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:24.665795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:24.666435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:24.736893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lazy-loading 'flavor' on Instance uuid 6f06aaa4-9003-4c2b-93f2-58dffe88714d {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:47:24.765798 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Cannot 'shelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state shelved_offloaded Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action HTTP/1.1 Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 14 Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: {"shelve": {}} Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: exception: Cannot 'shelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state shelved_offloaded Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d', 'body': {'shelve': {}}} Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:47:24.767896 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state shelved_offloaded Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state shelved_offloaded Oct 17 15:47:24.773526 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:47:24.777632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 409 to user: Cannot 'shelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state shelved_offloaded {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:47:24.778803 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2d28bdd4-381d-4ff5-86c9-4598d35ebd51 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 409 len: 155 microversion: 2.1 time: 0.137338 Oct 17 15:47:24.781983 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2314/4892] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:47:24 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 155 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 15:47:24.796913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:24.798985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:24.824455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:24.825315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:24.831557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:24.832794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:24.833516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:24.834168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:25.944399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:25.959821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:25.972365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:25.974205 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f62a4eb-f5ad-4902-a9b7-c964d154a6f9 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 1.190796 Oct 17 15:47:25.975005 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2315/4893] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:24 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:25.981084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:25.982140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:25.997553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:25.998478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:25.999208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:26.002335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:26.003236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:26.005255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:26.569830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:26.586169 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f97eda6-6476-471a-bf5c-08b3221c2df7 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1362 microversion: 2.1 time: 0.609019 Oct 17 15:47:26.588081 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2316/4894] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:25 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1362 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:26.599514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:26.601778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:26.616927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:26.617814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:26.618667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:26.619951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:26.620798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:26.623486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:26.732674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120407) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 15:47:26.936195 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a4b3340-d721-4bd0-ad3e-492a846c1ace tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 202 len: 0 microversion: 2.1 time: 0.342525 Oct 17 15:47:26.937241 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2317/4895] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:47:26 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:47:26.958025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-60139a0d-7ff8-4180-8d9d-e4f9ff35fc0a req-a6781f57-094c-43d4-830d-9a88bf12a699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7fcd63-035e-4da8-98e7-dd8482ff909e", "name": "network-vif-plugged", "status": "completed", "tag": "b9e2a5a9-0869-4c99-a9a5-9a99b93deedc"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:27.000081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-60139a0d-7ff8-4180-8d9d-e4f9ff35fc0a req-a6781f57-094c-43d4-830d-9a88bf12a699 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:27.010251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-60139a0d-7ff8-4180-8d9d-e4f9ff35fc0a req-a6781f57-094c-43d4-830d-9a88bf12a699 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:27.011967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-60139a0d-7ff8-4180-8d9d-e4f9ff35fc0a req-a6781f57-094c-43d4-830d-9a88bf12a699 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:27.042779 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-60139a0d-7ff8-4180-8d9d-e4f9ff35fc0a req-a6781f57-094c-43d4-830d-9a88bf12a699 service nova] Creating event network-vif-plugged:b9e2a5a9-0869-4c99-a9a5-9a99b93deedc for instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e on n-h1-854441-12 Oct 17 15:47:27.056542 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-60139a0d-7ff8-4180-8d9d-e4f9ff35fc0a req-a6781f57-094c-43d4-830d-9a88bf12a699 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114406 Oct 17 15:47:27.061866 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2318/4896] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:27.075325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:27.076918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:27.103066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:27.104322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:27.106646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:27.108202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:27.111228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:27.113455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:27.890305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:27.905956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:27.908784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:27.910450 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5601b5b7-6a3d-480d-9630-1da1ac7c9738 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1887 microversion: 2.42 time: 0.844848 Oct 17 15:47:27.911648 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2319/4897] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:27 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1887 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:27.921178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:27.926933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:27.944538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:27.956714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:27.957844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:27.960830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:27.963573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:27.965768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:27.966400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:28.593858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:28.606185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f8f056a1-6eed-4c85-a7c5-6051b0120528 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1462 microversion: 2.1 time: 0.693091 Oct 17 15:47:28.607954 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2320/4898] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:27 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1462 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:28.614787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:28.616051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:28.624070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:28.633570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:28.634408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:28.635597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:28.636341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:28.637340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:29.058141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:29.069529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:29.085345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:29.091970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:29.094535 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95a43d5d-e642-469f-8788-82e252e749c0 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 0.484924 Oct 17 15:47:29.095711 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2321/4899] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:28 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:29.104465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:29.105453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:29.116886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:29.117718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:29.118748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:29.119779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:29.120455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:29.121068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:29.534866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:29.549909 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a7819cb-1f3b-499a-97c6-b464c4df3dc3 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1548 microversion: 2.1 time: 0.446225 Oct 17 15:47:29.552001 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2322/4900] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:29 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1548 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:29.563744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c902bb16-9549-486e-b63b-cff0e11e5548 req-111bf355-313e-4220-905a-cb4054753de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "tag": "6ef23b02-c3af-4bff-97d6-68183f1e63d3"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:29.603398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c902bb16-9549-486e-b63b-cff0e11e5548 req-111bf355-313e-4220-905a-cb4054753de5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:29.614601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c902bb16-9549-486e-b63b-cff0e11e5548 req-111bf355-313e-4220-905a-cb4054753de5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:29.620729 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b12be36-486e-49b0-8db2-e7179fd24914 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.728354 Oct 17 15:47:29.631852 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2579/4901] 10.222.0.87 () {60 vars in 1170 bytes} [Mon Oct 17 15:47:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:29.632072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c902bb16-9549-486e-b63b-cff0e11e5548 req-111bf355-313e-4220-905a-cb4054753de5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:29.632205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:29.632205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:29.639465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:29.640969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:29.641698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:29.642757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:29.643386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:29.644096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:29.707224 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c902bb16-9549-486e-b63b-cff0e11e5548 req-111bf355-313e-4220-905a-cb4054753de5 service nova] Creating event network-changed:6ef23b02-c3af-4bff-97d6-68183f1e63d3 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:47:29.726718 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c902bb16-9549-486e-b63b-cff0e11e5548 req-111bf355-313e-4220-905a-cb4054753de5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171672 Oct 17 15:47:29.728057 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2323/4902] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:29.752269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6e2a102-cd2f-45aa-ada7-6ebc7b24c262 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:29.756017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c6e2a102-cd2f-45aa-ada7-6ebc7b24c262 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:29.774809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6e2a102-cd2f-45aa-ada7-6ebc7b24c262 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:29.775797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6e2a102-cd2f-45aa-ada7-6ebc7b24c262 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:29.779686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6e2a102-cd2f-45aa-ada7-6ebc7b24c262 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:29.781020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6e2a102-cd2f-45aa-ada7-6ebc7b24c262 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:29.783977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6e2a102-cd2f-45aa-ada7-6ebc7b24c262 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:29.784765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6e2a102-cd2f-45aa-ada7-6ebc7b24c262 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:30.062137 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c6e2a102-cd2f-45aa-ada7-6ebc7b24c262 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332200 Oct 17 15:47:30.063419 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2324/4903] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:47:29 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:30.069639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.133"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:30.072247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:30.120874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:30.121578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:30.125305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:30.131256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:30.133113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:30.133521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:30.406842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "refresh_cache-5b384c7b-4321-4acd-831e-a1420246c794" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:47:30.410301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquired lock "refresh_cache-5b384c7b-4321-4acd-831e-a1420246c794" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:47:33.040308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:33.058800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:33.076705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:33.082221 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f76ec0de-3d91-418d-8eec-96b18ee6c9f3 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1887 microversion: 2.42 time: 3.456642 Oct 17 15:47:33.083961 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2580/4904] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:29 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1887 bytes in 3459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:33.098167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:33.108469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:33.141068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:33.147436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:33.149874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:33.151438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:33.156949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:33.158894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:34.172352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:34.224428 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-daefed87-2757-42ee-9b17-844e257e09a9 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 1.129850 Oct 17 15:47:34.229465 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2581/4905] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:33 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:34.245117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:34.247587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:34.262596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:34.264455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:34.265719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:34.268040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:34.269453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:34.270718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:35.109777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:35.142097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:35.152584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:35.161818 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13c853a0-d98d-451f-be99-c3c5c5905fe1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 0.928507 Oct 17 15:47:35.166472 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2582/4906] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:34 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:35.205917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:35.209233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:35.249328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:35.251632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:35.257316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:35.259363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:35.271733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:35.273108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:36.847765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:36.879940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:36.894360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:36.899712 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d87be05-c78d-42e3-9f23-101107d6bb05 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1887 microversion: 2.42 time: 1.725602 Oct 17 15:47:36.908432 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2583/4907] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:35 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1887 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:36.937695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a2b5b549-b7a3-4290-bd8a-9d1644ae59de req-34a37d4f-ea29-4bf7-a161-b2827216d6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "tag": "a89396e5-b63d-407b-8fb4-cfdd873892f8"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:36.988422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2b5b549-b7a3-4290-bd8a-9d1644ae59de req-34a37d4f-ea29-4bf7-a161-b2827216d6bd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:36.993602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2b5b549-b7a3-4290-bd8a-9d1644ae59de req-34a37d4f-ea29-4bf7-a161-b2827216d6bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:36.996976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a2b5b549-b7a3-4290-bd8a-9d1644ae59de req-34a37d4f-ea29-4bf7-a161-b2827216d6bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:37.050090 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a2b5b549-b7a3-4290-bd8a-9d1644ae59de req-34a37d4f-ea29-4bf7-a161-b2827216d6bd service nova] Creating event network-changed:a89396e5-b63d-407b-8fb4-cfdd873892f8 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:47:37.078098 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a2b5b549-b7a3-4290-bd8a-9d1644ae59de req-34a37d4f-ea29-4bf7-a161-b2827216d6bd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163508 Oct 17 15:47:37.081531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2584/4908] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:37.104729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:37.108311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:37.147285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:37.151172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:37.157341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:37.159120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:37.160281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:37.166030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:38.440359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:38.477627 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da036cdc-211f-49ca-b1c6-918b5a7ded1d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 1.375244 Oct 17 15:47:38.478847 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2585/4909] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:37 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:38.513120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:38.517230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:38.554191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:38.557138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:38.567599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:38.574696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:38.578084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:38.579689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:39.813436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:39.854348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:39.872659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:39.883075 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aed11855-9e19-4708-8b08-8a42af6d2fd1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 1.398673 Oct 17 15:47:39.898537 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2586/4910] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:38 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:39.908021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:39.926888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:39.956421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:39.961194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:39.962342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:39.965219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:39.983255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:39.988998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:40.090316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:40.112409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:40.241188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Building network info cache for instance {{(pid=120407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:47:42.275132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:42.330947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:42.366031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:42.374267 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-236a7475-be27-49ea-ad69-8395f0c5ff49 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 2.479686 Oct 17 15:47:42.381358 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2587/4911] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:39 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:42.408138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8c2db7e2-2f28-46bb-b908-b559cd95f0c7 req-4cffae6b-5498-4dd3-8d09-b19ec30124d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7fcd63-035e-4da8-98e7-dd8482ff909e", "tag": "b9e2a5a9-0869-4c99-a9a5-9a99b93deedc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:42.482954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8c2db7e2-2f28-46bb-b908-b559cd95f0c7 req-4cffae6b-5498-4dd3-8d09-b19ec30124d2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:42.484195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8c2db7e2-2f28-46bb-b908-b559cd95f0c7 req-4cffae6b-5498-4dd3-8d09-b19ec30124d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:42.492456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8c2db7e2-2f28-46bb-b908-b559cd95f0c7 req-4cffae6b-5498-4dd3-8d09-b19ec30124d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:42.556771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8c2db7e2-2f28-46bb-b908-b559cd95f0c7 req-4cffae6b-5498-4dd3-8d09-b19ec30124d2 service nova] Creating event network-changed:b9e2a5a9-0869-4c99-a9a5-9a99b93deedc for instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e on n-h1-854441-12 Oct 17 15:47:42.575173 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8c2db7e2-2f28-46bb-b908-b559cd95f0c7 req-4cffae6b-5498-4dd3-8d09-b19ec30124d2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184504 Oct 17 15:47:42.578786 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2588/4912] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:42.589743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:42.606717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:42.621317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:42.629470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:42.630393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:42.631834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:42.632481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:42.633102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:43.440752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:43.455208 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98509367-ed83-44e5-8a50-075054ee832d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.868201 Oct 17 15:47:43.455822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Updating instance_info_cache with network_info: [{"id": "38a668b2-11af-470e-8ba9-5d4f822fcfd0", "address": "fa:16:3e:95:6d:3e", "network": {"id": "fece443f-d643-4ff2-8212-7b146139b48c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-884464958-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "081813733e79419a80f777371c76725d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap38a668b2-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:47:43.458893 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2589/4913] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:42 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:43.474206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f6a2805e-edc0-4801-a937-813311834af6 req-5bfc0a13-afa4-4ec3-b27d-85c7d657a3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "tag": "b7535a0d-d61b-4a19-99f0-a6cd01a96405"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:43.520716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Releasing lock "refresh_cache-5b384c7b-4321-4acd-831e-a1420246c794" {{(pid=120407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:47:43.530346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f6a2805e-edc0-4801-a937-813311834af6 req-5bfc0a13-afa4-4ec3-b27d-85c7d657a3b6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:43.535830 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b883ba1-169e-4f6a-aa07-85da745768de tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action" status: 202 len: 0 microversion: 2.1 time: 13.471164 Oct 17 15:47:43.537870 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2325/4914] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:47:30 2022] POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action => generated 0 bytes in 13474 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 15:47:43.538673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f6a2805e-edc0-4801-a937-813311834af6 req-5bfc0a13-afa4-4ec3-b27d-85c7d657a3b6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:43.539575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f6a2805e-edc0-4801-a937-813311834af6 req-5bfc0a13-afa4-4ec3-b27d-85c7d657a3b6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:43.557082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:43.564438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:43.592795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:43.601480 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f6a2805e-edc0-4801-a937-813311834af6 req-5bfc0a13-afa4-4ec3-b27d-85c7d657a3b6 service nova] Creating event network-changed:b7535a0d-d61b-4a19-99f0-a6cd01a96405 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:47:43.603649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:43.609567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:43.612075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:43.620830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:43.626426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:43.630333 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f6a2805e-edc0-4801-a937-813311834af6 req-5bfc0a13-afa4-4ec3-b27d-85c7d657a3b6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165338 Oct 17 15:47:43.635363 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2590/4915] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:43.660904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:43.664637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:43.685946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:43.695406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:43.696344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:43.697039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:43.697641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:43.699195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:44.673017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:44.697325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:44.699657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:44.703301 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-173e91ed-4513-4072-9cc0-2e02574e7ac8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 1.065046 Oct 17 15:47:44.704363 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2591/4916] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:43 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:44.710200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.133"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:44.920374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:44.960401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:44.971978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:44.974385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3116b476-70e5-47b6-a196-367ae91b3b09 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 1.433501 Oct 17 15:47:45.014554 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2326/4917] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:43 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:45.024276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:45.025427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:45.065994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:45.066965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:45.067671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:45.068940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:45.070137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:45.071247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:45.900845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:45.928961 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3d45e5fb-2377-4b80-b999-aded09454df6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.912690 Oct 17 15:47:45.931951 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2327/4918] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:45 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:45.969220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:45.977740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-20eb0f2a-97ff-4320-bd8b-6b4a6036a0ab req-8c6f1fb4-0a59-4822-b6a0-8b5618211d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384c7b-4321-4acd-831e-a1420246c794", "tag": "38a668b2-11af-470e-8ba9-5d4f822fcfd0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:45.986690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:45.988135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:45.991507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:45.993157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:45.994608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:45.995583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:46.058184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20eb0f2a-97ff-4320-bd8b-6b4a6036a0ab req-8c6f1fb4-0a59-4822-b6a0-8b5618211d5f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:46.061314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20eb0f2a-97ff-4320-bd8b-6b4a6036a0ab req-8c6f1fb4-0a59-4822-b6a0-8b5618211d5f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:46.062164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20eb0f2a-97ff-4320-bd8b-6b4a6036a0ab req-8c6f1fb4-0a59-4822-b6a0-8b5618211d5f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:46.139797 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-20eb0f2a-97ff-4320-bd8b-6b4a6036a0ab req-8c6f1fb4-0a59-4822-b6a0-8b5618211d5f service nova] Creating event network-changed:38a668b2-11af-470e-8ba9-5d4f822fcfd0 for instance 5b384c7b-4321-4acd-831e-a1420246c794 on n-h1-854441-12 Oct 17 15:47:46.174935 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-20eb0f2a-97ff-4320-bd8b-6b4a6036a0ab req-8c6f1fb4-0a59-4822-b6a0-8b5618211d5f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228056 Oct 17 15:47:46.179770 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2328/4919] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:46.200906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:46.205813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:46.229349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:46.231486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:46.232654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:46.234361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:46.235828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:46.237202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:47.092112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "refresh_cache-5b384c7b-4321-4acd-831e-a1420246c794" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 15:47:47.094753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquired lock "refresh_cache-5b384c7b-4321-4acd-831e-a1420246c794" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 15:47:47.479795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:47.508037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:47.512576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:47.520668 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-98a5cde3-7934-4a18-a32a-38d7900aa60f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 1.337867 Oct 17 15:47:47.531627 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2329/4920] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:46 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:47.575084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:47.588121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:47.621478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:47.623252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:47.624948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:47.627204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:47.628707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:47.655011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:49.275806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:49.324212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:49.328258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:49.331391 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7dd699d8-9d3e-477e-887c-7df81d70c952 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 1.772645 Oct 17 15:47:49.333241 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2330/4921] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:47 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:49.370918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:49.378725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:49.397451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:49.398939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:49.399712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:49.400995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:49.401814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:49.402640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:49.922555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:49.965404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c06dfc0d-4fb7-4546-843d-ca09d91e2578 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.604835 Oct 17 15:47:49.991786 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2331/4922] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:49 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:50.039864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:50.041367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:50.060921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:50.061846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:50.063001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:50.064758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:50.065933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:50.067101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:50.968069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:51.035497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:51.039663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:51.047003 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0ec57255-2db0-4f7b-8b83-efc1beb3589e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 1.050434 Oct 17 15:47:51.053061 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2332/4923] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:49 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:51.078401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:51.081048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:51.114857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:51.120183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:51.121061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:51.122436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:51.123295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:51.128598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:51.196011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Building network info cache for instance {{(pid=120406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 15:47:51.691277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:51.707086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:51.711266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:51.713574 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5eb9fe4a-a34d-4ac6-bb97-fded7981d567 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 0.658410 Oct 17 15:47:51.730555 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2333/4924] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:51 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:51.745085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:51.747224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:51.774989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:51.775831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:51.776868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:51.779670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:51.781368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:51.782415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:52.287355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:52.308735 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b1c8b2f0-7821-4fe2-aa8e-8fadd4dcbede tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.591275 Oct 17 15:47:52.331472 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2334/4925] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:51 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:52.343824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-20d78a07-87aa-45c2-8c25-b2fae89baeeb req-a35a8492-cf7a-4fe7-ae41-a37065ab89f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384c7b-4321-4acd-831e-a1420246c794", "tag": "38a668b2-11af-470e-8ba9-5d4f822fcfd0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:47:52.387925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20d78a07-87aa-45c2-8c25-b2fae89baeeb req-a35a8492-cf7a-4fe7-ae41-a37065ab89f8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:52.389894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20d78a07-87aa-45c2-8c25-b2fae89baeeb req-a35a8492-cf7a-4fe7-ae41-a37065ab89f8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:52.390697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20d78a07-87aa-45c2-8c25-b2fae89baeeb req-a35a8492-cf7a-4fe7-ae41-a37065ab89f8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:52.430972 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-20d78a07-87aa-45c2-8c25-b2fae89baeeb req-a35a8492-cf7a-4fe7-ae41-a37065ab89f8 service nova] Creating event network-changed:38a668b2-11af-470e-8ba9-5d4f822fcfd0 for instance 5b384c7b-4321-4acd-831e-a1420246c794 on n-h1-854441-12 Oct 17 15:47:52.456047 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-20d78a07-87aa-45c2-8c25-b2fae89baeeb req-a35a8492-cf7a-4fe7-ae41-a37065ab89f8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119926 Oct 17 15:47:52.461996 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2335/4926] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:47:52.484416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:52.485703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:52.504744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:52.505634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:52.506433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:52.508231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:52.509265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:52.510094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:53.774700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:53.834757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:53.845922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:53.851463 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f15ca527-c854-444c-8fc3-af492bdef9c1 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 1.385519 Oct 17 15:47:53.874644 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2336/4927] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:52 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:53.903783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:53.904426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:53.937110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:53.937632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:53.938091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:53.938903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:53.939637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:53.963159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:54.054606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Updating instance_info_cache with network_info: [{"id": "38a668b2-11af-470e-8ba9-5d4f822fcfd0", "address": "fa:16:3e:95:6d:3e", "network": {"id": "fece443f-d643-4ff2-8212-7b146139b48c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-884464958-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "081813733e79419a80f777371c76725d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap38a668b2-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 15:47:54.071044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Releasing lock "refresh_cache-5b384c7b-4321-4acd-831e-a1420246c794" {{(pid=120406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 15:47:54.076457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69d1a11d-3fbe-4553-aab6-7658c19fafea tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action" status: 202 len: 0 microversion: 2.1 time: 9.370522 Oct 17 15:47:54.077132 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2592/4928] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:47:44 2022] POST /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794/action => generated 0 bytes in 9372 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 15:47:54.123676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:54.126928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:54.154636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:54.155153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:54.155603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:54.156339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:54.156808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:54.157240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:54.856218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:54.881735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:54.899389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:54.901656 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c69acd8b-796b-4524-8cf8-7c0f58a4e9f7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 1.018395 Oct 17 15:47:54.907940 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2337/4929] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:53 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:54.936613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-18c0a452-4e17-4e56-bd7a-a8b5a167083e tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '.version_select at 0x7f28bdf9f1f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:55.176353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:55.185220 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14c0f585-f7ac-4e78-811d-65a86dcaf280 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 1.096526 Oct 17 15:47:55.191468 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2593/4930] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:54 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:55.206317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:55.217018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:55.248957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:55.249207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:55.249635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:55.250393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:55.259191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:55.259719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:55.903135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:55.924901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:55.926635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:55.939771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a60af2d-8d23-4e3f-a3f3-c1cb5fb4344f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.746912 Oct 17 15:47:55.962105 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2594/4931] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:55 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:55.987554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:55.988190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:56.028503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:56.029223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:56.030412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:56.032051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:56.041319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:56.042255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:57.441987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:57.470887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:57.481461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:57.484798 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54f8017c-7449-4e9f-b17f-c7056e009673 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 1.518435 Oct 17 15:47:57.485454 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2595/4932] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:55 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:57.502940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:57.505171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:57.532035 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-18c0a452-4e17-4e56-bd7a-a8b5a167083e tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "DELETE /compute/v2.1/os-floating-ips/abc71459-c5e9-4667-a2ca-5a1db1c83709" status: 202 len: 0 microversion: 2.1 time: 2.608428 Oct 17 15:47:57.534220 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2338/4933] 10.222.0.87 () {58 vars in 1263 bytes} [Mon Oct 17 15:47:54 2022] DELETE /compute/v2.1/os-floating-ips/abc71459-c5e9-4667-a2ca-5a1db1c83709 => generated 0 bytes in 2625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:47:57.543097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:57.544167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:57.554425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:57.555888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:57.557145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:57.558950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:57.560870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:57.564306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:57.574621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:57.588422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:57.588422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:57.588422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:57.604517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:57.604517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:58.048716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:58.083806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:58.090122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:58.101432 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b675e6cb-aad7-4479-b7b3-58b653749d6a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.565597 Oct 17 15:47:58.112514 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2339/4934] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:57 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:58.119237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c2098562-702a-4439-94bf-dee6c0dbdfc8 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '.version_select at 0x7f28bdbd3ee0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:58.157299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:58.171451 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c72fdff-ba92-45d5-a8f9-543f9a59872f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.680562 Oct 17 15:47:58.174218 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2596/4935] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:57 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:58.449912 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c2098562-702a-4439-94bf-dee6c0dbdfc8 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "DELETE /compute/v2.1/os-security-groups/b4020c84-07dc-4ad3-9953-c20802113c4f" status: 202 len: 0 microversion: 2.1 time: 0.339187 Oct 17 15:47:58.450446 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2340/4936] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 15:47:58 2022] DELETE /compute/v2.1/os-security-groups/b4020c84-07dc-4ad3-9953-c20802113c4f => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:47:58.472930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:58.477710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:58.495622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=35 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:58.499386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:58.500265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:58.505341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:58.508201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:58.509502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:58.511192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:58.540547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:58.542571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:58.555012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:58.556220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:58.557516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:58.558824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:58.559988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:58.560970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:58.565558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:47:58.730454 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8d7c2a4-90cc-4155-ac95-0ac8897b6934 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 204 len: 0 microversion: 2.1 time: 0.272363 Oct 17 15:47:58.731783 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2597/4937] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:47:58 2022] DELETE /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:47:58.747284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:58.760596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:58.794890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:58.795908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:58.796720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:58.804407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:58.805483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:58.812912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:58.939609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:58.991372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:59.005205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:59.006617 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-476be21e-ff37-4554-8b90-e3e97b9cf84d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 0.473815 Oct 17 15:47:59.039729 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2341/4938] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:58 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:47:59.157322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:59.158430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:59.177148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:59.181354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:59.183528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:59.187584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:59.188852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:59.192136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:59.325007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:47:59.654444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:47:59.730627 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a59ae2c-a130-426a-83f0-51eb57472a71 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1510 microversion: 2.1 time: 0.977050 Oct 17 15:47:59.732399 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2598/4939] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:58 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1510 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:47:59.760515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:47:59.814237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:47:59.895771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:59.896271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:59.907414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:47:59.908584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:47:59.909456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:47:59.919157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:00.059063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:00.080747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:00.096075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:00.097596 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d90322c2-f2cd-48c5-8b5e-9f4fa8899703 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.945703 Oct 17 15:48:00.098673 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2342/4940] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:47:59 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:48:00.114144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:00.115463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:00.131618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:00.144562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:00.146143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:00.147374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:00.150439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:00.152437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:00.402124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:00.419553 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f922b78e-b59f-4031-80ce-d8e243b02d18 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.681700 Oct 17 15:48:00.421790 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2599/4941] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:47:59 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:00.704246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:00.735066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:00.740252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:00.746335 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-671924e2-b753-447b-b94d-bfed28725fe7 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 0.642648 Oct 17 15:48:00.749278 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2343/4942] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:00 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:00.762602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:00.762602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:00.777578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:00.778090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:00.778561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:00.783642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:00.784270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:00.784736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:01.148396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:01.149857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:01.164126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:01.164957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:01.165578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:01.166659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:01.167347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:01.167990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:01.522406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:01.539097 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-780976bf-6e51-4525-9a5b-392fecdb74fb tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1510 microversion: 2.1 time: 0.785908 Oct 17 15:48:01.540668 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2600/4943] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:00 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1510 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:01.560700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:01.564225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:01.580930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:01.583460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:01.587360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:01.588407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:01.589145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:01.589744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:01.933552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:01.944413 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d92fd3af-22b6-4860-ac2b-af09200b588b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.402059 Oct 17 15:48:01.958797 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2601/4944] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:01 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:01.979781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc186612-5371-45d1-88e0-44522ac07a19 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:01.981250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc186612-5371-45d1-88e0-44522ac07a19 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:02.038909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc186612-5371-45d1-88e0-44522ac07a19 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:02.045385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc186612-5371-45d1-88e0-44522ac07a19 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:02.049844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc186612-5371-45d1-88e0-44522ac07a19 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:02.053229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc186612-5371-45d1-88e0-44522ac07a19 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:02.055914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc186612-5371-45d1-88e0-44522ac07a19 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:02.058094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc186612-5371-45d1-88e0-44522ac07a19 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:02.131836 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc186612-5371-45d1-88e0-44522ac07a19 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/ips" status: 200 len: 146 microversion: 2.1 time: 0.174043 Oct 17 15:48:02.141452 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2602/4945] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:48:01 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/ips => generated 146 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:02.148423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:02.149758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:02.160106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:02.160954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:02.161864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:02.163422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:02.164276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:02.165055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:02.174211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:02.188699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:02.190980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:02.203594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:02.205428 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a811e83b-516f-46a6-96af-ecba769fd14e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 1.061132 Oct 17 15:48:02.206703 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2344/4946] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:01 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:02.215907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-98c12983-4d70-4816-9df9-49ab4fa563c8 req-e98d2d59-bcd6-453a-a972-24db0337057e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781ce8e0-1ad0-4713-ac95-2abac4f7a1d7", "name": "network-vif-plugged", "status": "completed", "tag": "e23fd663-fe28-4bf5-ae5b-5433ac887247"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:02.249859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-98c12983-4d70-4816-9df9-49ab4fa563c8 req-e98d2d59-bcd6-453a-a972-24db0337057e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:02.257364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-98c12983-4d70-4816-9df9-49ab4fa563c8 req-e98d2d59-bcd6-453a-a972-24db0337057e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:02.259555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-98c12983-4d70-4816-9df9-49ab4fa563c8 req-e98d2d59-bcd6-453a-a972-24db0337057e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:02.292982 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-98c12983-4d70-4816-9df9-49ab4fa563c8 req-e98d2d59-bcd6-453a-a972-24db0337057e service nova] Creating event network-vif-plugged:e23fd663-fe28-4bf5-ae5b-5433ac887247 for instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 on n-h2-854441-12 Oct 17 15:48:02.306534 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-98c12983-4d70-4816-9df9-49ab4fa563c8 req-e98d2d59-bcd6-453a-a972-24db0337057e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098069 Oct 17 15:48:02.310746 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2345/4947] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:02.522468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:02.533996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:02.536685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:02.553194 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0253eff8-0829-4b05-b111-5293d92b1af6 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 0.409894 Oct 17 15:48:02.555141 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2603/4948] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:02 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:02.569509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:02.573733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:02.616598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:02.621208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:02.622394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:02.643998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:02.647926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:02.656502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:02.979700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:02.979700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:03.046584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:03.062578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:03.063901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:03.071955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:03.075631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:03.079040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:03.104930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d6823a721a4bbe8cde326981d14e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081813733e79419a80f777371c76725d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:03.127865 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e1fa7ff7-a4f8-4305-aa3e-b39e18929971 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 200 len: 1468 microversion: 2.1 time: 0.566337 Oct 17 15:48:03.130200 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2346/4949] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:02 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 1468 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:03.148710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2f0468d5-24f1-4b32-bf6d-5ad6c5805faf req-615e1413-34f5-4f7f-aed2-0041c5baf8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b384c7b-4321-4acd-831e-a1420246c794", "name": "network-vif-deleted", "tag": "38a668b2-11af-470e-8ba9-5d4f822fcfd0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:03.196651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2f0468d5-24f1-4b32-bf6d-5ad6c5805faf req-615e1413-34f5-4f7f-aed2-0041c5baf8d8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:03.199328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2f0468d5-24f1-4b32-bf6d-5ad6c5805faf req-615e1413-34f5-4f7f-aed2-0041c5baf8d8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:03.205754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2f0468d5-24f1-4b32-bf6d-5ad6c5805faf req-615e1413-34f5-4f7f-aed2-0041c5baf8d8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:03.260671 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2f0468d5-24f1-4b32-bf6d-5ad6c5805faf req-615e1413-34f5-4f7f-aed2-0041c5baf8d8 service nova] Creating event network-vif-deleted:38a668b2-11af-470e-8ba9-5d4f822fcfd0 for instance 5b384c7b-4321-4acd-831e-a1420246c794 on n-h1-854441-12 Oct 17 15:48:03.289332 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2f0468d5-24f1-4b32-bf6d-5ad6c5805faf req-615e1413-34f5-4f7f-aed2-0041c5baf8d8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156993 Oct 17 15:48:03.299793 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2347/4950] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:03.343236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:03.344101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:03.370978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:03.380147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:03.380610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:03.387337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:03.392102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:03.396745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:04.423796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:04.462893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:04.471463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:04.474259 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f4879e4-7ad5-49d6-9734-072fb2438276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 1.172750 Oct 17 15:48:04.481821 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2348/4951] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:03 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:04.505509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:04.507835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:04.597690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:04.597690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:04.602923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:04.607848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:04.613757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:04.617784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:05.135044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:05.149893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:05.152104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:05.155681 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-93be2519-856c-4253-ae9c-c71d7f7d723d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 0.671797 Oct 17 15:48:05.162424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:05.163510 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2349/4952] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:04 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:05.169130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:05.175184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] [instance: 5b384c7b-4321-4acd-831e-a1420246c794] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:05.187938 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2793899-0087-4067-9ebb-1995c70950ef tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 2.220986 Oct 17 15:48:05.188611 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2604/4953] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:02 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:05.190929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:05.191945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:05.192612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:05.193600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:05.194279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:05.194960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:05.238576 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] HTTP exception thrown: Instance 5b384c7b-4321-4acd-831e-a1420246c794 could not be found. Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Request method failure captured: Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 HTTP/1.1 Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXjGtEShjeULpDCL1YFgp1NDGnaxTnTPG_L8_ySfjccjIxguJ_O1kYrrEXB0MRQTjAiOMBaz0PSio68n6SIVoAAMPpKMJ3Q_Dw_eKZxCDaBd7bRp0BbiqK6fmkQvIWVXjFArCio23TCa8-Vb1JbIZzOfOBpt6ohfr2nPvBVqtU2EuRw Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 081813733e79419a80f777371c76725d Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-196128293 Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/081813733e79419a80f777371c76725d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/081813733e79419a80f777371c76725d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_081813733e79419a80f777371c76725d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/081813733e79419a80f777371c76725d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-196128293 Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 081813733e79419a80f777371c76725d Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-196128293 Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerRescueTestJSONUnderV235-196128293-project Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 30d6823a721a4bbe8cde326981d14e3a Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-196128293-project Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 5b384c7b-4321-4acd-831e-a1420246c794 could not be found. Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '5b384c7b-4321-4acd-831e-a1420246c794'} Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b384c7b-4321-4acd-831e-a1420246c794 could not be found. Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b384c7b-4321-4acd-831e-a1420246c794 could not be found. Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:05.241459 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:05.248677 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:05.248677 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:05.248677 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:05.248677 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:05.248677 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:05.248677 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:05.248677 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b384c7b-4321-4acd-831e-a1420246c794 could not be found. Oct 17 15:48:05.248677 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:05.251519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] Returning 404 to user: Instance 5b384c7b-4321-4acd-831e-a1420246c794 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:05.253005 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5bb2a55-8aec-4200-93eb-09f2372e1704 tempest-ServerRescueTestJSONUnderV235-196128293 tempest-ServerRescueTestJSONUnderV235-196128293-project] 10.222.0.87 "GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794" status: 404 len: 111 microversion: 2.1 time: 0.087944 Oct 17 15:48:05.254411 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2350/4954] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:05 2022] GET /compute/v2.1/servers/5b384c7b-4321-4acd-831e-a1420246c794 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:48:05.527712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:05.528526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:05.550328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:05.553190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:05.553719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:05.555298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:05.555787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:05.556230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:06.197687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:06.200982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:06.240234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:06.241374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:06.246028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:06.248740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:06.249887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:06.257639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:07.791458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:07.822886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:07.832382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:07.853042 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f271179-b14f-428a-943c-3c15d8f564f2 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 2.329436 Oct 17 15:48:07.865537 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2605/4955] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:05 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:07.895687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:07.902969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:07.960002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:07.965187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:07.966662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:07.969219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:07.975230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:07.976843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:08.142343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:08.154895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:08.161518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:08.169597 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8fc28bd6-5516-4e36-8bb6-915a6eb0c702 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 1.981323 Oct 17 15:48:08.170883 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2351/4956] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:06 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:08.681048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:08.702120 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98d81fc8-5a87-460b-9649-85a7871df14b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.829782 Oct 17 15:48:08.715443 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2606/4957] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:07 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:08.767387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97798352-1f87-4ec5-b07b-29c9abbd5c07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da13bd3e-e6b5-4689-8113-c4dc4e1d2c0c"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:08.772422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97798352-1f87-4ec5-b07b-29c9abbd5c07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:08.783104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97798352-1f87-4ec5-b07b-29c9abbd5c07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:08.783867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97798352-1f87-4ec5-b07b-29c9abbd5c07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:08.784482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97798352-1f87-4ec5-b07b-29c9abbd5c07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:08.785430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97798352-1f87-4ec5-b07b-29c9abbd5c07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:08.786197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97798352-1f87-4ec5-b07b-29c9abbd5c07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:08.786815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97798352-1f87-4ec5-b07b-29c9abbd5c07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:08.921767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:08.922396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:08.933285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:08.946248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:08.952650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:08.956077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:08.959107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:08.962208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:09.400411 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97798352-1f87-4ec5-b07b-29c9abbd5c07 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637202 Oct 17 15:48:09.401507 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2352/4958] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:48:08 2022] POST /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments => generated 194 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:09.428945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:09.429663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:09.456270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:09.475786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:09.476516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:09.477133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:09.477597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:09.478032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:10.140391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:10.163628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:10.177320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:10.186306 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13b6bb80-ddb2-408f-91ba-82e1bdba75b5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 1.262558 Oct 17 15:48:10.204949 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2607/4959] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:08 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:10.215109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:10.227491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:10.246884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:10.259857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:10.268412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:10.269666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:10.270537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:10.271182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:10.827657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:10.837411 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9c1a985-db5f-4a19-86c7-59ab9c7963a2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.630982 Oct 17 15:48:10.838019 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2608/4960] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:10 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:10.903047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:10.947755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:10.957565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:10.964533 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8e5b64da-0288-4e65-8049-e3bebf4e221d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1730 microversion: 2.20 time: 1.561817 Oct 17 15:48:10.974198 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2353/4961] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:09 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1730 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:11.226482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:11.227514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:11.236488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:11.237411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:11.238044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:11.239848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:11.240789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:11.241445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:11.733288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:11.763709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:11.769894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:11.771169 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c3f7f7d-0651-4a14-978e-7e808a3e3cdb tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.557035 Oct 17 15:48:11.789784 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2609/4962] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:11 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:11.885440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:11.886817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:11.893962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=53 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:11.914363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:11.917435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:11.918063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:11.921519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:11.924893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:11.925518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:12.010672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:12.011566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:12.023630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:12.024420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:12.027246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:12.028216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:12.030162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:12.032201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:12.193031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:12.202860 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-061799a3-981f-47c4-998b-703c8cbb2567 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.321949 Oct 17 15:48:12.204220 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2354/4963] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:11 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:12.838964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:12.840215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:12.856859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:12.860594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:12.866865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:12.866865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:12.866865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:12.866865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:13.008676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:13.021840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:13.023635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:13.028126 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cfd7687b-0cf4-479c-95a5-5415ef33a19c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1717 microversion: 2.20 time: 1.026824 Oct 17 15:48:13.034949 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2610/4964] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:12 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1717 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:13.245364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:13.246481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:13.272019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:13.272568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:13.275703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:13.280065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:13.281365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:13.285945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:13.287407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:13.293425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:13.298047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:13.299396 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fab19284-bef9-424e-9bf8-23777cbcb0b4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.473027 Oct 17 15:48:13.308470 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2355/4965] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:12 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:13.879509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:13.903601 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-efae5a96-b01d-47d3-822d-6aa28205f5df tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.662350 Oct 17 15:48:13.907036 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2611/4966] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:13 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:14.328462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:14.329417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:14.345898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:14.346597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:14.347165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:14.347904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:14.348476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:14.348999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:14.834744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:14.852807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:14.854428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:14.862320 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef663be3-4fe2-49ba-a62e-91e83acdad02 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.531656 Oct 17 15:48:14.862320 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2356/4967] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:14 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:14.934801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:14.936804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:14.958227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:14.970750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:14.971314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:14.972224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:14.974553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:14.976300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:15.302545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:15.313409 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0214d73-7c8b-4dad-b1eb-7ffa980a09f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.382991 Oct 17 15:48:15.324235 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2612/4968] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:14 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:15.649230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-30c024f9-510e-4a7d-b112-1ff06f698190 req-ca2a5a5d-b654-43f2-a65e-35402f853cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f06aaa4-9003-4c2b-93f2-58dffe88714d", "name": "network-vif-plugged", "status": "completed", "tag": "266c890a-8733-4318-9e57-c80fb316ccdb"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:15.666956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-30c024f9-510e-4a7d-b112-1ff06f698190 req-ca2a5a5d-b654-43f2-a65e-35402f853cbc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:15.668276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-30c024f9-510e-4a7d-b112-1ff06f698190 req-ca2a5a5d-b654-43f2-a65e-35402f853cbc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:15.668956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-30c024f9-510e-4a7d-b112-1ff06f698190 req-ca2a5a5d-b654-43f2-a65e-35402f853cbc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:15.708843 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-30c024f9-510e-4a7d-b112-1ff06f698190 req-ca2a5a5d-b654-43f2-a65e-35402f853cbc service nova] Creating event network-vif-plugged:266c890a-8733-4318-9e57-c80fb316ccdb for instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d on n-h2-854441-12 Oct 17 15:48:15.720379 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-30c024f9-510e-4a7d-b112-1ff06f698190 req-ca2a5a5d-b654-43f2-a65e-35402f853cbc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075819 Oct 17 15:48:15.726301 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2357/4969] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:15.891910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:15.892729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:15.904587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:15.916761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:15.919835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:15.922081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:15.923709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:15.925211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:16.250659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:16.263051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:16.264936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:16.266725 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54c817b9-986e-4565-962e-5191c57431f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.380264 Oct 17 15:48:16.267906 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2613/4970] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:15 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:16.340809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:16.342285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:16.351620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:16.352574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:16.353227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:16.354338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:16.355250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:16.356119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:16.656427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:16.670430 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6dfc98de-3b7f-424d-be6c-2982b4b47baa tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.336415 Oct 17 15:48:16.682531 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2358/4971] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:16 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:17.295324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:17.296816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:17.305677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:17.306493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:17.307190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:17.308185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:17.308844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:17.309534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:17.667427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:17.683879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:17.685477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:17.686761 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3b405ee-b37c-4433-9bfd-99d6d89aec0e tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.397224 Oct 17 15:48:17.687347 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2614/4972] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:17 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:48:17.699768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:17.700983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:17.710166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:17.711122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:17.711779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:17.712669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:17.713294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:17.713899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:17.958064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:17.973785 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-514f0a1c-a96e-47ac-bfdc-22ac1dbec840 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.278186 Oct 17 15:48:17.978560 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2359/4973] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:17 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:18.725899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:18.726697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:18.739537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:18.742000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:18.743062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:18.745839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:18.747001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:18.750009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:19.005073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:19.006529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:19.032735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:19.035639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:19.037235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:19.040340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:19.042595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:19.044176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:19.113063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:19.276817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:19.294929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:19.300598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:19.304648 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6c6dea0-6254-4bd6-b9ba-6ac7b55a496a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.583027 Oct 17 15:48:19.314936 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2615/4974] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:18 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:19.351317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:19.362355 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-45dd95c6-d371-4f5c-9fd2-3eac52804597 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.361511 Oct 17 15:48:19.363528 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2360/4975] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:18 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:20.340571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:20.342055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:20.361182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:20.361692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:20.362132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:20.369335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:20.370074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:20.370913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:20.387503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:20.388772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:20.406105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:20.412998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:20.412998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:20.412998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:20.413798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:20.413798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:20.825692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:20.857658 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-75ebf461-4b3e-463c-b7cc-5a51152747a5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1520 microversion: 2.1 time: 0.473421 Oct 17 15:48:20.859901 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2361/4976] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:20 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1520 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:20.938834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:20.949975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:20.960239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:20.961792 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79c4aac3-0ca4-468f-be04-84246888bd59 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.626196 Oct 17 15:48:20.962398 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2616/4977] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:20 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:21.887237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:21.888300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:21.921861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:21.922370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:21.925568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:21.927493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:21.928060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:21.930793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:21.992185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:21.993042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:22.012603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:22.017786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:22.018427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:22.029788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:22.030471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:22.031459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:22.384524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:22.400106 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9121fc6a-b8c3-469e-a2dd-cf61b6216a0d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.521436 Oct 17 15:48:22.401686 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2362/4978] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:21 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:22.436548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:22.446025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:22.479657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:22.480142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:22.480870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:22.481798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:22.482440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:22.483173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:22.932333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:22.944286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:22.945811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:22.947079 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9dfbbe0d-1ef4-431c-9f37-c632112b0521 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.961306 Oct 17 15:48:22.948271 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2617/4979] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:21 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:22.993972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:23.006137 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6a06fdea-5109-45f4-b1f4-2631857c8827 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.581478 Oct 17 15:48:23.024666 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2363/4980] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:22 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:23.045455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:23.046903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:23.055485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:23.056017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:23.056467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:23.057214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:23.057674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:23.058100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:23.980209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:23.981123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:24.011205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:24.012520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:24.013190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:24.017529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:24.018255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:24.019237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:24.096080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:24.105228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ccf0d07-5e2d-4a1e-9c89-9fa37487fa42 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 1.066132 Oct 17 15:48:24.111244 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2618/4981] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:23 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:24.138263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-114b93b2-58ec-4cf0-8515-c9585920b7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:24.157632 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-114b93b2-58ec-4cf0-8515-c9585920b7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 430a8b7c-1699-445a-a974-ae6a44645c47 has no mapping to a cell. Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-114b93b2-58ec-4cf0-8515-c9585920b7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/430a8b7c-1699-445a-a974-ae6a44645c47/action HTTP/1.1 Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 15 Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: {"os-stop": {}} Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 430a8b7c-1699-445a-a974-ae6a44645c47 has no mapping to a cell. Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '430a8b7c-1699-445a-a974-ae6a44645c47', 'body': {'os-stop': {}}} Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 430a8b7c-1699-445a-a974-ae6a44645c47 has no mapping to a cell. Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:48:24.169633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430a8b7c-1699-445a-a974-ae6a44645c47 has no mapping to a cell. Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430a8b7c-1699-445a-a974-ae6a44645c47 has no mapping to a cell. Oct 17 15:48:24.173943 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:24.176223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-114b93b2-58ec-4cf0-8515-c9585920b7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 430a8b7c-1699-445a-a974-ae6a44645c47 has no mapping to a cell. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:24.177454 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-114b93b2-58ec-4cf0-8515-c9585920b7c5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/430a8b7c-1699-445a-a974-ae6a44645c47/action" status: 404 len: 117 microversion: 2.1 time: 0.043521 Oct 17 15:48:24.182054 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2619/4982] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:48:24 2022] POST /compute/v2.1/servers/430a8b7c-1699-445a-a974-ae6a44645c47/action => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:48:24.190861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:24.191771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:24.199718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:24.201279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:24.202019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:24.203117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:24.203859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:24.204510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:24.447442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:24.462948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:24.464471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:24.465739 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b24dc6e1-e2da-4e12-933c-254707394fe7 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.489945 Oct 17 15:48:24.476120 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2364/4983] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:23 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:48:24.918478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-10a60c92-80aa-4cf9-804f-0757412225d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:24.921908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-10a60c92-80aa-4cf9-804f-0757412225d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:24.930266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10a60c92-80aa-4cf9-804f-0757412225d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:24.931252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10a60c92-80aa-4cf9-804f-0757412225d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:24.931953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10a60c92-80aa-4cf9-804f-0757412225d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:24.932948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10a60c92-80aa-4cf9-804f-0757412225d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:24.933654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10a60c92-80aa-4cf9-804f-0757412225d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:24.935539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10a60c92-80aa-4cf9-804f-0757412225d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:24.960003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:24.967620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:24.973947 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ccaab6b-098e-4418-a1f5-2aff630cbcb7 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.789758 Oct 17 15:48:24.977417 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2620/4984] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:24 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:25.008119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:25.014912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:25.045991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:25.051106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:25.057457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:25.058541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:25.059311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:25.059968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:25.130124 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-10a60c92-80aa-4cf9-804f-0757412225d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210634 Oct 17 15:48:25.133852 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2365/4985] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:48:24 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:25.164574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cdd28b5b-f37e-4603-ab30-8649139e9b48 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:25.165794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cdd28b5b-f37e-4603-ab30-8649139e9b48 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:25.180178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdd28b5b-f37e-4603-ab30-8649139e9b48 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:25.181470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdd28b5b-f37e-4603-ab30-8649139e9b48 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:25.182487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdd28b5b-f37e-4603-ab30-8649139e9b48 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:25.185209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdd28b5b-f37e-4603-ab30-8649139e9b48 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:25.187471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdd28b5b-f37e-4603-ab30-8649139e9b48 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:25.189580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cdd28b5b-f37e-4603-ab30-8649139e9b48 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:25.346214 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cdd28b5b-f37e-4603-ab30-8649139e9b48 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/da13bd3e-e6b5-4689-8113-c4dc4e1d2c0c" status: 200 len: 194 microversion: 2.1 time: 0.203656 Oct 17 15:48:25.348302 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2366/4986] 10.222.0.87 () {58 vars in 1413 bytes} [Mon Oct 17 15:48:25 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/da13bd3e-e6b5-4689-8113-c4dc4e1d2c0c => generated 194 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:48:25.502991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:25.506302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:25.540835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:25.545613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:25.548792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:25.554418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:25.559258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:25.560413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:26.087323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:26.104050 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-436598c8-84f9-4961-8195-27d2c77bd813 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 1.099164 Oct 17 15:48:26.115921 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2621/4987] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:25 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:26.129833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6faef26f-7f3a-4b6b-ba6e-51d97a97a5f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:26.130703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6faef26f-7f3a-4b6b-ba6e-51d97a97a5f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 79915b94-a39f-4197-950a-854f69b8cb97] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:26.146171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:26.176635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:26.177965 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6faef26f-7f3a-4b6b-ba6e-51d97a97a5f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 79915b94-a39f-4197-950a-854f69b8cb97 could not be found. Oct 17 15:48:26.182187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6faef26f-7f3a-4b6b-ba6e-51d97a97a5f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/79915b94-a39f-4197-950a-854f69b8cb97/action HTTP/1.1 Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 15 Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: {"suspend": {}} Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 79915b94-a39f-4197-950a-854f69b8cb97 could not be found. Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '79915b94-a39f-4197-950a-854f69b8cb97', 'body': {'suspend': {}}} Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79915b94-a39f-4197-950a-854f69b8cb97 could not be found. Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79915b94-a39f-4197-950a-854f69b8cb97 could not be found. Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:26.182630 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:26.187003 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:26.187003 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:26.187003 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79915b94-a39f-4197-950a-854f69b8cb97 could not be found. Oct 17 15:48:26.187003 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:26.189496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6faef26f-7f3a-4b6b-ba6e-51d97a97a5f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 79915b94-a39f-4197-950a-854f69b8cb97 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:26.190474 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-82d21510-e6a4-4a36-a7c6-8726f0e0684f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.701061 Oct 17 15:48:26.191753 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6faef26f-7f3a-4b6b-ba6e-51d97a97a5f2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/79915b94-a39f-4197-950a-854f69b8cb97/action" status: 404 len: 111 microversion: 2.1 time: 0.066765 Oct 17 15:48:26.200615 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2367/4988] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:25 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:48:26.201664 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2622/4989] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:48:26 2022] POST /compute/v2.1/servers/79915b94-a39f-4197-950a-854f69b8cb97/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:48:26.208540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:26.209458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:26.233037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:26.238565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:26.239475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:26.241500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:26.242206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:26.243217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:27.178856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:27.189323 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-41cbb0cd-4cf1-48f9-b9c5-ac51ce22f10b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.985032 Oct 17 15:48:27.206530 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2368/4990] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:26 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:27.219270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:27.220681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:27.227992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:27.229239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:27.232282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:27.236780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:27.237580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:27.238193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:27.238601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:27.239310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:27.239846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:27.240385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:27.240789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:27.241495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:27.241639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:27.243178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:27.648648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:27.699946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:27.700825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:27.711628 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3b99251-5dbd-4f93-bb32-a43cdcbee2f8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.482878 Oct 17 15:48:27.712500 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2369/4991] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:27 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:27.951520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:27.980547 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e281f152-e3db-48b9-b93b-90d3f5c67dc5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.765149 Oct 17 15:48:27.982580 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2623/4992] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:27 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:28.011396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:28.012027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:28.028738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:28.029310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:28.029735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:28.030596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:28.031474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:28.032000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:28.075994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lazy-loading 'flavor' on Instance uuid 6f06aaa4-9003-4c2b-93f2-58dffe88714d {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:48:28.259956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c18b1de0-fd89-4c07-aa98-32a9c9ad0e03 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dd68d7c-79d1-4604-9831-5e117a1f4228"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:28.266193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c18b1de0-fd89-4c07-aa98-32a9c9ad0e03 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:28.291606 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f183bf55-8b3d-4a27-8f07-41ff95dd9847 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 202 len: 0 microversion: 2.1 time: 0.285930 Oct 17 15:48:28.294614 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2370/4993] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:48:28 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:48:28.298304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c18b1de0-fd89-4c07-aa98-32a9c9ad0e03 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:28.304885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c18b1de0-fd89-4c07-aa98-32a9c9ad0e03 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:28.311681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c18b1de0-fd89-4c07-aa98-32a9c9ad0e03 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:28.313940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c18b1de0-fd89-4c07-aa98-32a9c9ad0e03 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:28.315236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c18b1de0-fd89-4c07-aa98-32a9c9ad0e03 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:28.316180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c18b1de0-fd89-4c07-aa98-32a9c9ad0e03 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:28.327530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:28.328930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:28.369891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:28.370766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:28.371551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:28.372777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:28.373558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:28.374280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:29.084410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:29.101247 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c18b1de0-fd89-4c07-aa98-32a9c9ad0e03 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "POST /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849003 Oct 17 15:48:29.112503 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2624/4994] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:48:28 2022] POST /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:48:29.118665 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f6089476-6048-4418-84e6-5a968a958b22 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1515 microversion: 2.1 time: 0.816309 Oct 17 15:48:29.123555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:29.124694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:29.132238 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2371/4995] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:28 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1515 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:29.135383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:29.137384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:29.138302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:29.146475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:29.155516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:29.157257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:29.160256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:29.728106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-794763030", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "54423d23-912b-4e26-80bb-450813721e3a"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:29.891842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] validate_networks() for [('54423d23-912b-4e26-80bb-450813721e3a', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:48:29.998784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:30.017510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:30.019306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:30.020790 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-896927b1-9c3c-41d1-bd07-9f14be07f0f5 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.906682 Oct 17 15:48:30.035682 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2625/4996] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:29 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:30.173123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:30.174004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:30.184193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:30.188452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:30.189104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:30.190035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:30.190732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:30.191356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:30.536182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:30.553354 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3c703ab-641f-4ddf-9102-dda7c4cfefcf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1498 microversion: 2.1 time: 0.406036 Oct 17 15:48:30.558716 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2626/4997] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:30 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1498 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:30.584818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:30.585814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:30.604771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:30.605413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:30.605948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:30.606800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:30.610432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:30.611060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:30.694291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lazy-loading 'flavor' on Instance uuid 6f06aaa4-9003-4c2b-93f2-58dffe88714d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:48:30.725815 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Cannot 'suspend' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state suspended Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action HTTP/1.1 Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 15 Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: {"suspend": {}} Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'suspend' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state suspended Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d', 'body': {'suspend': {}}} Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d in vm_state suspended. Cannot suspend while the instance is in this state. Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 17 15:48:30.727897 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state suspended Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state suspended Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:30.732660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 409 to user: Cannot 'suspend' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state suspended {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:30.734347 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51ef973c-c7a9-4606-98d1-47f6b256af49 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 409 len: 148 microversion: 2.1 time: 0.155311 Oct 17 15:48:30.735648 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2627/4998] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:48:30 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 148 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 15:48:30.744523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab28fc43-5c39-4bb3-b78c-5de53c0b590a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:30.753222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab28fc43-5c39-4bb3-b78c-5de53c0b590a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:30.765547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab28fc43-5c39-4bb3-b78c-5de53c0b590a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:30.766728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab28fc43-5c39-4bb3-b78c-5de53c0b590a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:30.767431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab28fc43-5c39-4bb3-b78c-5de53c0b590a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:30.768641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab28fc43-5c39-4bb3-b78c-5de53c0b590a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:30.772959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab28fc43-5c39-4bb3-b78c-5de53c0b590a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:30.773760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab28fc43-5c39-4bb3-b78c-5de53c0b590a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:30.955847 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab28fc43-5c39-4bb3-b78c-5de53c0b590a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 202 len: 0 microversion: 2.1 time: 0.215475 Oct 17 15:48:30.959642 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2628/4999] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:48:30 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:48:30.965804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:30.974388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:31.008131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:31.012286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:31.014184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:31.023564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:31.025274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:31.031276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:31.382126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:48:31.384090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:48:31.386798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:48:31.389627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:48:31.391798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:48:31.430138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:31.432974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:31.434078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:31.437050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:31.441332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:31.442315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:31.497778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:48:31.506139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for user bec6f504a59b46228db013140f4ce605 and project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:48:31.538804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:48:31.543128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:48:31.558211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:31.586465 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9452de8-9f9e-46e3-865d-05ad0f8662b3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1504 microversion: 2.1 time: 0.624785 Oct 17 15:48:31.594818 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2629/5000] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:30 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:31.612078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:31.612950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:31.640822 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c93aabe9-0feb-4473-9644-7508f36df287 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.198741 Oct 17 15:48:31.641443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:31.641572 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2372/5001] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:48:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:48:31.645546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:31.648035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:31.649070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:31.651150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:31.652344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:31.662644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20cf8ec2-9479-4079-ae89-bbe0dd1a7dd7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:31.663274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-20cf8ec2-9479-4079-ae89-bbe0dd1a7dd7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:32.067317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-20cf8ec2-9479-4079-ae89-bbe0dd1a7dd7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:32.078803 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20cf8ec2-9479-4079-ae89-bbe0dd1a7dd7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1192 microversion: 2.1 time: 0.426984 Oct 17 15:48:32.089869 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2373/5002] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:31 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1192 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:32.621857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:32.623209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:32.624119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:32.634448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:32.635266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:32.635914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:32.636955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:32.637660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:32.638433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:32.647242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:32.653310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:32.659231 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-024f9bf3-c72a-45b5-a51b-d5a0516043ea tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 1.060895 Oct 17 15:48:32.685985 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2630/5003] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:31 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:33.127960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b351e0b-5068-4e89-a19c-9c5225e52ad0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:33.141256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b351e0b-5068-4e89-a19c-9c5225e52ad0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:33.212870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:33.251581 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-50addcc6-6126-474a-a522-d4555dc34082 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1504 microversion: 2.1 time: 0.635105 Oct 17 15:48:33.258453 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2374/5004] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:32 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:33.382457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b351e0b-5068-4e89-a19c-9c5225e52ad0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:33.402010 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b351e0b-5068-4e89-a19c-9c5225e52ad0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1192 microversion: 2.1 time: 0.280607 Oct 17 15:48:33.404268 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2631/5005] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:33 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1192 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:33.696035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:33.704168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:33.755833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:33.761177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:33.762916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:33.764603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:33.765897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:33.767285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:34.288524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:34.297001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:34.339800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:34.345749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:34.346512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:34.350554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:34.351299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:34.356655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:34.534859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:34.567276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:34.569322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:34.573993 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e62edc72-eff0-4828-a99b-bf7b56c58276 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.885645 Oct 17 15:48:34.575768 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2375/5006] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:33 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:34.599780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:34.614450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:34.636273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:34.637268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:34.639184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:34.640499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:34.641422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:34.648242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:34.915783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:34.927584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:34.954340 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92d73027-2b1e-4cd4-80ce-897abac4896c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1252 microversion: 2.1 time: 0.376298 Oct 17 15:48:34.962568 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2376/5007] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:34 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1252 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:35.625171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:35.627790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:35.663250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:35.669065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:35.671764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:35.675892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:35.678652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:35.681940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:35.818634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:35.842359 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f6ab384-ed32-46a3-a61b-cd6e89cea403 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1504 microversion: 2.1 time: 1.563567 Oct 17 15:48:35.842913 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2632/5008] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:34 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1504 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:35.987132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:35.988080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:35.998994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:36.001628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:36.004115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:36.005109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:36.008410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:36.008863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:36.208110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:36.224754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:36.234894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:36.236448 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-096a713d-ff49-4963-957f-7dc38d0d13cd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.619801 Oct 17 15:48:36.239165 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2377/5009] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:35 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:36.429759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:36.452618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8c7bd76-6b02-41dc-8f6b-35b70bc247fc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1250 microversion: 2.1 time: 0.462415 Oct 17 15:48:36.468279 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2633/5010] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:35 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1250 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:36.869225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:36.870277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:36.887710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:36.887710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:36.887965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:36.888699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:36.890815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:36.893312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:37.270948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:37.271852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:37.285019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:37.289732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:37.292135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:37.294441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:37.295338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:37.301674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:37.702179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:37.712541 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-46f16a60-52f2-463f-a3f9-d4aee1bed9e3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.847515 Oct 17 15:48:37.714053 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2378/5011] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:36 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:37.745026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:37.746489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:37.772473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:37.773032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:37.773487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:37.789445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:37.790600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:37.791495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:38.048395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:38.067775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:38.070815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:38.079455 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b3244c8-f1cf-4a36-971f-a1dda840c39d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.812856 Oct 17 15:48:38.080723 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2634/5012] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:37 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:38.091994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:38.095199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:38.115318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:38.136698 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7d5a0b20-0738-45e6-bbab-d8ab8daa3be1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1292 microversion: 2.1 time: 0.421013 Oct 17 15:48:38.137998 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2379/5013] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:37 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1292 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:38.140162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:38.140677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:38.141232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:38.141979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:38.142431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:38.142895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:38.632469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:38.644242 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e566932e-f4e8-485d-96fd-0a2f6456a046 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.562058 Oct 17 15:48:38.648819 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2635/5014] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:38 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:38.670727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2752edbf-93c3-4085-8abd-c6479601c44d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:38.671582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2752edbf-93c3-4085-8abd-c6479601c44d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 2f064259-af6c-4164-b1e7-cfdb3176a51a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:38.681836 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-2752edbf-93c3-4085-8abd-c6479601c44d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 2f064259-af6c-4164-b1e7-cfdb3176a51a could not be found. Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2752edbf-93c3-4085-8abd-c6479601c44d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/2f064259-af6c-4164-b1e7-cfdb3176a51a/action HTTP/1.1 Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 15 Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: {"unpause": {}} Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 2f064259-af6c-4164-b1e7-cfdb3176a51a could not be found. Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '2f064259-af6c-4164-b1e7-cfdb3176a51a', 'body': {'unpause': {}}} Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f064259-af6c-4164-b1e7-cfdb3176a51a could not be found. Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f064259-af6c-4164-b1e7-cfdb3176a51a could not be found. Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:38.685143 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:38.694028 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:38.694028 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:38.694028 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f064259-af6c-4164-b1e7-cfdb3176a51a could not be found. Oct 17 15:48:38.694028 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:38.701382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2752edbf-93c3-4085-8abd-c6479601c44d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 2f064259-af6c-4164-b1e7-cfdb3176a51a could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:38.701382 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2752edbf-93c3-4085-8abd-c6479601c44d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/2f064259-af6c-4164-b1e7-cfdb3176a51a/action" status: 404 len: 111 microversion: 2.1 time: 0.030474 Oct 17 15:48:38.701382 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2380/5015] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:48:38 2022] POST /compute/v2.1/servers/2f064259-af6c-4164-b1e7-cfdb3176a51a/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:48:38.707709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:38.708270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:38.723847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:38.724363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:38.729591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:38.747513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:38.748181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:38.748640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:39.108996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:39.109868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:39.134657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:39.135441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:39.136448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:39.138226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:39.139858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:39.140639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:39.422938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:39.437069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc7087a6-b152-450a-a530-77291463eabe tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.733270 Oct 17 15:48:39.438147 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2636/5016] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:38 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:39.451801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:39.452345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:39.476556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:39.477082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:39.477486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:39.478212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:39.478703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:39.479928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:39.487162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:39.798075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:39.812098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:39.822867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:39.827885 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-54c1be52-f8d3-4a22-8250-3bed1d88f9ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.721657 Oct 17 15:48:39.849712 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2381/5017] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:39 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:39.856213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:39.857138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:39.865874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:39.866772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:39.867449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:39.869102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:39.870284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:39.872161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:40.067205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:40.080633 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d035ddf-3341-4b38-b93a-fb59801216f0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1292 microversion: 2.1 time: 0.639528 Oct 17 15:48:40.083405 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2637/5018] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:39 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1292 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:40.344466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6a339f2e-091f-46ce-9be9-5f0ef5539caa req-03bcdcdb-f3dd-44b5-993b-df3d5e9766b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0085d265-5f11-46e5-a77f-ffd5a2ccb1b9", "tag": "0d5c2440-50c9-4416-8d8c-537faec8b77c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:40.359828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a339f2e-091f-46ce-9be9-5f0ef5539caa req-03bcdcdb-f3dd-44b5-993b-df3d5e9766b5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:40.360723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a339f2e-091f-46ce-9be9-5f0ef5539caa req-03bcdcdb-f3dd-44b5-993b-df3d5e9766b5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:40.361366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6a339f2e-091f-46ce-9be9-5f0ef5539caa req-03bcdcdb-f3dd-44b5-993b-df3d5e9766b5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:40.376528 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6a339f2e-091f-46ce-9be9-5f0ef5539caa req-03bcdcdb-f3dd-44b5-993b-df3d5e9766b5 service nova] Creating event network-changed:0d5c2440-50c9-4416-8d8c-537faec8b77c for instance 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 on n-h1-854441-12 Oct 17 15:48:40.385310 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6a339f2e-091f-46ce-9be9-5f0ef5539caa req-03bcdcdb-f3dd-44b5-993b-df3d5e9766b5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.298646 Oct 17 15:48:40.386311 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2638/5019] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:40.513533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:40.528062 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-67cc060b-2144-4917-800e-76ef57d75b17 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.676389 Oct 17 15:48:40.529683 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2382/5020] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:39 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:40.575558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:40.576829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:40.597513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:40.598897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:40.599604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:40.605084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:40.613120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:40.616813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:40.720614 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Cannot 'unpause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action HTTP/1.1 Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 15 Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: {"unpause": {}} Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'unpause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d', 'body': {'unpause': {}}} Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d in vm_state active. Cannot unpause while the instance is in this state. Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:40.727125 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:40.732143 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:40.732143 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:40.732143 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:40.732143 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:48:40.732143 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:40.732143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 409 to user: Cannot 'unpause' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:40.732143 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-672db15e-acad-41b9-ae79-4a8aa282c6de tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 409 len: 145 microversion: 2.1 time: 0.160318 Oct 17 15:48:40.732646 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2639/5021] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:48:40 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 145 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 15:48:40.744994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:40.745550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:40.759151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:40.759679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:40.760138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:40.763293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:40.763852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:40.764310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:40.882143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:40.901899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:40.955688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:40.955948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:40.956185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:40.956940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:40.957404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:40.957831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:41.318708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:41.332487 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-caf28f97-2d54-46db-87de-3e78189931f5 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.592995 Oct 17 15:48:41.350922 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2383/5022] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:40 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:41.484025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:41.974458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:41.984551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:41.994330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8db27dad-178a-4ae9-a694-423758a94ea5 req-dc455a5f-4c94-494c-93d7-9e2dd1e4c740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-plugged", "status": "completed", "tag": "39f10735-71ca-470f-b9b6-7a8e6629500c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:42.007474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:42.013438 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9cb00ba3-84b1-4e7a-afd8-8423fa78a8d6 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 1.152762 Oct 17 15:48:42.018852 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2640/5023] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:40 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:42.023464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:42.030181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:42.033760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8db27dad-178a-4ae9-a694-423758a94ea5 req-dc455a5f-4c94-494c-93d7-9e2dd1e4c740 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:42.035921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8db27dad-178a-4ae9-a694-423758a94ea5 req-dc455a5f-4c94-494c-93d7-9e2dd1e4c740 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:42.036892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8db27dad-178a-4ae9-a694-423758a94ea5 req-dc455a5f-4c94-494c-93d7-9e2dd1e4c740 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:42.043502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:42.062536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:42.064165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:42.067796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:42.072358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:42.079671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:42.079671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:42.079902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:42.085260 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8db27dad-178a-4ae9-a694-423758a94ea5 req-dc455a5f-4c94-494c-93d7-9e2dd1e4c740 service nova] Creating event network-vif-plugged:39f10735-71ca-470f-b9b6-7a8e6629500c for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:48:42.104997 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8db27dad-178a-4ae9-a694-423758a94ea5 req-dc455a5f-4c94-494c-93d7-9e2dd1e4c740 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.769167 Oct 17 15:48:42.106472 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2384/5024] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:42.132365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:42.133580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:42.159958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:42.161779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:42.166674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:42.170849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:42.171691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:42.176796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:42.929439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:42.945335 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95fe28b6-135b-47dd-a248-ce7fa5243f25 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.835910 Oct 17 15:48:42.969256 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2385/5025] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:42 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:42.982269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-655e5e6e-6080-48ed-a25b-e0f7513c7bb2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:42.983667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-655e5e6e-6080-48ed-a25b-e0f7513c7bb2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 7194b525-ed7a-47f2-941e-b9e33b39d654] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:42.997803 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-655e5e6e-6080-48ed-a25b-e0f7513c7bb2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 7194b525-ed7a-47f2-941e-b9e33b39d654 could not be found. Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-655e5e6e-6080-48ed-a25b-e0f7513c7bb2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/7194b525-ed7a-47f2-941e-b9e33b39d654/action HTTP/1.1 Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 18 Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: {"unshelve": null} Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 7194b525-ed7a-47f2-941e-b9e33b39d654 could not be found. Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7194b525-ed7a-47f2-941e-b9e33b39d654', 'body': {'unshelve': None}} Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7194b525-ed7a-47f2-941e-b9e33b39d654 could not be found. Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7194b525-ed7a-47f2-941e-b9e33b39d654 could not be found. Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:43.001462 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7194b525-ed7a-47f2-941e-b9e33b39d654 could not be found. Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-655e5e6e-6080-48ed-a25b-e0f7513c7bb2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 7194b525-ed7a-47f2-941e-b9e33b39d654 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-655e5e6e-6080-48ed-a25b-e0f7513c7bb2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/7194b525-ed7a-47f2-941e-b9e33b39d654/action" status: 404 len: 111 microversion: 2.1 time: 0.028365 Oct 17 15:48:43.010618 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2386/5026] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:48:42 2022] POST /compute/v2.1/servers/7194b525-ed7a-47f2-941e-b9e33b39d654/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:48:43.015094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:43.015749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:43.040124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:43.069597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:43.069597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:43.069597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:43.069597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:43.069597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:43.342287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:43.358040 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a59cc363-cd9a-4814-915d-b32115571bbf tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.346814 Oct 17 15:48:43.359228 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2387/5027] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:43 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:43.365188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:43.379026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:43.398698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:43.400770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:43.401231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:43.401990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:43.409963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:43.409963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:43.438165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:43.700714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:43.723765 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a02aff4-176d-4d00-bb1c-be282d59ba1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1292 microversion: 2.1 time: 1.703231 Oct 17 15:48:43.727433 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2641/5028] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:42 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1292 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:43.796028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:43.797595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:43.826531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:43.827354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:43.827961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:43.828957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:43.829623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:43.831656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:43.922185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:43.964171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:43.985205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:43.987737 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5edf2ce2-d405-4ed5-815b-683c3d32935a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.626075 Oct 17 15:48:43.988844 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2388/5029] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:43 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:44.208480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b0b64942-760a-4689-af99-258c1aee9b2f req-ac3e7187-dc09-4080-aae0-c6f5a96f3ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-plugged", "status": "completed", "tag": "a89396e5-b63d-407b-8fb4-cfdd873892f8"}, {"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-plugged", "status": "completed", "tag": "3c70d92c-4ec6-4149-8343-459bac51739d"}, {"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-plugged", "status": "completed", "tag": "0f279a23-da10-436b-938e-d8af8305e6bd"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:44.285585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b0b64942-760a-4689-af99-258c1aee9b2f req-ac3e7187-dc09-4080-aae0-c6f5a96f3ccc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:44.286893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b0b64942-760a-4689-af99-258c1aee9b2f req-ac3e7187-dc09-4080-aae0-c6f5a96f3ccc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:44.287781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b0b64942-760a-4689-af99-258c1aee9b2f req-ac3e7187-dc09-4080-aae0-c6f5a96f3ccc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:44.313119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:44.322612 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b0b64942-760a-4689-af99-258c1aee9b2f req-ac3e7187-dc09-4080-aae0-c6f5a96f3ccc service nova] Creating event network-vif-plugged:a89396e5-b63d-407b-8fb4-cfdd873892f8 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:48:44.325171 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b0b64942-760a-4689-af99-258c1aee9b2f req-ac3e7187-dc09-4080-aae0-c6f5a96f3ccc service nova] Creating event network-vif-plugged:3c70d92c-4ec6-4149-8343-459bac51739d for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:48:44.326451 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b0b64942-760a-4689-af99-258c1aee9b2f req-ac3e7187-dc09-4080-aae0-c6f5a96f3ccc service nova] Creating event network-vif-plugged:0f279a23-da10-436b-938e-d8af8305e6bd for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:48:44.346586 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b47c494-9e09-4d34-bc70-178f13e2d687 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.592919 Oct 17 15:48:44.346586 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2642/5030] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:43 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:44.354932 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b0b64942-760a-4689-af99-258c1aee9b2f req-ac3e7187-dc09-4080-aae0-c6f5a96f3ccc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.171831 Oct 17 15:48:44.355706 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2389/5031] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:44.396219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:44.397077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:44.403561 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:48:44.403905 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 15:48:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action (ip 10.222.0.87) !!! Oct 17 15:48:44.411998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:44.412496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:44.413144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:44.413899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:44.414355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:44.414825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:44.449564 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Cannot 'unshelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action HTTP/1.1 Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 18 Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: {"unshelve": null} Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: exception: Cannot 'unshelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d', 'body': {'unshelve': None}} Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d in vm_state active. Cannot unshelve while the instance is in this state. Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 15:48:44.451616 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active Oct 17 15:48:44.456636 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:44.458864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 409 to user: Cannot 'unshelve' instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d while it is in vm_state active {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:44.459493 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9962a26e-c88e-40b2-b058-d45ef008a91e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action" status: 409 len: 146 microversion: 2.1 time: 0.069916 Oct 17 15:48:44.462570 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2643/5032] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:48:44 2022] POST /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d/action => generated 146 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 15:48:44.472349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:44.473093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:44.480302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:44.480792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:44.483656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:44.484849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:44.485566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:44.486397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:44.758779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:44.759204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:44.763491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:44.775319 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f328db83-43e1-4020-a0eb-cf90ae65f06c tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.307134 Oct 17 15:48:44.778589 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2390/5033] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:44 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:44.780394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:44.780956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:44.781440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:44.782188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:44.782685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:44.783613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:44.803611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:44.804418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:44.815600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:44.816166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:44.816843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:44.817785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:44.818301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:44.819013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:45.048267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:45.058979 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb87f460-d64f-41ea-91aa-17478c4c297f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1292 microversion: 2.1 time: 0.307109 Oct 17 15:48:45.061325 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2644/5034] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:44 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1292 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:45.066672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:45.068452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:45.073115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:45.075919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:45.076511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:45.077045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:45.077980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:45.078888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:45.079783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:45.090774 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a3bb8e62-8977-48aa-af59-fd0c3cc53be3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.292983 Oct 17 15:48:45.104949 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2391/5035] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:44 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:45.117626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-30f88de1-6c6a-4ed4-916c-d66a9b632630 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1090231154_updated"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:45.120975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-30f88de1-6c6a-4ed4-916c-d66a9b632630 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: ab140e25-4b08-4296-8b7f-a536535a70ca] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:45.128763 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-30f88de1-6c6a-4ed4-916c-d66a9b632630 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance ab140e25-4b08-4296-8b7f-a536535a70ca could not be found. Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-30f88de1-6c6a-4ed4-916c-d66a9b632630 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: request: PUT /compute/v2.1/servers/ab140e25-4b08-4296-8b7f-a536535a70ca HTTP/1.1 Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 81 Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1090231154_updated"}} Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ab140e25-4b08-4296-8b7f-a536535a70ca could not be found. Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ab140e25-4b08-4296-8b7f-a536535a70ca', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1090231154_updated'}}} Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab140e25-4b08-4296-8b7f-a536535a70ca could not be found. Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 17 15:48:45.131342 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab140e25-4b08-4296-8b7f-a536535a70ca could not be found. Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab140e25-4b08-4296-8b7f-a536535a70ca could not be found. Oct 17 15:48:45.136561 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.141193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-30f88de1-6c6a-4ed4-916c-d66a9b632630 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance ab140e25-4b08-4296-8b7f-a536535a70ca could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:45.142339 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-30f88de1-6c6a-4ed4-916c-d66a9b632630 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "PUT /compute/v2.1/servers/ab140e25-4b08-4296-8b7f-a536535a70ca" status: 404 len: 111 microversion: 2.1 time: 0.029154 Oct 17 15:48:45.147635 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2392/5036] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 15:48:45 2022] PUT /compute/v2.1/servers/ab140e25-4b08-4296-8b7f-a536535a70ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:48:45.165057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:45.166186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:45.181382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:45.182302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:45.182874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:45.183998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:45.184531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:45.185207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:45.420909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:45.447827 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-85856a55-7908-4ce8-a493-5f151f6c82a3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.294045 Oct 17 15:48:45.449364 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2393/5037] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:45 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:45.463206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:45.477276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:45.478386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:45.483988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:45.487025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:45.488289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:45.489406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:45.490089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:45.490756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3b4db14-bd38-4e69-a664-60d81e4f1836 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.428106 Oct 17 15:48:45.491873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:45.494101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:45.494913 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2645/5038] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:45 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:45.496252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:45.908958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:45.926331 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-09a8421d-7e7e-4482-a957-0742c0e39cd6 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.453508 Oct 17 15:48:45.940557 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2394/5039] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:45 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:45.953697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87920458-b62c-4eb1-9cd9-1bb5af6be352 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87920458-b62c-4eb1-9cd9-1bb5af6be352 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: request: PUT /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d HTTP/1.1 Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 280 Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.958912 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 15:48:45.964617 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:48:45.970719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87920458-b62c-4eb1-9cd9-1bb5af6be352 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:45.972689 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87920458-b62c-4eb1-9cd9-1bb5af6be352 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "PUT /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 400 len: 619 microversion: 2.1 time: 0.024124 Oct 17 15:48:45.977866 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2646/5040] 10.222.0.87 () {60 vars in 1257 bytes} [Mon Oct 17 15:48:45 2022] PUT /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:48:45.983720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:45.984621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:45.992351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:45.992849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:45.993439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:45.994186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:45.994690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:45.995330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.094088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:46.094325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:46.131131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:46.131649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:46.132100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.134690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:46.135191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:46.135633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.294429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:46.316069 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c9f6b42b-b080-4149-8950-52ab22c2caf1 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.336100 Oct 17 15:48:46.317156 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2395/5041] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:45 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:46.352039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:46.353120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:46.375380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:46.387847 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2b8469a-b83f-4ba3-8557-0e790c9cd972 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1292 microversion: 2.1 time: 0.301191 Oct 17 15:48:46.388797 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2647/5042] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:46 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1292 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:46.390832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:46.394743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:46.395523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.397095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:46.398125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:46.400035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.524800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:46.528551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:46.539208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:46.539859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:46.540597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.541609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:46.542479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:46.542981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.640818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:46.662455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad07ed2b-932e-4579-aeaf-abd99c6a04b2 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.321242 Oct 17 15:48:46.664820 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2396/5043] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:46 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:48:46.676191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9571107a-4531-4e14-9c23-6b060ac04e9c req-39f50690-6354-4d08-8d37-2e188804548e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-plugged", "status": "completed", "tag": "6ef23b02-c3af-4bff-97d6-68183f1e63d3"}, {"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-plugged", "status": "completed", "tag": "ced7f9e8-794b-4f8d-96e3-2e670ce44545"}, {"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-plugged", "status": "completed", "tag": "b7535a0d-d61b-4a19-99f0-a6cd01a96405"}, {"server_uuid": "0085d265-5f11-46e5-a77f-ffd5a2ccb1b9", "name": "network-vif-plugged", "status": "completed", "tag": "0d5c2440-50c9-4416-8d8c-537faec8b77c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:46.704131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9571107a-4531-4e14-9c23-6b060ac04e9c req-39f50690-6354-4d08-8d37-2e188804548e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:46.704753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9571107a-4531-4e14-9c23-6b060ac04e9c req-39f50690-6354-4d08-8d37-2e188804548e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:46.705556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9571107a-4531-4e14-9c23-6b060ac04e9c req-39f50690-6354-4d08-8d37-2e188804548e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.732270 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9571107a-4531-4e14-9c23-6b060ac04e9c req-39f50690-6354-4d08-8d37-2e188804548e service nova] Creating event network-vif-plugged:6ef23b02-c3af-4bff-97d6-68183f1e63d3 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:48:46.733162 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9571107a-4531-4e14-9c23-6b060ac04e9c req-39f50690-6354-4d08-8d37-2e188804548e service nova] Creating event network-vif-plugged:ced7f9e8-794b-4f8d-96e3-2e670ce44545 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:48:46.734033 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9571107a-4531-4e14-9c23-6b060ac04e9c req-39f50690-6354-4d08-8d37-2e188804548e service nova] Creating event network-vif-plugged:b7535a0d-d61b-4a19-99f0-a6cd01a96405 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:48:46.734978 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9571107a-4531-4e14-9c23-6b060ac04e9c req-39f50690-6354-4d08-8d37-2e188804548e service nova] Creating event network-vif-plugged:0d5c2440-50c9-4416-8d8c-537faec8b77c for instance 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 on n-h1-854441-12 Oct 17 15:48:46.768775 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9571107a-4531-4e14-9c23-6b060ac04e9c req-39f50690-6354-4d08-8d37-2e188804548e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.087799 Oct 17 15:48:46.769904 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2397/5044] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:46.787017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55edda7c-c37c-4b35-a501-11d4054ca181 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55edda7c-c37c-4b35-a501-11d4054ca181 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: request: PUT /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d HTTP/1.1 Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 24 Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: {"server": {"name": ""}} Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d', 'body': {'server': {'name': ''}}} Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '' Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:48:46.795597 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55edda7c-c37c-4b35-a501-11d4054ca181 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-55edda7c-c37c-4b35-a501-11d4054ca181 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "PUT /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 400 len: 108 microversion: 2.1 time: 0.028891 Oct 17 15:48:46.806920 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2398/5045] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 15:48:46 2022] PUT /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:48:46.818363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:46.820414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:46.835660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:46.836702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:46.837656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.839072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:46.839945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:46.840937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:46.897218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:46.985862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:47.000586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:47.002343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:47.004113 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-229dc68a-beb3-4f12-bb09-128914863c07 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.483847 Oct 17 15:48:47.029420 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2648/5046] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:46 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:47.424032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:47.433452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:47.447656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:47.448656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:47.449523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:47.451504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:47.452717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:47.453863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:47.648648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:47.660534 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2867949b-a797-4caf-a001-aad0d1b4d75d tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1507 microversion: 2.1 time: 0.847442 Oct 17 15:48:47.661362 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2399/5047] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:46 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1507 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:47.696146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:47.708057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91ec6040-73a4-4ff6-83cf-5f3a0b5643f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1292 microversion: 2.1 time: 0.299656 Oct 17 15:48:47.717484 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2649/5048] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:47 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1292 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:48.042755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:48.046559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:48.077983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:48.082330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:48.083454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:48.088184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:48.089447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:48.092227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:48.617064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:48.634753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:48.636583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:48.637868 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9aabcba2-fce3-4179-afde-743a8322e70c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1875 microversion: 2.42 time: 0.605916 Oct 17 15:48:48.638464 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2400/5049] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:48 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1875 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:48.754226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:48.755064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:48.780818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:48.783189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:48.784938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:48.785901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:48.786602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:48.790064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:49.102989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:49.115595 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a013399-1d2f-4b62-8856-7400bc41dc66 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1473 microversion: 2.1 time: 0.368836 Oct 17 15:48:49.118189 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2650/5050] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:48 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1473 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:49.310335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-42d7acc0-f513-4bbd-a889-6c1e450183d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:49.316199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-42d7acc0-f513-4bbd-a889-6c1e450183d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:49.339045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42d7acc0-f513-4bbd-a889-6c1e450183d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:49.340505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42d7acc0-f513-4bbd-a889-6c1e450183d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:49.341868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42d7acc0-f513-4bbd-a889-6c1e450183d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:49.343449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42d7acc0-f513-4bbd-a889-6c1e450183d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:49.344705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42d7acc0-f513-4bbd-a889-6c1e450183d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:49.345646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42d7acc0-f513-4bbd-a889-6c1e450183d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:49.420250 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-42d7acc0-f513-4bbd-a889-6c1e450183d6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.121243 Oct 17 15:48:49.427076 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2401/5051] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:48:49 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:49.570746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-42e10a5b-ed1f-4fab-b706-8311e888a815 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:49.571584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1607899597", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:49.573612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-42e10a5b-ed1f-4fab-b706-8311e888a815 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:49.588150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e10a5b-ed1f-4fab-b706-8311e888a815 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:49.592331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e10a5b-ed1f-4fab-b706-8311e888a815 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:49.594913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e10a5b-ed1f-4fab-b706-8311e888a815 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:49.599053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e10a5b-ed1f-4fab-b706-8311e888a815 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:49.599970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e10a5b-ed1f-4fab-b706-8311e888a815 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:49.602430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42e10a5b-ed1f-4fab-b706-8311e888a815 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:49.669149 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-42e10a5b-ed1f-4fab-b706-8311e888a815 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/da13bd3e-e6b5-4689-8113-c4dc4e1d2c0c" status: 200 len: 194 microversion: 2.1 time: 0.108090 Oct 17 15:48:49.681334 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2402/5052] 10.222.0.87 () {58 vars in 1413 bytes} [Mon Oct 17 15:48:49 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/da13bd3e-e6b5-4689-8113-c4dc4e1d2c0c => generated 194 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:48:49.692454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:49.698638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:49.730230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:49.736872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:49.738009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:49.741453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:49.749719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:49.751286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:49.772722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] validate_networks() for [('54423d23-912b-4e26-80bb-450813721e3a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:48:50.023811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lazy-loading 'services' on Instance uuid 1b7fcd63-035e-4da8-98e7-dd8482ff909e {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:48:50.213737 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5f08e3d-027d-49be-9e5a-c351450afb88 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/da13bd3e-e6b5-4689-8113-c4dc4e1d2c0c" status: 202 len: 0 microversion: 2.1 time: 0.531052 Oct 17 15:48:50.228416 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2403/5053] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:48:49 2022] DELETE /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/da13bd3e-e6b5-4689-8113-c4dc4e1d2c0c => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:48:50.262427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:50.266188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:50.291085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:50.293491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:50.294570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:50.295338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:50.296192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:50.296995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:50.670534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:48:50.671849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:48:50.673022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:48:50.673641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:48:50.674255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:48:50.687155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:50.689551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:50.690376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:50.692645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:50.693413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:50.694082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:50.720805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:48:50.730385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for user bec6f504a59b46228db013140f4ce605 and project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:48:50.749827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:48:50.754204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:48:50.818904 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87845fe0-7772-4836-821b-e2fc5b29ddf3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261408 Oct 17 15:48:50.820753 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2651/5054] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:48:50.838101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1859acd5-afe7-4125-a86c-7dab2f251021 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:50.843674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1859acd5-afe7-4125-a86c-7dab2f251021 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:50.884757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1859acd5-afe7-4125-a86c-7dab2f251021 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:48:50.901667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:50.941286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:50.949080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:50.951723 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-50cc2d97-5dda-4426-b493-0b0b1802e963 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2834 microversion: 2.42 time: 0.718966 Oct 17 15:48:50.956009 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2404/5055] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:48:50 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2834 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:48:50.995766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-903b5a03-abe1-4738-8516-88e8861386ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:50.996654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-903b5a03-abe1-4738-8516-88e8861386ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:51.015919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-903b5a03-abe1-4738-8516-88e8861386ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:51.016926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-903b5a03-abe1-4738-8516-88e8861386ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:51.020244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-903b5a03-abe1-4738-8516-88e8861386ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:51.021553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-903b5a03-abe1-4738-8516-88e8861386ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:51.024868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-903b5a03-abe1-4738-8516-88e8861386ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:51.025707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-903b5a03-abe1-4738-8516-88e8861386ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:51.384302 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-903b5a03-abe1-4738-8516-88e8861386ba tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.399012 Oct 17 15:48:51.385175 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2405/5056] 10.222.0.87 () {60 vars in 1316 bytes} [Mon Oct 17 15:48:50 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e/os-interface => generated 1832 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:48:51.833156 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.scheduler.client.report [None req-1859acd5-afe7-4125-a86c-7dab2f251021 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Deleted allocations for instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 Oct 17 15:48:51.843178 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.compute.api [None req-1859acd5-afe7-4125-a86c-7dab2f251021 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3] Instance Mapping does not exist while attempting local delete cleanup. Oct 17 15:48:51.844864 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1859acd5-afe7-4125-a86c-7dab2f251021 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3" status: 204 len: 0 microversion: 2.1 time: 1.014665 Oct 17 15:48:51.847458 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2652/5057] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:48:50 2022] DELETE /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:48:51.856526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-655af648-8257-4a79-9f9f-35747847e66c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:51.858766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-655af648-8257-4a79-9f9f-35747847e66c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:51.871353 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-655af648-8257-4a79-9f9f-35747847e66c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-655af648-8257-4a79-9f9f-35747847e66c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 HTTP/1.1 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3'} Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:51.872975 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:51.879232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:51.879232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:51.879232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:51.879232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:48:51.879232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:51.879232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-655af648-8257-4a79-9f9f-35747847e66c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:51.879232 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-655af648-8257-4a79-9f9f-35747847e66c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3" status: 404 len: 111 microversion: 2.1 time: 0.022457 Oct 17 15:48:51.889256 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2406/5058] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:51 2022] GET /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:48:52.291884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1728917271", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "54423d23-912b-4e26-80bb-450813721e3a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:52.495867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] validate_networks() for [('54423d23-912b-4e26-80bb-450813721e3a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:48:54.772328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:48:54.772871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:48:54.773291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:48:54.773722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:48:54.774142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:48:54.816007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-4a9e2c1a-34ec-44da-af22-a2efc6c63529 req-89d4ffc5-e14a-4486-9483-79dc37132a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "tag": "39f10735-71ca-470f-b9b6-7a8e6629500c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:48:54.826146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:54.829083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:54.829832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:54.836609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:54.837155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:54.837611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:54.874809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4a9e2c1a-34ec-44da-af22-a2efc6c63529 req-89d4ffc5-e14a-4486-9483-79dc37132a68 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:54.878646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4a9e2c1a-34ec-44da-af22-a2efc6c63529 req-89d4ffc5-e14a-4486-9483-79dc37132a68 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:54.887338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4a9e2c1a-34ec-44da-af22-a2efc6c63529 req-89d4ffc5-e14a-4486-9483-79dc37132a68 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:54.926531 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-4a9e2c1a-34ec-44da-af22-a2efc6c63529 req-89d4ffc5-e14a-4486-9483-79dc37132a68 service nova] Creating event network-changed:39f10735-71ca-470f-b9b6-7a8e6629500c for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:48:54.958837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:48:54.962303 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-4a9e2c1a-34ec-44da-af22-a2efc6c63529 req-89d4ffc5-e14a-4486-9483-79dc37132a68 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150628 Oct 17 15:48:54.964240 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2407/5059] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:48:54.977593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for user bec6f504a59b46228db013140f4ce605 and project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:48:55.028811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:48:55.042055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:48:55.267700 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c53347bf-38b7-469b-a431-2090e5f0de85 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.979444 Oct 17 15:48:55.269692 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2653/5060] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:48:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:48:55.281767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a816a873-929d-436b-9184-5185761791ab tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:55.282518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a816a873-929d-436b-9184-5185761791ab tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:55.389467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a816a873-929d-436b-9184-5185761791ab tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:55.431541 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a816a873-929d-436b-9184-5185761791ab tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1221 microversion: 2.1 time: 0.137508 Oct 17 15:48:55.446547 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2408/5061] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:55 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:56.464324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:56.465913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:56.488560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:56.496085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:56.504260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:56.506779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:56.509902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:56.515642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:56.763995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:56.775634 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c74f46a-b2b2-44ef-8305-0769a2c63a9d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1225 microversion: 2.1 time: 0.316772 Oct 17 15:48:56.799853 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2654/5062] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:56 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1225 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:57.809348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:57.811102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:57.841817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:57.856293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:57.856967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:57.857762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:57.860323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:57.862708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:58.134127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:48:58.180208 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-231ab4fd-0cfa-4a78-a77d-6c5100188dfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1281 microversion: 2.1 time: 0.376532 Oct 17 15:48:58.188076 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2409/5063] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:57 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1281 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:48:59.224947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:59.227906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:59.253046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:48:59.258412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:59.259705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:59.260726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:59.262476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:59.263613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:59.264862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:59.551831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:59.552777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:59.578877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:59.581301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:59.582067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:59.583602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:59.584372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:59.585070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:59.644721 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 HTTP/1.1 Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f8548020-e957-4428-8e54-c34c68c9b446'} Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:48:59.649682 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:59.653668 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed3e32c1-7961-483e-917b-fa9977a3fc50 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 404 len: 111 microversion: 2.1 time: 0.107533 Oct 17 15:48:59.660740 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2410/5064] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:48:59 2022] DELETE /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:48:59.680674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:59.689072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: f8548020-e957-4428-8e54-c34c68c9b446] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:59.701561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:59.703587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:59.704703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:59.706297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:59.707456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:59.708492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:59.740907 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 HTTP/1.1 Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f8548020-e957-4428-8e54-c34c68c9b446'} Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:48:59.744802 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.753941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:48:59.753941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:48:59.753941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:48:59.753941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:48:59.753941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:48:59.753941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. Oct 17 15:48:59.753941 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:48:59.757012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance f8548020-e957-4428-8e54-c34c68c9b446 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:48:59.758911 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7913e41c-9709-4c92-9525-4d2bcf38896a tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446" status: 404 len: 111 microversion: 2.1 time: 0.094567 Oct 17 15:48:59.765818 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2411/5065] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:59 2022] GET /compute/v2.1/servers/f8548020-e957-4428-8e54-c34c68c9b446 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:48:59.776097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:48:59.777466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:48:59.800812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:59.802152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:59.803325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:59.805031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:48:59.806453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:48:59.807567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:48:59.869527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:49:00.087937 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9309ec5c-25e1-4475-8777-160c28773a5f tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 204 len: 0 microversion: 2.1 time: 0.315443 Oct 17 15:49:00.092632 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2412/5066] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:48:59 2022] DELETE /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:49:00.107188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:00.109586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:00.131644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:00.132312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:00.132765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:00.135178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:00.137899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:00.139248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:00.239040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:00.251022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56206018-9abd-4134-b47f-15e910722b10 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1279 microversion: 2.1 time: 1.036960 Oct 17 15:49:00.254342 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2655/5067] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:48:59 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1279 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:00.479331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:00.501394 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4e82c08c-186b-4f7f-9463-8c72670efae8 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.405987 Oct 17 15:49:00.502871 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2413/5068] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:00 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:01.289545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:01.292878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:01.314150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-413db657-5768-495e-86c3-d4a1ad3c2970 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:01.317454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-413db657-5768-495e-86c3-d4a1ad3c2970 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:01.336797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-413db657-5768-495e-86c3-d4a1ad3c2970 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:01.338438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-413db657-5768-495e-86c3-d4a1ad3c2970 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:01.339150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-413db657-5768-495e-86c3-d4a1ad3c2970 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:01.340078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-413db657-5768-495e-86c3-d4a1ad3c2970 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:01.342169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-413db657-5768-495e-86c3-d4a1ad3c2970 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:01.347299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-413db657-5768-495e-86c3-d4a1ad3c2970 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:01.359196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:01.363508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:01.366896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:01.368953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:01.372655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:01.374109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:01.492180 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-413db657-5768-495e-86c3-d4a1ad3c2970 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.179304 Oct 17 15:49:01.498914 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2414/5069] 10.222.0.87 () {60 vars in 1343 bytes} [Mon Oct 17 15:49:01 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:01.538264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:01.543017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:01.594188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:01.595003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:01.595678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:01.610158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:01.621683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:01.623618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:01.633197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:01.675696 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-908443a1-16f1-4fcd-b1cb-d6a5be4e67bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1279 microversion: 2.1 time: 0.392020 Oct 17 15:49:01.676951 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2656/5070] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:01 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1279 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:01.804441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:01.805756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:01.822655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:01.823340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:01.823900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:01.824914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:01.826035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:01.828927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:01.884248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:49:01.976991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:02.118427 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ad13a29-6c7b-4b52-b86f-5f29aca48ff4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "DELETE /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 204 len: 0 microversion: 2.20 time: 0.316904 Oct 17 15:49:02.120696 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2657/5071] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:49:01 2022] DELETE /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:49:02.133993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9fddb149-d442-4846-ab59-7698d9589693 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:02.139821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9fddb149-d442-4846-ab59-7698d9589693 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:02.151952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fddb149-d442-4846-ab59-7698d9589693 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:02.153218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fddb149-d442-4846-ab59-7698d9589693 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:02.157958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fddb149-d442-4846-ab59-7698d9589693 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:02.159095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fddb149-d442-4846-ab59-7698d9589693 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:02.159775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fddb149-d442-4846-ab59-7698d9589693 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:02.160394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9fddb149-d442-4846-ab59-7698d9589693 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:02.249215 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9fddb149-d442-4846-ab59-7698d9589693 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/5dd68d7c-79d1-4604-9831-5e117a1f4228" status: 200 len: 194 microversion: 2.1 time: 0.126799 Oct 17 15:49:02.250069 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2658/5072] 10.222.0.87 () {58 vars in 1413 bytes} [Mon Oct 17 15:49:02 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/5dd68d7c-79d1-4604-9831-5e117a1f4228 => generated 194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:02.268977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:02.270295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:02.284065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:02.285057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:02.285734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:02.286801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:02.287535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:02.288302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:02.484025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:02.517565 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e933ac13-e83d-4ca1-aa07-ae2e6bd54a3b tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.987520 Oct 17 15:49:02.520681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2415/5073] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:01 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:02.533204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:02.534545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:02.569014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:02.574712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:02.577293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:02.581655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:02.586376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:02.587768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:02.808588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lazy-loading 'services' on Instance uuid 1b7fcd63-035e-4da8-98e7-dd8482ff909e {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:49:02.914670 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c72bbbd2-8d88-42e0-8d7d-2e6ef05d5192 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/5dd68d7c-79d1-4604-9831-5e117a1f4228" status: 202 len: 0 microversion: 2.1 time: 0.389479 Oct 17 15:49:02.916362 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2416/5074] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:49:02 2022] DELETE /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments/5dd68d7c-79d1-4604-9831-5e117a1f4228 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:49:02.927244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:02.928737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:02.941851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:02.942826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:02.943714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:02.945133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:02.946054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:02.946977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:02.992093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:03.177285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:03.189806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:03.192341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:03.195055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-339984a3-c839-4d62-91ef-a77d0916dbfe tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 0.940022 Oct 17 15:49:03.196967 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2659/5075] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:49:02 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:49:03.401131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:03.417877 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a699b325-4b63-4252-bdad-2f2b74062ca0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1321 microversion: 2.1 time: 0.499181 Oct 17 15:49:03.419348 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2417/5076] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:02 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:03.567592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:03.571579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:03.581907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:03.582937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:03.584482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:03.585873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:03.587522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:03.588711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:04.226815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:04.227860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:04.263289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:04.271573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:04.272508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:04.274841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:04.278283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:04.279498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:04.280049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:04.298880 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52a326af-aee1-4af3-ba89-acc19c1f0393 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.731780 Oct 17 15:49:04.300267 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2660/5077] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:03 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:04.442976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:04.443797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:04.456977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:04.457973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:04.460587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:04.461844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:04.464543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:04.465641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:04.885596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:05.003603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:05.394384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:05.639586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:05.660665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:05.662958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:05.675202 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d47dd8b5-2c14-469f-a969-659e5fc7ea63 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 1.455141 Oct 17 15:49:05.681651 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2418/5078] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:49:04 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:49:05.699247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:05.699903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:05.725270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:05.726465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:05.728634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:05.730536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:05.731798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:05.732936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:06.213612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:06.261953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:06.280222 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-613d75b5-a294-4d09-bfe5-e12a5cc75a7a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1321 microversion: 2.1 time: 1.841636 Oct 17 15:49:06.296143 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2661/5079] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:04 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1321 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:06.308510 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b513d2f-53a9-4fa2-89f1-da271e4f3392 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.611020 Oct 17 15:49:06.313165 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2419/5080] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:05 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:06.745881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:06.746985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:06.789571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:06.794213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:06.797655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:06.798559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:06.800308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:06.812156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:07.325892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:07.328177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:07.341184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:07.343113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:07.343640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:07.344426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:07.344908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:07.348566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:07.740429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:07.759726 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc14cdb1-cd4d-43f0-be15-8f566afa4c26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1321 microversion: 2.1 time: 0.439174 Oct 17 15:49:07.768074 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2420/5081] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:07 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:07.777426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:07.781531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:07.792434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:07.793253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:07.796752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:07.802882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:07.815997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:07.819412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:08.259305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:08.268973 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f0f82615-1b13-49cc-a588-2847a22d9f00 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 0.499353 Oct 17 15:49:08.275464 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2421/5082] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:07 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:08.287466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1435d4bc-2054-41bb-bba3-d7f7b949682a req-1f40439a-6e0f-449a-b84f-ce01ca9bf28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f06aaa4-9003-4c2b-93f2-58dffe88714d", "name": "network-vif-unplugged", "status": "completed", "tag": "266c890a-8733-4318-9e57-c80fb316ccdb"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:08.313318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1435d4bc-2054-41bb-bba3-d7f7b949682a req-1f40439a-6e0f-449a-b84f-ce01ca9bf28b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:08.313866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1435d4bc-2054-41bb-bba3-d7f7b949682a req-1f40439a-6e0f-449a-b84f-ce01ca9bf28b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:08.314937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1435d4bc-2054-41bb-bba3-d7f7b949682a req-1f40439a-6e0f-449a-b84f-ce01ca9bf28b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:08.357426 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1435d4bc-2054-41bb-bba3-d7f7b949682a req-1f40439a-6e0f-449a-b84f-ce01ca9bf28b service nova] Creating event network-vif-unplugged:266c890a-8733-4318-9e57-c80fb316ccdb for instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d on n-h2-854441-12 Oct 17 15:49:08.368012 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1435d4bc-2054-41bb-bba3-d7f7b949682a req-1f40439a-6e0f-449a-b84f-ce01ca9bf28b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083613 Oct 17 15:49:08.370660 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2422/5083] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:49:08.628809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:08.671220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:08.680722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:08.685392 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34bcd1bb-63b3-4e36-b93c-f5029d2cd2a1 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1723 microversion: 2.20 time: 1.958420 Oct 17 15:49:08.690460 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2662/5084] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:49:06 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1723 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:49:08.840668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:08.845929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:08.891259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:08.891911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:08.892690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:08.893956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:08.894829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:08.895588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:09.316367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:09.340576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:09.358024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:09.360530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:09.361839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:09.364688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:09.365992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:09.367214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:10.427464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:10.464391 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:49:10.472741 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 15:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 (ip 10.222.0.87) !!! Oct 17 15:49:10.501995 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-654e0c19-64f9-4b56-81ab-70d7823e2f4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1321 microversion: 2.1 time: 1.686765 Oct 17 15:49:10.504908 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2423/5085] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:08 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1321 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:10.518045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d6176e41-732d-421a-b987-307a5d43946b req-1861951b-0a2c-4493-bdbe-f01e032b79b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086ff15e-a334-492d-86b7-4f8e2ca49472", "tag": "8fd9890f-dae7-4de5-9dde-2f6dfc87282f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:10.593977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d6176e41-732d-421a-b987-307a5d43946b req-1861951b-0a2c-4493-bdbe-f01e032b79b9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:10.608972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d6176e41-732d-421a-b987-307a5d43946b req-1861951b-0a2c-4493-bdbe-f01e032b79b9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:10.613242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d6176e41-732d-421a-b987-307a5d43946b req-1861951b-0a2c-4493-bdbe-f01e032b79b9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:10.756167 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d6176e41-732d-421a-b987-307a5d43946b req-1861951b-0a2c-4493-bdbe-f01e032b79b9 service nova] Creating event network-changed:8fd9890f-dae7-4de5-9dde-2f6dfc87282f for instance 086ff15e-a334-492d-86b7-4f8e2ca49472 on n-h1-854441-12 Oct 17 15:49:10.793540 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d6176e41-732d-421a-b987-307a5d43946b req-1861951b-0a2c-4493-bdbe-f01e032b79b9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286000 Oct 17 15:49:10.800338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2424/5086] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:10.820588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:10.827536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:10.854916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:10.857530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:10.875632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:10.891584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:10.899999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:10.903765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:11.203480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:11.237513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:11.241248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:11.259731 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-91882e1d-77d1-4c62-a473-813f75d8dbe2 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1655 microversion: 2.20 time: 0.451489 Oct 17 15:49:11.263830 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2425/5087] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:49:10 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1655 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:49:11.288860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-89803159", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:11.511073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:49:11.641018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:11.700037 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e704dae3-c198-445e-979a-6ccf9ae7dee3 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1513 microversion: 2.1 time: 2.404362 Oct 17 15:49:11.718541 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2663/5088] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:09 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1513 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:11.725820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:11.735473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:11.772356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:11.773849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:11.787638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:11.789200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:11.790837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:11.791951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:12.698275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:12.733795 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-852b7c90-6e44-4c1b-a0f0-5b14b727a01e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1321 microversion: 2.1 time: 1.020866 Oct 17 15:49:12.734896 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2664/5089] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:11 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1321 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:12.740188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:12.741019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:12.783808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:12.784374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:12.786017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:12.792024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:12.792658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:12.801200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:12.943257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:12.958247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:12.959619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:12.961055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lazy-loading 'fault' on Instance uuid 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:49:13.133673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:13.150618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:13.156245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60b5d6c1fa7c40c4876495acf7476732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8081c4b357e0404fb26842274162d055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:13.160627 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb6ae4e3-acf7-4830-9750-9c059e0c7426 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 200 len: 1370 microversion: 2.20 time: 0.422707 Oct 17 15:49:13.163116 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2665/5090] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:49:12 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 1370 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:49:13.177966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:13.179127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:13.199070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:13.201423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:13.202585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:13.204267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:13.208187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:13.210016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:13.348048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:13.352132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:13.352878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:13.356596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lazy-loading 'fault' on Instance uuid 6f06aaa4-9003-4c2b-93f2-58dffe88714d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:49:13.440862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:49:13.441747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:49:13.444268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:49:13.445426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:49:13.449299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:49:13.453588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:13.505649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:13.506541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:13.507264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:13.513464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:13.514330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:13.519849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:13.579798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Getting quotas for project 57c859fd70674ec6917bd25aefa30fe3. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:49:13.600785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Getting quotas for user 79a52fdffce04022b9098bcaf9e57aaa and project 57c859fd70674ec6917bd25aefa30fe3. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:49:13.624829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:49:13.628400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:49:13.650923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '867ef1e9bae64d5fb08ea45376f905c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3c8332d724f649611c888b2d5639b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:13.667235 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5f839be-4110-4d25-83bd-5980eb912b8e tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 200 len: 1307 microversion: 2.1 time: 0.501058 Oct 17 15:49:13.671668 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2666/5091] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:13 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 1307 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:13.693688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-06facd61-8101-43fe-b249-6809748fa69f req-42e4def4-6b69-4c1c-beec-bf91caaadbef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781ce8e0-1ad0-4713-ac95-2abac4f7a1d7", "name": "network-vif-deleted", "tag": "e23fd663-fe28-4bf5-ae5b-5433ac887247"}, {"server_uuid": "6f06aaa4-9003-4c2b-93f2-58dffe88714d", "name": "network-vif-deleted", "tag": "266c890a-8733-4318-9e57-c80fb316ccdb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:13.735787 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fbecfa47-d8e0-4721-85e3-fcb6e715bd4a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.461763 Oct 17 15:49:13.744447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-06facd61-8101-43fe-b249-6809748fa69f req-42e4def4-6b69-4c1c-beec-bf91caaadbef service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:13.745588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-06facd61-8101-43fe-b249-6809748fa69f req-42e4def4-6b69-4c1c-beec-bf91caaadbef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:13.746771 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2426/5092] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:49:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:49:13.751489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-06facd61-8101-43fe-b249-6809748fa69f req-42e4def4-6b69-4c1c-beec-bf91caaadbef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:13.766704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4320de9-c169-4618-a26f-f7d9ca06dff2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:13.767714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a4320de9-c169-4618-a26f-f7d9ca06dff2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:13.810560 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-06facd61-8101-43fe-b249-6809748fa69f req-42e4def4-6b69-4c1c-beec-bf91caaadbef service nova] Creating event network-vif-deleted:e23fd663-fe28-4bf5-ae5b-5433ac887247 for instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 on n-h2-854441-12 Oct 17 15:49:13.811413 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-06facd61-8101-43fe-b249-6809748fa69f req-42e4def4-6b69-4c1c-beec-bf91caaadbef service nova] Creating event network-vif-deleted:266c890a-8733-4318-9e57-c80fb316ccdb for instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d on n-h2-854441-12 Oct 17 15:49:13.840270 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-06facd61-8101-43fe-b249-6809748fa69f req-42e4def4-6b69-4c1c-beec-bf91caaadbef service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.164722 Oct 17 15:49:13.845610 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2667/5093] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:13.869270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:13.870601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:13.921970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:13.923490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:13.923893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:13.928597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:13.930890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:13.931683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:14.108163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a4320de9-c169-4618-a26f-f7d9ca06dff2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:14.119811 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4320de9-c169-4618-a26f-f7d9ca06dff2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1212 microversion: 2.1 time: 0.371392 Oct 17 15:49:14.136437 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2427/5094] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:13 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1212 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:14.253764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:14.254585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:14.265626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:14.271204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:14.279191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:14.280437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:14.281386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:14.282287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:14.328859 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] HTTP exception thrown: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Request method failure captured: Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 HTTP/1.1 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXc0Y4M5OfVkLji0-Kod_g_5Orm6D-_QJCAc157CTns0AQxd2F5fpnYAtiRnJuCnExhXNvzz80T8C8K4k3hVyFywkADoDffE8w9njuo-zvpxuBzpb2K8KUlpvqpqfSwczmQCPOiXiFbZ8bNeKU5puQeLuDyyaaV8Hq1TOUay4C2Ni7Q Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8081c4b357e0404fb26842274162d055"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8081c4b357e0404fb26842274162d055"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 60b5d6c1fa7c40c4876495acf7476732 Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '781ce8e0-1ad0-4713-ac95-2abac4f7a1d7'} Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.331574 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:14.336229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.336229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:14.336229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:14.336229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:14.336229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:14.336229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:14.336229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:14.336229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.339742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Returning 404 to user: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:14.341045 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c83e4d2c-49c6-470d-bc86-d0ab770cf1b4 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 404 len: 111 microversion: 2.20 time: 0.092095 Oct 17 15:49:14.342372 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2428/5095] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:49:14 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:49:14.356468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9272a822-75c8-4045-b4f4-6af81fc1b88d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '.version_select at 0x7f28bec8d9d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:14.493159 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9272a822-75c8-4045-b4f4-6af81fc1b88d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-666418255" status: 204 len: 0 microversion: 2.20 time: 0.138880 Oct 17 15:49:14.507879 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2429/5096] 10.222.0.87 () {60 vars in 1259 bytes} [Mon Oct 17 15:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-666418255 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 15:49:14.730217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:14.737285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] [instance: 6f06aaa4-9003-4c2b-93f2-58dffe88714d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:14.778015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:14.778567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:14.779167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:14.780017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:14.780569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:14.787464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:14.791496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:14.801938 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29522e2c-0751-4db5-a73a-afa5de1174a6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1321 microversion: 2.1 time: 0.953677 Oct 17 15:49:14.805498 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2668/5097] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:13 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1321 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:14.868898 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] HTTP exception thrown: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d could not be found. Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Request method failure captured: Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d HTTP/1.1 Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXg1AWN-8cosWIrzSUytW8C0WfRaBKC-I9NNSZHVO7tcsriRdNPgYFSWJZE_S7nu0aNBgbnkfcROtY-rsnlYBFoiebkkTGAgkHCN0byjTfq3zJL9ww7M9X3JbZUNtjxBnM6JWhjJcN2cPhKF-6yPKWGn4M8dSKEfrgONJrLLrbl-eS4 Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b8e3c8332d724f649611c888b2d5639b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b8e3c8332d724f649611c888b2d5639b Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-292502795 Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 867ef1e9bae64d5fb08ea45376f905c8 Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-292502795-project Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d could not be found. Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6f06aaa4-9003-4c2b-93f2-58dffe88714d'} Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d could not be found. Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d could not be found. Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:14.870627 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d could not be found. Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] Returning 404 to user: Instance 6f06aaa4-9003-4c2b-93f2-58dffe88714d could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e1c81d8b-1fbe-4fe0-856a-5534ad537054 tempest-ServersNegativeTestJSON-292502795 tempest-ServersNegativeTestJSON-292502795-project] 10.222.0.87 "GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d" status: 404 len: 111 microversion: 2.1 time: 0.161695 Oct 17 15:49:14.875338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2430/5098] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:14 2022] GET /compute/v2.1/servers/6f06aaa4-9003-4c2b-93f2-58dffe88714d => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:49:15.152854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:15.154257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:15.175913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:15.191574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:15.193827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:15.197310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:15.203637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:15.206942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:15.829841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e86c078b-6898-4bf6-8334-1c7cd4d6f379 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:15.836285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e86c078b-6898-4bf6-8334-1c7cd4d6f379 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:15.857636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e86c078b-6898-4bf6-8334-1c7cd4d6f379 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:15.859656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e86c078b-6898-4bf6-8334-1c7cd4d6f379 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:15.860940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e86c078b-6898-4bf6-8334-1c7cd4d6f379 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:15.877791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e86c078b-6898-4bf6-8334-1c7cd4d6f379 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:15.880391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e86c078b-6898-4bf6-8334-1c7cd4d6f379 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:15.881904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e86c078b-6898-4bf6-8334-1c7cd4d6f379 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:15.987413 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e86c078b-6898-4bf6-8334-1c7cd4d6f379 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.166308 Oct 17 15:49:15.992609 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2431/5099] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:49:15 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:49:16.019375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:16.019998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:16.036445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:16.036948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:16.037390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:16.038132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:16.038915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:16.039540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:16.197787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:16.207291 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e9ba254-02d5-4e62-a50d-74e90a1e578e tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1216 microversion: 2.1 time: 1.060391 Oct 17 15:49:16.208644 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2669/5100] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:15 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1216 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:16.216118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9b605ca-3ed2-4bd2-9719-b21b42d8f773 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:16.219869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d9b605ca-3ed2-4bd2-9719-b21b42d8f773 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:16.231081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b605ca-3ed2-4bd2-9719-b21b42d8f773 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:16.232103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b605ca-3ed2-4bd2-9719-b21b42d8f773 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:16.232824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b605ca-3ed2-4bd2-9719-b21b42d8f773 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:16.234145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b605ca-3ed2-4bd2-9719-b21b42d8f773 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:16.235002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b605ca-3ed2-4bd2-9719-b21b42d8f773 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:16.235895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b605ca-3ed2-4bd2-9719-b21b42d8f773 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:16.277136 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d9b605ca-3ed2-4bd2-9719-b21b42d8f773 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066438 Oct 17 15:49:16.277925 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2670/5101] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:49:16 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:49:16.421270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:16.423395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:16.439325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:16.440588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:16.441579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:16.443773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:16.444914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:16.445983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:16.465988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:16.477453 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b4e78685-8d3d-4766-b4da-81cedbc0cdea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1321 microversion: 2.1 time: 0.479307 Oct 17 15:49:16.478074 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2432/5102] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:15 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:16.555318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:49:16.690551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:16.735826 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-317e0a49-4588-40a6-b09f-818fa84ac74f tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 204 len: 0 microversion: 2.1 time: 0.325265 Oct 17 15:49:16.737390 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2671/5103] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:49:16 2022] DELETE /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:49:16.751496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:16.752505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:16.768776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:16.769613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:16.770816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:16.772179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:16.772892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:16.773558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:17.252466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:17.253976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:17.262153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:17.263785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:17.264322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:17.265613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:17.266467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:17.267032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:17.380032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:17.391083 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c78181da-5bf2-4717-b361-ea842644d567 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1270 microversion: 2.1 time: 0.144219 Oct 17 15:49:17.394732 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2672/5104] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:17 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:17.528054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:17.531168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:17.545271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:17.546964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:17.548112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:17.550334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:17.551918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:17.553124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:18.055783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:18.066725 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-df8bdb59-7eca-4d9d-ade0-c323efb81a35 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1673 microversion: 2.1 time: 1.322762 Oct 17 15:49:18.067794 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2433/5105] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:16 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1673 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:18.074783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f86d90dc-55d2-4cc6-bc71-bc87a4aec1f4 req-43553fe6-9850-43b5-94af-738ad5d8192b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086ff15e-a334-492d-86b7-4f8e2ca49472", "name": "network-vif-plugged", "status": "completed", "tag": "8fd9890f-dae7-4de5-9dde-2f6dfc87282f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:18.104984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:18.113298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f86d90dc-55d2-4cc6-bc71-bc87a4aec1f4 req-43553fe6-9850-43b5-94af-738ad5d8192b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:18.114435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f86d90dc-55d2-4cc6-bc71-bc87a4aec1f4 req-43553fe6-9850-43b5-94af-738ad5d8192b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:18.115414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f86d90dc-55d2-4cc6-bc71-bc87a4aec1f4 req-43553fe6-9850-43b5-94af-738ad5d8192b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:18.150784 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f86d90dc-55d2-4cc6-bc71-bc87a4aec1f4 req-43553fe6-9850-43b5-94af-738ad5d8192b service nova] Creating event network-vif-plugged:8fd9890f-dae7-4de5-9dde-2f6dfc87282f for instance 086ff15e-a334-492d-86b7-4f8e2ca49472 on n-h1-854441-12 Oct 17 15:49:18.152090 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0f528e2-1826-4c5f-a326-3825e041dba2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1321 microversion: 2.1 time: 0.629959 Oct 17 15:49:18.153565 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2673/5106] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:17 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1321 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:18.171566 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f86d90dc-55d2-4cc6-bc71-bc87a4aec1f4 req-43553fe6-9850-43b5-94af-738ad5d8192b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101449 Oct 17 15:49:18.181031 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2434/5107] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:18.425967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:18.428077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:18.452558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:18.454129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:18.455325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:18.459220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:18.461161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:18.462115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:18.877001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:18.894854 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e983e54a-599e-49ba-91ab-41448001ed10 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1270 microversion: 2.1 time: 0.477209 Oct 17 15:49:18.911083 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2674/5108] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:18 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1270 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:19.152954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:19.161028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:19.199560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:19.203063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:19.203524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:19.204741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:19.206013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:19.209842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:19.213379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:19.214859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:19.236320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:19.246883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:19.248164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:19.250207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:19.252231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:19.253402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:20.071570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:20.092296 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-663fc3ac-ac26-4871-8aaf-14be6699d2dc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1321 microversion: 2.1 time: 0.897854 Oct 17 15:49:20.096630 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2675/5109] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:19 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1321 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:20.111015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:20.113211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:20.129665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:20.133990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:20.136344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:20.138419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:20.139963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:20.141404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:20.601097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:20.635723 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ac6152ad-ef59-44cf-aef6-1f3bfeb5f117 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1673 microversion: 2.1 time: 1.512278 Oct 17 15:49:20.637787 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2435/5110] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:19 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1673 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:20.681265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:20.692879 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5e74dff-a77c-49bb-a919-ed307a9836ef tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1312 microversion: 2.1 time: 0.593442 Oct 17 15:49:20.693248 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2676/5111] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:20 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1312 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:21.146486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:21.152577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:21.176633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:21.178162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:21.182401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:21.184897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:21.186467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:21.187636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:21.672393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:21.685444 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b6544150-a47f-41b6-9d7e-fdfdd7148e11 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1502 microversion: 2.1 time: 0.549709 Oct 17 15:49:21.689162 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2436/5112] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:21 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1502 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:21.698169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:21.699829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:21.713681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:21.714191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:21.714695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:21.715411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:21.717366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:21.718760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:21.724780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:21.725223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:21.730424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:21.731491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:21.739249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:21.744230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:21.748833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:21.750490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:21.986932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:22.010527 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e993b38-f0c7-4097-a8fd-0ccfa1f02708 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1605 microversion: 2.1 time: 0.324040 Oct 17 15:49:22.056534 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2677/5113] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:21 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1605 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:22.077934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:22.079018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:22.101096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:22.102130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:22.102828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:22.103864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:22.107992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:22.108824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.102806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:23.144810 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff294b48-6f37-4dfa-b530-7df961258176 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1502 microversion: 2.1 time: 1.432785 Oct 17 15:49:23.153770 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2437/5114] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:21 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1502 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:23.174236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-7ea9f63e-1a39-43a8-97e8-b783c70b9a05 req-9004f985-f6d4-47fb-8e09-6188319ac9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b5908c-f098-4ae4-9d26-aceefaa05ec3", "tag": "508e0a84-d600-4722-9e33-b8528a425e12"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:23.202169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:23.216447 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-630541a1-9ace-4290-9b77-6b27d3734d5c tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1312 microversion: 2.1 time: 1.154979 Oct 17 15:49:23.218070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7ea9f63e-1a39-43a8-97e8-b783c70b9a05 req-9004f985-f6d4-47fb-8e09-6188319ac9d0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:23.220273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7ea9f63e-1a39-43a8-97e8-b783c70b9a05 req-9004f985-f6d4-47fb-8e09-6188319ac9d0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:23.223995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7ea9f63e-1a39-43a8-97e8-b783c70b9a05 req-9004f985-f6d4-47fb-8e09-6188319ac9d0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.230989 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2678/5115] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:22 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1312 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:23.237565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:23.238056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:23.246396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:23.246962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:23.247422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.248338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:23.252152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:23.252726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.275735 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-7ea9f63e-1a39-43a8-97e8-b783c70b9a05 req-9004f985-f6d4-47fb-8e09-6188319ac9d0 service nova] Creating event network-changed:508e0a84-d600-4722-9e33-b8528a425e12 for instance b0b5908c-f098-4ae4-9d26-aceefaa05ec3 on n-h2-854441-12 Oct 17 15:49:23.302359 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-7ea9f63e-1a39-43a8-97e8-b783c70b9a05 req-9004f985-f6d4-47fb-8e09-6188319ac9d0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145670 Oct 17 15:49:23.306049 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] HTTP exception thrown: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.308179 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2438/5116] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Request method failure captured: Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 HTTP/1.1 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXc0Y4M5OfVkLji0-Kod_g_5Orm6D-_QJCAc157CTns0AQxd2F5fpnYAtiRnJuCnExhXNvzz80T8C8K4k3hVyFywkADoDffE8w9njuo-zvpxuBzpb2K8KUlpvqpqfSwczmQCPOiXiFbZ8bNeKU5puQeLuDyyaaV8Hq1TOUay4C2Ni7Q Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8081c4b357e0404fb26842274162d055"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8081c4b357e0404fb26842274162d055"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 60b5d6c1fa7c40c4876495acf7476732 Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '781ce8e0-1ad0-4713-ac95-2abac4f7a1d7'} Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:23.315591 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Returning 404 to user: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:23.320382 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b3b651f-a9bf-4f87-929c-ddc77e3ef43c tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "DELETE /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 404 len: 111 microversion: 2.20 time: 0.085683 Oct 17 15:49:23.335280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:23.336770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:23.337991 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2679/5117] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:49:23 2022] DELETE /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:49:23.360611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:23.361445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:23.374175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:23.379667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:23.380700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.382412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:23.383510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:23.387677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.391074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:23.396552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:23.397324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.401626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:23.402729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:23.403505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.538548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:49:23.544199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:23.822904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:23.876405 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef2560c3-bc01-43f8-8035-c1aa459bac91 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1605 microversion: 2.1 time: 0.561483 Oct 17 15:49:23.881214 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2439/5118] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:23 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1605 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:23.910146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:23.920372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:23.937043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:23.938471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:23.939658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.941510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:23.943175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:23.944581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:23.946071 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec3c5074-64c2-4cac-95d0-10c2e5c39651 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 204 len: 0 microversion: 2.1 time: 0.601572 Oct 17 15:49:23.950169 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2680/5119] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:49:23 2022] DELETE /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:49:23.974776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:23.976793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:23.977457 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] HTTP exception thrown: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Request method failure captured: Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 HTTP/1.1 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXc0Y4M5OfVkLji0-Kod_g_5Orm6D-_QJCAc157CTns0AQxd2F5fpnYAtiRnJuCnExhXNvzz80T8C8K4k3hVyFywkADoDffE8w9njuo-zvpxuBzpb2K8KUlpvqpqfSwczmQCPOiXiFbZ8bNeKU5puQeLuDyyaaV8Hq1TOUay4C2Ni7Q Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8081c4b357e0404fb26842274162d055"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8081c4b357e0404fb26842274162d055"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 60b5d6c1fa7c40c4876495acf7476732 Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '781ce8e0-1ad0-4713-ac95-2abac4f7a1d7'} Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.982177 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:23.991335 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.991335 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:23.991335 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:23.991335 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:23.991335 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:23.991335 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:23.991335 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. Oct 17 15:49:23.991335 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:23.996146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Returning 404 to user: Instance 781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:23.997265 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bea2de6e-1d0e-4990-81fa-f7b37433d422 tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7" status: 404 len: 111 microversion: 2.20 time: 0.108548 Oct 17 15:49:23.999031 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2440/5120] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:49:23 2022] GET /compute/v2.1/servers/781ce8e0-1ad0-4713-ac95-2abac4f7a1d7 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:49:24.016477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:24.017664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:24.019463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:24.021586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:24.024326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:24.026136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:24.244430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:24.245303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:24.280258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:24.293352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:24.294387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:24.295176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:24.296434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:24.312066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:24.333960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:24.570193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:24.681319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:24.699674 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7a36cfd-cb96-4531-a00b-6e6abf4b384f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1508 microversion: 2.1 time: 0.735832 Oct 17 15:49:24.701337 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2681/5121] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:23 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1508 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:24.935835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:24.936810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:24.973862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:24.975234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:24.975845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:24.976761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:24.977432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:24.980184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:25.607716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:25.621358 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4400932d-d94b-4804-9e0c-83a0127232ef tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1605 microversion: 2.1 time: 0.702586 Oct 17 15:49:25.630558 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2682/5122] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:24 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1605 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:26.070204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2c746c43-8958-41bc-8801-f0e8754b5975 req-b3148038-df03-4180-bad3-fbd46fa8d4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7fcd63-035e-4da8-98e7-dd8482ff909e", "name": "network-vif-deleted", "tag": "b9e2a5a9-0869-4c99-a9a5-9a99b93deedc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:26.131198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c746c43-8958-41bc-8801-f0e8754b5975 req-b3148038-df03-4180-bad3-fbd46fa8d4e3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:26.133512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c746c43-8958-41bc-8801-f0e8754b5975 req-b3148038-df03-4180-bad3-fbd46fa8d4e3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:26.141616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2c746c43-8958-41bc-8801-f0e8754b5975 req-b3148038-df03-4180-bad3-fbd46fa8d4e3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:26.145088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:26.161624 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6cda085a-5e96-40a4-b867-d486680dfdd2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1312 microversion: 2.1 time: 1.921894 Oct 17 15:49:26.178958 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2441/5123] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:24 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1312 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:26.193968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:26.193968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:26.208900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:26.209426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:26.214797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:26.219422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:26.221974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:26.222449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:26.236418 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2c746c43-8958-41bc-8801-f0e8754b5975 req-b3148038-df03-4180-bad3-fbd46fa8d4e3 service nova] Creating event network-vif-deleted:b9e2a5a9-0869-4c99-a9a5-9a99b93deedc for instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e on n-h1-854441-12 Oct 17 15:49:26.267462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2c746c43-8958-41bc-8801-f0e8754b5975 req-b3148038-df03-4180-bad3-fbd46fa8d4e3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.628718 Oct 17 15:49:26.271562 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2683/5124] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:26.664665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:26.666463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:26.698569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:26.700082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:26.701229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:26.702959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:26.704225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:26.705561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:26.882033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:26.888344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:26.893593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:26.894874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lazy-loading 'fault' on Instance uuid 1b7fcd63-035e-4da8-98e7-dd8482ff909e {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:49:27.405922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:27.433167 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-85791580-33a8-40bd-a98e-2b4b6d6770c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1508 microversion: 2.1 time: 1.264406 Oct 17 15:49:27.440904 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2442/5125] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:26 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1508 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:27.462800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:27.465764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:27.488083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:27.489250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:27.490439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:27.492368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:27.494192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:27.495781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:27.909462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b639ed781808456f97784cc215163549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc252cb98cc4704ac21c859ac75e121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:27.920233 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a066ad62-d787-4149-b85f-381cddc6ac1c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 200 len: 1326 microversion: 2.1 time: 1.269309 Oct 17 15:49:27.921168 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2684/5126] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:26 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 1326 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:28.080120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:28.088924 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f4e184e-00e8-4525-808f-2161ab7c5abf tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1312 microversion: 2.1 time: 0.645423 Oct 17 15:49:28.093275 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2443/5127] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:27 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1312 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:28.467222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:28.468048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:28.480573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:28.483477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:28.484477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:28.489127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:28.490054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:28.490779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:28.694587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a5e85477-865a-4549-9ff4-facde2be033f req-eb9d4574-a678-4c27-8b84-e0d34e044372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086ff15e-a334-492d-86b7-4f8e2ca49472", "name": "network-vif-deleted", "tag": "8fd9890f-dae7-4de5-9dde-2f6dfc87282f"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:28.719951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a5e85477-865a-4549-9ff4-facde2be033f req-eb9d4574-a678-4c27-8b84-e0d34e044372 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:28.720881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a5e85477-865a-4549-9ff4-facde2be033f req-eb9d4574-a678-4c27-8b84-e0d34e044372 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:28.721605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a5e85477-865a-4549-9ff4-facde2be033f req-eb9d4574-a678-4c27-8b84-e0d34e044372 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:28.756060 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a5e85477-865a-4549-9ff4-facde2be033f req-eb9d4574-a678-4c27-8b84-e0d34e044372 service nova] Creating event network-vif-deleted:8fd9890f-dae7-4de5-9dde-2f6dfc87282f for instance 086ff15e-a334-492d-86b7-4f8e2ca49472 on n-h1-854441-12 Oct 17 15:49:28.771352 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a5e85477-865a-4549-9ff4-facde2be033f req-eb9d4574-a678-4c27-8b84-e0d34e044372 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080843 Oct 17 15:49:28.785660 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2444/5128] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:49:28.948537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:28.949998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:28.993781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:28.998867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:28.999689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:29.001025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:29.001842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:29.002613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:29.094385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] HTTP exception thrown: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Request method failure captured: Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e HTTP/1.1 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXfHRGsNmbIljC6FDbmFxSE1niSTP4rXJVcyZdQHLk7TeDhFFYTET7eETQsG_ucgc7-1fCvGsMVK9sjP-E6IqP4nDaUlFJli_olEvZxPZpRY9v7dnQvtcQukE8bPZu6IKCZRGn3e9Bc4Q_F1imbWErfoobnUFGK6QLFFhf3A2GoL_Rs Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b639ed781808456f97784cc215163549 Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '1b7fcd63-035e-4da8-98e7-dd8482ff909e'} Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:29.098161 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:29.103362 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:29.103362 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:29.103362 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:29.103362 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:29.103362 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:29.103362 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:29.103362 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:29.104884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Returning 404 to user: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:29.107083 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f3ceadf-1dd2-4a5f-b2aa-592b11d99ed6 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 404 len: 111 microversion: 2.1 time: 0.162582 Oct 17 15:49:29.108710 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2445/5129] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:28 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:49:29.132789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92fbf71b-5a71-4d98-a7a7-1bfcd0b87f4c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '.version_select at 0x7f28c2f3c1f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:29.230921 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92fbf71b-5a71-4d98-a7a7-1bfcd0b87f4c tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-578893038" status: 202 len: 0 microversion: 2.1 time: 0.114024 Oct 17 15:49:29.234819 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2446/5130] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:49:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-578893038 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:49:29.253611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:29.258061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:29.289271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:29.291097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:29.294042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:29.296216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:29.297485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:29.299171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:29.341883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:29.373193 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3dc53b88-605b-42da-aa52-797fec91873b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 200 len: 1466 microversion: 2.1 time: 0.910393 Oct 17 15:49:29.383347 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2685/5131] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:28 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 1466 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:30.453508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:30.468691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:30.474875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:30.483853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:30.494083 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9f92a21b-a997-4e4d-9be6-1694e9d3d921 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1312 microversion: 2.1 time: 1.253531 Oct 17 15:49:30.497780 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2447/5132] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:29 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1312 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:30.498364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:30.499170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:30.499886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:30.500801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:30.501429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:30.502027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:30.551625 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 HTTP/1.1 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '086ff15e-a334-492d-86b7-4f8e2ca49472'} Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:30.558257 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48120f5b-30b2-47a8-8709-086d58dee9d3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 404 len: 111 microversion: 2.1 time: 0.143135 Oct 17 15:49:30.585004 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2686/5133] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:30 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:49:30.595545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2289f7c6-f678-4af7-b221-d7fed8961146 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'create', calling method: .version_select at 0x7f28be3975e0>, body: {"keypair": {"name": "tempest-key-915312029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2OxT5loORSVVf5vTpGn2iW3ASSdqkXlHx8anxafn/wnP1ynIA/msa498uAhB6WRkosEqXkyk9FkuVtKGdBGWDbeXmzWKC8TOw5tSMmv5nz70A+fMFE+vLSLOEM5Vyd7g=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:30.622059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-2289f7c6-f678-4af7-b221-d7fed8961146 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:49:30.642444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-2289f7c6-f678-4af7-b221-d7fed8961146 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for user bec6f504a59b46228db013140f4ce605 and project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:49:30.715037 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2289f7c6-f678-4af7-b221-d7fed8961146 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.131847 Oct 17 15:49:30.715037 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2448/5134] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:49:30 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:30.725658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d621a48e-1cf3-48ad-824c-920319ffb60a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '.version_select at 0x7f28bd8ccee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:30.730109 n-d-854441-12 devstack@n-api.service[120406]: WARNING oslo_db.sqlalchemy.utils [None req-d621a48e-1cf3-48ad-824c-920319ffb60a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 15:49:30.748972 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d621a48e-1cf3-48ad-824c-920319ffb60a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.027043 Oct 17 15:49:30.763044 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2687/5135] 10.222.0.87 () {58 vars in 1137 bytes} [Mon Oct 17 15:49:30 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:49:30.976826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1076056825", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "key_name": "tempest-key-915312029", "networks": [{"uuid": "54423d23-912b-4e26-80bb-450813721e3a"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:31.011804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a44fe99a-19fd-413c-90fe-0fabd0c67ca8 req-0266d521-6544-47c3-b0eb-23647aac9f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b5908c-f098-4ae4-9d26-aceefaa05ec3", "name": "network-vif-plugged", "status": "completed", "tag": "508e0a84-d600-4722-9e33-b8528a425e12"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:31.030210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a44fe99a-19fd-413c-90fe-0fabd0c67ca8 req-0266d521-6544-47c3-b0eb-23647aac9f18 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:31.030736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a44fe99a-19fd-413c-90fe-0fabd0c67ca8 req-0266d521-6544-47c3-b0eb-23647aac9f18 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:31.031182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a44fe99a-19fd-413c-90fe-0fabd0c67ca8 req-0266d521-6544-47c3-b0eb-23647aac9f18 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:31.057923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a44fe99a-19fd-413c-90fe-0fabd0c67ca8 req-0266d521-6544-47c3-b0eb-23647aac9f18 service nova] Creating event network-vif-plugged:508e0a84-d600-4722-9e33-b8528a425e12 for instance b0b5908c-f098-4ae4-9d26-aceefaa05ec3 on n-h2-854441-12 Oct 17 15:49:31.074255 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a44fe99a-19fd-413c-90fe-0fabd0c67ca8 req-0266d521-6544-47c3-b0eb-23647aac9f18 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065874 Oct 17 15:49:31.079879 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2688/5136] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:31.103204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] validate_networks() for [('54423d23-912b-4e26-80bb-450813721e3a', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:49:31.552454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:31.555026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:31.599805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:31.602194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:31.604050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:31.606608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:31.607799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:31.608842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:32.396682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:49:32.397462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:49:32.398165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:49:32.398730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:49:32.399662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:49:32.423319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:32.424312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:32.426398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:32.428666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:32.431686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:32.433843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:32.506739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:49:32.523324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for user bec6f504a59b46228db013140f4ce605 and project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:49:32.567020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:49:32.574352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:49:32.748388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f49200c8-1aaa-4c0a-b480-f419a830dcf4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.775478 Oct 17 15:49:32.749643 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2449/5137] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:49:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:49:32.785633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dbc9b240-34cf-4475-8f45-b0e87dced359 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:32.789779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dbc9b240-34cf-4475-8f45-b0e87dced359 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:32.972405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:32.996799 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94820f9e-b923-4585-a5b9-c8612d318243 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1312 microversion: 2.1 time: 1.444696 Oct 17 15:49:32.997552 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2689/5138] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:31 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1312 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:33.087220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dbc9b240-34cf-4475-8f45-b0e87dced359 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:33.097374 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dbc9b240-34cf-4475-8f45-b0e87dced359 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1228 microversion: 2.1 time: 0.333079 Oct 17 15:49:33.113599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:33.114996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:33.120589 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2450/5139] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:32 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1228 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:33.126623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:33.127533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:33.127533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:33.128629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:33.129277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:33.130042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:33.163991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:33.198778 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] HTTP exception thrown: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Request method failure captured: Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 HTTP/1.1 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXc0Y4M5OfVkLji0-Kod_g_5Orm6D-_QJCAc157CTns0AQxd2F5fpnYAtiRnJuCnExhXNvzz80T8C8K4k3hVyFywkADoDffE8w9njuo-zvpxuBzpb2K8KUlpvqpqfSwczmQCPOiXiFbZ8bNeKU5puQeLuDyyaaV8Hq1TOUay4C2Ni7Q Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8081c4b357e0404fb26842274162d055"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8081c4b357e0404fb26842274162d055"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 60b5d6c1fa7c40c4876495acf7476732 Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '45f53954-5109-4fb4-8634-490b9664c7d8'} Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:33.201019 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.206042 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.212388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Returning 404 to user: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:33.215695 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98d66771-2279-408e-b211-81f4cc582a5d tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "DELETE /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 404 len: 111 microversion: 2.20 time: 0.110018 Oct 17 15:49:33.219119 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2690/5140] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:49:33 2022] DELETE /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:49:33.227474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:33.228282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] [instance: 45f53954-5109-4fb4-8634-490b9664c7d8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:33.254832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:33.268373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:33.279593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:33.281126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:33.282825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:33.283470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:33.310138 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] HTTP exception thrown: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Request method failure captured: Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 HTTP/1.1 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXc0Y4M5OfVkLji0-Kod_g_5Orm6D-_QJCAc157CTns0AQxd2F5fpnYAtiRnJuCnExhXNvzz80T8C8K4k3hVyFywkADoDffE8w9njuo-zvpxuBzpb2K8KUlpvqpqfSwczmQCPOiXiFbZ8bNeKU5puQeLuDyyaaV8Hq1TOUay4C2Ni7Q Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8081c4b357e0404fb26842274162d055"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8081c4b357e0404fb26842274162d055"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8081c4b357e0404fb26842274162d055"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8081c4b357e0404fb26842274162d055 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2061113384 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 60b5d6c1fa7c40c4876495acf7476732 Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2061113384-project Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '45f53954-5109-4fb4-8634-490b9664c7d8'} Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.312192 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:33.317092 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.317092 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:33.317092 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:33.317092 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:33.317092 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:33.317092 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:33.317092 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. Oct 17 15:49:33.317092 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:33.320869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] Returning 404 to user: Instance 45f53954-5109-4fb4-8634-490b9664c7d8 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:33.327149 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3da832af-f63c-4333-8a2f-10079e35936a tempest-AttachVolumeShelveTestJSON-2061113384 tempest-AttachVolumeShelveTestJSON-2061113384-project] 10.222.0.87 "GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8" status: 404 len: 111 microversion: 2.20 time: 0.103200 Oct 17 15:49:33.329617 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2451/5141] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:49:33 2022] GET /compute/v2.1/servers/45f53954-5109-4fb4-8634-490b9664c7d8 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:49:34.028534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:34.036479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:34.092317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:34.097025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:34.100843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:34.104133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:34.109847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:34.114853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:34.154423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:34.160235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:34.201752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:34.203671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:34.204849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:34.206612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:34.207828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:34.209484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:34.696013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:34.724344 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-be19cd13-682c-4bca-ad07-f2bdc6164bef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1232 microversion: 2.1 time: 0.577696 Oct 17 15:49:34.741257 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2452/5142] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:34 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1232 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:49:35.044222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:35.081218 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f89f742-4359-4ff3-a4a3-757c54b8d0c2 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1461 microversion: 2.1 time: 1.057883 Oct 17 15:49:35.087140 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2691/5143] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:34 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1461 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:35.118312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-44660fce-d64f-401b-9a65-124e3536fbc5 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3be4ef46-b70c-4b15-8f3d-181ae02673ae", "device": "/dev/sdb"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:35.124549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-44660fce-d64f-401b-9a65-124e3536fbc5 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:35.128984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:35.155318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44660fce-d64f-401b-9a65-124e3536fbc5 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:35.158001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44660fce-d64f-401b-9a65-124e3536fbc5 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:35.161493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44660fce-d64f-401b-9a65-124e3536fbc5 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:35.169612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44660fce-d64f-401b-9a65-124e3536fbc5 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:35.171101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44660fce-d64f-401b-9a65-124e3536fbc5 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:35.172453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44660fce-d64f-401b-9a65-124e3536fbc5 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:35.762026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:35.762716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:35.772028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:35.772525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:35.772964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:35.773695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:35.774149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:35.774608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:35.858954 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-44660fce-d64f-401b-9a65-124e3536fbc5 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "POST /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749378 Oct 17 15:49:35.869379 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2453/5144] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:49:35 2022] POST /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:49:35.996573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:36.005686 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2140a69a-0fdd-45ab-aec7-f7fcd0175bcf tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1298 microversion: 2.1 time: 0.247881 Oct 17 15:49:36.006946 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2692/5145] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:35 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1298 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:37.034215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:37.035786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:37.054765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:37.055672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:37.060352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:37.064412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:37.065655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:37.074865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:37.324834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:37.346429 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-027ee14b-c65a-4296-a6de-b9c4a5b7dcae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1286 microversion: 2.1 time: 0.317058 Oct 17 15:49:37.363625 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2454/5146] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:37 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1286 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:38.384777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:38.389259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:38.430330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:38.435338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:38.438646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:38.442560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:38.446677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:38.448318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:39.397528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:39.460490 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1328 microversion: 2.1 time: 1.084840 Oct 17 15:49:39.463809 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2693/5147] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:38 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1328 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:39.991893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:39.992948 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001639 Oct 17 15:49:40.001133 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2694/5148] 10.222.0.87 () {56 vars in 886 bytes} [Mon Oct 17 15:49:39 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 17 15:49:40.003346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:40.004691 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002259 Oct 17 15:49:40.013135 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2695/5149] 10.222.0.87 () {54 vars in 1035 bytes} [Mon Oct 17 15:49:40 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 17 15:49:40.013944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:40.015387 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001930 Oct 17 15:49:40.015859 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2696/5150] 10.222.0.87 () {54 vars in 1041 bytes} [Mon Oct 17 15:49:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:40.025076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:40.026538 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-938b2964-085e-47c4-afb2-dc3ded8342a9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001824 Oct 17 15:49:40.026939 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2697/5151] 10.222.0.87 () {56 vars in 886 bytes} [Mon Oct 17 15:49:40 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 17 15:49:40.497374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:40.500897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:40.543801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:40.544401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:40.552255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:40.555762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:40.557631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:40.560660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:40.621231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Calling method '.version_select at 0x7f28bea48940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:40.624371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:40.626721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:40.631627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:40.720815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:40.724993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:40.725908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:40.768360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:40.775055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:40.780129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:40.807148 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef30009a-0499-4523-aaca-225fa507c1a8 tempest-PortsAdminExtendedAttrsTestJSON-1244174365 tempest-PortsAdminExtendedAttrsTestJSON-1244174365-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.916665 Oct 17 15:49:40.808981 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2455/5152] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:49:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:41.554598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:41.573327 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a25f6483-8df5-4262-ac78-0055b804b4df tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1328 microversion: 2.1 time: 1.082561 Oct 17 15:49:41.574427 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2698/5153] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:40 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1328 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:42.629847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:42.630524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:42.648359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:42.654009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:42.655295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:42.656302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:42.659384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:42.660491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:42.671759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:42.934190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:42.964423 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-349bc4af-2ff9-4996-b23a-10c991fd718d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1328 microversion: 2.1 time: 0.340419 Oct 17 15:49:42.967882 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2456/5154] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:42 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1328 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:44.039194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:44.042210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:44.082525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:44.084488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:44.088537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:44.089968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:44.091010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:44.099735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:44.251296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ddc5e006-34fa-4ea8-af05-eb05ac440aa2 req-69079021-9249-4f52-bbd4-35908056ef52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0f50ef5-ee08-4d7b-b51a-df574fbc61cd", "tag": "5c06a8b1-67f7-46da-8203-e1ef151b7bb5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:44.256953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=12 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:44.292583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ddc5e006-34fa-4ea8-af05-eb05ac440aa2 req-69079021-9249-4f52-bbd4-35908056ef52 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:44.292982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ddc5e006-34fa-4ea8-af05-eb05ac440aa2 req-69079021-9249-4f52-bbd4-35908056ef52 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:44.293423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ddc5e006-34fa-4ea8-af05-eb05ac440aa2 req-69079021-9249-4f52-bbd4-35908056ef52 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:44.336198 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ddc5e006-34fa-4ea8-af05-eb05ac440aa2 req-69079021-9249-4f52-bbd4-35908056ef52 service nova] Creating event network-changed:5c06a8b1-67f7-46da-8203-e1ef151b7bb5 for instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd on n-h1-854441-12 Oct 17 15:49:44.348525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ddc5e006-34fa-4ea8-af05-eb05ac440aa2 req-69079021-9249-4f52-bbd4-35908056ef52 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101949 Oct 17 15:49:44.353702 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2457/5155] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:49:45.296732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:45.362423 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-591fa455-6b90-46ea-902f-80d0f890c49d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1328 microversion: 2.1 time: 1.344721 Oct 17 15:49:45.368266 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2699/5156] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:44 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1328 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:46.149217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22365bb4-1033-450a-a593-67249d2fdd44 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Action: 'create', calling method: .version_select at 0x7f28c2fe31f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1074731450", "metadata": {"Type": "work"}}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:46.421610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:46.467613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:46.487736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:46.488638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:46.489437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:46.490810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:46.491656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:46.492818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:47.600848 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22365bb4-1033-450a-a593-67249d2fdd44 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.984787 Oct 17 15:49:47.603626 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2458/5157] 10.222.0.87 () {60 vars in 1156 bytes} [Mon Oct 17 15:49:45 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1989 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 17 15:49:47.630908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-217b1f31-fd20-48c0-9f15-b686b950c9df tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28beca18b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:47.821445 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-217b1f31-fd20-48c0-9f15-b686b950c9df tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 200 len: 353 microversion: 2.1 time: 0.207191 Oct 17 15:49:47.823566 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2459/5158] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:47 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 353 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:47.839541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:47.875496 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f70458ae-0337-433f-99cd-6f7aaee5cf88 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1328 microversion: 2.1 time: 1.475614 Oct 17 15:49:47.894620 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2700/5159] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:46 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1328 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:48.855373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8c746d2c-f6e8-4cd0-8227-b1dcd339897d tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28be0a11f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:48.914488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:48.915725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:48.953569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:48.954081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:48.961168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:48.962425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:48.968281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:48.971081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:49.040971 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8c746d2c-f6e8-4cd0-8227-b1dcd339897d tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 200 len: 353 microversion: 2.1 time: 0.206628 Oct 17 15:49:49.042478 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2460/5160] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:48 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:50.072354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7da0a090-a200-42f4-9ea1-a7ac41bd428c tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28be0a14c0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:50.263034 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7da0a090-a200-42f4-9ea1-a7ac41bd428c tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 200 len: 354 microversion: 2.1 time: 0.206754 Oct 17 15:49:50.265454 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2461/5161] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:50 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 354 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:50.282403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5e0f5302-5ee8-4a71-83e4-a7d2cc92af77 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28beca18b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:50.399145 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5e0f5302-5ee8-4a71-83e4-a7d2cc92af77 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 200 len: 354 microversion: 2.1 time: 0.124282 Oct 17 15:49:50.402240 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2462/5162] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:50 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:50.414783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3e9a77f-21ea-4027-a8d7-5124caeb7446 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28c2f3cb80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:50.556225 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3e9a77f-21ea-4027-a8d7-5124caeb7446 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 202 len: 0 microversion: 2.1 time: 0.145506 Oct 17 15:49:50.560960 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2463/5163] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:49:50 2022] DELETE /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:49:50.567753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2c2b02d-3dbe-4f7b-8106-153641f8607b tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28c2f3c1f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:50.609779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:50.620699 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-761d3a0a-290e-490d-94bf-aa1e73f57cfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1328 microversion: 2.1 time: 1.713882 Oct 17 15:49:50.635059 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2701/5164] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:48 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1328 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:50.693196 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2c2b02d-3dbe-4f7b-8106-153641f8607b tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 200 len: 353 microversion: 2.1 time: 0.130638 Oct 17 15:49:50.693820 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2464/5165] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:50 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:51.058427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:51.059055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:51.072919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:51.073498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:51.077528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:51.083330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:51.086341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:51.086341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:51.128404 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] HTTP exception thrown: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Request method failure captured: Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e HTTP/1.1 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXfHRGsNmbIljC6FDbmFxSE1niSTP4rXJVcyZdQHLk7TeDhFFYTET7eETQsG_ucgc7-1fCvGsMVK9sjP-E6IqP4nDaUlFJli_olEvZxPZpRY9v7dnQvtcQukE8bPZu6IKCZRGn3e9Bc4Q_F1imbWErfoobnUFGK6QLFFhf3A2GoL_Rs Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b639ed781808456f97784cc215163549 Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1b7fcd63-035e-4da8-98e7-dd8482ff909e'} Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:51.130048 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Returning 404 to user: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ec00513-ff54-41fe-87ff-82b49fea3f1b tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 404 len: 111 microversion: 2.1 time: 0.079534 Oct 17 15:49:51.134380 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2702/5166] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:49:51 2022] DELETE /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:49:51.145075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:51.145979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 1b7fcd63-035e-4da8-98e7-dd8482ff909e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:51.156414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:51.157365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:51.161390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:51.172237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:51.173149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:51.173827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:51.196383 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] HTTP exception thrown: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Request method failure captured: Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e HTTP/1.1 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXfHRGsNmbIljC6FDbmFxSE1niSTP4rXJVcyZdQHLk7TeDhFFYTET7eETQsG_ucgc7-1fCvGsMVK9sjP-E6IqP4nDaUlFJli_olEvZxPZpRY9v7dnQvtcQukE8bPZu6IKCZRGn3e9Bc4Q_F1imbWErfoobnUFGK6QLFFhf3A2GoL_Rs Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b639ed781808456f97784cc215163549 Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '1b7fcd63-035e-4da8-98e7-dd8482ff909e'} Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:51.199343 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.203566 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:51.203566 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:51.203566 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:51.203566 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:51.203566 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:51.203566 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. Oct 17 15:49:51.203566 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:49:51.206119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Returning 404 to user: Instance 1b7fcd63-035e-4da8-98e7-dd8482ff909e could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:51.207464 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-462a79d5-28b8-415d-861b-104d7dfcdf3e tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e" status: 404 len: 111 microversion: 2.1 time: 0.067444 Oct 17 15:49:51.208867 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2465/5167] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:51 2022] GET /compute/v2.1/servers/1b7fcd63-035e-4da8-98e7-dd8482ff909e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:49:51.664026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:51.665133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:51.707150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:51.709762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:51.710793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:51.711665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2af59282-022a-4577-86b0-7e277419a01b tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28c2f3c1f0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:51.713251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:51.728049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:51.730092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:51.893704 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2af59282-022a-4577-86b0-7e277419a01b tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 200 len: 353 microversion: 2.1 time: 0.187275 Oct 17 15:49:51.898445 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2466/5168] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:51 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 353 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:49:52.288121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-7b05f3e6-0284-4354-9a3d-0ecf09b493af req-957b8b19-eaa8-4179-b05d-2c83012f3b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f50ef5-ee08-4d7b-b51a-df574fbc61cd", "name": "network-vif-plugged", "status": "completed", "tag": "5c06a8b1-67f7-46da-8203-e1ef151b7bb5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:49:52.316788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7b05f3e6-0284-4354-9a3d-0ecf09b493af req-957b8b19-eaa8-4179-b05d-2c83012f3b16 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:52.322096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7b05f3e6-0284-4354-9a3d-0ecf09b493af req-957b8b19-eaa8-4179-b05d-2c83012f3b16 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:52.323077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7b05f3e6-0284-4354-9a3d-0ecf09b493af req-957b8b19-eaa8-4179-b05d-2c83012f3b16 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:52.348490 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-7b05f3e6-0284-4354-9a3d-0ecf09b493af req-957b8b19-eaa8-4179-b05d-2c83012f3b16 service nova] Creating event network-vif-plugged:5c06a8b1-67f7-46da-8203-e1ef151b7bb5 for instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd on n-h1-854441-12 Oct 17 15:49:52.362419 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-7b05f3e6-0284-4354-9a3d-0ecf09b493af req-957b8b19-eaa8-4179-b05d-2c83012f3b16 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080555 Oct 17 15:49:52.367067 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2467/5169] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:52.723194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:52.743691 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0160d0ae-2597-4e97-8709-8462cd1b4217 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1328 microversion: 2.1 time: 1.092783 Oct 17 15:49:52.744743 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2703/5170] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:51 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1328 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:52.925861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-885f2fe1-11e8-4ab3-bb1a-a0203a2e9c7c tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28c2f3c550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:53.144157 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-885f2fe1-11e8-4ab3-bb1a-a0203a2e9c7c tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 200 len: 353 microversion: 2.1 time: 0.223637 Oct 17 15:49:53.145562 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2468/5171] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:52 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:53.780721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:53.781847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:53.835679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:53.840766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:53.842309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:53.848965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:53.849881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:53.851936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:54.175727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4de272b3-675c-4301-a26f-9f0f66775855 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28c2efce50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:54.366031 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4de272b3-675c-4301-a26f-9f0f66775855 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 200 len: 353 microversion: 2.1 time: 0.203069 Oct 17 15:49:54.367766 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2469/5172] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:54 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 353 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:54.501588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:54.534942 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dcd9e55e-8add-43e1-99b2-1e8bb3f2d4aa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1328 microversion: 2.1 time: 0.764485 Oct 17 15:49:54.543241 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2704/5173] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:53 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1328 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:55.393210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-33a09705-a048-431e-9c25-6adf81b2e413 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28be50b940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:55.478008 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-33a09705-a048-431e-9c25-6adf81b2e413 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 200 len: 353 microversion: 2.1 time: 0.098260 Oct 17 15:49:55.480052 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2470/5174] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:55 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:49:55.582544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:55.585665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:55.622539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:55.627049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:55.631486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:55.639817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:55.642532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:55.643480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:56.251271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:56.276192 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d11ff8f9-607d-42e9-be2a-4d4eda102801 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1510 microversion: 2.1 time: 0.709905 Oct 17 15:49:56.276809 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2705/5175] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:55 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1510 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:56.312460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:56.319128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:56.337695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:56.339110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:56.339593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:56.342046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:56.342576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:56.344903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:56.397930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:49:56.497638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7e4a21e-bc77-4087-b55e-2baf35f64952 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Calling method '.version_select at 0x7f28bd856f70>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:56.554288 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f7e4a21e-bc77-4087-b55e-2baf35f64952 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] HTTP exception thrown: Volume 50d1d375-1790-4178-8de2-8bbb7919d72b could not be found. Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7e4a21e-bc77-4087-b55e-2baf35f64952 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Request method failure captured: Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b HTTP/1.1 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXmZzfON6CedcZRNQrvgLZq4mFuXvfrS9i0su-tamxvNyn8NM6bOzXTYWacXWL5kpKz-loOsPMoY7a3BGGhsAlWB_p0ntznXzTDf9qsKwDuI642g18Am0bQk78lCnBHEcRpaiPMz1wH-BXjaSk6EVUiFNkhKi9PmpyyU8PACs7q-JKw Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 1b32c3d9348c4512b129e0f6ee908d36 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesGetTestJSON-1557482143 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1b32c3d9348c4512b129e0f6ee908d36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/1b32c3d9348c4512b129e0f6ee908d36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_1b32c3d9348c4512b129e0f6ee908d36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/1b32c3d9348c4512b129e0f6ee908d36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesGetTestJSON-1557482143 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 1b32c3d9348c4512b129e0f6ee908d36 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesGetTestJSON-1557482143 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-VolumesGetTestJSON-1557482143-project Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: f297e5a364284aeca0bfab7feee21538 Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesGetTestJSON-1557482143-project Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: exception: Volume 50d1d375-1790-4178-8de2-8bbb7919d72b could not be found. Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '50d1d375-1790-4178-8de2-8bbb7919d72b'} Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50d1d375-1790-4178-8de2-8bbb7919d72b could not be found. (HTTP 404) (Request-ID: req-37ab817a-07a3-41d4-ac2d-1b483afab9aa) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 15:49:56.561107 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50d1d375-1790-4178-8de2-8bbb7919d72b could not be found. Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50d1d375-1790-4178-8de2-8bbb7919d72b could not be found. Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50d1d375-1790-4178-8de2-8bbb7919d72b could not be found. Oct 17 15:49:56.567921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:56.574475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7e4a21e-bc77-4087-b55e-2baf35f64952 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] Returning 404 to user: Volume 50d1d375-1790-4178-8de2-8bbb7919d72b could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:56.574475 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7e4a21e-bc77-4087-b55e-2baf35f64952 tempest-VolumesGetTestJSON-1557482143 tempest-VolumesGetTestJSON-1557482143-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b" status: 404 len: 109 microversion: 2.1 time: 0.083898 Oct 17 15:49:56.578176 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2706/5176] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:49:56 2022] GET /compute/v2.1/os-volumes/50d1d375-1790-4178-8de2-8bbb7919d72b => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:49:56.864419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:56.865441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:56.886752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:56.890823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:56.896072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:56.897887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:56.905529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:56.911083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:57.026018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:57.040538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5d610506-4d10-4157-8c96-b26819240050 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1510 microversion: 2.1 time: 0.740129 Oct 17 15:49:57.056576 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2471/5177] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:56 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1510 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:57.068030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:57.068930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:57.098105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:57.099799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:57.102422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:57.107169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:57.111064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:57.115591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:57.259210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:49:57.586005 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36b1129b-57ae-4a18-80b6-3f17f743faae tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 204 len: 0 microversion: 2.1 time: 0.513425 Oct 17 15:49:57.589775 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2472/5178] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:49:57 2022] DELETE /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:49:57.613536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:57.620406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:57.648651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:57.649664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:57.650901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:57.656412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:57.656659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:57.657125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:59.034368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:59.054702 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a21dd695-1e67-4a07-817e-cbdd90180d9c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1516 microversion: 2.1 time: 1.458166 Oct 17 15:49:59.058709 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2473/5179] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:57 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1516 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:49:59.205536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:59.262430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:59.306349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:49:59.331998 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c621bf0f-0193-49a5-97e7-d25da91d7c06 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2953 microversion: 2.42 time: 2.459989 Oct 17 15:49:59.337291 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2707/5180] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:49:56 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2953 bytes in 2478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:49:59.369717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa8dae8f-a4de-4b58-9e6d-bb3be0163532 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:59.370805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa8dae8f-a4de-4b58-9e6d-bb3be0163532 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:59.381989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa8dae8f-a4de-4b58-9e6d-bb3be0163532 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:59.387011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa8dae8f-a4de-4b58-9e6d-bb3be0163532 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:59.387858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa8dae8f-a4de-4b58-9e6d-bb3be0163532 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:59.388905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa8dae8f-a4de-4b58-9e6d-bb3be0163532 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:59.397686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa8dae8f-a4de-4b58-9e6d-bb3be0163532 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:59.398819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa8dae8f-a4de-4b58-9e6d-bb3be0163532 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:59.546154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:59.546856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:59.556760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:59.585044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:59.586281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:59.587428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:59.588173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:59.588825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:59.628395 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] HTTP exception thrown: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Request method failure captured: Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 HTTP/1.1 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXfHRGsNmbIljC6FDbmFxSE1niSTP4rXJVcyZdQHLk7TeDhFFYTET7eETQsG_ucgc7-1fCvGsMVK9sjP-E6IqP4nDaUlFJli_olEvZxPZpRY9v7dnQvtcQukE8bPZu6IKCZRGn3e9Bc4Q_F1imbWErfoobnUFGK6QLFFhf3A2GoL_Rs Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b639ed781808456f97784cc215163549 Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '287b7782-35f5-4a0a-ac6e-d803d65080d1'} Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:59.633625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.642940 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.665918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Returning 404 to user: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:59.668140 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66f5703d-528f-4428-879c-4c7ebb70b430 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "DELETE /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 404 len: 111 microversion: 2.1 time: 0.126541 Oct 17 15:49:59.671793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2708/5181] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:49:59 2022] DELETE /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:49:59.696416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:49:59.699310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] [instance: 287b7782-35f5-4a0a-ac6e-d803d65080d1] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:49:59.781717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:59.800905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:59.802245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:59.809325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:49:59.811959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:49:59.813413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:49:59.878105 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] HTTP exception thrown: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Request method failure captured: Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 HTTP/1.1 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXfHRGsNmbIljC6FDbmFxSE1niSTP4rXJVcyZdQHLk7TeDhFFYTET7eETQsG_ucgc7-1fCvGsMVK9sjP-E6IqP4nDaUlFJli_olEvZxPZpRY9v7dnQvtcQukE8bPZu6IKCZRGn3e9Bc4Q_F1imbWErfoobnUFGK6QLFFhf3A2GoL_Rs Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fbc252cb98cc4704ac21c859ac75e121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: fbc252cb98cc4704ac21c859ac75e121 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1337995829 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b639ed781808456f97784cc215163549 Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeTestJSON-1337995829-project Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '287b7782-35f5-4a0a-ac6e-d803d65080d1'} Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:49:59.880633 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.886559 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:49:59.886559 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:49:59.886559 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:49:59.886559 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:49:59.886559 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:49:59.886559 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. Oct 17 15:49:59.886559 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:49:59.888639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] Returning 404 to user: Instance 287b7782-35f5-4a0a-ac6e-d803d65080d1 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:49:59.889862 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c1f01ec-1d4e-469c-9904-f6829c8f7039 tempest-AttachVolumeTestJSON-1337995829 tempest-AttachVolumeTestJSON-1337995829-project] 10.222.0.87 "GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1" status: 404 len: 111 microversion: 2.1 time: 0.213118 Oct 17 15:49:59.894884 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2709/5182] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:49:59 2022] GET /compute/v2.1/servers/287b7782-35f5-4a0a-ac6e-d803d65080d1 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:50:00.086886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:00.087481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:00.116635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:00.117208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:00.126719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:00.128430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:00.134279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:00.143407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:00.748375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa8dae8f-a4de-4b58-9e6d-bb3be0163532 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e/os-interface" status: 200 len: 1832 microversion: 2.42 time: 1.382862 Oct 17 15:50:00.749129 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2474/5183] 10.222.0.87 () {60 vars in 1316 bytes} [Mon Oct 17 15:49:59 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e/os-interface => generated 1832 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:50:01.761654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:01.798816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-22a9890f-030e-44b3-8ffd-f0b665a19291 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1516 microversion: 2.1 time: 1.713602 Oct 17 15:50:01.803300 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2710/5184] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:00 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1516 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:02.191614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d2ef1b81-f366-480e-83d7-38f7ef43d3ca req-087a2f04-eb24-41b5-a3e2-8541def0ede3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f50ef5-ee08-4d7b-b51a-df574fbc61cd", "name": "network-vif-deleted", "tag": "5c06a8b1-67f7-46da-8203-e1ef151b7bb5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:02.250025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d2ef1b81-f366-480e-83d7-38f7ef43d3ca req-087a2f04-eb24-41b5-a3e2-8541def0ede3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:02.264531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d2ef1b81-f366-480e-83d7-38f7ef43d3ca req-087a2f04-eb24-41b5-a3e2-8541def0ede3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:02.265975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d2ef1b81-f366-480e-83d7-38f7ef43d3ca req-087a2f04-eb24-41b5-a3e2-8541def0ede3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:02.309405 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d2ef1b81-f366-480e-83d7-38f7ef43d3ca req-087a2f04-eb24-41b5-a3e2-8541def0ede3 service nova] Creating event network-vif-deleted:5c06a8b1-67f7-46da-8203-e1ef151b7bb5 for instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd on n-h1-854441-12 Oct 17 15:50:02.332447 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d2ef1b81-f366-480e-83d7-38f7ef43d3ca req-087a2f04-eb24-41b5-a3e2-8541def0ede3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145253 Oct 17 15:50:02.342106 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2475/5185] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:02.845169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:02.846319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:02.868377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=40 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:02.877180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:02.878381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:02.887068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:02.888484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:02.889341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:02.890117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:03.083403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:03.084099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:03.084777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:03.085506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lazy-loading 'fault' on Instance uuid e0f50ef5-ee08-4d7b-b51a-df574fbc61cd {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:50:03.399889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:03.436591 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90d0c4aa-73d1-4d6e-8260-d26371403653 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 200 len: 1318 microversion: 2.1 time: 0.597200 Oct 17 15:50:03.439368 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2711/5186] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:02 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:04.482353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:04.485164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:04.516651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:04.518676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:04.520093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:04.523974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:04.528954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:04.532448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:04.638081 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd HTTP/1.1 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'e0f50ef5-ee08-4d7b-b51a-df574fbc61cd'} Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:50:04.648785 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:50:04.665424 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:50:04.665424 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:50:04.665424 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:50:04.665424 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:50:04.665424 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:50:04.665424 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:50:04.665424 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:50:04.676070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:50:04.680749 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-532221e4-ea70-4594-9835-657adb47a2bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 404 len: 111 microversion: 2.1 time: 0.206414 Oct 17 15:50:04.685909 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2476/5187] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:04 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:50:04.706789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8ed026d-a025-47a8-ab2e-9bff34f473b6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '.version_select at 0x7f28bedb9160>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:04.762341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8ed026d-a025-47a8-ab2e-9bff34f473b6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-key-915312029" status: 202 len: 0 microversion: 2.1 time: 0.071723 Oct 17 15:50:04.763749 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2712/5188] 10.222.0.87 () {58 vars in 1206 bytes} [Mon Oct 17 15:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-915312029 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:50:05.188248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1327811772", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "54423d23-912b-4e26-80bb-450813721e3a"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:05.312629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] validate_networks() for [('54423d23-912b-4e26-80bb-450813721e3a', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:50:07.170477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:50:07.171253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:50:07.171543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:50:07.172122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:50:07.172557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:50:07.174921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:07.205620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:07.224959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:07.228170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:07.234890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:07.243339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:07.247545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:07.320713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:50:07.343391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for user bec6f504a59b46228db013140f4ce605 and project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:50:07.403419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:50:07.408248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:50:07.574175 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d0cf7755-4d08-4cf2-b8fa-70d58ad8ae33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.391323 Oct 17 15:50:07.583548 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2477/5189] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:50:07.603685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a5a57e5-3e63-49e4-a59f-dd12ec4a3d8d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:07.604861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a5a57e5-3e63-49e4-a59f-dd12ec4a3d8d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:08.296599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a5a57e5-3e63-49e4-a59f-dd12ec4a3d8d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:08.305865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a5a57e5-3e63-49e4-a59f-dd12ec4a3d8d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1209 microversion: 2.1 time: 0.722219 Oct 17 15:50:08.315519 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2713/5190] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:07 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1209 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:09.339977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:09.340781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:09.390778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:09.391371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:09.392210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:09.393187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:09.394136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:09.394772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:10.515633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:10.534380 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e8e2373b-dc4c-48b9-aab3-e8e30789ab2d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1213 microversion: 2.1 time: 1.200387 Oct 17 15:50:10.537912 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2478/5191] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:09 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1213 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:11.577978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:11.578845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:11.596790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:11.597373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:11.597833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:11.598650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:11.599135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:11.599579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:11.608567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=87 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:11.909815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:11.929480 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c311fec8-3575-4206-ad92-64aed1f8f16b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1269 microversion: 2.1 time: 0.356456 Oct 17 15:50:11.930527 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2714/5192] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:11 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1269 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:12.981255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:12.982414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:13.014195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:13.020542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:13.027995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:13.028961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:13.029580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:13.030075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:13.280638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:13.295870 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a7f92520-a179-4177-97f4-a49507e36f33 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1267 microversion: 2.1 time: 0.329228 Oct 17 15:50:13.297502 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2479/5193] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:12 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1267 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:14.326043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:14.326981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:14.405963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:14.413719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:14.416480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:14.418737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:14.427268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:14.431120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:14.819404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:14.840649 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4c6c41f-ad77-49d8-9906-368b9c6022e5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1267 microversion: 2.1 time: 0.521041 Oct 17 15:50:14.841905 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2715/5194] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:14 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1267 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:15.944685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:15.963127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:16.017096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:16.019350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:16.020904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:16.026170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:16.027203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:16.028347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:16.941094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:17.042150 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20f474b1-616f-42bd-b0e5-df04ad15ed21 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1267 microversion: 2.1 time: 1.117400 Oct 17 15:50:17.043693 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2480/5195] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:15 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1267 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:18.088516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:18.092203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:18.122728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:18.131455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:18.132728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:18.136903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:18.141051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:18.142277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:18.311374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:18.646939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:18.656756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef4b6531-c848-4868-bb8e-0ca78d017c7b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1309 microversion: 2.1 time: 0.593894 Oct 17 15:50:18.674543 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2716/5196] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:18 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1309 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:19.721537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:19.745856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:19.797159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:19.801648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:19.828379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:19.834541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:19.839401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:19.845183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:19.848958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:19.852961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:20.632999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:20.672808 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81a14040-3bfc-4d00-9fcf-9a79508dae26 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1309 microversion: 2.1 time: 0.947912 Oct 17 15:50:20.675101 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2481/5197] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:19 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1309 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:20.728142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b15365b-7ca1-4a64-9ed9-3e89780f4088 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: .version_select at 0x7f28bd88b5e0>, body: {"keypair": {"name": "tempest-keypair-166454863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSFUz+s3XvjZkXw5EQlmCUqSWtzjH+G36aXADxmIxmsoXmZxWJHmoO7Jjp4WW1F/FtPb/nxfBKLgBLaoEBlEvrFq2CbjLwrfLt9XoA2TkYF/ojUVwf3i+jSzDM29VJjlg=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:20.770254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2b15365b-7ca1-4a64-9ed9-3e89780f4088 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for project 95e7c17929974c669051e99792e83d40. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:50:20.791110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2b15365b-7ca1-4a64-9ed9-3e89780f4088 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for user 98d8f0d40fd0472e8ffc58d09811c4cc and project 95e7c17929974c669051e99792e83d40. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:50:20.851300 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b15365b-7ca1-4a64-9ed9-3e89780f4088 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.884048 Oct 17 15:50:20.855807 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2717/5198] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:50:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:21.701858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:21.701858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:21.725620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:21.726138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:21.726630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:21.727387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:21.734666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:21.735468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:22.384450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:22.400261 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6e4f8235-400c-40bb-82ff-d539b7ed077b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1309 microversion: 2.1 time: 0.705530 Oct 17 15:50:22.406013 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2482/5199] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:21 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1309 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:23.182806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a16e4e32-ee42-46a4-84de-b79413df0f64 req-7b9c29a0-dc60-47e9-897b-3002ac7ba610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8d001d-71ea-49d9-9e2f-929062d28b27", "tag": "e61225b0-fd5f-4a35-be0b-4c7db75a25fd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:23.227093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a16e4e32-ee42-46a4-84de-b79413df0f64 req-7b9c29a0-dc60-47e9-897b-3002ac7ba610 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:23.227821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a16e4e32-ee42-46a4-84de-b79413df0f64 req-7b9c29a0-dc60-47e9-897b-3002ac7ba610 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:23.228290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a16e4e32-ee42-46a4-84de-b79413df0f64 req-7b9c29a0-dc60-47e9-897b-3002ac7ba610 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:23.278320 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a16e4e32-ee42-46a4-84de-b79413df0f64 req-7b9c29a0-dc60-47e9-897b-3002ac7ba610 service nova] Creating event network-changed:e61225b0-fd5f-4a35-be0b-4c7db75a25fd for instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 on n-h1-854441-12 Oct 17 15:50:23.296707 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a16e4e32-ee42-46a4-84de-b79413df0f64 req-7b9c29a0-dc60-47e9-897b-3002ac7ba610 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132732 Oct 17 15:50:23.297414 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2718/5200] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:50:23.431412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:23.432560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:23.446492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97694025-789f-487b-8d60-87d458b8aee5 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28bd84a700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:23.457352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:23.457839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:23.461516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:23.462672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:23.463327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:23.464035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:23.557893 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97694025-789f-487b-8d60-87d458b8aee5 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/1873dc6d-b4b1-41d1-afc3-2f5f549a7f2f" status: 200 len: 350 microversion: 2.1 time: 0.116658 Oct 17 15:50:23.559044 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2719/5201] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:50:23 2022] GET /compute/v2.1/os-volumes/1873dc6d-b4b1-41d1-afc3-2f5f549a7f2f => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:50:25.648737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:25.666534 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b60c4f79-5294-460b-9d90-6e2d926467d2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1309 microversion: 2.1 time: 2.240791 Oct 17 15:50:25.667134 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2483/5202] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:23 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1309 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:26.496970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ce68c52-d3c7-4b0f-91f3-35aea94e234b tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28bd824dc0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:26.606568 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ce68c52-d3c7-4b0f-91f3-35aea94e234b tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/4e313272-caac-4f96-82d1-963afb992ff8" status: 200 len: 351 microversion: 2.1 time: 0.130443 Oct 17 15:50:26.623076 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2720/5203] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:50:26 2022] GET /compute/v2.1/os-volumes/4e313272-caac-4f96-82d1-963afb992ff8 => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:26.694281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:26.695654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:26.756912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:26.767168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:26.770182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:26.773572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:26.779074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:26.780169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:26.829107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:28.420695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:28.436742 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f6d79121-b7cd-4cbe-b9ae-27873ee5b0eb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1309 microversion: 2.1 time: 1.750576 Oct 17 15:50:28.437967 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2484/5204] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:26 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1309 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:29.465873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:29.467504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:29.477948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:29.480491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:29.480491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:29.481808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:29.482775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:29.485005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:29.828862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:29.836774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b65a9501-8b26-4c14-9d84-dcd4360f9fcc tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28be4d5790>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:29.843415 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac2994cb-4149-451b-8d4b-39e68a1cf629 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1309 microversion: 2.1 time: 0.382231 Oct 17 15:50:29.844841 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2721/5205] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:29 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:29.941010 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b65a9501-8b26-4c14-9d84-dcd4360f9fcc tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/6d33d5f7-97f2-4b21-9d3e-8c539f91e2d4" status: 200 len: 351 microversion: 2.1 time: 0.108223 Oct 17 15:50:29.942422 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2485/5206] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:50:29 2022] GET /compute/v2.1/os-volumes/6d33d5f7-97f2-4b21-9d3e-8c539f91e2d4 => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:29.957889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9962154-8828-4b9f-8372-4392f309ee50 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28bd824e50>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:30.116212 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9962154-8828-4b9f-8372-4392f309ee50 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.162714 Oct 17 15:50:30.131979 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2722/5207] 10.222.0.87 () {58 vars in 1134 bytes} [Mon Oct 17 15:50:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:30.153605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d62abf9b-92cc-4db5-ad96-03bfc1366d38 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28c2df3550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:30.489129 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d62abf9b-92cc-4db5-ad96-03bfc1366d38 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.339687 Oct 17 15:50:30.489765 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2486/5208] 10.222.0.87 () {58 vars in 1149 bytes} [Mon Oct 17 15:50:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:30.548584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3547e7e6-619a-4b2f-935f-1a55e7f5861e tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28bd84ac10>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:30.814396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:30.822803 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3547e7e6-619a-4b2f-935f-1a55e7f5861e tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.302714 Oct 17 15:50:30.824317 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2723/5209] 10.222.0.87 () {58 vars in 1134 bytes} [Mon Oct 17 15:50:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:30.850056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-622a9e8f-add7-4e27-adba-bbc1c7085938 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28be32da60>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:30.868449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:30.869610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:30.892737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:30.894864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:30.895337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:30.896108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:30.896587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:30.905685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:31.112473 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-622a9e8f-add7-4e27-adba-bbc1c7085938 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.266505 Oct 17 15:50:31.113742 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2487/5210] 10.222.0.87 () {58 vars in 1167 bytes} [Mon Oct 17 15:50:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:31.140917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aaa4bd9f-ad8a-4f70-a14c-5f759187e0cd tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28be010d30>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:31.485831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aaa4bd9f-ad8a-4f70-a14c-5f759187e0cd tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.349005 Oct 17 15:50:31.488019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2488/5211] 10.222.0.87 () {58 vars in 1170 bytes} [Mon Oct 17 15:50:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:31.521126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f5eb5e8-4762-40df-907b-f9d0f40b34e3 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28bea483a0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:31.771636 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f5eb5e8-4762-40df-907b-f9d0f40b34e3 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.256305 Oct 17 15:50:31.772774 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2489/5212] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:50:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:31.805728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:31.811049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbab6b12-8560-4dd0-a6e6-b522fd689313 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28bf1f8c10>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:31.852643 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b379a1ce-6f70-47e0-be96-f55cb67b4683 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1309 microversion: 2.1 time: 0.987762 Oct 17 15:50:31.854402 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2724/5213] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:30 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1309 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:32.125186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bbab6b12-8560-4dd0-a6e6-b522fd689313 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.329304 Oct 17 15:50:32.128311 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2490/5214] 10.222.0.87 () {58 vars in 1188 bytes} [Mon Oct 17 15:50:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:32.161843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9aff80d4-6beb-4fe3-8154-8c250f1cbc14 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] Calling method '.version_select at 0x7f28be0fa790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:32.362981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-518713566", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "610043dc-4af1-4887-b876-94edd1ec11a6"}], "security_groups": [{"name": "tempest-securitygroup--1171978642"}], "key_name": "tempest-keypair-166454863", "user_data": "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:32.500093 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9aff80d4-6beb-4fe3-8154-8c250f1cbc14 tempest-VolumesTestJSON-658981637 tempest-VolumesTestJSON-658981637-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.346491 Oct 17 15:50:32.516050 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2725/5215] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 15:50:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:32.692134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] validate_networks() for [('610043dc-4af1-4887-b876-94edd1ec11a6', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:50:32.900748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:32.911724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:32.921914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:32.957861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:32.959223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:32.961147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:32.965110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:32.967491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:32.971411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:33.897653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:33.922202 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3022afe0-4566-40df-85b5-c03298c2c36e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1309 microversion: 2.1 time: 1.039587 Oct 17 15:50:33.923089 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2726/5216] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:32 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1309 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:33.943108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-392fefb2-922d-4f90-8f7a-a14a8435879a req-5ef89b3e-94cf-4a10-a808-c151b6095dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d001d-71ea-49d9-9e2f-929062d28b27", "name": "network-vif-plugged", "status": "completed", "tag": "e61225b0-fd5f-4a35-be0b-4c7db75a25fd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:33.980177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-392fefb2-922d-4f90-8f7a-a14a8435879a req-5ef89b3e-94cf-4a10-a808-c151b6095dcc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:33.989536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-392fefb2-922d-4f90-8f7a-a14a8435879a req-5ef89b3e-94cf-4a10-a808-c151b6095dcc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:33.990190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-392fefb2-922d-4f90-8f7a-a14a8435879a req-5ef89b3e-94cf-4a10-a808-c151b6095dcc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:34.031387 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-392fefb2-922d-4f90-8f7a-a14a8435879a req-5ef89b3e-94cf-4a10-a808-c151b6095dcc service nova] Creating event network-vif-plugged:e61225b0-fd5f-4a35-be0b-4c7db75a25fd for instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 on n-h1-854441-12 Oct 17 15:50:34.035890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:50:34.036534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:50:34.036746 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-392fefb2-922d-4f90-8f7a-a14a8435879a req-5ef89b3e-94cf-4a10-a808-c151b6095dcc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105743 Oct 17 15:50:34.037394 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2727/5217] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:34.037836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:50:34.038681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:50:34.039418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:50:34.095789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:34.108946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:34.110700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:34.120902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:34.127607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:34.131469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:34.171936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for project 95e7c17929974c669051e99792e83d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:50:34.189728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for user 98d8f0d40fd0472e8ffc58d09811c4cc and project 95e7c17929974c669051e99792e83d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:50:34.259021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:50:34.265306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:50:34.437267 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a0e5bbc-5fa4-4333-b5d2-d42867171946 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.088310 Oct 17 15:50:34.443624 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2491/5218] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:50:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:50:34.463099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd9754f3-1ec4-4a22-9860-864642bcaa37 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:34.464267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd9754f3-1ec4-4a22-9860-864642bcaa37 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:34.611613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd9754f3-1ec4-4a22-9860-864642bcaa37 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:34.673840 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd9754f3-1ec4-4a22-9860-864642bcaa37 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1240 microversion: 2.1 time: 0.213669 Oct 17 15:50:34.681000 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2728/5219] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:34 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1240 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:34.950770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:34.952005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:34.967631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:34.971084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:34.971686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:34.972582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:34.975474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:34.978148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:35.371135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:35.384694 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8bef733a-0ad9-4aab-bf50-097fcddf3dfa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1309 microversion: 2.1 time: 0.439298 Oct 17 15:50:35.388467 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2492/5220] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:34 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1309 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:35.722143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:35.723022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:35.737850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:35.738421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:35.738907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:35.739649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:35.740112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:35.740539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:35.957520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:35.968470 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3da8544-286a-4768-8b17-131f6d38e9ce tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1236 microversion: 2.1 time: 0.250303 Oct 17 15:50:35.982973 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2729/5221] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:35 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1236 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:36.412430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:36.413241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:36.449059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:36.449555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:36.449989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:36.456126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:36.459054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:36.464505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:37.021251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:37.028077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:37.052028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:37.055359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:37.060760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:37.062233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:37.062973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:37.063598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:37.250939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:37.263855 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-120919d3-9226-451f-8f9d-12e2c588499e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1310 microversion: 2.1 time: 0.247226 Oct 17 15:50:37.270912 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2730/5222] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:37 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1310 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:37.441821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:37.454782 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d121b2b-a45a-40ce-a88f-117fd3b15895 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1490 microversion: 2.1 time: 1.047025 Oct 17 15:50:37.460199 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2493/5223] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:36 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1490 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:37.664461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1327811772", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "54423d23-912b-4e26-80bb-450813721e3a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:37.742116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] validate_networks() for [('54423d23-912b-4e26-80bb-450813721e3a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:50:38.295681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:38.296873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:38.310840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:38.313365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:38.315625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:38.319517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:38.320857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:38.322265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:38.326489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:38.569597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:38.590734 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-be3a57ab-33e2-4db6-91c3-1bebfc6c7f36 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1298 microversion: 2.1 time: 0.300366 Oct 17 15:50:38.607769 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2494/5224] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:38 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1298 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:38.955659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:50:38.956495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:50:38.957455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:50:38.958216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:50:38.959009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:50:39.004373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:39.007074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:39.010349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:39.018750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:39.020048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:39.025686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:39.115218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:50:39.162156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for user bec6f504a59b46228db013140f4ce605 and project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:50:39.194772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:50:39.197352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:50:39.288667 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b668a99d-6586-4e78-a28e-7e3b1055195d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.628163 Oct 17 15:50:39.290132 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2731/5225] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:50:39.315932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5102c1ba-51b8-4f1c-bb50-c382d0adfa05 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:39.316982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5102c1ba-51b8-4f1c-bb50-c382d0adfa05 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:39.625249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:39.625889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:39.647621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:39.648733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:39.649392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:39.655622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:39.656387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:39.658171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:39.693500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5102c1ba-51b8-4f1c-bb50-c382d0adfa05 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:39.705754 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5102c1ba-51b8-4f1c-bb50-c382d0adfa05 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1209 microversion: 2.1 time: 0.402959 Oct 17 15:50:39.710274 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2495/5226] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:39 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1209 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:40.263294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:40.313746 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98dbd849-ca2d-4f3c-897a-06430773b5c7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1366 microversion: 2.1 time: 0.692873 Oct 17 15:50:40.317317 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2732/5227] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:39 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1366 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:40.735176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c69aba29-fee5-4992-8a86-5c71955b771e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:40.738151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c69aba29-fee5-4992-8a86-5c71955b771e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:40.991621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c69aba29-fee5-4992-8a86-5c71955b771e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:41.018077 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c69aba29-fee5-4992-8a86-5c71955b771e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1209 microversion: 2.1 time: 0.290968 Oct 17 15:50:41.031803 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2496/5228] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:40 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1209 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:41.363845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:41.365422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:41.384382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:41.385943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:41.386703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:41.388609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:41.390538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:41.392477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:42.078551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:42.080706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:42.096014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:42.096793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:42.097730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:42.100265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:42.102255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:42.103390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:42.364960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:42.369637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=64 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:42.384568 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc4861fd-17f4-466a-836c-bf443d75b97f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1366 microversion: 2.1 time: 1.031117 Oct 17 15:50:42.390367 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2733/5229] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:41 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1366 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:42.604193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:42.645617 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1786fa5c-67d8-4d93-85f6-aedc10c50aca tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1269 microversion: 2.1 time: 0.575158 Oct 17 15:50:42.650292 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2497/5230] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:42 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1269 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:42.744540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-eb2081c4-0acc-4374-a066-5dfb5eb8bb27 req-b81173aa-35c4-4909-976f-cccc0e413ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f0e647-c24a-496d-ac11-6a9187931eee", "tag": "77e125cd-110d-49fa-bcf8-1866d2ccafee"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:42.789745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb2081c4-0acc-4374-a066-5dfb5eb8bb27 req-b81173aa-35c4-4909-976f-cccc0e413ee2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:42.791247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb2081c4-0acc-4374-a066-5dfb5eb8bb27 req-b81173aa-35c4-4909-976f-cccc0e413ee2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:42.792337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-eb2081c4-0acc-4374-a066-5dfb5eb8bb27 req-b81173aa-35c4-4909-976f-cccc0e413ee2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:42.828994 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-eb2081c4-0acc-4374-a066-5dfb5eb8bb27 req-b81173aa-35c4-4909-976f-cccc0e413ee2 service nova] Creating event network-changed:77e125cd-110d-49fa-bcf8-1866d2ccafee for instance 48f0e647-c24a-496d-ac11-6a9187931eee on n-h2-854441-12 Oct 17 15:50:42.843679 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-eb2081c4-0acc-4374-a066-5dfb5eb8bb27 req-b81173aa-35c4-4909-976f-cccc0e413ee2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100228 Oct 17 15:50:42.844666 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2734/5231] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:43.433606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:43.439153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:43.470948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:43.472086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:43.472882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:43.474324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:43.475433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:43.484909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:43.688031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:43.689334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:43.741924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:43.743193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:43.744070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:43.745440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:43.748342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:43.749398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:43.934891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:43.953965 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8be018f6-d90b-4211-8c67-5bdffd659907 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1267 microversion: 2.1 time: 0.277840 Oct 17 15:50:43.955849 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2735/5232] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:43 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:44.153002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:45.015479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:45.016976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:45.035878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:45.037074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:45.043037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:45.044289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:45.044982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:45.045662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:45.248091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:45.260876 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4134db78-1245-447e-beee-d4103cdc4e96 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1366 microversion: 2.1 time: 1.835456 Oct 17 15:50:45.267482 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2498/5233] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:43 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1366 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:45.346110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:45.365627 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-343b1921-08e7-4d9c-931b-21d9c7f84c98 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1267 microversion: 2.1 time: 0.353358 Oct 17 15:50:45.368215 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2736/5234] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:45 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1267 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:46.288220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:46.289622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:46.305694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:46.306797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:46.307981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:46.309657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:46.311067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:46.313881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:46.419744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:46.421660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:46.434487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:46.440761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:46.442234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:46.443285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:46.444033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:46.444639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:46.521516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:46.533828 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b16e4f05-6c73-4a34-9390-fb0422b887ef tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1267 microversion: 2.1 time: 0.117141 Oct 17 15:50:46.535464 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2737/5235] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:46 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1267 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:46.781641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:46.790152 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a0dafa5-0b4b-43a7-bdfd-5b1b75b4ad7e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1366 microversion: 2.1 time: 0.506376 Oct 17 15:50:46.803382 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2499/5236] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:46 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:47.574562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:47.575329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:47.591027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:47.597352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:47.597352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:47.597352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:47.597352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:47.597352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:47.808847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-93d84a1a-12a4-4d19-9925-924ea5963dde req-fc991790-5a63-4139-aeaf-dd9c0d43252d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f0e647-c24a-496d-ac11-6a9187931eee", "name": "network-vif-plugged", "status": "completed", "tag": "77e125cd-110d-49fa-bcf8-1866d2ccafee"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:47.831488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-93d84a1a-12a4-4d19-9925-924ea5963dde req-fc991790-5a63-4139-aeaf-dd9c0d43252d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:47.837654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-93d84a1a-12a4-4d19-9925-924ea5963dde req-fc991790-5a63-4139-aeaf-dd9c0d43252d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:47.839064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-93d84a1a-12a4-4d19-9925-924ea5963dde req-fc991790-5a63-4139-aeaf-dd9c0d43252d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:47.871473 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-93d84a1a-12a4-4d19-9925-924ea5963dde req-fc991790-5a63-4139-aeaf-dd9c0d43252d service nova] Creating event network-vif-plugged:77e125cd-110d-49fa-bcf8-1866d2ccafee for instance 48f0e647-c24a-496d-ac11-6a9187931eee on n-h2-854441-12 Oct 17 15:50:47.884175 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-93d84a1a-12a4-4d19-9925-924ea5963dde req-fc991790-5a63-4139-aeaf-dd9c0d43252d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079079 Oct 17 15:50:47.885209 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2500/5237] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:50:47.915532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:47.916429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:47.936530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:47.937325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:47.939092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:47.940030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:47.944585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:47.945242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:48.241986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:48.255618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-666f0219-a8df-476e-9bb7-29aed2ccb4ce tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.684975 Oct 17 15:50:48.256614 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2738/5238] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:47 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:48.842911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:48.854368 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea4a55a6-136c-4336-ad1c-421df2ee78bc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1366 microversion: 2.1 time: 0.967305 Oct 17 15:50:48.855623 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2501/5239] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:47 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1366 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:49.284524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:49.285343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:49.303497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:49.304431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:49.306362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:49.307036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:49.307729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:49.309019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:49.310400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:49.312143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:49.724611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:49.754319 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cec5f05d-bd21-4af0-8bc8-f62faf4e5463 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.472895 Oct 17 15:50:49.758960 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2739/5240] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:49 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:49.889126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:49.889994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:49.900723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:49.902349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:49.903556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:49.904614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:49.905283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:49.905889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:50.788147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:50.789808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:50.807994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:50.808631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:50.809545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:50.812812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:50.815148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:50.815597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:51.017658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:51.092484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:51.095024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:51.117098 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af174e6a-f41c-421b-8ed5-d8503bfece47 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.337006 Oct 17 15:50:51.119386 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2740/5241] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:50 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:51.119896 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0fd7bc16-977c-4ce0-8b1e-38694b040bf8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1555 microversion: 2.1 time: 1.235169 Oct 17 15:50:51.122913 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2502/5242] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:49 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1555 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:51.150258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24fe9875-37cb-4bcd-8d32-0e236702bf8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:51.151080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24fe9875-37cb-4bcd-8d32-0e236702bf8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:51.160763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fe9875-37cb-4bcd-8d32-0e236702bf8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:51.161824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fe9875-37cb-4bcd-8d32-0e236702bf8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:51.162992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fe9875-37cb-4bcd-8d32-0e236702bf8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:51.164002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fe9875-37cb-4bcd-8d32-0e236702bf8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:51.164723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fe9875-37cb-4bcd-8d32-0e236702bf8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:51.165385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24fe9875-37cb-4bcd-8d32-0e236702bf8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:51.307196 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24fe9875-37cb-4bcd-8d32-0e236702bf8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162792 Oct 17 15:50:51.308558 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2741/5243] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:50:51 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:52.146518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:52.148994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:52.157193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:52.157997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:52.160005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:52.160989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:52.161649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:52.162257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:52.276399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3d3256ee-cd6e-4150-99e0-931c325016c4 req-d4b14207-406a-4045-aa13-24ca7ac3bb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e849c30a-09cc-4908-a3b6-ff475c7bb547", "tag": "3bc0e666-31f5-4017-8069-f023149ca37a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:52.293913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3d3256ee-cd6e-4150-99e0-931c325016c4 req-d4b14207-406a-4045-aa13-24ca7ac3bb08 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:52.297001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3d3256ee-cd6e-4150-99e0-931c325016c4 req-d4b14207-406a-4045-aa13-24ca7ac3bb08 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:52.299804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3d3256ee-cd6e-4150-99e0-931c325016c4 req-d4b14207-406a-4045-aa13-24ca7ac3bb08 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:52.322957 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3d3256ee-cd6e-4150-99e0-931c325016c4 req-d4b14207-406a-4045-aa13-24ca7ac3bb08 service nova] Creating event network-changed:3bc0e666-31f5-4017-8069-f023149ca37a for instance e849c30a-09cc-4908-a3b6-ff475c7bb547 on n-h1-854441-12 Oct 17 15:50:52.344098 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3d3256ee-cd6e-4150-99e0-931c325016c4 req-d4b14207-406a-4045-aa13-24ca7ac3bb08 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077565 Oct 17 15:50:52.346111 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2742/5244] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:50:52.856621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:52.875672 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b9e84f2c-f76d-45bb-95b9-d03f8bc51c0a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.736408 Oct 17 15:50:52.876299 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2503/5245] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:52 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:50:53.125670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-887c2d21-0dd6-4c2d-9e24-74c9b9096fd7 req-510a9579-e17e-442f-ac75-e2b7c7a78e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f0e647-c24a-496d-ac11-6a9187931eee", "tag": "77e125cd-110d-49fa-bcf8-1866d2ccafee"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:50:53.199226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-887c2d21-0dd6-4c2d-9e24-74c9b9096fd7 req-510a9579-e17e-442f-ac75-e2b7c7a78e9c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:53.207834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-887c2d21-0dd6-4c2d-9e24-74c9b9096fd7 req-510a9579-e17e-442f-ac75-e2b7c7a78e9c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:53.215679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-887c2d21-0dd6-4c2d-9e24-74c9b9096fd7 req-510a9579-e17e-442f-ac75-e2b7c7a78e9c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:53.277000 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-887c2d21-0dd6-4c2d-9e24-74c9b9096fd7 req-510a9579-e17e-442f-ac75-e2b7c7a78e9c service nova] Creating event network-changed:77e125cd-110d-49fa-bcf8-1866d2ccafee for instance 48f0e647-c24a-496d-ac11-6a9187931eee on n-h2-854441-12 Oct 17 15:50:53.316848 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-887c2d21-0dd6-4c2d-9e24-74c9b9096fd7 req-510a9579-e17e-442f-ac75-e2b7c7a78e9c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200085 Oct 17 15:50:53.317953 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2743/5246] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:50:53.914007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:53.920345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:53.943571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:53.944437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:53.945093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:53.946629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:53.947981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:53.950643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:54.450364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:54.472645 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-da2392ea-8da0-4b0d-a3e8-d73aa4a5071d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.570180 Oct 17 15:50:54.492857 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2504/5247] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:53 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:55.541966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:55.543032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:55.562316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:55.562892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:55.563357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:55.572014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:55.572733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:55.573193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:56.307882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:56.336134 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8dae6a69-ee04-4ed5-bb19-6eeac10611a7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.799672 Oct 17 15:50:56.338197 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2744/5248] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:55 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:57.388225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:57.390891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:57.418479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:57.419399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:57.420207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:57.428734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:57.429833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:57.430688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:57.451539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=70 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:50:57.801340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:57.822092 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9cfa38b0-0fa4-4995-82d9-c3242efe465d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.459781 Oct 17 15:50:57.823736 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2505/5249] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:57 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:50:58.861449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:50:58.862484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:50:58.901630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:58.908547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:58.910881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:58.912101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:50:58.920261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:50:58.925362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:50:59.469065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:50:59.486225 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ac762ac-7898-4e0f-ae50-c5ce20c6caa5 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.633667 Oct 17 15:50:59.488839 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2745/5250] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:50:58 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:00.391883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-70bdbca7-dd04-4cf5-8194-144d99b3f5f8 req-9e9f6651-e411-4434-a029-0dfa1e8c7978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e849c30a-09cc-4908-a3b6-ff475c7bb547", "name": "network-vif-plugged", "status": "completed", "tag": "3bc0e666-31f5-4017-8069-f023149ca37a"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:00.414128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-70bdbca7-dd04-4cf5-8194-144d99b3f5f8 req-9e9f6651-e411-4434-a029-0dfa1e8c7978 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:00.418471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-70bdbca7-dd04-4cf5-8194-144d99b3f5f8 req-9e9f6651-e411-4434-a029-0dfa1e8c7978 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:00.419147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-70bdbca7-dd04-4cf5-8194-144d99b3f5f8 req-9e9f6651-e411-4434-a029-0dfa1e8c7978 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:00.449044 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-70bdbca7-dd04-4cf5-8194-144d99b3f5f8 req-9e9f6651-e411-4434-a029-0dfa1e8c7978 service nova] Creating event network-vif-plugged:3bc0e666-31f5-4017-8069-f023149ca37a for instance e849c30a-09cc-4908-a3b6-ff475c7bb547 on n-h1-854441-12 Oct 17 15:51:00.474027 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-70bdbca7-dd04-4cf5-8194-144d99b3f5f8 req-9e9f6651-e411-4434-a029-0dfa1e8c7978 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086445 Oct 17 15:51:00.495619 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2506/5251] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:51:00.520099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:00.520649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:00.530044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:00.530956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:00.531586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:00.532834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:00.533510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:00.534344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:01.023445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:01.045841 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48179e5d-427b-467a-b466-bb179807fc59 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.532362 Oct 17 15:51:01.047145 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2746/5252] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:00 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:02.090347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:02.091616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:02.112359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:02.114189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:02.117834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:02.120246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:02.124261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:02.125674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:02.812385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:02.830420 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-823143b1-8470-48fc-8dc4-6b44fdf274e8 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1309 microversion: 2.1 time: 0.745003 Oct 17 15:51:02.833006 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2507/5253] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:02 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1309 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:03.861166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:03.862146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:03.868711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:03.884600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:03.885240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:03.888129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:03.898485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:03.900997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:03.903606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:04.583015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:04.599977 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b27ede64-4a70-47e0-a067-4f0bc016f6d9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1491 microversion: 2.1 time: 0.745937 Oct 17 15:51:04.601250 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2747/5254] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:03 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1491 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:51:04.633282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:04.634016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:04.657128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:04.658933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:04.660517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:04.663684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:04.664197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:04.667379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:05.183973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:05.193241 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-562b150a-2ce7-4bcf-b3e9-bea6a654a3de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1490 microversion: 2.1 time: 0.566331 Oct 17 15:51:05.196299 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2508/5255] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:04 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1490 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:05.226752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:05.228303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:05.246305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:05.247239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:05.249345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:05.250468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:05.258225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:05.260592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:05.766877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:05.782010 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16747f61-d885-4613-b5be-0f66c1af5534 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1491 microversion: 2.1 time: 0.559112 Oct 17 15:51:05.794209 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2748/5256] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:05 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1491 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:05.811899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:05.812491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:05.827694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:05.828094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:05.828542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:05.834709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:05.839385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:05.841745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:05.900323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:51:06.128815 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4f0eecb4-7767-462a-ad94-74e502c75b4e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 204 len: 0 microversion: 2.1 time: 0.320261 Oct 17 15:51:06.137131 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2509/5257] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:51:05 2022] DELETE /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:51:06.145592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:06.147940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:06.165637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:06.167106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:06.170267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:06.186420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:06.188095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:06.193021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:06.863947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:06.873722 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-927ad483-bbe9-4d78-97ef-388508b3ba8e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1497 microversion: 2.1 time: 0.732260 Oct 17 15:51:06.880327 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2749/5258] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:06 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1497 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:07.946322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:07.948364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:07.967974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:07.974385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:07.975619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:07.982297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:07.983022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:07.986955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:08.560094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:08.583464 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a614da98-28b8-41e0-a02c-bc6c18ca37de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1497 microversion: 2.1 time: 0.643730 Oct 17 15:51:08.599878 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2510/5259] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:07 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1497 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:09.595264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d88bfa57-a450-4c7e-b9ab-03e34a5c491b req-1ddaa256-cd42-44e6-abd7-fc550707706c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e849c30a-09cc-4908-a3b6-ff475c7bb547", "name": "network-vif-deleted", "tag": "3bc0e666-31f5-4017-8069-f023149ca37a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:09.644827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:09.650881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:09.669364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:09.693713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:09.694933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:09.698211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:09.700870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:09.703007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:09.703736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:09.706673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d88bfa57-a450-4c7e-b9ab-03e34a5c491b req-1ddaa256-cd42-44e6-abd7-fc550707706c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:09.708281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d88bfa57-a450-4c7e-b9ab-03e34a5c491b req-1ddaa256-cd42-44e6-abd7-fc550707706c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:09.709644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d88bfa57-a450-4c7e-b9ab-03e34a5c491b req-1ddaa256-cd42-44e6-abd7-fc550707706c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:09.767278 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d88bfa57-a450-4c7e-b9ab-03e34a5c491b req-1ddaa256-cd42-44e6-abd7-fc550707706c service nova] Creating event network-vif-deleted:3bc0e666-31f5-4017-8069-f023149ca37a for instance e849c30a-09cc-4908-a3b6-ff475c7bb547 on n-h1-854441-12 Oct 17 15:51:09.793649 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d88bfa57-a450-4c7e-b9ab-03e34a5c491b req-1ddaa256-cd42-44e6-abd7-fc550707706c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214834 Oct 17 15:51:09.795776 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2750/5260] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:51:10.013465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:10.034611 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31e5e1da-be2e-4c30-9290-22ebe2a7a934 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 200 len: 1294 microversion: 2.1 time: 0.408702 Oct 17 15:51:10.046927 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2511/5261] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:09 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 1294 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:11.087106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:11.091489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:11.136071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:11.136071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:11.147602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:11.148645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:11.149182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:11.153816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:11.208839 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 HTTP/1.1 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e849c30a-09cc-4908-a3b6-ff475c7bb547'} Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:51:11.223812 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00037647-f82e-4adf-9e56-cc66c1be3d4c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 404 len: 111 microversion: 2.1 time: 0.156250 Oct 17 15:51:11.237470 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2751/5262] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:11 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:51:11.254575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:11.257205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:11.306081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:11.307882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:11.310134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:11.312100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:11.314359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:11.316222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:11.380209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:51:11.652995 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee084d09-f316-4ad7-89bb-452219f22d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 204 len: 0 microversion: 2.1 time: 0.413641 Oct 17 15:51:11.658318 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2512/5263] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:51:11 2022] DELETE /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:51:11.668919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:11.670061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:11.683999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:11.687175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:11.687913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:11.690130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:11.693863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:11.694692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:12.021393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:12.034357 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e344d963-de5f-4b75-b2d5-e03e44c7a1d1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1496 microversion: 2.1 time: 0.369965 Oct 17 15:51:12.055622 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2752/5264] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:11 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1496 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:13.077362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:13.088697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:13.107453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:13.107982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:13.109056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:13.109838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:13.110306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:13.114173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:13.752851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:13.765548 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92a3f9d4-a09a-4b3d-acb4-8f1b30e4b202 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1496 microversion: 2.1 time: 0.692843 Oct 17 15:51:13.766180 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2513/5265] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:13 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1496 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:14.801722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:14.803972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:14.833551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:14.837804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:14.839668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:14.840881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:14.842588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:14.846031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:14.860436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=94 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:15.077944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:15.111966 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd247705-b416-4a71-b03b-62fe7fdb5894 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1454 microversion: 2.1 time: 0.321407 Oct 17 15:51:15.115806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2753/5266] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:14 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1454 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:15.384497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5f925874-39f7-433e-a5b9-2c398f94c9bc req-af3e3cfe-274f-480b-8012-6d57871e115b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8d001d-71ea-49d9-9e2f-929062d28b27", "name": "network-vif-deleted", "tag": "e61225b0-fd5f-4a35-be0b-4c7db75a25fd"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:15.400857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5f925874-39f7-433e-a5b9-2c398f94c9bc req-af3e3cfe-274f-480b-8012-6d57871e115b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:15.401954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5f925874-39f7-433e-a5b9-2c398f94c9bc req-af3e3cfe-274f-480b-8012-6d57871e115b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:15.402870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5f925874-39f7-433e-a5b9-2c398f94c9bc req-af3e3cfe-274f-480b-8012-6d57871e115b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:15.457724 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5f925874-39f7-433e-a5b9-2c398f94c9bc req-af3e3cfe-274f-480b-8012-6d57871e115b service nova] Creating event network-vif-deleted:e61225b0-fd5f-4a35-be0b-4c7db75a25fd for instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 on n-h1-854441-12 Oct 17 15:51:15.471812 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5f925874-39f7-433e-a5b9-2c398f94c9bc req-af3e3cfe-274f-480b-8012-6d57871e115b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090590 Oct 17 15:51:15.475635 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2514/5267] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:51:16.166423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:16.168008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:16.183076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:16.183969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:16.185356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:16.187563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:16.187563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:16.187563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:16.231300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:16.231300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:16.231300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:16.231300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lazy-loading 'fault' on Instance uuid 5d8d001d-71ea-49d9-9e2f-929062d28b27 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:51:16.391479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:16.405128 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d30f4b2e-ee4e-411d-893d-582bbb37cf1d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 200 len: 1299 microversion: 2.1 time: 0.246109 Oct 17 15:51:16.406566 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2754/5268] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:16 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 1299 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:17.448964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:17.449826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:17.469831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:17.470336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:17.473337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:17.474380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:17.475143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:17.477786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:17.505329 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 HTTP/1.1 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '5d8d001d-71ea-49d9-9e2f-929062d28b27'} Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:51:17.507717 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:51:17.515700 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:51:17.515700 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:51:17.515700 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:51:17.515700 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:51:17.515700 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:51:17.515700 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:51:17.515700 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:51:17.528760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:51:17.529677 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7388f3a7-0781-4320-ae7c-8813049f727d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 404 len: 111 microversion: 2.1 time: 0.086866 Oct 17 15:51:17.530635 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2515/5269] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:17 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:51:18.077076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1349404659", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "54423d23-912b-4e26-80bb-450813721e3a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:18.192623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] validate_networks() for [('54423d23-912b-4e26-80bb-450813721e3a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:51:19.888427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:51:19.890264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:51:19.891455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:51:19.892435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:51:19.893635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:51:19.929957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:19.931290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:19.932325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:19.933963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:19.935434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:19.936450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:19.977790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:51:19.992896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for user bec6f504a59b46228db013140f4ce605 and project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:51:20.024903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:51:20.027707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:51:20.120776 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f8eda2f-288a-4d57-bdec-952ff14babdd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.048341 Oct 17 15:51:20.130639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2755/5270] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:51:20.139329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd5f6c58-8f3b-4a0f-9eeb-f16da1c7da3f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:20.140415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cd5f6c58-8f3b-4a0f-9eeb-f16da1c7da3f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:20.339935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cd5f6c58-8f3b-4a0f-9eeb-f16da1c7da3f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:20.352834 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd5f6c58-8f3b-4a0f-9eeb-f16da1c7da3f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1209 microversion: 2.1 time: 0.215008 Oct 17 15:51:20.353734 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2516/5271] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:20 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1209 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:51:21.403446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2611e7d7-53d5-4fea-a876-4851cb019228 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:21.404134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2611e7d7-53d5-4fea-a876-4851cb019228 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:21.552233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2611e7d7-53d5-4fea-a876-4851cb019228 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:21.576184 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2611e7d7-53d5-4fea-a876-4851cb019228 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1209 microversion: 2.1 time: 0.177781 Oct 17 15:51:21.576798 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2756/5272] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:21 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1209 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:22.612048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:22.622761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:22.654439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:22.655340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:22.656166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:22.660492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:22.663837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:22.667293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:22.928359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:22.943157 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e04c8098-1d82-4b79-bcd9-ab62db442abb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1279 microversion: 2.1 time: 0.337463 Oct 17 15:51:22.943806 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2517/5273] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:22 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1279 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:23.991280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:23.991280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:24.001448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:24.002259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:24.002749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:24.003495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:24.003959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:24.004397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:25.115206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:25.131878 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85747a1a-7c9b-45f4-a49a-253d25cd7455 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1309 microversion: 2.1 time: 1.146380 Oct 17 15:51:25.152956 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2757/5274] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:23 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1309 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:26.166013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:26.167381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:26.186945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:26.188334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:26.189954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:26.195594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:26.197075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:26.198679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:26.990009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:27.004494 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-93b66c39-6739-4a5c-b888-237237267263 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1309 microversion: 2.1 time: 0.842188 Oct 17 15:51:27.006438 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2518/5275] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:26 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1309 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:27.087140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6efdbaab-b219-4291-af92-b888bd90ff4e req-15799b8e-d07f-463a-a5bc-c864113981ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c4e267-895a-4ece-95fe-f9c8b99da226", "tag": "94b3f6b3-0d67-4fab-b9a8-a2af3c20a8c1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:27.105154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6efdbaab-b219-4291-af92-b888bd90ff4e req-15799b8e-d07f-463a-a5bc-c864113981ac service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:27.105860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6efdbaab-b219-4291-af92-b888bd90ff4e req-15799b8e-d07f-463a-a5bc-c864113981ac service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:27.107242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6efdbaab-b219-4291-af92-b888bd90ff4e req-15799b8e-d07f-463a-a5bc-c864113981ac service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:27.122280 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6efdbaab-b219-4291-af92-b888bd90ff4e req-15799b8e-d07f-463a-a5bc-c864113981ac service nova] Creating event network-changed:94b3f6b3-0d67-4fab-b9a8-a2af3c20a8c1 for instance b5c4e267-895a-4ece-95fe-f9c8b99da226 on n-h1-854441-12 Oct 17 15:51:27.130331 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6efdbaab-b219-4291-af92-b888bd90ff4e req-15799b8e-d07f-463a-a5bc-c864113981ac service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049644 Oct 17 15:51:27.132639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2758/5276] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:51:28.048735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:28.049899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:28.064819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:28.066092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:28.069484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:28.072079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:28.074481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:28.075952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:28.096122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:28.761209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:28.771451 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1cb52766-ba83-4376-9904-f8fc85482a0b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1309 microversion: 2.1 time: 0.726838 Oct 17 15:51:28.772083 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2519/5277] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:28 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1309 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:29.797816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:29.798581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:29.811458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:29.818470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:29.819271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:29.820208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:29.820856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:29.821505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:29.956481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:30.448198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:30.471888 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cc6ac97-ac93-4803-ae86-25ea30ba4dbb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1309 microversion: 2.1 time: 0.677867 Oct 17 15:51:30.473373 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2759/5278] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:29 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1309 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:31.504318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:31.543097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:31.550242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:31.607206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:31.609797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:31.612004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:31.614294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:31.616013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:31.616683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:31.952888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:31.988914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-544f0c08-1963-437c-906a-f288453ef7da tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1309 microversion: 2.1 time: 0.486486 Oct 17 15:51:32.002892 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2520/5279] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:31 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1309 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:33.038792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:33.044148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:33.070648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:33.079390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:33.084704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:33.085703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:33.087449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:33.089315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:33.097152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:33.663774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad5452da-2692-4eca-bded-49ca4a3e7e45 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:33.665889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad5452da-2692-4eca-bded-49ca4a3e7e45 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:33.687400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad5452da-2692-4eca-bded-49ca4a3e7e45 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:33.691196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad5452da-2692-4eca-bded-49ca4a3e7e45 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:33.693544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad5452da-2692-4eca-bded-49ca4a3e7e45 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:33.702236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad5452da-2692-4eca-bded-49ca4a3e7e45 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:33.703436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad5452da-2692-4eca-bded-49ca4a3e7e45 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:33.704512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad5452da-2692-4eca-bded-49ca4a3e7e45 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:33.777639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:33.795280 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad5452da-2692-4eca-bded-49ca4a3e7e45 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/ips" status: 200 len: 149 microversion: 2.1 time: 0.125700 Oct 17 15:51:33.812290 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2521/5280] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:51:33 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/ips => generated 149 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:51:33.820277 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc50d15b-857c-4c2f-9f4c-6f7989136eee tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1309 microversion: 2.1 time: 0.778161 Oct 17 15:51:33.834768 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2760/5281] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:33 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1309 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:34.869185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:34.870250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:34.889326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:34.907337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:34.908127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:34.909313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:34.910000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:34.910680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:35.225932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f7b8a77a-5935-4f23-8a13-59a4cb86bdef req-d899d7a3-d4eb-4d3b-b357-c2f4f698107c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c4e267-895a-4ece-95fe-f9c8b99da226", "name": "network-vif-plugged", "status": "completed", "tag": "94b3f6b3-0d67-4fab-b9a8-a2af3c20a8c1"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:35.247925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:35.253565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f7b8a77a-5935-4f23-8a13-59a4cb86bdef req-d899d7a3-d4eb-4d3b-b357-c2f4f698107c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:35.255452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f7b8a77a-5935-4f23-8a13-59a4cb86bdef req-d899d7a3-d4eb-4d3b-b357-c2f4f698107c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:35.257019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f7b8a77a-5935-4f23-8a13-59a4cb86bdef req-d899d7a3-d4eb-4d3b-b357-c2f4f698107c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:35.316217 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f7b8a77a-5935-4f23-8a13-59a4cb86bdef req-d899d7a3-d4eb-4d3b-b357-c2f4f698107c service nova] Creating event network-vif-plugged:94b3f6b3-0d67-4fab-b9a8-a2af3c20a8c1 for instance b5c4e267-895a-4ece-95fe-f9c8b99da226 on n-h1-854441-12 Oct 17 15:51:35.329449 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f7b8a77a-5935-4f23-8a13-59a4cb86bdef req-d899d7a3-d4eb-4d3b-b357-c2f4f698107c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111356 Oct 17 15:51:35.331608 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2761/5282] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:51:35.722209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:35.734850 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d229d93f-471d-407b-b1bc-f1dee60cd67a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1309 microversion: 2.1 time: 0.869676 Oct 17 15:51:35.735487 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2522/5283] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:34 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1309 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:36.788821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:36.791302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:36.816841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:36.819005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:36.820438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:36.822581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:36.823978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:36.825009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:37.247395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-adbeaecd-bc08-42fd-8aec-e9e235c256e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7b95f36-597b-4012-8e45-288939f9db28"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:37.252008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-adbeaecd-bc08-42fd-8aec-e9e235c256e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:37.290841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adbeaecd-bc08-42fd-8aec-e9e235c256e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:37.292331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adbeaecd-bc08-42fd-8aec-e9e235c256e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:37.293410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adbeaecd-bc08-42fd-8aec-e9e235c256e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:37.295057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adbeaecd-bc08-42fd-8aec-e9e235c256e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:37.296472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adbeaecd-bc08-42fd-8aec-e9e235c256e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:37.297559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-adbeaecd-bc08-42fd-8aec-e9e235c256e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:37.516802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:37.583596 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a44ba4b-787a-47e7-a318-f5a973aa0617 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1309 microversion: 2.1 time: 0.817535 Oct 17 15:51:37.589242 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2762/5284] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:36 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1309 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:37.897336 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-adbeaecd-bc08-42fd-8aec-e9e235c256e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657542 Oct 17 15:51:37.902806 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2523/5285] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:51:37 2022] POST /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:51:38.615586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:38.616279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:38.633867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:38.634229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:38.634723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:38.637559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:38.638080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:38.639047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:39.331502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:39.364895 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bca71baf-c3e8-43bc-9212-97c417e1628b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1491 microversion: 2.1 time: 0.735539 Oct 17 15:51:39.378227 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2763/5286] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:38 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1491 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:39.431348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-53fb0515-4c71-48f6-b5a8-fa89ed8aca91 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:39.447470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-53fb0515-4c71-48f6-b5a8-fa89ed8aca91 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:39.472108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53fb0515-4c71-48f6-b5a8-fa89ed8aca91 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:39.473378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53fb0515-4c71-48f6-b5a8-fa89ed8aca91 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:39.474739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53fb0515-4c71-48f6-b5a8-fa89ed8aca91 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:39.479608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53fb0515-4c71-48f6-b5a8-fa89ed8aca91 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:39.480837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53fb0515-4c71-48f6-b5a8-fa89ed8aca91 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:39.484787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53fb0515-4c71-48f6-b5a8-fa89ed8aca91 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:39.800780 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-53fb0515-4c71-48f6-b5a8-fa89ed8aca91 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "PUT /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1086 microversion: 2.1 time: 0.378023 Oct 17 15:51:39.804504 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2524/5287] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 15:51:39 2022] PUT /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1086 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:39.847745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:39.851656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:39.881193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:39.882258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:39.883490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:39.884680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:39.885698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:39.886836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:40.598060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:40.608212 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc984a52-49b6-445c-9c02-b3177b5f3f9f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1512 microversion: 2.1 time: 0.768790 Oct 17 15:51:40.632375 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2764/5288] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:39 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1512 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:40.639806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:40.641915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:40.651031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:40.654311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:40.656138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:40.656972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:40.678414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:40.680614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:40.681657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:41.160017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:41.168974 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3347c5f-729c-451e-bb43-c961b8273765 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1512 microversion: 2.1 time: 0.535377 Oct 17 15:51:41.174596 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2525/5289] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:40 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1512 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:51:41.196573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:41.197178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:41.213562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:41.214064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:41.214536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:41.216550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:41.217023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:41.217457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:41.306095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:51:41.483756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5ee18064-c079-4a7b-87b6-a23c47ff8ff9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 204 len: 0 microversion: 2.1 time: 0.291148 Oct 17 15:51:41.490009 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2765/5290] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:51:41 2022] DELETE /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:51:41.497388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:41.498075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:41.515112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:41.515592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:41.516091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:41.521313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:41.525539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:41.526344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:41.994365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:42.017219 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-10e0a973-ba91-4499-b8c4-7792edf132d0 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1518 microversion: 2.1 time: 0.523700 Oct 17 15:51:42.020295 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2526/5291] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:41 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1518 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:43.053543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:43.055288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:43.071003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:43.071716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:43.072790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:43.073727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:43.074361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:43.075090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:44.410370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:44.465858 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50de66ce-919e-4abb-ae28-48996d0b33a1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 200 len: 1518 microversion: 2.1 time: 1.419040 Oct 17 15:51:44.467771 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2766/5292] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:43 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 1518 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:51:44.536094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-10b8b360-6d1c-429a-9e31-8d31001ac1a6 req-598b7ef8-f0b1-4b14-952a-4e4d6ddd022b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c4e267-895a-4ece-95fe-f9c8b99da226", "name": "network-vif-deleted", "tag": "94b3f6b3-0d67-4fab-b9a8-a2af3c20a8c1"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:44.594713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-10b8b360-6d1c-429a-9e31-8d31001ac1a6 req-598b7ef8-f0b1-4b14-952a-4e4d6ddd022b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:44.596145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-10b8b360-6d1c-429a-9e31-8d31001ac1a6 req-598b7ef8-f0b1-4b14-952a-4e4d6ddd022b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:44.598189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-10b8b360-6d1c-429a-9e31-8d31001ac1a6 req-598b7ef8-f0b1-4b14-952a-4e4d6ddd022b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:44.667395 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-10b8b360-6d1c-429a-9e31-8d31001ac1a6 req-598b7ef8-f0b1-4b14-952a-4e4d6ddd022b service nova] Creating event network-vif-deleted:94b3f6b3-0d67-4fab-b9a8-a2af3c20a8c1 for instance b5c4e267-895a-4ece-95fe-f9c8b99da226 on n-h1-854441-12 Oct 17 15:51:44.701575 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-10b8b360-6d1c-429a-9e31-8d31001ac1a6 req-598b7ef8-f0b1-4b14-952a-4e4d6ddd022b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174999 Oct 17 15:51:44.709073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2527/5293] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:51:45.521674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:45.526126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:45.556673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:45.557890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:45.558557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:45.559502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:45.560733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:45.561361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:45.605410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:45.607268 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 HTTP/1.1 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'b5c4e267-895a-4ece-95fe-f9c8b99da226'} Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:51:45.609494 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:45.615628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:51:45.615628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:51:45.615628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:51:45.615628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:51:45.615628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:51:45.615628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:51:45.615628 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:51:45.617670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:51:45.618815 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b8190cf-7d46-404b-9cd2-4287654fecba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 404 len: 111 microversion: 2.1 time: 0.106453 Oct 17 15:51:45.619643 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2767/5294] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:45 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:51:46.019644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1524781518", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "54423d23-912b-4e26-80bb-450813721e3a"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:46.313435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] validate_networks() for [('54423d23-912b-4e26-80bb-450813721e3a', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:51:47.909669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:51:47.910620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:51:47.911515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:51:47.927622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:51:47.928571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:51:47.950448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:47.951765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:47.952881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:47.954611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:47.955973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:47.957065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:47.999509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:51:48.013573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Getting quotas for user bec6f504a59b46228db013140f4ce605 and project 6ad2427ccdb24e21b3e62ee89827fa69. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:51:48.045866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:51:48.052933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:51:48.161765 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a1f57432-7865-485c-890e-392ae86a21f2 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.153952 Oct 17 15:51:48.163427 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2528/5295] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:51:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:51:48.175964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a13bc1c5-757d-402b-802d-ee2ac0e50198 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:48.177442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a13bc1c5-757d-402b-802d-ee2ac0e50198 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:48.427063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a13bc1c5-757d-402b-802d-ee2ac0e50198 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:48.441548 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a13bc1c5-757d-402b-802d-ee2ac0e50198 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1209 microversion: 2.1 time: 0.269193 Oct 17 15:51:48.442366 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2768/5296] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:48 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1209 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:49.495131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:49.500216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:49.562678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:49.572052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:49.588676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:49.592158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:49.594274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:49.594827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:50.114712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:50.143609 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2300c155-6afc-4027-8a1e-561a131bb104 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1205 microversion: 2.1 time: 0.676419 Oct 17 15:51:50.146284 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2529/5297] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:49 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1205 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:51.195399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:51.200036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:51.227348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:51.228705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:51.229749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:51.231343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:51.234230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:51.237398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:51.646792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:51.683351 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4d620f0-8a5b-4b60-b2b9-6720b3f6ac4a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1267 microversion: 2.1 time: 0.495203 Oct 17 15:51:51.684473 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2769/5298] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:51 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1267 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:52.730925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:52.732589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:52.760642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:52.761961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:52.763409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:52.766043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:52.767584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:52.769436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:55.062775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:55.091373 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61861fec-e29c-4f8f-a394-fad188f1e79b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1309 microversion: 2.1 time: 2.369149 Oct 17 15:51:55.099907 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2530/5299] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:52 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1309 bytes in 2379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:56.132731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:56.134597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:56.156418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:56.162041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:56.162994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:56.170220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:56.174432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:56.175460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:56.803324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:56.823213 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30feff53-b37a-4239-8e59-78cd2e7cebfe tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1309 microversion: 2.1 time: 0.695395 Oct 17 15:51:56.825258 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2770/5300] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:56 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1309 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:51:57.876700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:57.877346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:57.903223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:57.904032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:57.904673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:57.910043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:57.912862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:57.917063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:57.997624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:58.032296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:58.522011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:51:58.533509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:58.540683 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bfaeabfd-3415-47a0-a455-392926296bcb tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1309 microversion: 2.1 time: 0.668216 Oct 17 15:51:58.574212 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2531/5301] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:57 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1309 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:51:59.083843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-93f59776-9f8c-4647-9ce4-45c3fa35deda req-072ee224-531e-430e-889b-d1897f961005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c45c6b0-61dd-41ef-8abf-bd132df191fd", "tag": "153c2ed7-69cc-4acc-9fd1-587dd3b55e54"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:51:59.100286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:51:59.109555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-93f59776-9f8c-4647-9ce4-45c3fa35deda req-072ee224-531e-430e-889b-d1897f961005 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:59.110384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-93f59776-9f8c-4647-9ce4-45c3fa35deda req-072ee224-531e-430e-889b-d1897f961005 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:59.111049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-93f59776-9f8c-4647-9ce4-45c3fa35deda req-072ee224-531e-430e-889b-d1897f961005 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:59.129290 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-93f59776-9f8c-4647-9ce4-45c3fa35deda req-072ee224-531e-430e-889b-d1897f961005 service nova] Creating event network-changed:153c2ed7-69cc-4acc-9fd1-587dd3b55e54 for instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd on n-h1-854441-12 Oct 17 15:51:59.135872 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-93f59776-9f8c-4647-9ce4-45c3fa35deda req-072ee224-531e-430e-889b-d1897f961005 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057145 Oct 17 15:51:59.136504 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2771/5302] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:51:59.578843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:51:59.580149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:51:59.589049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:59.589826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:59.591143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:51:59.592653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:51:59.593316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:51:59.593967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:00.282535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:00.302661 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-da4caf99-d1b7-491a-9960-79e463a359de tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1309 microversion: 2.1 time: 0.728062 Oct 17 15:52:00.304483 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2532/5303] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:51:59 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1309 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:01.078910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6b2c367-bf91-4856-884b-e1b96534bda6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: .version_select at 0x7f28bd843a60>, body: {"keypair": {"name": "tempest-keypair-394635804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYspigh0XqkhvnRgVse4SoF0h2+PKQxC3B2OfvSVDiksFUbP1Mrk6L/t3NzrhfV8iWnLNzXEv+D3DQuxV2QR6X35EoPZ80m2uNS3aVS0EYnXUqPliK4xvMDrv8u0sKNDA=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:01.137639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b6b2c367-bf91-4856-884b-e1b96534bda6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for project 95e7c17929974c669051e99792e83d40. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:52:01.184633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b6b2c367-bf91-4856-884b-e1b96534bda6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for user 98d8f0d40fd0472e8ffc58d09811c4cc and project 95e7c17929974c669051e99792e83d40. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:52:01.268322 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6b2c367-bf91-4856-884b-e1b96534bda6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.201754 Oct 17 15:52:01.270778 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2772/5304] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:52:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:01.350265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:01.351743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:01.405213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:01.407422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:01.409487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:01.410451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:01.413456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:01.414061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:02.279134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:02.332107 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-72615d44-dafc-4e9a-8714-9838bb1d2b86 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1309 microversion: 2.1 time: 0.987233 Oct 17 15:52:02.333887 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2533/5305] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:01 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1309 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:03.363985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:03.364846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:03.385525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:03.388596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:03.389357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:03.393852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:03.394703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:03.398911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:03.867648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:03.888805 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbeb3519-72b9-45ee-a20b-a74c55f180b9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1309 microversion: 2.1 time: 0.531674 Oct 17 15:52:03.894873 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2773/5306] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:03 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1309 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:04.942178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:04.944455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:04.969122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:04.982664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:04.984155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:04.985898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:04.987461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:05.019780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:06.154773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:06.207425 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9f045a97-5453-45b0-b2ad-ed09f4100e7c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1309 microversion: 2.1 time: 1.271245 Oct 17 15:52:06.231656 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2534/5307] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:04 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1309 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:07.267109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:07.267968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:07.289770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:07.292675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:07.297976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:07.299824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:07.307560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:07.308207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:07.959176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:07.960162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:07.965399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:07.990251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:07.992386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:07.993894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:07.995788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:07.997909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:07.999022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:08.062798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:08.078760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:52:08.087605 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0e0e185c-f9cf-4fc8-b51e-482d9480eb6c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1309 microversion: 2.1 time: 0.822867 Oct 17 15:52:08.106543 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2535/5308] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:07 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1309 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:08.316916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:08.317516 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebffa090-a0ca-4789-a0be-8822d0a1661c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 204 len: 0 microversion: 2.42 time: 1.317403 Oct 17 15:52:08.317969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:08.322944 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2774/5309] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:52:06 2022] DELETE /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 0 bytes in 1322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:52:08.333468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:08.335096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:08.336581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:08.341820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:08.342457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:08.345253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:08.347600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:08.348328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:08.361258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:08.364657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:08.365577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:08.367476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:08.368893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:08.370880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:08.580571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lazy-loading 'services' on Instance uuid b0b5908c-f098-4ae4-9d26-aceefaa05ec3 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:52:08.842659 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-df97b2e8-0317-43e9-be38-6a058e9c8512 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3/os-volume_attachments/3be4ef46-b70c-4b15-8f3d-181ae02673ae" status: 202 len: 0 microversion: 2.1 time: 0.515905 Oct 17 15:52:08.843691 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2536/5310] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:52:08 2022] DELETE /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3/os-volume_attachments/3be4ef46-b70c-4b15-8f3d-181ae02673ae => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:52:09.053518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-dfd73796-3211-4349-b0cd-3d17dc012960 req-7c661fe4-d39d-4232-84bc-b4e45e6ad09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c45c6b0-61dd-41ef-8abf-bd132df191fd", "name": "network-vif-plugged", "status": "completed", "tag": "153c2ed7-69cc-4acc-9fd1-587dd3b55e54"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:09.080986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dfd73796-3211-4349-b0cd-3d17dc012960 req-7c661fe4-d39d-4232-84bc-b4e45e6ad09c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:09.081617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dfd73796-3211-4349-b0cd-3d17dc012960 req-7c661fe4-d39d-4232-84bc-b4e45e6ad09c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:09.082306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-dfd73796-3211-4349-b0cd-3d17dc012960 req-7c661fe4-d39d-4232-84bc-b4e45e6ad09c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:09.109941 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-dfd73796-3211-4349-b0cd-3d17dc012960 req-7c661fe4-d39d-4232-84bc-b4e45e6ad09c service nova] Creating event network-vif-plugged:153c2ed7-69cc-4acc-9fd1-587dd3b55e54 for instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd on n-h1-854441-12 Oct 17 15:52:09.129852 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-dfd73796-3211-4349-b0cd-3d17dc012960 req-7c661fe4-d39d-4232-84bc-b4e45e6ad09c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080860 Oct 17 15:52:09.131094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2537/5311] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:52:09.159391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:09.176946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:09.208218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:09.209933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:09.211110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:09.212351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:09.213133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:09.214192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:09.744086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:09.785053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:09.789126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:09.793756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-303503a4-493b-4314-9844-74c4ec2d53a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2959 microversion: 2.42 time: 1.468526 Oct 17 15:52:09.796127 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2775/5312] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:08 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2959 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:10.084372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:10.106252 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5300065f-b241-46a9-ade1-26c813ccba5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1309 microversion: 2.1 time: 0.971894 Oct 17 15:52:10.109623 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2538/5313] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:09 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1309 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:10.840720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:10.846877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:10.893644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:10.894935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:10.897318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:10.900880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:10.903942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:10.905132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:11.160524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:11.166952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:11.176379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:11.200571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:11.203261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:11.209249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:11.210448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:11.216322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:11.217244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:11.218207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:12.129584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:12.155896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:12.162711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:12.164731 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80792a92-07be-4a80-aedd-de1ca634a4fc tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2959 microversion: 2.42 time: 1.331688 Oct 17 15:52:12.169371 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2776/5314] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:10 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2959 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:52:12.912749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1733974276", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "565998b8-ded6-4f62-84d3-25058e7be371"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:13.144809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] validate_networks() for [('565998b8-ded6-4f62-84d3-25058e7be371', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:52:14.195666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:14.268163 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-74966b07-2c37-423f-a451-949addb1cbf1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1490 microversion: 2.1 time: 3.112297 Oct 17 15:52:14.270984 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2539/5315] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:11 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1490 bytes in 3123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:14.291857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1942656991", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "610043dc-4af1-4887-b876-94edd1ec11a6"}], "security_groups": [{"name": "tempest-securitygroup--1474231158"}], "key_name": "tempest-keypair-394635804", "user_data": "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:14.879884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] validate_networks() for [('610043dc-4af1-4887-b876-94edd1ec11a6', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:52:16.063687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:52:16.065280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:52:16.065857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:52:16.067241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:52:16.067241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:52:16.098106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:16.098707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:16.099297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:16.100511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:16.101331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:16.111271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:16.153599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Getting quotas for project 4a43e3d0b41b410bba0cfeba3779a50a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:52:16.170399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Getting quotas for user a1e3d13a41b2403bb5b02fb5ed47358d and project 4a43e3d0b41b410bba0cfeba3779a50a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:52:16.209359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:52:16.218689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:52:16.376642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:52:16.379913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:52:16.382604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:52:16.383153 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85e4415e-c19f-4b8b-85a8-6d6fececbf34 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.209849 Oct 17 15:52:16.387281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:52:16.387584 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2777/5316] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:52:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:52:16.390471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:52:16.403769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:16.404777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:16.419759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:16.425019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:16.425870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:16.428311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:16.429794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:16.430537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:16.431201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:16.431714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:16.432164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:16.432957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:16.433433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:16.433880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:16.500453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for project 95e7c17929974c669051e99792e83d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:52:16.519990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for user 98d8f0d40fd0472e8ffc58d09811c4cc and project 95e7c17929974c669051e99792e83d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:52:16.567161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:52:16.570090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:52:16.686914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-df706127-9307-452f-9d9b-1e2214d16e17 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.412776 Oct 17 15:52:16.695408 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2540/5317] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:52:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:52:16.701670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8fe143ea-27e8-4723-ac73-59bbd84f8d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1434304949"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:16.717267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8fe143ea-27e8-4723-ac73-59bbd84f8d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:16.727489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fe143ea-27e8-4723-ac73-59bbd84f8d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:16.735181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fe143ea-27e8-4723-ac73-59bbd84f8d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:16.738931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fe143ea-27e8-4723-ac73-59bbd84f8d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:16.739903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fe143ea-27e8-4723-ac73-59bbd84f8d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:16.740575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fe143ea-27e8-4723-ac73-59bbd84f8d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:16.741310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fe143ea-27e8-4723-ac73-59bbd84f8d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:16.934249 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8fe143ea-27e8-4723-ac73-59bbd84f8d5f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "PUT /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1075 microversion: 2.1 time: 0.237143 Oct 17 15:52:16.947164 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2541/5318] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 15:52:16 2022] PUT /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1075 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:16.956764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2ed3bb46-9a11-4156-aaf0-e1d01fc50c28 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:16.957397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2ed3bb46-9a11-4156-aaf0-e1d01fc50c28 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:17.099973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ed3bb46-9a11-4156-aaf0-e1d01fc50c28 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:17.117605 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2ed3bb46-9a11-4156-aaf0-e1d01fc50c28 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1214 microversion: 2.1 time: 0.164636 Oct 17 15:52:17.119731 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2542/5319] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:16 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:17.137457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a1a6999-5765-4989-81bc-218bb2641955 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:17.139380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0a1a6999-5765-4989-81bc-218bb2641955 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:17.598684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0a1a6999-5765-4989-81bc-218bb2641955 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:17.613201 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a1a6999-5765-4989-81bc-218bb2641955 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1241 microversion: 2.1 time: 0.491611 Oct 17 15:52:17.626372 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2543/5320] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:17 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1241 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:17.640696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:17.646330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:17.666666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:17.667173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:17.672950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:17.675872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:17.678724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:17.686709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:18.232499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:18.254039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d65bd6b0-2a57-41a2-a432-627d055a6a2a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1501 microversion: 2.1 time: 0.615762 Oct 17 15:52:18.270867 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2544/5321] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:17 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1501 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:18.295343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:18.295981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:18.316522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:18.317040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:18.317498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:18.318266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:18.318788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:18.319230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:18.667105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:18.684153 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d25f6c73-a841-4019-b1d7-281c27942a03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1266 microversion: 2.1 time: 0.411156 Oct 17 15:52:18.708887 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2545/5322] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:18 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1266 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:18.716286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:18.718541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:18.726031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:18.726891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:18.728308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:18.729472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:18.730361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:18.731107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:18.989108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:19.017287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:19.024119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:19.036487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:19.038942 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8552c05b-d276-4133-8b2a-3cc2ab69f4ec tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2938 microversion: 2.42 time: 2.643264 Oct 17 15:52:19.059240 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2778/5323] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:16 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2938 bytes in 2671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:19.088916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-45d76d4b-1d75-4688-9020-88c82481f8b6 req-f0827356-2007-4081-931f-4cb4f3152e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-unplugged", "status": "completed", "tag": "39f10735-71ca-470f-b9b6-7a8e6629500c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:19.125578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45d76d4b-1d75-4688-9020-88c82481f8b6 req-f0827356-2007-4081-931f-4cb4f3152e18 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:19.128157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45d76d4b-1d75-4688-9020-88c82481f8b6 req-f0827356-2007-4081-931f-4cb4f3152e18 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:19.129351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-45d76d4b-1d75-4688-9020-88c82481f8b6 req-f0827356-2007-4081-931f-4cb4f3152e18 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:19.160525 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-45d76d4b-1d75-4688-9020-88c82481f8b6 req-f0827356-2007-4081-931f-4cb4f3152e18 service nova] Creating event network-vif-unplugged:39f10735-71ca-470f-b9b6-7a8e6629500c for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:19.173093 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-45d76d4b-1d75-4688-9020-88c82481f8b6 req-f0827356-2007-4081-931f-4cb4f3152e18 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111528 Oct 17 15:52:19.174616 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2779/5324] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:19.185812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:19.187728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:19.200778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:19.202174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:19.203441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:19.205202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:19.206427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:19.207575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:19.381466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:19.417358 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40c8c7c5-3d9e-4ba3-9a92-a34d375f17bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1237 microversion: 2.1 time: 0.237695 Oct 17 15:52:19.421546 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2780/5325] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:19 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1237 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:19.692680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:19.718119 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-45828892-0ada-490d-a655-67e0272b7a8b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1501 microversion: 2.1 time: 1.006913 Oct 17 15:52:19.719003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:19.720317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:19.724808 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2546/5326] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:18 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1501 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:19.769398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:19.770036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:19.770226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c35ee8b1-c6b7-4eb6-aeb0-29c4889e4084 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:19.770855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:19.771841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:19.772555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:19.773215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:19.784101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c35ee8b1-c6b7-4eb6-aeb0-29c4889e4084 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:19.784616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c35ee8b1-c6b7-4eb6-aeb0-29c4889e4084 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:19.785064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c35ee8b1-c6b7-4eb6-aeb0-29c4889e4084 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:19.876460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c35ee8b1-c6b7-4eb6-aeb0-29c4889e4084 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Going to try to stop instance {{(pid=120407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 15:52:19.962971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:19.974247 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04e1ea3b-d462-494a-b0d1-1276e43ccdf0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1272 microversion: 2.1 time: 0.264264 Oct 17 15:52:19.976346 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c35ee8b1-c6b7-4eb6-aeb0-29c4889e4084 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "POST /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd/action" status: 202 len: 0 microversion: 2.1 time: 0.208636 Oct 17 15:52:19.980058 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2547/5327] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:52:19 2022] POST /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:52:19.992452 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2781/5328] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:19 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:20.011631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:20.016359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:20.041411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:20.047704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:20.049181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:20.050851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:20.052910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:20.054115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:20.098653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:20.099790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:20.114905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:20.115562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:20.116096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:20.117797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:20.118670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:20.119345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:20.679211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:20.697526 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-712cd8f1-6a22-4d77-bdeb-d7e95c175929 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 0.711105 Oct 17 15:52:20.699517 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2548/5329] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:19 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:20.707261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:20.710574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:20.725301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:20.727159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:20.735360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:20.736816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:20.737635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:20.738324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:20.788056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:20.899686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:20.909049 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-71f8338d-f5af-46c0-9025-38171c89c089 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1299 microversion: 2.1 time: 0.208195 Oct 17 15:52:20.914286 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2549/5330] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:20 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:21.025464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:21.030176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:21.058107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:21.060717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:21.064045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:21.089647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:21.089647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:21.092323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:21.297292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:21.311804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:21.314735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:21.317464 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca52aa01-a234-4179-97c0-80fd69811d24 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2917 microversion: 2.42 time: 1.224592 Oct 17 15:52:21.318701 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2782/5331] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:20 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2917 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:52:21.410448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-060609b5-ee2e-43e8-bb3d-aded6338a2a9 req-484c9ffa-e976-425f-862a-d529099a8c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-unplugged", "status": "completed", "tag": "a89396e5-b63d-407b-8fb4-cfdd873892f8"}, {"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-unplugged", "status": "completed", "tag": "3c70d92c-4ec6-4149-8343-459bac51739d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:21.452761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-060609b5-ee2e-43e8-bb3d-aded6338a2a9 req-484c9ffa-e976-425f-862a-d529099a8c68 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:21.459724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-060609b5-ee2e-43e8-bb3d-aded6338a2a9 req-484c9ffa-e976-425f-862a-d529099a8c68 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:21.464289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-060609b5-ee2e-43e8-bb3d-aded6338a2a9 req-484c9ffa-e976-425f-862a-d529099a8c68 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:21.486082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:21.503557 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f5823ae2-810f-437c-a3a5-3e6f7f5541e9 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1272 microversion: 2.1 time: 0.484234 Oct 17 15:52:21.506783 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2550/5332] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:21 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1272 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:21.522954 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-060609b5-ee2e-43e8-bb3d-aded6338a2a9 req-484c9ffa-e976-425f-862a-d529099a8c68 service nova] Creating event network-vif-unplugged:a89396e5-b63d-407b-8fb4-cfdd873892f8 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:21.524499 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-060609b5-ee2e-43e8-bb3d-aded6338a2a9 req-484c9ffa-e976-425f-862a-d529099a8c68 service nova] Creating event network-vif-unplugged:3c70d92c-4ec6-4149-8343-459bac51739d for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:21.556443 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-060609b5-ee2e-43e8-bb3d-aded6338a2a9 req-484c9ffa-e976-425f-862a-d529099a8c68 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.145634 Oct 17 15:52:21.565085 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2783/5333] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:21.753408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:21.756082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:21.770588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:21.774380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:21.780083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:21.782897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:21.786129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:21.790451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:21.956096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:21.965919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:21.989116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:21.995015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:21.996316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:21.998306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:21.999682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:22.000969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:22.379198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:22.408252 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fcd252a0-04f7-418f-9a6d-10c2942b02c1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1299 microversion: 2.1 time: 0.462720 Oct 17 15:52:22.409610 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2784/5334] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:21 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1299 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:22.420340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:22.421627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:22.473465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:22.475295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:22.476107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:22.477522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:22.478392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:22.479182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:22.738289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:22.752937 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-68b9fa6d-12d5-4507-8d42-6bdce45ddf9e tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 1.004693 Oct 17 15:52:22.767510 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2551/5335] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:21 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:22.777726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:22.778373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:22.785588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:22.786424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:22.791629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:22.792874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:22.793738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:22.794424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:23.011323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:23.073019 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4aa95b13-c6e1-48a9-abf7-82bc73e642c8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1272 microversion: 2.1 time: 0.272351 Oct 17 15:52:23.074895 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2552/5336] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:22 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:23.119734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b4171da0-870f-400e-b4d6-63496d16ce89 req-6cacf1bf-d673-4795-abb6-a9a38b58e12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-deleted", "tag": "a89396e5-b63d-407b-8fb4-cfdd873892f8"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:23.162680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b4171da0-870f-400e-b4d6-63496d16ce89 req-6cacf1bf-d673-4795-abb6-a9a38b58e12e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:23.163571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b4171da0-870f-400e-b4d6-63496d16ce89 req-6cacf1bf-d673-4795-abb6-a9a38b58e12e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:23.164549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b4171da0-870f-400e-b4d6-63496d16ce89 req-6cacf1bf-d673-4795-abb6-a9a38b58e12e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:23.223591 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b4171da0-870f-400e-b4d6-63496d16ce89 req-6cacf1bf-d673-4795-abb6-a9a38b58e12e service nova] Creating event network-vif-deleted:a89396e5-b63d-407b-8fb4-cfdd873892f8 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:23.259622 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b4171da0-870f-400e-b4d6-63496d16ce89 req-6cacf1bf-d673-4795-abb6-a9a38b58e12e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179396 Oct 17 15:52:23.264051 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2553/5337] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:23.457866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:23.462298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:23.480997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:23.481789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:23.482637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:23.483733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:23.484331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:23.484854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:23.534944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:23.568783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:23.605117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:23.615514 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e5cd3dc-feb0-4f27-b25b-d8415a348374 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2871 microversion: 2.42 time: 1.201114 Oct 17 15:52:23.619571 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2785/5338] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:22 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2871 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:23.660676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-61d7c728-b0a1-415f-9d50-fb2d2bbc1903 req-62e51ad1-b2f3-4ff5-9144-8da83872924c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-unplugged", "status": "completed", "tag": "6ef23b02-c3af-4bff-97d6-68183f1e63d3"}, {"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-unplugged", "status": "completed", "tag": "b7535a0d-d61b-4a19-99f0-a6cd01a96405"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:23.724890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-61d7c728-b0a1-415f-9d50-fb2d2bbc1903 req-62e51ad1-b2f3-4ff5-9144-8da83872924c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:23.727036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-61d7c728-b0a1-415f-9d50-fb2d2bbc1903 req-62e51ad1-b2f3-4ff5-9144-8da83872924c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:23.728876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-61d7c728-b0a1-415f-9d50-fb2d2bbc1903 req-62e51ad1-b2f3-4ff5-9144-8da83872924c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:23.761825 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-61d7c728-b0a1-415f-9d50-fb2d2bbc1903 req-62e51ad1-b2f3-4ff5-9144-8da83872924c service nova] Creating event network-vif-unplugged:6ef23b02-c3af-4bff-97d6-68183f1e63d3 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:23.763202 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-61d7c728-b0a1-415f-9d50-fb2d2bbc1903 req-62e51ad1-b2f3-4ff5-9144-8da83872924c service nova] Creating event network-vif-unplugged:b7535a0d-d61b-4a19-99f0-a6cd01a96405 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:23.778534 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-61d7c728-b0a1-415f-9d50-fb2d2bbc1903 req-62e51ad1-b2f3-4ff5-9144-8da83872924c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.154326 Oct 17 15:52:23.785484 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2786/5339] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:23.802022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:23.804375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:23.818665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:23.819792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:23.823204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:23.825917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:23.827050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:23.828038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:23.924045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:23.939627 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0445ab2c-024e-4fd9-8286-4dcd63552c5f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 0.486368 Oct 17 15:52:23.943957 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2554/5340] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:23 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:24.130416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:24.132438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:24.148514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:24.149709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:24.151033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:24.153048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:24.154065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:24.155014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:24.332426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:24.352021 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ac20888-b9ea-47d4-a852-806ff3ee3042 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 0.563676 Oct 17 15:52:24.353215 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2787/5341] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:23 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:24.383288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:24.405776 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-68317193-d8d9-4460-b45d-3f7d4934e5b6 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1272 microversion: 2.1 time: 0.290366 Oct 17 15:52:24.407666 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2555/5342] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:24 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:24.520340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:24.521339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:24.531322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:24.532298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:24.532977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:24.536286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:24.543080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:24.543911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:24.596627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:52:24.690209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:24.699245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:24.732362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:24.735216 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9b49544-2f02-46ba-9866-33d7f1cd683a tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 204 len: 0 microversion: 2.1 time: 0.219889 Oct 17 15:52:24.736791 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2788/5343] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:24 2022] DELETE /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:52:24.737981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:24.741634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:24.743495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:24.744415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:24.745213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:24.748819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:24.751620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:24.762748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:24.764038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:24.766047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:24.767466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:24.768278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:24.770590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:25.148138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:25.170452 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80169435-0e6d-43c2-89e1-64fc395103ad tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1467 microversion: 2.1 time: 0.428967 Oct 17 15:52:25.171825 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2789/5344] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:24 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1467 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:25.191998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:25.193083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:25.204912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:25.205941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:25.206450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:25.207238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:25.207707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:25.210547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:25.593896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:25.609121 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c660b608-4523-4835-95ad-f79d368669a5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 0.435538 Oct 17 15:52:25.609936 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2790/5345] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:25 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:25.615637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:25.616553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:25.625383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:25.626731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:25.627568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:25.628689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:25.629336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:25.629935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:25.707073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:25.727546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:25.729508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:25.731459 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7913918b-4f4d-4571-8c3a-ee48479f509f tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2711 microversion: 2.42 time: 1.062474 Oct 17 15:52:25.732651 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2556/5346] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:24 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2711 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:25.739740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e651e5e5-11ce-4d22-8e90-807b4bdea038 req-f80d7f1b-47d6-4076-925c-f5d8b075acbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-deleted", "tag": "6ef23b02-c3af-4bff-97d6-68183f1e63d3"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:25.754469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e651e5e5-11ce-4d22-8e90-807b4bdea038 req-f80d7f1b-47d6-4076-925c-f5d8b075acbd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:25.755630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e651e5e5-11ce-4d22-8e90-807b4bdea038 req-f80d7f1b-47d6-4076-925c-f5d8b075acbd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:25.756367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e651e5e5-11ce-4d22-8e90-807b4bdea038 req-f80d7f1b-47d6-4076-925c-f5d8b075acbd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:25.795110 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e651e5e5-11ce-4d22-8e90-807b4bdea038 req-f80d7f1b-47d6-4076-925c-f5d8b075acbd service nova] Creating event network-vif-deleted:6ef23b02-c3af-4bff-97d6-68183f1e63d3 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:25.805820 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e651e5e5-11ce-4d22-8e90-807b4bdea038 req-f80d7f1b-47d6-4076-925c-f5d8b075acbd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070716 Oct 17 15:52:25.807964 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2557/5347] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:25.822151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:25.823731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:25.835779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:25.837936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:25.838783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:25.840408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:25.840929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:25.841870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:26.017385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:26.035297 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e16465ba-3cfd-4e63-872d-894e87f8a361 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 0.423483 Oct 17 15:52:26.045622 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2791/5348] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:25 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:26.215803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:26.216648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:26.221261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:26.222784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:26.236289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:26.237790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:26.238702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:26.239994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:26.240966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:26.242169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:26.477459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:26.716749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:26.730597 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3297650e-b412-4f01-8f99-2cb8c9625b1b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1314 microversion: 2.1 time: 0.920332 Oct 17 15:52:26.745494 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2558/5349] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:25 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1314 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:26.745494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:26.745494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:26.757024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:26.758223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:26.760494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:26.762327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:26.763536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:26.765153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:27.044333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:27.071122 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f612615b-c7e8-4886-a1af-9fabbaa5bf56 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1467 microversion: 2.1 time: 0.857345 Oct 17 15:52:27.072199 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2792/5350] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:26 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1467 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:27.089393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:27.091888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:27.101754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:27.103607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:27.105293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:27.108797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:27.110109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:27.110832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:27.544740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:27.565815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:27.568961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:27.572857 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-05e71ce0-c411-4c4d-93f3-29bc404ad208 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2597 microversion: 2.42 time: 0.488448 Oct 17 15:52:27.574299 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2793/5351] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:27 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2597 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:27.583781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:27.585153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:27.605138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:27.605746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:27.606266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:27.607136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:27.607670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:27.608170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:27.609800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:27.744356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:27.759722 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-756dda60-e5be-4f05-ab24-7d51e3debd8e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 1.026654 Oct 17 15:52:27.763274 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2559/5352] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:26 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:27.806092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:27.809536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:27.825009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:27.825759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:27.826393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:27.829164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:27.829906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:27.830538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:28.356588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:28.370291 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69ad773b-2b7d-4a87-840c-43e54b41c1bd tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 0.794072 Oct 17 15:52:28.382540 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2794/5353] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:27 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:28.392640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e19a6e22-2a8e-47f0-b06e-8fd15489e8d6 req-8af3572e-c02e-4c75-ba0d-3adfd0c3b343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45ae5f2d-8644-4ac2-87a7-851f4fb73090", "tag": "49fa7a48-2894-4813-9351-b0b2610dbc20"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:28.411501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e19a6e22-2a8e-47f0-b06e-8fd15489e8d6 req-8af3572e-c02e-4c75-ba0d-3adfd0c3b343 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:28.418006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e19a6e22-2a8e-47f0-b06e-8fd15489e8d6 req-8af3572e-c02e-4c75-ba0d-3adfd0c3b343 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:28.418709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e19a6e22-2a8e-47f0-b06e-8fd15489e8d6 req-8af3572e-c02e-4c75-ba0d-3adfd0c3b343 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:28.432547 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e19a6e22-2a8e-47f0-b06e-8fd15489e8d6 req-8af3572e-c02e-4c75-ba0d-3adfd0c3b343 service nova] Creating event network-changed:49fa7a48-2894-4813-9351-b0b2610dbc20 for instance 45ae5f2d-8644-4ac2-87a7-851f4fb73090 on n-h1-854441-12 Oct 17 15:52:28.439144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e19a6e22-2a8e-47f0-b06e-8fd15489e8d6 req-8af3572e-c02e-4c75-ba0d-3adfd0c3b343 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062048 Oct 17 15:52:28.440089 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2795/5354] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:28.447934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:28.449088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:28.459680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:28.460611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:28.461685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:28.463961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:28.464702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:28.465356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:28.493072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:28.845788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:28.897942 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-74cc9d45-1d20-4268-86a0-b432214503bb tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1314 microversion: 2.1 time: 1.122130 Oct 17 15:52:28.901205 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2560/5355] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:27 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:28.918215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:28.920430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:28.947831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:28.958812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:28.959830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:28.961883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:28.966406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:28.966406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:29.284035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:29.301745 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-85ba9042-864b-4172-9611-fbebe353ad86 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1467 microversion: 2.1 time: 0.859968 Oct 17 15:52:29.302666 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2796/5356] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:28 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1467 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:29.311196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-af883047-4c92-49df-b693-5e1e63d5d7e2 req-8faca3e3-f815-417b-bd25-97622c68cb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab31a979-fc59-4acd-aa58-232e78ecf883", "tag": "edf25674-0f91-4c6d-b5e7-05216d1b143a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:29.384768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af883047-4c92-49df-b693-5e1e63d5d7e2 req-8faca3e3-f815-417b-bd25-97622c68cb1a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:29.387970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af883047-4c92-49df-b693-5e1e63d5d7e2 req-8faca3e3-f815-417b-bd25-97622c68cb1a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:29.389345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-af883047-4c92-49df-b693-5e1e63d5d7e2 req-8faca3e3-f815-417b-bd25-97622c68cb1a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:29.468924 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-af883047-4c92-49df-b693-5e1e63d5d7e2 req-8faca3e3-f815-417b-bd25-97622c68cb1a service nova] Creating event network-changed:edf25674-0f91-4c6d-b5e7-05216d1b143a for instance ab31a979-fc59-4acd-aa58-232e78ecf883 on n-h1-854441-12 Oct 17 15:52:29.505496 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-af883047-4c92-49df-b693-5e1e63d5d7e2 req-8faca3e3-f815-417b-bd25-97622c68cb1a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200788 Oct 17 15:52:29.511990 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2797/5357] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:29.545295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:29.547372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:29.560728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:29.562164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:29.563519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:29.565307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:29.566540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:29.567806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:29.606727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:29.622166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:29.625042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:29.631186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0936b709-5158-4d42-9fa8-80a1c1b456d8 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2551 microversion: 2.42 time: 0.726122 Oct 17 15:52:29.642887 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2561/5358] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:28 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2551 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:29.656437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:29.657400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:29.667178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:29.667949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:29.668587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:29.669581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:29.670303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:29.671238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:30.285903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:30.301864 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-46780291-22e0-4c0d-a611-6e152d68ee13 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 0.779210 Oct 17 15:52:30.303040 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2798/5359] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:29 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:30.310491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:30.323343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:30.333843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:30.334956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:30.337972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:30.342382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:30.343259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:30.346322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:30.525399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:30.537277 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6aeb65a0-b945-4f78-abee-6d296d45f2ea tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 0.892073 Oct 17 15:52:30.543334 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2562/5360] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:29 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:30.557003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:30.560184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:30.579603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:30.583839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:30.584595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:30.586713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:30.590391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:30.590898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:30.707283 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:52:30.708254 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 15:52:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 (ip 10.222.0.87) !!! Oct 17 15:52:30.761483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:30.768211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:30.768740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:30.769200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:30.769689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lazy-loading 'fault' on Instance uuid b0b5908c-f098-4ae4-9d26-aceefaa05ec3 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:52:30.779280 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a49038a6-ac1d-4905-970f-90c9f45c8c08 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1314 microversion: 2.1 time: 0.474366 Oct 17 15:52:30.797967 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2799/5361] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:30 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:30.807721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d428dbd6-cba5-421e-b24e-5cb8641781fb req-80839a2e-09dd-4ee1-a7ba-cbd86422bd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-deleted", "tag": "b7535a0d-d61b-4a19-99f0-a6cd01a96405"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:30.829465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a52fdffce04022b9098bcaf9e57aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c859fd70674ec6917bd25aefa30fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:30.832034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d428dbd6-cba5-421e-b24e-5cb8641781fb req-80839a2e-09dd-4ee1-a7ba-cbd86422bd5b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:30.837998 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-834a778d-546b-4cb6-8d44-135866427ce6 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 200 len: 1302 microversion: 2.1 time: 0.293142 Oct 17 15:52:30.838925 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2563/5362] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:30 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 1302 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:30.841062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d428dbd6-cba5-421e-b24e-5cb8641781fb req-80839a2e-09dd-4ee1-a7ba-cbd86422bd5b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:30.841618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d428dbd6-cba5-421e-b24e-5cb8641781fb req-80839a2e-09dd-4ee1-a7ba-cbd86422bd5b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:30.846447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:30.847423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:30.854978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:30.862261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:30.863276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:30.864264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:30.865579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:30.866249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:30.866434 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d428dbd6-cba5-421e-b24e-5cb8641781fb req-80839a2e-09dd-4ee1-a7ba-cbd86422bd5b service nova] Creating event network-vif-deleted:b7535a0d-d61b-4a19-99f0-a6cd01a96405 for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:30.884906 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d428dbd6-cba5-421e-b24e-5cb8641781fb req-80839a2e-09dd-4ee1-a7ba-cbd86422bd5b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083194 Oct 17 15:52:30.888183 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2800/5363] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:31.320853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:31.352111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:31.360644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:31.369292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:31.402107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:31.411175 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-78caa302-4ad2-46c7-8c19-917d4fb7f666 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2505 microversion: 2.42 time: 0.567342 Oct 17 15:52:31.412294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:31.412889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:31.413348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:31.414114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:31.420472 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2564/5364] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:30 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:31.420835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:31.422056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:31.545138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-12a5e47f-1040-4400-88b7-ec9b2c4843da req-0eba8cfe-2779-408b-8f01-65fa735f8204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b5908c-f098-4ae4-9d26-aceefaa05ec3", "name": "network-vif-deleted", "tag": "508e0a84-d600-4722-9e33-b8528a425e12"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:31.569245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-12a5e47f-1040-4400-88b7-ec9b2c4843da req-0eba8cfe-2779-408b-8f01-65fa735f8204 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:31.570748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-12a5e47f-1040-4400-88b7-ec9b2c4843da req-0eba8cfe-2779-408b-8f01-65fa735f8204 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:31.571842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-12a5e47f-1040-4400-88b7-ec9b2c4843da req-0eba8cfe-2779-408b-8f01-65fa735f8204 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:31.600368 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-12a5e47f-1040-4400-88b7-ec9b2c4843da req-0eba8cfe-2779-408b-8f01-65fa735f8204 service nova] Creating event network-vif-deleted:508e0a84-d600-4722-9e33-b8528a425e12 for instance b0b5908c-f098-4ae4-9d26-aceefaa05ec3 on n-h2-854441-12 Oct 17 15:52:31.610465 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-12a5e47f-1040-4400-88b7-ec9b2c4843da req-0eba8cfe-2779-408b-8f01-65fa735f8204 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069881 Oct 17 15:52:31.611939 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2565/5365] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:31.624272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:31.626541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:31.640036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:31.641258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:31.642183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:31.644005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:31.645088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:31.645966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:32.062954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:32.097651 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-78f27662-bcc8-4874-a20b-b7d7be63808b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 0.483419 Oct 17 15:52:32.103434 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2566/5366] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:31 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:32.116962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:32.117733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:32.134881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:32.135406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:32.135849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:32.136585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:32.137125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:32.137580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:32.218312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:32.237774 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a97e8f2c-fdc1-4086-921f-0167b3626436 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 0.896851 Oct 17 15:52:32.238457 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2801/5367] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:31 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:32.243876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:32.244846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] [instance: b0b5908c-f098-4ae4-9d26-aceefaa05ec3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:32.261489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:32.263045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:32.266389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:32.267561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:32.268228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:32.271502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:32.311573 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] HTTP exception thrown: Instance b0b5908c-f098-4ae4-9d26-aceefaa05ec3 could not be found. Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Request method failure captured: Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 HTTP/1.1 Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlxc1skddw395rzfYHnz76LMEGQNH5IPDqzCNDMH9bhKLlH4xlu2QgbQ7NIhwGJGor800Y2KC2VSk1qPzJ8CHuxGL9nU4bPOeWPnREo6ArGH15AoSQcTHYoPAzA1w-NAIPV6_W28xXaCGpdQfgDxAeiz-G1CkUtns3pQVzZ9tPNmoc Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 57c859fd70674ec6917bd25aefa30fe3 Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesBackupsTest-1961659050 Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/57c859fd70674ec6917bd25aefa30fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/57c859fd70674ec6917bd25aefa30fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_57c859fd70674ec6917bd25aefa30fe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/57c859fd70674ec6917bd25aefa30fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesBackupsTest-1961659050 Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 57c859fd70674ec6917bd25aefa30fe3 Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesBackupsTest-1961659050 Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-VolumesBackupsTest-1961659050-project Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 79a52fdffce04022b9098bcaf9e57aaa Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesBackupsTest-1961659050-project Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance b0b5908c-f098-4ae4-9d26-aceefaa05ec3 could not be found. Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'b0b5908c-f098-4ae4-9d26-aceefaa05ec3'} Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b5908c-f098-4ae4-9d26-aceefaa05ec3 could not be found. Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b5908c-f098-4ae4-9d26-aceefaa05ec3 could not be found. Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:32.313521 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b5908c-f098-4ae4-9d26-aceefaa05ec3 could not be found. Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] Returning 404 to user: Instance b0b5908c-f098-4ae4-9d26-aceefaa05ec3 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfe30e5d-3ae7-42fb-ae25-48fbf4a5de42 tempest-VolumesBackupsTest-1961659050 tempest-VolumesBackupsTest-1961659050-project] 10.222.0.87 "GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3" status: 404 len: 111 microversion: 2.1 time: 0.079009 Oct 17 15:52:32.328435 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2802/5368] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:32 2022] GET /compute/v2.1/servers/b0b5908c-f098-4ae4-9d26-aceefaa05ec3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:32.449849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:32.450605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:32.465907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:32.466940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:32.467877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:32.468680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:32.469427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:32.469875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:32.738906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:32.752050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:32.760717 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b2dc4b8-e29e-4407-ab5a-aaa0a7e56c91 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1314 microversion: 2.1 time: 0.652943 Oct 17 15:52:32.764570 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2567/5369] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:32 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:33.101896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-7d97af35-7217-423d-af7a-b980d0e84f88 req-25fdd768-c6ee-41e5-8211-4de482956004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-deleted", "tag": "39f10735-71ca-470f-b9b6-7a8e6629500c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:33.126826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7d97af35-7217-423d-af7a-b980d0e84f88 req-25fdd768-c6ee-41e5-8211-4de482956004 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:33.127329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7d97af35-7217-423d-af7a-b980d0e84f88 req-25fdd768-c6ee-41e5-8211-4de482956004 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:33.138602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7d97af35-7217-423d-af7a-b980d0e84f88 req-25fdd768-c6ee-41e5-8211-4de482956004 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:33.172701 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-7d97af35-7217-423d-af7a-b980d0e84f88 req-25fdd768-c6ee-41e5-8211-4de482956004 service nova] Creating event network-vif-deleted:39f10735-71ca-470f-b9b6-7a8e6629500c for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:33.198184 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-7d97af35-7217-423d-af7a-b980d0e84f88 req-25fdd768-c6ee-41e5-8211-4de482956004 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100692 Oct 17 15:52:33.200885 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2568/5370] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:33.213663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:33.226548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:33.250228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:33.253854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:33.257907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:33.262749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:33.268111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:33.268584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:33.718455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:33.746314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:33.756627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:33.760257 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6534df8f-c603-4e0c-a2de-5bde133218a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2347 microversion: 2.42 time: 1.314649 Oct 17 15:52:33.761811 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2803/5371] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:32 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2347 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:52:33.771572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:33.775782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:33.799284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:33.801290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:33.803086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:33.805489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:33.806032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:33.808565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:34.577787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:34.650968 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4902e561-7763-4982-8de9-27d262cab8be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 0.886402 Oct 17 15:52:34.667790 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2804/5372] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:33 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:34.709529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:34.716703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:34.744744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:34.749097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:34.749097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:34.750012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:34.751201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:34.752283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:34.771336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:34.781688 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36e3d1a0-3b1f-4837-9b33-2359ec192f1b tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 1.579186 Oct 17 15:52:34.785508 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2569/5373] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:33 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:34.805951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:34.807832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:34.828571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:34.831970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:34.833461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:34.836757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:34.839290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:34.840281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:35.106672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:35.142692 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ef44eff-aba6-4b2f-aedf-c20f739ebff4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1314 microversion: 2.1 time: 0.469366 Oct 17 15:52:35.146027 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2805/5374] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:34 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:35.536424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-17c75933-64a6-4642-991b-b1addd9000ad req-9d04ee0f-d9aa-417d-824e-9eb528e859b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1823624-6a8c-4a42-9e15-03b25f78821e", "name": "network-vif-deleted", "tag": "3c70d92c-4ec6-4149-8343-459bac51739d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:35.575282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-17c75933-64a6-4642-991b-b1addd9000ad req-9d04ee0f-d9aa-417d-824e-9eb528e859b1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:35.580717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-17c75933-64a6-4642-991b-b1addd9000ad req-9d04ee0f-d9aa-417d-824e-9eb528e859b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:35.584157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-17c75933-64a6-4642-991b-b1addd9000ad req-9d04ee0f-d9aa-417d-824e-9eb528e859b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:35.629358 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-17c75933-64a6-4642-991b-b1addd9000ad req-9d04ee0f-d9aa-417d-824e-9eb528e859b1 service nova] Creating event network-vif-deleted:3c70d92c-4ec6-4149-8343-459bac51739d for instance d1823624-6a8c-4a42-9e15-03b25f78821e on n-h2-854441-12 Oct 17 15:52:35.644899 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-17c75933-64a6-4642-991b-b1addd9000ad req-9d04ee0f-d9aa-417d-824e-9eb528e859b1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121139 Oct 17 15:52:35.645844 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2806/5375] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:52:35.696074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:35.697994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:35.715281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:35.716259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:35.716968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:35.718876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:35.719683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:35.722605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:35.886027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:35.936609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:35.953873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:35.963424 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c551310-e2cf-42d7-8a8e-7773d67071b9 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 2054 microversion: 2.42 time: 1.161144 Oct 17 15:52:35.982622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2570/5376] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:34 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 2054 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:36.003606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:36.004248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:36.016548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:36.017051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:36.017490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:36.018226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:36.018716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:36.019149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:36.426429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:36.455906 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb84d782-ef15-4cfd-9823-2fe45f6cae3e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 0.754972 Oct 17 15:52:36.459665 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2807/5377] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:35 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:36.475917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:36.486706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:36.522376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:36.523781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:36.524365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:36.525525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:36.526398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:36.527453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:36.635644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:36.650659 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e1f7b22-a10f-4d0f-946c-4c0e99629a6a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 0.672706 Oct 17 15:52:36.667505 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2571/5378] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:35 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:37.004737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:37.005853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:37.034473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:37.035373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:37.036525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:37.038093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:37.039387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:37.043720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:37.085844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:37.115048 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9115df52-a6ce-4901-a556-4380feaf2da8 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1314 microversion: 2.1 time: 0.644938 Oct 17 15:52:37.116716 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2808/5379] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:36 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:37.238886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:37.269982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:37.284876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:37.289495 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-62a52950-82df-4625-92a9-497b3794e4f4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.291960 Oct 17 15:52:37.290603 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2572/5380] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:36 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:52:37.455514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a60277fe-ed3c-42a2-92d1-6b0ddf1925cb req-45022f15-4eb5-41e9-865a-5debebac1acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ae5f2d-8644-4ac2-87a7-851f4fb73090", "name": "network-vif-plugged", "status": "completed", "tag": "49fa7a48-2894-4813-9351-b0b2610dbc20"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:37.494255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:37.495778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:37.500721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a60277fe-ed3c-42a2-92d1-6b0ddf1925cb req-45022f15-4eb5-41e9-865a-5debebac1acb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:37.503439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a60277fe-ed3c-42a2-92d1-6b0ddf1925cb req-45022f15-4eb5-41e9-865a-5debebac1acb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:37.507238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a60277fe-ed3c-42a2-92d1-6b0ddf1925cb req-45022f15-4eb5-41e9-865a-5debebac1acb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:37.513996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:37.516111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:37.516731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:37.520914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:37.521424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:37.522069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:37.584439 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a60277fe-ed3c-42a2-92d1-6b0ddf1925cb req-45022f15-4eb5-41e9-865a-5debebac1acb service nova] Creating event network-vif-plugged:49fa7a48-2894-4813-9351-b0b2610dbc20 for instance 45ae5f2d-8644-4ac2-87a7-851f4fb73090 on n-h1-854441-12 Oct 17 15:52:37.601120 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a60277fe-ed3c-42a2-92d1-6b0ddf1925cb req-45022f15-4eb5-41e9-865a-5debebac1acb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155721 Oct 17 15:52:37.604077 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2809/5381] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:37.686689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:37.687909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:37.701527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:37.702542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:37.703194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:37.704340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:37.706982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:37.707763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:37.911997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:37.925018 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-772ff032-f193-4b1d-b05d-8d07e5bfe015 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 0.437801 Oct 17 15:52:37.926116 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2573/5382] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:37 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:38.145431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:38.147175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:38.160264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:38.165059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:38.165850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:38.168807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:38.169968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:38.172853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:38.301431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:38.329434 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-72eb1f82-f3f2-41ab-9a86-9e9500282973 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 0.652383 Oct 17 15:52:38.350559 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2810/5383] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:37 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:38.352874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:38.359645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:38.381846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:38.389709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:38.391183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:38.393868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:38.400715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:38.402019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:38.403249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:38.507213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:38.521961 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0236f75b-d09f-4562-a2a8-939b90a7dec5 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1314 microversion: 2.1 time: 0.378547 Oct 17 15:52:38.540813 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2574/5384] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:38 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:38.959158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:38.965649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:38.966717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:38.979458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:38.980080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:38.980632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:38.981483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:38.984673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:38.985539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:39.014797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:39.018328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:39.021551 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14d50f87-75e3-4a4e-9070-73600cc9eeb0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.680345 Oct 17 15:52:39.035800 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2811/5385] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:38 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:39.367798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:39.368484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:39.388181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:39.388701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:39.389165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:39.389907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:39.390398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:39.390879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:39.571038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:39.588818 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-60a26433-1c09-4344-a41f-0f89dc24b59b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 0.627293 Oct 17 15:52:39.594068 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2575/5386] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:38 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:39.609204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:39.610625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:39.628549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:39.635019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:39.638094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:39.641753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:39.642739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:39.644259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:40.103099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:40.120900 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f559d3ff-7d6d-499f-aef2-10776fe21be0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1498 microversion: 2.1 time: 0.523244 Oct 17 15:52:40.146033 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2576/5387] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:39 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1498 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:40.158532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:40.162255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:40.178299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:40.182621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:40.184672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:40.188243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:40.189122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:40.189958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:40.543131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:40.571316 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-951ab0d7-e412-4433-83b2-07b75d204adc tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1511 microversion: 2.1 time: 1.194458 Oct 17 15:52:40.608105 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2812/5388] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:39 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1511 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:40.612669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:40.640482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:40.641197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:40.647474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:40.652949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:40.669356 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-67121279-3580-4202-b87b-7b3ea812ba3a tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.506695 Oct 17 15:52:40.670132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:40.670889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:40.671480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:40.673702 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2577/5389] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:40 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:40.700693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:40.705457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:40.706576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:41.122546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a9bf978f-5c0a-4d33-978c-c4c04580fce3 req-9bf0326b-f262-4ae3-9f8e-ccecc6cd083d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab31a979-fc59-4acd-aa58-232e78ecf883", "name": "network-vif-plugged", "status": "completed", "tag": "edf25674-0f91-4c6d-b5e7-05216d1b143a"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:41.159194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:41.178734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a9bf978f-5c0a-4d33-978c-c4c04580fce3 req-9bf0326b-f262-4ae3-9f8e-ccecc6cd083d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:41.182085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a9bf978f-5c0a-4d33-978c-c4c04580fce3 req-9bf0326b-f262-4ae3-9f8e-ccecc6cd083d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:41.183029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a9bf978f-5c0a-4d33-978c-c4c04580fce3 req-9bf0326b-f262-4ae3-9f8e-ccecc6cd083d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:41.223700 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a9bf978f-5c0a-4d33-978c-c4c04580fce3 req-9bf0326b-f262-4ae3-9f8e-ccecc6cd083d service nova] Creating event network-vif-plugged:edf25674-0f91-4c6d-b5e7-05216d1b143a for instance ab31a979-fc59-4acd-aa58-232e78ecf883 on n-h1-854441-12 Oct 17 15:52:41.252461 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a9bf978f-5c0a-4d33-978c-c4c04580fce3 req-9bf0326b-f262-4ae3-9f8e-ccecc6cd083d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142790 Oct 17 15:52:41.253647 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2578/5390] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:52:41.620289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:41.626884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:41.688906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:41.692437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:41.701376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:41.706605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:41.712712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:41.715672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:41.835551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:41.883131 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5249023-a53c-4adf-bf2c-14f49b4ba405 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 1.250951 Oct 17 15:52:41.896454 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2813/5391] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:40 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:41.930560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:41.932723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:41.961754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:41.963367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:41.964687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:41.966267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:41.967636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:41.975511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:42.286832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:42.333660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:42.345596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:42.355533 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc1e4b5e-e633-4a79-9755-595da4bf0e56 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.446812 Oct 17 15:52:42.358403 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2814/5392] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:41 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:42.612899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:42.630874 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-41c75708-1d43-41a7-b724-f6b04386af8f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1488 microversion: 2.1 time: 1.024025 Oct 17 15:52:42.640352 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2579/5393] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:41 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1488 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:42.694133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86aea4cb-4b50-41e8-9644-52f4013ad10a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-186063256"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:42.707468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86aea4cb-4b50-41e8-9644-52f4013ad10a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:42.744873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86aea4cb-4b50-41e8-9644-52f4013ad10a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:42.745748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86aea4cb-4b50-41e8-9644-52f4013ad10a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:42.757562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86aea4cb-4b50-41e8-9644-52f4013ad10a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:42.757562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86aea4cb-4b50-41e8-9644-52f4013ad10a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:42.757562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86aea4cb-4b50-41e8-9644-52f4013ad10a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:42.757562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86aea4cb-4b50-41e8-9644-52f4013ad10a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:42.929640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:42.930405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:42.943028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:42.947727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:42.948617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:42.952391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:42.959572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:42.966540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:43.065900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:43.153164 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86aea4cb-4b50-41e8-9644-52f4013ad10a tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "PUT /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1060 microversion: 2.1 time: 0.467924 Oct 17 15:52:43.158150 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2815/5394] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 15:52:42 2022] PUT /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1060 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:43.194939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:43.202906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:43.237880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:43.239210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:43.240312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:43.241938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:43.243464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:43.244488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:44.037072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:44.050881 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99f8841b-1c92-40f9-99a4-be1cb6a2fa47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1367 microversion: 2.1 time: 1.125538 Oct 17 15:52:44.051504 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2580/5395] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:42 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1367 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:44.072117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:44.081146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:44.105529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:44.115202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:44.116526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:44.119596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:44.120850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:44.122940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:44.126685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:44.164448 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-441adae4-15b1-4fd5-af38-c0253b62fd75 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1487 microversion: 2.1 time: 0.977748 Oct 17 15:52:44.188238 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2816/5396] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:43 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1487 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:44.222487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:44.227487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:44.251344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:44.252419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:44.253489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:44.255062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:44.260661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:44.268212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:44.613120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:44.644692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:44.644692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:44.644692 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-58d86ba2-1fec-4d21-9bb9-75dfc0dbeb82 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.583898 Oct 17 15:52:44.644692 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2581/5397] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:44 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:44.922004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:44.956137 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-463f9adf-54a3-43e1-969e-b1963fd48daa tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1487 microversion: 2.1 time: 0.741654 Oct 17 15:52:44.985780 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2817/5398] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:44 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1487 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:45.002478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:45.003442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:45.031464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:45.032332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:45.033118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:45.040200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:45.044593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:45.048175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:45.104087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:45.112540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:45.140631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:45.141427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:45.142223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:45.143454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:45.144295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:45.145040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:45.195072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:52:45.488790 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7aa9328d-07fe-434a-915a-8809b8ca0e72 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 204 len: 0 microversion: 2.1 time: 0.493845 Oct 17 15:52:45.496395 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2582/5399] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:44 2022] DELETE /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:52:45.516743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:45.524062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:45.551345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:45.553392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:45.553781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:45.557601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:45.573624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:45.575459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:45.741688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:45.754347 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-71afbaf9-3f20-47f6-a0dd-73268e7e123e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1557 microversion: 2.1 time: 0.659631 Oct 17 15:52:45.757745 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2818/5400] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:45 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1557 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:45.769916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:45.770971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:45.782486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:45.783397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:45.784163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:45.785062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:45.785666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:45.786231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:45.968072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:45.985346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:45.994865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:45.996580 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4127f05e-c689-44b3-9976-25f7e4e65601 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.237242 Oct 17 15:52:46.011390 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2819/5401] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:45 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:46.024253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a538e292-ec28-4c5d-b0b6-862fa9afe04a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:46.025068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a538e292-ec28-4c5d-b0b6-862fa9afe04a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:46.032614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a538e292-ec28-4c5d-b0b6-862fa9afe04a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:46.033455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a538e292-ec28-4c5d-b0b6-862fa9afe04a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:46.034548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a538e292-ec28-4c5d-b0b6-862fa9afe04a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:46.035552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a538e292-ec28-4c5d-b0b6-862fa9afe04a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:46.037157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a538e292-ec28-4c5d-b0b6-862fa9afe04a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:46.037856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a538e292-ec28-4c5d-b0b6-862fa9afe04a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:46.172181 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a538e292-ec28-4c5d-b0b6-862fa9afe04a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159137 Oct 17 15:52:46.173303 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2820/5402] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:52:46 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:46.258640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:46.274313 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-de839d81-2255-4e66-a125-184de795abc6 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1493 microversion: 2.1 time: 0.771605 Oct 17 15:52:46.299225 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2583/5403] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:45 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1493 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:47.031079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:47.032851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:47.073138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:47.075575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:47.078560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:47.081797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:47.082525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:47.084568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:47.313264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:47.315794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:47.342253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:47.351740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:47.353053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:47.354359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:47.355233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:47.356007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:47.444983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:47.981567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:48.001234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:48.008102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:48.012056 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af452b5b-6d05-4e1a-9d76-b7da99edddb4 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.984589 Oct 17 15:52:48.013814 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2821/5404] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:47 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:48.200293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:48.223552 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-643d56af-7798-4808-823c-bfb677e9623d tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1493 microversion: 2.1 time: 0.921267 Oct 17 15:52:48.241859 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2584/5405] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:47 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1493 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:48.616708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:48.617659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:48.642630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:48.644312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:48.651341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:48.654221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:48.657773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:48.661283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:48.797903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:52:49.039619 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd366f95-fda6-424e-8a12-0b98c22d621d tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "DELETE /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 204 len: 0 microversion: 2.1 time: 0.427901 Oct 17 15:52:49.058178 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2822/5406] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:48 2022] DELETE /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:52:49.068834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:49.070178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:49.078349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:49.080255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:49.095069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:49.095916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:49.096582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:49.097593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:49.098295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:49.098997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:49.100795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:49.102249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:49.103168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:49.106905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:49.109039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:49.110145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:49.363649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:49.376282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:49.385208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:49.390105 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0688961f-d593-483e-ba87-d1fa77f0ae61 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.320895 Oct 17 15:52:49.390105 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2823/5407] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:49 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:49.395835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:49.401372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:49.419404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:49.420014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:49.420535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:49.421337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:49.425546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:49.426208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:49.950166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:49.959005 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8432154e-2cc6-4453-87d7-50b000fcfb03 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1504 microversion: 2.1 time: 0.899305 Oct 17 15:52:49.963086 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2585/5408] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:49 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1504 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:49.977685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8893303d-45f0-4f51-b796-40b02d7aae7e req-838e454f-10a9-4cb2-ac65-d5d937d25df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c45c6b0-61dd-41ef-8abf-bd132df191fd", "name": "network-vif-deleted", "tag": "153c2ed7-69cc-4acc-9fd1-587dd3b55e54"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:50.009606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8893303d-45f0-4f51-b796-40b02d7aae7e req-838e454f-10a9-4cb2-ac65-d5d937d25df1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:50.010398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8893303d-45f0-4f51-b796-40b02d7aae7e req-838e454f-10a9-4cb2-ac65-d5d937d25df1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:50.011058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8893303d-45f0-4f51-b796-40b02d7aae7e req-838e454f-10a9-4cb2-ac65-d5d937d25df1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:50.030448 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8893303d-45f0-4f51-b796-40b02d7aae7e req-838e454f-10a9-4cb2-ac65-d5d937d25df1 service nova] Creating event network-vif-deleted:153c2ed7-69cc-4acc-9fd1-587dd3b55e54 for instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd on n-h1-854441-12 Oct 17 15:52:50.046157 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8893303d-45f0-4f51-b796-40b02d7aae7e req-838e454f-10a9-4cb2-ac65-d5d937d25df1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080712 Oct 17 15:52:50.047495 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2586/5409] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:50.179964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:50.190194 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63f61285-9486-41e3-97b9-b84e36f4651c tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 200 len: 1493 microversion: 2.1 time: 0.801768 Oct 17 15:52:50.205952 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2824/5410] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:49 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 1493 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:50.438562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:50.440132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:50.460002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:50.475389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:50.476325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:50.481687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:50.482482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:50.483169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:50.752336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a4430c3c-71f5-48e7-beeb-3ac9443a487d req-0c3fbe68-19f9-4ce8-96f6-b7c94ad96903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab31a979-fc59-4acd-aa58-232e78ecf883", "tag": "edf25674-0f91-4c6d-b5e7-05216d1b143a"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:50.774651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4430c3c-71f5-48e7-beeb-3ac9443a487d req-0c3fbe68-19f9-4ce8-96f6-b7c94ad96903 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:50.782869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4430c3c-71f5-48e7-beeb-3ac9443a487d req-0c3fbe68-19f9-4ce8-96f6-b7c94ad96903 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:50.783642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4430c3c-71f5-48e7-beeb-3ac9443a487d req-0c3fbe68-19f9-4ce8-96f6-b7c94ad96903 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:50.806177 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a4430c3c-71f5-48e7-beeb-3ac9443a487d req-0c3fbe68-19f9-4ce8-96f6-b7c94ad96903 service nova] Creating event network-changed:edf25674-0f91-4c6d-b5e7-05216d1b143a for instance ab31a979-fc59-4acd-aa58-232e78ecf883 on n-h1-854441-12 Oct 17 15:52:50.820295 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a4430c3c-71f5-48e7-beeb-3ac9443a487d req-0c3fbe68-19f9-4ce8-96f6-b7c94ad96903 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072143 Oct 17 15:52:50.823753 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2825/5411] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:51.006100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:51.009697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:51.043122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:51.045848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:51.054298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:51.056630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:51.061537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:51.063195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:51.691084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:51.705118 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3376043e-b293-4d4c-8436-0c49a0649442 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1504 microversion: 2.1 time: 0.704111 Oct 17 15:52:51.706263 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2826/5412] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:50 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1504 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:51.717974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:51.726785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:51.742231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:51.748759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:51.749370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:51.750283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:51.755834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:51.757200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:51.795143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:51.818572 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.821200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd HTTP/1.1 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '7c45c6b0-61dd-41ef-8abf-bd132df191fd'} Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:51.821910 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.827683 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:51.827683 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:51.827683 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:51.827683 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:51.827683 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:51.827683 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.827683 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.827683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:51.827683 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ccad786f-d72c-4c53-9cb8-093501634053 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 404 len: 111 microversion: 2.1 time: 0.113321 Oct 17 15:52:51.832445 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2827/5413] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:51 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:51.835873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:51.837977 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b40e60b6-cc8f-4541-abc1-8ce9f278e453 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 1.403960 Oct 17 15:52:51.850962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:51.850962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:51.852471 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2587/5414] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:50 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:51.868589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:51.870069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:51.876241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:51.878209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:51.880919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:51.888130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:51.946555 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd HTTP/1.1 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '7c45c6b0-61dd-41ef-8abf-bd132df191fd'} Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:51.957826 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:51.970857 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:51.984105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:51.984105 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e13a37ca-e8fd-4d71-986b-e01d024dbbd1 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 404 len: 111 microversion: 2.1 time: 0.138303 Oct 17 15:52:51.985335 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2828/5415] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:51 2022] DELETE /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:51.993690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:52.000520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 7c45c6b0-61dd-41ef-8abf-bd132df191fd] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:52.029246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.034612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.035685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.037202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.041670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.049829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.134346 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd HTTP/1.1 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7c45c6b0-61dd-41ef-8abf-bd132df191fd'} Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.143159 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.161298 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.161298 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.161298 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.161298 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:52.161298 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:52.161298 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. Oct 17 15:52:52.161298 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.161298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 7c45c6b0-61dd-41ef-8abf-bd132df191fd could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:52.161298 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-54dd6e08-5783-4cb1-9e8a-29691c1d0d95 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd" status: 404 len: 111 microversion: 2.1 time: 0.172174 Oct 17 15:52:52.165192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2588/5416] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:51 2022] GET /compute/v2.1/servers/7c45c6b0-61dd-41ef-8abf-bd132df191fd => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:52:52.173876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:52.174397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:52.199657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.200375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.201305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.202246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.202979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.203583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.241610 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 HTTP/1.1 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'b5c4e267-895a-4ece-95fe-f9c8b99da226'} Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:52.253737 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.258590 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.265610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:52.266820 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69c2ed3e-e615-49d3-b263-7afbfbd53aba tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 404 len: 111 microversion: 2.1 time: 0.097667 Oct 17 15:52:52.267753 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2829/5417] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:52 2022] DELETE /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:52.286671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:52.290247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: b5c4e267-895a-4ece-95fe-f9c8b99da226] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:52.325344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.327483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.334229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.338760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.341715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.345890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.415194 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 HTTP/1.1 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'b5c4e267-895a-4ece-95fe-f9c8b99da226'} Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.427310 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.440739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.440739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.440739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.440739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:52.440739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:52.440739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. Oct 17 15:52:52.440739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.450997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance b5c4e267-895a-4ece-95fe-f9c8b99da226 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:52.454317 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a33331be-9383-4f69-b31d-0814d4a744db tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226" status: 404 len: 111 microversion: 2.1 time: 0.179361 Oct 17 15:52:52.456941 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2589/5418] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:52 2022] GET /compute/v2.1/servers/b5c4e267-895a-4ece-95fe-f9c8b99da226 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:52.466058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:52.466610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:52.481963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.482481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.482957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.483706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.500301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.501418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.561056 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 HTTP/1.1 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e849c30a-09cc-4908-a3b6-ff475c7bb547'} Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:52.565499 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.570821 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.577254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:52.581638 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2c45e06-ac2f-4685-9080-668cbf927602 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 404 len: 111 microversion: 2.1 time: 0.120049 Oct 17 15:52:52.586633 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2830/5419] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:52 2022] DELETE /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:52.606152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:52.614805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e849c30a-09cc-4908-a3b6-ff475c7bb547] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:52.633399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.634778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.635853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.637481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.640850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.642117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.676662 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 HTTP/1.1 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'e849c30a-09cc-4908-a3b6-ff475c7bb547'} Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.679391 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.684379 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.684379 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.684379 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.684379 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:52.684379 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:52.684379 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. Oct 17 15:52:52.684379 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.688610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance e849c30a-09cc-4908-a3b6-ff475c7bb547 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:52.694237 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-56bade58-4e56-4b9e-9fd6-a2e4daa568b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547" status: 404 len: 111 microversion: 2.1 time: 0.100671 Oct 17 15:52:52.699676 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2590/5420] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:52 2022] GET /compute/v2.1/servers/e849c30a-09cc-4908-a3b6-ff475c7bb547 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:52.706390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:52.706390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:52.722178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.722721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.728355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.733394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.735499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.738359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.756175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:52.757003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:52.771740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.780275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.783578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.784537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.785125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.788888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.806622 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 HTTP/1.1 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5d8d001d-71ea-49d9-9e2f-929062d28b27'} Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:52.816182 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:52.823892 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:52.843784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:52.845789 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a7f0361-9e93-4566-8fc2-dbd4f3576db7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 404 len: 111 microversion: 2.1 time: 0.143522 Oct 17 15:52:52.847205 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2831/5421] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:52 2022] DELETE /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:52.868571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:52.874576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 5d8d001d-71ea-49d9-9e2f-929062d28b27] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:52.906076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.907843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.912047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:52.916083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:52.917303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:52.918249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.001478 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:53.015848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 HTTP/1.1 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '5d8d001d-71ea-49d9-9e2f-929062d28b27'} Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.018970 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.031295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.031295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.031295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.031295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:53.031295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:53.031295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. Oct 17 15:52:53.031295 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.034473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 5d8d001d-71ea-49d9-9e2f-929062d28b27 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:53.041772 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7ce8a5ec-cc4c-4459-9883-d571513ae46b tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1462 microversion: 2.1 time: 0.291250 Oct 17 15:52:53.042900 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2591/5422] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:52 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1462 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:53.055337 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6bf436c-8144-4c73-a9c1-9dc84771e8c9 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27" status: 404 len: 111 microversion: 2.1 time: 0.189636 Oct 17 15:52:53.056830 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2832/5423] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:52 2022] GET /compute/v2.1/servers/5d8d001d-71ea-49d9-9e2f-929062d28b27 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:52:53.072788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:53.074633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:53.078742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:53.083636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:53.094437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.095308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.096226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.098654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.106574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.107451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.129377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.130318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.139703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.141072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.141954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.142821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.267247 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd HTTP/1.1 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e0f50ef5-ee08-4d7b-b51a-df574fbc61cd'} Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:53.275894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.287538 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.292117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:53.301137 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a3eea8f-1330-42e5-9d6a-0d8a09f4e4be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 404 len: 111 microversion: 2.1 time: 0.239460 Oct 17 15:52:53.307650 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2833/5424] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:53 2022] DELETE /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 111 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:53.358629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:53.359896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: e0f50ef5-ee08-4d7b-b51a-df574fbc61cd] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:53.401399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.402218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.403058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.404327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.405120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.405881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.485428 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd HTTP/1.1 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e0f50ef5-ee08-4d7b-b51a-df574fbc61cd'} Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.488621 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.493778 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.493778 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.493778 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.493778 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:53.493778 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:53.493778 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. Oct 17 15:52:53.493778 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.493778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance e0f50ef5-ee08-4d7b-b51a-df574fbc61cd could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:53.495638 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aac9f52b-386c-4712-9e26-4e053cad0179 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd" status: 404 len: 111 microversion: 2.1 time: 0.181095 Oct 17 15:52:53.499234 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2834/5425] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:53 2022] GET /compute/v2.1/servers/e0f50ef5-ee08-4d7b-b51a-df574fbc61cd => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:53.513033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:53.514008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:53.528251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.532022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.533105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.535832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.540315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.573052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.636628 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 HTTP/1.1 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '086ff15e-a334-492d-86b7-4f8e2ca49472'} Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:53.641407 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.647007 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.653435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:53.657232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9a530e7-68be-4721-8093-5df37e29990f tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 404 len: 111 microversion: 2.1 time: 0.152492 Oct 17 15:52:53.659239 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2835/5426] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:53 2022] DELETE /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:53.689660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:53.690297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 086ff15e-a334-492d-86b7-4f8e2ca49472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:53.710373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.716544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.717025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.717813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.718302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.718801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.755959 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 HTTP/1.1 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '086ff15e-a334-492d-86b7-4f8e2ca49472'} Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.757625 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.769429 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.769429 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.769429 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.769429 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:53.769429 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:53.769429 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. Oct 17 15:52:53.769429 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.769429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 086ff15e-a334-492d-86b7-4f8e2ca49472 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:53.772625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:53.773301 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-084156c7-27b2-44ae-9bc0-fe72363a29b4 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472" status: 404 len: 111 microversion: 2.1 time: 0.093570 Oct 17 15:52:53.773301 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2836/5427] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:53 2022] GET /compute/v2.1/servers/086ff15e-a334-492d-86b7-4f8e2ca49472 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:53.777496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c4aabd70-721e-480c-baa2-7b58ba72fff6 req-6f4bf6ce-19bb-4248-8689-410e4b0c53e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ae5f2d-8644-4ac2-87a7-851f4fb73090", "name": "network-vif-deleted", "tag": "49fa7a48-2894-4813-9351-b0b2610dbc20"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:53.793282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:53.797995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4aabd70-721e-480c-baa2-7b58ba72fff6 req-6f4bf6ce-19bb-4248-8689-410e4b0c53e3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.798527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4aabd70-721e-480c-baa2-7b58ba72fff6 req-6f4bf6ce-19bb-4248-8689-410e4b0c53e3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.802386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:53.803587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c4aabd70-721e-480c-baa2-7b58ba72fff6 req-6f4bf6ce-19bb-4248-8689-410e4b0c53e3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.809435 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f7b3bb6d-d425-40da-8c09-c13f02743272 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.752520 Oct 17 15:52:53.814642 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2592/5428] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:53 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:53.833327 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c4aabd70-721e-480c-baa2-7b58ba72fff6 req-6f4bf6ce-19bb-4248-8689-410e4b0c53e3 service nova] Creating event network-vif-deleted:49fa7a48-2894-4813-9351-b0b2610dbc20 for instance 45ae5f2d-8644-4ac2-87a7-851f4fb73090 on n-h1-854441-12 Oct 17 15:52:53.839213 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c4aabd70-721e-480c-baa2-7b58ba72fff6 req-6f4bf6ce-19bb-4248-8689-410e4b0c53e3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065235 Oct 17 15:52:53.840208 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2837/5429] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:52:53.841775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03698010-6578-4524-8e03-171d9b584c50 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:53.846541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-03698010-6578-4524-8e03-171d9b584c50 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:53.873615 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-03698010-6578-4524-8e03-171d9b584c50 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03698010-6578-4524-8e03-171d9b584c50 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 HTTP/1.1 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3'} Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.886609 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.896098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.896098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.896098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.896098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:53.896098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:53.896098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.896098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.898779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03698010-6578-4524-8e03-171d9b584c50 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:53.909013 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-03698010-6578-4524-8e03-171d9b584c50 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3" status: 404 len: 111 microversion: 2.1 time: 0.091608 Oct 17 15:52:53.910216 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2593/5430] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:53 2022] DELETE /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:53.919769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d296b70-f2b6-4336-bf2e-efba46355533 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:53.920448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d296b70-f2b6-4336-bf2e-efba46355533 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:53.937787 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-5d296b70-f2b6-4336-bf2e-efba46355533 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d296b70-f2b6-4336-bf2e-efba46355533 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 HTTP/1.1 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3'} Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:53.944557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:53.949925 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:53.949925 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:53.949925 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:53.949925 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. Oct 17 15:52:53.949925 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:52:53.949925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d296b70-f2b6-4336-bf2e-efba46355533 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:53.949925 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d296b70-f2b6-4336-bf2e-efba46355533 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3" status: 404 len: 111 microversion: 2.1 time: 0.030920 Oct 17 15:52:53.957416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:53.958247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:53.966827 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2838/5431] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:53 2022] GET /compute/v2.1/servers/35b5b89c-d836-4cbb-8dfc-08fa0fcc09b3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:53.973100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.977830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.978615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:53.979573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:53.981234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:53.981914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:54.049481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:52:54.090695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:54.091487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:54.124608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:54.125124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:54.125594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:54.126749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:54.127320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:54.127645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:54.232101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:54.232613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:54.233060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:54.237086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lazy-loading 'fault' on Instance uuid 45ae5f2d-8644-4ac2-87a7-851f4fb73090 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:52:54.274964 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-74d2d33e-564e-44b2-b530-275724611ed3 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 204 len: 0 microversion: 2.1 time: 0.318485 Oct 17 15:52:54.275634 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2594/5432] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:52:53 2022] DELETE /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:52:54.298798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:54.301974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:54.317689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:54.319911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:54.320660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:54.324542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:54.325341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:54.328696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:54.419111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:54.422124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:52:54.464392 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9116e1e5-12a9-40d7-96aa-f20f143ac3f4 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1304 microversion: 2.1 time: 0.378819 Oct 17 15:52:54.490796 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2839/5433] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:54 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1304 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:52:54.842687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:54.844172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:54.861860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:54.865978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:54.868421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:54.876907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:54.877342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:54.877796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:55.240248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:55.282067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:55.288786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:55.291775 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f391cf1-0dd0-4bdb-85b2-9a0fa821855b tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.452846 Oct 17 15:52:55.293066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:55.293591 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2840/5434] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:54 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:55.309264 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-69b046f4-397f-4e00-ac79-4ad0a60846be tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1479 microversion: 2.1 time: 1.023526 Oct 17 15:52:55.318026 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2595/5435] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:54 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1479 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:55.494400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:55.495911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:55.511117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:55.512588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:55.513465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:55.514601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:55.521233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:55.522476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:55.649805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:55.650339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:55.650799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:55.654856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lazy-loading 'fault' on Instance uuid 45ae5f2d-8644-4ac2-87a7-851f4fb73090 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:52:56.351039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:56.352600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:56.365955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:56.367194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:56.368049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:56.369406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:56.370146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:56.370812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:56.523056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e3d13a41b2403bb5b02fb5ed47358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a43e3d0b41b410bba0cfeba3779a50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:56.535529 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae3ca7dc-ef2d-477d-8c71-3bc00be8f1ec tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 200 len: 1304 microversion: 2.1 time: 1.046211 Oct 17 15:52:56.536149 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2841/5436] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:55 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 1304 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:56.548517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:56.549153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:56.571888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:56.572461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:56.572839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:56.573654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:56.574043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:56.574512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:56.687958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:56.706020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:56.714092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:56.720808 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f705e79-37f4-45f8-8bad-bc359b68299d tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.377704 Oct 17 15:52:56.736214 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2596/5437] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:56 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:52:57.222145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:57.235018 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36ec6ef3-2b32-4d09-90f5-8b079f6f6b36 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1479 microversion: 2.1 time: 0.696661 Oct 17 15:52:57.257658 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2842/5438] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:56 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1479 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:57.581801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:57.583170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] [instance: 45ae5f2d-8644-4ac2-87a7-851f4fb73090] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:57.629920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:57.631412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:57.635041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:57.638696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:57.641932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:57.648112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:57.687060 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] HTTP exception thrown: Instance 45ae5f2d-8644-4ac2-87a7-851f4fb73090 could not be found. Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Request method failure captured: Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 HTTP/1.1 Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXolhiYiroSqXDSlk4yuBLpFwklM-5CyWNSMZsNj5YMkp9-rnryG9X_4i15gYSvUd5mpfRnTjOGJ8ULy3eMuw5ugpLaIdzzxp2OrWKhAPxw_NVdVADTSbVepxnmQKGJGxQx-fkTjOOK3M18a7_whDqqLFWIUT1ZITnxNtz6GpdbZUMQ Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4a43e3d0b41b410bba0cfeba3779a50a Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesActionsTest-1221327016 Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4a43e3d0b41b410bba0cfeba3779a50a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4a43e3d0b41b410bba0cfeba3779a50a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4a43e3d0b41b410bba0cfeba3779a50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4a43e3d0b41b410bba0cfeba3779a50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesActionsTest-1221327016 Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4a43e3d0b41b410bba0cfeba3779a50a Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesActionsTest-1221327016 Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesActionsTest-1221327016-project Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a1e3d13a41b2403bb5b02fb5ed47358d Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesActionsTest-1221327016-project Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 45ae5f2d-8644-4ac2-87a7-851f4fb73090 could not be found. Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '45ae5f2d-8644-4ac2-87a7-851f4fb73090'} Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45ae5f2d-8644-4ac2-87a7-851f4fb73090 could not be found. Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45ae5f2d-8644-4ac2-87a7-851f4fb73090 could not be found. Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:52:57.688972 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:57.695861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:52:57.695861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:52:57.695861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:52:57.695861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:52:57.695861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:52:57.695861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45ae5f2d-8644-4ac2-87a7-851f4fb73090 could not be found. Oct 17 15:52:57.695861 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:52:57.695861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] Returning 404 to user: Instance 45ae5f2d-8644-4ac2-87a7-851f4fb73090 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:52:57.696572 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c693ae64-7a18-43c7-a6e0-fb3d4574dac0 tempest-VolumesActionsTest-1221327016 tempest-VolumesActionsTest-1221327016-project] 10.222.0.87 "GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090" status: 404 len: 111 microversion: 2.1 time: 0.116358 Oct 17 15:52:57.697328 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2597/5439] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:57 2022] GET /compute/v2.1/servers/45ae5f2d-8644-4ac2-87a7-851f4fb73090 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:52:57.752209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:57.755763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:57.770828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:57.773988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:57.775091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:57.778523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:57.779309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:57.781691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:58.016475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:58.032995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:58.043364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:58.045304 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88189b3d-83c6-4c5e-ac91-dd09ac5a0fce tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.299026 Oct 17 15:52:58.059314 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2843/5440] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:57 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:58.265774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:58.267721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:58.284265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:58.285107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:58.285588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:58.286326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:58.286820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:58.287252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:58.385154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e91306af-5c57-44d7-b1de-37a077e12b2b req-dd99e50c-9e97-4f35-bbfb-0173482022fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0085d265-5f11-46e5-a77f-ffd5a2ccb1b9", "name": "network-vif-deleted", "tag": "0d5c2440-50c9-4416-8d8c-537faec8b77c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:52:58.408244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e91306af-5c57-44d7-b1de-37a077e12b2b req-dd99e50c-9e97-4f35-bbfb-0173482022fc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:58.419068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e91306af-5c57-44d7-b1de-37a077e12b2b req-dd99e50c-9e97-4f35-bbfb-0173482022fc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:58.419800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e91306af-5c57-44d7-b1de-37a077e12b2b req-dd99e50c-9e97-4f35-bbfb-0173482022fc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:58.448054 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e91306af-5c57-44d7-b1de-37a077e12b2b req-dd99e50c-9e97-4f35-bbfb-0173482022fc service nova] Creating event network-vif-deleted:0d5c2440-50c9-4416-8d8c-537faec8b77c for instance 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 on n-h1-854441-12 Oct 17 15:52:58.460914 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e91306af-5c57-44d7-b1de-37a077e12b2b req-dd99e50c-9e97-4f35-bbfb-0173482022fc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079754 Oct 17 15:52:58.464762 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2844/5441] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:52:58.508331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:58.520939 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9327e9c-db25-475d-ab90-7bafd7b043f7 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1437 microversion: 2.1 time: 0.260520 Oct 17 15:52:58.538873 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2598/5442] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:58 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1437 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:52:59.079321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:59.080791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:59.094082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:59.095076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:59.095934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:59.097084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:59.098092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:59.099107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:59.334414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:59.357473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:59.366893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:52:59.374304 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-389646ea-1723-429b-917a-8ffe146f1a8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.301239 Oct 17 15:52:59.391382 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2845/5443] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:52:59 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:52:59.552960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:52:59.553662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:52:59.573684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:59.575171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:59.575711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:59.576533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:59.577023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:59.577475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:59.789659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:52:59.792391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:52:59.794801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:52:59.797539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lazy-loading 'fault' on Instance uuid 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:53:00.023895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec6f504a59b46228db013140f4ce605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2427ccdb24e21b3e62ee89827fa69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:00.060713 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-90f0e568-1b28-40e2-8654-3230d2d74811 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 200 len: 1282 microversion: 2.1 time: 0.508896 Oct 17 15:53:00.083424 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2599/5444] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:52:59 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 1282 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:53:00.416897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:00.418185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:00.433646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:00.434471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:00.438823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:00.440498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:00.441219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:00.441910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:00.632531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:00.646775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:00.652300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:00.656349 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1f0b796-7389-40ac-8a19-a0a2563ce5fd tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.246745 Oct 17 15:53:00.663670 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2846/5445] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:00 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:01.098936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:01.098936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] [instance: 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:01.139422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:01.140450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:01.141234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:01.142539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:01.143361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:01.144114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:01.261120 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] HTTP exception thrown: Instance 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 could not be found. Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Request method failure captured: Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 HTTP/1.1 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXlNyXUmzMdfIQQZt4YQaS8kEHe4hrmBIdT_Iz5-wyXcs6zKk0LJ8CNQfIt_u3x5kpQ4hvLpchZPPxkNY-su9DxywWRynkfHLauJ2P3Yn_IPKc2R2r4AQidFOA2vfIvZl3MChYevr_mV50rG5ok1EhSn8IXFQH-61mKjJlRM_V2iVzQ Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6ad2427ccdb24e21b3e62ee89827fa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersTestJSON-1476373773 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 6ad2427ccdb24e21b3e62ee89827fa69 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersTestJSON-1476373773 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersTestJSON-1476373773-project Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: bec6f504a59b46228db013140f4ce605 Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersTestJSON-1476373773-project Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 could not be found. Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '0085d265-5f11-46e5-a77f-ffd5a2ccb1b9'} Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 could not be found. Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 could not be found. Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:01.274014 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 could not be found. Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] Returning 404 to user: Instance 0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f624325e-7cb8-4008-8ff1-97090f15c524 tempest-ServersTestJSON-1476373773 tempest-ServersTestJSON-1476373773-project] 10.222.0.87 "GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9" status: 404 len: 111 microversion: 2.1 time: 0.192229 Oct 17 15:53:01.300532 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2600/5446] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:01 2022] GET /compute/v2.1/servers/0085d265-5f11-46e5-a77f-ffd5a2ccb1b9 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:53:01.690673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:01.691393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:01.715369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:01.720736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:01.721920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:01.723549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:01.736608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:01.737833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:01.984752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:02.029387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:02.032965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:02.044248 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dc28523a-9fc6-45c6-9459-2e6873e38e13 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.357474 Oct 17 15:53:02.044950 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2847/5447] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:01 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:03.118884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:03.130913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:03.184637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:03.186964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:03.199413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:03.200288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:03.200779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:03.206279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:03.508423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:03.528099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:03.539750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:03.542876 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4b12d063-e79d-40af-ac12-8283efdb4948 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.437333 Oct 17 15:53:03.544021 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2601/5448] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:03 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:04.600990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:04.605657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:04.637505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:04.640412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:04.648144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:04.650161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:04.651860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:04.660737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:04.959365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:04.985630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:04.989057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:05.001350 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e973c6c8-1d73-471b-8150-d1ad6d64da60 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.407793 Oct 17 15:53:05.015965 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2848/5449] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:04 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:06.058117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:06.058999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:06.086374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:06.086994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:06.087472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:06.088238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:06.088705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:06.089143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:06.375849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:06.431566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:06.444337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:06.446963 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fea63849-1aec-48be-9d60-b1e7d619c151 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.394361 Oct 17 15:53:06.448184 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2602/5450] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:06 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:07.479944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:07.483791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:07.507080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:07.512353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:07.517300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:07.526410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:07.528911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:07.530623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:07.808694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:07.832043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:07.833652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:07.847128 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1fbdc57-05da-443c-8e39-1e2d571528a0 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.359843 Oct 17 15:53:07.851378 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2849/5451] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:07 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:08.880337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:08.881153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:08.901194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:08.909238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:08.909754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:08.910607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:08.911050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:08.911492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:09.459248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:09.463446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:09.487324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:09.495728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:09.497878 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a378481c-4031-4298-afbf-280f09486b93 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1605 microversion: 2.42 time: 0.621721 Oct 17 15:53:09.511324 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2603/5452] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:08 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1605 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:10.532406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:10.533781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:10.542270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:10.569672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:10.570837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:10.571493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:10.577533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:10.591399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:10.591861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:10.782888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:10.783354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:10.783816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:10.784464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lazy-loading 'fault' on Instance uuid d1823624-6a8c-4a42-9e15-03b25f78821e {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:53:12.275849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:12.292384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:12.299824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1931a1c3ed04b77ac11e19e74944f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4704af8d692b4d1c8b5c77de7b7a8c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:12.320567 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-670a6055-be52-4f64-8826-dcc087d9ab8c tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 200 len: 1372 microversion: 2.42 time: 1.781185 Oct 17 15:53:12.341278 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2850/5453] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:10 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 1372 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:13.362297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:13.362937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:13.366242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:13.393734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:13.396765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:13.397754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:13.403045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:13.404112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:13.405255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:13.437616 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] HTTP exception thrown: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Request method failure captured: Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e HTTP/1.1 Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXhk1MeG0wRr6BJhf2_88UNu49uN03_EFej2qbBUDQpZbtBW2DTs8i9gIfqQ0Zy--qI3OlsDehmUVyaW38MnnMhH3EizTmXy4HY2DVC-LCrDa7qpiCraINB6Q1Fdod7VRp8yPXlc7PntfuQY7_M813Lfp2zv3qAwv8GoMNcSNHbzckk Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4704af8d692b4d1c8b5c77de7b7a8c5b Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-895109046 Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TaggedBootDevicesTest_v242-895109046 Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4704af8d692b4d1c8b5c77de7b7a8c5b Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-895109046 Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TaggedBootDevicesTest_v242-895109046-project Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a1931a1c3ed04b77ac11e19e74944f4e Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TaggedBootDevicesTest_v242-895109046-project Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd1823624-6a8c-4a42-9e15-03b25f78821e'} Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:13.454087 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:13.460630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:13.460630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:13.460630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:13.460630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:13.460630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:53:13.460630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:53:13.460630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:13.460630 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:13.464703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Returning 404 to user: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:53:13.466516 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-86e1f95f-a228-4a2e-9e4f-a61ced3eb947 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 404 len: 111 microversion: 2.42 time: 0.108497 Oct 17 15:53:13.467742 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2604/5454] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:13 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:53:13.477813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45069572-c694-433d-8570-1e6fc6cb4422 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '.version_select at 0x7f28bd6e81f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:13.535408 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45069572-c694-433d-8570-1e6fc6cb4422 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056605329" status: 204 len: 0 microversion: 2.42 time: 0.062922 Oct 17 15:53:13.539329 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2851/5455] 10.222.0.87 () {60 vars in 1262 bytes} [Mon Oct 17 15:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056605329 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:53:20.474929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-846899061", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": "none"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:53:20.627506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:53:20.629852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:53:20.630392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:53:20.633906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:53:20.634607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:53:20.668166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:20.668691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:20.669245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:20.670047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:20.679203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:20.679950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:20.787323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Getting quotas for project b07d425253054dffaa746f843414c80d. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:53:20.824215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Getting quotas for user 2b55fe937db14802b4d7174a28cf66b2 and project b07d425253054dffaa746f843414c80d. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:53:20.885469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:53:20.897307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:53:20.931045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0c28005e-fd0f-4d93-8f53-e83a9a4d8395 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:20.931708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0c28005e-fd0f-4d93-8f53-e83a9a4d8395 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:20.961786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c28005e-fd0f-4d93-8f53-e83a9a4d8395 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:20.963136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c28005e-fd0f-4d93-8f53-e83a9a4d8395 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:20.967285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c28005e-fd0f-4d93-8f53-e83a9a4d8395 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:20.968406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c28005e-fd0f-4d93-8f53-e83a9a4d8395 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:20.969116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c28005e-fd0f-4d93-8f53-e83a9a4d8395 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:20.970591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0c28005e-fd0f-4d93-8f53-e83a9a4d8395 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:21.032139 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0c28005e-fd0f-4d93-8f53-e83a9a4d8395 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883/ips" status: 200 len: 150 microversion: 2.1 time: 0.105519 Oct 17 15:53:21.043032 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2852/5456] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:53:20 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883/ips => generated 150 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:53:21.049904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7b95f36-597b-4012-8e45-288939f9db28"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:53:21.057292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:21.094371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:21.095405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:21.096148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:21.097180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:21.097908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:21.098695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:21.152624 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea8b60e6-bd95-4918-96c2-cb45e13d264c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.014066 Oct 17 15:53:21.168311 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2605/5457] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:53:21.199347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5da4fb6-4993-493a-9c0a-b5165a8b6d9a tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:21.200357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5da4fb6-4993-493a-9c0a-b5165a8b6d9a tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:21.245888 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Invalid volume: volume a7b95f36-597b-4012-8e45-288939f9db28 is already attached to instances: 48f0e647-c24a-496d-ac11-6a9187931eee Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883/os-volume_attachments HTTP/1.1 Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 74 Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: {"volumeAttachment": {"volumeId": "a7b95f36-597b-4012-8e45-288939f9db28"}} Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid volume: volume a7b95f36-597b-4012-8e45-288939f9db28 is already attached to instances: 48f0e647-c24a-496d-ac11-6a9187931eee Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': 'ab31a979-fc59-4acd-aa58-232e78ecf883', 'body': {'volumeAttachment': {'volumeId': 'a7b95f36-597b-4012-8e45-288939f9db28'}}} Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a7b95f36-597b-4012-8e45-288939f9db28 is already attached to instances: 48f0e647-c24a-496d-ac11-6a9187931eee Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:53:21.251195 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a7b95f36-597b-4012-8e45-288939f9db28 is already attached to instances: 48f0e647-c24a-496d-ac11-6a9187931eee Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a7b95f36-597b-4012-8e45-288939f9db28 is already attached to instances: 48f0e647-c24a-496d-ac11-6a9187931eee Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 400 to user: Invalid volume: volume a7b95f36-597b-4012-8e45-288939f9db28 is already attached to instances: 48f0e647-c24a-496d-ac11-6a9187931eee {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd01f6eb-9c38-4bf4-9435-b8101a596a98 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.208430 Oct 17 15:53:21.256446 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2853/5458] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:53:21 2022] POST /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883/os-volume_attachments => generated 174 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:53:21.265348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:21.265852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:21.293153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:21.293667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:21.299422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:21.300404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:21.300927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:21.301410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:21.414179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:53:21.606173 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50146335-c9f4-4450-a12d-b5b1c7c07205 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 204 len: 0 microversion: 2.1 time: 0.344424 Oct 17 15:53:21.616987 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2854/5459] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:53:21 2022] DELETE /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:53:21.634264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:21.639878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:21.654249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:21.659788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:21.660501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:21.661519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:21.662346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:21.663167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:21.710756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5da4fb6-4993-493a-9c0a-b5165a8b6d9a tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:21.724256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5da4fb6-4993-493a-9c0a-b5165a8b6d9a tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:21.730420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5da4fb6-4993-493a-9c0a-b5165a8b6d9a tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:21.733571 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5da4fb6-4993-493a-9c0a-b5165a8b6d9a tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1277 microversion: 2.54 time: 0.556888 Oct 17 15:53:21.737485 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2606/5460] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:21 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1277 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:22.378126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:22.394110 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f791650-3f1e-499d-b11d-70b44f40e98a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1682 microversion: 2.1 time: 0.775179 Oct 17 15:53:22.395075 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2855/5461] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:21 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1682 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:53:22.771897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:22.772904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:22.786609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:22.799380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:22.800192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:22.801381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:22.802125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:22.802812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:23.153317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:23.181269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:23.183195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:23.188275 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff2198ab-5ef5-40f3-abb6-ba28ff02cdd2 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1281 microversion: 2.54 time: 0.419775 Oct 17 15:53:23.189508 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2607/5462] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:22 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1281 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:23.419408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:23.420346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:23.440425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:23.441088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:23.441580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:23.442469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:23.443023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:23.443490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:23.447462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:24.246004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:24.247467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:24.265107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:24.269898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:24.271143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:24.275830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:24.277867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:24.280625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:24.299318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:24.311433 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c44eff8-c7f4-4ee9-8a8e-7dbade899628 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1682 microversion: 2.1 time: 0.897452 Oct 17 15:53:24.327627 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2856/5463] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:23 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1682 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:53:24.911713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:24.938911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:24.947102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:24.957648 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-577039cf-8a58-4a7e-95b1-dd4d14a07a0e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1347 microversion: 2.54 time: 0.715910 Oct 17 15:53:24.963469 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2608/5464] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:24 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1347 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:53:25.345936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:25.347340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:25.360532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:25.366892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:25.367721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:25.368683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:25.369360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:25.370139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:26.018682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:26.021782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:26.047269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:26.048765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:26.051222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:26.054980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:26.057906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:26.058983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:26.359000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:26.372080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:26.373636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:26.379394 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a35baeb3-5ec6-46dd-b12a-76c369d89ab7 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1335 microversion: 2.54 time: 0.366721 Oct 17 15:53:26.394536 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2609/5465] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:26 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1335 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:26.814898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:26.840389 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e657046-fca8-4077-99f2-e1ce92d2daeb tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1682 microversion: 2.1 time: 1.498997 Oct 17 15:53:26.842099 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2857/5466] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:25 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1682 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:53:27.432118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:27.433028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:27.445426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:27.445937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:27.446375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:27.447232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:27.447902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:27.449306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:27.883693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:27.884645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:27.905752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:27.906660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:27.907286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:27.911350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:27.915252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:27.915920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:27.969811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:28.005696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:28.050229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:28.057688 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0ebba2c7-cc17-4085-aa90-e27e4a571d9e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1356 microversion: 2.54 time: 0.627993 Oct 17 15:53:28.060821 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2610/5467] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:27 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1356 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:28.137925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55874d40-9cff-44af-8b9c-e7de7984bd72 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Action: 'create', calling method: .version_select at 0x7f28be04e0d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-950250554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDrpvqPrAfzWSkeUOJ5iIJkn4X8iV2pHnSB8H9y2XNLefBgOA42qafrNR5nLpwJzm/mLSeziud/p2oIf5p3f7wjcgDacecs7vyKYceWk1WeWRgaHsECWRkA81F8bHYRug=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:53:28.284741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-55874d40-9cff-44af-8b9c-e7de7984bd72 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Getting quotas for project b07d425253054dffaa746f843414c80d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:53:28.317597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-55874d40-9cff-44af-8b9c-e7de7984bd72 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Getting quotas for user 2b55fe937db14802b4d7174a28cf66b2 and project b07d425253054dffaa746f843414c80d. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:53:28.369706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:28.393648 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3385f472-bbca-4427-87ef-0188c5b5e74a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1614 microversion: 2.1 time: 0.514454 Oct 17 15:53:28.394612 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2858/5468] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:27 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1614 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:53:28.500092 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-55874d40-9cff-44af-8b9c-e7de7984bd72 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.372880 Oct 17 15:53:28.507759 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2611/5469] 10.222.0.87 () {62 vars in 1200 bytes} [Mon Oct 17 15:53:28 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 376 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 15:53:28.516472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-950250554", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:53:28.519700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:28.540076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:28.540676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:28.541116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:28.541811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:28.542437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:28.542912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:28.756357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:53:28.756792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:53:28.765893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:53:28.766550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:53:28.766985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:53:28.829364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c6de1d6c-1347-4b0a-8903-dd6e8b0307d5 req-35992ee9-bc45-47eb-8168-bac154373503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab31a979-fc59-4acd-aa58-232e78ecf883", "name": "network-vif-deleted", "tag": "edf25674-0f91-4c6d-b5e7-05216d1b143a"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:53:28.867765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c6de1d6c-1347-4b0a-8903-dd6e8b0307d5 req-35992ee9-bc45-47eb-8168-bac154373503 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:28.868262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c6de1d6c-1347-4b0a-8903-dd6e8b0307d5 req-35992ee9-bc45-47eb-8168-bac154373503 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:28.868720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c6de1d6c-1347-4b0a-8903-dd6e8b0307d5 req-35992ee9-bc45-47eb-8168-bac154373503 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:28.887772 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c6de1d6c-1347-4b0a-8903-dd6e8b0307d5 req-35992ee9-bc45-47eb-8168-bac154373503 service nova] Creating event network-vif-deleted:edf25674-0f91-4c6d-b5e7-05216d1b143a for instance ab31a979-fc59-4acd-aa58-232e78ecf883 on n-h1-854441-12 Oct 17 15:53:28.934900 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c6de1d6c-1347-4b0a-8903-dd6e8b0307d5 req-35992ee9-bc45-47eb-8168-bac154373503 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109527 Oct 17 15:53:28.942169 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2612/5470] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:53:29.161670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:29.232078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:29.236614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:29.237471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:29.238895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:29.250779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:29.259524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:29.453839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:29.454959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:29.455750 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f29a4bc3-1b94-4bf4-9715-d754f72ff106 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "POST /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a/action" status: 202 len: 1138 microversion: 2.54 time: 0.942989 Oct 17 15:53:29.463698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2859/5471] 10.222.0.87 () {62 vars in 1320 bytes} [Mon Oct 17 15:53:28 2022] POST /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a/action => generated 1138 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 17 15:53:29.476282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:29.479275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:29.481429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:29.483840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:29.492110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:29.492873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:29.516445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:29.527156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:29.599767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:29.599995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:29.600728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:29.602240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:29.604224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:29.605238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:29.653347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:29.663779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:29.668488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:29.670533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lazy-loading 'fault' on Instance uuid ab31a979-fc59-4acd-aa58-232e78ecf883 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:53:29.894120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:29.907279 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07809b29-50ea-4274-85b6-d0d68f412e8f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 200 len: 1331 microversion: 2.1 time: 0.458954 Oct 17 15:53:29.914622 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2613/5472] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:29 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 1331 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:53:30.096718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:30.143586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:30.153597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:30.161386 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31acb278-9090-44d0-b6ad-8f257f1e9558 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.664543 Oct 17 15:53:30.165325 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2860/5473] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:29 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:30.866688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:30.867938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:30.872161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:30.901516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:30.904444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:30.907704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:30.908984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:30.914320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:30.915733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:30.972028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:30.973381 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] HTTP exception thrown: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Request method failure captured: Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e HTTP/1.1 Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXhk1MeG0wRr6BJhf2_88UNu49uN03_EFej2qbBUDQpZbtBW2DTs8i9gIfqQ0Zy--qI3OlsDehmUVyaW38MnnMhH3EizTmXy4HY2DVC-LCrDa7qpiCraINB6Q1Fdod7VRp8yPXlc7PntfuQY7_M813Lfp2zv3qAwv8GoMNcSNHbzckk Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4704af8d692b4d1c8b5c77de7b7a8c5b Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-895109046 Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TaggedBootDevicesTest_v242-895109046 Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4704af8d692b4d1c8b5c77de7b7a8c5b Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-895109046 Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TaggedBootDevicesTest_v242-895109046-project Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a1931a1c3ed04b77ac11e19e74944f4e Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TaggedBootDevicesTest_v242-895109046-project Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd1823624-6a8c-4a42-9e15-03b25f78821e'} Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:53:30.975223 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:30.979998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:30.980778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:30.985759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Returning 404 to user: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:53:30.990314 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-69781c4d-fa4a-4587-9f17-1d690a26ea30 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 404 len: 111 microversion: 2.42 time: 0.128124 Oct 17 15:53:30.991951 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2614/5474] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:53:30 2022] DELETE /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:53:31.007749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:31.009035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] [instance: d1823624-6a8c-4a42-9e15-03b25f78821e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:31.009849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:31.010809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:31.020889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:31.025863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:31.027435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:31.028093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:31.029046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:31.029938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:31.033172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:31.036079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:31.036615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:31.036858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:31.077923 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] HTTP exception thrown: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Request method failure captured: Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e HTTP/1.1 Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXhk1MeG0wRr6BJhf2_88UNu49uN03_EFej2qbBUDQpZbtBW2DTs8i9gIfqQ0Zy--qI3OlsDehmUVyaW38MnnMhH3EizTmXy4HY2DVC-LCrDa7qpiCraINB6Q1Fdod7VRp8yPXlc7PntfuQY7_M813Lfp2zv3qAwv8GoMNcSNHbzckk Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 4704af8d692b4d1c8b5c77de7b7a8c5b Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-895109046 Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/4704af8d692b4d1c8b5c77de7b7a8c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TaggedBootDevicesTest_v242-895109046 Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 4704af8d692b4d1c8b5c77de7b7a8c5b Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-895109046 Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TaggedBootDevicesTest_v242-895109046-project Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a1931a1c3ed04b77ac11e19e74944f4e Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TaggedBootDevicesTest_v242-895109046-project Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd1823624-6a8c-4a42-9e15-03b25f78821e'} Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.081907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] Returning 404 to user: Instance d1823624-6a8c-4a42-9e15-03b25f78821e could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7a19111e-5ff9-43f2-b728-c516f4f91f18 tempest-TaggedBootDevicesTest_v242-895109046 tempest-TaggedBootDevicesTest_v242-895109046-project] 10.222.0.87 "GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e" status: 404 len: 111 microversion: 2.42 time: 0.090626 Oct 17 15:53:31.098733 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2615/5475] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:30 2022] GET /compute/v2.1/servers/d1823624-6a8c-4a42-9e15-03b25f78821e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 15:53:31.114886 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 HTTP/1.1 Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'ab31a979-fc59-4acd-aa58-232e78ecf883'} Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:53:31.120735 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f996b2c-0884-4f4f-8fc7-dbd8e7bfaf3d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 404 len: 111 microversion: 2.1 time: 0.159635 Oct 17 15:53:31.131881 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2861/5476] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:30 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:53:31.140046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a54ac8a-781f-40e0-956a-fd6fef7cb6fd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '.version_select at 0x7f28bdff1f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:31.177760 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a54ac8a-781f-40e0-956a-fd6fef7cb6fd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-394635804" status: 202 len: 0 microversion: 2.1 time: 0.044496 Oct 17 15:53:31.179101 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2616/5477] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:53:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-394635804 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:53:31.212167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:31.213766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:31.228033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:31.228821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:31.230108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:31.231423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:31.234273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:31.235074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:31.458873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:31.466471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:31.472553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:31.477702 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4c1cd30-74f7-4f6d-8bd0-309e77008db4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.269905 Oct 17 15:53:31.495855 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2862/5478] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:31 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:53:32.508399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:32.509724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:32.533582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:32.535059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:32.537241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:32.546672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:32.547165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:32.547781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:32.827195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:32.854174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:32.859399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:32.861236 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-47597e51-c7c4-4271-8be2-b23ad5c8caf0 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.357973 Oct 17 15:53:32.866996 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2617/5479] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:32 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:53:33.910778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:33.915559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:33.948129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:33.952097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:33.955333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:33.956763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:33.960646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:33.963605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:34.316051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:34.352506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:34.355229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:34.363410 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70ca91dc-d67b-4df5-ad59-835b9c45d06b tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.465172 Oct 17 15:53:34.369601 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2863/5480] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:33 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:34.991571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:34.995008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:35.047922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:35.048771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:35.049536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:35.050828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:35.061497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:35.062310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:35.403222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:35.404469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:35.415196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lazy-loading 'services' on Instance uuid 48f0e647-c24a-496d-ac11-6a9187931eee {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:53:35.441167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:35.451241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:35.459429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:35.460251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:35.460844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:35.461394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:35.649758 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4b360a20-e887-4b57-b09e-cef79d94f5ff tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments/a7b95f36-597b-4012-8e45-288939f9db28" status: 202 len: 0 microversion: 2.1 time: 0.667045 Oct 17 15:53:35.655501 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2618/5481] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:53:34 2022] DELETE /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments/a7b95f36-597b-4012-8e45-288939f9db28 => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:53:35.686087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eaed5af0-4f3f-448f-8476-5c4944f43ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:35.697748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eaed5af0-4f3f-448f-8476-5c4944f43ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:35.757898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaed5af0-4f3f-448f-8476-5c4944f43ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:35.759689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaed5af0-4f3f-448f-8476-5c4944f43ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:35.760763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaed5af0-4f3f-448f-8476-5c4944f43ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:35.762416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaed5af0-4f3f-448f-8476-5c4944f43ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:35.763521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaed5af0-4f3f-448f-8476-5c4944f43ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:35.765910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eaed5af0-4f3f-448f-8476-5c4944f43ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:35.878446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:35.933593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:35.940545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:35.942610 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b08271e4-c5d5-4f06-9b71-9ffdeb463964 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.547205 Oct 17 15:53:35.968625 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eaed5af0-4f3f-448f-8476-5c4944f43ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.307496 Oct 17 15:53:35.969519 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2619/5483] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:35 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:35.981911 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2864/5483] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:35 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:53:37.002835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-379c76f7-e48c-43f5-b04d-deffaf460d51 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:37.006158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:37.009610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:37.011257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-379c76f7-e48c-43f5-b04d-deffaf460d51 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:37.028016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-379c76f7-e48c-43f5-b04d-deffaf460d51 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:37.029770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-379c76f7-e48c-43f5-b04d-deffaf460d51 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:37.031274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-379c76f7-e48c-43f5-b04d-deffaf460d51 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:37.033183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-379c76f7-e48c-43f5-b04d-deffaf460d51 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:37.034181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-379c76f7-e48c-43f5-b04d-deffaf460d51 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:37.035252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-379c76f7-e48c-43f5-b04d-deffaf460d51 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:37.050556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:37.051259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:37.051908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:37.059532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:37.060460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:37.061634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:37.170342 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-379c76f7-e48c-43f5-b04d-deffaf460d51 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185163 Oct 17 15:53:37.174453 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2620/5484] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:36 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:37.320074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:37.344512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:37.348966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:37.352848 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-765bc0a3-84a8-41e8-a2db-9d4d750ec8c4 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.356975 Oct 17 15:53:37.380043 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2865/5485] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:36 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:53:38.198848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-298ebf9c-4d4c-4843-9645-6f1486256a39 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:38.227828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-298ebf9c-4d4c-4843-9645-6f1486256a39 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:38.257650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298ebf9c-4d4c-4843-9645-6f1486256a39 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:38.260753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298ebf9c-4d4c-4843-9645-6f1486256a39 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:38.262335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298ebf9c-4d4c-4843-9645-6f1486256a39 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:38.265416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298ebf9c-4d4c-4843-9645-6f1486256a39 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:38.268968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298ebf9c-4d4c-4843-9645-6f1486256a39 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:38.270937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-298ebf9c-4d4c-4843-9645-6f1486256a39 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:38.383774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=12 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:38.412024 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-298ebf9c-4d4c-4843-9645-6f1486256a39 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224635 Oct 17 15:53:38.416864 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2621/5486] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:38 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:38.417418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:38.423544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:38.489382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:38.491626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:38.494398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:38.499120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:38.502273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:38.507172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:38.896396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:38.906589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:38.918679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:38.921191 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-095ebeaa-b71f-4643-8d40-a03d3bbc4abd tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.520955 Oct 17 15:53:38.923839 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2866/5487] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:38 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:39.440318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5e1c136-cbd0-47c6-b14f-a8b7dccc7794 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:39.452676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5e1c136-cbd0-47c6-b14f-a8b7dccc7794 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:39.491937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e1c136-cbd0-47c6-b14f-a8b7dccc7794 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:39.493697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e1c136-cbd0-47c6-b14f-a8b7dccc7794 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:39.495797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e1c136-cbd0-47c6-b14f-a8b7dccc7794 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:39.497901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e1c136-cbd0-47c6-b14f-a8b7dccc7794 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:39.500485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e1c136-cbd0-47c6-b14f-a8b7dccc7794 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:39.501716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e1c136-cbd0-47c6-b14f-a8b7dccc7794 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:39.616363 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5e1c136-cbd0-47c6-b14f-a8b7dccc7794 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180430 Oct 17 15:53:39.619258 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2622/5488] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:39 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:39.984597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:39.996937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:40.039038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:40.042154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:40.049179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:40.055147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:40.058482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:40.059659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:40.412712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:40.447194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:40.450557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:40.452687 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b241b8ff-07b4-4f35-bead-c7de94bba6aa tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.478396 Oct 17 15:53:40.463506 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2867/5489] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:39 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:40.645685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fec17e35-5a37-4285-a1fd-d892e7053c50 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:40.653627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fec17e35-5a37-4285-a1fd-d892e7053c50 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:40.684438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec17e35-5a37-4285-a1fd-d892e7053c50 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:40.687321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec17e35-5a37-4285-a1fd-d892e7053c50 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:40.689552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec17e35-5a37-4285-a1fd-d892e7053c50 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:40.692197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec17e35-5a37-4285-a1fd-d892e7053c50 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:40.693786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec17e35-5a37-4285-a1fd-d892e7053c50 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:40.695945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fec17e35-5a37-4285-a1fd-d892e7053c50 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:40.772246 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fec17e35-5a37-4285-a1fd-d892e7053c50 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136066 Oct 17 15:53:40.774255 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2623/5490] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:40 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:41.491715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:41.492466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:41.496177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:41.512668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:41.513602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:41.514822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:41.523693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:41.524710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:41.525528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:41.790559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-10574ab2-21a3-4c18-866f-e2a8da0465c5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:41.806478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-10574ab2-21a3-4c18-866f-e2a8da0465c5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:41.828755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10574ab2-21a3-4c18-866f-e2a8da0465c5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:41.832967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10574ab2-21a3-4c18-866f-e2a8da0465c5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:41.844263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10574ab2-21a3-4c18-866f-e2a8da0465c5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:41.848099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10574ab2-21a3-4c18-866f-e2a8da0465c5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:41.858706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10574ab2-21a3-4c18-866f-e2a8da0465c5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:41.861581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10574ab2-21a3-4c18-866f-e2a8da0465c5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:42.055556 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-10574ab2-21a3-4c18-866f-e2a8da0465c5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.270720 Oct 17 15:53:42.060761 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2624/5491] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:41 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:53:42.410439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:42.426330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:42.430005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:42.438487 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7bc2de2-dfe7-4873-b957-f9822dab4aa1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.950462 Oct 17 15:53:42.456715 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2868/5492] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:41 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:43.079203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d245c21-e1f3-4f14-8054-11b07d8cbad8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:43.089751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d245c21-e1f3-4f14-8054-11b07d8cbad8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:43.105847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d245c21-e1f3-4f14-8054-11b07d8cbad8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:43.107224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d245c21-e1f3-4f14-8054-11b07d8cbad8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:43.108207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d245c21-e1f3-4f14-8054-11b07d8cbad8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:43.109965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d245c21-e1f3-4f14-8054-11b07d8cbad8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:43.111046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d245c21-e1f3-4f14-8054-11b07d8cbad8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:43.113012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d245c21-e1f3-4f14-8054-11b07d8cbad8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:43.285857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:43.296223 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d245c21-e1f3-4f14-8054-11b07d8cbad8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227044 Oct 17 15:53:43.322298 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2625/5493] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:43 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:43.476971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:43.478094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:43.513232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:43.516117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:43.520532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:43.524908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:43.526995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:43.530312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:43.712121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:43.748061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:43.758122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:43.771493 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d8393df-691b-4c66-b0a6-b761e683a73f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.298018 Oct 17 15:53:43.773624 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2869/5494] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:43 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:44.319034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-82d956b6-02d7-4a02-ae8a-eeb8aafc0f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:44.322318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-82d956b6-02d7-4a02-ae8a-eeb8aafc0f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:44.365586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:44.378565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d956b6-02d7-4a02-ae8a-eeb8aafc0f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:44.381147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d956b6-02d7-4a02-ae8a-eeb8aafc0f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:44.383340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d956b6-02d7-4a02-ae8a-eeb8aafc0f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:44.387524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d956b6-02d7-4a02-ae8a-eeb8aafc0f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:44.388662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d956b6-02d7-4a02-ae8a-eeb8aafc0f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:44.395617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-82d956b6-02d7-4a02-ae8a-eeb8aafc0f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:44.591522 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-82d956b6-02d7-4a02-ae8a-eeb8aafc0f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.279544 Oct 17 15:53:44.593072 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2626/5495] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:44 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:44.831924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:44.833492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:44.860634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:44.861364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:44.861955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:44.862906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:44.868939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:44.875435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:45.109415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:45.120770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:45.131451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:45.143222 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b9c9018-d0c1-405b-90e1-62aa4c893fda tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.322523 Oct 17 15:53:45.144485 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2870/5496] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:44 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:45.607087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-481f6eae-5ce3-46e1-8a6b-fe128075207b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:45.610268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-481f6eae-5ce3-46e1-8a6b-fe128075207b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:45.647982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481f6eae-5ce3-46e1-8a6b-fe128075207b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:45.648712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481f6eae-5ce3-46e1-8a6b-fe128075207b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:45.650196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481f6eae-5ce3-46e1-8a6b-fe128075207b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:45.651233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481f6eae-5ce3-46e1-8a6b-fe128075207b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:45.655342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481f6eae-5ce3-46e1-8a6b-fe128075207b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:45.656070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481f6eae-5ce3-46e1-8a6b-fe128075207b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:45.733703 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-481f6eae-5ce3-46e1-8a6b-fe128075207b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131607 Oct 17 15:53:45.742576 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2627/5497] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:45 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:53:46.191224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:46.192339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:46.212999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:46.213807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:46.216536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:46.217993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:46.218876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:46.219685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:46.240164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:53:46.554105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:46.579452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:46.585124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:46.592201 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83da3d5b-8c44-46e6-84e9-c8c4457e834e tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.407990 Oct 17 15:53:46.595531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2871/5498] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:46 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:46.746440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b97b9e2-f016-428c-9db6-3a7949d83b76 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:46.750952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b97b9e2-f016-428c-9db6-3a7949d83b76 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:46.771903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b97b9e2-f016-428c-9db6-3a7949d83b76 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:46.772578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b97b9e2-f016-428c-9db6-3a7949d83b76 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:46.773318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b97b9e2-f016-428c-9db6-3a7949d83b76 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:46.775477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b97b9e2-f016-428c-9db6-3a7949d83b76 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:46.777180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b97b9e2-f016-428c-9db6-3a7949d83b76 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:46.777993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b97b9e2-f016-428c-9db6-3a7949d83b76 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:46.882076 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b97b9e2-f016-428c-9db6-3a7949d83b76 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136565 Oct 17 15:53:46.889325 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2628/5499] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:46 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:47.625349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:47.628969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:47.648169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:47.648970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:47.651926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:47.652958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:47.655235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:47.656004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:47.837862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:47.852464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:47.856525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:47.858811 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b210599a-4b39-4c58-816a-90b9c4d01d98 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.238271 Oct 17 15:53:47.860239 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2872/5500] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:47 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:47.901616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f492a17d-cce5-4178-83f4-f935a25d78e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:47.905463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f492a17d-cce5-4178-83f4-f935a25d78e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:47.925541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f492a17d-cce5-4178-83f4-f935a25d78e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:47.926352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f492a17d-cce5-4178-83f4-f935a25d78e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:47.927013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f492a17d-cce5-4178-83f4-f935a25d78e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:47.937658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f492a17d-cce5-4178-83f4-f935a25d78e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:47.938358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f492a17d-cce5-4178-83f4-f935a25d78e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:47.943612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f492a17d-cce5-4178-83f4-f935a25d78e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:48.001594 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f492a17d-cce5-4178-83f4-f935a25d78e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108689 Oct 17 15:53:48.011175 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2629/5501] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:47 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:48.890939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:48.892341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:48.910770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:48.912224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:48.912967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:48.915770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:48.917535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:48.919451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:49.019519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6caf439f-10ed-4433-9e94-a5d6d9a3c20a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:49.023447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6caf439f-10ed-4433-9e94-a5d6d9a3c20a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:49.061629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caf439f-10ed-4433-9e94-a5d6d9a3c20a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:49.062441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caf439f-10ed-4433-9e94-a5d6d9a3c20a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:49.063239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caf439f-10ed-4433-9e94-a5d6d9a3c20a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:49.064439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caf439f-10ed-4433-9e94-a5d6d9a3c20a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:49.065246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caf439f-10ed-4433-9e94-a5d6d9a3c20a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:49.065964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caf439f-10ed-4433-9e94-a5d6d9a3c20a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:49.172494 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6caf439f-10ed-4433-9e94-a5d6d9a3c20a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160442 Oct 17 15:53:49.177738 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2630/5502] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:49 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:49.282616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:49.315349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:49.326023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:49.328899 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e0726808-56b1-49c8-b2d4-b5a4b03d578f tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.444163 Oct 17 15:53:49.332007 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2873/5503] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:48 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:50.190415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aff513bb-baed-4984-828e-1939b8b3cc3f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:50.203968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aff513bb-baed-4984-828e-1939b8b3cc3f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:50.275557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff513bb-baed-4984-828e-1939b8b3cc3f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:50.276343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff513bb-baed-4984-828e-1939b8b3cc3f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:50.283165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff513bb-baed-4984-828e-1939b8b3cc3f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:50.285120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff513bb-baed-4984-828e-1939b8b3cc3f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:50.289481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff513bb-baed-4984-828e-1939b8b3cc3f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:50.295572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff513bb-baed-4984-828e-1939b8b3cc3f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:50.376904 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aff513bb-baed-4984-828e-1939b8b3cc3f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.194464 Oct 17 15:53:50.378761 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2631/5504] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:53:50 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee/os-volume_attachments => generated 25 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:53:50.381887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:50.395089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:50.438694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:50.449877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:50.450971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:50.452205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:50.452951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:50.453705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:50.524477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:50.528153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:50.558617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:50.563592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:50.567039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:50.573042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:50.576714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:50.578917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:50.757785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:53:50.866541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:50.905731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:50.914557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:50.926428 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7343a517-ed58-49e7-82b8-f216f4f3fa01 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.548011 Oct 17 15:53:50.928639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2874/5505] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:50 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:53:51.128760 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-63e97093-d1f7-48dd-afc1-4d9eb89e0cd5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 204 len: 0 microversion: 2.1 time: 0.612470 Oct 17 15:53:51.135413 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2632/5506] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:53:50 2022] DELETE /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:53:51.145617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:51.157306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:51.213169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:51.223567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:51.225007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:51.230839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:51.237546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:51.241428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:51.985370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:51.986914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:52.003043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:52.006906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:52.008010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:52.010641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:52.011924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:52.012579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:52.015182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:52.037582 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a9f37abd-595b-4f99-a951-71b7fcb40d0d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1680 microversion: 2.1 time: 0.892578 Oct 17 15:53:52.038754 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2875/5507] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:51 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1680 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:53:52.287954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:52.299933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:52.307684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:52.313151 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9543d83b-47dd-482b-bc62-32e69c066421 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.332603 Oct 17 15:53:52.314861 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2633/5508] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:51 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:53.074698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:53.075791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:53.107485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:53.113915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:53.115950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:53.123540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:53.127988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:53.129592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:53.362834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:53.363597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:53.394903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:53.395580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:53.396255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:53.397159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:53.397770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:53.399177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:53.710092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:53.728418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:53.739773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:53.751992 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-699ac9b8-b0bb-4a92-9540-ce945cdb0f57 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.393863 Oct 17 15:53:53.756997 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2634/5509] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:53 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:53:54.604566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:54.618694 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1decbd35-296c-477e-be4c-780ca72bb4e4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1680 microversion: 2.1 time: 1.552585 Oct 17 15:53:54.640878 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2876/5510] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:53 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1680 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:53:54.790549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:54.791308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:54.824242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:54.825065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:54.825665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:54.828597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:54.830261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:54.833925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:55.186262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:55.206969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:55.214977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:55.221349 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-28076aeb-00b5-44ff-b547-2b76c30bae49 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.433698 Oct 17 15:53:55.237326 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2635/5511] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:54 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:53:55.650581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:55.651303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:55.673820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:55.674368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:55.674875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:55.684430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:55.685010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:55.685474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:56.263870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:56.271541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:56.313544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:56.314061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:56.314539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:56.315285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:56.315765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:56.316258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:56.702825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:56.724720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:56.728689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:56.731854 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba26b821-a1ea-43f5-88b7-b2fcb82c0205 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1407 microversion: 2.54 time: 0.474570 Oct 17 15:53:56.734258 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2636/5512] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:56 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:56.817105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:56.834411 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7448c58d-3752-4a0a-ada8-75c2eee5535e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1680 microversion: 2.1 time: 1.190997 Oct 17 15:53:56.841002 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2877/5513] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:55 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1680 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:53:57.768872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:57.770929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:57.794849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:57.795358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:57.795805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:57.796541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:57.812335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:57.815079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:57.868833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:57.869646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:57.905561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:57.906081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:57.907178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:57.907351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:57.922153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:57.922655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:58.293065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:58.352922 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b744afc-0f1b-466c-a0c2-f46a40e4842f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1612 microversion: 2.1 time: 0.488250 Oct 17 15:53:58.377496 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2878/5514] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:57 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1612 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:53:58.407307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:58.493917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:58.518271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:53:58.520620 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a693e10-a027-488e-b12a-301bc4c4fa96 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1413 microversion: 2.54 time: 0.757969 Oct 17 15:53:58.551698 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2637/5515] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:57 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1413 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:53:58.962940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b546e303-fe2e-467a-86a1-35f56c4e0004 req-aeefce67-78d5-481a-bf2e-8e9892d73bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f0e647-c24a-496d-ac11-6a9187931eee", "name": "network-vif-deleted", "tag": "77e125cd-110d-49fa-bcf8-1866d2ccafee"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:53:59.012374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b546e303-fe2e-467a-86a1-35f56c4e0004 req-aeefce67-78d5-481a-bf2e-8e9892d73bf7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:59.012817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b546e303-fe2e-467a-86a1-35f56c4e0004 req-aeefce67-78d5-481a-bf2e-8e9892d73bf7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:59.025380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b546e303-fe2e-467a-86a1-35f56c4e0004 req-aeefce67-78d5-481a-bf2e-8e9892d73bf7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:59.091431 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b546e303-fe2e-467a-86a1-35f56c4e0004 req-aeefce67-78d5-481a-bf2e-8e9892d73bf7 service nova] Creating event network-vif-deleted:77e125cd-110d-49fa-bcf8-1866d2ccafee for instance 48f0e647-c24a-496d-ac11-6a9187931eee on n-h2-854441-12 Oct 17 15:53:59.121611 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b546e303-fe2e-467a-86a1-35f56c4e0004 req-aeefce67-78d5-481a-bf2e-8e9892d73bf7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.741355 Oct 17 15:53:59.122831 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2879/5516] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:53:59.408228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:59.415885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:59.456508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:59.457421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:59.458191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:59.459597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:59.460511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:59.469978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:59.609079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:53:59.610423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:53:59.685677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:59.686589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:59.687390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:59.688764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:59.689630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:59.690266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:59.757578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:53:59.763023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:53:59.771653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:53:59.772963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lazy-loading 'fault' on Instance uuid 48f0e647-c24a-496d-ac11-6a9187931eee {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:54:00.093357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:00.124579 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb2f3278-075f-4fc9-98bb-44c81cca2baf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 200 len: 1330 microversion: 2.1 time: 0.724799 Oct 17 15:54:00.179758 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2638/5517] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:53:59 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 1330 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:54:00.334526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:00.371438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:00.392417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:00.394888 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6d0a7a9-a81c-4783-8753-5d81f1afa282 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1413 microversion: 2.54 time: 0.794137 Oct 17 15:54:00.415285 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2880/5518] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:53:59 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1413 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:01.183873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:01.185497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:01.205196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:01.206193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:01.206893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:01.209376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:01.210056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:01.212031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:01.268369 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee HTTP/1.1 Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '48f0e647-c24a-496d-ac11-6a9187931eee'} Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:54:01.276107 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:01.279479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:54:01.279479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:54:01.279479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:54:01.279479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:54:01.279479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:54:01.279479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:54:01.279479 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:01.279479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:54:01.279479 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c0e88d50-fc92-4b6d-a3cd-c30d83450b00 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 404 len: 111 microversion: 2.1 time: 0.098789 Oct 17 15:54:01.279938 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2639/5519] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:01 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:54:01.295089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16f9c013-d4d1-4804-b1ae-6151be878f1a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '.version_select at 0x7f28bd77b4c0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:01.391735 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16f9c013-d4d1-4804-b1ae-6151be878f1a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-166454863" status: 202 len: 0 microversion: 2.1 time: 0.105893 Oct 17 15:54:01.393659 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2881/5520] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:54:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-166454863 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:54:01.462008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:01.462937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:01.493156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:01.493932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:01.502862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:01.503918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:01.504566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:01.505249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:01.882381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:01.923332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:01.932343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:01.937427 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-48a9c1d5-10c1-4bfb-acfc-15695d7ae343 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1398 microversion: 2.54 time: 0.479331 Oct 17 15:54:01.943223 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2640/5521] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:01 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1398 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:01.974090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f8733e3d-b38d-46e4-b476-4c7aeedec1ab tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '.version_select at 0x7f28bd7d9280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:02.047367 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f8733e3d-b38d-46e4-b476-4c7aeedec1ab tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-950250554" status: 204 len: 0 microversion: 2.54 time: 0.077342 Oct 17 15:54:02.048003 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2882/5522] 10.222.0.87 () {60 vars in 1316 bytes} [Mon Oct 17 15:54:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-950250554 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:54:02.072944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:02.083470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:02.112056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:02.113890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:02.115052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:02.120585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:02.121659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:02.123938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:02.144426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:02.277644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:54:02.615669 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-59625844-2bc1-4361-9c16-0d9bcc2c863c tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 204 len: 0 microversion: 2.54 time: 0.554807 Oct 17 15:54:02.620181 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2641/5523] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:54:02 2022] DELETE /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:54:02.629155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:02.629948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:02.659579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:02.667127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:02.667732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:02.668522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:02.669012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:02.677416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:03.150832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:03.197037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:03.211994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:03.214783 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8293efb9-bd32-4d12-9430-6fccb0957c32 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1404 microversion: 2.54 time: 0.589611 Oct 17 15:54:03.219732 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2883/5524] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:02 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1404 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:04.260317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:04.277993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:04.335555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:04.336422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:04.337181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:04.338412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:04.339193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:04.339959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:05.275269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:05.316779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:05.340364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:05.343023 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-213a8326-8981-43d2-b046-c2932256a8be tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1404 microversion: 2.54 time: 1.096174 Oct 17 15:54:05.354141 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2642/5525] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:04 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1404 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:06.392153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:06.402324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:06.445252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:06.450220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:06.451497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:06.462183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:06.463747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:06.470263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:06.722749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:06.730675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:06.741480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:06.745771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lazy-loading 'fault' on Instance uuid ec9b8e2f-d355-4ce8-b168-31a86ba2de1a {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:54:07.050286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:07.099211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:07.104836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b55fe937db14802b4d7174a28cf66b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07d425253054dffaa746f843414c80d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:07.110265 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-453095ec-4140-4eb8-bff2-f9a2b78a7ee1 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 200 len: 1409 microversion: 2.54 time: 0.735852 Oct 17 15:54:07.122841 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2884/5526] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:06 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 1409 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:08.172135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:08.189689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] [instance: ec9b8e2f-d355-4ce8-b168-31a86ba2de1a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:08.234560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:08.241465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:08.243529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:08.243529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:08.246561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:08.246561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:08.388519 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] HTTP exception thrown: Instance ec9b8e2f-d355-4ce8-b168-31a86ba2de1a could not be found. Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Request method failure captured: Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a HTTP/1.1 Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXpvpzV182sdlKYfUM15Sb_v8JXgiTBmhWv5qtwhPWRdBzlf5ddTFLoq813r4Qu2j7Hktnbr41NLIrfbuIzXuV9FE2XoCRnz15KQg6xy5ZBun4bjPfJPc6rb-RNFJ_cIbYAXXMD6IzdHkwbzImgxClXzYI3S6JJeIi0SBVKdmY6_WEI Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.54 Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b07d425253054dffaa746f843414c80d Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerShowV254Test-1781560639 Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b07d425253054dffaa746f843414c80d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b07d425253054dffaa746f843414c80d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b07d425253054dffaa746f843414c80d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b07d425253054dffaa746f843414c80d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerShowV254Test-1781560639 Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b07d425253054dffaa746f843414c80d Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerShowV254Test-1781560639 Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerShowV254Test-1781560639-project Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 2b55fe937db14802b4d7174a28cf66b2 Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerShowV254Test-1781560639-project Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ec9b8e2f-d355-4ce8-b168-31a86ba2de1a could not be found. Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ec9b8e2f-d355-4ce8-b168-31a86ba2de1a'} Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9b8e2f-d355-4ce8-b168-31a86ba2de1a could not be found. Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9b8e2f-d355-4ce8-b168-31a86ba2de1a could not be found. Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:54:08.396770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:08.401040 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:54:08.401040 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:54:08.401040 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:54:08.401040 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:54:08.401040 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:54:08.401040 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9b8e2f-d355-4ce8-b168-31a86ba2de1a could not be found. Oct 17 15:54:08.401040 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:54:08.401040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] Returning 404 to user: Instance ec9b8e2f-d355-4ce8-b168-31a86ba2de1a could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:54:08.402288 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc33e352-a393-4a4f-ad0e-a1c388341320 tempest-ServerShowV254Test-1781560639 tempest-ServerShowV254Test-1781560639-project] 10.222.0.87 "GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a" status: 404 len: 111 microversion: 2.54 time: 0.261028 Oct 17 15:54:08.403395 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2643/5527] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:08 2022] GET /compute/v2.1/servers/ec9b8e2f-d355-4ce8-b168-31a86ba2de1a => generated 111 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 15:54:08.948349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc976ee5-37e8-4bf3-b0f7-1bd51551974e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: .version_select at 0x7f28bdc641f0>, body: {"keypair": {"name": "tempest-keypair-45740877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrm8jbqdfDdOVY+HIENaamhT1sJNWoXmWq623FIsGFVg24/bgLZUM0hvA0/NRcv1wPYvZzOmdyJtso0JHlccNI6EeYjSyfrmoZKf4Vl1gEmKh5cBL3qIJvpFdCHJKHwwg=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:54:09.010359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fc976ee5-37e8-4bf3-b0f7-1bd51551974e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for project 95e7c17929974c669051e99792e83d40. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:54:09.027198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-fc976ee5-37e8-4bf3-b0f7-1bd51551974e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for user 98d8f0d40fd0472e8ffc58d09811c4cc and project 95e7c17929974c669051e99792e83d40. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:54:09.176182 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc976ee5-37e8-4bf3-b0f7-1bd51551974e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.270971 Oct 17 15:54:09.203801 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2885/5528] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:54:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:54:18.233998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:18.388957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:18.962638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-676741729", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": "none"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:54:19.132067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:54:19.134858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:54:19.134858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:54:19.134858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:54:19.134858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:54:19.148458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:19.148956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:19.149385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:19.150364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:19.151142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:19.153054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:19.192439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Getting quotas for project e7a7049b52e94b2a95c1dd3ec2a58508. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:54:19.199996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Getting quotas for user 48c278a4b3954b11b83f4fc73dd3b483 and project e7a7049b52e94b2a95c1dd3ec2a58508. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:54:19.232221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1099505170", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "610043dc-4af1-4887-b876-94edd1ec11a6"}], "security_groups": [{"name": "tempest-securitygroup--1389848234"}], "key_name": "tempest-keypair-45740877", "user_data": "}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:54:19.236048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:54:19.242411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:54:19.364405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=69 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:19.365550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:19.366966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:19.400009 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed79dedd-1b4b-400d-ac12-d3e10edb232b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.289639 Oct 17 15:54:19.408943 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2644/5529] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:54:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 15:54:19.435095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-086e50f4-f6c3-4091-8f36-dfa028a80807 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:19.435740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-086e50f4-f6c3-4091-8f36-dfa028a80807 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:19.753812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-086e50f4-f6c3-4091-8f36-dfa028a80807 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:19.772201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-086e50f4-f6c3-4091-8f36-dfa028a80807 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:19.776670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-086e50f4-f6c3-4091-8f36-dfa028a80807 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:19.781034 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-086e50f4-f6c3-4091-8f36-dfa028a80807 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1277 microversion: 2.57 time: 0.363942 Oct 17 15:54:19.786312 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2645/5530] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:19 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1277 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:19.952746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] validate_networks() for [('610043dc-4af1-4887-b876-94edd1ec11a6', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:54:20.821022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-029e6452-286e-4e2f-8abb-ddff8c83412f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:20.821990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-029e6452-286e-4e2f-8abb-ddff8c83412f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:21.064380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-029e6452-286e-4e2f-8abb-ddff8c83412f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:21.139470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-029e6452-286e-4e2f-8abb-ddff8c83412f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:21.182673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-029e6452-286e-4e2f-8abb-ddff8c83412f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:21.196515 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-029e6452-286e-4e2f-8abb-ddff8c83412f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1277 microversion: 2.57 time: 0.376486 Oct 17 15:54:21.199037 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2646/5531] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:20 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1277 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:22.241205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:22.241839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:22.276605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:22.277107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:22.283988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:22.285230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:22.294876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:22.296487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:22.508877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:22.528233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:22.534941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:22.536427 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad6a2a32-a233-4eee-8691-863abb6f0f6d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1329 microversion: 2.57 time: 0.299458 Oct 17 15:54:22.542911 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2647/5532] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:22 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1329 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:22.659053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:54:22.660136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:54:22.660860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:54:22.661509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:54:22.662141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:54:22.694957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:22.696644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:22.697583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:22.700348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:22.702790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:22.705538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:22.761301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for project 95e7c17929974c669051e99792e83d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:54:22.784266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for user 98d8f0d40fd0472e8ffc58d09811c4cc and project 95e7c17929974c669051e99792e83d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:54:22.820247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:54:22.823513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:54:23.011760 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c44746dd-8779-4504-9726-ceacb4628439 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.791200 Oct 17 15:54:23.023786 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2886/5533] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:54:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 3799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:54:23.030096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-508d5997-5e8b-4848-87d7-6645a3b96b62 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:23.030991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-508d5997-5e8b-4848-87d7-6645a3b96b62 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:23.256817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-508d5997-5e8b-4848-87d7-6645a3b96b62 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:23.271645 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-508d5997-5e8b-4848-87d7-6645a3b96b62 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1240 microversion: 2.1 time: 0.245877 Oct 17 15:54:23.273676 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2648/5534] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:23 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1240 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:54:23.572495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:23.573474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:23.592209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:23.596441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:23.599790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:23.606228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:23.607203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:23.611746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:23.835371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:23.850816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:23.855893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:23.858169 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-caee8e85-aefb-41a2-8e65-a8c33f7522f6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1335 microversion: 2.57 time: 0.292078 Oct 17 15:54:23.861581 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2887/5535] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:23 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1335 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:24.317652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-88e7f8d2-60fb-4e85-8c48-9a06aa212cfa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:24.318883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-88e7f8d2-60fb-4e85-8c48-9a06aa212cfa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:24.822002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88e7f8d2-60fb-4e85-8c48-9a06aa212cfa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:24.844648 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-88e7f8d2-60fb-4e85-8c48-9a06aa212cfa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1240 microversion: 2.1 time: 0.536377 Oct 17 15:54:24.847319 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2649/5536] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:24 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1240 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:54:24.902103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:24.909167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:24.951516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:24.956419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:24.960273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:24.965601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:24.970252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:24.974170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:25.308906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:25.327869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:25.331080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:25.332645 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c34583f-b8ee-4773-81a9-0ec3a86e3e18 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1335 microversion: 2.57 time: 0.442830 Oct 17 15:54:25.355345 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2888/5537] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:24 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1335 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:25.875923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:25.877221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:25.901963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:25.904501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:25.905014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:25.907540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:25.908752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:25.909225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:26.361736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:26.362382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:26.378468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:26.379056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:26.379693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:26.380527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:26.381008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:26.381509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:26.848208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:26.861715 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7d445a56-2d0a-4b76-a480-b082675a6672 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1292 microversion: 2.1 time: 0.991127 Oct 17 15:54:26.863208 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2650/5538] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:25 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1292 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:54:26.959754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:26.974421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:26.981165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:26.989002 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8acb356d-82c7-4ed5-a6d0-9a1bfd4be9a9 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1356 microversion: 2.57 time: 0.625164 Oct 17 15:54:26.993952 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2889/5539] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:26 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1356 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:27.023078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:54:27.027616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:27.036583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:27.037400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:27.038008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:27.040404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:27.041089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:27.041950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:27.209305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:54:27.209772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:54:27.212499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:54:27.215733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:54:27.217056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:54:27.356541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:27.381628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:27.385510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:27.388589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:27.389749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:27.394567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:27.395885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:27.509694 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-46af3b35-9a99-464b-9535-595b0af4d0d4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "POST /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e/action" status: 202 len: 1137 microversion: 2.57 time: 0.487351 Oct 17 15:54:27.513526 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2651/5540] 10.222.0.87 () {62 vars in 1320 bytes} [Mon Oct 17 15:54:27 2022] POST /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e/action => generated 1137 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 15:54:27.602030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:27.605006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:27.654900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:27.655405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:27.655846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:27.656570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:27.657029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:27.657456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:27.908527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:27.914333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:27.956660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:27.960633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:27.963495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:27.974652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:27.979848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:27.981095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:28.532615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:28.552252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:28.576989 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-03d4a273-4d12-432e-be04-514cbaf9aeb1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1298 microversion: 2.1 time: 0.694552 Oct 17 15:54:28.577980 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2652/5541] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:27 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1298 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:54:28.586927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:28.615402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:28.632517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb374913-97c9-4acd-b1d3-5129f58c7576 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 1.060674 Oct 17 15:54:28.634129 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2890/5542] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:27 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:29.621556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:29.622381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:29.639314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:29.641710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:29.642169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:29.650847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:29.651522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:29.653696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:29.654141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:29.669584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:29.676725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:29.705215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:29.706299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:29.707278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:29.708839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:29.709847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:29.710819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:30.271971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:30.301852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:30.314762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:30.328213 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d99f81d7-87ae-4bab-905d-ea5cb2dbe964 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.665766 Oct 17 15:54:30.330202 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2891/5543] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:29 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:30.543383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:30.556179 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1fe22c17-618e-423a-a2c2-b0e7510075b5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1298 microversion: 2.1 time: 0.935303 Oct 17 15:54:30.556854 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2653/5544] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:29 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1298 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:54:31.366155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:31.368277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:31.434756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:31.436276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:31.445410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:31.449928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:31.452148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:31.476043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:31.605660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:31.606855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:31.682542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:31.703703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:31.704561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:31.728742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:31.729653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:31.730405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:32.352845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:32.385877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:32.392612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:32.395693 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4058436a-ec11-4072-945d-04d91a785a5e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 1.037155 Oct 17 15:54:32.400314 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2892/5545] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:31 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:33.286970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:33.322399 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a32137e9-de9b-4ac6-9430-727eb2e92a07 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1366 microversion: 2.1 time: 1.724777 Oct 17 15:54:33.326938 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2654/5546] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:31 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1366 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:54:33.429365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:33.434840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:33.445493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:33.447208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:33.476206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:33.477542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:33.480854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:33.483023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:33.487250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:33.488528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:33.767721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5a4f416d-5e66-4324-8675-ce9c971810f2 req-5a0d96d5-7b6a-4281-ae62-99e645441e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e7dd4ba-982a-4677-93b2-fcd9597d2508", "tag": "6bfc86e7-ea78-4ccd-9b36-3cad7a70f54b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:54:33.818447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5a4f416d-5e66-4324-8675-ce9c971810f2 req-5a0d96d5-7b6a-4281-ae62-99e645441e82 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:33.822108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5a4f416d-5e66-4324-8675-ce9c971810f2 req-5a0d96d5-7b6a-4281-ae62-99e645441e82 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:33.824299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5a4f416d-5e66-4324-8675-ce9c971810f2 req-5a0d96d5-7b6a-4281-ae62-99e645441e82 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:33.877185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5a4f416d-5e66-4324-8675-ce9c971810f2 req-5a0d96d5-7b6a-4281-ae62-99e645441e82 service nova] Creating event network-changed:6bfc86e7-ea78-4ccd-9b36-3cad7a70f54b for instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 on n-h2-854441-12 Oct 17 15:54:33.903098 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5a4f416d-5e66-4324-8675-ce9c971810f2 req-5a0d96d5-7b6a-4281-ae62-99e645441e82 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143021 Oct 17 15:54:33.905953 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2655/5547] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:54:33.925101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:33.963752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:33.971614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:33.979428 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c16cd69e-a2fa-4640-932d-e15e5e3e6ba5 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.555028 Oct 17 15:54:33.983438 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2893/5548] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:33 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:34.369789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:34.371156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:34.415806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:34.420906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:34.422206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:34.433745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:34.434643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:34.435431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:34.842626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=14 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:35.020140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:35.026709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:35.060398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:35.061246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:35.062026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:35.077571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:35.078315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:35.079139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:35.496702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:35.553462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:35.556212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:35.567013 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6136878-b137-40c8-8d1e-9d4c4d23e223 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.552187 Oct 17 15:54:35.569067 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2894/5549] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:35 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:36.036281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:36.063664 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f2f8d532-3eba-49bf-a75d-625a78421ee5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1366 microversion: 2.1 time: 1.702176 Oct 17 15:54:36.081225 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2656/5550] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:34 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1366 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:54:36.601829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:36.603269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:36.628129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:36.632193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:36.634528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:36.639876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:36.641054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:36.642575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:37.013902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:37.040956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:37.052048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:37.062831 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66acb9e8-d2f9-41a2-9a1d-440969571d1e tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.463741 Oct 17 15:54:37.075129 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2895/5551] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:36 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:37.088936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:37.091442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:37.111831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:37.113663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:37.117482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:37.118525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:37.119161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:37.119786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:37.578025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:37.615204 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7bed3172-4bb0-4a7a-83b4-e5f098c3d1a8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1366 microversion: 2.1 time: 0.530667 Oct 17 15:54:37.617311 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2657/5552] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:37 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:54:38.103122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:38.109222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:38.136308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:38.146472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:38.148505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:38.150616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:38.156829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:38.158633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:38.518853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:38.555665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:38.564439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:38.567623 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aeabb47d-4335-4073-859f-2f75af208860 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.473231 Oct 17 15:54:38.573473 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2896/5553] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:38 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:38.648610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:38.650995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:38.686888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:38.687446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:38.687901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:38.688642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:38.691753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:38.692860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:39.612782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:39.614610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:39.632075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:39.633128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:39.633875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:39.649973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:39.654924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:39.656008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:40.139116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:40.208965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:40.212118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:40.232971 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25635ef0-77cb-49fe-9cf9-4abf8ad5c67d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.631801 Oct 17 15:54:40.240042 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2897/5554] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:39 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:40.545454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:40.572454 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee92513a-bfac-45bd-92de-df6d1db1d4bf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1366 microversion: 2.1 time: 1.934921 Oct 17 15:54:40.617030 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2658/5555] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:38 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1366 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:54:41.278887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:41.286931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:41.320235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:41.323271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:41.325746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:41.331009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:41.333856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:41.338188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:41.609826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:41.610492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:41.638061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:41.638545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:41.639371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:41.639778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:41.646190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:41.649113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:41.869210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:41.895118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:41.904512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:41.907966 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8cf4f8ed-3449-4cad-8454-1ae099d7b553 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.637754 Oct 17 15:54:41.911300 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2898/5556] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:41 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:42.959101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:42.960686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:42.974385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:42.975309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:42.976107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:42.977296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:42.978295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:42.980386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:43.194552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:43.248905 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cbff2965-66c5-4777-8a8f-e9902679bfc5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1366 microversion: 2.1 time: 1.643081 Oct 17 15:54:43.259465 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2659/5557] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:41 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1366 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:54:43.301140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:43.324741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:43.327713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:43.330828 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c93e5b6-46ac-4ba2-b880-303d93f280e3 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.376603 Oct 17 15:54:43.337128 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2899/5558] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:42 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:44.273467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:44.274939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:44.287724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:44.292706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:44.293476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:44.299554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:44.300992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:44.301650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:44.386764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:44.387563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:44.401475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:44.403549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:44.404184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:44.407186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:44.410645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:44.411582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:44.579102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:44.611824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:44.614460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:44.620105 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a47ccd7-c645-4f81-9e75-4a1b443183a0 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.237777 Oct 17 15:54:44.626372 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2900/5559] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:44 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:45.214265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:45.269365 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef220f79-8162-4adb-96b6-18b6bb1d1ad0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1366 microversion: 2.1 time: 1.000865 Oct 17 15:54:45.272553 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2660/5560] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:44 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1366 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:54:45.679442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:45.680168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:45.704599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:45.708743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:45.709537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:45.710486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:45.711150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:45.712591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:45.918006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:45.954731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:45.956480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:45.958212 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ec9c27d-92dd-4279-abc5-0189c07ae80f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.287932 Oct 17 15:54:45.958897 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2901/5561] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:45 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:46.300079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:46.300787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:46.313278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:46.313788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:46.314378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:46.315277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:46.315833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:46.316476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:46.715819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:46.727313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b436981c-01dc-48c4-a0d6-3f9ad05530cc req-2a390db3-43ce-4616-9cde-affbbcae3e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7dd4ba-982a-4677-93b2-fcd9597d2508", "name": "network-vif-plugged", "status": "completed", "tag": "6bfc86e7-ea78-4ccd-9b36-3cad7a70f54b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:54:46.757153 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c274dec-03f5-4719-a990-33fde8bae24e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1366 microversion: 2.1 time: 0.461380 Oct 17 15:54:46.760410 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2902/5562] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:46 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1366 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:54:46.763285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b436981c-01dc-48c4-a0d6-3f9ad05530cc req-2a390db3-43ce-4616-9cde-affbbcae3e40 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:46.764024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b436981c-01dc-48c4-a0d6-3f9ad05530cc req-2a390db3-43ce-4616-9cde-affbbcae3e40 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:46.764614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b436981c-01dc-48c4-a0d6-3f9ad05530cc req-2a390db3-43ce-4616-9cde-affbbcae3e40 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:46.779111 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b436981c-01dc-48c4-a0d6-3f9ad05530cc req-2a390db3-43ce-4616-9cde-affbbcae3e40 service nova] Creating event network-vif-plugged:6bfc86e7-ea78-4ccd-9b36-3cad7a70f54b for instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 on n-h2-854441-12 Oct 17 15:54:46.797289 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b436981c-01dc-48c4-a0d6-3f9ad05530cc req-2a390db3-43ce-4616-9cde-affbbcae3e40 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.514760 Oct 17 15:54:46.798302 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2661/5563] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:54:47.002188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:47.002894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:47.026876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:47.027768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:47.028638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:47.033271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:47.037340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:47.038122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:47.122528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:47.203628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:47.215923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:47.217462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:47.218896 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a45729f-b86c-40ea-a9e8-dd60d4861a97 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.221488 Oct 17 15:54:47.219492 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2903/5564] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:46 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:47.782418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:47.783194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:47.798919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:47.799669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:47.800379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:47.804798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:47.805455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:47.806043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:48.247515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:48.248240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:48.265504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:48.266006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:48.266446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:48.267199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:48.267652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:48.268078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:48.400572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:48.410025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:48.412219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:48.421027 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92705f39-d628-410b-9c5a-e5b7a5e2cd9f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.177531 Oct 17 15:54:48.422178 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2904/5565] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:48 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:48.798806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:48.810962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:48.826993 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e7712bd-61b3-44cb-b193-bb9b2a9480a2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1366 microversion: 2.1 time: 1.037069 Oct 17 15:54:48.828303 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2662/5566] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:47 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1366 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:54:49.456777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:49.457402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:49.470467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:49.472522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:49.473390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:49.478575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:49.479919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:49.480641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:49.481295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:49.879466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:49.880503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:49.894445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:54:49.960027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:49.960889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:49.961651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:49.988732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:49.989709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:49.990872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:49.992859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:50.035813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:50.044636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:50.047567 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50c3d641-4d75-42e7-bddd-cb5eb6660091 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.594823 Oct 17 15:54:50.055887 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2905/5567] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:49 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:51.064204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:51.104090 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-43c47c87-6f00-4153-ab86-8e6a75a7f6fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1556 microversion: 2.1 time: 1.232048 Oct 17 15:54:51.111843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:51.114050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:51.123409 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2663/5568] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:54:49 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1556 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:54:51.139169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:51.142777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:51.143891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:51.148060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:51.158679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:51.160282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:51.161592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ede07737-7e10-44a5-b82d-107becab100b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:51.162699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ede07737-7e10-44a5-b82d-107becab100b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:51.204248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ede07737-7e10-44a5-b82d-107becab100b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:51.205056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ede07737-7e10-44a5-b82d-107becab100b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:51.205752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ede07737-7e10-44a5-b82d-107becab100b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:51.216308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ede07737-7e10-44a5-b82d-107becab100b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:51.222404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ede07737-7e10-44a5-b82d-107becab100b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:51.223266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ede07737-7e10-44a5-b82d-107becab100b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:51.623331 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ede07737-7e10-44a5-b82d-107becab100b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.468750 Oct 17 15:54:51.624812 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2664/5569] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:54:51 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-interface => generated 285 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:54:51.824465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:51.852670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:51.873420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:51.884536 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0aa66b6c-d62f-4e7d-b480-547aabdf4c32 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 0.780787 Oct 17 15:54:51.885490 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2906/5570] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:51 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:52.937276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:52.940384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:52.975218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:52.982425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:52.988208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:52.989755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:52.991478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:52.992709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:54.074203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:54.113655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:54.134530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:54.143226 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b67221b3-26f5-494f-8261-bfc567844911 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1365 microversion: 2.57 time: 1.213961 Oct 17 15:54:54.152297 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2665/5571] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:52 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1365 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:55.195817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:55.196538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:55.211769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:55.212447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:55.212899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:55.213629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:55.214096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:55.214544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:55.747091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:55.797931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:55.816426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:55.818011 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6fbd7cc8-b8d3-45a9-b53e-1505e9ad56c6 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1371 microversion: 2.57 time: 0.626665 Oct 17 15:54:55.842579 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2907/5572] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:55 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1371 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:56.883815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:56.890689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:56.907407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:56.907901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:56.916755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:56.919567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:56.924818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:56.926469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:57.076578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:57.092254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:57.094333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:57.097113 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b77f8fee-ac1b-4ac2-9dbd-0ba1b141344f tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1371 microversion: 2.57 time: 0.218885 Oct 17 15:54:57.101255 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2666/5573] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:56 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:54:57.785694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-62325e83-6964-4a8b-abc7-053ea1ffdd9f req-e0a5c8f6-424a-49d4-a2ef-2723bc9ee224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e7dd4ba-982a-4677-93b2-fcd9597d2508", "tag": "6bfc86e7-ea78-4ccd-9b36-3cad7a70f54b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:54:57.814627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-62325e83-6964-4a8b-abc7-053ea1ffdd9f req-e0a5c8f6-424a-49d4-a2ef-2723bc9ee224 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:57.816679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-62325e83-6964-4a8b-abc7-053ea1ffdd9f req-e0a5c8f6-424a-49d4-a2ef-2723bc9ee224 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:57.818547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-62325e83-6964-4a8b-abc7-053ea1ffdd9f req-e0a5c8f6-424a-49d4-a2ef-2723bc9ee224 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:57.855307 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-62325e83-6964-4a8b-abc7-053ea1ffdd9f req-e0a5c8f6-424a-49d4-a2ef-2723bc9ee224 service nova] Creating event network-changed:6bfc86e7-ea78-4ccd-9b36-3cad7a70f54b for instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 on n-h2-854441-12 Oct 17 15:54:57.866361 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-62325e83-6964-4a8b-abc7-053ea1ffdd9f req-e0a5c8f6-424a-49d4-a2ef-2723bc9ee224 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.760465 Oct 17 15:54:57.871212 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2908/5574] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:54:58.141505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:58.142467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:58.159790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:58.160836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:58.161357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:58.162389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:58.163050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:58.163480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:59.257778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:59.268623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:59.274268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:59.279773 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-707d85b3-1d80-4b27-ad86-6a1207243e5b tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1356 microversion: 2.57 time: 1.142177 Oct 17 15:54:59.280867 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2667/5575] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:58 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1356 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:54:59.357785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:59.358560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:59.386477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:59.387133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:59.387665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:59.388656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:59.389384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:59.390030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:59.421826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:54:59.569122 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ba8f25a5-42f1-490e-a9fc-39d08d351f5d tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "DELETE /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 204 len: 0 microversion: 2.57 time: 0.207364 Oct 17 15:54:59.572548 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2909/5576] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:54:59 2022] DELETE /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 15:54:59.582262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:54:59.583345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:54:59.605601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:59.615085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:59.616194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:59.623615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:54:59.625432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:54:59.626520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:54:59.888607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:59.910101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:59.912001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:54:59.913519 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d177f519-1a39-4282-a07e-6003e772c578 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1362 microversion: 2.57 time: 0.335748 Oct 17 15:54:59.914363 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2668/5577] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:54:59 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:55:00.948824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:00.949545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:01.016863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:01.028093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:01.030475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:01.031448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:01.039223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:01.040171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:01.590561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:01.600123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:01.613511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:01.614901 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2f1fe01-3f55-45d1-8298-096611d244a1 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1362 microversion: 2.57 time: 0.675803 Oct 17 15:55:01.622193 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2910/5578] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:00 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:55:02.676130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:02.677563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:02.703094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:02.706867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:02.707972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:02.709168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:02.719664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:02.722761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:02.897915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:02.907915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:02.909871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:02.911036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lazy-loading 'fault' on Instance uuid fac10894-2fd0-4af1-9982-349e2728363e {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:55:03.218187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:03.237634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:03.239780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48c278a4b3954b11b83f4fc73dd3b483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a7049b52e94b2a95c1dd3ec2a58508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:03.267574 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 200 len: 1367 microversion: 2.57 time: 0.599454 Oct 17 15:55:03.277099 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2669/5579] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:02 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:55:04.305409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:04.308845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] [instance: fac10894-2fd0-4af1-9982-349e2728363e] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:04.325262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:04.330139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:04.331061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:04.332064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:04.332778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:04.333480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:04.373589 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] HTTP exception thrown: Instance fac10894-2fd0-4af1-9982-349e2728363e could not be found. Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Request method failure captured: Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e HTTP/1.1 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXqp5RtrCQCCimK2ZT58Zy80ih65ksLhOE3YiSnFIbecWX8WEV8BR4GuM-0EljH00CVYJsU3gktjsvhXCO7JgHn1PVkmwpzAyjsabemjCyELKBj5Vx-ptwUAd4TvRHFk4k8II9A3vi6Nd7il6NjAeJHiOimCQXPmeiQbmIUm5w9Y1YQ Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.57 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: e7a7049b52e94b2a95c1dd3ec2a58508 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerShowV257Test-37077899 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e7a7049b52e94b2a95c1dd3ec2a58508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e7a7049b52e94b2a95c1dd3ec2a58508"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e7a7049b52e94b2a95c1dd3ec2a58508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e7a7049b52e94b2a95c1dd3ec2a58508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerShowV257Test-37077899 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: e7a7049b52e94b2a95c1dd3ec2a58508 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerShowV257Test-37077899 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerShowV257Test-37077899-project Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 48c278a4b3954b11b83f4fc73dd3b483 Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerShowV257Test-37077899-project Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance fac10894-2fd0-4af1-9982-349e2728363e could not be found. Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'fac10894-2fd0-4af1-9982-349e2728363e'} Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac10894-2fd0-4af1-9982-349e2728363e could not be found. Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac10894-2fd0-4af1-9982-349e2728363e could not be found. Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:55:04.377380 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:55:04.385201 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:55:04.385201 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:55:04.385201 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:55:04.385201 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:55:04.385201 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:55:04.385201 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac10894-2fd0-4af1-9982-349e2728363e could not be found. Oct 17 15:55:04.385201 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:55:04.387720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Returning 404 to user: Instance fac10894-2fd0-4af1-9982-349e2728363e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:55:04.394335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60acdbf9-a5dc-42d8-8945-6c5c151fb195 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e" status: 404 len: 111 microversion: 2.57 time: 0.095692 Oct 17 15:55:04.398367 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2911/5580] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:04 2022] GET /compute/v2.1/servers/fac10894-2fd0-4af1-9982-349e2728363e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:55:10.908640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:10.911093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c2d81e6-c4b7-4e4f-aefe-8525a5e4fdc4 tempest-ServerShowV257Test-37077899 tempest-ServerShowV257Test-37077899-project] 10.222.0.87 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002607 Oct 17 15:55:10.911699 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2670/5581] 10.222.0.87 () {56 vars in 886 bytes} [Mon Oct 17 15:55:10 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 15:55:26.711386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:55:26.713923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:55:27.759599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-844c8d76-ab6e-45c2-9c06-83db28c40af2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:27.760340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-844c8d76-ab6e-45c2-9c06-83db28c40af2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:27.799718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-844c8d76-ab6e-45c2-9c06-83db28c40af2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:27.800242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-844c8d76-ab6e-45c2-9c06-83db28c40af2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:27.800925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-844c8d76-ab6e-45c2-9c06-83db28c40af2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:27.802102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-844c8d76-ab6e-45c2-9c06-83db28c40af2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:27.802873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-844c8d76-ab6e-45c2-9c06-83db28c40af2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:27.813044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-844c8d76-ab6e-45c2-9c06-83db28c40af2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:27.916225 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-844c8d76-ab6e-45c2-9c06-83db28c40af2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/ips" status: 200 len: 150 microversion: 2.1 time: 1.225456 Oct 17 15:55:27.935308 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2912/5582] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:55:26 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/ips => generated 150 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:55:33.557889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-be702dde-cfd2-48e7-837d-bd14f3a420f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54eab9db-3fd5-4b18-9f70-f467337a87d5"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:55:33.562791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-be702dde-cfd2-48e7-837d-bd14f3a420f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:33.593637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=15 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:55:33.594414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=43 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:55:33.622113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be702dde-cfd2-48e7-837d-bd14f3a420f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:33.622645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be702dde-cfd2-48e7-837d-bd14f3a420f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:33.623090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be702dde-cfd2-48e7-837d-bd14f3a420f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:33.624172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be702dde-cfd2-48e7-837d-bd14f3a420f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:33.624636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be702dde-cfd2-48e7-837d-bd14f3a420f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:33.625067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be702dde-cfd2-48e7-837d-bd14f3a420f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:34.245392 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-be702dde-cfd2-48e7-837d-bd14f3a420f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691681 Oct 17 15:55:34.246092 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2671/5583] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:55:33 2022] POST /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:55:38.034337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-569c0ba3-239e-49f2-a96b-edc16094c2f6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Action: 'create', calling method: .version_select at 0x7f28bd83cdc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-639089191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTExy+sU9yi2yZdiRMhbptEQubgrrHa4X2TElojZGYytV9PjLSaqR6lp2y6o0lSoUva8r1XZmI/FxvczEZ07Sak1sHJYAk8CgwDdH5aFMVwCPcvCzAWM/0bLJxHvB1Vxw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:55:38.094436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:55:38.095903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:55:38.160437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-569c0ba3-239e-49f2-a96b-edc16094c2f6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for project 15545d0f177d4dcab629c37feb5a6328. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:55:38.188351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-569c0ba3-239e-49f2-a96b-edc16094c2f6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for user b6684e87890f4ba5af7adb91145e4d4f and project 15545d0f177d4dcab629c37feb5a6328. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:55:38.273665 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-569c0ba3-239e-49f2-a96b-edc16094c2f6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.246468 Oct 17 15:55:38.274601 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2913/5584] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:55:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:55:39.859268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1063769521", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "cae92ad1-42b8-4d4f-844a-45971fda5c6d"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:55:40.017506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] validate_networks() for [('cae92ad1-42b8-4d4f-844a-45971fda5c6d', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:55:43.975251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:55:43.975251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:55:43.975251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:55:43.975251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:55:43.975251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:55:44.030038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:44.033460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:44.035557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:44.036461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:44.036953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:44.066650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:44.170222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Getting quotas for project 16b57b38701345e1961d074f1e871781. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:55:44.186414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Getting quotas for user 72f2642cb16e44419658ab1b578293f9 and project 16b57b38701345e1961d074f1e871781. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:55:44.237301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:55:44.240092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:55:44.356735 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e7239aae-2128-4f7f-b9f5-224b739079b5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 5.342783 Oct 17 15:55:44.358291 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2672/5585] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 15:55:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 5345 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 15:55:44.396604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77d90bf2-0eba-4adc-922a-fee5379fc0a1 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:44.400215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77d90bf2-0eba-4adc-922a-fee5379fc0a1 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:44.810653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77d90bf2-0eba-4adc-922a-fee5379fc0a1 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:44.840714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77d90bf2-0eba-4adc-922a-fee5379fc0a1 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:44.844294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77d90bf2-0eba-4adc-922a-fee5379fc0a1 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:44.857200 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77d90bf2-0eba-4adc-922a-fee5379fc0a1 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1259 microversion: 2.21 time: 0.485874 Oct 17 15:55:44.859014 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2914/5586] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:44 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1259 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:55:45.916787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:45.918755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:45.956399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:45.957340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:45.958254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:45.959358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:45.960008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:45.963899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:47.453219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:47.472039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:47.477167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:47.484437 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-751c1c73-44af-4263-8c28-e33c8a0a8689 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1263 microversion: 2.21 time: 1.580741 Oct 17 15:55:47.509298 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2673/5587] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:45 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1263 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:55:48.518806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:48.519865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:48.589186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:48.590172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:48.591017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:48.592227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:48.592971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:48.593703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:49.001228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:49.024667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:49.032238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:49.042321 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6399d55e-39c3-49ac-b911-132a661ff700 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1317 microversion: 2.21 time: 0.530289 Oct 17 15:55:49.047522 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2915/5588] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:48 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:55:50.143935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:50.144723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:50.163803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:50.164529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:50.165151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:50.166424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:50.167050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:50.167656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:50.637405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-494184528", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "2359f895-d35c-4e18-a279-f9bda779d34c"}], "key_name": "tempest-TestNetworkBasicOps-639089191", "security_groups": [{"name": "tempest-secgroup-smoke-1498777439"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:55:50.657760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:50.689227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:50.700126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:50.704347 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4a6f0141-ad78-4aa4-8f68-e00d827590f3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1317 microversion: 2.21 time: 0.564688 Oct 17 15:55:50.722529 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2674/5589] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:50 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:55:51.589588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] validate_networks() for [('2359f895-d35c-4e18-a279-f9bda779d34c', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:55:51.749659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:51.750390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:51.788091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:51.788541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:51.789017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:51.793452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:51.793961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:51.794416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:53.105773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:53.135149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:53.136761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:53.141227 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3ef269e-d0fd-4927-8d6c-94b7ccd34fa2 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 1.397976 Oct 17 15:55:53.157959 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2675/5590] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:51 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:55:53.484644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:55:53.486036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:55:53.486728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:55:53.487363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:55:53.487963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:55:53.530267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:53.530818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:53.531283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:53.543377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:53.544004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:53.546403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:53.653508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for project 15545d0f177d4dcab629c37feb5a6328. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:55:53.673314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for user b6684e87890f4ba5af7adb91145e4d4f and project 15545d0f177d4dcab629c37feb5a6328. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:55:53.717578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:55:53.727568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:55:53.908633 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40db40e7-ee49-4bce-b96e-425dbe8ef524 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.270599 Oct 17 15:55:53.918929 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2916/5591] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:55:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 3287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:55:53.932861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-acacf8bc-4402-49d2-9d3c-36974f72838c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:53.934626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-acacf8bc-4402-49d2-9d3c-36974f72838c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:54.116315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:55:54.172047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:54.172931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:54.208201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:54.216067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:54.223768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:54.224669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:55:54.226573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:54.233250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:54.239194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:54.994894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:55.075388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:55.082117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:55.106072 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5587426b-a7e7-497f-9ff9-49c4c8ce249f tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 0.938475 Oct 17 15:55:55.116863 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2917/5592] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:54 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:55:55.510952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-acacf8bc-4402-49d2-9d3c-36974f72838c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:55.525011 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-acacf8bc-4402-49d2-9d3c-36974f72838c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1247 microversion: 2.1 time: 1.595655 Oct 17 15:55:55.550226 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2676/5593] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:55:53 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1247 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:55:56.158266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:56.160167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:56.227801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:56.228710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:56.239843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:56.242750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:56.248324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:56.252707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:56.551540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:56.553006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:56.579848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:56.581490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:56.582549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:56.583641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:56.587310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:56.588928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:57.339657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:57.376723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:57.379505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:57.380856 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e719c7e1-c266-4f22-bd3a-44154a1fb699 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 1.233272 Oct 17 15:55:57.392632 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2918/5594] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:56 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:55:57.629847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:57.651227 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-018696ef-2980-4529-973b-b380dc875174 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1243 microversion: 2.1 time: 1.105258 Oct 17 15:55:57.651858 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2677/5595] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:55:56 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1243 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:55:58.367319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-484bdd4a-c39e-48f9-8669-f57f0a975639 req-649d9528-642b-41cb-a9c6-5b38722d0c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baad6aa6-d5f1-4de8-97fe-611102a8f472", "tag": "0ddae2f0-5a52-4301-af27-4b1f69359d10"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:55:58.403189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-484bdd4a-c39e-48f9-8669-f57f0a975639 req-649d9528-642b-41cb-a9c6-5b38722d0c58 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:58.404211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-484bdd4a-c39e-48f9-8669-f57f0a975639 req-649d9528-642b-41cb-a9c6-5b38722d0c58 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:58.405064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-484bdd4a-c39e-48f9-8669-f57f0a975639 req-649d9528-642b-41cb-a9c6-5b38722d0c58 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:58.412946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:58.413918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:58.447940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:58.448947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:58.449632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:58.450665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:58.452127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:58.453581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:58.461484 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-484bdd4a-c39e-48f9-8669-f57f0a975639 req-649d9528-642b-41cb-a9c6-5b38722d0c58 service nova] Creating event network-changed:0ddae2f0-5a52-4301-af27-4b1f69359d10 for instance baad6aa6-d5f1-4de8-97fe-611102a8f472 on n-h1-854441-12 Oct 17 15:55:58.479293 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-484bdd4a-c39e-48f9-8669-f57f0a975639 req-649d9528-642b-41cb-a9c6-5b38722d0c58 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119225 Oct 17 15:55:58.482037 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2919/5596] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:55:58.682916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:55:58.683693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:55:58.696566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:58.697086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:58.697544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:58.698308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:55:58.698858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:55:58.699308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:55:58.947875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:58.985813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:58.989059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:58.996498 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cba274b7-fb8c-43a9-9476-2b05f9e4bf35 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 0.589097 Oct 17 15:55:58.998167 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2678/5597] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:55:58 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:55:59.024575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:55:59.035689 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24cceeec-12ee-422e-8934-0cd1a39c45e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1305 microversion: 2.1 time: 0.357686 Oct 17 15:55:59.048847 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2920/5598] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:55:58 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1305 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:00.041998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:00.051159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:00.067132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:00.068314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:00.095466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:00.117532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:00.142094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:00.146685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:00.147312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:00.147771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:00.148936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:00.153367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:00.154211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:00.157219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:00.157219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:00.157430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:00.450567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:00.470705 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a216f851-fdbf-47f6-a923-192180524dbe tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1305 microversion: 2.1 time: 0.411925 Oct 17 15:56:00.471328 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2921/5599] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:00 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1305 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:00.483828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54eab9db-3fd5-4b18-9f70-f467337a87d5"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:00.490098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:00.506003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:00.509438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:00.510340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:00.511551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:00.517188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:00.518123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:00.716242 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Invalid volume: volume 54eab9db-3fd5-4b18-9f70-f467337a87d5 is already attached to instances: 4e7dd4ba-982a-4677-93b2-fcd9597d2508 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments HTTP/1.1 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 74 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: {"volumeAttachment": {"volumeId": "54eab9db-3fd5-4b18-9f70-f467337a87d5"}} Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid volume: volume 54eab9db-3fd5-4b18-9f70-f467337a87d5 is already attached to instances: 4e7dd4ba-982a-4677-93b2-fcd9597d2508 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': '4e7dd4ba-982a-4677-93b2-fcd9597d2508', 'body': {'volumeAttachment': {'volumeId': '54eab9db-3fd5-4b18-9f70-f467337a87d5'}}} Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 54eab9db-3fd5-4b18-9f70-f467337a87d5 is already attached to instances: 4e7dd4ba-982a-4677-93b2-fcd9597d2508 Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:56:00.724135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 54eab9db-3fd5-4b18-9f70-f467337a87d5 is already attached to instances: 4e7dd4ba-982a-4677-93b2-fcd9597d2508 Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 54eab9db-3fd5-4b18-9f70-f467337a87d5 is already attached to instances: 4e7dd4ba-982a-4677-93b2-fcd9597d2508 Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 400 to user: Invalid volume: volume 54eab9db-3fd5-4b18-9f70-f467337a87d5 is already attached to instances: 4e7dd4ba-982a-4677-93b2-fcd9597d2508 {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-574019ec-bb01-4f39-a710-4ff81f55b659 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.251313 Oct 17 15:56:00.731254 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2922/5600] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:56:00 2022] POST /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 174 bytes in 253 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:56:00.858874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:00.859371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:00.868867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:00.869633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:00.870229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:00.871917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:00.874754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:00.875774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:00.906595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:00.929217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:00.932603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:00.936222 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6eeb1149-27a3-44e0-9cbc-4b6d4a8b8bee tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 0.911441 Oct 17 15:56:00.938277 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2679/5601] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:00 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:56:01.195655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lazy-loading 'services' on Instance uuid 4e7dd4ba-982a-4677-93b2-fcd9597d2508 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:56:01.421759 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47208374-eeb7-40bb-9c17-cdb49cc8547d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments/54eab9db-3fd5-4b18-9f70-f467337a87d5" status: 202 len: 0 microversion: 2.1 time: 0.566544 Oct 17 15:56:01.426181 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2923/5602] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:56:00 2022] DELETE /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments/54eab9db-3fd5-4b18-9f70-f467337a87d5 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:56:01.439520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca706300-fdb9-44a9-ba50-217a8d9705cf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:01.454220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca706300-fdb9-44a9-ba50-217a8d9705cf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:01.497488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca706300-fdb9-44a9-ba50-217a8d9705cf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:01.498010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca706300-fdb9-44a9-ba50-217a8d9705cf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:01.498802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca706300-fdb9-44a9-ba50-217a8d9705cf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:01.499543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca706300-fdb9-44a9-ba50-217a8d9705cf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:01.500011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca706300-fdb9-44a9-ba50-217a8d9705cf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:01.500452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca706300-fdb9-44a9-ba50-217a8d9705cf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:01.510400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:01.511460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:01.529330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:01.530369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:01.532764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:01.534380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:01.537170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:01.539829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:01.668466 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca706300-fdb9-44a9-ba50-217a8d9705cf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240077 Oct 17 15:56:01.678918 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2680/5603] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:01 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:01.979023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:01.979798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:02.001103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:02.001818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:02.002397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:02.003351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:02.003844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:02.010064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:02.193447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:02.221004 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18e86d92-2aee-434c-8b78-2b0027e971c8 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1373 microversion: 2.1 time: 0.724946 Oct 17 15:56:02.232912 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2924/5604] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:01 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1373 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:02.684268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5c92065-df32-4d84-882f-358fb20ede7c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:02.688224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f5c92065-df32-4d84-882f-358fb20ede7c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:02.705937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5c92065-df32-4d84-882f-358fb20ede7c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:02.713089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5c92065-df32-4d84-882f-358fb20ede7c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:02.714031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5c92065-df32-4d84-882f-358fb20ede7c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:02.715138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5c92065-df32-4d84-882f-358fb20ede7c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:02.723255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5c92065-df32-4d84-882f-358fb20ede7c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:02.724095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5c92065-df32-4d84-882f-358fb20ede7c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:02.734999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:02.772201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:02.800030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:02.803049 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f497ea33-de14-47a0-a386-b7b20f867a13 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 0.840519 Oct 17 15:56:02.805500 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2681/5605] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:01 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:56:02.865582 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5c92065-df32-4d84-882f-358fb20ede7c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186538 Oct 17 15:56:02.872244 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2925/5606] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:02 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:56:03.265664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:03.273917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:03.325796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:03.327994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:03.336184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:03.339090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:03.343363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:03.348400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:03.859530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:03.869030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:03.912481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:03.919557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:03.928628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:03.932486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:03.934615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:03.936952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:03.941344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:03.944334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:04.501525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:04.572687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:04.597806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:04.604982 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b175b401-003c-4950-addd-e32401faf6f7 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 0.753544 Oct 17 15:56:04.612225 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2926/5607] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:03 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:56:04.630024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89c48cda-c5f1-43e3-a50e-7959b5e66c9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:04.644361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89c48cda-c5f1-43e3-a50e-7959b5e66c9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:04.675338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c48cda-c5f1-43e3-a50e-7959b5e66c9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:04.688652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c48cda-c5f1-43e3-a50e-7959b5e66c9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:04.691323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c48cda-c5f1-43e3-a50e-7959b5e66c9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:04.693684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c48cda-c5f1-43e3-a50e-7959b5e66c9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:04.699210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c48cda-c5f1-43e3-a50e-7959b5e66c9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:04.701944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89c48cda-c5f1-43e3-a50e-7959b5e66c9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:04.877892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89c48cda-c5f1-43e3-a50e-7959b5e66c9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.263217 Oct 17 15:56:04.883675 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2927/5608] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:04 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:04.905099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d952403c-4f8e-4f23-ab82-744a65cdaa9f req-2f3523cd-d7f1-40ea-abca-b3f7569ac464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6ca639-0504-4438-9b9c-622fdb6bf751", "tag": "c6e6674d-70f6-41ea-9f4f-694d45f7ede7"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:04.947335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d952403c-4f8e-4f23-ab82-744a65cdaa9f req-2f3523cd-d7f1-40ea-abca-b3f7569ac464 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:04.948395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d952403c-4f8e-4f23-ab82-744a65cdaa9f req-2f3523cd-d7f1-40ea-abca-b3f7569ac464 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:04.948395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d952403c-4f8e-4f23-ab82-744a65cdaa9f req-2f3523cd-d7f1-40ea-abca-b3f7569ac464 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:05.003647 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d952403c-4f8e-4f23-ab82-744a65cdaa9f req-2f3523cd-d7f1-40ea-abca-b3f7569ac464 service nova] Creating event network-changed:c6e6674d-70f6-41ea-9f4f-694d45f7ede7 for instance cc6ca639-0504-4438-9b9c-622fdb6bf751 on n-h2-854441-12 Oct 17 15:56:05.045588 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d952403c-4f8e-4f23-ab82-744a65cdaa9f req-2f3523cd-d7f1-40ea-abca-b3f7569ac464 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159998 Oct 17 15:56:05.059324 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2928/5609] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:05.309477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:05.347813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:05.352115 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-50e0a1a9-2ee1-47d3-bcc9-49e0493face0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1373 microversion: 2.1 time: 2.095063 Oct 17 15:56:05.353130 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2682/5610] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:03 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1373 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:05.668030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:05.669289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:05.699829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:05.715071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:05.717154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:05.728238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:05.740245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:05.748262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:05.900203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8d97627-0990-4337-98b5-11da5b7cb116 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:05.904815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d8d97627-0990-4337-98b5-11da5b7cb116 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:05.944799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:05.948911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:06.005882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8d97627-0990-4337-98b5-11da5b7cb116 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:06.006964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8d97627-0990-4337-98b5-11da5b7cb116 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:06.019032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8d97627-0990-4337-98b5-11da5b7cb116 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:06.021071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8d97627-0990-4337-98b5-11da5b7cb116 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:06.022425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8d97627-0990-4337-98b5-11da5b7cb116 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:06.028673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8d97627-0990-4337-98b5-11da5b7cb116 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:06.273609 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d8d97627-0990-4337-98b5-11da5b7cb116 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.374854 Oct 17 15:56:06.286600 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2683/5611] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:05 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:56:06.381476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:06.391028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:06.421173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:06.422278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:06.423367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:06.429494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:06.430321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:06.431276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:06.785391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:06.834309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:06.844807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:06.850394 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94b5383f-f01b-4e0b-a108-b2bdd62adbca tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 1.190646 Oct 17 15:56:06.883016 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2929/5612] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:05 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:56:06.897615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:06.929405 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-89ce30df-0b60-44e1-9f65-90517e6e9bf1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1373 microversion: 2.1 time: 0.549287 Oct 17 15:56:06.943183 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2684/5613] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:06 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1373 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:56:07.291467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cc1fb721-d95f-43fd-abbd-8b775ade8b7b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:07.295596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cc1fb721-d95f-43fd-abbd-8b775ade8b7b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:07.320584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1fb721-d95f-43fd-abbd-8b775ade8b7b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:07.325333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1fb721-d95f-43fd-abbd-8b775ade8b7b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:07.328257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1fb721-d95f-43fd-abbd-8b775ade8b7b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:07.331559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1fb721-d95f-43fd-abbd-8b775ade8b7b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:07.333375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1fb721-d95f-43fd-abbd-8b775ade8b7b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:07.335108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc1fb721-d95f-43fd-abbd-8b775ade8b7b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:07.433829 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cc1fb721-d95f-43fd-abbd-8b775ade8b7b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146817 Oct 17 15:56:07.439024 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2930/5614] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:07 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:07.914286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:07.914957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:07.947570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:07.948611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:07.949082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:07.949847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:07.950365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:07.950775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:07.978222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:07.978957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:07.993780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:07.994295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:07.994833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:07.995595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:07.996066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:07.996501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:08.681810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:08.698132 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95b5db3c-828f-43ce-9e9f-ce88b2eb2ca0 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1373 microversion: 2.1 time: 0.723872 Oct 17 15:56:08.705265 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2931/5615] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:07 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1373 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:56:08.727885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee654e38-d922-411c-872f-f17198761df0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:08.732038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee654e38-d922-411c-872f-f17198761df0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:08.752018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:08.760537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee654e38-d922-411c-872f-f17198761df0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:08.764635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee654e38-d922-411c-872f-f17198761df0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:08.767829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee654e38-d922-411c-872f-f17198761df0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:08.769028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee654e38-d922-411c-872f-f17198761df0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:08.774964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee654e38-d922-411c-872f-f17198761df0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:08.775868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee654e38-d922-411c-872f-f17198761df0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:08.889534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:08.914594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:08.921785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:08.927219 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee654e38-d922-411c-872f-f17198761df0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.218185 Oct 17 15:56:08.929575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:08.933183 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d64dcaf-f630-4262-8c8e-e608780786fa tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 1.028872 Oct 17 15:56:08.951009 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2932/5616] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:08 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:08.958436 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2685/5617] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:07 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:56:09.753733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:09.755490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:09.770879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:09.781034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:09.782114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:09.784216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:09.798178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:09.802858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:09.952288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f33eab64-ec15-4f3b-8b34-4aa0de5993ae tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:09.955950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f33eab64-ec15-4f3b-8b34-4aa0de5993ae tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:10.000840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33eab64-ec15-4f3b-8b34-4aa0de5993ae tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:10.008070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33eab64-ec15-4f3b-8b34-4aa0de5993ae tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:10.009954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33eab64-ec15-4f3b-8b34-4aa0de5993ae tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:10.015277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33eab64-ec15-4f3b-8b34-4aa0de5993ae tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:10.020910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33eab64-ec15-4f3b-8b34-4aa0de5993ae tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:10.026879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f33eab64-ec15-4f3b-8b34-4aa0de5993ae tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:10.115557 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f33eab64-ec15-4f3b-8b34-4aa0de5993ae tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167315 Oct 17 15:56:10.124019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2686/5618] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:09 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:56:10.132432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:10.133455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:10.164333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:10.169207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:10.188586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:10.193397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:10.196817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:10.197447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:11.179853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:11.189456 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04dabfb6-54f5-4bb7-ba7d-ed6f085de43b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1373 microversion: 2.1 time: 1.441604 Oct 17 15:56:11.203565 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2933/5619] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:09 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1373 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:56:11.210268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09823ace-93bd-4b2b-b3c2-3afcc640c6e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:11.214294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09823ace-93bd-4b2b-b3c2-3afcc640c6e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:11.236307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09823ace-93bd-4b2b-b3c2-3afcc640c6e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:11.239412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09823ace-93bd-4b2b-b3c2-3afcc640c6e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:11.247165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09823ace-93bd-4b2b-b3c2-3afcc640c6e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:11.248717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09823ace-93bd-4b2b-b3c2-3afcc640c6e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:11.249461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09823ace-93bd-4b2b-b3c2-3afcc640c6e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:11.250237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09823ace-93bd-4b2b-b3c2-3afcc640c6e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:11.335992 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09823ace-93bd-4b2b-b3c2-3afcc640c6e3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130782 Oct 17 15:56:11.337407 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2934/5620] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:11 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:11.344640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:11.422948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:11.428838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:11.437844 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-85ba0dea-8c11-4843-af1e-b8a693c14929 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 1.311983 Oct 17 15:56:11.446852 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2687/5621] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:10 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:56:12.129532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-507a8b90-d02e-4b0a-a387-973fb3bb8fe5 req-a6abe8ab-911a-4439-b4f6-409bfb6308e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baad6aa6-d5f1-4de8-97fe-611102a8f472", "name": "network-vif-plugged", "status": "completed", "tag": "0ddae2f0-5a52-4301-af27-4b1f69359d10"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:12.154889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-507a8b90-d02e-4b0a-a387-973fb3bb8fe5 req-a6abe8ab-911a-4439-b4f6-409bfb6308e7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:12.157197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-507a8b90-d02e-4b0a-a387-973fb3bb8fe5 req-a6abe8ab-911a-4439-b4f6-409bfb6308e7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:12.158189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-507a8b90-d02e-4b0a-a387-973fb3bb8fe5 req-a6abe8ab-911a-4439-b4f6-409bfb6308e7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:12.178586 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-507a8b90-d02e-4b0a-a387-973fb3bb8fe5 req-a6abe8ab-911a-4439-b4f6-409bfb6308e7 service nova] Creating event network-vif-plugged:0ddae2f0-5a52-4301-af27-4b1f69359d10 for instance baad6aa6-d5f1-4de8-97fe-611102a8f472 on n-h1-854441-12 Oct 17 15:56:12.185411 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-507a8b90-d02e-4b0a-a387-973fb3bb8fe5 req-a6abe8ab-911a-4439-b4f6-409bfb6308e7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059717 Oct 17 15:56:12.188263 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2935/5622] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:12.225886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:12.227944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:12.256986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:12.261999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:12.262869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:12.264633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:12.265612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:12.275486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:12.351566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4acfdd1-6387-4d47-ad9a-f9d5456a8e4c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:12.355258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4acfdd1-6387-4d47-ad9a-f9d5456a8e4c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:12.376842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4acfdd1-6387-4d47-ad9a-f9d5456a8e4c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:12.377368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4acfdd1-6387-4d47-ad9a-f9d5456a8e4c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:12.377822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4acfdd1-6387-4d47-ad9a-f9d5456a8e4c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:12.384135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4acfdd1-6387-4d47-ad9a-f9d5456a8e4c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:12.384722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4acfdd1-6387-4d47-ad9a-f9d5456a8e4c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:12.385182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4acfdd1-6387-4d47-ad9a-f9d5456a8e4c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:12.429916 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4acfdd1-6387-4d47-ad9a-f9d5456a8e4c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083376 Oct 17 15:56:12.431210 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2936/5623] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:12 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:56:12.472359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:12.473421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:12.484495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:12.485270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:12.485894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:12.486853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:12.487501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:12.488098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:13.593235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:13.619495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:13.625013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:13.630115 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4bad064d-b910-4c86-a9a5-0d4b12f7949c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 1.160351 Oct 17 15:56:13.651155 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2937/5624] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:12 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:56:13.668565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31306431-0e27-4d6e-95a1-cd5000921d5e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:13.671477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31306431-0e27-4d6e-95a1-cd5000921d5e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:13.681324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31306431-0e27-4d6e-95a1-cd5000921d5e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:13.682229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31306431-0e27-4d6e-95a1-cd5000921d5e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:13.682957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31306431-0e27-4d6e-95a1-cd5000921d5e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:13.684735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31306431-0e27-4d6e-95a1-cd5000921d5e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:13.685444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31306431-0e27-4d6e-95a1-cd5000921d5e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:13.686125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31306431-0e27-4d6e-95a1-cd5000921d5e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:13.734901 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31306431-0e27-4d6e-95a1-cd5000921d5e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082220 Oct 17 15:56:13.736951 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2938/5625] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:13 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:13.839682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:13.871185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b77c5b08-e122-4189-a15f-47fbc7b8858e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1373 microversion: 2.1 time: 1.645377 Oct 17 15:56:13.887998 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2688/5626] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:12 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1373 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:14.690408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:14.702157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:14.728887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:14.729406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:14.730168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:14.730583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:14.731055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:14.731483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:14.759791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-94d5b9b0-8130-4ba6-8f02-307067cc13b3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:14.766435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-94d5b9b0-8130-4ba6-8f02-307067cc13b3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:14.797780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94d5b9b0-8130-4ba6-8f02-307067cc13b3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:14.802852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94d5b9b0-8130-4ba6-8f02-307067cc13b3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:14.806680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94d5b9b0-8130-4ba6-8f02-307067cc13b3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:14.808377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94d5b9b0-8130-4ba6-8f02-307067cc13b3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:14.814065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94d5b9b0-8130-4ba6-8f02-307067cc13b3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:14.816413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94d5b9b0-8130-4ba6-8f02-307067cc13b3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:15.023933 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-94d5b9b0-8130-4ba6-8f02-307067cc13b3 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.271991 Oct 17 15:56:15.040918 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2689/5627] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:56:14 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508/os-volume_attachments => generated 25 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:56:15.063037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:15.072070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:15.120151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:15.121208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:15.121987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:15.130014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:15.130968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:15.131709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:15.374238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:15.399859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:15.416037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:15.427794 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5b54f29-7cb0-4cfd-85e1-2f32161ee35c tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1359 microversion: 2.21 time: 0.768402 Oct 17 15:56:15.458748 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2939/5628] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:14 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1359 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:56:15.498209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:15.505107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:15.536306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:15.543013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:15.546347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:15.554218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:15.560290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:15.566614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:15.716702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:15.738275 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cb74d576-d535-4b04-bf0b-9bd709a24769 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1373 microversion: 2.1 time: 0.686547 Oct 17 15:56:15.747510 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2690/5629] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:15 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1373 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:15.780992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:56:15.944361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-715220c7-ce2c-4870-bb52-87bb118d5cd3 req-e7b3f35d-4e88-47f9-96c7-527945edd597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6ca639-0504-4438-9b9c-622fdb6bf751", "name": "network-vif-plugged", "status": "completed", "tag": "c6e6674d-70f6-41ea-9f4f-694d45f7ede7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:15.985756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-715220c7-ce2c-4870-bb52-87bb118d5cd3 req-e7b3f35d-4e88-47f9-96c7-527945edd597 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:15.996867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-715220c7-ce2c-4870-bb52-87bb118d5cd3 req-e7b3f35d-4e88-47f9-96c7-527945edd597 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:16.009535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-715220c7-ce2c-4870-bb52-87bb118d5cd3 req-e7b3f35d-4e88-47f9-96c7-527945edd597 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:16.060401 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-715220c7-ce2c-4870-bb52-87bb118d5cd3 req-e7b3f35d-4e88-47f9-96c7-527945edd597 service nova] Creating event network-vif-plugged:c6e6674d-70f6-41ea-9f4f-694d45f7ede7 for instance cc6ca639-0504-4438-9b9c-622fdb6bf751 on n-h2-854441-12 Oct 17 15:56:16.130264 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-715220c7-ce2c-4870-bb52-87bb118d5cd3 req-e7b3f35d-4e88-47f9-96c7-527945edd597 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192113 Oct 17 15:56:16.132529 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2691/5630] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:16.211172 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68ae7581-2ce4-4ae8-8ad0-1d4400732587 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 204 len: 0 microversion: 2.1 time: 0.749706 Oct 17 15:56:16.218639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2940/5631] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:56:15 2022] DELETE /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:56:16.226663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:16.227456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:16.255026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:16.272400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:16.274777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:16.278582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:16.280597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:16.284803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:16.499988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:16.502195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:16.538993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:16.540627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:16.541315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:16.542973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:16.545048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:16.545938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:16.920166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:16.940054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:16.946290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:16.951240 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a4e1ebb-c1b0-42de-8bab-263eb5772a15 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1553 microversion: 2.21 time: 0.469232 Oct 17 15:56:16.968459 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2941/5632] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:16 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1553 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 15:56:16.983730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:16.992934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:17.016783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:17.021029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:17.023279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:17.026969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:17.028940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:17.029794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:17.434736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:17.453719 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa81bd1a-eff2-477d-8e4e-3b61494d33be tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1681 microversion: 2.1 time: 1.231252 Oct 17 15:56:17.454517 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2692/5633] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:16 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1681 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:17.459653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:17.460162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:17.501445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:17.501980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:17.502440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:17.503298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:17.503826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:17.504306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:17.655244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:56:17.880080 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f9f07886-ba23-4ea4-afdb-a82c7ca340d3 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "DELETE /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 204 len: 0 microversion: 2.21 time: 0.422643 Oct 17 15:56:17.883174 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2693/5634] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:56:17 2022] DELETE /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 15:56:17.899327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:17.906287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:17.921965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:17.922923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:17.923978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:17.927643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:17.928339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:17.931480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:17.941674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:18.004637 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57d30dd2-2bed-407b-9eb9-57ba0c074919 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1373 microversion: 2.1 time: 1.034279 Oct 17 15:56:18.013651 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2942/5635] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:16 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1373 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:18.486709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:18.489419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:18.521245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:18.535612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:18.537180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:18.544338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:18.551895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:18.552684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:18.593228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:18.605507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:18.611751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:18.613210 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2ee58a92-512c-4dc8-8450-3c96c38022b0 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1559 microversion: 2.21 time: 0.723387 Oct 17 15:56:18.614194 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2694/5636] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:17 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1559 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:56:19.052188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:19.053038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:19.076140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:19.087829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:19.089781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:19.092481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:19.096136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:19.097298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:19.335319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:19.348631 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e7a67a5-7b61-47f8-966e-79abd577f63d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1681 microversion: 2.1 time: 0.873030 Oct 17 15:56:19.351972 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2943/5637] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:18 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1681 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:19.667987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:19.668626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:19.680502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:19.683226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:19.684580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:19.685462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:19.688335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:19.690931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:20.044645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:20.065515 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc311c23-de58-4ce1-93f9-ffbd01ae3f27 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1373 microversion: 2.1 time: 1.018172 Oct 17 15:56:20.066159 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2695/5638] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:19 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1373 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:20.175181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:20.198464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:20.200268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:20.201547 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d743ce21-05ed-490f-9a6a-6e04b2cf3dce tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1559 microversion: 2.21 time: 0.538127 Oct 17 15:56:20.206272 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2944/5639] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:19 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1559 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:56:20.376854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:20.377478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:20.396114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:20.400688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:20.403444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:20.404621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:20.405607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:20.406284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:21.102247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:21.102935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:21.139852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:21.140733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:21.141256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:21.143113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:21.143635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:21.149281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:21.656807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:21.673084 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9195451-e30f-456e-873e-5f8d22835f8e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1546 microversion: 2.1 time: 0.575265 Oct 17 15:56:21.675663 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2945/5640] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:21 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1546 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:56:21.693691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:21.696517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:21.718229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:21.724375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:21.725513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:21.727426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:21.729913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:21.731190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:21.975076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:22.031815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:22.034326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:22.037504 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ef41436c-5d07-4478-a6a4-297a921ff5eb tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1517 microversion: 2.21 time: 0.358737 Oct 17 15:56:22.038862 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2946/5641] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:21 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:56:22.048542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:22.050429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:22.080595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:22.084961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:22.092435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:22.097657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:22.098579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:22.100872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:22.563592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:22.608585 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-666cde70-5ded-483c-855f-58f0645454aa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1681 microversion: 2.1 time: 2.235734 Oct 17 15:56:22.625681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2696/5642] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:20 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1681 bytes in 2254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:22.641903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-09a67fbb-6779-4568-9d1b-1ab0a9cf94ec req-58d749db-42e6-4db7-adef-9f947ce5c110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baad6aa6-d5f1-4de8-97fe-611102a8f472", "name": "network-vif-deleted", "tag": "0ddae2f0-5a52-4301-af27-4b1f69359d10"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:22.666366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:22.683249 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-478afddf-1ae6-40b2-a30d-5398d4dd7b4e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1546 microversion: 2.1 time: 0.642003 Oct 17 15:56:22.706554 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2947/5643] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:22 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1546 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:22.719556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-09a67fbb-6779-4568-9d1b-1ab0a9cf94ec req-58d749db-42e6-4db7-adef-9f947ce5c110 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:22.719556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-09a67fbb-6779-4568-9d1b-1ab0a9cf94ec req-58d749db-42e6-4db7-adef-9f947ce5c110 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:22.719861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-09a67fbb-6779-4568-9d1b-1ab0a9cf94ec req-58d749db-42e6-4db7-adef-9f947ce5c110 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:22.783543 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-09a67fbb-6779-4568-9d1b-1ab0a9cf94ec req-58d749db-42e6-4db7-adef-9f947ce5c110 service nova] Creating event network-vif-deleted:0ddae2f0-5a52-4301-af27-4b1f69359d10 for instance baad6aa6-d5f1-4de8-97fe-611102a8f472 on n-h1-854441-12 Oct 17 15:56:22.805749 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-09a67fbb-6779-4568-9d1b-1ab0a9cf94ec req-58d749db-42e6-4db7-adef-9f947ce5c110 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176724 Oct 17 15:56:22.806957 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2697/5644] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:23.090312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:23.091337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:23.116130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:23.120095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:23.121063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:23.122416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:23.123684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:23.124417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:23.264538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:23.314816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:23.315974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:23.317662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:23.318358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lazy-loading 'fault' on Instance uuid baad6aa6-d5f1-4de8-97fe-611102a8f472 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:56:23.412105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:23.431323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:23.443736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f2642cb16e44419658ab1b578293f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b57b38701345e1961d074f1e871781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:23.447785 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23b968f2-47a7-4d00-9c02-bd5f46d36bd5 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 200 len: 1349 microversion: 2.21 time: 0.362273 Oct 17 15:56:23.449892 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2948/5645] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:23 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 1349 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 15:56:23.671014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:23.673632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:23.702069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:23.703144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:23.707291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:23.712029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:23.714895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:23.718277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:24.158528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:24.178847 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31512308-20a6-4a17-bae7-340572abe1a1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1613 microversion: 2.1 time: 0.529124 Oct 17 15:56:24.188529 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2698/5646] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:23 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1613 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:24.498646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:24.499519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:24.518955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:24.519714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:24.522971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:24.524184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:24.524863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:24.529486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:24.618260 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] HTTP exception thrown: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Request method failure captured: Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 HTTP/1.1 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXr6fKGl5kXVy-EcgLCFXaIU-iYOEUYkdooG6N2QKCD7WBp-YlPA3iE3SSUbtBMYN2Aiar7Md5qqKYby-5EAVWk2tmLIhSUM1xzV1_T4nXwmQYa9j0hiHpQ-hgGBj-DmCXvaP08QFqwcd6vasgj6Km5THsoZjNVuMs_qwRczJKPheQE Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 16b57b38701345e1961d074f1e871781 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1314217002 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/16b57b38701345e1961d074f1e871781"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/16b57b38701345e1961d074f1e871781"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_16b57b38701345e1961d074f1e871781"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/16b57b38701345e1961d074f1e871781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceActionsV221TestJSON-1314217002 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 16b57b38701345e1961d074f1e871781 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1314217002 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-InstanceActionsV221TestJSON-1314217002-project Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 72f2642cb16e44419658ab1b578293f9 Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceActionsV221TestJSON-1314217002-project Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'baad6aa6-d5f1-4de8-97fe-611102a8f472'} Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:24.623083 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:24.634037 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:24.634037 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:24.634037 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:24.634037 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:24.634037 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:56:24.634037 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:56:24.634037 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:24.634037 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:24.639427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Returning 404 to user: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:56:24.644676 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11dc5f46-528a-43d6-9492-35da2e5d29fc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 404 len: 111 microversion: 2.21 time: 0.148102 Oct 17 15:56:24.646640 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2949/5647] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:24 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:56:24.685111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6153c885-e3bf-41a7-a3e4-2e318494c0c8 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '.version_select at 0x7f28be509700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:24.690626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6153c885-e3bf-41a7-a3e4-2e318494c0c8 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:24.741182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6153c885-e3bf-41a7-a3e4-2e318494c0c8 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:24.747537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6153c885-e3bf-41a7-a3e4-2e318494c0c8 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:24.749063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6153c885-e3bf-41a7-a3e4-2e318494c0c8 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:24.751854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6153c885-e3bf-41a7-a3e4-2e318494c0c8 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:24.755263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6153c885-e3bf-41a7-a3e4-2e318494c0c8 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:24.755977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6153c885-e3bf-41a7-a3e4-2e318494c0c8 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:24.870278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:24.974575 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6153c885-e3bf-41a7-a3e4-2e318494c0c8 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.322176 Oct 17 15:56:24.976112 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2699/5648] 10.222.0.87 () {60 vars in 1337 bytes} [Mon Oct 17 15:56:24 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472/os-instance-actions => generated 611 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 15:56:25.001476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:25.002467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:25.034276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:25.036514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:25.037281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:25.038492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:25.046828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:25.047968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:25.164005 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] HTTP exception thrown: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Request method failure captured: Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 HTTP/1.1 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXr6fKGl5kXVy-EcgLCFXaIU-iYOEUYkdooG6N2QKCD7WBp-YlPA3iE3SSUbtBMYN2Aiar7Md5qqKYby-5EAVWk2tmLIhSUM1xzV1_T4nXwmQYa9j0hiHpQ-hgGBj-DmCXvaP08QFqwcd6vasgj6Km5THsoZjNVuMs_qwRczJKPheQE Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 16b57b38701345e1961d074f1e871781 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1314217002 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/16b57b38701345e1961d074f1e871781"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/16b57b38701345e1961d074f1e871781"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_16b57b38701345e1961d074f1e871781"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/16b57b38701345e1961d074f1e871781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-InstanceActionsV221TestJSON-1314217002 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 16b57b38701345e1961d074f1e871781 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1314217002 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-InstanceActionsV221TestJSON-1314217002-project Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 72f2642cb16e44419658ab1b578293f9 Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-InstanceActionsV221TestJSON-1314217002-project Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'baad6aa6-d5f1-4de8-97fe-611102a8f472'} Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:56:25.168288 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.172870 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.175883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Returning 404 to user: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:56:25.177384 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c42512b-826c-41f2-8307-88bbe13bc149 tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "DELETE /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 404 len: 111 microversion: 2.21 time: 0.184846 Oct 17 15:56:25.178485 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2950/5649] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 15:56:24 2022] DELETE /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:56:25.190067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:25.190842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] [instance: baad6aa6-d5f1-4de8-97fe-611102a8f472] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:25.211398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:25.211973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:25.212611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:25.213634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:25.215040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:25.220444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:25.221206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:25.221726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:25.231300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:25.240627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:25.241506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:25.242684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:25.243411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:25.250807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:25.283260 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] HTTP exception thrown: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Request method failure captured: Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 HTTP/1.1 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXr6fKGl5kXVy-EcgLCFXaIU-iYOEUYkdooG6N2QKCD7WBp-YlPA3iE3SSUbtBMYN2Aiar7Md5qqKYby-5EAVWk2tmLIhSUM1xzV1_T4nXwmQYa9j0hiHpQ-hgGBj-DmCXvaP08QFqwcd6vasgj6Km5THsoZjNVuMs_qwRczJKPheQE Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 16b57b38701345e1961d074f1e871781 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1314217002 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/16b57b38701345e1961d074f1e871781"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/16b57b38701345e1961d074f1e871781"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_16b57b38701345e1961d074f1e871781"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/16b57b38701345e1961d074f1e871781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-InstanceActionsV221TestJSON-1314217002 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 16b57b38701345e1961d074f1e871781 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1314217002 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-InstanceActionsV221TestJSON-1314217002-project Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 72f2642cb16e44419658ab1b578293f9 Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-InstanceActionsV221TestJSON-1314217002-project Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'baad6aa6-d5f1-4de8-97fe-611102a8f472'} Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.285228 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] Returning 404 to user: Instance baad6aa6-d5f1-4de8-97fe-611102a8f472 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23f543b1-b9ee-478b-b5e6-d425d7e1a1cc tempest-InstanceActionsV221TestJSON-1314217002 tempest-InstanceActionsV221TestJSON-1314217002-project] 10.222.0.87 "GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472" status: 404 len: 111 microversion: 2.21 time: 0.103702 Oct 17 15:56:25.288970 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2700/5650] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 15:56:25 2022] GET /compute/v2.1/servers/baad6aa6-d5f1-4de8-97fe-611102a8f472 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:56:25.582298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:25.607237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01819680-1dfe-4408-a253-cc68f8a39d8b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1613 microversion: 2.1 time: 0.400133 Oct 17 15:56:25.608159 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2951/5651] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:25 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1613 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:56:25.859882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-176dcd55-7d50-4d8c-a42e-d0b111cf90f3 req-d5838826-f29e-4046-9361-3ef860dbd0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7dd4ba-982a-4677-93b2-fcd9597d2508", "name": "network-vif-deleted", "tag": "6bfc86e7-ea78-4ccd-9b36-3cad7a70f54b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:25.893113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-176dcd55-7d50-4d8c-a42e-d0b111cf90f3 req-d5838826-f29e-4046-9361-3ef860dbd0c5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:25.899582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-176dcd55-7d50-4d8c-a42e-d0b111cf90f3 req-d5838826-f29e-4046-9361-3ef860dbd0c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:25.900059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-176dcd55-7d50-4d8c-a42e-d0b111cf90f3 req-d5838826-f29e-4046-9361-3ef860dbd0c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:25.944550 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-176dcd55-7d50-4d8c-a42e-d0b111cf90f3 req-d5838826-f29e-4046-9361-3ef860dbd0c5 service nova] Creating event network-vif-deleted:6bfc86e7-ea78-4ccd-9b36-3cad7a70f54b for instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 on n-h2-854441-12 Oct 17 15:56:25.964955 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-176dcd55-7d50-4d8c-a42e-d0b111cf90f3 req-d5838826-f29e-4046-9361-3ef860dbd0c5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109110 Oct 17 15:56:25.972710 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2701/5652] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:26.638041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:26.638902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:26.655961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:26.659970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:26.660821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:26.661849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:26.662602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:26.667380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:26.760004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:26.766740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:26.768165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:26.778821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lazy-loading 'fault' on Instance uuid 4e7dd4ba-982a-4677-93b2-fcd9597d2508 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:56:27.341915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:27.358734 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1c885fb-66fa-4790-828f-37d7d433c545 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 200 len: 1330 microversion: 2.1 time: 0.724863 Oct 17 15:56:27.359280 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2952/5653] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:26 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 1330 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:28.402264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:28.413770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:28.437852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:28.438835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:28.441563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:28.443644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:28.448794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:28.449610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:28.501159 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 HTTP/1.1 Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '4e7dd4ba-982a-4677-93b2-fcd9597d2508'} Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:56:28.504846 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:28.514203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:56:28.514203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:56:28.514203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:56:28.514203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:56:28.514203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:56:28.514203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:56:28.514203 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:56:28.515844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:56:28.517935 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2f801c8a-6f4b-4fa4-9e32-3e5d1988ff58 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 404 len: 111 microversion: 2.1 time: 0.136873 Oct 17 15:56:28.519766 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2702/5654] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:28 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:56:28.532707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06d4affc-7be4-46c8-92e1-7bf881a86902 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '.version_select at 0x7f28bdc6d310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:28.569079 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06d4affc-7be4-46c8-92e1-7bf881a86902 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-45740877" status: 202 len: 0 microversion: 2.1 time: 0.043406 Oct 17 15:56:28.571077 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2953/5655] 10.222.0.87 () {58 vars in 1215 bytes} [Mon Oct 17 15:56:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-45740877 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:56:29.519457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-00050ce6-051c-4ff3-a7ef-d2f1d0d43dde req-eb24b08b-cef8-4627-8cc8-daf2a44093c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6ca639-0504-4438-9b9c-622fdb6bf751", "tag": "c6e6674d-70f6-41ea-9f4f-694d45f7ede7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:29.544386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-00050ce6-051c-4ff3-a7ef-d2f1d0d43dde req-eb24b08b-cef8-4627-8cc8-daf2a44093c0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:29.547694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-00050ce6-051c-4ff3-a7ef-d2f1d0d43dde req-eb24b08b-cef8-4627-8cc8-daf2a44093c0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:29.555011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-00050ce6-051c-4ff3-a7ef-d2f1d0d43dde req-eb24b08b-cef8-4627-8cc8-daf2a44093c0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:29.575519 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-00050ce6-051c-4ff3-a7ef-d2f1d0d43dde req-eb24b08b-cef8-4627-8cc8-daf2a44093c0 service nova] Creating event network-changed:c6e6674d-70f6-41ea-9f4f-694d45f7ede7 for instance cc6ca639-0504-4438-9b9c-622fdb6bf751 on n-h2-854441-12 Oct 17 15:56:29.591966 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-00050ce6-051c-4ff3-a7ef-d2f1d0d43dde req-eb24b08b-cef8-4627-8cc8-daf2a44093c0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076888 Oct 17 15:56:29.596513 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2703/5656] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:30.530670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13d45b1e-0df7-4667-aaf9-755ac6b3942a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: .version_select at 0x7f28be0fa5e0>, body: {"keypair": {"name": "tempest-keypair-934056903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAYL8lILpGCoAftbvPH6+aCt7ffdh5jF1OiRm5udiEmRRQmr9hi5c9ekrtSNy6V62XZrA39jI7jPWrf/ci1K1OvBcyiG4ayYo2GH/dwug/AeHI2yXK4x/MDsE2vCFFRbQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:30.592281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-13d45b1e-0df7-4667-aaf9-755ac6b3942a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for project 95e7c17929974c669051e99792e83d40. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:56:30.600069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-13d45b1e-0df7-4667-aaf9-755ac6b3942a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for user 98d8f0d40fd0472e8ffc58d09811c4cc and project 95e7c17929974c669051e99792e83d40. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:56:30.684367 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13d45b1e-0df7-4667-aaf9-755ac6b3942a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161197 Oct 17 15:56:30.688323 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2954/5657] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:56:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:56:36.106074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-952162229", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "610043dc-4af1-4887-b876-94edd1ec11a6"}], "security_groups": [{"name": "tempest-securitygroup--481839427"}], "key_name": "tempest-keypair-934056903", "user_data": "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:36.175662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:36.859217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] validate_networks() for [('610043dc-4af1-4887-b876-94edd1ec11a6', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:56:38.756474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:56:38.757134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:56:38.757393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:56:38.757786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:56:38.758226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:56:38.783597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:38.784370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:38.784982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:38.785939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:38.788012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:38.790351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:38.847075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for project 95e7c17929974c669051e99792e83d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:56:38.861908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Getting quotas for user 98d8f0d40fd0472e8ffc58d09811c4cc and project 95e7c17929974c669051e99792e83d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:56:38.878895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:56:38.885121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:56:38.989022 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57f4716a-377c-4446-a591-331e456ae5b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.889870 Oct 17 15:56:38.989608 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2704/5658] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:56:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 15:56:39.015982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6660ec85-53be-41fa-96b6-b14f5d2db0b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:39.019071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6660ec85-53be-41fa-96b6-b14f5d2db0b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:39.056738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=22 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:39.064876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:39.401156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6660ec85-53be-41fa-96b6-b14f5d2db0b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:39.445566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6660ec85-53be-41fa-96b6-b14f5d2db0b7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1240 microversion: 2.1 time: 0.442018 Oct 17 15:56:39.452457 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2955/5659] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:38 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1240 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:40.470823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:40.471449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:40.512546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:40.513447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:40.514079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:40.517998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:40.519310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:40.520272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:40.865217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:40.874480 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-76190801-b2d1-4d2b-9153-6309f55f04d1 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1292 microversion: 2.1 time: 0.407909 Oct 17 15:56:40.875181 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2705/5660] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:40 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1292 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:41.898041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:41.900900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:41.914140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:41.918611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:41.924677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:41.926629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:41.927402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:41.933308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:42.096559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:42.112153 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8890c2b3-f67a-4515-9aa8-24f76804593c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1298 microversion: 2.1 time: 0.218410 Oct 17 15:56:42.113911 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2956/5661] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:41 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1298 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:43.140107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:43.141630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:43.153843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:43.163635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:43.164452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:43.167621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:43.173381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:43.175221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:45.321105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:45.386709 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-04326f0f-fe95-4aeb-988e-0178128b584a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1365 microversion: 2.1 time: 2.243846 Oct 17 15:56:45.387829 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2706/5662] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:43 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1365 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:56:46.434391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:46.445941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:46.515828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:46.520042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:46.529509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:46.533730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:46.571975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:46.572858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:46.959242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aed46ca3-4900-4de4-9ddc-0edf084f3b2b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:46.961882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aed46ca3-4900-4de4-9ddc-0edf084f3b2b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:46.992933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aed46ca3-4900-4de4-9ddc-0edf084f3b2b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:46.993458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aed46ca3-4900-4de4-9ddc-0edf084f3b2b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:46.994394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aed46ca3-4900-4de4-9ddc-0edf084f3b2b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:46.996048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aed46ca3-4900-4de4-9ddc-0edf084f3b2b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:46.996751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aed46ca3-4900-4de4-9ddc-0edf084f3b2b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:47.005597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aed46ca3-4900-4de4-9ddc-0edf084f3b2b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:47.096051 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aed46ca3-4900-4de4-9ddc-0edf084f3b2b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "POST /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751/action" status: 200 len: 24556 microversion: 2.1 time: 0.141278 Oct 17 15:56:47.096819 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2707/5663] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 15:56:46 2022] POST /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751/action => generated 24556 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 15:56:47.104732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-21dcf819-6f85-471a-a7ea-e2deef07fd97 req-f532c916-93d1-4ed1-b883-47509ec5c2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd185b3-a95a-4603-9860-18ca741ec903", "tag": "f0bb8b1f-0b27-4bb5-a392-e1d3614f22da"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:47.138915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-21dcf819-6f85-471a-a7ea-e2deef07fd97 req-f532c916-93d1-4ed1-b883-47509ec5c2b3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:47.143189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-21dcf819-6f85-471a-a7ea-e2deef07fd97 req-f532c916-93d1-4ed1-b883-47509ec5c2b3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:47.143694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-21dcf819-6f85-471a-a7ea-e2deef07fd97 req-f532c916-93d1-4ed1-b883-47509ec5c2b3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:47.176084 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-21dcf819-6f85-471a-a7ea-e2deef07fd97 req-f532c916-93d1-4ed1-b883-47509ec5c2b3 service nova] Creating event network-changed:f0bb8b1f-0b27-4bb5-a392-e1d3614f22da for instance 8dd185b3-a95a-4603-9860-18ca741ec903 on n-h1-854441-12 Oct 17 15:56:47.187854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:47.198883 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e9fbc290-900e-4137-bf95-108ef53dee9a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1365 microversion: 2.1 time: 0.785843 Oct 17 15:56:47.201436 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-21dcf819-6f85-471a-a7ea-e2deef07fd97 req-f532c916-93d1-4ed1-b883-47509ec5c2b3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103143 Oct 17 15:56:47.202077 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2708/5664] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:56:47.202565 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2957/5665] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:46 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1365 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:48.248804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:48.249545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:48.283338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:48.283874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:48.284331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:48.285859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:48.286569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:48.287183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:49.218904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:49.259931 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-173befb5-21f5-43c3-8dd2-0ef9a925f6f8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1365 microversion: 2.1 time: 1.019256 Oct 17 15:56:49.279099 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2958/5666] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:48 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1365 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:56:50.312202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:50.312763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:50.333797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:50.337629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:50.340811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:50.343176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:50.345645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:50.347295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:50.350093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:50.350938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:51.087551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:51.106124 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2d93592f-15f3-4dcd-9bf1-6125db27e43a tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1365 microversion: 2.1 time: 0.793205 Oct 17 15:56:51.107159 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2709/5667] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:50 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1365 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:52.164837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:52.164837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:52.181831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:52.220079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:52.227253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:52.227974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:52.229580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:52.230860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:52.231804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:53.800014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:53.809460 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37852420-0274-4f70-9848-c4dd5a3f8cfc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1365 microversion: 2.1 time: 1.658432 Oct 17 15:56:53.828761 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2959/5668] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:52 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1365 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:54.865399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:54.867688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:54.887684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:54.888873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:54.890142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:54.892097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:54.895746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:54.898594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:55.458824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:55.495002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=44 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:56:55.507955 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c37768a-75c1-44af-8883-6f650ea75ff6 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1365 microversion: 2.1 time: 0.649985 Oct 17 15:56:55.509941 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2710/5669] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:54 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1365 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:56:56.545874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:56.550766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:56.598301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:56.605380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:56.617037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:56.618953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:56.620107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:56.628320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:57.067071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:57.094658 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2076c377-c3e3-4835-b4f6-37373d32817e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1365 microversion: 2.1 time: 0.555162 Oct 17 15:56:57.096025 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2960/5670] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:56 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1365 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:56:57.965657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f8499401-9c77-47a3-bc86-3df1e5067277 req-f8aee92f-461b-4aea-a292-c87ad014b4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd185b3-a95a-4603-9860-18ca741ec903", "name": "network-vif-plugged", "status": "completed", "tag": "f0bb8b1f-0b27-4bb5-a392-e1d3614f22da"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:56:57.965657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f8499401-9c77-47a3-bc86-3df1e5067277 req-f8aee92f-461b-4aea-a292-c87ad014b4d6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:57.965657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f8499401-9c77-47a3-bc86-3df1e5067277 req-f8aee92f-461b-4aea-a292-c87ad014b4d6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:57.965657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f8499401-9c77-47a3-bc86-3df1e5067277 req-f8aee92f-461b-4aea-a292-c87ad014b4d6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:57.965657 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f8499401-9c77-47a3-bc86-3df1e5067277 req-f8aee92f-461b-4aea-a292-c87ad014b4d6 service nova] Creating event network-vif-plugged:f0bb8b1f-0b27-4bb5-a392-e1d3614f22da for instance 8dd185b3-a95a-4603-9860-18ca741ec903 on n-h1-854441-12 Oct 17 15:56:57.979365 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f8499401-9c77-47a3-bc86-3df1e5067277 req-f8aee92f-461b-4aea-a292-c87ad014b4d6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184353 Oct 17 15:56:57.980033 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2711/5671] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:56:58.139894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:56:58.141320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:56:58.157420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:58.171857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:58.172767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:58.192939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:56:58.193779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:56:58.194489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:56:59.425650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:56:59.439409 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd0ddc7c-59e5-4cc5-b542-4510f670f366 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1365 microversion: 2.1 time: 1.305505 Oct 17 15:56:59.445320 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2961/5672] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:56:58 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1365 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:00.474745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:00.475911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:00.511548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:00.512882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:00.558421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:00.561920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:00.563177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:00.573821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:01.274815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:01.300268 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-151aa9c8-a050-4482-9860-26a6282df761 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1554 microversion: 2.1 time: 0.827314 Oct 17 15:57:01.305693 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2712/5673] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:00 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1554 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:01.334536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52a89eda-8b5d-4dbb-8574-95b6e7775f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:01.335153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52a89eda-8b5d-4dbb-8574-95b6e7775f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:01.365246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a89eda-8b5d-4dbb-8574-95b6e7775f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:01.365795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a89eda-8b5d-4dbb-8574-95b6e7775f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:01.366243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a89eda-8b5d-4dbb-8574-95b6e7775f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:01.367032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a89eda-8b5d-4dbb-8574-95b6e7775f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:01.367628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a89eda-8b5d-4dbb-8574-95b6e7775f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:01.368066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52a89eda-8b5d-4dbb-8574-95b6e7775f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:02.810953 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52a89eda-8b5d-4dbb-8574-95b6e7775f97 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.482646 Oct 17 15:57:02.812622 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2962/5674] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 15:57:01 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-interface => generated 284 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:08.292169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5793af06-c85c-4608-9d8f-f0a17026eaf6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Action: 'create', calling method: .version_select at 0x7f28bdb56ca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1118721756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSCoCGPL1aF2zm6HOS8e+6/MOK1NDo0xTUN5ffVehLC3tnYu/J5cmYgKJLXgj+FI71Y3ue797foOMrIj2SWAyugvOE5knh0nM1pRAE9aY2c+ULhkOvawKoi10ER59SG7A=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:08.322397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:08.421454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5793af06-c85c-4608-9d8f-f0a17026eaf6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for project 15545d0f177d4dcab629c37feb5a6328. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:57:08.448516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5793af06-c85c-4608-9d8f-f0a17026eaf6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for user b6684e87890f4ba5af7adb91145e4d4f and project 15545d0f177d4dcab629c37feb5a6328. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:57:08.550532 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5793af06-c85c-4608-9d8f-f0a17026eaf6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.266556 Oct 17 15:57:08.551591 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2713/5675] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 15:57:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:12.275041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-49be053c-118e-45fa-b677-16656049f845 req-c216d51d-33f8-4440-a680-ed78a5478879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd185b3-a95a-4603-9860-18ca741ec903", "tag": "f0bb8b1f-0b27-4bb5-a392-e1d3614f22da"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:12.329141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=17 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:12.334293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=40 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:12.344654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-49be053c-118e-45fa-b677-16656049f845 req-c216d51d-33f8-4440-a680-ed78a5478879 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:12.348403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-49be053c-118e-45fa-b677-16656049f845 req-c216d51d-33f8-4440-a680-ed78a5478879 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:12.349980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-49be053c-118e-45fa-b677-16656049f845 req-c216d51d-33f8-4440-a680-ed78a5478879 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:12.383501 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-49be053c-118e-45fa-b677-16656049f845 req-c216d51d-33f8-4440-a680-ed78a5478879 service nova] Creating event network-changed:f0bb8b1f-0b27-4bb5-a392-e1d3614f22da for instance 8dd185b3-a95a-4603-9860-18ca741ec903 on n-h1-854441-12 Oct 17 15:57:12.391227 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-49be053c-118e-45fa-b677-16656049f845 req-c216d51d-33f8-4440-a680-ed78a5478879 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131721 Oct 17 15:57:12.393557 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2963/5676] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:13.358636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=9 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:13.856625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-291894229", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "5f8b5ed8-68ff-47a9-a7cb-0d871a8ecc00"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:14.919059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] validate_networks() for [('5f8b5ed8-68ff-47a9-a7cb-0d871a8ecc00', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:57:15.463007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-870076224", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "f10dc842-9cc3-444b-a237-97fb2d7cf2ad"}], "key_name": "tempest-TestNetworkBasicOps-1118721756", "security_groups": [{"name": "tempest-secgroup-smoke-751346136"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:16.659294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] validate_networks() for [('f10dc842-9cc3-444b-a237-97fb2d7cf2ad', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:57:18.472199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:18.671251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:57:18.671840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:57:18.673196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:57:18.673709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:57:18.675359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:57:18.697762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:18.698542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:18.700814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:18.702071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:18.704386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:18.707183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:18.812447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for project 15545d0f177d4dcab629c37feb5a6328. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:57:18.850959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for user b6684e87890f4ba5af7adb91145e4d4f and project 15545d0f177d4dcab629c37feb5a6328. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:57:18.916327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:57:18.922977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:57:19.060113 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-459ab882-5d7d-4722-b247-7472354f1981 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.622956 Oct 17 15:57:19.061751 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2964/5677] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:57:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 3627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:57:19.074110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d7fdb676-f72e-47f7-9e3b-3967c31a7101 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:19.075060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d7fdb676-f72e-47f7-9e3b-3967c31a7101 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:19.865203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d7fdb676-f72e-47f7-9e3b-3967c31a7101 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:19.878108 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d7fdb676-f72e-47f7-9e3b-3967c31a7101 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1248 microversion: 2.1 time: 0.808918 Oct 17 15:57:19.903173 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2965/5678] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:19 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1248 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:19.926343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:57:19.927074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:57:19.932526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:57:19.933305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:57:19.933878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:57:19.991125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:19.992081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:19.996037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:20.001880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:20.003822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:20.008598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:20.108634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Getting quotas for project 8b7953dc90864760924cf059873bcb15. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:57:20.160375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Getting quotas for user 316bf11b6d044bb29ae004cd27f22cfd and project 8b7953dc90864760924cf059873bcb15. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:57:20.265059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Going to run 3 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:57:20.277208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:57:20.810610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=8457fdd6-3a84-4899-8d62-7de827b71e36,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:57:20.908418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:20.917569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:20.944400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:20.949565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:20.950231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:20.953003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:20.953761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:20.955133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:21.159798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=fe903d81-8be2-4324-bda5-0f8a7b0a72b4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:57:21.188720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:21.212319 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de7d630e-b29d-4269-94dc-fed8eddac71a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1252 microversion: 2.1 time: 0.309261 Oct 17 15:57:21.220904 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2966/5679] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:20 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1252 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:21.522190 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fde0ff2e-316b-428b-b3bc-e567ed9e937a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.168899 Oct 17 15:57:21.540018 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2714/5680] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 8189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:57:21.545471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:21.552242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:21.553072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Searching by: {'deleted': False, 'project_id': '8b7953dc90864760924cf059873bcb15'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:57:21.657232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:21.657790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:21.692893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:21.694005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:21.699528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:21.705485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:21.799496 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c5403ef-9dd7-4d4a-a397-ddf6d8e6da8d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.258183 Oct 17 15:57:21.815268 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2967/5681] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:57:21 2022] GET /compute/v2.1/servers => generated 1015 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:21.849436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fbccbd28-be25-429c-8440-76ec632cc7a0 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:21.853528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fbccbd28-be25-429c-8440-76ec632cc7a0 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:22.244148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fbccbd28-be25-429c-8440-76ec632cc7a0 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:22.260088 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fbccbd28-be25-429c-8440-76ec632cc7a0 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1222 microversion: 2.1 time: 0.422073 Oct 17 15:57:22.267175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:22.267886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:22.279590 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2715/5682] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:21 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1222 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:22.283900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:22.287678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:22.289005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:22.292571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:22.293082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:22.293539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:22.509154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:22.519448 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50b32ad6-6698-4940-b5d8-611d5919f819 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1300 microversion: 2.1 time: 0.257451 Oct 17 15:57:22.538531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2968/5683] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:22 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1300 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:23.328933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5e209034-265b-494a-950a-6a480b9a2559 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:23.330114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5e209034-265b-494a-950a-6a480b9a2559 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:23.534658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5e209034-265b-494a-950a-6a480b9a2559 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:23.576065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:23.577365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:23.582048 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5e209034-265b-494a-950a-6a480b9a2559 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1222 microversion: 2.1 time: 0.262075 Oct 17 15:57:23.592891 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2716/5684] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:23 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1222 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:23.627008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:23.634437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:23.635178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:23.636162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:23.636895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:23.638004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:24.228460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:24.279227 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f82dbb2-05e9-4882-a3ec-fbdf2bbcbad4 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1306 microversion: 2.1 time: 0.711338 Oct 17 15:57:24.281903 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2969/5685] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:23 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1306 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:24.628417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:24.633534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:24.665083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:24.686462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:24.688523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:24.693866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:24.702262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:24.704315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:25.276959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:25.292303 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-62a962fa-3a0b-4e23-ac93-e644600bc6e1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1226 microversion: 2.1 time: 0.677830 Oct 17 15:57:25.296925 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2717/5686] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:24 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1226 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:25.327302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:25.328514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:25.342404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:25.345127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:25.350550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:25.353944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:25.354935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:25.359114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:25.521188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:25.537261 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2767517-d404-4e73-96bd-93ee296594e7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1306 microversion: 2.1 time: 0.212536 Oct 17 15:57:25.538669 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2970/5687] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:25 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1306 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:26.328803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:26.335867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:26.385419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:26.385878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:26.386357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:26.391261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:26.391838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:26.392362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:26.591136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:26.593274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:26.615804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:26.616517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:26.617190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:26.618472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:26.619138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:26.619775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:26.822011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:26.879934 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f4e22a76-fb0c-4262-bff1-5ae68e4eb0b9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1274 microversion: 2.1 time: 0.564039 Oct 17 15:57:26.888071 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2718/5688] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:26 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1274 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:27.913159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:27.914966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:27.932918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:27.944468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:27.947111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:27.954612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:27.955789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:27.956967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:28.974037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:29.032304 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-78c31bee-ae45-413d-8c04-1846ef7edd9e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1280 microversion: 2.1 time: 1.109776 Oct 17 15:57:29.067393 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2719/5689] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:27 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1280 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:29.366579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:29.401601 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-446f400d-2a6e-409d-86e9-4b729b448c60 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 2.831234 Oct 17 15:57:29.417774 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2971/5690] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:26 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 2848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:30.061771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:30.062907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:30.069088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:30.107841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:30.108663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:30.109345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:30.110976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:30.111683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:30.112563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:30.333921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:30.353729 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc671570-49cc-4889-95d4-edb5ca0a297b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1280 microversion: 2.1 time: 0.286870 Oct 17 15:57:30.358234 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2720/5691] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:30 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:30.458737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:30.459371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:30.462793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:30.501399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:30.503539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:30.505003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:30.507913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:30.509604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:30.513242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:31.400265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:31.401087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:31.458899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:31.459447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:31.459916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:31.460729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:31.479429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:31.479877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:31.697469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:31.712811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:31.722171 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b4b34179-8ea1-43dd-af49-0c8099b7d421 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1280 microversion: 2.1 time: 0.325920 Oct 17 15:57:31.731138 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2721/5692] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:31 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1280 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:31.780157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:31.787162 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58acbeee-c669-49dd-9af6-37c7ebb0d768 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 1.331169 Oct 17 15:57:31.790049 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2972/5693] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:30 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:32.640293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-49481241-e6b1-4a71-8846-f4dd80338d8d req-4b942da2-fe8d-48bb-9e9e-feed49498620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2a8c6c-1822-44b3-a171-47ab75bb7831", "tag": "c6b96428-a5bc-4ac0-98d9-92024f787db9"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:32.680870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-49481241-e6b1-4a71-8846-f4dd80338d8d req-4b942da2-fe8d-48bb-9e9e-feed49498620 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:32.681378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-49481241-e6b1-4a71-8846-f4dd80338d8d req-4b942da2-fe8d-48bb-9e9e-feed49498620 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:32.681823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-49481241-e6b1-4a71-8846-f4dd80338d8d req-4b942da2-fe8d-48bb-9e9e-feed49498620 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:32.715439 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-49481241-e6b1-4a71-8846-f4dd80338d8d req-4b942da2-fe8d-48bb-9e9e-feed49498620 service nova] Creating event network-changed:c6b96428-a5bc-4ac0-98d9-92024f787db9 for instance 1b2a8c6c-1822-44b3-a171-47ab75bb7831 on n-h1-854441-12 Oct 17 15:57:32.733031 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-49481241-e6b1-4a71-8846-f4dd80338d8d req-4b942da2-fe8d-48bb-9e9e-feed49498620 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097426 Oct 17 15:57:32.740945 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2722/5694] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:32.784745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:32.791934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:32.827362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:32.828098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:32.845206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:32.846050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:32.846714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:32.847799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:32.848426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:32.849008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:32.855992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:32.856857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:32.863053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:32.875995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:32.876817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:32.877613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:33.563152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:33.838824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:33.875902 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-58ecca4a-8115-4693-aa7c-2c5fcb620f94 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 1.049928 Oct 17 15:57:33.878487 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2723/5695] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:32 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:33.916386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e82b723d-9d3c-4613-8b1b-532344ec82dc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:33.917980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:33.920512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e82b723d-9d3c-4613-8b1b-532344ec82dc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:33.942966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e82b723d-9d3c-4613-8b1b-532344ec82dc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:33.953365 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c129b07-d974-4985-8caa-41650f051357 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 1.173829 Oct 17 15:57:33.955776 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2973/5696] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:32 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:33.962534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e82b723d-9d3c-4613-8b1b-532344ec82dc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:33.967795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e82b723d-9d3c-4613-8b1b-532344ec82dc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:33.980472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e82b723d-9d3c-4613-8b1b-532344ec82dc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:33.993051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e82b723d-9d3c-4613-8b1b-532344ec82dc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:33.999909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e82b723d-9d3c-4613-8b1b-532344ec82dc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:34.174882 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e82b723d-9d3c-4613-8b1b-532344ec82dc tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/ips" status: 200 len: 149 microversion: 2.1 time: 0.290479 Oct 17 15:57:34.176633 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2724/5697] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:57:33 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/ips => generated 149 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:34.926703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:34.931188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:34.950737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:34.952880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:34.954193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:34.956512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:34.957724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:34.958838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:35.004007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:35.005574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:35.042588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:35.044422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:35.051569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:35.053793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:35.056354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:35.058878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:36.312506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:36.335811 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e7990563-fed6-4b9f-955a-6c37898076ca tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 1.338060 Oct 17 15:57:36.337122 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2725/5698] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:34 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:37.105612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:37.123557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-41b88039-3aaa-4098-b3da-9b8e53a85e32 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 2.196463 Oct 17 15:57:37.123557 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2974/5699] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:34 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:37.401510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:37.403012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:37.418653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:37.420677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:37.421834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:37.434026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:37.434565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:37.436915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:37.657261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a305ea5-4876-4e87-b978-9fe4073c72f2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d43b1a52-5810-4ecf-9c22-6a40ec6a6a1a"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:37.660297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a305ea5-4876-4e87-b978-9fe4073c72f2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:37.679912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a305ea5-4876-4e87-b978-9fe4073c72f2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:37.680335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a305ea5-4876-4e87-b978-9fe4073c72f2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:37.680781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a305ea5-4876-4e87-b978-9fe4073c72f2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:37.681563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a305ea5-4876-4e87-b978-9fe4073c72f2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:37.682080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a305ea5-4876-4e87-b978-9fe4073c72f2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:37.682573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a305ea5-4876-4e87-b978-9fe4073c72f2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:37.990003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:38.006596 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-069570ad-6cf3-47e0-bbcf-b026ad1c1b7d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 0.622309 Oct 17 15:57:38.011563 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2726/5700] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:37 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:38.140935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:38.141686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:38.149922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:38.150480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:38.152117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:38.152401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:38.152931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:38.153374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:38.333529 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a305ea5-4876-4e87-b978-9fe4073c72f2 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "POST /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.679590 Oct 17 15:57:38.334335 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2975/5701] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 15:57:37 2022] POST /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 194 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:38.452894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6d036e32-93cf-40f2-a937-49f94ab97d18 req-74463444-8ac7-4776-9665-cf7c160e39dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6823d76e-ff20-4cf5-88ab-94c86d1cd0f9", "tag": "8bd9488c-09ae-4955-85e7-012ea3b75781"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:38.471402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d036e32-93cf-40f2-a937-49f94ab97d18 req-74463444-8ac7-4776-9665-cf7c160e39dd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:38.471902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d036e32-93cf-40f2-a937-49f94ab97d18 req-74463444-8ac7-4776-9665-cf7c160e39dd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:38.472342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d036e32-93cf-40f2-a937-49f94ab97d18 req-74463444-8ac7-4776-9665-cf7c160e39dd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:38.513517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6d036e32-93cf-40f2-a937-49f94ab97d18 req-74463444-8ac7-4776-9665-cf7c160e39dd service nova] Creating event network-changed:8bd9488c-09ae-4955-85e7-012ea3b75781 for instance 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 on n-h2-854441-12 Oct 17 15:57:38.524248 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6d036e32-93cf-40f2-a937-49f94ab97d18 req-74463444-8ac7-4776-9665-cf7c160e39dd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077030 Oct 17 15:57:38.525080 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2976/5702] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:57:38.915903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:38.934301 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a569a3cf-0097-4c19-872a-5e2aac8be681 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 0.798653 Oct 17 15:57:38.935637 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2727/5703] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:38 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:39.037423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:39.038365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:39.054556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:39.057957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:39.061338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:39.065603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:39.066635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:39.069190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:39.963395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:39.964088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:39.982835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:40.000115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:40.008648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:40.009610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:40.011316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:40.012560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:40.014832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:40.016079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:40.101040 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08ed1303-5e07-486b-8347-f9cc2e709e6c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 1.068879 Oct 17 15:57:40.124013 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2977/5704] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:39 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:40.520445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-72422447-f092-455e-8a5e-08a9d36de5a0 req-39bcb32c-8a2c-4c57-84e7-ecc3f143ac29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe903d81-8be2-4324-bda5-0f8a7b0a72b4", "tag": "0fa8d9a4-6c21-4523-ad8d-387df21a8fe2"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:40.578070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-72422447-f092-455e-8a5e-08a9d36de5a0 req-39bcb32c-8a2c-4c57-84e7-ecc3f143ac29 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:40.579325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-72422447-f092-455e-8a5e-08a9d36de5a0 req-39bcb32c-8a2c-4c57-84e7-ecc3f143ac29 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:40.580478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-72422447-f092-455e-8a5e-08a9d36de5a0 req-39bcb32c-8a2c-4c57-84e7-ecc3f143ac29 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:40.620109 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-72422447-f092-455e-8a5e-08a9d36de5a0 req-39bcb32c-8a2c-4c57-84e7-ecc3f143ac29 service nova] Creating event network-changed:0fa8d9a4-6c21-4523-ad8d-387df21a8fe2 for instance fe903d81-8be2-4324-bda5-0f8a7b0a72b4 on n-h1-854441-12 Oct 17 15:57:40.628209 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-72422447-f092-455e-8a5e-08a9d36de5a0 req-39bcb32c-8a2c-4c57-84e7-ecc3f143ac29 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112552 Oct 17 15:57:40.628987 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2978/5705] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:41.021611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:41.043598 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4130abbb-97aa-44f5-a082-cf79f5d89e5f tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 1.084024 Oct 17 15:57:41.050190 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2728/5706] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:39 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:41.139977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:41.141348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:41.157084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:41.158094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:41.158751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:41.163540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:41.164833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:41.165535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:41.961811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:41.977412 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a49a9160-2b40-433f-9caa-7647343ffc8c tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 0.843874 Oct 17 15:57:41.980911 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2979/5707] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:41 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:42.103792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:42.104671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:42.118473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:42.125131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:42.126181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:42.127313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:42.128976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:42.133026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:42.948563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-876f838f-784c-4cd4-8f9b-7549b5585766 req-e73c348a-c216-4396-87a8-83e359931171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8457fdd6-3a84-4899-8d62-7de827b71e36", "tag": "40f0bd51-80a8-4df6-a2f5-8a0ca1710d89"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:42.971942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:42.984456 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-49ecaca2-7ec7-457f-8708-9b5afe87a60c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 0.885211 Oct 17 15:57:43.002550 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2729/5708] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:42 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:43.009733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:43.011430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:43.038116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:43.039406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:43.040437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:43.042373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:43.044855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:43.046097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:43.063526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:43.077226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-876f838f-784c-4cd4-8f9b-7549b5585766 req-e73c348a-c216-4396-87a8-83e359931171 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:43.080770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-876f838f-784c-4cd4-8f9b-7549b5585766 req-e73c348a-c216-4396-87a8-83e359931171 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:43.087578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-876f838f-784c-4cd4-8f9b-7549b5585766 req-e73c348a-c216-4396-87a8-83e359931171 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:43.139217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:43.216512 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-876f838f-784c-4cd4-8f9b-7549b5585766 req-e73c348a-c216-4396-87a8-83e359931171 service nova] Creating event network-changed:40f0bd51-80a8-4df6-a2f5-8a0ca1710d89 for instance 8457fdd6-3a84-4899-8d62-7de827b71e36 on n-h2-854441-12 Oct 17 15:57:43.288676 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-876f838f-784c-4cd4-8f9b-7549b5585766 req-e73c348a-c216-4396-87a8-83e359931171 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372956 Oct 17 15:57:43.290290 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2980/5709] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:44.053064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:44.054056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:44.074894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:44.075449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:44.075898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:44.076647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:44.082107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:44.082635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:45.622010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:45.665246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:45.693236 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c69518f0-5009-4f87-b7bb-3316812ef00c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 1.660741 Oct 17 15:57:45.704148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=79 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:57:45.705967 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2981/5710] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:44 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:45.752999 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3c95c2e8-5181-4cf7-afe1-aedc6a57c2f3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 2.744623 Oct 17 15:57:45.759403 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2730/5711] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:43 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 2756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:46.767470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:46.775044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:46.786280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:46.787905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:46.843366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:46.843879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:46.844326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:46.852496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:46.853006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:46.853451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:46.854196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:46.855663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:46.856165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:46.856661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:46.871271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:46.871444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:47.576671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:47.621298 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0be20ad5-0e18-481b-9d81-b9cad8d89dc5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 0.840143 Oct 17 15:57:47.628944 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2731/5712] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:46 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:48.655143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:48.661045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:48.690799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:48.691951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:48.692846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:48.693978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:48.699282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:48.701825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:48.944817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:48.983441 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-169ef3d2-48ed-4302-bdba-79ec4090e6ab tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 2.222695 Oct 17 15:57:49.008810 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2982/5713] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:46 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 2250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:49.637897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:49.654014 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dd38960d-8164-42bb-aa86-14ce2da2a460 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 1.007671 Oct 17 15:57:49.654681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2732/5714] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:48 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:50.032513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:50.037861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:50.066297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:50.072564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:50.073200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:50.079203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:50.080353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:50.081339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:50.681056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:50.681850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:50.773717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:50.774285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:50.774781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:50.775535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:50.780371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:50.781016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:51.085451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:51.141890 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-262cfd98-e113-4da1-a202-e3004a43a365 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 1.114509 Oct 17 15:57:51.161982 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2983/5715] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:50 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:51.183611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-23a2f8f2-f902-4a21-8e53-88441a263acb req-e2097c88-f5c9-468b-889b-53b39b7bb6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6823d76e-ff20-4cf5-88ab-94c86d1cd0f9", "name": "network-vif-plugged", "status": "completed", "tag": "8bd9488c-09ae-4955-85e7-012ea3b75781"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:51.220585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-23a2f8f2-f902-4a21-8e53-88441a263acb req-e2097c88-f5c9-468b-889b-53b39b7bb6e9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:51.222514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-23a2f8f2-f902-4a21-8e53-88441a263acb req-e2097c88-f5c9-468b-889b-53b39b7bb6e9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:51.223875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-23a2f8f2-f902-4a21-8e53-88441a263acb req-e2097c88-f5c9-468b-889b-53b39b7bb6e9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:51.291928 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-23a2f8f2-f902-4a21-8e53-88441a263acb req-e2097c88-f5c9-468b-889b-53b39b7bb6e9 service nova] Creating event network-vif-plugged:8bd9488c-09ae-4955-85e7-012ea3b75781 for instance 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 on n-h2-854441-12 Oct 17 15:57:51.306779 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-23a2f8f2-f902-4a21-8e53-88441a263acb req-e2097c88-f5c9-468b-889b-53b39b7bb6e9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142856 Oct 17 15:57:51.316876 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2984/5716] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:51.442424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:51.460697 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-56d6bde8-3bbb-451b-9e8c-50dc9e2821f5 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 0.783768 Oct 17 15:57:51.467322 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2733/5717] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:50 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:52.186598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:52.187438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:52.202042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:52.204767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:52.205354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:52.206178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:52.206697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:52.207126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:52.494030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:52.501124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:52.537086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:52.537968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:52.559061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:52.563442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:52.564348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:52.565017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:52.847299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:52.862362 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6dfe6e35-7834-498e-8b08-5f11ebe85732 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1322 microversion: 2.1 time: 0.376355 Oct 17 15:57:52.867851 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2734/5718] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:52 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:53.025290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:53.059746 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9030dcc8-ab4d-4a38-ba83-5aaa5461c364 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 0.878101 Oct 17 15:57:53.064950 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2985/5719] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:52 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:53.785115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1810ee73-441d-46f3-8b2f-6d9efa897675 req-d4e10239-af6e-49b0-be36-c0a6d25f2874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2a8c6c-1822-44b3-a171-47ab75bb7831", "name": "network-vif-plugged", "status": "completed", "tag": "c6b96428-a5bc-4ac0-98d9-92024f787db9"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:53.868087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1810ee73-441d-46f3-8b2f-6d9efa897675 req-d4e10239-af6e-49b0-be36-c0a6d25f2874 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:53.869718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1810ee73-441d-46f3-8b2f-6d9efa897675 req-d4e10239-af6e-49b0-be36-c0a6d25f2874 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:53.873550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1810ee73-441d-46f3-8b2f-6d9efa897675 req-d4e10239-af6e-49b0-be36-c0a6d25f2874 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:53.904900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:53.905999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:53.912768 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1810ee73-441d-46f3-8b2f-6d9efa897675 req-d4e10239-af6e-49b0-be36-c0a6d25f2874 service nova] Creating event network-vif-plugged:c6b96428-a5bc-4ac0-98d9-92024f787db9 for instance 1b2a8c6c-1822-44b3-a171-47ab75bb7831 on n-h1-854441-12 Oct 17 15:57:53.928055 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1810ee73-441d-46f3-8b2f-6d9efa897675 req-d4e10239-af6e-49b0-be36-c0a6d25f2874 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155404 Oct 17 15:57:53.935009 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2735/5720] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:53.965796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:53.973485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:53.974555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:53.975626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:53.976404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:53.976946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:54.097190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:54.100714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:54.133479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:54.141430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:54.146833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:54.147985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:54.148715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:54.154777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:54.524232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:54.536787 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83c08a5e-b8e3-46d5-b8d6-13c127cb2ae8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 200 len: 1515 microversion: 2.1 time: 0.640068 Oct 17 15:57:54.537755 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2986/5721] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:53 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 1515 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:54.567496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:54.567845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:54.581639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:54.584501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:54.585190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:54.587485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:54.589971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:54.590662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:54.941714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:54.963624 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-299a247e-1e64-4db6-bc78-6e2b688c2c0f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4" status: 200 len: 1322 microversion: 2.1 time: 0.401438 Oct 17 15:57:54.970486 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2987/5722] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:54 2022] GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:55.179232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:55.230259 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5f7b3ab0-88c9-428f-beb1-4c4ce4120b23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1373 microversion: 2.1 time: 1.134903 Oct 17 15:57:55.237605 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2736/5723] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:54 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1373 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:56.013168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:56.019122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:56.068372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:56.069233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:56.069984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:56.076966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:56.078065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:56.082899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:56.172431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-7957e281-c3dc-4552-9e69-4d3c0f6cb361 req-5d594afd-db5b-47b1-a9ed-db80446bc303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe903d81-8be2-4324-bda5-0f8a7b0a72b4", "name": "network-vif-plugged", "status": "completed", "tag": "0fa8d9a4-6c21-4523-ad8d-387df21a8fe2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:56.222256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7957e281-c3dc-4552-9e69-4d3c0f6cb361 req-5d594afd-db5b-47b1-a9ed-db80446bc303 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:56.224648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7957e281-c3dc-4552-9e69-4d3c0f6cb361 req-5d594afd-db5b-47b1-a9ed-db80446bc303 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:56.225862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7957e281-c3dc-4552-9e69-4d3c0f6cb361 req-5d594afd-db5b-47b1-a9ed-db80446bc303 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:56.261667 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-7957e281-c3dc-4552-9e69-4d3c0f6cb361 req-5d594afd-db5b-47b1-a9ed-db80446bc303 service nova] Creating event network-vif-plugged:0fa8d9a4-6c21-4523-ad8d-387df21a8fe2 for instance fe903d81-8be2-4324-bda5-0f8a7b0a72b4 on n-h1-854441-12 Oct 17 15:57:56.276764 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-7957e281-c3dc-4552-9e69-4d3c0f6cb361 req-5d594afd-db5b-47b1-a9ed-db80446bc303 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110905 Oct 17 15:57:56.279323 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2737/5724] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:57:56.294043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:56.296077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:56.331802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:56.337833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:56.340484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:56.342821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:56.347237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:56.349447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:57.138073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:57.156537 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-17d650ba-a8f7-4e72-ba61-744889a4aef9 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1546 microversion: 2.1 time: 0.872497 Oct 17 15:57:57.157433 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2738/5725] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:56 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1546 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:57.200281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:57.214451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:57.275971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:57.279701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:57.280583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:57.285684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:57.286684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:57.289080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:57.370161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:57.386081 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82f4c233-9596-49f8-8e58-e7cd919229e7 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4" status: 200 len: 1322 microversion: 2.1 time: 1.402007 Oct 17 15:57:57.387403 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2988/5726] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:55 2022] GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 => generated 1322 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:57:57.860047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:57.874255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-934bfef4-c0c8-4d13-97f0-44f8f3936644 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1546 microversion: 2.1 time: 0.685614 Oct 17 15:57:57.875810 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2739/5727] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:57 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1546 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:57:58.405686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d7e702ab-ddd3-4797-973f-83ab1fed17e7 req-36c178c7-d2f3-4d2e-974f-47548c1adcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8457fdd6-3a84-4899-8d62-7de827b71e36", "name": "network-vif-plugged", "status": "completed", "tag": "40f0bd51-80a8-4df6-a2f5-8a0ca1710d89"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:57:58.417775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:57:58.426031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:57:58.452486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:58.453570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:58.460016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:58.462129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:58.463207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:58.464133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d7e702ab-ddd3-4797-973f-83ab1fed17e7 req-36c178c7-d2f3-4d2e-974f-47548c1adcdc service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:57:58.465152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:58.466531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d7e702ab-ddd3-4797-973f-83ab1fed17e7 req-36c178c7-d2f3-4d2e-974f-47548c1adcdc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:57:58.472411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d7e702ab-ddd3-4797-973f-83ab1fed17e7 req-36c178c7-d2f3-4d2e-974f-47548c1adcdc service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:57:58.547110 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d7e702ab-ddd3-4797-973f-83ab1fed17e7 req-36c178c7-d2f3-4d2e-974f-47548c1adcdc service nova] Creating event network-vif-plugged:40f0bd51-80a8-4df6-a2f5-8a0ca1710d89 for instance 8457fdd6-3a84-4899-8d62-7de827b71e36 on n-h2-854441-12 Oct 17 15:57:58.564670 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d7e702ab-ddd3-4797-973f-83ab1fed17e7 req-36c178c7-d2f3-4d2e-974f-47548c1adcdc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174060 Oct 17 15:57:58.568562 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2989/5728] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:57:59.071261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:57:59.095773 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c92b1da2-2f3c-43a0-9580-76f5ccb393ff tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4" status: 200 len: 1322 microversion: 2.1 time: 0.684643 Oct 17 15:57:59.096958 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2740/5729] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:57:58 2022] GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:00.128110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:00.129662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:00.151501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:00.159440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:00.161511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:00.165171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:00.176220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:00.177411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:00.734141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:00.762879 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1202e58-5800-4a90-9302-4e6d317b10b3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4" status: 200 len: 1515 microversion: 2.1 time: 0.639454 Oct 17 15:58:00.764316 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2990/5730] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:00 2022] GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 => generated 1515 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:00.818876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:00.821092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:00.864726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:00.867492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:00.868409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:00.869912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:00.870886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:00.871813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:02.761217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:02.774722 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4a501d24-0b1f-4c6b-b791-bff960ba0a31 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36" status: 200 len: 1515 microversion: 2.1 time: 1.964616 Oct 17 15:58:02.785973 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2741/5731] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:00 2022] GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 => generated 1515 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:02.802848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:02.803480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:02.813085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:02.814037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:02.814885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:02.817200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:02.818059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:02.818918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:02.876899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:58:02.901683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:02.902614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:02.917955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:02.923050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:02.923881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:02.925656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:02.927599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:02.928312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:03.211230 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-48e6f7f8-6cd9-4e82-b470-b3a9e54fefd1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36" status: 204 len: 0 microversion: 2.1 time: 0.411458 Oct 17 15:58:03.213648 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2991/5732] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:58:02 2022] DELETE /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:58:03.224707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lazy-loading 'services' on Instance uuid 8dd185b3-a95a-4603-9860-18ca741ec903 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:58:03.234561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:03.235274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:03.251367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:03.251702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:03.252172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:03.253493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:03.253493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:03.253868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:03.555015 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-db80d678-4095-4784-a87d-79ba2ade8321 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments/d43b1a52-5810-4ecf-9c22-6a40ec6a6a1a" status: 202 len: 0 microversion: 2.1 time: 0.660510 Oct 17 15:58:03.556140 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2742/5733] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 15:58:02 2022] DELETE /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments/d43b1a52-5810-4ecf-9c22-6a40ec6a6a1a => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:58:03.610834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f0f67ce0-35c6-412e-8e02-2583f67774ee tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:03.617759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f0f67ce0-35c6-412e-8e02-2583f67774ee tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:03.663717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f67ce0-35c6-412e-8e02-2583f67774ee tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:03.673511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f67ce0-35c6-412e-8e02-2583f67774ee tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:03.674983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f67ce0-35c6-412e-8e02-2583f67774ee tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:03.678249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f67ce0-35c6-412e-8e02-2583f67774ee tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:03.679714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f67ce0-35c6-412e-8e02-2583f67774ee tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:03.682711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0f67ce0-35c6-412e-8e02-2583f67774ee tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:03.775955 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f0f67ce0-35c6-412e-8e02-2583f67774ee tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191410 Oct 17 15:58:03.776849 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2743/5734] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:03 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:04.217503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:04.232416 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee99f23f-0fcc-483b-be18-6d85e120cc5b tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36" status: 200 len: 1521 microversion: 2.1 time: 1.010274 Oct 17 15:58:04.234327 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2992/5735] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:03 2022] GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 => generated 1521 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:04.795109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c271a84-96df-42dd-8f84-1a1293b10fa5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:04.797818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c271a84-96df-42dd-8f84-1a1293b10fa5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:04.825585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c271a84-96df-42dd-8f84-1a1293b10fa5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:04.826264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c271a84-96df-42dd-8f84-1a1293b10fa5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:04.826875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c271a84-96df-42dd-8f84-1a1293b10fa5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:04.828304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c271a84-96df-42dd-8f84-1a1293b10fa5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:04.829375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c271a84-96df-42dd-8f84-1a1293b10fa5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:04.830121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c271a84-96df-42dd-8f84-1a1293b10fa5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:04.949832 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c271a84-96df-42dd-8f84-1a1293b10fa5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157999 Oct 17 15:58:04.951956 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2744/5736] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:04 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:58:05.283811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:05.284877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:05.318396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:05.318949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:05.319507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:05.320151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:05.320615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:05.321045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:05.969614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b9402f3f-d742-470b-b86d-330d35edfbef tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:05.973022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b9402f3f-d742-470b-b86d-330d35edfbef tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:05.993053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9402f3f-d742-470b-b86d-330d35edfbef tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:05.993847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9402f3f-d742-470b-b86d-330d35edfbef tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:05.996641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9402f3f-d742-470b-b86d-330d35edfbef tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:05.998139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9402f3f-d742-470b-b86d-330d35edfbef tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:05.999105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9402f3f-d742-470b-b86d-330d35edfbef tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:06.002309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9402f3f-d742-470b-b86d-330d35edfbef tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:06.073945 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b9402f3f-d742-470b-b86d-330d35edfbef tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108801 Oct 17 15:58:06.075395 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2745/5737] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:05 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:06.938647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:06.964166 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0705819e-726c-4727-b9c3-dacdffc254b2 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36" status: 200 len: 1521 microversion: 2.1 time: 1.688443 Oct 17 15:58:06.971317 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2993/5738] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:05 2022] GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 => generated 1521 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:07.092153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-093bac34-d225-44a5-9aad-c93cf170884d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:07.095553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-093bac34-d225-44a5-9aad-c93cf170884d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:07.114722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-093bac34-d225-44a5-9aad-c93cf170884d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:07.119912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-093bac34-d225-44a5-9aad-c93cf170884d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:07.120578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-093bac34-d225-44a5-9aad-c93cf170884d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:07.121612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-093bac34-d225-44a5-9aad-c93cf170884d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:07.125802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-093bac34-d225-44a5-9aad-c93cf170884d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:07.127044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-093bac34-d225-44a5-9aad-c93cf170884d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:07.265988 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-093bac34-d225-44a5-9aad-c93cf170884d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170611 Oct 17 15:58:07.276607 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2746/5739] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:07 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:07.582465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2af52146-b2b0-4e02-9220-bcdb80008095 req-a2ae5978-a900-4579-a071-cefb8310550e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8457fdd6-3a84-4899-8d62-7de827b71e36", "name": "network-vif-deleted", "tag": "40f0bd51-80a8-4df6-a2f5-8a0ca1710d89"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:58:07.675579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2af52146-b2b0-4e02-9220-bcdb80008095 req-a2ae5978-a900-4579-a071-cefb8310550e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:07.676476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2af52146-b2b0-4e02-9220-bcdb80008095 req-a2ae5978-a900-4579-a071-cefb8310550e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:07.677268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2af52146-b2b0-4e02-9220-bcdb80008095 req-a2ae5978-a900-4579-a071-cefb8310550e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:07.787962 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2af52146-b2b0-4e02-9220-bcdb80008095 req-a2ae5978-a900-4579-a071-cefb8310550e service nova] Creating event network-vif-deleted:40f0bd51-80a8-4df6-a2f5-8a0ca1710d89 for instance 8457fdd6-3a84-4899-8d62-7de827b71e36 on n-h2-854441-12 Oct 17 15:58:07.805333 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2af52146-b2b0-4e02-9220-bcdb80008095 req-a2ae5978-a900-4579-a071-cefb8310550e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241067 Oct 17 15:58:07.811296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2994/5740] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:08.024746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:08.028478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:08.058080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:08.059639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:08.060910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:08.065504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:08.073161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:08.075473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:08.222488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:08.238133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:08.241406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:08.242739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lazy-loading 'fault' on Instance uuid 8457fdd6-3a84-4899-8d62-7de827b71e36 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:58:08.302757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-66a59bc2-7420-41ce-86c1-59ce8f6384fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:08.309908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-66a59bc2-7420-41ce-86c1-59ce8f6384fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:08.341244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a59bc2-7420-41ce-86c1-59ce8f6384fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:08.341760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a59bc2-7420-41ce-86c1-59ce8f6384fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:08.342215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a59bc2-7420-41ce-86c1-59ce8f6384fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:08.343008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a59bc2-7420-41ce-86c1-59ce8f6384fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:08.343474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a59bc2-7420-41ce-86c1-59ce8f6384fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:08.343907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-66a59bc2-7420-41ce-86c1-59ce8f6384fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:08.461886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:08.475688 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-66a59bc2-7420-41ce-86c1-59ce8f6384fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185033 Oct 17 15:58:08.490964 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2995/5741] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:08 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:08.507234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:08.519388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a602d41-3963-47b7-9221-adc33aebf7e9 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36" status: 200 len: 1312 microversion: 2.1 time: 0.504355 Oct 17 15:58:08.528929 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2747/5742] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:08 2022] GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 => generated 1312 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:09.502676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eca66475-f9cd-44f5-817a-0ef92677ed84 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:09.511750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eca66475-f9cd-44f5-817a-0ef92677ed84 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:09.538231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca66475-f9cd-44f5-817a-0ef92677ed84 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:09.541825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca66475-f9cd-44f5-817a-0ef92677ed84 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:09.542542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca66475-f9cd-44f5-817a-0ef92677ed84 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:09.543933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca66475-f9cd-44f5-817a-0ef92677ed84 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:09.544761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca66475-f9cd-44f5-817a-0ef92677ed84 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:09.545405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eca66475-f9cd-44f5-817a-0ef92677ed84 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:09.571287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:09.572677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:09.602689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:09.603513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:09.604185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:09.605200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:09.608786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:09.609493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:09.662935 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] HTTP exception thrown: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Request method failure captured: Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 HTTP/1.1 Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXtZ16srrDGffSzK_pX3tXyIBn1MuiDvjsgfRUuFgFc5XUcQRjAbiADIED6kKbtB46Uwj_TjUi279sGnWQLvfe-NaJlXQpUaYEioPf2BjVAPyfvbj-ZFyiunHX6mws3h73u6oPiq62NX4-oci2ouKQz4WySPaHj93GZYNvEgQ2YbBug Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8b7953dc90864760924cf059873bcb15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8b7953dc90864760924cf059873bcb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 316bf11b6d044bb29ae004cd27f22cfd Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '8457fdd6-3a84-4899-8d62-7de827b71e36'} Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:09.665303 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:09.672039 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:09.672039 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:09.672039 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:09.672039 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:09.672039 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:58:09.672039 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:58:09.672039 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:09.672039 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:09.674124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Returning 404 to user: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:09.675308 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-edf1efec-095f-48bb-bc9b-8534062585b1 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36" status: 404 len: 111 microversion: 2.1 time: 0.115991 Oct 17 15:58:09.681763 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2748/5743] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:09 2022] GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:58:09.697325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:09.722941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:09.724776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '8b7953dc90864760924cf059873bcb15'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:58:09.752040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:09.761699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:09.762814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:09.763960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:09.764795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:09.765542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:09.806143 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eca66475-f9cd-44f5-817a-0ef92677ed84 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.312340 Oct 17 15:58:09.814785 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2996/5744] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:09 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:10.078558 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-38b448ec-8e7b-4207-966e-bed3f6afb629 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.388374 Oct 17 15:58:10.080048 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2749/5745] 10.222.0.87 () {58 vars in 1230 bytes} [Mon Oct 17 15:58:09 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 15:58:10.106767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e08a4612-c145-4f97-a741-4bf859cbf5c3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e08a4612-c145-4f97-a741-4bf859cbf5c3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Request method failure captured: Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXtZ16srrDGffSzK_pX3tXyIBn1MuiDvjsgfRUuFgFc5XUcQRjAbiADIED6kKbtB46Uwj_TjUi279sGnWQLvfe-NaJlXQpUaYEioPf2BjVAPyfvbj-ZFyiunHX6mws3h73u6oPiq62NX4-oci2ouKQz4WySPaHj93GZYNvEgQ2YbBug Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8b7953dc90864760924cf059873bcb15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8b7953dc90864760924cf059873bcb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 316bf11b6d044bb29ae004cd27f22cfd Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: action_args: {} Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 15:58:10.113673 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 15:58:10.117678 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.125412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e08a4612-c145-4f97-a741-4bf859cbf5c3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:10.136051 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e08a4612-c145-4f97-a741-4bf859cbf5c3 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.031720 Oct 17 15:58:10.142436 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2997/5746] 10.222.0.87 () {58 vars in 1182 bytes} [Mon Oct 17 15:58:10 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:58:10.159158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:10.171234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:10.172889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Searching by: {'deleted': False, 'project_id': '8b7953dc90864760924cf059873bcb15'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:58:10.194191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=46 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:10.199665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:10.200823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:10.201846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:10.203519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:10.204824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:10.206298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:10.278346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:58:10.370341 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3bfc1296-6940-40bb-bb41-b47f88385f15 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.219117 Oct 17 15:58:10.371638 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2750/5747] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:58:10 2022] GET /compute/v2.1/servers => generated 681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:10.395183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:10.401441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:10.402271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.compute.servers [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Removing options 'limit' from query {{(pid=120406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 15:58:10.403402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Searching by: {'deleted': False, 'project_id': '8b7953dc90864760924cf059873bcb15'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:58:10.414251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:10.415047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:10.415688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:10.418367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:10.419056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:10.419667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:10.479993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:58:10.491366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:10.661858 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47029119-797f-41c8-888a-0e470e4ec4a8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.260485 Oct 17 15:58:10.663940 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2998/5748] 10.222.0.87 () {58 vars in 1144 bytes} [Mon Oct 17 15:58:10 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:10.683636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c1da1348-1e2e-4cd9-88ff-1e6a6ddac821 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c1da1348-1e2e-4cd9-88ff-1e6a6ddac821 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Request method failure captured: Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXtZ16srrDGffSzK_pX3tXyIBn1MuiDvjsgfRUuFgFc5XUcQRjAbiADIED6kKbtB46Uwj_TjUi279sGnWQLvfe-NaJlXQpUaYEioPf2BjVAPyfvbj-ZFyiunHX6mws3h73u6oPiq62NX4-oci2ouKQz4WySPaHj93GZYNvEgQ2YbBug Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8b7953dc90864760924cf059873bcb15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8b7953dc90864760924cf059873bcb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 316bf11b6d044bb29ae004cd27f22cfd Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: action_args: {} Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '-1' Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 15:58:10.700847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.711608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c1da1348-1e2e-4cd9-88ff-1e6a6ddac821 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:10.717968 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c1da1348-1e2e-4cd9-88ff-1e6a6ddac821 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.037735 Oct 17 15:58:10.717968 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2751/5749] 10.222.0.87 () {58 vars in 1142 bytes} [Mon Oct 17 15:58:10 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:58:10.728478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a5a8cd9-0724-42bb-bb18-5921af948038 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a5a8cd9-0724-42bb-bb18-5921af948038 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Request method failure captured: Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXtZ16srrDGffSzK_pX3tXyIBn1MuiDvjsgfRUuFgFc5XUcQRjAbiADIED6kKbtB46Uwj_TjUi279sGnWQLvfe-NaJlXQpUaYEioPf2BjVAPyfvbj-ZFyiunHX6mws3h73u6oPiq62NX4-oci2ouKQz4WySPaHj93GZYNvEgQ2YbBug Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8b7953dc90864760924cf059873bcb15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8b7953dc90864760924cf059873bcb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 316bf11b6d044bb29ae004cd27f22cfd Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: action_args: {} Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise error Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi 'testing' Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 15:58:10.737115 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a5a8cd9-0724-42bb-bb18-5921af948038 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a5a8cd9-0724-42bb-bb18-5921af948038 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016622 Oct 17 15:58:10.748724 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 2999/5750] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 15:58:10 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 15:58:10.755397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4910a8db-84c2-4c25-a861-1865bbcbbbcd tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:10.766689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4910a8db-84c2-4c25-a861-1865bbcbbbcd tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:10.766988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4910a8db-84c2-4c25-a861-1865bbcbbbcd tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '8b7953dc90864760924cf059873bcb15'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:58:10.795614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.compute.servers [None req-4910a8db-84c2-4c25-a861-1865bbcbbbcd tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Flavor 'non_existing_flavor' could not be found {{(pid=120407) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 17 15:58:10.796732 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4910a8db-84c2-4c25-a861-1865bbcbbbcd tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.047136 Oct 17 15:58:10.814085 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2752/5751] 10.222.0.87 () {58 vars in 1178 bytes} [Mon Oct 17 15:58:10 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:58:10.816210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:10.823959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:10.824773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '8b7953dc90864760924cf059873bcb15'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:58:10.841400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-91ef4908-c1bd-41c4-b5e4-60db2c9f19e8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:10.846336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-91ef4908-c1bd-41c4-b5e4-60db2c9f19e8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:10.848847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:10.851266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:10.854151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:10.856829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:10.861497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:10.862351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:10.873723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91ef4908-c1bd-41c4-b5e4-60db2c9f19e8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:10.874229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91ef4908-c1bd-41c4-b5e4-60db2c9f19e8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:10.874702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91ef4908-c1bd-41c4-b5e4-60db2c9f19e8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:10.875420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91ef4908-c1bd-41c4-b5e4-60db2c9f19e8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:10.876391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91ef4908-c1bd-41c4-b5e4-60db2c9f19e8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:10.888586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91ef4908-c1bd-41c4-b5e4-60db2c9f19e8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:11.024219 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-91ef4908-c1bd-41c4-b5e4-60db2c9f19e8 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202343 Oct 17 15:58:11.036393 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2753/5752] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:10 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:11.095275 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6da5018d-5cec-4af0-831f-b887f406cc17 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.281317 Oct 17 15:58:11.095985 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3000/5753] 10.222.0.87 () {58 vars in 1174 bytes} [Mon Oct 17 15:58:10 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:58:11.117364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:11.129701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:11.135732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '8b7953dc90864760924cf059873bcb15'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:58:11.155982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:11.162155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:11.164601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:11.169217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:11.174203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:11.175334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:11.544655 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-be5fb3db-2cde-4200-a874-d4e84875800d tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.431648 Oct 17 15:58:11.551246 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2754/5754] 10.222.0.87 () {58 vars in 1184 bytes} [Mon Oct 17 15:58:11 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 15:58:11.581662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:11.602617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:11.609612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Searching by: {'deleted': False, 'project_id': '8b7953dc90864760924cf059873bcb15'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:58:11.637230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:11.637890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:11.638353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:11.639278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:11.639670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:11.640106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:11.738876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:58:11.854082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:11.873978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:11.876160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:11.877119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:12.049474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95379599-6c8a-4382-8346-756be75101d5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:12.057770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-95379599-6c8a-4382-8346-756be75101d5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:12.091445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95379599-6c8a-4382-8346-756be75101d5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:12.092561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95379599-6c8a-4382-8346-756be75101d5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:12.093565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95379599-6c8a-4382-8346-756be75101d5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:12.095355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95379599-6c8a-4382-8346-756be75101d5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:12.096509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95379599-6c8a-4382-8346-756be75101d5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:12.097491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95379599-6c8a-4382-8346-756be75101d5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:12.176502 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95379599-6c8a-4382-8346-756be75101d5 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135132 Oct 17 15:58:12.178232 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2755/5755] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:12 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:58:12.826817 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7bf486b3-f6f4-4272-ab52-845e8c4441ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 1.253841 Oct 17 15:58:12.827824 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3001/5756] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 15:58:11 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:12.859153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2821bdf4-66aa-43fb-9883-c4c1ac9703ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:12.864691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2821bdf4-66aa-43fb-9883-c4c1ac9703ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:12.865752 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2821bdf4-66aa-43fb-9883-c4c1ac9703ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010910 Oct 17 15:58:12.876585 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2756/5757] 10.222.0.87 () {58 vars in 1178 bytes} [Mon Oct 17 15:58:12 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:58:12.882552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:12.888320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:12.889759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Searching by: {'deleted': False, 'project_id': '8b7953dc90864760924cf059873bcb15'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:58:12.896112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:12.896917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:12.897532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:12.898557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:12.899207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:12.899838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:12.960630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 15:58:13.045058 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-366731c8-99d2-4974-a272-b52d7125b33f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.166800 Oct 17 15:58:13.053972 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3002/5758] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:58:12 2022] GET /compute/v2.1/servers => generated 681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:13.074887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:13.076114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:13.086254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:13.094375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:13.095844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:13.096861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:13.097708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:13.098327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:13.159825 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] HTTP exception thrown: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Request method failure captured: Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 HTTP/1.1 Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXtZ16srrDGffSzK_pX3tXyIBn1MuiDvjsgfRUuFgFc5XUcQRjAbiADIED6kKbtB46Uwj_TjUi279sGnWQLvfe-NaJlXQpUaYEioPf2BjVAPyfvbj-ZFyiunHX6mws3h73u6oPiq62NX4-oci2ouKQz4WySPaHj93GZYNvEgQ2YbBug Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8b7953dc90864760924cf059873bcb15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8b7953dc90864760924cf059873bcb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 316bf11b6d044bb29ae004cd27f22cfd Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '8457fdd6-3a84-4899-8d62-7de827b71e36'} Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:58:13.161601 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:13.166198 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:13.169022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Returning 404 to user: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:13.170114 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-91b9c88e-9d1a-4745-8515-cc572b171973 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36" status: 404 len: 111 microversion: 2.1 time: 0.099711 Oct 17 15:58:13.171141 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2757/5759] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:58:13 2022] DELETE /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:58:13.180836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:13.181614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:13.196737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:13.200914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:13.209370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:13.209982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:13.210734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:13.211191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:13.211964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d05b426-0c14-4ff4-883f-cea977813592 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:13.214484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d05b426-0c14-4ff4-883f-cea977813592 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:13.215448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:13.248519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d05b426-0c14-4ff4-883f-cea977813592 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:13.249052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d05b426-0c14-4ff4-883f-cea977813592 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:13.249710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d05b426-0c14-4ff4-883f-cea977813592 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:13.250684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d05b426-0c14-4ff4-883f-cea977813592 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:13.251701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d05b426-0c14-4ff4-883f-cea977813592 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:13.252738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d05b426-0c14-4ff4-883f-cea977813592 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:13.351385 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1d05b426-0c14-4ff4-883f-cea977813592 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159662 Oct 17 15:58:13.369591 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2758/5760] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:13 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:13.392332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:58:13.807529 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4a21ba4-092e-4d8c-91da-b93f58124241 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "DELETE /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4" status: 204 len: 0 microversion: 2.1 time: 0.614658 Oct 17 15:58:13.809959 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3003/5761] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:58:13 2022] DELETE /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:58:13.823437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:13.824391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:13.841763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:13.842224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:13.843811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:13.848425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:13.850117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:13.851449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:13.980389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:58:14.255751 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4eb0c046-3d70-4e11-8487-4674de7bd733 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 204 len: 0 microversion: 2.1 time: 0.440371 Oct 17 15:58:14.256843 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2759/5762] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:58:13 2022] DELETE /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:58:14.292026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:14.295764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 8457fdd6-3a84-4899-8d62-7de827b71e36] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:14.309844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:14.311339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:14.313363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:14.316262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:14.317503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:14.318695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:14.352400 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] HTTP exception thrown: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Request method failure captured: Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 HTTP/1.1 Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXtZ16srrDGffSzK_pX3tXyIBn1MuiDvjsgfRUuFgFc5XUcQRjAbiADIED6kKbtB46Uwj_TjUi279sGnWQLvfe-NaJlXQpUaYEioPf2BjVAPyfvbj-ZFyiunHX6mws3h73u6oPiq62NX4-oci2ouKQz4WySPaHj93GZYNvEgQ2YbBug Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8b7953dc90864760924cf059873bcb15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8b7953dc90864760924cf059873bcb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 316bf11b6d044bb29ae004cd27f22cfd Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8457fdd6-3a84-4899-8d62-7de827b71e36'} Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:14.356871 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:14.369166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:14.369166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:14.369166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:14.369166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:14.369166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:58:14.369166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:58:14.369166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. Oct 17 15:58:14.369166 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:14.372238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Returning 404 to user: Instance 8457fdd6-3a84-4899-8d62-7de827b71e36 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:14.378118 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbd1b56f-f15e-446d-9706-6afb947b3267 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36" status: 404 len: 111 microversion: 2.1 time: 0.097142 Oct 17 15:58:14.380047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8139986f-07e6-47ec-be02-d46470a02c47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:14.380696 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3004/5763] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:14 2022] GET /compute/v2.1/servers/8457fdd6-3a84-4899-8d62-7de827b71e36 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:58:14.393900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8139986f-07e6-47ec-be02-d46470a02c47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:14.397649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:14.399126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:14.417645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:14.419690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:14.420680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:14.422017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:14.422885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:14.423859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:15.239656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8139986f-07e6-47ec-be02-d46470a02c47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:15.240365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8139986f-07e6-47ec-be02-d46470a02c47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:15.241004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8139986f-07e6-47ec-be02-d46470a02c47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:15.242044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8139986f-07e6-47ec-be02-d46470a02c47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:15.242897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8139986f-07e6-47ec-be02-d46470a02c47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:15.243590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8139986f-07e6-47ec-be02-d46470a02c47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:15.311555 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8139986f-07e6-47ec-be02-d46470a02c47 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.936991 Oct 17 15:58:15.323711 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2760/5764] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:14 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:58:16.152970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:16.169317 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe19ede7-0bc8-412e-8c55-2416223918c8 tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4" status: 200 len: 1521 microversion: 2.1 time: 1.783193 Oct 17 15:58:16.169940 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3005/5765] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:14 2022] GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 => generated 1521 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:16.336291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-27f7c198-ec29-42ea-b4a9-e95451ac6a2d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:16.342272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-27f7c198-ec29-42ea-b4a9-e95451ac6a2d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:16.361801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27f7c198-ec29-42ea-b4a9-e95451ac6a2d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:16.363589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27f7c198-ec29-42ea-b4a9-e95451ac6a2d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:16.364806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27f7c198-ec29-42ea-b4a9-e95451ac6a2d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:16.366988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27f7c198-ec29-42ea-b4a9-e95451ac6a2d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:16.368240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27f7c198-ec29-42ea-b4a9-e95451ac6a2d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:16.369256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-27f7c198-ec29-42ea-b4a9-e95451ac6a2d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:16.527108 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-27f7c198-ec29-42ea-b4a9-e95451ac6a2d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202565 Oct 17 15:58:16.537873 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2761/5766] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:16 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:17.210537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:17.212043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:17.230104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:17.231357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:17.232347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:17.233953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:17.235395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:17.236101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:17.546016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b31055d-28ab-481d-aa4c-39050aa429dd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:17.552096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2b31055d-28ab-481d-aa4c-39050aa429dd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:17.568807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b31055d-28ab-481d-aa4c-39050aa429dd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:17.572806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b31055d-28ab-481d-aa4c-39050aa429dd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:17.575503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b31055d-28ab-481d-aa4c-39050aa429dd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:17.580252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b31055d-28ab-481d-aa4c-39050aa429dd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:17.581357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b31055d-28ab-481d-aa4c-39050aa429dd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:17.585180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b31055d-28ab-481d-aa4c-39050aa429dd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:17.638787 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2b31055d-28ab-481d-aa4c-39050aa429dd tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099083 Oct 17 15:58:17.639882 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2762/5767] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:17 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:18.098307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:18.153099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6556efb0-2b8e-422e-ae59-07a28571b55f tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4" status: 200 len: 1521 microversion: 2.1 time: 0.948083 Oct 17 15:58:18.164641 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3006/5768] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:17 2022] GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 => generated 1521 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:18.277109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-358fbb91-4a54-4239-b633-fd127ea9e5f5 req-f34ccecf-6ece-4620-87c6-f52bc106cb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe903d81-8be2-4324-bda5-0f8a7b0a72b4", "name": "network-vif-deleted", "tag": "0fa8d9a4-6c21-4523-ad8d-387df21a8fe2"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:58:18.297541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-358fbb91-4a54-4239-b633-fd127ea9e5f5 req-f34ccecf-6ece-4620-87c6-f52bc106cb3a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:18.298319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-358fbb91-4a54-4239-b633-fd127ea9e5f5 req-f34ccecf-6ece-4620-87c6-f52bc106cb3a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:18.299274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-358fbb91-4a54-4239-b633-fd127ea9e5f5 req-f34ccecf-6ece-4620-87c6-f52bc106cb3a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:18.329211 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-358fbb91-4a54-4239-b633-fd127ea9e5f5 req-f34ccecf-6ece-4620-87c6-f52bc106cb3a service nova] Creating event network-vif-deleted:0fa8d9a4-6c21-4523-ad8d-387df21a8fe2 for instance fe903d81-8be2-4324-bda5-0f8a7b0a72b4 on n-h1-854441-12 Oct 17 15:58:18.346292 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-358fbb91-4a54-4239-b633-fd127ea9e5f5 req-f34ccecf-6ece-4620-87c6-f52bc106cb3a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073241 Oct 17 15:58:18.349905 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2763/5769] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:58:18.657640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2dbe0143-5433-4e0a-91b9-cdaa5ef206f4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:18.664613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2dbe0143-5433-4e0a-91b9-cdaa5ef206f4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:18.678263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dbe0143-5433-4e0a-91b9-cdaa5ef206f4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:18.680227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dbe0143-5433-4e0a-91b9-cdaa5ef206f4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:18.685664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dbe0143-5433-4e0a-91b9-cdaa5ef206f4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:18.687155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dbe0143-5433-4e0a-91b9-cdaa5ef206f4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:18.687893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dbe0143-5433-4e0a-91b9-cdaa5ef206f4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:18.688582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2dbe0143-5433-4e0a-91b9-cdaa5ef206f4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:18.772177 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2dbe0143-5433-4e0a-91b9-cdaa5ef206f4 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123839 Oct 17 15:58:18.773517 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3007/5770] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:18 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:19.233459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:19.237455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:19.297758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:19.301093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:19.309011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:19.317456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:19.320960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:19.324141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:19.471079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:19.477140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:19.477746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:19.479232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lazy-loading 'fault' on Instance uuid fe903d81-8be2-4324-bda5-0f8a7b0a72b4 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:58:19.620229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316bf11b6d044bb29ae004cd27f22cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7953dc90864760924cf059873bcb15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:19.632734 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6253bb5e-830d-419d-9fc8-2504c20d101a tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4" status: 200 len: 1312 microversion: 2.1 time: 0.415751 Oct 17 15:58:19.647509 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2764/5771] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:19 2022] GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 => generated 1312 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:19.789451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be77ff42-065c-4e1e-86eb-cf9f4f40ca86 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:19.792146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be77ff42-065c-4e1e-86eb-cf9f4f40ca86 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:19.820531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be77ff42-065c-4e1e-86eb-cf9f4f40ca86 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:19.821046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be77ff42-065c-4e1e-86eb-cf9f4f40ca86 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:19.821500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be77ff42-065c-4e1e-86eb-cf9f4f40ca86 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:19.822257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be77ff42-065c-4e1e-86eb-cf9f4f40ca86 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:19.830935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be77ff42-065c-4e1e-86eb-cf9f4f40ca86 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:19.831570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be77ff42-065c-4e1e-86eb-cf9f4f40ca86 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:19.957243 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be77ff42-065c-4e1e-86eb-cf9f4f40ca86 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174450 Oct 17 15:58:19.958611 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3008/5772] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:19 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:20.384927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-3a508477-419a-4a36-90a6-2bea58f7ee3a req-28732611-2b99-42b8-a3db-dbf592d5e450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6823d76e-ff20-4cf5-88ab-94c86d1cd0f9", "name": "network-vif-deleted", "tag": "8bd9488c-09ae-4955-85e7-012ea3b75781"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:58:20.399137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3a508477-419a-4a36-90a6-2bea58f7ee3a req-28732611-2b99-42b8-a3db-dbf592d5e450 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:20.399974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3a508477-419a-4a36-90a6-2bea58f7ee3a req-28732611-2b99-42b8-a3db-dbf592d5e450 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:20.400655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3a508477-419a-4a36-90a6-2bea58f7ee3a req-28732611-2b99-42b8-a3db-dbf592d5e450 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:20.418906 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-3a508477-419a-4a36-90a6-2bea58f7ee3a req-28732611-2b99-42b8-a3db-dbf592d5e450 service nova] Creating event network-vif-deleted:8bd9488c-09ae-4955-85e7-012ea3b75781 for instance 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 on n-h2-854441-12 Oct 17 15:58:20.427096 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-3a508477-419a-4a36-90a6-2bea58f7ee3a req-28732611-2b99-42b8-a3db-dbf592d5e450 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047206 Oct 17 15:58:20.428585 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2765/5773] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:20.699630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:20.700481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: fe903d81-8be2-4324-bda5-0f8a7b0a72b4] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:20.713772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:20.717174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:20.717829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:20.720283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:20.721080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:20.722563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:20.771961 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] HTTP exception thrown: Instance fe903d81-8be2-4324-bda5-0f8a7b0a72b4 could not be found. Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Request method failure captured: Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 HTTP/1.1 Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXtZ16srrDGffSzK_pX3tXyIBn1MuiDvjsgfRUuFgFc5XUcQRjAbiADIED6kKbtB46Uwj_TjUi279sGnWQLvfe-NaJlXQpUaYEioPf2BjVAPyfvbj-ZFyiunHX6mws3h73u6oPiq62NX4-oci2ouKQz4WySPaHj93GZYNvEgQ2YbBug Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8b7953dc90864760924cf059873bcb15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8b7953dc90864760924cf059873bcb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 316bf11b6d044bb29ae004cd27f22cfd Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance fe903d81-8be2-4324-bda5-0f8a7b0a72b4 could not be found. Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'fe903d81-8be2-4324-bda5-0f8a7b0a72b4'} Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe903d81-8be2-4324-bda5-0f8a7b0a72b4 could not be found. Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe903d81-8be2-4324-bda5-0f8a7b0a72b4 could not be found. Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.773610 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe903d81-8be2-4324-bda5-0f8a7b0a72b4 could not be found. Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Returning 404 to user: Instance fe903d81-8be2-4324-bda5-0f8a7b0a72b4 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:20.777835 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed49832b-3053-4483-aa88-593f07c3f40e tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4" status: 404 len: 111 microversion: 2.1 time: 0.081053 Oct 17 15:58:20.787126 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3009/5774] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:20 2022] GET /compute/v2.1/servers/fe903d81-8be2-4324-bda5-0f8a7b0a72b4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:58:20.803342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:20.804625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] [instance: 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:20.824049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:20.824956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:20.825662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:20.826794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:20.827549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:20.828218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:20.858062 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] HTTP exception thrown: Instance 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 could not be found. Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Request method failure captured: Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 HTTP/1.1 Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXtZ16srrDGffSzK_pX3tXyIBn1MuiDvjsgfRUuFgFc5XUcQRjAbiADIED6kKbtB46Uwj_TjUi279sGnWQLvfe-NaJlXQpUaYEioPf2BjVAPyfvbj-ZFyiunHX6mws3h73u6oPiq62NX4-oci2ouKQz4WySPaHj93GZYNvEgQ2YbBug Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8b7953dc90864760924cf059873bcb15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8b7953dc90864760924cf059873bcb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8b7953dc90864760924cf059873bcb15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8b7953dc90864760924cf059873bcb15 Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1030640935 Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 316bf11b6d044bb29ae004cd27f22cfd Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ListServersNegativeTestJSON-1030640935-project Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 could not be found. Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6823d76e-ff20-4cf5-88ab-94c86d1cd0f9'} Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 could not be found. Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 could not be found. Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.860473 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:20.864357 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.864357 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:20.864357 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:20.864357 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:20.864357 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:58:20.864357 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:58:20.864357 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 could not be found. Oct 17 15:58:20.864357 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:20.868135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] Returning 404 to user: Instance 6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:20.870271 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e900f79e-071d-4698-be3f-0443613802ee tempest-ListServersNegativeTestJSON-1030640935 tempest-ListServersNegativeTestJSON-1030640935-project] 10.222.0.87 "GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9" status: 404 len: 111 microversion: 2.1 time: 0.078846 Oct 17 15:58:20.872579 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2766/5775] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:20 2022] GET /compute/v2.1/servers/6823d76e-ff20-4cf5-88ab-94c86d1cd0f9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:58:20.969933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee577aaa-ad81-43a3-9cd7-df27e69f0ecf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:20.974031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee577aaa-ad81-43a3-9cd7-df27e69f0ecf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:21.000743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee577aaa-ad81-43a3-9cd7-df27e69f0ecf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:21.002449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee577aaa-ad81-43a3-9cd7-df27e69f0ecf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:21.002944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee577aaa-ad81-43a3-9cd7-df27e69f0ecf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:21.003733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee577aaa-ad81-43a3-9cd7-df27e69f0ecf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:21.004431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee577aaa-ad81-43a3-9cd7-df27e69f0ecf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:21.004915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee577aaa-ad81-43a3-9cd7-df27e69f0ecf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:21.071771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee577aaa-ad81-43a3-9cd7-df27e69f0ecf tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105969 Oct 17 15:58:21.075734 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3010/5776] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:20 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:22.094929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba40ea0b-549d-4dc4-b45d-7a4bab1cf982 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:22.098621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba40ea0b-549d-4dc4-b45d-7a4bab1cf982 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:22.121384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:22.127515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba40ea0b-549d-4dc4-b45d-7a4bab1cf982 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:22.129128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba40ea0b-549d-4dc4-b45d-7a4bab1cf982 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:22.130233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba40ea0b-549d-4dc4-b45d-7a4bab1cf982 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:22.132235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba40ea0b-549d-4dc4-b45d-7a4bab1cf982 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:22.134040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba40ea0b-549d-4dc4-b45d-7a4bab1cf982 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:22.135452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba40ea0b-549d-4dc4-b45d-7a4bab1cf982 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:22.301687 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba40ea0b-549d-4dc4-b45d-7a4bab1cf982 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.215860 Oct 17 15:58:22.303270 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2767/5777] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 15:58:22 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903/os-volume_attachments => generated 25 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 15:58:22.386992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:22.387692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:22.398750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:22.402480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:22.408760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:22.409732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:22.411457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:22.415226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:22.416953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:22.475085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:58:22.638099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-846c2afc-06ae-44eb-850c-9d734abe008c tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 204 len: 0 microversion: 2.1 time: 0.256404 Oct 17 15:58:22.639324 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3011/5778] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:58:22 2022] DELETE /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 15:58:22.652444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:22.653565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:22.687762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:22.689163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:22.690627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:22.704902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:22.706226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:22.707333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:23.550292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:23.574014 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc73f374-f145-422e-968c-1ce7ac1e7a66 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1679 microversion: 2.1 time: 0.928709 Oct 17 15:58:23.598548 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2768/5779] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:22 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1679 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:24.636463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:24.642739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:24.643619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:24.659646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:24.661898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:24.663566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:24.664450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:24.669424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:24.670013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:26.197289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:26.225813 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-357fba6f-94f3-4d7f-877d-23229e21e96e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1679 microversion: 2.1 time: 1.589866 Oct 17 15:58:26.229416 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3012/5780] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:24 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1679 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:27.265800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:27.267468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:27.322724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:27.324282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:27.325393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:27.327094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:27.328248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:27.329369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:27.648914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:27.657330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:27.662433 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1868a263-10c6-460e-88f7-9e49dd7d8d6e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1679 microversion: 2.1 time: 0.405526 Oct 17 15:58:27.671507 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2769/5781] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:27 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1679 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:27.849453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9bc4ace9-4578-4802-8987-a029558c9889 req-d1b28d73-b671-4c21-b959-6e03f0a8b09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd185b3-a95a-4603-9860-18ca741ec903", "name": "network-vif-unplugged", "status": "completed", "tag": "f0bb8b1f-0b27-4bb5-a392-e1d3614f22da"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:58:27.867922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9bc4ace9-4578-4802-8987-a029558c9889 req-d1b28d73-b671-4c21-b959-6e03f0a8b09e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:27.874031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9bc4ace9-4578-4802-8987-a029558c9889 req-d1b28d73-b671-4c21-b959-6e03f0a8b09e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:27.874617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9bc4ace9-4578-4802-8987-a029558c9889 req-d1b28d73-b671-4c21-b959-6e03f0a8b09e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:27.902224 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9bc4ace9-4578-4802-8987-a029558c9889 req-d1b28d73-b671-4c21-b959-6e03f0a8b09e service nova] Creating event network-vif-unplugged:f0bb8b1f-0b27-4bb5-a392-e1d3614f22da for instance 8dd185b3-a95a-4603-9860-18ca741ec903 on n-h1-854441-12 Oct 17 15:58:27.915341 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9bc4ace9-4578-4802-8987-a029558c9889 req-d1b28d73-b671-4c21-b959-6e03f0a8b09e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068292 Oct 17 15:58:27.919772 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3013/5782] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:28.700283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:28.700961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:28.719760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:28.720267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:28.725581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:28.729060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:28.729828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:28.732243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:29.846940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:29.858852 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-974a494e-72cb-4af7-8756-def00eb78657 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1679 microversion: 2.1 time: 1.165022 Oct 17 15:58:29.859470 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2770/5783] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:28 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1679 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:58:30.898983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:30.899912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:30.940758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:30.945982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:30.948410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:30.956960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:30.959435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:30.960625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:31.035846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:31.832325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:31.875712 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5590f1fb-6e5d-4176-b60c-6ac82b3666e0 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1679 microversion: 2.1 time: 0.982241 Oct 17 15:58:31.877206 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3014/5784] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:30 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1679 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:32.918037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:32.918708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:32.933305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:32.936336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:32.939587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:32.942609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:32.948168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:32.948944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:33.314386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:33.331359 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fadd47ce-89d4-4d08-957b-d982c4b22eb7 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1612 microversion: 2.1 time: 0.408984 Oct 17 15:58:33.332187 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2771/5785] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:32 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1612 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:58:33.473854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:33.476210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:33.503739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:33.504527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:33.505718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:33.507005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:33.507713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:33.508723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:33.593346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:58:33.911517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30bc0490-878a-4194-95d0-70043f76e38d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 204 len: 0 microversion: 2.1 time: 0.451072 Oct 17 15:58:33.914942 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3015/5786] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:58:33 2022] DELETE /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:58:33.927113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:33.928392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:33.945889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:33.946587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:33.947136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:33.947982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:33.948463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:33.948963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:34.374305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:34.377834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:34.402435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:34.403919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:34.405428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:34.412431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:34.413241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:34.413995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:34.635760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:34.655754 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96dae283-0d1f-4445-90e4-eb73efac740e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1612 microversion: 2.1 time: 0.297122 Oct 17 15:58:34.656903 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3016/5787] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:34 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1612 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:58:34.661761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3748e237-4782-4b69-8064-16640896e4f0 req-6c0a3bb5-cf90-468a-8bb4-6d8e66800cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd185b3-a95a-4603-9860-18ca741ec903", "name": "network-vif-deleted", "tag": "f0bb8b1f-0b27-4bb5-a392-e1d3614f22da"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:58:34.691264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3748e237-4782-4b69-8064-16640896e4f0 req-6c0a3bb5-cf90-468a-8bb4-6d8e66800cef service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:34.692078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3748e237-4782-4b69-8064-16640896e4f0 req-6c0a3bb5-cf90-468a-8bb4-6d8e66800cef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:34.692937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3748e237-4782-4b69-8064-16640896e4f0 req-6c0a3bb5-cf90-468a-8bb4-6d8e66800cef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:34.714157 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3748e237-4782-4b69-8064-16640896e4f0 req-6c0a3bb5-cf90-468a-8bb4-6d8e66800cef service nova] Creating event network-vif-deleted:f0bb8b1f-0b27-4bb5-a392-e1d3614f22da for instance 8dd185b3-a95a-4603-9860-18ca741ec903 on n-h1-854441-12 Oct 17 15:58:34.727464 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3748e237-4782-4b69-8064-16640896e4f0 req-6c0a3bb5-cf90-468a-8bb4-6d8e66800cef service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069290 Oct 17 15:58:34.731555 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3017/5788] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:35.691650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:35.694617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:35.746398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:35.752341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:35.755984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:35.762472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:35.763976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:35.768689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:35.940775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:35.944026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:35.950060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:35.952280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lazy-loading 'fault' on Instance uuid 8dd185b3-a95a-4603-9860-18ca741ec903 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:58:36.015560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:36.079452 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07a0a953-82b6-493e-a723-ae518121c703 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1552 microversion: 2.1 time: 2.157496 Oct 17 15:58:36.094459 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2772/5789] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:33 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1552 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:58:36.165598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d8f0d40fd0472e8ffc58d09811c4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e7c17929974c669051e99792e83d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:36.174953 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d49124e-1e8c-4405-82b2-b3e312527333 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 200 len: 1330 microversion: 2.1 time: 0.494446 Oct 17 15:58:36.188334 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3018/5790] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:35 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 1330 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:37.137181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:37.139434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:37.188314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:37.194225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:37.196743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:37.202962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:37.207703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:37.209107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:37.215299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:37.216718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:37.236684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:37.237272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:37.237771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:37.238551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:37.249469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:37.250248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:37.298781 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 HTTP/1.1 Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8dd185b3-a95a-4603-9860-18ca741ec903'} Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:37.307574 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:37.311599 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:37.311599 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:37.311599 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:37.311599 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:58:37.311599 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:58:37.311599 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:37.311599 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:37.311599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:37.311599 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4f84f95-d204-449e-994a-79dabb60666f tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 404 len: 111 microversion: 2.1 time: 0.099018 Oct 17 15:58:37.317705 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3019/5791] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:37 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:58:37.332242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2adb03f-9ae5-44a5-bc06-7f14761a0b95 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '.version_select at 0x7f28be00a550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:37.399355 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2adb03f-9ae5-44a5-bc06-7f14761a0b95 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934056903" status: 202 len: 0 microversion: 2.1 time: 0.080219 Oct 17 15:58:37.400233 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3020/5792] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 15:58:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934056903 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:58:38.850608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:38.867874 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-790dba62-ede1-47d5-92d3-756cc8e61b67 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1552 microversion: 2.1 time: 1.744766 Oct 17 15:58:38.871034 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2773/5793] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:37 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1552 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:39.146751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-90be69f4-5e12-4d4c-95d8-e56d4ddbd3ed req-48426bad-7b0c-4fbf-a70f-6aa8a6a811a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2a8c6c-1822-44b3-a171-47ab75bb7831", "name": "network-vif-deleted", "tag": "c6b96428-a5bc-4ac0-98d9-92024f787db9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:58:39.296847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-90be69f4-5e12-4d4c-95d8-e56d4ddbd3ed req-48426bad-7b0c-4fbf-a70f-6aa8a6a811a6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:39.302992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-90be69f4-5e12-4d4c-95d8-e56d4ddbd3ed req-48426bad-7b0c-4fbf-a70f-6aa8a6a811a6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:39.313417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-90be69f4-5e12-4d4c-95d8-e56d4ddbd3ed req-48426bad-7b0c-4fbf-a70f-6aa8a6a811a6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:39.440419 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-90be69f4-5e12-4d4c-95d8-e56d4ddbd3ed req-48426bad-7b0c-4fbf-a70f-6aa8a6a811a6 service nova] Creating event network-vif-deleted:c6b96428-a5bc-4ac0-98d9-92024f787db9 for instance 1b2a8c6c-1822-44b3-a171-47ab75bb7831 on n-h1-854441-12 Oct 17 15:58:39.482770 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-90be69f4-5e12-4d4c-95d8-e56d4ddbd3ed req-48426bad-7b0c-4fbf-a70f-6aa8a6a811a6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384215 Oct 17 15:58:39.490550 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3021/5794] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:39.910669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:39.911587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:39.927253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:39.928724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:39.932518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:39.933489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:39.934122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:39.936945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:40.054999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:40.059297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:40.063769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:40.064618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lazy-loading 'fault' on Instance uuid 1b2a8c6c-1822-44b3-a171-47ab75bb7831 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:58:40.294766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:40.330303 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba9165ec-d827-4067-8180-80d43def8429 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 200 len: 1338 microversion: 2.1 time: 0.424920 Oct 17 15:58:40.332311 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2774/5795] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:39 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 1338 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:58:41.366027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:41.367229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 1b2a8c6c-1822-44b3-a171-47ab75bb7831] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:41.397507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:41.398825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:41.399868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:41.406981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:41.408128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:41.409170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:41.469667 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] HTTP exception thrown: Instance 1b2a8c6c-1822-44b3-a171-47ab75bb7831 could not be found. Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Request method failure captured: Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 HTTP/1.1 Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXrYmvVtskkk3IJAp_uwmzWUivTfPW4FDVljXfMuubDXkTCsC3l3T9d6saIAV8uR7d-xfB79w-8aJGnChazTyXCa-t3Ej9Lliq5R0pCC2o1d5-SzWkzFGcJjpfrDUwngb_7JI_SP0v_8xBEmgCUlMGbDISDhMxC9fDx7TyQeVtCOmrM Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 15545d0f177d4dcab629c37feb5a6328 Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkBasicOps-735217035 Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkBasicOps-735217035 Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 15545d0f177d4dcab629c37feb5a6328 Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkBasicOps-735217035 Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestNetworkBasicOps-735217035-project Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b6684e87890f4ba5af7adb91145e4d4f Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkBasicOps-735217035-project Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 1b2a8c6c-1822-44b3-a171-47ab75bb7831 could not be found. Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '1b2a8c6c-1822-44b3-a171-47ab75bb7831'} Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2a8c6c-1822-44b3-a171-47ab75bb7831 could not be found. Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2a8c6c-1822-44b3-a171-47ab75bb7831 could not be found. Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:41.477909 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:41.490632 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:41.490632 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:41.490632 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:41.490632 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:58:41.490632 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:58:41.490632 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2a8c6c-1822-44b3-a171-47ab75bb7831 could not be found. Oct 17 15:58:41.490632 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:41.490632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Returning 404 to user: Instance 1b2a8c6c-1822-44b3-a171-47ab75bb7831 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:41.490632 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ba83b52-0c8a-45a9-8369-1326f623adbc tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831" status: 404 len: 111 microversion: 2.1 time: 0.128287 Oct 17 15:58:41.494754 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3022/5796] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:41 2022] GET /compute/v2.1/servers/1b2a8c6c-1822-44b3-a171-47ab75bb7831 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:58:42.335748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-52ca9d44-e8a4-4ca3-a2db-707495cad9e5 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '.version_select at 0x7f28bda41310>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:42.381264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:42.435587 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-52ca9d44-e8a4-4ca3-a2db-707495cad9e5 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1118721756" status: 202 len: 0 microversion: 2.1 time: 0.112457 Oct 17 15:58:42.456590 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2775/5797] 10.222.0.87 () {58 vars in 1257 bytes} [Mon Oct 17 15:58:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1118721756 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 15:58:51.722045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:51.726734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:51.749070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:51.761516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:51.774870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:51.775782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:51.776645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:51.789064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:51.789955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:51.799250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:51.882149 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 HTTP/1.1 Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8dd185b3-a95a-4603-9860-18ca741ec903'} Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:58:51.889015 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:58:51.895852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:51.896936 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d9948b2-0778-469a-88a2-3bed5e2163f9 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 404 len: 111 microversion: 2.1 time: 0.178454 Oct 17 15:58:51.897607 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3023/5798] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:58:51 2022] DELETE /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:58:51.911106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:51.913971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 8dd185b3-a95a-4603-9860-18ca741ec903] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:51.946530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=33 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:58:51.953318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:51.956552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:51.958987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:51.961287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:51.961794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:51.967872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:52.076195 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 HTTP/1.1 Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '8dd185b3-a95a-4603-9860-18ca741ec903'} Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:58:52.081232 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance 8dd185b3-a95a-4603-9860-18ca741ec903 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8ef7df78-3a30-4b2f-baa8-fa8ebee7e091 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903" status: 404 len: 111 microversion: 2.1 time: 0.182680 Oct 17 15:58:52.090907 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2776/5799] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:51 2022] GET /compute/v2.1/servers/8dd185b3-a95a-4603-9860-18ca741ec903 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:58:54.253563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:54.254839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:54.305857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-63be0d22-ed1c-4a1d-a68e-e0ef3867fec0 req-7d3ffedc-f695-4727-b821-ddaa8bc97c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6ca639-0504-4438-9b9c-622fdb6bf751", "tag": "c6e6674d-70f6-41ea-9f4f-694d45f7ede7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:58:54.314197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:54.318660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:54.320673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:54.321467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:54.321950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:54.330859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:54.366716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-63be0d22-ed1c-4a1d-a68e-e0ef3867fec0 req-7d3ffedc-f695-4727-b821-ddaa8bc97c1d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:54.372334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-63be0d22-ed1c-4a1d-a68e-e0ef3867fec0 req-7d3ffedc-f695-4727-b821-ddaa8bc97c1d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:54.379477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-63be0d22-ed1c-4a1d-a68e-e0ef3867fec0 req-7d3ffedc-f695-4727-b821-ddaa8bc97c1d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:54.465658 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-63be0d22-ed1c-4a1d-a68e-e0ef3867fec0 req-7d3ffedc-f695-4727-b821-ddaa8bc97c1d service nova] Creating event network-changed:c6e6674d-70f6-41ea-9f4f-694d45f7ede7 for instance cc6ca639-0504-4438-9b9c-622fdb6bf751 on n-h2-854441-12 Oct 17 15:58:54.505628 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-63be0d22-ed1c-4a1d-a68e-e0ef3867fec0 req-7d3ffedc-f695-4727-b821-ddaa8bc97c1d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189271 Oct 17 15:58:54.511344 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2777/5800] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:58:54.539186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:58:54.818411 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d70f73d8-50f3-495b-972a-8b4f17215c50 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 204 len: 0 microversion: 2.1 time: 0.571530 Oct 17 15:58:54.819563 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3024/5801] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:58:54 2022] DELETE /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:58:54.829585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:54.831739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:54.858024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:54.865972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:54.867614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:54.873972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:54.877168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:54.880429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:55.598870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:55.621525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ebbbc66-f5af-40e7-9c75-dd3bc7376c6c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1670 microversion: 2.1 time: 0.790252 Oct 17 15:58:55.622975 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2778/5802] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:54 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1670 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:58:56.660329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:58:56.663639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:58:56.689974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:56.698290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:56.699103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:56.700383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:56.703380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:56.707923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:57.593329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-20e3262c-485b-4d34-a53a-a505fab24888 req-0ed8fcca-7f95-4fe9-8323-e19d92c87644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6ca639-0504-4438-9b9c-622fdb6bf751", "name": "network-vif-deleted", "tag": "c6e6674d-70f6-41ea-9f4f-694d45f7ede7"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:58:57.618393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20e3262c-485b-4d34-a53a-a505fab24888 req-0ed8fcca-7f95-4fe9-8323-e19d92c87644 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:58:57.619291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20e3262c-485b-4d34-a53a-a505fab24888 req-0ed8fcca-7f95-4fe9-8323-e19d92c87644 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:58:57.620114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20e3262c-485b-4d34-a53a-a505fab24888 req-0ed8fcca-7f95-4fe9-8323-e19d92c87644 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:58:57.657917 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-20e3262c-485b-4d34-a53a-a505fab24888 req-0ed8fcca-7f95-4fe9-8323-e19d92c87644 service nova] Creating event network-vif-deleted:c6e6674d-70f6-41ea-9f4f-694d45f7ede7 for instance cc6ca639-0504-4438-9b9c-622fdb6bf751 on n-h2-854441-12 Oct 17 15:58:57.689753 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-20e3262c-485b-4d34-a53a-a505fab24888 req-0ed8fcca-7f95-4fe9-8323-e19d92c87644 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110749 Oct 17 15:58:57.691828 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2779/5803] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:58:59.498907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:58:59.549527 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-251b849c-3c1e-44bc-b652-bccde017f017 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 200 len: 1670 microversion: 2.1 time: 2.896238 Oct 17 15:58:59.583080 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3025/5804] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:58:56 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 1670 bytes in 2933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:00.629659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:00.635606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: cc6ca639-0504-4438-9b9c-622fdb6bf751] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:00.684272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:00.684996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:00.685259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:00.686012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:00.686520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:00.686938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:00.773341 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] HTTP exception thrown: Instance cc6ca639-0504-4438-9b9c-622fdb6bf751 could not be found. Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Request method failure captured: Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 HTTP/1.1 Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXrYmvVtskkk3IJAp_uwmzWUivTfPW4FDVljXfMuubDXkTCsC3l3T9d6saIAV8uR7d-xfB79w-8aJGnChazTyXCa-t3Ej9Lliq5R0pCC2o1d5-SzWkzFGcJjpfrDUwngb_7JI_SP0v_8xBEmgCUlMGbDISDhMxC9fDx7TyQeVtCOmrM Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 15545d0f177d4dcab629c37feb5a6328 Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestNetworkBasicOps-735217035 Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestNetworkBasicOps-735217035 Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 15545d0f177d4dcab629c37feb5a6328 Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestNetworkBasicOps-735217035 Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestNetworkBasicOps-735217035-project Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b6684e87890f4ba5af7adb91145e4d4f Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestNetworkBasicOps-735217035-project Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance cc6ca639-0504-4438-9b9c-622fdb6bf751 could not be found. Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'cc6ca639-0504-4438-9b9c-622fdb6bf751'} Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc6ca639-0504-4438-9b9c-622fdb6bf751 could not be found. Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc6ca639-0504-4438-9b9c-622fdb6bf751 could not be found. Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:00.776924 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:00.781165 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:00.781165 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:00.781165 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:00.781165 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:59:00.781165 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:59:00.781165 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc6ca639-0504-4438-9b9c-622fdb6bf751 could not be found. Oct 17 15:59:00.781165 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:00.793904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Returning 404 to user: Instance cc6ca639-0504-4438-9b9c-622fdb6bf751 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:59:00.796788 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1d8bb6c3-53e8-43d1-a569-d6be7fd95908 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751" status: 404 len: 111 microversion: 2.1 time: 0.190706 Oct 17 15:59:00.798116 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2780/5805] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:00 2022] GET /compute/v2.1/servers/cc6ca639-0504-4438-9b9c-622fdb6bf751 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:59:02.045513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ccdb3fc-7473-476e-b7e9-60b140da7b29 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '.version_select at 0x7f28bea99a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:02.123412 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ccdb3fc-7473-476e-b7e9-60b140da7b29 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-639089191" status: 202 len: 0 microversion: 2.1 time: 0.087632 Oct 17 15:59:02.127796 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3026/5806] 10.222.0.87 () {58 vars in 1254 bytes} [Mon Oct 17 15:59:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-639089191 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:59:05.671749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:05.672569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:05.747287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:05.748238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:05.749043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:05.767441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:05.768352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:05.769147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:05.867536 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 HTTP/1.1 Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '4e7dd4ba-982a-4677-93b2-fcd9597d2508'} Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:59:05.890304 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:59:05.894558 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2cd5da55-0d07-4ac6-aadb-a31bb65f314d tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 404 len: 111 microversion: 2.1 time: 0.229606 Oct 17 15:59:05.897626 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2781/5807] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:59:05 2022] DELETE /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:59:05.925862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:05.933326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 4e7dd4ba-982a-4677-93b2-fcd9597d2508] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:06.007165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:06.020642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:06.027555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:06.037488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:06.038384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:06.039254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:06.149145 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 HTTP/1.1 Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '4e7dd4ba-982a-4677-93b2-fcd9597d2508'} Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:06.171382 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.182806 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:06.182806 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:06.182806 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:06.182806 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:59:06.182806 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:59:06.182806 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. Oct 17 15:59:06.182806 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.186044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance 4e7dd4ba-982a-4677-93b2-fcd9597d2508 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:59:06.187623 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0d88936-8cc2-48df-9127-3e8deb437684 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508" status: 404 len: 111 microversion: 2.1 time: 0.287821 Oct 17 15:59:06.188790 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3027/5808] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:05 2022] GET /compute/v2.1/servers/4e7dd4ba-982a-4677-93b2-fcd9597d2508 => generated 111 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:59:06.204702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:06.205629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:06.245777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:06.247125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:06.273855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:06.275429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:06.276442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:06.277229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:06.420101 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 HTTP/1.1 Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ab31a979-fc59-4acd-aa58-232e78ecf883'} Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:59:06.433211 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.437215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:59:06.447457 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-757c817b-14d1-44ba-87a8-832cada1555e tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 404 len: 111 microversion: 2.1 time: 0.249664 Oct 17 15:59:06.455653 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2782/5809] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:59:06 2022] DELETE /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:59:06.464964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:06.466250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: ab31a979-fc59-4acd-aa58-232e78ecf883] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:06.521403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:06.522276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:06.523225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:06.524585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:06.525496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:06.526345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:06.657362 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 HTTP/1.1 Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'ab31a979-fc59-4acd-aa58-232e78ecf883'} Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:06.660570 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.669462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:06.669462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:06.669462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:06.669462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:59:06.669462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:59:06.669462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. Oct 17 15:59:06.669462 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:06.669462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance ab31a979-fc59-4acd-aa58-232e78ecf883 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:59:06.687840 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55452b60-be87-40ca-aacd-d7b81e428584 tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883" status: 404 len: 111 microversion: 2.1 time: 0.231549 Oct 17 15:59:06.712906 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3028/5810] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:06 2022] GET /compute/v2.1/servers/ab31a979-fc59-4acd-aa58-232e78ecf883 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:59:17.227407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:17.235206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:17.276898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:17.279421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=18 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:17.288116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:17.323958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:17.324944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:17.326373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:17.327683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:17.328625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:17.435900 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee HTTP/1.1 Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '48f0e647-c24a-496d-ac11-6a9187931eee'} Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:59:17.450842 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.459057 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.474215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:59:17.489400 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a32ca98-e02d-4789-a0bd-ab0fa471e4fa tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "DELETE /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 404 len: 111 microversion: 2.1 time: 0.258713 Oct 17 15:59:17.516074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:17.517417 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2783/5811] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 15:59:17 2022] DELETE /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 111 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 15:59:17.519093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] [instance: 48f0e647-c24a-496d-ac11-6a9187931eee] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:17.525071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:17.533264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:17.595670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:17.596104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:17.599314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:17.600086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:17.600558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:17.601000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:17.643909 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] HTTP exception thrown: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Request method failure captured: Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee HTTP/1.1 Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXm7XKukdJH1NYKhD3erwmk0Ck0c0iCKRq0H-WqDelz_EIAztkTfDaIqYHZtpjZWN-hqAgIcb1hn_IVUyYzoqRK4Ui2KW4gHjqmhPyTLF6mLwKB0JdlJ09QqYOZgD2C0XN6DnXtRDpkKSrbS7pNrFgb-a9vFQIu2McWHShewBcE2ApM Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/95e7c17929974c669051e99792e83d40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_95e7c17929974c669051e99792e83d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/95e7c17929974c669051e99792e83d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 95e7c17929974c669051e99792e83d40 Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-934300353 Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 98d8f0d40fd0472e8ffc58d09811c4cc Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-AttachVolumeNegativeTest-934300353-project Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '48f0e647-c24a-496d-ac11-6a9187931eee'} Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:17.646383 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.651306 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:17.651306 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:17.651306 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:17.651306 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:59:17.651306 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:59:17.651306 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. Oct 17 15:59:17.651306 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 15:59:17.653570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] Returning 404 to user: Instance 48f0e647-c24a-496d-ac11-6a9187931eee could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:59:17.655826 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1be7cae9-3664-4457-9e75-cd5d41d8b82b tempest-AttachVolumeNegativeTest-934300353 tempest-AttachVolumeNegativeTest-934300353-project] 10.222.0.87 "GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee" status: 404 len: 111 microversion: 2.1 time: 0.149082 Oct 17 15:59:17.657089 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3029/5812] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:17 2022] GET /compute/v2.1/servers/48f0e647-c24a-496d-ac11-6a9187931eee => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:59:18.883194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1947905826", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "3d0b62e7-8f40-4041-a44c-2541d3501e8f"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:59:19.086204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] validate_networks() for [('3d0b62e7-8f40-4041-a44c-2541d3501e8f', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:59:22.163978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:59:22.165089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:59:22.166302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:59:22.167242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:59:22.172871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:59:22.211947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:22.213231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:22.214758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:22.216497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:22.225671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:22.260766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:22.400009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Getting quotas for project 84871cf9d1c540fbb205ce4a09c77aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:59:22.426160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Getting quotas for user 7f21c15c2af940128aed2c6a0b2bbe9d and project 84871cf9d1c540fbb205ce4a09c77aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:59:22.471688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Going to run 2 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:59:22.478578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 0c30b9b7-7499-4d2d-8a0d-a5ad4252a014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:59:22.642233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=0c30b9b7-7499-4d2d-8a0d-a5ad4252a014,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:59:22.943819 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8b63e63d-cfdf-43ee-8d87-5880f95b7d3a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.434517 Oct 17 15:59:22.971937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:22.972647 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2784/5813] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 15:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:59:22.982296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:22.985445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Searching by: {'deleted': False, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 15:59:23.029546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:23.031179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:23.032857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:23.037740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:23.041013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:23.042356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:23.121367 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79ca8b9d-55d9-49e8-bb1a-376a0a634b22 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.155829 Oct 17 15:59:23.155850 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3030/5814] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 15:59:22 2022] GET /compute/v2.1/servers => generated 677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:59:23.186009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab9e41e9-281a-42cd-89eb-2a68265f14cf tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:23.190901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab9e41e9-281a-42cd-89eb-2a68265f14cf tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:23.759824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ab9e41e9-281a-42cd-89eb-2a68265f14cf tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:23.785375 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab9e41e9-281a-42cd-89eb-2a68265f14cf tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1220 microversion: 2.1 time: 0.607808 Oct 17 15:59:23.815073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2785/5815] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:23 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1220 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:24.829522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d344a507-ab05-4d15-a501-cfbf7401c433 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:24.831163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d344a507-ab05-4d15-a501-cfbf7401c433 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:25.466694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d344a507-ab05-4d15-a501-cfbf7401c433 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:25.479285 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d344a507-ab05-4d15-a501-cfbf7401c433 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1220 microversion: 2.1 time: 0.657180 Oct 17 15:59:25.479914 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3031/5816] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:24 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1220 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:26.540465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:26.546476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:26.601084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:26.602690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:26.607877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:26.612734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:26.618453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:26.619860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:27.051505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:27.080455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-16a84556-162f-42bf-a782-2e70363b4f84 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1272 microversion: 2.1 time: 0.543497 Oct 17 15:59:27.081281 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2786/5817] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:26 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1272 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:28.145776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:28.147237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:28.166602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:28.167654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:28.168418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:28.170403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:28.171660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:28.172353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:29.079463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:29.095767 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b5bac176-8324-482e-9ddd-c17f104256ad tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1278 microversion: 2.1 time: 0.973025 Oct 17 15:59:29.103416 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3032/5818] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:28 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1278 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:30.130205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:30.131806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:30.146814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:30.153819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:30.154605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:30.157256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:30.165330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:30.167309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:30.307856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:30.346024 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-88751175-7b9b-428d-a743-f97b64dc743d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1278 microversion: 2.1 time: 0.217552 Oct 17 15:59:30.349831 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2787/5819] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:30 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:31.386717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:31.388220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:31.407135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:31.408031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:31.408727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:31.409744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:31.411757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:31.412504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:31.790084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:31.840691 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f89cc11-5887-4b02-9309-2c6269bc25b4 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1278 microversion: 2.1 time: 0.455518 Oct 17 15:59:31.842184 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3033/5820] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:31 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1278 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:32.871281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:32.872174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:32.875876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:32.941523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:32.943829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:32.947556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:32.950216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:32.952253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:32.952740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:33.427685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:33.488760 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b36b92af-d6c8-44fd-9ed8-3eee0863ac74 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1278 microversion: 2.1 time: 0.623211 Oct 17 15:59:33.491093 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2788/5821] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:32 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1278 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:34.519416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:34.520698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:34.525079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:34.532353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:34.533291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:34.534655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:34.536569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:34.537289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:34.538022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:35.290490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:35.304282 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c8dc53a1-556c-4ee7-ba88-a623e3c8950c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1278 microversion: 2.1 time: 0.789941 Oct 17 15:59:35.323508 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3034/5822] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:34 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1278 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:36.352645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:36.353666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:36.372518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:36.418026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:36.419297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:36.427469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:36.428820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:36.444670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:36.445677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:37.001054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:37.039531 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4dced882-0327-471d-b0ed-b78a6852bd24 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1278 microversion: 2.1 time: 0.690223 Oct 17 15:59:37.075128 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2789/5823] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:36 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1278 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:38.098288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:38.101350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:38.127011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:38.167560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:38.173479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:38.177380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:38.184543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:38.202977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:38.204187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:38.996162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:39.009334 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d87f687f-b82c-44bf-89d2-41e8eabdc927 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 0.918027 Oct 17 15:59:39.009968 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3035/5824] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:38 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:40.042124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:40.043815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:40.078023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:40.082576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:40.083771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:40.087460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:40.092078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:40.096568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:41.171225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:41.188851 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-62eaaa01-c487-44ab-9baf-4c2fcba55d9f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 1.152828 Oct 17 15:59:41.197034 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2790/5825] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:40 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:42.343185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2407a6fe-fafa-4dfd-b228-8d99e38a4228 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Action: 'create', calling method: .version_select at 0x7f28bea1b280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1548039567"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:59:42.389567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a0ae9f19-f849-4d1b-97e5-70b40a34101c req-6b52b40e-9d07-4a26-b57c-34b47cd7e086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c30b9b7-7499-4d2d-8a0d-a5ad4252a014", "tag": "0935e8aa-23e0-4834-9ed7-337cd95b74e9"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:59:42.427966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a0ae9f19-f849-4d1b-97e5-70b40a34101c req-6b52b40e-9d07-4a26-b57c-34b47cd7e086 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:42.432493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a0ae9f19-f849-4d1b-97e5-70b40a34101c req-6b52b40e-9d07-4a26-b57c-34b47cd7e086 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:42.433098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a0ae9f19-f849-4d1b-97e5-70b40a34101c req-6b52b40e-9d07-4a26-b57c-34b47cd7e086 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:42.473434 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a0ae9f19-f849-4d1b-97e5-70b40a34101c req-6b52b40e-9d07-4a26-b57c-34b47cd7e086 service nova] Creating event network-changed:0935e8aa-23e0-4834-9ed7-337cd95b74e9 for instance 0c30b9b7-7499-4d2d-8a0d-a5ad4252a014 on n-h1-854441-12 Oct 17 15:59:42.500593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a0ae9f19-f849-4d1b-97e5-70b40a34101c req-6b52b40e-9d07-4a26-b57c-34b47cd7e086 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.337300 Oct 17 15:59:42.501804 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2791/5826] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:42.507561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:42.520990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:42.540214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:42.543599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:42.548021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:42.549276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:42.549960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:42.550635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:43.557485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:43.652477 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e0763e72-d736-427c-a3cf-e62172536a6f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 1.148894 Oct 17 15:59:43.676091 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2792/5827] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:42 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:43.970822 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2407a6fe-fafa-4dfd-b228-8d99e38a4228 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.131428 Oct 17 15:59:43.974303 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3036/5828] 10.222.0.87 () {60 vars in 1155 bytes} [Mon Oct 17 15:59:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2137 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 15:59:43.992756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1cdcc476-81ad-4a13-b773-e581593b3675 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bda41af0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:44.229826 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1cdcc476-81ad-4a13-b773-e581593b3675 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 200 len: 345 microversion: 2.1 time: 0.244946 Oct 17 15:59:44.231599 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2793/5829] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:59:43 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:44.704804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:44.707909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:44.739963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d8b4a69a-a45c-4fcf-b9c9-c2777f624529 req-a973fcc1-95d1-4f2b-894b-17950e05705c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6aa2437-9304-423e-b77a-084f6a6412bc", "tag": "10495184-bc71-4358-b58e-a94449d68641"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:59:44.749357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:44.750266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:44.760785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:44.767573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:44.768370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:44.769184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:44.816452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d8b4a69a-a45c-4fcf-b9c9-c2777f624529 req-a973fcc1-95d1-4f2b-894b-17950e05705c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:44.817446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d8b4a69a-a45c-4fcf-b9c9-c2777f624529 req-a973fcc1-95d1-4f2b-894b-17950e05705c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:44.821464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d8b4a69a-a45c-4fcf-b9c9-c2777f624529 req-a973fcc1-95d1-4f2b-894b-17950e05705c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:44.876055 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d8b4a69a-a45c-4fcf-b9c9-c2777f624529 req-a973fcc1-95d1-4f2b-894b-17950e05705c service nova] Creating event network-changed:10495184-bc71-4358-b58e-a94449d68641 for instance f6aa2437-9304-423e-b77a-084f6a6412bc on n-h2-854441-12 Oct 17 15:59:44.887837 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d8b4a69a-a45c-4fcf-b9c9-c2777f624529 req-a973fcc1-95d1-4f2b-894b-17950e05705c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156136 Oct 17 15:59:44.888807 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2794/5830] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:45.246039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f4ad8b3-d0db-4abb-b98f-bc066a5188ac tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdab4e50>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:45.369479 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f4ad8b3-d0db-4abb-b98f-bc066a5188ac tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 200 len: 345 microversion: 2.1 time: 0.128164 Oct 17 15:59:45.370408 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2795/5831] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:59:45 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:45.992247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:46.009049 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b1a53c6a-4cf8-4e5c-bb25-d6e587c07b57 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 1.313561 Oct 17 15:59:46.010296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3037/5832] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:44 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:46.386895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9fdc9df6-306c-47d5-9166-0cc2339ae9b5 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdbd2b80>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:46.565685 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9fdc9df6-306c-47d5-9166-0cc2339ae9b5 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 200 len: 346 microversion: 2.1 time: 0.184441 Oct 17 15:59:46.566727 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2796/5833] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:59:46 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:46.595341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b2cc0b0-8321-48e9-b7cd-f9013851e4b7 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Action: 'create', calling method: .version_select at 0x7f28bea1b670>, body: {"snapshot": {"volume_id": "655f88d3-73de-43c0-82c6-8b9dc2bcc780", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2032864401"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:59:47.008481 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b2cc0b0-8321-48e9-b7cd-f9013851e4b7 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.418299 Oct 17 15:59:47.015418 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3038/5834] 10.222.0.87 () {60 vars in 1162 bytes} [Mon Oct 17 15:59:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:59:47.022175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-333feefc-a50c-47b2-903e-66253d14123e tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdb59040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:47.038143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:47.038900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:47.080336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:47.085654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:47.088374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:47.097392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:47.106289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:47.109184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:47.152770 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-333feefc-a50c-47b2-903e-66253d14123e tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 287 microversion: 2.1 time: 0.135862 Oct 17 15:59:47.159572 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2797/5835] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:47 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:47.168318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e27e399-5158-4536-81a6-96065f54679f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdb59f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:47.327684 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e27e399-5158-4536-81a6-96065f54679f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.165809 Oct 17 15:59:47.328733 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2798/5836] 10.222.0.87 () {58 vars in 1140 bytes} [Mon Oct 17 15:59:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:59:47.376121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7092b70b-bbca-455d-9008-708257d31730 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdbd2f70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:47.504717 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7092b70b-bbca-455d-9008-708257d31730 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 287 microversion: 2.1 time: 0.156546 Oct 17 15:59:47.509105 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2799/5837] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:47 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:48.528966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79c41d17-89a2-4cd6-be52-eceeb125ace3 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdbd2af0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:48.677978 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-79c41d17-89a2-4cd6-be52-eceeb125ace3 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 287 microversion: 2.1 time: 0.159786 Oct 17 15:59:48.680738 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2800/5838] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:48 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:59:49.698128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4b0ebdfa-57b7-4e0a-90af-afe95772ebfe tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdbd2430>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:49.860651 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4b0ebdfa-57b7-4e0a-90af-afe95772ebfe tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 287 microversion: 2.1 time: 0.170483 Oct 17 15:59:49.862657 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2801/5839] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:49 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:59:50.911354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea9a802c-298f-4dc7-b0f2-b68e92e07599 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdab4820>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:51.052164 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea9a802c-298f-4dc7-b0f2-b68e92e07599 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 287 microversion: 2.1 time: 0.170981 Oct 17 15:59:51.060575 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2802/5840] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:50 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 287 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:51.422207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:51.432044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=39 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:51.439797 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-297657f6-56e4-4a8b-b7d3-ae2997ca9a8c tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 4.407889 Oct 17 15:59:51.444487 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3039/5841] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:47 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 4414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:52.071218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c1052013-f15c-4347-8e33-9780034577ec tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdb3c3a0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:52.151891 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c1052013-f15c-4347-8e33-9780034577ec tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 288 microversion: 2.1 time: 0.089240 Oct 17 15:59:52.153418 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2803/5842] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:52 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:52.174768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3adfb013-a42e-44a0-8a01-4e6559f67f7b tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bedde040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:52.429680 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3adfb013-a42e-44a0-8a01-4e6559f67f7b tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "DELETE /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 202 len: 0 microversion: 2.1 time: 0.263237 Oct 17 15:59:52.433018 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3040/5843] 10.222.0.87 () {58 vars in 1254 bytes} [Mon Oct 17 15:59:52 2022] DELETE /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:59:52.449926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c3927c2-6f3a-4e64-be03-80d3e09d2caf tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bda41700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:52.477957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:52.481546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:52.485065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=21 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:52.532105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:52.532668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:52.533126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:52.533870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:52.534326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:52.534813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:52.548725 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c3927c2-6f3a-4e64-be03-80d3e09d2caf tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 287 microversion: 2.1 time: 0.109161 Oct 17 15:59:52.550064 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2804/5844] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:52 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:53.567262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-102f605c-8252-4fa9-bb93-41474a61a736 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdab48b0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:53.670892 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-102f605c-8252-4fa9-bb93-41474a61a736 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 287 microversion: 2.1 time: 0.111028 Oct 17 15:59:53.681968 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2805/5845] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:53 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:54.264939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:54.297658 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11ce11f9-e05e-402d-9c32-2f721883db51 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 1.827789 Oct 17 15:59:54.315170 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3041/5846] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:52 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:54.700111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a573586-6f82-4469-ba31-77a21e503dde tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdbd2820>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:54.799934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:54.839350 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a573586-6f82-4469-ba31-77a21e503dde tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 287 microversion: 2.1 time: 0.154060 Oct 17 15:59:54.840170 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2806/5847] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:54 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:59:55.340138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:55.340865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:55.365666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:55.366194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:55.366659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:55.367430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:55.367964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:55.368392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:55.854964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=44 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:59:55.862943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-612685b1-90e7-4908-a6f3-ff695b0edbfe tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdab44c0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:55.928953 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-612685b1-90e7-4908-a6f3-ff695b0edbfe tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 200 len: 287 microversion: 2.1 time: 0.073137 Oct 17 15:59:55.938594 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2807/5848] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:55 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:59:56.957937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24d5f07a-ae9d-4e20-9f37-e17be8fb398f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdfa0700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:57.027350 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-24d5f07a-ae9d-4e20-9f37-e17be8fb398f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] HTTP exception thrown: Snapshot 7085f810-dd5b-4c93-ab30-ead46f2004dc could not be found. Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24d5f07a-ae9d-4e20-9f37-e17be8fb398f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Request method failure captured: Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc HTTP/1.1 Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXvt-Jy3PU2k6OjN_1Cox6DCqExZTHHqjGQbDZKae0aphyjXamksexeICuJYlHwR26BF1hPV3fj7O79ggdT77sZo06ziEOfEOTupK15QHY1etTfMAzfc3n4n_tjV2oR3jftYZyWBP34nLLU2tWUa-HONcaZUTzXOhU5zqOiSJR_1B6A Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: d35ed75736aa4768a31f6904cf2fafec Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: d35ed75736aa4768a31f6904cf2fafec Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesSnapshotsTestJSON-23607557-project Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 52faeb6e7c4e4707939ecce5f384ba16 Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-23607557-project Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: method: Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: exception: Snapshot 7085f810-dd5b-4c93-ab30-ead46f2004dc could not be found. Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7085f810-dd5b-4c93-ab30-ead46f2004dc'} Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7085f810-dd5b-4c93-ab30-ead46f2004dc could not be found. (HTTP 404) (Request-ID: req-8c51fcb5-351d-4bc7-b31c-aeddb6a86bd3) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 15:59:57.038906 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7085f810-dd5b-4c93-ab30-ead46f2004dc could not be found. Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7085f810-dd5b-4c93-ab30-ead46f2004dc could not be found. Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7085f810-dd5b-4c93-ab30-ead46f2004dc could not be found. Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 15:59:57.046237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24d5f07a-ae9d-4e20-9f37-e17be8fb398f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Returning 404 to user: Snapshot 7085f810-dd5b-4c93-ab30-ead46f2004dc could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:59:57.053618 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24d5f07a-ae9d-4e20-9f37-e17be8fb398f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc" status: 404 len: 111 microversion: 2.1 time: 0.106395 Oct 17 15:59:57.056142 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2808/5849] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 15:59:56 2022] GET /compute/v2.1/os-snapshots/7085f810-dd5b-4c93-ab30-ead46f2004dc => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:59:57.064189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c4b650de-3b4f-45d0-80fd-baabc5a465b8 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdab40d0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:57.214014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:57.232361 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43758757-563b-4d6a-9f66-619a03c2e336 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 1.896275 Oct 17 15:59:57.234104 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3042/5850] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:55 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:57.293400 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c4b650de-3b4f-45d0-80fd-baabc5a465b8 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 202 len: 0 microversion: 2.1 time: 0.235507 Oct 17 15:59:57.299906 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2809/5851] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 15:59:57 2022] DELETE /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:59:57.315343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c11de61e-148f-4a13-a369-7284dc397d1f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28beedd700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:57.401367 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c11de61e-148f-4a13-a369-7284dc397d1f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 200 len: 345 microversion: 2.1 time: 0.101504 Oct 17 15:59:57.402182 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3043/5852] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:59:57 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:58.261367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:58.262206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:59:58.285723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:58.291752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:58.301928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:58.301928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:58.301928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:58.301928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:58.593590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-11b2ff14-c9ee-4c95-a688-c9a9d859286f req-e8e6629c-4719-419f-9a82-1d62f4893e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c30b9b7-7499-4d2d-8a0d-a5ad4252a014", "name": "network-vif-plugged", "status": "completed", "tag": "0935e8aa-23e0-4834-9ed7-337cd95b74e9"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:59:58.633982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-11b2ff14-c9ee-4c95-a688-c9a9d859286f req-e8e6629c-4719-419f-9a82-1d62f4893e1d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:59:58.634550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-11b2ff14-c9ee-4c95-a688-c9a9d859286f req-e8e6629c-4719-419f-9a82-1d62f4893e1d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:59:58.639735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-11b2ff14-c9ee-4c95-a688-c9a9d859286f req-e8e6629c-4719-419f-9a82-1d62f4893e1d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:59:58.675767 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-11b2ff14-c9ee-4c95-a688-c9a9d859286f req-e8e6629c-4719-419f-9a82-1d62f4893e1d service nova] Creating event network-vif-plugged:0935e8aa-23e0-4834-9ed7-337cd95b74e9 for instance 0c30b9b7-7499-4d2d-8a0d-a5ad4252a014 on n-h1-854441-12 Oct 17 15:59:58.703571 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-11b2ff14-c9ee-4c95-a688-c9a9d859286f req-e8e6629c-4719-419f-9a82-1d62f4893e1d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.603130 Oct 17 15:59:58.708354 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2810/5853] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 15:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:58.724219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4be0036-7016-4f15-941a-ced916e384f6 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdff1280>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:59:58.856388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4be0036-7016-4f15-941a-ced916e384f6 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 200 len: 345 microversion: 2.1 time: 0.146578 Oct 17 15:59:58.856991 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2811/5854] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:59:58 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:59:59.671124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:59:59.680258 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f21b3615-557c-4eea-a14f-24c867ac881f tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 1.423388 Oct 17 15:59:59.698533 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3044/5855] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 15:59:58 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:59:59.879057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd2b64c9-fcd8-4fe5-a9f5-39d06a9c6543 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdf4b940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:00.099041 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd2b64c9-fcd8-4fe5-a9f5-39d06a9c6543 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 200 len: 345 microversion: 2.1 time: 0.232086 Oct 17 16:00:00.099644 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2812/5856] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 15:59:59 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 345 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:00:00.717247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:00.718338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:00.751920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5aaa88e4-85d9-4de0-88d2-5de5e07e7685 req-834facef-0e9f-474d-8cf1-986f921972a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6aa2437-9304-423e-b77a-084f6a6412bc", "name": "network-vif-plugged", "status": "completed", "tag": "10495184-bc71-4358-b58e-a94449d68641"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:00.765927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:00.770321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:00.771834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:00.782094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:00.785961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:00.788293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:00.804403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5aaa88e4-85d9-4de0-88d2-5de5e07e7685 req-834facef-0e9f-474d-8cf1-986f921972a7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:00.808247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5aaa88e4-85d9-4de0-88d2-5de5e07e7685 req-834facef-0e9f-474d-8cf1-986f921972a7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:00.809358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5aaa88e4-85d9-4de0-88d2-5de5e07e7685 req-834facef-0e9f-474d-8cf1-986f921972a7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:00.864822 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5aaa88e4-85d9-4de0-88d2-5de5e07e7685 req-834facef-0e9f-474d-8cf1-986f921972a7 service nova] Creating event network-vif-plugged:10495184-bc71-4358-b58e-a94449d68641 for instance f6aa2437-9304-423e-b77a-084f6a6412bc on n-h2-854441-12 Oct 17 16:00:00.894018 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5aaa88e4-85d9-4de0-88d2-5de5e07e7685 req-834facef-0e9f-474d-8cf1-986f921972a7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146443 Oct 17 16:00:00.894731 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2813/5857] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:01.122925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e0bcea62-b03d-4394-bf9c-77757ed65389 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28bdfa05e0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:01.232831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e0bcea62-b03d-4394-bf9c-77757ed65389 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 200 len: 345 microversion: 2.1 time: 0.115445 Oct 17 16:00:01.240449 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2814/5858] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 16:00:01 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:01.615564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:01.666161 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b430a072-d7f2-4afd-a586-82f1a0f042bb tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 0.956931 Oct 17 16:00:01.695954 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3045/5859] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:00 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:01.733348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1d79d5bd-8a19-4085-9a1d-6a03b16d1f2a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Action: 'create', calling method: .version_select at 0x7f28bdb9ec10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1362819479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlX1e+UBjxhV8a2QUfGRpuPEKdXdgWIXrFx+x4Q+hAnpj5gbL82LgXCG3BCWDXBB6bC+rieVYA0kwxMKEu4FyU/A+d/a1F9/qfguzn+dBkSGNrrmzdmYr8J40NxutksLQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:01.798310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-1d79d5bd-8a19-4085-9a1d-6a03b16d1f2a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for project 15545d0f177d4dcab629c37feb5a6328. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:00:01.865844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-1d79d5bd-8a19-4085-9a1d-6a03b16d1f2a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for user b6684e87890f4ba5af7adb91145e4d4f and project 15545d0f177d4dcab629c37feb5a6328. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:00:01.988558 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1d79d5bd-8a19-4085-9a1d-6a03b16d1f2a tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.255970 Oct 17 16:00:01.996769 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2815/5860] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:00:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:02.257520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89c20478-6781-418e-83df-b001e8171993 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28be993820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:02.397879 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89c20478-6781-418e-83df-b001e8171993 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 200 len: 345 microversion: 2.1 time: 0.150032 Oct 17 16:00:02.399991 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3046/5861] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 16:00:02 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:02.699473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:02.700424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:02.725762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:02.730587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:02.731313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:02.734396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:02.735111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:02.735582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:03.420224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-235bcfa3-4961-4f2c-8e72-537c65378369 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28c2ff8940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:03.518874 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-235bcfa3-4961-4f2c-8e72-537c65378369 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] HTTP exception thrown: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-235bcfa3-4961-4f2c-8e72-537c65378369 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Request method failure captured: Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 HTTP/1.1 Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXvt-Jy3PU2k6OjN_1Cox6DCqExZTHHqjGQbDZKae0aphyjXamksexeICuJYlHwR26BF1hPV3fj7O79ggdT77sZo06ziEOfEOTupK15QHY1etTfMAzfc3n4n_tjV2oR3jftYZyWBP34nLLU2tWUa-HONcaZUTzXOhU5zqOiSJR_1B6A Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: d35ed75736aa4768a31f6904cf2fafec Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: d35ed75736aa4768a31f6904cf2fafec Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-VolumesSnapshotsTestJSON-23607557-project Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 52faeb6e7c4e4707939ecce5f384ba16 Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesSnapshotsTestJSON-23607557-project Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: exception: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '655f88d3-73de-43c0-82c6-8b9dc2bcc780'} Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. (HTTP 404) (Request-ID: req-866540f8-2a94-4dcc-9d20-d1d4edc778cd) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 16:00:03.521229 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.525324 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.528707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-235bcfa3-4961-4f2c-8e72-537c65378369 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Returning 404 to user: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:00:03.529869 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-235bcfa3-4961-4f2c-8e72-537c65378369 tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 404 len: 109 microversion: 2.1 time: 0.114641 Oct 17 16:00:03.533302 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3047/5862] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 16:00:03 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:00:03.543237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3d6bc10-62f3-4601-8809-0c3e5358ef3d tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28c2ff8040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:03.653265 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d3d6bc10-62f3-4601-8809-0c3e5358ef3d tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] HTTP exception thrown: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3d6bc10-62f3-4601-8809-0c3e5358ef3d tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Request method failure captured: Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 HTTP/1.1 Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXvt-Jy3PU2k6OjN_1Cox6DCqExZTHHqjGQbDZKae0aphyjXamksexeICuJYlHwR26BF1hPV3fj7O79ggdT77sZo06ziEOfEOTupK15QHY1etTfMAzfc3n4n_tjV2oR3jftYZyWBP34nLLU2tWUa-HONcaZUTzXOhU5zqOiSJR_1B6A Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: d35ed75736aa4768a31f6904cf2fafec Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: d35ed75736aa4768a31f6904cf2fafec Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-VolumesSnapshotsTestJSON-23607557-project Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 52faeb6e7c4e4707939ecce5f384ba16 Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesSnapshotsTestJSON-23607557-project Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: exception: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '655f88d3-73de-43c0-82c6-8b9dc2bcc780'} Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. (HTTP 404) (Request-ID: req-cc996cfd-46fa-4286-be4b-839241e5ff67) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 16:00:03.655894 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.659960 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.667092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3d6bc10-62f3-4601-8809-0c3e5358ef3d tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Returning 404 to user: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:00:03.668394 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3d6bc10-62f3-4601-8809-0c3e5358ef3d tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 404 len: 109 microversion: 2.1 time: 0.129567 Oct 17 16:00:03.669580 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3048/5863] 10.222.0.87 () {58 vars in 1248 bytes} [Mon Oct 17 16:00:03 2022] DELETE /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:00:03.681172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b239617-4764-4c9e-9332-f190eb65a05f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Calling method '.version_select at 0x7f28be3d8550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:03.804765 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-1b239617-4764-4c9e-9332-f190eb65a05f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] HTTP exception thrown: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b239617-4764-4c9e-9332-f190eb65a05f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Request method failure captured: Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 HTTP/1.1 Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXvt-Jy3PU2k6OjN_1Cox6DCqExZTHHqjGQbDZKae0aphyjXamksexeICuJYlHwR26BF1hPV3fj7O79ggdT77sZo06ziEOfEOTupK15QHY1etTfMAzfc3n4n_tjV2oR3jftYZyWBP34nLLU2tWUa-HONcaZUTzXOhU5zqOiSJR_1B6A Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: d35ed75736aa4768a31f6904cf2fafec Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d35ed75736aa4768a31f6904cf2fafec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: d35ed75736aa4768a31f6904cf2fafec Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-23607557 Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-VolumesSnapshotsTestJSON-23607557-project Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 52faeb6e7c4e4707939ecce5f384ba16 Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesSnapshotsTestJSON-23607557-project Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: method: Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: exception: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '655f88d3-73de-43c0-82c6-8b9dc2bcc780'} Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. (HTTP 404) (Request-ID: req-d9d61dd2-6780-44c0-8093-26804a63ad9a) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 16:00:03.807647 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b239617-4764-4c9e-9332-f190eb65a05f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] Returning 404 to user: Volume 655f88d3-73de-43c0-82c6-8b9dc2bcc780 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:00:03.816081 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b239617-4764-4c9e-9332-f190eb65a05f tempest-VolumesSnapshotsTestJSON-23607557 tempest-VolumesSnapshotsTestJSON-23607557-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780" status: 404 len: 109 microversion: 2.1 time: 0.136384 Oct 17 16:00:03.827534 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3049/5864] 10.222.0.87 () {58 vars in 1245 bytes} [Mon Oct 17 16:00:03 2022] GET /compute/v2.1/os-volumes/655f88d3-73de-43c0-82c6-8b9dc2bcc780 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:00:04.099963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:04.139171 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a8c0a5bb-3d12-45a7-ac4d-fe0c22a58367 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1320 microversion: 2.1 time: 1.436389 Oct 17 16:00:04.140580 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2816/5865] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:02 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1320 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:05.197312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:05.199108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:05.220066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:05.224859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:05.225665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:05.226923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:05.227410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:05.228093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:06.289929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:06.300052 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cf48e40-4758-40cc-8f9b-39dddb830d8a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 200 len: 1507 microversion: 2.1 time: 1.107732 Oct 17 16:00:06.307658 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3050/5866] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:05 2022] GET /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 1507 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:06.338799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:06.345808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 0c30b9b7-7499-4d2d-8a0d-a5ad4252a014] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:06.394298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:06.402910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:06.404131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:06.406416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:06.407597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:06.412270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:07.220210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:07.241127 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e02bc03-3c8f-4e82-bedb-dc3d8230b569 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/0c30b9b7-7499-4d2d-8a0d-a5ad4252a014" status: 200 len: 1507 microversion: 2.1 time: 0.909698 Oct 17 16:00:07.245181 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2817/5867] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:06 2022] GET /compute/v2.1/servers/0c30b9b7-7499-4d2d-8a0d-a5ad4252a014 => generated 1507 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:07.296510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:07.297295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 0c30b9b7-7499-4d2d-8a0d-a5ad4252a014] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:07.311720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:07.312479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:07.313342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:07.314245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:07.314921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:07.317580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:07.399908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 0c30b9b7-7499-4d2d-8a0d-a5ad4252a014] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:00:07.637955 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0569140b-5b9f-4b5f-afc9-8b7e117d647d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0c30b9b7-7499-4d2d-8a0d-a5ad4252a014" status: 204 len: 0 microversion: 2.1 time: 0.345069 Oct 17 16:00:07.641391 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3051/5868] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:00:07 2022] DELETE /compute/v2.1/servers/0c30b9b7-7499-4d2d-8a0d-a5ad4252a014 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:00:07.653677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:07.654816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:07.671948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:07.673711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:07.677544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:07.678740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:07.681261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:07.687139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:07.805262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: f6aa2437-9304-423e-b77a-084f6a6412bc] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:00:08.062269 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a0748526-0ab4-4166-be22-ef77d55e8dd0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc" status: 204 len: 0 microversion: 2.1 time: 0.413342 Oct 17 16:00:08.077725 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2818/5869] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:00:07 2022] DELETE /compute/v2.1/servers/f6aa2437-9304-423e-b77a-084f6a6412bc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:00:08.617409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-506914357", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "3d0b62e7-8f40-4041-a44c-2541d3501e8f"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:08.814464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] validate_networks() for [('3d0b62e7-8f40-4041-a44c-2541d3501e8f', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:00:13.140727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-baf7065f-1413-485b-a85c-3d9c62baab3e req-fcd728d2-0e8a-4446-a177-36bd4f1e405a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c30b9b7-7499-4d2d-8a0d-a5ad4252a014", "name": "network-vif-unplugged", "status": "completed", "tag": "0935e8aa-23e0-4834-9ed7-337cd95b74e9"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:13.154221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:13.190163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-baf7065f-1413-485b-a85c-3d9c62baab3e req-fcd728d2-0e8a-4446-a177-36bd4f1e405a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:13.191012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-baf7065f-1413-485b-a85c-3d9c62baab3e req-fcd728d2-0e8a-4446-a177-36bd4f1e405a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:13.195263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-baf7065f-1413-485b-a85c-3d9c62baab3e req-fcd728d2-0e8a-4446-a177-36bd4f1e405a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:13.234902 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-baf7065f-1413-485b-a85c-3d9c62baab3e req-fcd728d2-0e8a-4446-a177-36bd4f1e405a service nova] Creating event network-vif-unplugged:0935e8aa-23e0-4834-9ed7-337cd95b74e9 for instance 0c30b9b7-7499-4d2d-8a0d-a5ad4252a014 on n-h1-854441-12 Oct 17 16:00:13.256737 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-baf7065f-1413-485b-a85c-3d9c62baab3e req-fcd728d2-0e8a-4446-a177-36bd4f1e405a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120191 Oct 17 16:00:13.262340 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2819/5870] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:00:14.512727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-49e68d79-3190-4e73-bfe0-e602c31c99d7 req-3ee691e6-26a2-4c5e-b6af-9fca4287cf88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6aa2437-9304-423e-b77a-084f6a6412bc", "name": "network-vif-deleted", "tag": "10495184-bc71-4358-b58e-a94449d68641"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:14.574206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-49e68d79-3190-4e73-bfe0-e602c31c99d7 req-3ee691e6-26a2-4c5e-b6af-9fca4287cf88 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:14.574930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-49e68d79-3190-4e73-bfe0-e602c31c99d7 req-3ee691e6-26a2-4c5e-b6af-9fca4287cf88 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:14.577665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-49e68d79-3190-4e73-bfe0-e602c31c99d7 req-3ee691e6-26a2-4c5e-b6af-9fca4287cf88 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:14.620021 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-49e68d79-3190-4e73-bfe0-e602c31c99d7 req-3ee691e6-26a2-4c5e-b6af-9fca4287cf88 service nova] Creating event network-vif-deleted:10495184-bc71-4358-b58e-a94449d68641 for instance f6aa2437-9304-423e-b77a-084f6a6412bc on n-h2-854441-12 Oct 17 16:00:14.637562 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-49e68d79-3190-4e73-bfe0-e602c31c99d7 req-3ee691e6-26a2-4c5e-b6af-9fca4287cf88 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143490 Oct 17 16:00:14.638355 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2820/5871] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 17 16:00:15.146730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:00:15.146730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:00:15.147508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:00:15.147908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:00:15.148530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:00:15.191272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:15.192162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:15.194163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:15.197953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:15.199170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:15.201385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:15.305282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Getting quotas for project 84871cf9d1c540fbb205ce4a09c77aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:00:15.330426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Getting quotas for user 7f21c15c2af940128aed2c6a0b2bbe9d and project 84871cf9d1c540fbb205ce4a09c77aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:00:15.384910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Going to run 2 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:00:15.396646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 9aa44f03-6370-481a-8fcb-549be6f05d5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:00:15.495505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=9aa44f03-6370-481a-8fcb-549be6f05d5d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:00:15.602226 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [21803a1b-e1a4-4b0e-800f-a5d69ae60f09] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:00:16.611389 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [21803a1b-e1a4-4b0e-800f-a5d69ae60f09] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 45108. Oct 17 16:00:16.624127 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82c44899-70af-4286-9d4b-884b9b754f5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 8.009562 Oct 17 16:00:16.630383 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3052/5872] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:00:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 8016 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 17 16:00:16.638359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:16.660718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:16.680886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Searching by: {'deleted': False, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 16:00:16.804098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:16.805058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:16.811277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:16.819589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:16.827370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:16.835567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:16.866258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-def97b84-6a0b-408b-88d7-661f3c7909e3 req-7cdbf81f-5bba-44f0-b2ca-f5720cb68df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c30b9b7-7499-4d2d-8a0d-a5ad4252a014", "name": "network-vif-deleted", "tag": "0935e8aa-23e0-4834-9ed7-337cd95b74e9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:16.912382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-def97b84-6a0b-408b-88d7-661f3c7909e3 req-7cdbf81f-5bba-44f0-b2ca-f5720cb68df7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:16.914190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-def97b84-6a0b-408b-88d7-661f3c7909e3 req-7cdbf81f-5bba-44f0-b2ca-f5720cb68df7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:16.914743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-def97b84-6a0b-408b-88d7-661f3c7909e3 req-7cdbf81f-5bba-44f0-b2ca-f5720cb68df7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:16.953591 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-def97b84-6a0b-408b-88d7-661f3c7909e3 req-7cdbf81f-5bba-44f0-b2ca-f5720cb68df7 service nova] Creating event network-vif-deleted:0935e8aa-23e0-4834-9ed7-337cd95b74e9 for instance 0c30b9b7-7499-4d2d-8a0d-a5ad4252a014 on n-h1-854441-12 Oct 17 16:00:16.961589 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-def97b84-6a0b-408b-88d7-661f3c7909e3 req-7cdbf81f-5bba-44f0-b2ca-f5720cb68df7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100955 Oct 17 16:00:16.962656 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3053/5873] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:00:16.968598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 16:00:17.126163 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4afa55e4-897a-44b1-810c-dad0e47fa915 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.493406 Oct 17 16:00:17.131800 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2821/5874] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 16:00:16 2022] GET /compute/v2.1/servers => generated 1003 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:17.157524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-868d5554-f951-48ac-a2e0-26f86f0c8051 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:17.158124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-868d5554-f951-48ac-a2e0-26f86f0c8051 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:17.357034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-722493973", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "104ff3e5-f531-4744-a775-9471f27d02f2"}], "key_name": "tempest-TestNetworkBasicOps-1362819479", "security_groups": [{"name": "tempest-secgroup-smoke-1878873345"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:17.645378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-868d5554-f951-48ac-a2e0-26f86f0c8051 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:17.654656 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-868d5554-f951-48ac-a2e0-26f86f0c8051 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1217 microversion: 2.1 time: 0.507186 Oct 17 16:00:17.658848 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3054/5875] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:17 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1217 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:17.958268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] validate_networks() for [('104ff3e5-f531-4744-a775-9471f27d02f2', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:00:18.702097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8d5604b-c1bd-4ab6-8ba0-44b12d27e462 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:18.702958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8d5604b-c1bd-4ab6-8ba0-44b12d27e462 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:18.874783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8d5604b-c1bd-4ab6-8ba0-44b12d27e462 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:18.882772 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8d5604b-c1bd-4ab6-8ba0-44b12d27e462 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1217 microversion: 2.1 time: 0.194696 Oct 17 16:00:18.889311 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3055/5876] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:18 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:19.922641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-703198d7-d145-47b5-84a0-ee3602f560df tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:19.923775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-703198d7-d145-47b5-84a0-ee3602f560df tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:20.309230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-703198d7-d145-47b5-84a0-ee3602f560df tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:20.317323 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-703198d7-d145-47b5-84a0-ee3602f560df tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1217 microversion: 2.1 time: 0.400032 Oct 17 16:00:20.320203 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3056/5877] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:19 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1217 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:21.354803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15ad3a5c-ff64-4c50-a3cc-ab2adbd9cb8d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:21.355750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15ad3a5c-ff64-4c50-a3cc-ab2adbd9cb8d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:21.515765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:00:21.516389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:00:21.516743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:00:21.517206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:00:21.517757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:00:21.544161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:21.544680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:21.545134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:21.545909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:21.546383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:21.546857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:21.656521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for project 15545d0f177d4dcab629c37feb5a6328. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:00:21.683961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Getting quotas for user b6684e87890f4ba5af7adb91145e4d4f and project 15545d0f177d4dcab629c37feb5a6328. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:00:21.739167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:00:21.772593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:00:21.827747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15ad3a5c-ff64-4c50-a3cc-ab2adbd9cb8d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:21.871237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15ad3a5c-ff64-4c50-a3cc-ab2adbd9cb8d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1217 microversion: 2.1 time: 0.516749 Oct 17 16:00:21.874362 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3057/5878] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:21 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1217 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:21.993300 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bd8b336b-f4cb-47bb-8c07-b94004c6c19c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.644310 Oct 17 16:00:21.996315 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2822/5879] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:00:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 4648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:00:22.014008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7af58aa4-5f81-4f05-a365-4655221feaf7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:22.016222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7af58aa4-5f81-4f05-a365-4655221feaf7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:22.701103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7af58aa4-5f81-4f05-a365-4655221feaf7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:22.735855 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7af58aa4-5f81-4f05-a365-4655221feaf7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1248 microversion: 2.1 time: 0.726234 Oct 17 16:00:22.764718 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3058/5880] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:22 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1248 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:22.932229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3e726a6-ed38-4aec-aeec-681b176be9a1 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:22.936649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3e726a6-ed38-4aec-aeec-681b176be9a1 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:23.795132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:23.801546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:23.832110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:23.842831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:23.844070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:23.857895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:23.858785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:23.859430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:23.859893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:23.883496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e3e726a6-ed38-4aec-aeec-681b176be9a1 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:23.893684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:23.926165 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3e726a6-ed38-4aec-aeec-681b176be9a1 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1217 microversion: 2.1 time: 1.001910 Oct 17 16:00:23.945658 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2823/5881] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:22 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1217 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:24.255770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:24.322138 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-481a5273-976b-48c1-a506-f4ae0a1c5a96 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1252 microversion: 2.1 time: 0.530045 Oct 17 16:00:24.346888 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3059/5882] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:23 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1252 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:24.981795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:24.982674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:25.009989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:25.021690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:25.022337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:25.023008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:25.023937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:25.029682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:25.030379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:25.262371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:25.285124 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc28edca-8f23-44bd-bce0-a41388b9c60e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1277 microversion: 2.1 time: 0.309093 Oct 17 16:00:25.304451 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2824/5883] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:24 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1277 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:25.373622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:25.375897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:25.462333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:25.491310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:25.493269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:25.502976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:25.511405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:25.515838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:25.516961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:26.327010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:26.328216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:26.343492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:26.344337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:26.345334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:26.346757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:26.347784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:26.348592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:26.359634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:26.487648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:26.506727 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a51ba904-f3be-40dc-a83e-d308fa2ddd23 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1308 microversion: 2.1 time: 1.141546 Oct 17 16:00:26.507887 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3060/5884] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:25 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1308 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:26.593069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:26.630817 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8c95dab4-d90e-4c98-a288-04c8b2b42f4a tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1275 microversion: 2.1 time: 0.314821 Oct 17 16:00:26.650556 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2825/5885] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:26 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1275 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:27.536757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:27.537589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:27.550031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:27.554685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:27.555556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:27.590379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:27.591247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:27.594789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:27.677076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:27.681485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:27.733163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:27.737475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:27.739470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:27.745563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:27.751369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:27.752405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:27.934913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:27.949883 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b329bcd0-48be-47de-a402-9e0694a5100b tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1306 microversion: 2.1 time: 0.418379 Oct 17 16:00:27.950811 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3061/5886] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:27 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1306 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:28.349900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:28.393990 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-580fe167-fdac-44e1-9e11-175b9ee22b7d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1275 microversion: 2.1 time: 0.722302 Oct 17 16:00:28.411384 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2826/5887] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:27 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1275 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:28.987456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:28.989616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:29.014768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:29.019637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:29.020391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:29.021553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:29.027553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:29.028767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:29.260077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:29.283475 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82f124eb-fb7f-49dd-a0ab-106488fc215c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1306 microversion: 2.1 time: 0.302652 Oct 17 16:00:29.295076 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3062/5888] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:28 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1306 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:29.463070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:29.464324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:29.498795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:29.500296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:29.502456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:29.505281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:29.505821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:29.508806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:29.807653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:29.828483 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c41cf41e-ca36-4a5f-a10d-e5f8aa5c8241 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1275 microversion: 2.1 time: 0.370273 Oct 17 16:00:29.828483 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2827/5889] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:29 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1275 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:30.314189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:30.322002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:30.370683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:30.371637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:30.382451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:30.383933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:30.384808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:30.391991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:30.852376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:30.853022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:30.869301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:30.879423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:30.887311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:30.889043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:30.889801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:30.890687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:31.296286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:31.310701 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53c8058f-e424-465d-b3f2-f2d0a0d52058 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1374 microversion: 2.1 time: 1.003953 Oct 17 16:00:31.319237 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3063/5890] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:30 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1374 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:31.510112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:31.521253 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa5c87d8-b676-49d9-8ad4-de7fe84f1ff6 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 0.672956 Oct 17 16:00:31.521905 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2828/5891] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:30 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:32.342272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:32.343451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:32.368514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:32.369697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:32.371402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:32.372586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:32.373304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:32.373964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:32.574211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:32.579742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:32.584025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:32.617811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:32.618191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:32.619306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:32.621779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:32.623028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:32.624058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:32.732325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:33.361407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:33.389150 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e58d42dd-7d84-457c-bcb4-8792b6a5a486 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1374 microversion: 2.1 time: 1.055050 Oct 17 16:00:33.397426 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3064/5892] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:32 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1374 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:33.921006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:34.137478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cab43deb-717f-45cc-b64e-95495fb639c3 req-15a87ccd-0d53-454f-91e1-f54a4f310d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a583160-a18d-4425-b60f-ecdccb91b019", "tag": "8873bad7-cb98-4e08-98ae-1d4304e2bf5e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:34.189571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cab43deb-717f-45cc-b64e-95495fb639c3 req-15a87ccd-0d53-454f-91e1-f54a4f310d16 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:34.191204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cab43deb-717f-45cc-b64e-95495fb639c3 req-15a87ccd-0d53-454f-91e1-f54a4f310d16 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:34.192191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cab43deb-717f-45cc-b64e-95495fb639c3 req-15a87ccd-0d53-454f-91e1-f54a4f310d16 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:34.226404 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cab43deb-717f-45cc-b64e-95495fb639c3 req-15a87ccd-0d53-454f-91e1-f54a4f310d16 service nova] Creating event network-changed:8873bad7-cb98-4e08-98ae-1d4304e2bf5e for instance 9a583160-a18d-4425-b60f-ecdccb91b019 on n-h1-854441-12 Oct 17 16:00:34.238161 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cab43deb-717f-45cc-b64e-95495fb639c3 req-15a87ccd-0d53-454f-91e1-f54a4f310d16 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.835633 Oct 17 16:00:34.240479 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3065/5893] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:34.257074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0525bdd6-367e-4f55-939a-d8b1a6ba7c6d req-28a9f639-4e1c-4a00-8a92-bf4df0b80e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa44f03-6370-481a-8fcb-549be6f05d5d", "tag": "22d0405d-a1fc-424b-888f-f1d9f41d0904"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:34.283582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0525bdd6-367e-4f55-939a-d8b1a6ba7c6d req-28a9f639-4e1c-4a00-8a92-bf4df0b80e05 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:34.285374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0525bdd6-367e-4f55-939a-d8b1a6ba7c6d req-28a9f639-4e1c-4a00-8a92-bf4df0b80e05 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:34.286597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0525bdd6-367e-4f55-939a-d8b1a6ba7c6d req-28a9f639-4e1c-4a00-8a92-bf4df0b80e05 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:34.318106 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0525bdd6-367e-4f55-939a-d8b1a6ba7c6d req-28a9f639-4e1c-4a00-8a92-bf4df0b80e05 service nova] Creating event network-changed:22d0405d-a1fc-424b-888f-f1d9f41d0904 for instance 9aa44f03-6370-481a-8fcb-549be6f05d5d on n-h1-854441-12 Oct 17 16:00:34.330981 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0525bdd6-367e-4f55-939a-d8b1a6ba7c6d req-28a9f639-4e1c-4a00-8a92-bf4df0b80e05 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086597 Oct 17 16:00:34.333043 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3066/5894] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:34.422692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:34.425752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:34.446796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:34.448776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:34.450558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:34.452613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:34.454479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:34.455944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:34.573620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:34.584392 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4e36b794-3d77-472d-9912-4b557455cf38 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 2.021633 Oct 17 16:00:34.599150 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2829/5895] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:32 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:35.624543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:35.625801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:35.641113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:35.641923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:35.642572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:35.643501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:35.644134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:35.644736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:36.352614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:36.368471 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34d25984-6b3e-40d6-bc9c-4e6df9d82be6 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1374 microversion: 2.1 time: 1.956587 Oct 17 16:00:36.368471 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3067/5896] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:34 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1374 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:36.553146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:36.584293 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-552bbd25-1d48-4951-a3be-dfa62ee14c5d tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 0.964307 Oct 17 16:00:36.600725 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2830/5897] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:35 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:36.884304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7a2aa889-08a1-40ba-8603-8936b36d6783 req-952625d2-1fc4-48f4-8895-6f630b161cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0b799b-db3c-4f9d-8f09-11ae01ab21ad", "tag": "07e4f9b9-2337-4da6-be8a-e0b6d19ee1bc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:36.914242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a2aa889-08a1-40ba-8603-8936b36d6783 req-952625d2-1fc4-48f4-8895-6f630b161cb1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:36.931777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a2aa889-08a1-40ba-8603-8936b36d6783 req-952625d2-1fc4-48f4-8895-6f630b161cb1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:36.933136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a2aa889-08a1-40ba-8603-8936b36d6783 req-952625d2-1fc4-48f4-8895-6f630b161cb1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:36.979050 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7a2aa889-08a1-40ba-8603-8936b36d6783 req-952625d2-1fc4-48f4-8895-6f630b161cb1 service nova] Creating event network-changed:07e4f9b9-2337-4da6-be8a-e0b6d19ee1bc for instance 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad on n-h2-854441-12 Oct 17 16:00:37.002119 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7a2aa889-08a1-40ba-8603-8936b36d6783 req-952625d2-1fc4-48f4-8895-6f630b161cb1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121382 Oct 17 16:00:37.008022 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3068/5898] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:00:37.409056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:37.410632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:37.429230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:37.432006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:37.452109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:37.460257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:37.468208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:37.473625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:37.623151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:37.633382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:37.699293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:37.717767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:37.719211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:37.728631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:37.731596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:37.733028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:38.547378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:38.588721 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5a4ff714-c29f-4256-8f61-3b6a5e39f85d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1374 microversion: 2.1 time: 1.183933 Oct 17 16:00:38.589955 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2831/5899] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:37 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1374 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:39.074143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:39.089612 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6172380a-16a0-4760-89f6-c28e91708a91 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 1.480573 Oct 17 16:00:39.111335 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3069/5900] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:37 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:39.632702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:39.634137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:39.665099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:39.669979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:39.671534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:39.679667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:39.680580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:39.681379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:40.136190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:40.142324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:40.163903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:40.165568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:40.166985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:40.168407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:40.169170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:40.171426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:40.173475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:40.217455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7cbd79fa-25f4-4a94-a4f9-d8eb5c61423c tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1374 microversion: 2.1 time: 0.585606 Oct 17 16:00:40.232336 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2832/5901] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:39 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1374 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:40.274127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ead599d2-650d-4fe9-bba0-26f30c01ff06 req-ab2a30e3-7235-4f93-b25a-8be0a409a6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a583160-a18d-4425-b60f-ecdccb91b019", "name": "network-vif-plugged", "status": "completed", "tag": "8873bad7-cb98-4e08-98ae-1d4304e2bf5e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:40.341446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ead599d2-650d-4fe9-bba0-26f30c01ff06 req-ab2a30e3-7235-4f93-b25a-8be0a409a6ec service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:40.344569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ead599d2-650d-4fe9-bba0-26f30c01ff06 req-ab2a30e3-7235-4f93-b25a-8be0a409a6ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:40.348264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ead599d2-650d-4fe9-bba0-26f30c01ff06 req-ab2a30e3-7235-4f93-b25a-8be0a409a6ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:40.382903 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ead599d2-650d-4fe9-bba0-26f30c01ff06 req-ab2a30e3-7235-4f93-b25a-8be0a409a6ec service nova] Creating event network-vif-plugged:8873bad7-cb98-4e08-98ae-1d4304e2bf5e for instance 9a583160-a18d-4425-b60f-ecdccb91b019 on n-h1-854441-12 Oct 17 16:00:40.390482 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ead599d2-650d-4fe9-bba0-26f30c01ff06 req-ab2a30e3-7235-4f93-b25a-8be0a409a6ec service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141351 Oct 17 16:00:40.391415 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2833/5902] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:41.184365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:41.208855 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f5ba00dc-767d-4c79-ae6f-a441ae5f6249 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 1.081913 Oct 17 16:00:41.211017 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3070/5903] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:40 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:41.277043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:41.277962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:41.290425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:41.296236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:41.297087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:41.298434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:41.299209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:41.311123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:42.237671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:42.238994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:42.239820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:42.253547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:42.254044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:42.259059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:42.261799 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7542663c-4fe9-4ff3-8d62-5bc098b7988d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1374 microversion: 2.1 time: 0.990340 Oct 17 16:00:42.262798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:42.263316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:42.263749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:42.285802 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2834/5904] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:41 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1374 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:43.290841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:43.291855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:43.311465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:43.311925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:43.312366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:43.313164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:43.320357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:43.320933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:44.343309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:44.351000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:44.372993 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f454b97b-4aae-4b09-8d5f-4fccd2b91308 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1546 microversion: 2.1 time: 1.086539 Oct 17 16:00:44.374344 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-70e2d017-e9b3-492b-9c34-19f131e75b46 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 2.142190 Oct 17 16:00:44.394536 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3071/5905] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:42 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:44.395114 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2835/5906] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:43 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1546 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:44.405292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:44.405932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:44.413212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:44.414041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:44.422906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:44.424098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:44.425618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:44.428004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:44.588148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6f68310c-2111-49d9-8678-aef5be7cf5d4 req-b0c3bc98-8013-4f5d-a5c7-a6eb9194eac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa44f03-6370-481a-8fcb-549be6f05d5d", "name": "network-vif-plugged", "status": "completed", "tag": "22d0405d-a1fc-424b-888f-f1d9f41d0904"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:44.677471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6f68310c-2111-49d9-8678-aef5be7cf5d4 req-b0c3bc98-8013-4f5d-a5c7-a6eb9194eac4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:44.681422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6f68310c-2111-49d9-8678-aef5be7cf5d4 req-b0c3bc98-8013-4f5d-a5c7-a6eb9194eac4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:44.682232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6f68310c-2111-49d9-8678-aef5be7cf5d4 req-b0c3bc98-8013-4f5d-a5c7-a6eb9194eac4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:44.750034 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6f68310c-2111-49d9-8678-aef5be7cf5d4 req-b0c3bc98-8013-4f5d-a5c7-a6eb9194eac4 service nova] Creating event network-vif-plugged:22d0405d-a1fc-424b-888f-f1d9f41d0904 for instance 9aa44f03-6370-481a-8fcb-549be6f05d5d on n-h1-854441-12 Oct 17 16:00:44.767049 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6f68310c-2111-49d9-8678-aef5be7cf5d4 req-b0c3bc98-8013-4f5d-a5c7-a6eb9194eac4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189546 Oct 17 16:00:44.769546 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3072/5907] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:45.418985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:45.432997 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2fff0ffb-c198-4d6c-9f63-f8a41dbc12cb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1546 microversion: 2.1 time: 1.031902 Oct 17 16:00:45.433615 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2836/5908] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:44 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1546 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:45.444279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:45.445151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:45.472625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:45.473314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:45.473771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:45.480162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:45.480678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:45.485258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:46.408113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:46.417794 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33e386ef-220d-4a2f-a5b6-90f0e621b1fc tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 0.979396 Oct 17 16:00:46.430978 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3073/5909] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:45 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:47.465991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:47.467539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:47.500532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:47.507199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:47.513745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:47.518722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:47.522676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:47.523253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:48.708288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:48.749842 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f173d175-0a27-428d-b274-ef7a6bd93b93 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 1.289232 Oct 17 16:00:48.760472 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2837/5910] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:47 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:49.815154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:49.821180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:49.847762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:49.851142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:49.852961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:49.856447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:49.857890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:49.858959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:50.434156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f9805ead-af73-45d2-859d-73ab8d20176d req-756831d0-ae08-426b-a639-14dc42a931d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0b799b-db3c-4f9d-8f09-11ae01ab21ad", "name": "network-vif-plugged", "status": "completed", "tag": "07e4f9b9-2337-4da6-be8a-e0b6d19ee1bc"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:50.535265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f9805ead-af73-45d2-859d-73ab8d20176d req-756831d0-ae08-426b-a639-14dc42a931d1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:50.536746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f9805ead-af73-45d2-859d-73ab8d20176d req-756831d0-ae08-426b-a639-14dc42a931d1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:50.540004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f9805ead-af73-45d2-859d-73ab8d20176d req-756831d0-ae08-426b-a639-14dc42a931d1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:50.603428 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f9805ead-af73-45d2-859d-73ab8d20176d req-756831d0-ae08-426b-a639-14dc42a931d1 service nova] Creating event network-vif-plugged:07e4f9b9-2337-4da6-be8a-e0b6d19ee1bc for instance 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad on n-h2-854441-12 Oct 17 16:00:50.623529 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f9805ead-af73-45d2-859d-73ab8d20176d req-756831d0-ae08-426b-a639-14dc42a931d1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203260 Oct 17 16:00:50.650335 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2838/5911] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:51.279890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:51.294099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9f8ea2f9-9da6-4486-ba97-aefa9dd0cbf8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 1.489071 Oct 17 16:00:51.295160 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3074/5912] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:49 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:00:52.347451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:52.353569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:52.384422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:52.389317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:52.393467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:52.396860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:52.403353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:52.407412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:53.494372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:53.519279 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b94776e-61c7-4136-a8fa-0c41ff5969b8 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1317 microversion: 2.1 time: 1.185417 Oct 17 16:00:53.539603 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2839/5913] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:52 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1317 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:54.599570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:54.605646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:54.648272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:54.653874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:54.656948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:54.660482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:54.661935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:54.668707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:54.675453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:54.713441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=80 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:55.996654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:56.050429 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81a3f330-c3a6-4115-9ff5-669e977da675 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 200 len: 1505 microversion: 2.1 time: 1.484726 Oct 17 16:00:56.066198 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3075/5914] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:54 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 1505 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:56.087635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:56.088320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 9aa44f03-6370-481a-8fcb-549be6f05d5d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:56.091037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=32 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:56.101010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:56.101816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:56.102431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:56.103384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:56.107430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:56.108204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:57.089471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c9a3a76b-4f9c-4199-adf8-45bef6c24a26 req-bac35129-14c7-43bf-80d7-e104097e4f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a583160-a18d-4425-b60f-ecdccb91b019", "tag": "8873bad7-cb98-4e08-98ae-1d4304e2bf5e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:00:57.154130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c9a3a76b-4f9c-4199-adf8-45bef6c24a26 req-bac35129-14c7-43bf-80d7-e104097e4f8c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:57.165979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c9a3a76b-4f9c-4199-adf8-45bef6c24a26 req-bac35129-14c7-43bf-80d7-e104097e4f8c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:57.167564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c9a3a76b-4f9c-4199-adf8-45bef6c24a26 req-bac35129-14c7-43bf-80d7-e104097e4f8c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:57.247977 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c9a3a76b-4f9c-4199-adf8-45bef6c24a26 req-bac35129-14c7-43bf-80d7-e104097e4f8c service nova] Creating event network-changed:8873bad7-cb98-4e08-98ae-1d4304e2bf5e for instance 9a583160-a18d-4425-b60f-ecdccb91b019 on n-h1-854441-12 Oct 17 16:00:57.293741 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c9a3a76b-4f9c-4199-adf8-45bef6c24a26 req-bac35129-14c7-43bf-80d7-e104097e4f8c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226404 Oct 17 16:00:57.305577 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3076/5915] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:00:58.236257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:00:58.240623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=86 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:00:58.285327 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-da78859b-a767-4dc2-962d-3d8923a2140e tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d" status: 200 len: 1504 microversion: 2.1 time: 2.201879 Oct 17 16:00:58.300632 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2840/5916] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:56 2022] GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d => generated 1504 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:00:58.361395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:58.387229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 9aa44f03-6370-481a-8fcb-549be6f05d5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:58.424325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:58.425191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:58.426555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:58.437354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:58.438688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:58.439979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:58.591931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 9aa44f03-6370-481a-8fcb-549be6f05d5d] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:00:58.971930 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39499950-1787-4c92-8bb7-13d94d65c5b0 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d" status: 204 len: 0 microversion: 2.1 time: 0.631929 Oct 17 16:00:58.974413 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3077/5917] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:00:58 2022] DELETE /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:00:58.984466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:58.985965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:59.014311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:59.020634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:59.022488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:59.024547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:59.026459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:59.031345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:59.130329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:00:59.404192 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-76d45c93-bb9a-4269-a5ea-41e7d2549b6b tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 204 len: 0 microversion: 2.1 time: 0.423727 Oct 17 16:00:59.411180 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2841/5918] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:00:58 2022] DELETE /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:00:59.421103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:00:59.422112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 9aa44f03-6370-481a-8fcb-549be6f05d5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:00:59.477695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:59.478625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:59.481113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:00:59.482642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:00:59.493174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:00:59.498232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:01.269614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:01:01.283617 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e61d981f-6e22-4c37-8ad1-faf3f8b98f56 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d" status: 200 len: 1510 microversion: 2.1 time: 1.864102 Oct 17 16:01:01.284731 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3078/5919] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:00:59 2022] GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d => generated 1510 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:01:02.323245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:02.338136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 9aa44f03-6370-481a-8fcb-549be6f05d5d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:02.383532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:02.385818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:02.388762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:02.392055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:02.396700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:02.398722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:02.909128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:01:02.924090 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-05ee350f-4748-4e2b-99cf-3d740995fd25 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d" status: 200 len: 1468 microversion: 2.1 time: 0.618085 Oct 17 16:01:02.928103 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2842/5920] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:02 2022] GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d => generated 1468 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:01:03.152451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0481784f-1143-471d-b521-6c7c5b0fe237 req-782f8b4a-9ac7-4f40-9ead-2e73e6fb451c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0b799b-db3c-4f9d-8f09-11ae01ab21ad", "name": "network-vif-deleted", "tag": "07e4f9b9-2337-4da6-be8a-e0b6d19ee1bc"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:01:03.233646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0481784f-1143-471d-b521-6c7c5b0fe237 req-782f8b4a-9ac7-4f40-9ead-2e73e6fb451c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:03.234162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0481784f-1143-471d-b521-6c7c5b0fe237 req-782f8b4a-9ac7-4f40-9ead-2e73e6fb451c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:03.234636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0481784f-1143-471d-b521-6c7c5b0fe237 req-782f8b4a-9ac7-4f40-9ead-2e73e6fb451c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:03.280422 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0481784f-1143-471d-b521-6c7c5b0fe237 req-782f8b4a-9ac7-4f40-9ead-2e73e6fb451c service nova] Creating event network-vif-deleted:07e4f9b9-2337-4da6-be8a-e0b6d19ee1bc for instance 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad on n-h2-854441-12 Oct 17 16:01:03.298256 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0481784f-1143-471d-b521-6c7c5b0fe237 req-782f8b4a-9ac7-4f40-9ead-2e73e6fb451c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160233 Oct 17 16:01:03.300913 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3079/5921] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:01:03.543646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0341c87f-2d7f-4da9-85a7-da24aee461a6 req-7881c0a3-9367-48aa-b591-a486c06a21cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa44f03-6370-481a-8fcb-549be6f05d5d", "name": "network-vif-deleted", "tag": "22d0405d-a1fc-424b-888f-f1d9f41d0904"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:01:03.624293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0341c87f-2d7f-4da9-85a7-da24aee461a6 req-7881c0a3-9367-48aa-b591-a486c06a21cb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:03.632562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0341c87f-2d7f-4da9-85a7-da24aee461a6 req-7881c0a3-9367-48aa-b591-a486c06a21cb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:03.638016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0341c87f-2d7f-4da9-85a7-da24aee461a6 req-7881c0a3-9367-48aa-b591-a486c06a21cb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:03.717716 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0341c87f-2d7f-4da9-85a7-da24aee461a6 req-7881c0a3-9367-48aa-b591-a486c06a21cb service nova] Creating event network-vif-deleted:22d0405d-a1fc-424b-888f-f1d9f41d0904 for instance 9aa44f03-6370-481a-8fcb-549be6f05d5d on n-h1-854441-12 Oct 17 16:01:03.740157 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0341c87f-2d7f-4da9-85a7-da24aee461a6 req-7881c0a3-9367-48aa-b591-a486c06a21cb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227275 Oct 17 16:01:03.752401 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2843/5922] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:01:03.972269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:03.977341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 9aa44f03-6370-481a-8fcb-549be6f05d5d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:04.021936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:04.028423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:04.031167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:04.035032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:04.038309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:04.040876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:04.196206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:04.197405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:04.198042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:04.198731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lazy-loading 'fault' on Instance uuid 9aa44f03-6370-481a-8fcb-549be6f05d5d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:01:04.337793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f21c15c2af940128aed2c6a0b2bbe9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84871cf9d1c540fbb205ce4a09c77aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:01:04.353990 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-254950ff-1cf0-41fe-b129-7cbdc3ec50e2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d" status: 200 len: 1307 microversion: 2.1 time: 0.391349 Oct 17 16:01:04.372748 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3080/5923] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:03 2022] GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d => generated 1307 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:01:05.388490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:05.398575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 9aa44f03-6370-481a-8fcb-549be6f05d5d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:05.429044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:05.437663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:05.438701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:05.440146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:05.441918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:05.442975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:05.552424 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] HTTP exception thrown: Instance 9aa44f03-6370-481a-8fcb-549be6f05d5d could not be found. Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Request method failure captured: Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d HTTP/1.1 Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXvW_tpgoKfrsGGWSQeb-xR1nDQo31a6ypGSRofQZC3MIxfbQwJ_G_6UFqyJSQo4IjSYr4f0lpc4l60pMGOoy0rfNkBsLK_gnXVUeaPVWXYIwdzImpXjO9G-L55F6HXGx7UOJp5gDeQKINUyJa3rV-UNXHQuh5sCeooFAj7JBZX3QBI Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 84871cf9d1c540fbb205ce4a09c77aa5 Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-MultipleCreateTestJSON-1640085151 Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/84871cf9d1c540fbb205ce4a09c77aa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/84871cf9d1c540fbb205ce4a09c77aa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_84871cf9d1c540fbb205ce4a09c77aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/84871cf9d1c540fbb205ce4a09c77aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-MultipleCreateTestJSON-1640085151 Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 84871cf9d1c540fbb205ce4a09c77aa5 Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1640085151 Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-MultipleCreateTestJSON-1640085151-project Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 7f21c15c2af940128aed2c6a0b2bbe9d Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-MultipleCreateTestJSON-1640085151-project Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 9aa44f03-6370-481a-8fcb-549be6f05d5d could not be found. Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '9aa44f03-6370-481a-8fcb-549be6f05d5d'} Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aa44f03-6370-481a-8fcb-549be6f05d5d could not be found. Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aa44f03-6370-481a-8fcb-549be6f05d5d could not be found. Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:01:05.558184 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.563098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:01:05.563098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:01:05.563098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:01:05.563098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:01:05.563098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:01:05.563098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aa44f03-6370-481a-8fcb-549be6f05d5d could not be found. Oct 17 16:01:05.563098 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.567169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Returning 404 to user: Instance 9aa44f03-6370-481a-8fcb-549be6f05d5d could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:01:05.570949 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4ba6bf98-d073-4f6c-97fb-89e5785fa1f2 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d" status: 404 len: 111 microversion: 2.1 time: 0.192829 Oct 17 16:01:05.575355 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2844/5924] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:05 2022] GET /compute/v2.1/servers/9aa44f03-6370-481a-8fcb-549be6f05d5d => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:01:05.589925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:05.592747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] [instance: 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:05.620581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:05.623517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:05.626874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:05.629346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:05.630206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:05.634740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:05.685813 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] HTTP exception thrown: Instance 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad could not be found. Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Request method failure captured: Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad HTTP/1.1 Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXvW_tpgoKfrsGGWSQeb-xR1nDQo31a6ypGSRofQZC3MIxfbQwJ_G_6UFqyJSQo4IjSYr4f0lpc4l60pMGOoy0rfNkBsLK_gnXVUeaPVWXYIwdzImpXjO9G-L55F6HXGx7UOJp5gDeQKINUyJa3rV-UNXHQuh5sCeooFAj7JBZX3QBI Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 84871cf9d1c540fbb205ce4a09c77aa5 Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-MultipleCreateTestJSON-1640085151 Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/84871cf9d1c540fbb205ce4a09c77aa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/84871cf9d1c540fbb205ce4a09c77aa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_84871cf9d1c540fbb205ce4a09c77aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/84871cf9d1c540fbb205ce4a09c77aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-MultipleCreateTestJSON-1640085151 Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 84871cf9d1c540fbb205ce4a09c77aa5 Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1640085151 Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-MultipleCreateTestJSON-1640085151-project Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 7f21c15c2af940128aed2c6a0b2bbe9d Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-MultipleCreateTestJSON-1640085151-project Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad could not be found. Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6a0b799b-db3c-4f9d-8f09-11ae01ab21ad'} Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad could not be found. Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad could not be found. Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:01:05.699205 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.703848 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:01:05.703848 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:01:05.703848 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:01:05.703848 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:01:05.703848 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:01:05.703848 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad could not be found. Oct 17 16:01:05.703848 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:05.703848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] Returning 404 to user: Instance 6a0b799b-db3c-4f9d-8f09-11ae01ab21ad could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:01:05.704426 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa7277bf-eb68-4b20-a48a-94fe15615552 tempest-MultipleCreateTestJSON-1640085151 tempest-MultipleCreateTestJSON-1640085151-project] 10.222.0.87 "GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad" status: 404 len: 111 microversion: 2.1 time: 0.119574 Oct 17 16:01:05.717301 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3081/5925] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:05 2022] GET /compute/v2.1/servers/6a0b799b-db3c-4f9d-8f09-11ae01ab21ad => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:01:06.540161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55b409db-2fea-4ac5-a1eb-41b71e932ad3 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:01:06.543308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-55b409db-2fea-4ac5-a1eb-41b71e932ad3 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:06.569123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55b409db-2fea-4ac5-a1eb-41b71e932ad3 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:06.569943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55b409db-2fea-4ac5-a1eb-41b71e932ad3 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:06.570839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55b409db-2fea-4ac5-a1eb-41b71e932ad3 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:06.575867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55b409db-2fea-4ac5-a1eb-41b71e932ad3 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:06.576835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55b409db-2fea-4ac5-a1eb-41b71e932ad3 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:06.577715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55b409db-2fea-4ac5-a1eb-41b71e932ad3 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:06.710896 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-55b409db-2fea-4ac5-a1eb-41b71e932ad3 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "POST /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019/action" status: 200 len: 24565 microversion: 2.1 time: 0.174903 Oct 17 16:01:06.721710 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2845/5926] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:01:06 2022] POST /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019/action => generated 24565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:01:18.410825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-767c393c-74f9-4caf-83e0-12c5806d18eb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:01:18.416992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-767c393c-74f9-4caf-83e0-12c5806d18eb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:18.445019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:01:18.448614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:01:18.498332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767c393c-74f9-4caf-83e0-12c5806d18eb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:18.505066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767c393c-74f9-4caf-83e0-12c5806d18eb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:18.508702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767c393c-74f9-4caf-83e0-12c5806d18eb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:18.511728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767c393c-74f9-4caf-83e0-12c5806d18eb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:18.512816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767c393c-74f9-4caf-83e0-12c5806d18eb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:18.519666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-767c393c-74f9-4caf-83e0-12c5806d18eb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:18.793923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-767c393c-74f9-4caf-83e0-12c5806d18eb tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "POST /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019/action" status: 200 len: 32638 microversion: 2.1 time: 0.402144 Oct 17 16:01:18.795426 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3082/5927] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:01:18 2022] POST /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019/action => generated 32638 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:01:22.338839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:22.339497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:22.353082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0e90e2c6-0f2f-4424-9f06-27fe6b5c51c5 req-e338cad6-4dfe-4603-9f06-d136421c348a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a583160-a18d-4425-b60f-ecdccb91b019", "tag": "8873bad7-cb98-4e08-98ae-1d4304e2bf5e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:01:22.368987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:01:22.370123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:01:22.371863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:22.372363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:22.372799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:22.383010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:22.384265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0e90e2c6-0f2f-4424-9f06-27fe6b5c51c5 req-e338cad6-4dfe-4603-9f06-d136421c348a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:22.385035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:22.385891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0e90e2c6-0f2f-4424-9f06-27fe6b5c51c5 req-e338cad6-4dfe-4603-9f06-d136421c348a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:22.387075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:22.388820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0e90e2c6-0f2f-4424-9f06-27fe6b5c51c5 req-e338cad6-4dfe-4603-9f06-d136421c348a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:22.437856 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0e90e2c6-0f2f-4424-9f06-27fe6b5c51c5 req-e338cad6-4dfe-4603-9f06-d136421c348a service nova] Creating event network-changed:8873bad7-cb98-4e08-98ae-1d4304e2bf5e for instance 9a583160-a18d-4425-b60f-ecdccb91b019 on n-h1-854441-12 Oct 17 16:01:22.460324 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0e90e2c6-0f2f-4424-9f06-27fe6b5c51c5 req-e338cad6-4dfe-4603-9f06-d136421c348a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111508 Oct 17 16:01:22.465979 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3083/5928] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:01:22.499671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:01:22.783165 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e6832902-4838-400e-a0eb-67fa6e3524e1 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 204 len: 0 microversion: 2.1 time: 0.446156 Oct 17 16:01:22.786796 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2846/5929] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:01:22 2022] DELETE /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:01:22.796140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:22.797248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:22.817953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:22.824721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:22.827266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:22.836566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:22.837619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:22.838394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:23.923221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:01:23.987361 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a5b850e-fefb-482f-80f4-e98c0e318a77 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1671 microversion: 2.1 time: 1.186217 Oct 17 16:01:24.010019 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3084/5930] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:22 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1671 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:01:25.027635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:25.037763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:25.077530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:25.087697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:25.089672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:25.091126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:25.092006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:25.092865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:27.173265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:01:27.266815 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2ba58b44-acb9-4b83-9093-a7accadd483d tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1671 microversion: 2.1 time: 2.245553 Oct 17 16:01:27.271341 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2847/5931] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:25 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1671 bytes in 2259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:01:27.373115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-85b26d9d-06e6-4c5c-86c3-2f8edb06c7df req-e60ff7a2-1952-45e2-8b34-d8e862529d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a583160-a18d-4425-b60f-ecdccb91b019", "name": "network-vif-deleted", "tag": "8873bad7-cb98-4e08-98ae-1d4304e2bf5e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:01:27.407119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85b26d9d-06e6-4c5c-86c3-2f8edb06c7df req-e60ff7a2-1952-45e2-8b34-d8e862529d8b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:27.407634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85b26d9d-06e6-4c5c-86c3-2f8edb06c7df req-e60ff7a2-1952-45e2-8b34-d8e862529d8b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:27.411069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-85b26d9d-06e6-4c5c-86c3-2f8edb06c7df req-e60ff7a2-1952-45e2-8b34-d8e862529d8b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:27.432414 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-85b26d9d-06e6-4c5c-86c3-2f8edb06c7df req-e60ff7a2-1952-45e2-8b34-d8e862529d8b service nova] Creating event network-vif-deleted:8873bad7-cb98-4e08-98ae-1d4304e2bf5e for instance 9a583160-a18d-4425-b60f-ecdccb91b019 on n-h1-854441-12 Oct 17 16:01:27.459336 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-85b26d9d-06e6-4c5c-86c3-2f8edb06c7df req-e60ff7a2-1952-45e2-8b34-d8e862529d8b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090665 Oct 17 16:01:27.461016 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3085/5932] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:01:28.319611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:28.328573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:28.372475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:28.375695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:28.383173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:28.387398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:28.389248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:28.391734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:28.506557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:28.509973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:28.510930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:28.512186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lazy-loading 'fault' on Instance uuid 9a583160-a18d-4425-b60f-ecdccb91b019 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:01:28.637704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6684e87890f4ba5af7adb91145e4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15545d0f177d4dcab629c37feb5a6328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:01:28.649318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7ad8d815-87d4-439b-8cbb-0cb2cd88d631 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 200 len: 1338 microversion: 2.1 time: 0.356338 Oct 17 16:01:28.655552 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2848/5933] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:28 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 1338 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:01:29.706485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:29.707306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] [instance: 9a583160-a18d-4425-b60f-ecdccb91b019] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:29.729858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:29.739456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:29.742086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:29.750802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:29.753589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:29.754725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:29.823579 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] HTTP exception thrown: Instance 9a583160-a18d-4425-b60f-ecdccb91b019 could not be found. Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Request method failure captured: Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 HTTP/1.1 Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXrYmvVtskkk3IJAp_uwmzWUivTfPW4FDVljXfMuubDXkTCsC3l3T9d6saIAV8uR7d-xfB79w-8aJGnChazTyXCa-t3Ej9Lliq5R0pCC2o1d5-SzWkzFGcJjpfrDUwngb_7JI_SP0v_8xBEmgCUlMGbDISDhMxC9fDx7TyQeVtCOmrM Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 15545d0f177d4dcab629c37feb5a6328 Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkBasicOps-735217035 Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/15545d0f177d4dcab629c37feb5a6328"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkBasicOps-735217035 Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 15545d0f177d4dcab629c37feb5a6328 Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkBasicOps-735217035 Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestNetworkBasicOps-735217035-project Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: b6684e87890f4ba5af7adb91145e4d4f Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkBasicOps-735217035-project Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 9a583160-a18d-4425-b60f-ecdccb91b019 could not be found. Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '9a583160-a18d-4425-b60f-ecdccb91b019'} Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a583160-a18d-4425-b60f-ecdccb91b019 could not be found. Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a583160-a18d-4425-b60f-ecdccb91b019 could not be found. Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:01:29.834144 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:29.843829 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:01:29.843829 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:01:29.843829 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:01:29.843829 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:01:29.843829 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:01:29.843829 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a583160-a18d-4425-b60f-ecdccb91b019 could not be found. Oct 17 16:01:29.843829 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:01:29.847979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Returning 404 to user: Instance 9a583160-a18d-4425-b60f-ecdccb91b019 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:01:29.850421 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d76aa900-f68e-4f79-bfc8-e04213a630a7 tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019" status: 404 len: 111 microversion: 2.1 time: 0.148281 Oct 17 16:01:29.872640 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3086/5934] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:29 2022] GET /compute/v2.1/servers/9a583160-a18d-4425-b60f-ecdccb91b019 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:01:32.312641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f729a5c-0b8b-414c-b7b0-332392a6587e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] Calling method '.version_select at 0x7f28bdf064c0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:32.402368 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f729a5c-0b8b-414c-b7b0-332392a6587e tempest-TestNetworkBasicOps-735217035 tempest-TestNetworkBasicOps-735217035-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1362819479" status: 202 len: 0 microversion: 2.1 time: 0.098534 Oct 17 16:01:32.407514 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2849/5935] 10.222.0.87 () {58 vars in 1257 bytes} [Mon Oct 17 16:01:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1362819479 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:01:52.361324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=10 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:01:52.362123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:01:52.931050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-289443019", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "d5bdaed5-7dac-4941-978b-f8bd5de8b1dd"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:01:53.174527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] validate_networks() for [('d5bdaed5-7dac-4941-978b-f8bd5de8b1dd', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:01:56.709194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:01:56.709194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:01:56.717528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:01:56.718653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:01:56.742746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:01:56.825927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:56.835099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:56.839468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:56.846285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:01:56.852457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:01:56.859206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:01:56.932163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Getting quotas for project 733bb08f33274533b5aef131f8429095. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:01:56.963439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Getting quotas for user 996027d88c1d47ccb4f02932391ddd80 and project 733bb08f33274533b5aef131f8429095. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:01:57.030535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:01:57.035330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:01:57.277261 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82aab407-1775-4ee1-a6c9-70e6e01b7ddb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.921493 Oct 17 16:01:57.279592 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3087/5936] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:01:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 16:01:57.290316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:01:57.292078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:01:57.311005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80261fc7-846f-414d-bdde-5d28d2272d3d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:57.312474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-80261fc7-846f-414d-bdde-5d28d2272d3d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:57.764211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80261fc7-846f-414d-bdde-5d28d2272d3d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:01:57.811608 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80261fc7-846f-414d-bdde-5d28d2272d3d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1224 microversion: 2.1 time: 0.519280 Oct 17 16:01:57.821158 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2850/5937] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:57 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1224 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:01:58.853362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-afe89f84-21d8-40e1-8506-3f63e1ece974 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:01:58.864661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-afe89f84-21d8-40e1-8506-3f63e1ece974 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:01:59.207488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-afe89f84-21d8-40e1-8506-3f63e1ece974 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:01:59.252948 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-afe89f84-21d8-40e1-8506-3f63e1ece974 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1224 microversion: 2.1 time: 0.398029 Oct 17 16:01:59.270383 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3088/5938] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:01:58 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1224 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:02:00.295451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:00.296310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:00.325092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:00.325605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:00.331775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:00.332923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:00.333596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:00.334241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:00.625877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:00.641922 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-79de56f7-3e51-4c4f-a0f8-fa68b7599fe9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1276 microversion: 2.1 time: 0.351519 Oct 17 16:02:00.650257 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2851/5939] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:00 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:01.700499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:01.701400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:01.717398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:01.718378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:01.721627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:01.723076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:01.724903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:01.728952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:02.594078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:02.606027 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-998b1746-32cc-4ac8-a6f4-aab4fd9cd03b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1282 microversion: 2.1 time: 0.910110 Oct 17 16:02:02.607534 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3089/5940] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:01 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1282 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:03.462682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Calling method '.version_select at 0x7f28bdf57ca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:03.464855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:03.465406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:03.468154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:03.550324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:03.551559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:03.552249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:03.612461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:03.614114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:03.619825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:03.651597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:03.652990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:03.663984 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-59dd138f-05a3-4dd4-a673-2b54dc5e7694 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1807230373-project-admin] 10.222.0.87 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.971725 Oct 17 16:02:03.664602 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2852/5941] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 16:02:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:02:03.676899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:03.677856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:03.679147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:03.683743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:03.684977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:03.688383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:04.293024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:04.316241 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2c4e3b1-0928-471c-8357-c13f81ec77eb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1282 microversion: 2.1 time: 0.663747 Oct 17 16:02:04.317044 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3090/5942] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:03 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1282 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:02:05.362282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:05.363157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:05.391887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:05.392414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:05.401377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:05.402192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:05.402737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:05.408379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:05.817222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:05.855681 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-19df0bd3-b2ff-41e7-ac8b-8b5796b2a99b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1282 microversion: 2.1 time: 0.498661 Oct 17 16:02:05.874851 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2853/5943] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:05 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1282 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:02:06.898991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:06.899824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:06.911474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:06.912313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:06.912966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:06.913910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:06.914605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:06.915243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:06.915921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:07.907816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:07.991028 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84466085-ef65-4260-84f9-4eab92f20889 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1282 microversion: 2.1 time: 1.095978 Oct 17 16:02:08.007558 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3091/5944] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:06 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1282 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:09.034606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:09.036629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:09.077958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:09.089566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:09.090584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:09.091358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:09.092651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:09.093441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:09.094142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:09.771338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:09.815602 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc6a514b-19a1-4f57-bbd1-405563ccef3b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1282 microversion: 2.1 time: 0.788231 Oct 17 16:02:09.821383 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2854/5945] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:09 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1282 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:10.801254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:10.864413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:10.870320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:10.913623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:10.914791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:10.915294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:10.916601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:10.917442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:10.918173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:11.623331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dbcbfc75-d61b-44db-ac89-eb64a8ef772c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Action: 'create', calling method: .version_select at 0x7f28bdc6d310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1204053788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfFZjF0bOsVa8ALrR/NNGcJMyTkJpMi4m1UHR6A7kutXGNLkIRjoWvrSUyJ51fVtX+9fwmFnoGbFwQJaNtxqp7WqL/zLXy+RvS2o1ELvXLhqRnxfrgrGeYmqXfhCOH/Pw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:02:11.670754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-dbcbfc75-d61b-44db-ac89-eb64a8ef772c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Getting quotas for project eb82fb6ad5c34026b9cefcd474f1318a. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:02:11.686850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-dbcbfc75-d61b-44db-ac89-eb64a8ef772c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Getting quotas for user 0aaef713dfc34b7ba9423de7ff0e541e and project eb82fb6ad5c34026b9cefcd474f1318a. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:02:11.726802 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbcbfc75-d61b-44db-ac89-eb64a8ef772c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [36474296-f7ff-4acf-9067-e7a2c30eb8a3] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:02:11.801955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:11.822944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea2941d3-ad25-470a-a8fc-1ad5c14006fc tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1324 microversion: 2.1 time: 0.965431 Oct 17 16:02:11.829418 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2855/5946] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:10 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1324 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:12.736244 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbcbfc75-d61b-44db-ac89-eb64a8ef772c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [36474296-f7ff-4acf-9067-e7a2c30eb8a3] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 47636. Oct 17 16:02:12.777543 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dbcbfc75-d61b-44db-ac89-eb64a8ef772c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.992746 Oct 17 16:02:12.778662 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3092/5947] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:02:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:02:12.876122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:12.885077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:12.901584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:12.902435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:12.903260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:12.904588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:12.905639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:12.906432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:13.819055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:13.857844 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5d2364b1-d560-4aeb-945e-faf057c46da9 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1324 microversion: 2.1 time: 0.988868 Oct 17 16:02:13.858566 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2856/5948] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:12 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1324 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:14.887319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:14.890590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:14.899679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:14.900351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:14.901082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:14.901918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:14.902483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:14.903050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:15.697493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f3520357-fc09-4be9-8439-ea364cbc58c3 req-758795fa-da0c-459b-8baa-8e4008186d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49951b9f-fe0b-4fa7-a825-7098be7e12fe", "tag": "f602656a-5b7f-4484-bb25-39885579b632"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:02:15.726883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f3520357-fc09-4be9-8439-ea364cbc58c3 req-758795fa-da0c-459b-8baa-8e4008186d3a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:15.728290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f3520357-fc09-4be9-8439-ea364cbc58c3 req-758795fa-da0c-459b-8baa-8e4008186d3a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:15.729684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f3520357-fc09-4be9-8439-ea364cbc58c3 req-758795fa-da0c-459b-8baa-8e4008186d3a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:15.754144 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f3520357-fc09-4be9-8439-ea364cbc58c3 req-758795fa-da0c-459b-8baa-8e4008186d3a service nova] Creating event network-changed:f602656a-5b7f-4484-bb25-39885579b632 for instance 49951b9f-fe0b-4fa7-a825-7098be7e12fe on n-h2-854441-12 Oct 17 16:02:15.764750 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f3520357-fc09-4be9-8439-ea364cbc58c3 req-758795fa-da0c-459b-8baa-8e4008186d3a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074028 Oct 17 16:02:15.766811 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2857/5949] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:02:15.902181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:15.929143 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-438b4fe8-53bb-49df-ae47-9150a3643842 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1324 microversion: 2.1 time: 1.046948 Oct 17 16:02:15.936699 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3093/5950] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:14 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1324 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:16.960573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:16.960963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:16.976941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:16.977448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:16.977902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:16.978753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:16.979164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:16.979598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:18.026983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:18.046672 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8c917e45-4d65-4f5e-bf92-1333e9920d5d tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1324 microversion: 2.1 time: 1.090953 Oct 17 16:02:18.048058 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2858/5951] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:16 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1324 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:02:19.099971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:19.099971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:19.109222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:19.115163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:19.127342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:19.128591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:19.129086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:19.129525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:20.915128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:20.938255 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0d9b939-bd12-43cc-be99-54a62b8a8ffb tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1324 microversion: 2.1 time: 1.864272 Oct 17 16:02:20.949125 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3094/5952] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:19 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1324 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:21.996599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:21.997770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:22.005979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:22.006911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:22.007639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:22.008610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:22.009285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:22.009915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:23.416450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:23.427255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-62b883e2-3957-4a7d-9c8b-a94fc48221f6 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1324 microversion: 2.1 time: 1.453863 Oct 17 16:02:23.442872 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2859/5953] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:21 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1324 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:24.451094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:24.462722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:24.466169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:24.471554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:24.501035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:24.501549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:24.507430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:24.508615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:24.509402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:24.509847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:24.595497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=33 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:25.491449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:25.516334 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0897f5ff-d7b8-487a-b018-79480d86d172 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1324 microversion: 2.1 time: 1.070252 Oct 17 16:02:25.526920 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3095/5954] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:24 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1324 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:25.547399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a8a8811f-6279-4ffa-869c-b103187c842c req-c0f910e6-8646-404f-a48a-64a12f7f1b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49951b9f-fe0b-4fa7-a825-7098be7e12fe", "name": "network-vif-plugged", "status": "completed", "tag": "f602656a-5b7f-4484-bb25-39885579b632"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:02:25.601483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a8a8811f-6279-4ffa-869c-b103187c842c req-c0f910e6-8646-404f-a48a-64a12f7f1b99 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:25.602145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a8a8811f-6279-4ffa-869c-b103187c842c req-c0f910e6-8646-404f-a48a-64a12f7f1b99 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:25.602934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a8a8811f-6279-4ffa-869c-b103187c842c req-c0f910e6-8646-404f-a48a-64a12f7f1b99 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:25.619140 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a8a8811f-6279-4ffa-869c-b103187c842c req-c0f910e6-8646-404f-a48a-64a12f7f1b99 service nova] Creating event network-vif-plugged:f602656a-5b7f-4484-bb25-39885579b632 for instance 49951b9f-fe0b-4fa7-a825-7098be7e12fe on n-h2-854441-12 Oct 17 16:02:25.627263 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a8a8811f-6279-4ffa-869c-b103187c842c req-c0f910e6-8646-404f-a48a-64a12f7f1b99 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106065 Oct 17 16:02:25.628621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2860/5955] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:02:26.555075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:26.555995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:26.577144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:26.577657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:26.578102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:26.578878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:26.579345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:26.586111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:27.890216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:27.909523 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79028c93-fa19-4ec7-950e-9f78003cb8d7 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1324 microversion: 2.1 time: 1.360580 Oct 17 16:02:27.910149 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3096/5956] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:26 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1324 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:28.937503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:28.938243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:28.952478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=27 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:28.961873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:28.962779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:28.963676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:28.967271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:28.968260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:28.968913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:29.042868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=53 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:30.809492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:30.841969 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5f144060-0067-4673-906e-b1bd15400358 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1522 microversion: 2.1 time: 1.909052 Oct 17 16:02:30.864052 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2861/5957] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:28 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1522 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:02:30.889906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:30.891464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:30.907462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:30.910385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:30.911111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:30.912491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:30.914564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:30.915338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:30.979116 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] HTTP exception thrown: Instance is not a member of specified network Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Request method failure captured: Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe/ips/invalid HTTP/1.1 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXxvP3dUX-f-uNn5h1fwxeleRiOzFqJAw5GwFnLET-YoHJgiSUkk9zujopTh5enJX4_gbwZgl0a0ynHD5qHoOimdAA5agIOT12xUK01rsJ5tqXMrFHXYHik5GaHyPlojgkSCm3B2kaSoGp7gFkaHmIhv_aHvhO6ZcGay69k96E8vkaI Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 733bb08f33274533b5aef131f8429095 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1763807772 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/733bb08f33274533b5aef131f8429095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/733bb08f33274533b5aef131f8429095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_733bb08f33274533b5aef131f8429095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/733bb08f33274533b5aef131f8429095"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1763807772 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 733bb08f33274533b5aef131f8429095 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1763807772 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerAddressesNegativeTestJSON-1763807772-project Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 996027d88c1d47ccb4f02932391ddd80 Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1763807772-project Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance is not a member of specified network Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': '49951b9f-fe0b-4fa7-a825-7098be7e12fe', 'id': 'invalid'} Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 17 16:02:30.989271 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:02:30.996816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:02:30.996816 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-47b4ffdd-85cc-4ba6-82f0-997dae6921c1 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.106439 Oct 17 16:02:30.996816 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3097/5958] 10.222.0.87 () {58 vars in 1272 bytes} [Mon Oct 17 16:02:30 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe/ips/invalid => generated 91 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 16:02:31.012512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3694a149-64bb-4a38-9d74-12220b7d5501 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:31.013284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3694a149-64bb-4a38-9d74-12220b7d5501 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Failed to fetch instance by id 999 {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 16:02:31.014255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-3694a149-64bb-4a38-9d74-12220b7d5501 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] HTTP exception thrown: Instance 999 could not be found. Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3694a149-64bb-4a38-9d74-12220b7d5501 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Request method failure captured: Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXxvP3dUX-f-uNn5h1fwxeleRiOzFqJAw5GwFnLET-YoHJgiSUkk9zujopTh5enJX4_gbwZgl0a0ynHD5qHoOimdAA5agIOT12xUK01rsJ5tqXMrFHXYHik5GaHyPlojgkSCm3B2kaSoGp7gFkaHmIhv_aHvhO6ZcGay69k96E8vkaI Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 733bb08f33274533b5aef131f8429095 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1763807772 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/733bb08f33274533b5aef131f8429095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/733bb08f33274533b5aef131f8429095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_733bb08f33274533b5aef131f8429095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/733bb08f33274533b5aef131f8429095"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1763807772 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 733bb08f33274533b5aef131f8429095 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1763807772 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerAddressesNegativeTestJSON-1763807772-project Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 996027d88c1d47ccb4f02932391ddd80 Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1763807772-project Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 999 could not be found. Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'server_id': '999'} Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 17 16:02:31.033767 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:02:31.039427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3694a149-64bb-4a38-9d74-12220b7d5501 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:02:31.039427 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3694a149-64bb-4a38-9d74-12220b7d5501 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.037465 Oct 17 16:02:31.039427 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2862/5959] 10.222.0.87 () {58 vars in 1149 bytes} [Mon Oct 17 16:02:30 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 16:02:31.051148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:31.052052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:31.090700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:31.091601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:31.092384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:31.093670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:31.103674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:31.104338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:31.218186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:02:31.567103 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9079283b-5dc4-454a-9cb5-6ff09f5e86ca tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "DELETE /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 204 len: 0 microversion: 2.1 time: 0.521803 Oct 17 16:02:31.568116 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3098/5960] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:02:31 2022] DELETE /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:02:31.584766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:31.587074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:31.622448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:31.630938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:31.631780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:31.633172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:31.634013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:31.634837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:32.975450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:33.008654 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bab47374-cdb7-4363-83f3-65f24e12697b tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1528 microversion: 2.1 time: 1.434921 Oct 17 16:02:33.034746 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2863/5961] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:31 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1528 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:34.054226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:34.068155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:34.105576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:34.106456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:34.107314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:34.108676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:34.116030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:34.117015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:35.044079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:35.070603 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb825e6d-b51d-4ef1-8b6a-0a740af4df7e tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1528 microversion: 2.1 time: 1.033276 Oct 17 16:02:35.078553 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3099/5962] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:34 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1528 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:36.132867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:36.134078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:36.151825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:36.152350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:36.155299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:36.155858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:36.156328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:36.156761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:36.638626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:36.682518 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-031fb0c2-0c60-4f83-b71d-e2965d781e79 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1486 microversion: 2.1 time: 0.557354 Oct 17 16:02:36.683177 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2864/5963] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:36 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1486 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:37.077942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bf270ab1-3766-4fe2-89b0-d3c58b37a665 req-fdfa275d-87fe-40dc-9cee-fda8591af3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49951b9f-fe0b-4fa7-a825-7098be7e12fe", "name": "network-vif-deleted", "tag": "f602656a-5b7f-4484-bb25-39885579b632"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:02:37.101604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bf270ab1-3766-4fe2-89b0-d3c58b37a665 req-fdfa275d-87fe-40dc-9cee-fda8591af3d6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:37.102395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bf270ab1-3766-4fe2-89b0-d3c58b37a665 req-fdfa275d-87fe-40dc-9cee-fda8591af3d6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:37.104750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bf270ab1-3766-4fe2-89b0-d3c58b37a665 req-fdfa275d-87fe-40dc-9cee-fda8591af3d6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:37.133352 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bf270ab1-3766-4fe2-89b0-d3c58b37a665 req-fdfa275d-87fe-40dc-9cee-fda8591af3d6 service nova] Creating event network-vif-deleted:f602656a-5b7f-4484-bb25-39885579b632 for instance 49951b9f-fe0b-4fa7-a825-7098be7e12fe on n-h2-854441-12 Oct 17 16:02:37.145690 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bf270ab1-3766-4fe2-89b0-d3c58b37a665 req-fdfa275d-87fe-40dc-9cee-fda8591af3d6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071647 Oct 17 16:02:37.146417 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3100/5964] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:02:37.705862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:37.706825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:37.724360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:37.724990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:37.725524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:37.726331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:37.726896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:37.727406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:37.798970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:37.799984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:37.800610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:37.801256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lazy-loading 'fault' on Instance uuid 49951b9f-fe0b-4fa7-a825-7098be7e12fe {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:02:38.184772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996027d88c1d47ccb4f02932391ddd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733bb08f33274533b5aef131f8429095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:02:38.253617 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92110b56-5cb2-4836-8c38-d584387dade3 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 200 len: 1314 microversion: 2.1 time: 0.543848 Oct 17 16:02:38.256186 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2865/5965] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:37 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:02:39.280751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:02:39.281511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] [instance: 49951b9f-fe0b-4fa7-a825-7098be7e12fe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:02:39.309535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:39.309995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:39.310450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:39.311233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:02:39.311695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:02:39.312123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:02:39.362030 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] HTTP exception thrown: Instance 49951b9f-fe0b-4fa7-a825-7098be7e12fe could not be found. Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Request method failure captured: Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe HTTP/1.1 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXxvP3dUX-f-uNn5h1fwxeleRiOzFqJAw5GwFnLET-YoHJgiSUkk9zujopTh5enJX4_gbwZgl0a0ynHD5qHoOimdAA5agIOT12xUK01rsJ5tqXMrFHXYHik5GaHyPlojgkSCm3B2kaSoGp7gFkaHmIhv_aHvhO6ZcGay69k96E8vkaI Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 733bb08f33274533b5aef131f8429095 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1763807772 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/733bb08f33274533b5aef131f8429095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/733bb08f33274533b5aef131f8429095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_733bb08f33274533b5aef131f8429095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/733bb08f33274533b5aef131f8429095"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1763807772 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 733bb08f33274533b5aef131f8429095 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1763807772 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerAddressesNegativeTestJSON-1763807772-project Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 996027d88c1d47ccb4f02932391ddd80 Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1763807772-project Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 49951b9f-fe0b-4fa7-a825-7098be7e12fe could not be found. Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '49951b9f-fe0b-4fa7-a825-7098be7e12fe'} Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49951b9f-fe0b-4fa7-a825-7098be7e12fe could not be found. Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49951b9f-fe0b-4fa7-a825-7098be7e12fe could not be found. Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:02:39.363788 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49951b9f-fe0b-4fa7-a825-7098be7e12fe could not be found. Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] Returning 404 to user: Instance 49951b9f-fe0b-4fa7-a825-7098be7e12fe could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06bdc674-7b7b-4e1b-b3be-0a8b8e7d38c8 tempest-ServerAddressesNegativeTestJSON-1763807772 tempest-ServerAddressesNegativeTestJSON-1763807772-project] 10.222.0.87 "GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe" status: 404 len: 111 microversion: 2.1 time: 0.089891 Oct 17 16:02:39.370157 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3101/5966] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:02:39 2022] GET /compute/v2.1/servers/49951b9f-fe0b-4fa7-a825-7098be7e12fe => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:02:55.695450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=9 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:55.698870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=25 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:02:55.715192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-288841089-access_point-303512352", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "32163252-cff3-4233-a667-862464b61af9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1204053788", "security_groups": [{"name": "tempest-secgroup_access--1647018290"}, {"name": "tempest-secgroup_general--1310592763"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:02:57.489982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] validate_networks() for [('32163252-cff3-4233-a667-862464b61af9', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:03:01.085944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:03:01.086823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:03:01.088048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:03:01.089010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:03:01.090532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:03:01.129327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:01.130210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:01.130921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:01.131974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:01.132685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:01.133411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:01.189373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Getting quotas for project eb82fb6ad5c34026b9cefcd474f1318a. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:03:01.210829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Getting quotas for user 0aaef713dfc34b7ba9423de7ff0e541e and project eb82fb6ad5c34026b9cefcd474f1318a. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:03:01.243684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:03:01.246356 n-d-854441-12 devstack@n-api.service[120407]: WARNING nova.utils [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-288841089-access_point-303512352 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-288841089-acc Oct 17 16:03:01.247556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:03:01.325873 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1bb1f0c0-12ec-4a51-add5-850eea0b7de9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 5.634007 Oct 17 16:03:01.327137 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2866/5967] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:02:55 2022] POST /compute/v2.1/servers => generated 458 bytes in 5637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:03:01.345969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84deb41f-cd7e-4b4b-8f8b-f16bd9a7248d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:01.348554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84deb41f-cd7e-4b4b-8f8b-f16bd9a7248d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:01.362192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:01.366062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:02.848298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-84deb41f-cd7e-4b4b-8f8b-f16bd9a7248d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:02.959760 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84deb41f-cd7e-4b4b-8f8b-f16bd9a7248d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1293 microversion: 2.1 time: 1.615159 Oct 17 16:03:02.965012 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3102/5968] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:01 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1293 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:03.997538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:04.000763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:04.026351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:04.027991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:04.030332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:04.032343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:04.033872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:04.035005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:04.279406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:04.353770 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b90769da-a72d-4047-bb76-d839a985ac11 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1353 microversion: 2.1 time: 0.366630 Oct 17 16:03:04.357361 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2867/5969] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:03 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1353 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:05.401812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:05.402656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:05.420371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:05.429777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:05.430726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:05.432927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:05.437914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:05.438412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:05.767671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:05.779412 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d6e1434-1daa-4df9-ba23-90a0c20b2e94 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1351 microversion: 2.1 time: 0.380048 Oct 17 16:03:05.780121 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3103/5970] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:05 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1351 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:03:06.823328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:06.824035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:06.841034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:06.841775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:06.849029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:06.850741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:06.851812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:06.852895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:07.549379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:07.596897 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8fc6c2d9-c856-49f2-9d17-ce8cbefa8f7d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1351 microversion: 2.1 time: 0.765549 Oct 17 16:03:07.598564 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2868/5971] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:06 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1351 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:08.632067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:08.633173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:08.684166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:08.689718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:08.694103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:08.705347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:08.706458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:08.711738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:09.110539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:09.141312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64f75697-cb19-4b99-9165-36a58b1aa76f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1351 microversion: 2.1 time: 0.516481 Oct 17 16:03:09.178860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3104/5972] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:08 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1351 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:10.200462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:10.201625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:10.234972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:10.251495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:10.252140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:10.252933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:10.257802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:10.260847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:11.154438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:11.224520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:11.348938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:11.380441 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-511a2031-ebfa-4f65-9ede-5070f396b040 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1471 microversion: 2.1 time: 1.187668 Oct 17 16:03:11.385251 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2869/5973] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:10 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1471 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:12.427416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:12.428049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:12.448482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:12.449866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:12.450538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:12.451942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:12.452752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:12.454389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:12.896965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:13.485655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:13.514426 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86198b74-c64b-44c9-86dd-d94bb8b7f018 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1471 microversion: 2.1 time: 1.092112 Oct 17 16:03:13.516403 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3105/5974] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:12 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1471 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:14.567792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:14.574389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:14.600984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:14.607732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:14.608953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:14.610682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:14.615850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:14.616980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:15.525336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:15.535539 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c697e3ff-5283-4fb9-87a6-3feba3e63074 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1471 microversion: 2.1 time: 0.978516 Oct 17 16:03:15.536818 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2870/5975] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:14 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1471 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:16.564793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:16.568125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:16.602647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:16.603668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:16.604655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:16.606020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:16.607043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:16.611005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:16.902374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8b6961ba-ea68-4bf0-a66b-4fd1d2eee529 req-256675d7-907a-40dd-8504-935f46bf8858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a53040-8109-486b-bdb1-1f0a8c4c00f0", "tag": "0d0426cf-e695-4e14-800c-a59e2e138599"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:03:16.976356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8b6961ba-ea68-4bf0-a66b-4fd1d2eee529 req-256675d7-907a-40dd-8504-935f46bf8858 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:16.980188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8b6961ba-ea68-4bf0-a66b-4fd1d2eee529 req-256675d7-907a-40dd-8504-935f46bf8858 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:16.981959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8b6961ba-ea68-4bf0-a66b-4fd1d2eee529 req-256675d7-907a-40dd-8504-935f46bf8858 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:17.100819 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8b6961ba-ea68-4bf0-a66b-4fd1d2eee529 req-256675d7-907a-40dd-8504-935f46bf8858 service nova] Creating event network-changed:0d0426cf-e695-4e14-800c-a59e2e138599 for instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 on n-h1-854441-12 Oct 17 16:03:17.133031 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8b6961ba-ea68-4bf0-a66b-4fd1d2eee529 req-256675d7-907a-40dd-8504-935f46bf8858 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238247 Oct 17 16:03:17.138681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2871/5976] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:03:17.363217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:17.384439 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b17e00b-b4e5-413a-956a-34fafe644ab9 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1471 microversion: 2.1 time: 0.826319 Oct 17 16:03:17.392139 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3106/5977] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:16 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1471 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:18.439030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:18.444522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:18.489811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:18.493879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:18.498184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:18.500633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:18.503565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:18.510367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:20.955915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:20.971288 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2250fa11-f5c6-44b4-8bf8-53c418bd67a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1471 microversion: 2.1 time: 2.545411 Oct 17 16:03:20.990765 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2872/5978] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:18 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1471 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:22.004917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:22.007750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:22.026874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:22.028184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:22.029235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:22.039831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:22.041406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:22.043069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:23.453397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:23.497418 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1da07c0f-ed98-415a-bf4e-a0eb49fd168e tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1471 microversion: 2.1 time: 1.503214 Oct 17 16:03:23.505334 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3107/5979] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:21 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1471 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:24.563939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:24.585093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:24.635053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:24.638384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:24.641807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:24.642930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:24.643572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:24.644086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:25.469300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:25.519553 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3f0ba09e-72ca-4bf9-80a5-7a978389d00c tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1471 microversion: 2.1 time: 0.972430 Oct 17 16:03:25.521189 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2873/5980] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:24 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1471 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:26.569709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:26.570336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:26.581468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:26.595406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:26.595876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:26.596654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:26.597142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:26.597590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:28.319374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:28.329444 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63a8d59b-36be-475b-843b-407a5a1b6084 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1471 microversion: 2.1 time: 1.763506 Oct 17 16:03:28.335068 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3108/5981] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:26 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1471 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:28.394263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1e15e134-5ccc-4101-b643-68a1c40aabed req-00a83e99-9fca-4f3a-a097-11908f66a643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a53040-8109-486b-bdb1-1f0a8c4c00f0", "name": "network-vif-plugged", "status": "completed", "tag": "0d0426cf-e695-4e14-800c-a59e2e138599"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:03:28.467124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:28.477227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e15e134-5ccc-4101-b643-68a1c40aabed req-00a83e99-9fca-4f3a-a097-11908f66a643 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:28.479332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e15e134-5ccc-4101-b643-68a1c40aabed req-00a83e99-9fca-4f3a-a097-11908f66a643 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:28.481296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1e15e134-5ccc-4101-b643-68a1c40aabed req-00a83e99-9fca-4f3a-a097-11908f66a643 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:28.593207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=41 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:28.612708 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1e15e134-5ccc-4101-b643-68a1c40aabed req-00a83e99-9fca-4f3a-a097-11908f66a643 service nova] Creating event network-vif-plugged:0d0426cf-e695-4e14-800c-a59e2e138599 for instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 on n-h1-854441-12 Oct 17 16:03:28.651593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1e15e134-5ccc-4101-b643-68a1c40aabed req-00a83e99-9fca-4f3a-a097-11908f66a643 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261860 Oct 17 16:03:28.652406 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2874/5982] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:03:29.385062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:29.385062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:29.392482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:29.399589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:29.400498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:29.401268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:29.401944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:29.402618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:32.380014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:32.388504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=41 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:32.398566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-802a08b3-605f-4ad1-bd63-a19aa281bb5f tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1471 microversion: 2.1 time: 3.026122 Oct 17 16:03:32.403842 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3109/5983] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:29 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1471 bytes in 3032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:33.443914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:33.447528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:33.486794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:33.487762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:33.488532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:33.494510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:33.498352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:33.499250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:34.476369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:34.527501 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8ca8c647-92cc-4f75-bb79-d380c38ac972 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1642 microversion: 2.1 time: 1.096395 Oct 17 16:03:34.544945 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2875/5984] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:33 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1642 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:34.580516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:34.581320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:34.595508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=19 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:34.597740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:34.598333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:34.598825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:34.599578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:34.602995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:34.603785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:37.255177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:37.264158 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3823beb5-6ef8-4c51-ad42-15af97cefe7a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1642 microversion: 2.1 time: 2.688848 Oct 17 16:03:37.269268 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3110/5985] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:34 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1642 bytes in 2695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:03:37.311802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8099e8c8-b14e-4055-aa6a-259763daa4ca tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:37.314287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8099e8c8-b14e-4055-aa6a-259763daa4ca tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:37.364719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8099e8c8-b14e-4055-aa6a-259763daa4ca tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:37.373892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8099e8c8-b14e-4055-aa6a-259763daa4ca tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:37.379828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8099e8c8-b14e-4055-aa6a-259763daa4ca tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:37.381487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8099e8c8-b14e-4055-aa6a-259763daa4ca tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:37.391552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8099e8c8-b14e-4055-aa6a-259763daa4ca tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:37.393572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8099e8c8-b14e-4055-aa6a-259763daa4ca tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:39.436869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-102319872", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "700a530f-0263-49c2-ad44-b486a50c2169"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:03:39.608377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] validate_networks() for [('700a530f-0263-49c2-ad44-b486a50c2169', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:03:39.732335 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8099e8c8-b14e-4055-aa6a-259763daa4ca tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1795 microversion: 2.1 time: 2.428182 Oct 17 16:03:39.749691 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2876/5986] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:37 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1795 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:42.396540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:03:42.400280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:03:42.401734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:03:42.402963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:03:42.422967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:03:42.503795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:42.505054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:42.510464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:42.520559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:42.523980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:42.525005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:42.641469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Getting quotas for project 55c9631f9cd74648ba94a416cfe0ff8d. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:03:42.660975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Getting quotas for user b6a845e6eafc493fa1b69c85f59e5fdb and project 55c9631f9cd74648ba94a416cfe0ff8d. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:03:42.738220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:03:42.747595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:03:42.875176 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0024994f-6fdc-4977-a26f-780a9d14694f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.807430 Oct 17 16:03:42.889046 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3111/5987] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:03:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:03:42.898960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4df43549-027b-4f2e-a5fb-8052654f9cf6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:42.929167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4df43549-027b-4f2e-a5fb-8052654f9cf6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:44.291316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4df43549-027b-4f2e-a5fb-8052654f9cf6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:44.302587 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4df43549-027b-4f2e-a5fb-8052654f9cf6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1215 microversion: 2.1 time: 1.413154 Oct 17 16:03:44.306146 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2877/5988] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:42 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1215 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:45.361403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:45.371312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:45.409673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:45.417181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:45.418458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:45.420476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:45.421678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:45.427792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:45.917084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:45.946592 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63580334-bc68-4c5e-b326-cfd90b4b70c7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1275 microversion: 2.1 time: 0.593124 Oct 17 16:03:45.951118 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3112/5989] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:45 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1275 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:46.995724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:46.997236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:47.013111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:47.014525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:47.024446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:47.026180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:47.027733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:47.028876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:47.379682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:47.395971 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca262920-ecee-45f5-997a-8d6c235d2454 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1273 microversion: 2.1 time: 0.406071 Oct 17 16:03:47.396749 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2878/5990] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:46 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1273 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:48.432435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:48.436674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:48.476559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:48.477620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:48.478345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:48.483266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:48.487767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:48.489176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:48.984772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:49.024365 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df148ae4-f25b-40c4-add9-8f0794f117b6 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1273 microversion: 2.1 time: 0.600298 Oct 17 16:03:49.030965 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3113/5991] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:48 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1273 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:50.055148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:50.060053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:50.107629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:50.109286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:50.110549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:50.112102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:50.113197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:50.114185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:52.249193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:52.260727 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5f0d97fb-b3c2-4df7-9b4f-0217975de355 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1315 microversion: 2.1 time: 2.212876 Oct 17 16:03:52.291146 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2879/5992] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:50 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1315 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:53.292718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:53.294224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:53.317574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:53.321273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:53.347373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:53.348324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:53.349504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:53.357652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:53.358638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:53.360475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:53.840405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:53.854744 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33c3ecc9-9441-4203-9340-3da7096ea78f tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1315 microversion: 2.1 time: 0.565018 Oct 17 16:03:53.855398 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3114/5993] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:53 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:54.910949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:54.920200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:54.959692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-44092a03-9092-4a4a-b86c-a852f8dd994c req-3dbb28fd-2608-4454-829b-dcb41118d0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a53040-8109-486b-bdb1-1f0a8c4c00f0", "tag": "0d0426cf-e695-4e14-800c-a59e2e138599"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:03:54.986067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:54.991050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-44092a03-9092-4a4a-b86c-a852f8dd994c req-3dbb28fd-2608-4454-829b-dcb41118d0c7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:54.998311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-44092a03-9092-4a4a-b86c-a852f8dd994c req-3dbb28fd-2608-4454-829b-dcb41118d0c7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:54.999046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-44092a03-9092-4a4a-b86c-a852f8dd994c req-3dbb28fd-2608-4454-829b-dcb41118d0c7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:55.002767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:55.003675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:55.004516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:55.005946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:55.006960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:55.007799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:55.044199 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-44092a03-9092-4a4a-b86c-a852f8dd994c req-3dbb28fd-2608-4454-829b-dcb41118d0c7 service nova] Creating event network-changed:0d0426cf-e695-4e14-800c-a59e2e138599 for instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 on n-h1-854441-12 Oct 17 16:03:55.056497 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-44092a03-9092-4a4a-b86c-a852f8dd994c req-3dbb28fd-2608-4454-829b-dcb41118d0c7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111369 Oct 17 16:03:55.061739 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3115/5994] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:03:56.104406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:56.129909 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8d06967d-7c5d-4370-8068-8e4f0c7ecc29 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1315 microversion: 2.1 time: 1.227607 Oct 17 16:03:56.136295 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2880/5995] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:54 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1315 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:03:57.165196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:03:57.165899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:03:57.181301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:57.181803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:57.182246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:57.183021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:57.183487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:57.183913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:58.704567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ec7c2acf-64cc-49e5-a909-4ceafdd2f8df req-2d2f420a-85b9-4147-b364-964ce8363b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9d011d-048f-43f6-84e8-f671cd6ecad2", "tag": "5413ca9f-3a73-41a8-9c9e-cffc02fa2a43"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:03:58.774877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ec7c2acf-64cc-49e5-a909-4ceafdd2f8df req-2d2f420a-85b9-4147-b364-964ce8363b1f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:03:58.775766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ec7c2acf-64cc-49e5-a909-4ceafdd2f8df req-2d2f420a-85b9-4147-b364-964ce8363b1f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:03:58.776577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ec7c2acf-64cc-49e5-a909-4ceafdd2f8df req-2d2f420a-85b9-4147-b364-964ce8363b1f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:03:58.798940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=32 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:03:58.815175 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ec7c2acf-64cc-49e5-a909-4ceafdd2f8df req-2d2f420a-85b9-4147-b364-964ce8363b1f service nova] Creating event network-changed:5413ca9f-3a73-41a8-9c9e-cffc02fa2a43 for instance 5f9d011d-048f-43f6-84e8-f671cd6ecad2 on n-h2-854441-12 Oct 17 16:03:58.828578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ec7c2acf-64cc-49e5-a909-4ceafdd2f8df req-2d2f420a-85b9-4147-b364-964ce8363b1f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135842 Oct 17 16:03:58.829236 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2881/5996] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:03:59.314225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:03:59.325949 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bda75e69-cce4-4f00-ab81-d59e53bc268d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1315 microversion: 2.1 time: 2.165056 Oct 17 16:03:59.329204 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3116/5997] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:03:57 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1315 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:00.353365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:00.354482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:00.381253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:00.382038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:00.394387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:00.395833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:00.396137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:00.403587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:02.124093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:02.150841 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eee3cf00-3df5-4f99-a517-be8dc63fb81d tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1315 microversion: 2.1 time: 1.803572 Oct 17 16:04:02.151786 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2882/5998] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:00 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1315 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:03.199591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:03.201209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:03.225465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:03.225982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:03.226451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:03.230908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:03.231483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:03.231853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:05.827780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:05.832127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=40 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:04:05.839666 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad7fb762-fe7e-4a68-8322-62c5bf267926 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1315 microversion: 2.1 time: 2.646634 Oct 17 16:04:05.840296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3117/5999] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:03 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1315 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:06.898108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:06.900496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:06.973496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=20 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:04:06.991513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:06.998627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:06.999366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:07.008320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:07.009686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:07.017251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:09.502344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:09.535544 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c977d418-844e-4388-afc1-08350b695ba1 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1315 microversion: 2.1 time: 2.670173 Oct 17 16:04:09.544674 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2883/6000] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:06 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1315 bytes in 2681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:10.575678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:10.577502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:10.595254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:04:10.603530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:10.604055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:10.604664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:10.605249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:10.608514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:10.610328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:11.662521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a87ceb10-cdb0-4648-83bb-1e3427146dfb req-287a74bb-3cfc-4781-a529-35bbb998faa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9d011d-048f-43f6-84e8-f671cd6ecad2", "name": "network-vif-plugged", "status": "completed", "tag": "5413ca9f-3a73-41a8-9c9e-cffc02fa2a43"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:04:11.727248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a87ceb10-cdb0-4648-83bb-1e3427146dfb req-287a74bb-3cfc-4781-a529-35bbb998faa6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:11.729525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a87ceb10-cdb0-4648-83bb-1e3427146dfb req-287a74bb-3cfc-4781-a529-35bbb998faa6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:11.735529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a87ceb10-cdb0-4648-83bb-1e3427146dfb req-287a74bb-3cfc-4781-a529-35bbb998faa6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:11.801823 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a87ceb10-cdb0-4648-83bb-1e3427146dfb req-287a74bb-3cfc-4781-a529-35bbb998faa6 service nova] Creating event network-vif-plugged:5413ca9f-3a73-41a8-9c9e-cffc02fa2a43 for instance 5f9d011d-048f-43f6-84e8-f671cd6ecad2 on n-h2-854441-12 Oct 17 16:04:11.844632 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a87ceb10-cdb0-4648-83bb-1e3427146dfb req-287a74bb-3cfc-4781-a529-35bbb998faa6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192007 Oct 17 16:04:11.855436 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2884/6001] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:04:12.721476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:12.742981 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-55f1ff2f-5547-430a-8af1-bfdc77d2eced tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1315 microversion: 2.1 time: 2.173857 Oct 17 16:04:12.744348 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3118/6002] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:10 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1315 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:04:13.779427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:13.784358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:13.824939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:13.830123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:13.831831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:13.835825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:13.838447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:13.839689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:14.996165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:15.011480 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2d86bafe-b211-48b6-b74f-0887a08f43d3 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1315 microversion: 2.1 time: 1.246207 Oct 17 16:04:15.014178 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2885/6003] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:13 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1315 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:04:15.377532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f31803dc-cc06-428b-aa5b-018b4acd5efa tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-474315823", "availability_zone": "foo_zone"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:04:15.383095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.aggregate [None req-f31803dc-cc06-428b-aa5b-018b4acd5efa tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Generated uuid 29944fe2-c9ed-43d7-9666-15650d3453d9 for aggregate {{(pid=120406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 16:04:15.455858 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f31803dc-cc06-428b-aa5b-018b4acd5efa tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.464370 Oct 17 16:04:15.457633 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3119/6004] 10.222.0.87 () {60 vars in 1164 bytes} [Mon Oct 17 16:04:14 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:15.485109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe304895-df92-4f1d-95ff-e63cd365f189 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:04:15.576319 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe304895-df92-4f1d-95ff-e63cd365f189 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.098536 Oct 17 16:04:15.588420 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2886/6005] 10.222.0.87 () {60 vars in 1194 bytes} [Mon Oct 17 16:04:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:15.594397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd4f03a7-f898-4cb5-8ad7-5ec5a7fc0e5b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:15.598566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd4f03a7-f898-4cb5-8ad7-5ec5a7fc0e5b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:15.599066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd4f03a7-f898-4cb5-8ad7-5ec5a7fc0e5b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:15.603413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd4f03a7-f898-4cb5-8ad7-5ec5a7fc0e5b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:15.605078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd4f03a7-f898-4cb5-8ad7-5ec5a7fc0e5b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:15.613439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd4f03a7-f898-4cb5-8ad7-5ec5a7fc0e5b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:15.614320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd4f03a7-f898-4cb5-8ad7-5ec5a7fc0e5b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:15.656901 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd4f03a7-f898-4cb5-8ad7-5ec5a7fc0e5b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.066957 Oct 17 16:04:15.658342 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3120/6006] 10.222.0.87 () {58 vars in 1176 bytes} [Mon Oct 17 16:04:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:15.675879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-68b8abea-5f96-4a89-9ef1-c4f8a7e8994e tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:15.692213 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-68b8abea-5f96-4a89-9ef1-c4f8a7e8994e tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.021347 Oct 17 16:04:15.693419 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2887/6007] 10.222.0.87 () {58 vars in 1143 bytes} [Mon Oct 17 16:04:15 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:15.711879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d9c6333-0320-42a4-814b-1691e2a5f4e5 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:04:15.735309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d9c6333-0320-42a4-814b-1691e2a5f4e5 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:15.736137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d9c6333-0320-42a4-814b-1691e2a5f4e5 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:15.738772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d9c6333-0320-42a4-814b-1691e2a5f4e5 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:16.042815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:16.044284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:16.065747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:16.068290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:16.073450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:16.076599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:16.078563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:16.080052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:16.481459 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d9c6333-0320-42a4-814b-1691e2a5f4e5 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.770040 Oct 17 16:04:16.489301 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3121/6008] 10.222.0.87 () {60 vars in 1194 bytes} [Mon Oct 17 16:04:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:16.501269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fad00037-ca9d-4951-8b03-8b0d3f344173 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:16.537291 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fad00037-ca9d-4951-8b03-8b0d3f344173 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.045264 Oct 17 16:04:16.540058 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3122/6009] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 16:04:16 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:16.552397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb4769e5-a446-4e67-9d04-97123c4d205d tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-65111992", "availability_zone": "foo_zone"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:04:16.712109 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb4769e5-a446-4e67-9d04-97123c4d205d tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.164140 Oct 17 16:04:16.724760 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3123/6010] 10.222.0.87 () {60 vars in 1173 bytes} [Mon Oct 17 16:04:16 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:16.738005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c02a1395-9824-493e-83f0-1b8903fba684 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:04:16.795114 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c02a1395-9824-493e-83f0-1b8903fba684 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.063872 Oct 17 16:04:16.796254 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3124/6011] 10.222.0.87 () {60 vars in 1194 bytes} [Mon Oct 17 16:04:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:16.816885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6fae1812-7f71-481e-9af2-5008a3aea64b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:16.837409 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6fae1812-7f71-481e-9af2-5008a3aea64b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.032801 Oct 17 16:04:16.840572 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3125/6012] 10.222.0.87 () {58 vars in 1152 bytes} [Mon Oct 17 16:04:16 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:16.870163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bfb8f305-75ba-42df-8f45-13f4e5ffa10b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854441-12"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:04:16.886802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfb8f305-75ba-42df-8f45-13f4e5ffa10b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:16.888345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfb8f305-75ba-42df-8f45-13f4e5ffa10b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:16.890428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bfb8f305-75ba-42df-8f45-13f4e5ffa10b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:17.128737 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bfb8f305-75ba-42df-8f45-13f4e5ffa10b tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 339 microversion: 2.1 time: 0.277070 Oct 17 16:04:17.129847 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3126/6013] 10.222.0.87 () {60 vars in 1194 bytes} [Mon Oct 17 16:04:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 339 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:17.159512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b0c5fa47-4c9e-471a-8215-667b8e84e3f1 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:17.203741 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b0c5fa47-4c9e-471a-8215-667b8e84e3f1 tempest-TestAggregatesBasicOps-1518507435 tempest-TestAggregatesBasicOps-1518507435-project-admin] 10.222.0.87 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.055892 Oct 17 16:04:17.205167 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3127/6014] 10.222.0.87 () {58 vars in 1155 bytes} [Mon Oct 17 16:04:17 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 16:04:17.491291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:17.508907 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-365e0328-71a1-4c96-914a-c7cc1d41b74c tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1503 microversion: 2.1 time: 1.472321 Oct 17 16:04:17.511192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2888/6015] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:16 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1503 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:04:17.535091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86ee4679-7a75-4972-9787-a00abe821762 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:17.536371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86ee4679-7a75-4972-9787-a00abe821762 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:17.546259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee4679-7a75-4972-9787-a00abe821762 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:17.547244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee4679-7a75-4972-9787-a00abe821762 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:17.548164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee4679-7a75-4972-9787-a00abe821762 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:17.549132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee4679-7a75-4972-9787-a00abe821762 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:17.549834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee4679-7a75-4972-9787-a00abe821762 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:17.550455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86ee4679-7a75-4972-9787-a00abe821762 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:17.700239 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86ee4679-7a75-4972-9787-a00abe821762 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.170046 Oct 17 16:04:17.701622 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3128/6016] 10.222.0.87 () {58 vars in 1296 bytes} [Mon Oct 17 16:04:17 2022] DELETE /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2/os-server-password => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:04:17.714411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-822f6310-d244-4aa6-831a-ff6a1dbde7b7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:17.717793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-822f6310-d244-4aa6-831a-ff6a1dbde7b7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:17.733112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822f6310-d244-4aa6-831a-ff6a1dbde7b7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:17.738429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822f6310-d244-4aa6-831a-ff6a1dbde7b7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:17.740327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822f6310-d244-4aa6-831a-ff6a1dbde7b7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:17.744359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822f6310-d244-4aa6-831a-ff6a1dbde7b7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:17.745092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822f6310-d244-4aa6-831a-ff6a1dbde7b7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:17.745693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-822f6310-d244-4aa6-831a-ff6a1dbde7b7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:17.813295 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-822f6310-d244-4aa6-831a-ff6a1dbde7b7 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.103116 Oct 17 16:04:17.828820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:17.829940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:17.833194 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2889/6017] 10.222.0.87 () {58 vars in 1293 bytes} [Mon Oct 17 16:04:17 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2/os-server-password => generated 16 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 16:04:17.839016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:17.840975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:17.841722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:17.842934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:17.843811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:17.844458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:17.895422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:04:18.132349 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58287da1-ac3e-4ef1-b974-8dbf259a3e96 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 204 len: 0 microversion: 2.1 time: 0.302856 Oct 17 16:04:18.142002 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3129/6018] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:04:17 2022] DELETE /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:04:18.152362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:18.153456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:18.171107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:18.171911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:18.172552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:18.184182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:18.185289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:18.186193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:21.428935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:21.480355 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a302c1de-a346-4bb3-9e22-294d246ac4c9 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1509 microversion: 2.1 time: 3.323209 Oct 17 16:04:21.509051 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2890/6019] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:18 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1509 bytes in 3365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:22.555846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:22.595730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:22.643652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:22.644417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:22.645179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:22.646420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:22.647264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:22.648019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:24.006426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e3c011e6-c710-485a-bfaa-ce2c3b06dcac req-49e016d8-6f55-4bf6-a3bd-7e22a196c973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9d011d-048f-43f6-84e8-f671cd6ecad2", "name": "network-vif-deleted", "tag": "5413ca9f-3a73-41a8-9c9e-cffc02fa2a43"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:04:24.032660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e3c011e6-c710-485a-bfaa-ce2c3b06dcac req-49e016d8-6f55-4bf6-a3bd-7e22a196c973 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:24.038429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e3c011e6-c710-485a-bfaa-ce2c3b06dcac req-49e016d8-6f55-4bf6-a3bd-7e22a196c973 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:24.039259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e3c011e6-c710-485a-bfaa-ce2c3b06dcac req-49e016d8-6f55-4bf6-a3bd-7e22a196c973 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:24.074993 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e3c011e6-c710-485a-bfaa-ce2c3b06dcac req-49e016d8-6f55-4bf6-a3bd-7e22a196c973 service nova] Creating event network-vif-deleted:5413ca9f-3a73-41a8-9c9e-cffc02fa2a43 for instance 5f9d011d-048f-43f6-84e8-f671cd6ecad2 on n-h2-854441-12 Oct 17 16:04:24.082018 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e3c011e6-c710-485a-bfaa-ce2c3b06dcac req-49e016d8-6f55-4bf6-a3bd-7e22a196c973 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080333 Oct 17 16:04:24.084436 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2891/6020] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:04:25.620796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:04:25.644228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a845e6eafc493fa1b69c85f59e5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c9631f9cd74648ba94a416cfe0ff8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:25.652142 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78769bbe-29a4-4b9f-a1ab-fd6c8e25ddc8 tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 200 len: 1509 microversion: 2.1 time: 3.147242 Oct 17 16:04:25.665038 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3130/6021] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:22 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 1509 bytes in 3162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:26.679401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:26.682134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] [instance: 5f9d011d-048f-43f6-84e8-f671cd6ecad2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:26.697817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:26.700257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:26.704181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:26.705190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:26.706004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:26.707833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:26.750445 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] HTTP exception thrown: Instance 5f9d011d-048f-43f6-84e8-f671cd6ecad2 could not be found. Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Request method failure captured: Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 HTTP/1.1 Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTXza3cxW96_rr-VrsK0hjS5GwTVUujS1dwDbA2QqlaDnh5ZLq5VNhgn7g-_0el6TDLr3M2dW03QVZp1zgufZc1KAQsWASTc0UNprlG4CmLqEOc9AicKB1aSULEl8Ht511LbPdMxKvolEHf8PYcZOi4GchpD6Cy0Cl36_SdDGqKbbdxw Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 55c9631f9cd74648ba94a416cfe0ff8d Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerPasswordTestJSON-296268253 Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/55c9631f9cd74648ba94a416cfe0ff8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/55c9631f9cd74648ba94a416cfe0ff8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_55c9631f9cd74648ba94a416cfe0ff8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/55c9631f9cd74648ba94a416cfe0ff8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerPasswordTestJSON-296268253 Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 55c9631f9cd74648ba94a416cfe0ff8d Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerPasswordTestJSON-296268253 Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerPasswordTestJSON-296268253-project Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: b6a845e6eafc493fa1b69c85f59e5fdb Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerPasswordTestJSON-296268253-project Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 5f9d011d-048f-43f6-84e8-f671cd6ecad2 could not be found. Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '5f9d011d-048f-43f6-84e8-f671cd6ecad2'} Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9d011d-048f-43f6-84e8-f671cd6ecad2 could not be found. Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9d011d-048f-43f6-84e8-f671cd6ecad2 could not be found. Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:04:26.752429 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:04:26.755977 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:04:26.755977 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:04:26.755977 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:04:26.755977 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:04:26.755977 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:04:26.755977 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9d011d-048f-43f6-84e8-f671cd6ecad2 could not be found. Oct 17 16:04:26.755977 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:04:26.755977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] Returning 404 to user: Instance 5f9d011d-048f-43f6-84e8-f671cd6ecad2 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:04:26.758460 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-727c3bd5-a310-4ca4-bf87-bc8537aa13cc tempest-ServerPasswordTestJSON-296268253 tempest-ServerPasswordTestJSON-296268253-project] 10.222.0.87 "GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2" status: 404 len: 111 microversion: 2.1 time: 0.084392 Oct 17 16:04:26.759731 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2892/6022] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:26 2022] GET /compute/v2.1/servers/5f9d011d-048f-43f6-84e8-f671cd6ecad2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:04:46.347693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1419505393", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "0c177bc6-1afd-4e6a-91ea-f3c598ee85fa"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1204053788", "security_groups": []}, "os:scheduler_hints": {"different_host": ["63a53040-8109-486b-bdb1-1f0a8c4c00f0"]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:04:46.393924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:04:46.396536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:04:46.479341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] validate_networks() for [('0c177bc6-1afd-4e6a-91ea-f3c598ee85fa', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:04:51.724545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:04:51.731560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:04:51.732910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:04:51.734536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:04:51.738206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:04:51.835241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:51.836996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:51.847010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:51.851671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:51.852466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:51.853153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:51.965869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Getting quotas for project eb82fb6ad5c34026b9cefcd474f1318a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:04:52.008505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Getting quotas for user 0aaef713dfc34b7ba9423de7ff0e541e and project eb82fb6ad5c34026b9cefcd474f1318a. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:04:52.079203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:04:52.101308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:04:52.373563 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ccd2ace9-49dc-4661-b99f-766a15ad220a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 6.033637 Oct 17 16:04:52.395607 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3131/6023] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:04:46 2022] POST /compute/v2.1/servers => generated 361 bytes in 6057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:04:52.439843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa5693ec-ec50-4704-9db2-3dc5bbd944b5 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:52.441182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa5693ec-ec50-4704-9db2-3dc5bbd944b5 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:52.477755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:04:52.508909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=41 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:04:52.795745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aa5693ec-ec50-4704-9db2-3dc5bbd944b5 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:52.821755 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa5693ec-ec50-4704-9db2-3dc5bbd944b5 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1242 microversion: 2.1 time: 0.410914 Oct 17 16:04:52.832183 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2893/6024] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:52 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1242 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:53.875811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe18c779-4a75-4dec-b2cf-e7e861087fff tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:53.890199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe18c779-4a75-4dec-b2cf-e7e861087fff tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:54.858704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe18c779-4a75-4dec-b2cf-e7e861087fff tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:54.903929 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe18c779-4a75-4dec-b2cf-e7e861087fff tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1242 microversion: 2.1 time: 1.037229 Oct 17 16:04:54.918308 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3132/6025] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:53 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1242 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:55.964791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:55.965911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:56.019914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:56.025638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:56.026906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:56.028533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:56.031690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:56.044792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:56.670216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:56.705284 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3108c813-15cd-47fa-a042-4d8b479c7b2a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1312 microversion: 2.1 time: 0.737545 Oct 17 16:04:56.709283 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2894/6026] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:55 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1312 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:57.735492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:57.741709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:57.802222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:57.810606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:57.817291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:57.819094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:57.832545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:57.833965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:58.847896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:04:58.888774 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3eb008d-5ebc-4890-99b8-1661a233f298 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 1.160878 Oct 17 16:04:58.902398 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3133/6027] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:57 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:04:59.940000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:04:59.943127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:04:59.984076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:59.985037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:59.985741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:04:59.986935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:04:59.993769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:04:59.995179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:00.332067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:00.361378 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-75ababfe-5a16-4abc-8303-7c8b45b2f049 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 0.428272 Oct 17 16:05:00.376165 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2895/6028] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:04:59 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:05:01.410232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:01.411443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:01.440268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:01.454784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:01.455839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:01.457180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:01.458290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:01.459630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:01.915879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:02.324119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:02.363050 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-590828e7-3cea-4a24-8d8e-6f259e70eb3b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 0.959638 Oct 17 16:05:02.369649 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3134/6029] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:01 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:03.048048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-81270184-8ed8-490e-b855-fbd5f92b675b req-bb4735b0-1df7-4ed7-9156-1043cdfd3d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefd9911-0337-4e6c-ab7b-870e009568dc", "tag": "5f63411d-7e31-4e30-8abe-c961697ec6da"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:03.114114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:03.125673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-81270184-8ed8-490e-b855-fbd5f92b675b req-bb4735b0-1df7-4ed7-9156-1043cdfd3d95 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:03.127545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-81270184-8ed8-490e-b855-fbd5f92b675b req-bb4735b0-1df7-4ed7-9156-1043cdfd3d95 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:03.130675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-81270184-8ed8-490e-b855-fbd5f92b675b req-bb4735b0-1df7-4ed7-9156-1043cdfd3d95 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:03.185514 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-81270184-8ed8-490e-b855-fbd5f92b675b req-bb4735b0-1df7-4ed7-9156-1043cdfd3d95 service nova] Creating event network-changed:5f63411d-7e31-4e30-8abe-c961697ec6da for instance fefd9911-0337-4e6c-ab7b-870e009568dc on n-h2-854441-12 Oct 17 16:05:03.201556 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-81270184-8ed8-490e-b855-fbd5f92b675b req-bb4735b0-1df7-4ed7-9156-1043cdfd3d95 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173062 Oct 17 16:05:03.203688 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2896/6030] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:05:03.417853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:03.432116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:03.482613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:03.485868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:03.495030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:03.502854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:03.504673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:03.509465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:04.325775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:04.351297 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3263c9e-e5a0-469f-b09a-0de1a6b800c0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 0.949168 Oct 17 16:05:04.352381 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3135/6031] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:03 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:05.404497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:05.414380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:05.442380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:05.443595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:05.445061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:05.452180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:05.455957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:05.456940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:05.852383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:05.884670 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-275793b8-0b70-4bfa-a083-9360da6f2636 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 0.490636 Oct 17 16:05:05.886253 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2897/6032] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:05 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:06.919794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:06.924758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:06.954201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:07.006544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:07.013480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:07.016769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:07.023919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:07.025030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:07.028003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:07.380579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:07.446632 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aca1c272-4fa5-43c7-9680-0490285ac7b2 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 0.531678 Oct 17 16:05:07.453336 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3136/6033] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:06 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:08.484950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:08.485989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:08.526036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:08.526896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:08.527645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:08.533041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:08.534145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:08.540581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:09.628062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:09.656080 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7f5bd52b-98b8-4a12-b03b-fd5113c70a89 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 1.178135 Oct 17 16:05:09.661726 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2898/6034] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:08 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:10.689958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:10.691122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:10.726841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:10.731600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:10.736109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:10.748347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:10.749696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:10.751536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:11.748441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:11.787827 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1025e8cb-05dd-4685-9fc2-5c795aa59346 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 1.106372 Oct 17 16:05:11.795037 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3137/6035] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:10 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:12.829085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:12.832808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:12.859717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:12.860525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:12.861341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:12.862372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:12.863137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:12.863868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:13.468325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:13.491422 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-140e3156-897f-4bee-8cbf-ed99ea2e3fb3 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 0.667996 Oct 17 16:05:13.492895 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2899/6036] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:12 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:14.524653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:14.525957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:14.554650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:14.558288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:14.568871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:14.572114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:14.595101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:14.596111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:15.195165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:15.209625 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6421803-bdad-4f92-b082-cb6edceb08a4 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 0.692519 Oct 17 16:05:15.215469 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3138/6037] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:14 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:16.275387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:16.293023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:16.301859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:16.302371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:16.327082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:16.327919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:16.328421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:16.328874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:16.435085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=39 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:16.857662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:16.887139 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6bf413e-72c4-48b9-b3fe-0a9565ce90a0 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 0.612627 Oct 17 16:05:16.896080 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3139/6038] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:16 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:17.039317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ad053c0c-9f5e-48b4-a777-53f827f93ce3 req-862fa764-8e40-42a8-8483-6c1aab3ddaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefd9911-0337-4e6c-ab7b-870e009568dc", "name": "network-vif-plugged", "status": "completed", "tag": "5f63411d-7e31-4e30-8abe-c961697ec6da"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:17.064061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ad053c0c-9f5e-48b4-a777-53f827f93ce3 req-862fa764-8e40-42a8-8483-6c1aab3ddaf0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:17.066859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ad053c0c-9f5e-48b4-a777-53f827f93ce3 req-862fa764-8e40-42a8-8483-6c1aab3ddaf0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:17.067610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ad053c0c-9f5e-48b4-a777-53f827f93ce3 req-862fa764-8e40-42a8-8483-6c1aab3ddaf0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:17.093676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ad053c0c-9f5e-48b4-a777-53f827f93ce3 req-862fa764-8e40-42a8-8483-6c1aab3ddaf0 service nova] Creating event network-vif-plugged:5f63411d-7e31-4e30-8abe-c961697ec6da for instance fefd9911-0337-4e6c-ab7b-870e009568dc on n-h2-854441-12 Oct 17 16:05:17.113003 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ad053c0c-9f5e-48b4-a777-53f827f93ce3 req-862fa764-8e40-42a8-8483-6c1aab3ddaf0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.348427 Oct 17 16:05:17.114145 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2900/6039] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:05:17.986306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:17.987902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:18.008448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:18.015871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:18.022946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:18.024007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:18.030950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:18.036712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:18.037522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:18.383609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:18.395523 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4284d736-d287-4efa-bfa1-f1ca79fba7af tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 0.413632 Oct 17 16:05:18.396142 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3140/6040] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:17 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:19.433480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:19.440605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:19.497892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:19.500188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:19.502459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:19.505023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:19.510454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:19.529929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:20.873455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:20.892223 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c8d6b19c-c65d-4488-9471-0ff8de7383ec tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1300 microversion: 2.1 time: 1.459817 Oct 17 16:05:20.895321 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2901/6041] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:19 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1300 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:21.921928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:21.922613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:21.941435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:21.941944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:21.942382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:21.946098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:21.946852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:21.947105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:22.063294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2087036561", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "39145a29-c4ea-445b-af60-6e4517fa783c"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:22.184851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] validate_networks() for [('39145a29-c4ea-445b-af60-6e4517fa783c', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:05:22.476187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:22.497994 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c0b44e35-064d-43f1-bb8d-73cb3d4c54c1 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1473 microversion: 2.1 time: 0.580253 Oct 17 16:05:22.499378 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2902/6042] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:21 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1473 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:22.527039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:22.528300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:22.540284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:22.541304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:22.541957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:22.544747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:22.545432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:22.546736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:22.957938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:22.962089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=51 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:22.981544 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d8418d65-a106-4561-ba5a-a148893c2b67 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1473 microversion: 2.1 time: 0.458415 Oct 17 16:05:23.000404 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2903/6043] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:22 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1473 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:05:23.013876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93cd77ff-9422-4a20-bc19-4e4bc9fb21cc tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:23.014540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93cd77ff-9422-4a20-bc19-4e4bc9fb21cc tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:23.030246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=25 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:23.037722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cd77ff-9422-4a20-bc19-4e4bc9fb21cc tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:23.042354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cd77ff-9422-4a20-bc19-4e4bc9fb21cc tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:23.043256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cd77ff-9422-4a20-bc19-4e4bc9fb21cc tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:23.044231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cd77ff-9422-4a20-bc19-4e4bc9fb21cc tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:23.044954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cd77ff-9422-4a20-bc19-4e4bc9fb21cc tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:23.045619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93cd77ff-9422-4a20-bc19-4e4bc9fb21cc tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:23.436989 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-93cd77ff-9422-4a20-bc19-4e4bc9fb21cc tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1626 microversion: 2.1 time: 0.427281 Oct 17 16:05:23.459184 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2904/6044] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:23 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1626 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:05:23.472577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3dedf25c-e311-4049-9334-5dea1af53b2c tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:23.473489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3dedf25c-e311-4049-9334-5dea1af53b2c tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:23.483342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dedf25c-e311-4049-9334-5dea1af53b2c tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:23.483873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dedf25c-e311-4049-9334-5dea1af53b2c tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:23.484452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dedf25c-e311-4049-9334-5dea1af53b2c tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:23.485458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dedf25c-e311-4049-9334-5dea1af53b2c tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:23.490585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dedf25c-e311-4049-9334-5dea1af53b2c tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:23.491078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dedf25c-e311-4049-9334-5dea1af53b2c tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:23.786309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:05:23.786983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:05:23.788484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:05:23.789168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:05:23.789802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:05:23.804981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:23.805940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:23.806759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:23.808404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:23.809259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:23.810099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:23.847274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Getting quotas for project 8daaa81667d441fc8ec7da0edc22b89b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:05:23.859012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Getting quotas for user 6071f4123d964b668c4c6361472a849c and project 8daaa81667d441fc8ec7da0edc22b89b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:05:23.900278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:05:23.903785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:05:24.021860 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f680ff4-c275-4552-934f-5cb6f94789d5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.201816 Oct 17 16:05:24.029665 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3141/6045] 10.222.0.87 () {62 vars in 1188 bytes} [Mon Oct 17 16:05:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 16:05:24.035536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92929c5c-23f5-4d2a-ac61-e129c9a4f18a tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:24.036368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92929c5c-23f5-4d2a-ac61-e129c9a4f18a tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:24.177676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92929c5c-23f5-4d2a-ac61-e129c9a4f18a tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:24.199412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92929c5c-23f5-4d2a-ac61-e129c9a4f18a tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:24.201076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92929c5c-23f5-4d2a-ac61-e129c9a4f18a tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:24.202672 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92929c5c-23f5-4d2a-ac61-e129c9a4f18a tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1262 microversion: 2.26 time: 0.171705 Oct 17 16:05:24.204477 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3142/6046] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:24 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1262 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:25.240003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:25.241119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:25.269408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:25.270388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:25.270954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:25.271807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:25.272373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:25.272899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:25.400307 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3dedf25c-e311-4049-9334-5dea1af53b2c tempest-TestSecurityGroupsBasicOps-698404303 tempest-TestSecurityGroupsBasicOps-698404303-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1914 microversion: 2.1 time: 1.939584 Oct 17 16:05:25.411453 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2905/6047] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:23 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1914 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:26.083997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:26.098361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:26.107476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:26.108932 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57d96df2-d00a-4226-bb22-15098eb0c666 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1266 microversion: 2.26 time: 0.878828 Oct 17 16:05:26.110165 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3143/6048] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:25 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1266 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:26.187608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:26.189378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:26.265020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:26.276359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:26.276888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:26.277749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:26.278172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:26.278728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:26.348361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:05:26.562325 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5d2b79cf-dd63-43c7-bc85-595c41cb0767 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "DELETE /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 204 len: 0 microversion: 2.1 time: 0.397000 Oct 17 16:05:26.568191 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2906/6049] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:05:26 2022] DELETE /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:05:26.576518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:26.578095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:26.599419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:26.599933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:26.600384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:26.601106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:26.612475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:26.617486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:27.006926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:27.034918 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64d4ec3b-3c04-4869-8109-1b41497b1678 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1479 microversion: 2.1 time: 0.462430 Oct 17 16:05:27.037444 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3144/6050] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:26 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1479 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:27.154372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:27.157266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:27.181932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:27.183165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:27.183968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:27.185506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:27.187927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:27.191490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:27.614645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:27.628301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:27.637570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:27.639178 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3555045f-cec9-4af9-928b-f6fa5107b4f8 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1320 microversion: 2.26 time: 0.500862 Oct 17 16:05:27.642658 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2907/6051] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:27 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1320 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 16:05:28.068994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:28.070301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:28.106060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:28.107119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:28.109398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:28.111896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:28.112963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:28.113590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:28.519400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:28.543000 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d9df8077-2ec3-4452-9e80-5c2e00b7883b tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1479 microversion: 2.1 time: 0.480268 Oct 17 16:05:28.548067 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3145/6052] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:28 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1479 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:28.690752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:28.693633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:28.719312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:28.720580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:28.726235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:28.727608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:28.728496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:28.747048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:29.208290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:29.236800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:29.250450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:29.255464 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-be21b14f-eaa3-485f-8525-ae4c87e2af90 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1320 microversion: 2.26 time: 0.578211 Oct 17 16:05:29.256798 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2908/6053] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:28 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 16:05:29.574969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:29.580219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:29.612682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:29.615143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:29.620404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:29.622553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:29.624484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:29.626661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:29.805451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:29.819865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13e22353-51a8-495d-9966-b23e160a1c4a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1479 microversion: 2.1 time: 0.253294 Oct 17 16:05:29.820520 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3146/6054] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:29 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1479 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:30.291158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:30.296459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:30.342001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:30.342915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:30.343705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:30.345009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:30.345844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:30.369024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:30.852637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:30.853509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:30.872767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:30.875654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:30.876307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:30.877143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:30.882460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:30.883236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:31.254517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:31.269119 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cc591065-657a-4896-86cd-af557704c0f7 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1479 microversion: 2.1 time: 0.421999 Oct 17 16:05:31.269819 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3147/6055] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:30 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1479 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:31.881223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:31.901409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:31.904050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:31.927563 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4093d5b6-86fa-44a6-961a-af58716869c1 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1320 microversion: 2.26 time: 1.638552 Oct 17 16:05:31.934280 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2909/6056] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:30 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1320 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:32.310101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:32.316214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:32.365168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:32.369827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:32.371090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:32.376074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:32.382906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:32.384063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:32.614535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-074d2214-805c-44f2-9db8-42f552c97577 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:32.616444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-074d2214-805c-44f2-9db8-42f552c97577 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:32.616952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-074d2214-805c-44f2-9db8-42f552c97577 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:32.617404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-074d2214-805c-44f2-9db8-42f552c97577 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:32.618568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-074d2214-805c-44f2-9db8-42f552c97577 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:32.619045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-074d2214-805c-44f2-9db8-42f552c97577 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:32.619483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-074d2214-805c-44f2-9db8-42f552c97577 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:32.697099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-074d2214-805c-44f2-9db8-42f552c97577 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.879186 Oct 17 16:05:32.698637 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3148/6057] 10.222.0.87 () {58 vars in 1185 bytes} [Mon Oct 17 16:05:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:05:32.746698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:32.784215 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2fc7159a-703f-44dc-b4ca-611700c0a774 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 200 len: 1479 microversion: 2.1 time: 0.491168 Oct 17 16:05:32.787975 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2910/6058] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:32 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 1479 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:32.971578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:32.974432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:33.010560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-390127004", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "availability_zone": "nova:n-h2-854441-12", "networks": [{"uuid": "f33a17ba-528c-47b4-b0f5-299cf38dd924"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:33.029224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:33.034900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:33.036033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:33.041025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:33.043229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:33.047510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:33.229128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] validate_networks() for [('f33a17ba-528c-47b4-b0f5-299cf38dd924', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:05:34.187293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:34.706083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:34.736800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:34.739488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:34.740797 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa6fbcfc-634f-4fba-ab72-88e36e405fbb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1362 microversion: 2.26 time: 1.777004 Oct 17 16:05:34.750620 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3149/6059] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:32 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1362 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:35.115556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7054d13d-9698-457a-8cad-4aa6b3551382 req-5fb1eeb7-5300-4d55-b739-736b15445146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefd9911-0337-4e6c-ab7b-870e009568dc", "name": "network-vif-deleted", "tag": "5f63411d-7e31-4e30-8abe-c961697ec6da"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:35.133857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7054d13d-9698-457a-8cad-4aa6b3551382 req-5fb1eeb7-5300-4d55-b739-736b15445146 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:35.139059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7054d13d-9698-457a-8cad-4aa6b3551382 req-5fb1eeb7-5300-4d55-b739-736b15445146 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:35.141169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7054d13d-9698-457a-8cad-4aa6b3551382 req-5fb1eeb7-5300-4d55-b739-736b15445146 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:35.172852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7054d13d-9698-457a-8cad-4aa6b3551382 req-5fb1eeb7-5300-4d55-b739-736b15445146 service nova] Creating event network-vif-deleted:5f63411d-7e31-4e30-8abe-c961697ec6da for instance fefd9911-0337-4e6c-ab7b-870e009568dc on n-h2-854441-12 Oct 17 16:05:35.180928 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7054d13d-9698-457a-8cad-4aa6b3551382 req-5fb1eeb7-5300-4d55-b739-736b15445146 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437810 Oct 17 16:05:35.182163 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3150/6060] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:05:35.188649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:35.190599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: fefd9911-0337-4e6c-ab7b-870e009568dc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:35.200399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:35.201448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:35.202155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:35.203218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:35.204878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:35.207529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:35.246984 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] HTTP exception thrown: Instance fefd9911-0337-4e6c-ab7b-870e009568dc could not be found. Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Request method failure captured: Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc HTTP/1.1 Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXx-nV-Nb_yvjLJ08-3Axgyptfg-GV3bu5Ef8895NZJZsK2LzhDKQqMV1oru8FLzpE2p0OejZJd_tBu4zN83wYmbHVsPmumWhTBG0xXM43-R2tYDTCy0fk0EPMjMMSRtvTUNQbi00RXyPHUuQRmR2WCO7FgsLz4j24VpcOOA6XolqR0 Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: eb82fb6ad5c34026b9cefcd474f1318a Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-288841089 Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/eb82fb6ad5c34026b9cefcd474f1318a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/eb82fb6ad5c34026b9cefcd474f1318a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_eb82fb6ad5c34026b9cefcd474f1318a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/eb82fb6ad5c34026b9cefcd474f1318a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestSecurityGroupsBasicOps-288841089 Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: eb82fb6ad5c34026b9cefcd474f1318a Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-288841089 Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestSecurityGroupsBasicOps-288841089-project Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 0aaef713dfc34b7ba9423de7ff0e541e Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestSecurityGroupsBasicOps-288841089-project Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance fefd9911-0337-4e6c-ab7b-870e009568dc could not be found. Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'fefd9911-0337-4e6c-ab7b-870e009568dc'} Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefd9911-0337-4e6c-ab7b-870e009568dc could not be found. Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefd9911-0337-4e6c-ab7b-870e009568dc could not be found. Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:05:35.251995 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefd9911-0337-4e6c-ab7b-870e009568dc could not be found. Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Returning 404 to user: Instance fefd9911-0337-4e6c-ab7b-870e009568dc could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-006402f4-e230-445d-ada9-87bd836c2416 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc" status: 404 len: 111 microversion: 2.1 time: 0.069965 Oct 17 16:05:35.255919 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3151/6061] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:35 2022] GET /compute/v2.1/servers/fefd9911-0337-4e6c-ab7b-870e009568dc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:05:35.321226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:05:35.321942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:05:35.324955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:05:35.328251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:05:35.329214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:05:35.390191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:35.391618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:35.392578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:35.410451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:35.413862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:35.415267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:35.468611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Getting quotas for project 0b113393c1ca4f99b530ce65f45c9a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:05:35.485412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Getting quotas for user e511a2b4568445659ac9e83193c8a825 and project 0b113393c1ca4f99b530ce65f45c9a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:05:35.536390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:05:35.548420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:05:35.774887 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-64c40179-5387-4b3f-b9ec-a0ac8a48ad77 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.770077 Oct 17 16:05:35.776833 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2911/6062] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:05:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 16:05:35.788404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a48f610b-3da4-4f69-af5d-95e20ca48c0d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:35.789441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a48f610b-3da4-4f69-af5d-95e20ca48c0d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:35.808582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:35.818917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:35.835053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:35.840463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:35.841501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:35.842675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:35.843410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:35.844249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:36.201293 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a48f610b-3da4-4f69-af5d-95e20ca48c0d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1328 microversion: 2.1 time: 0.416874 Oct 17 16:05:36.206755 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3152/6063] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:35 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1328 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:36.586746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:36.617612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:36.623983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:36.626017 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b43c24a6-564d-4a32-801e-35b8fff58be9 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1362 microversion: 2.26 time: 0.827139 Oct 17 16:05:36.628852 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2912/6064] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:35 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1362 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:37.247869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de90225b-7ae4-4671-ab51-8f1e50c46add tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:37.250848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de90225b-7ae4-4671-ab51-8f1e50c46add tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:37.254034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2dab7792-535c-4db5-a4e3-15a47c00b936 req-a62ecccb-5e09-47bf-9ff1-a367b66891d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5cf4211-fb38-441c-963b-8021fb0d83c2", "tag": "6dcf2d57-53a7-4d31-84b7-074dfc475548"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:37.273660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de90225b-7ae4-4671-ab51-8f1e50c46add tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:37.277736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de90225b-7ae4-4671-ab51-8f1e50c46add tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:37.278427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de90225b-7ae4-4671-ab51-8f1e50c46add tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:37.279627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2dab7792-535c-4db5-a4e3-15a47c00b936 req-a62ecccb-5e09-47bf-9ff1-a367b66891d0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:37.280268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2dab7792-535c-4db5-a4e3-15a47c00b936 req-a62ecccb-5e09-47bf-9ff1-a367b66891d0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:37.280812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de90225b-7ae4-4671-ab51-8f1e50c46add tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:37.281166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2dab7792-535c-4db5-a4e3-15a47c00b936 req-a62ecccb-5e09-47bf-9ff1-a367b66891d0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:37.282608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de90225b-7ae4-4671-ab51-8f1e50c46add tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:37.283683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de90225b-7ae4-4671-ab51-8f1e50c46add tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:37.296169 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2dab7792-535c-4db5-a4e3-15a47c00b936 req-a62ecccb-5e09-47bf-9ff1-a367b66891d0 service nova] Creating event network-changed:6dcf2d57-53a7-4d31-84b7-074dfc475548 for instance c5cf4211-fb38-441c-963b-8021fb0d83c2 on n-h1-854441-12 Oct 17 16:05:37.319737 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2dab7792-535c-4db5-a4e3-15a47c00b936 req-a62ecccb-5e09-47bf-9ff1-a367b66891d0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068241 Oct 17 16:05:37.323192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2913/6065] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:05:37.660694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:37.662347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:37.680924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:37.683643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:37.684291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:37.689659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:37.690679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:37.691310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:38.071506 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de90225b-7ae4-4671-ab51-8f1e50c46add tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1345 microversion: 2.1 time: 0.828858 Oct 17 16:05:38.080833 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3153/6066] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:37 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1345 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:38.201872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:38.239511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:38.249375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:38.256054 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d2c5716f-aea8-4a22-808d-ea6725173767 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1362 microversion: 2.26 time: 0.599851 Oct 17 16:05:38.259941 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2914/6067] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:37 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1362 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:39.110338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-924de8b3-b724-418a-a778-8dba6dd80225 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:39.111359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-924de8b3-b724-418a-a778-8dba6dd80225 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:39.125256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924de8b3-b724-418a-a778-8dba6dd80225 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:39.126272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924de8b3-b724-418a-a778-8dba6dd80225 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:39.135936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924de8b3-b724-418a-a778-8dba6dd80225 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:39.138281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924de8b3-b724-418a-a778-8dba6dd80225 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:39.145669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924de8b3-b724-418a-a778-8dba6dd80225 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:39.147361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924de8b3-b724-418a-a778-8dba6dd80225 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:39.293167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:39.305533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:39.331750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:39.332872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:39.337719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:39.339085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:39.339996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:39.340919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:39.453306 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-924de8b3-b724-418a-a778-8dba6dd80225 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1423 microversion: 2.1 time: 0.349082 Oct 17 16:05:39.453930 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3154/6068] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:39 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1423 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:40.483254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76478b69-8e76-4e1c-8ef3-f85466647a84 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:40.484849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76478b69-8e76-4e1c-8ef3-f85466647a84 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:40.514004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76478b69-8e76-4e1c-8ef3-f85466647a84 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:40.515867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76478b69-8e76-4e1c-8ef3-f85466647a84 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:40.518758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76478b69-8e76-4e1c-8ef3-f85466647a84 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:40.530137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76478b69-8e76-4e1c-8ef3-f85466647a84 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:40.531113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76478b69-8e76-4e1c-8ef3-f85466647a84 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:40.532206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76478b69-8e76-4e1c-8ef3-f85466647a84 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:41.185342 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76478b69-8e76-4e1c-8ef3-f85466647a84 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1423 microversion: 2.1 time: 0.705427 Oct 17 16:05:41.207175 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3155/6069] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:40 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1423 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:05:41.230945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:41.247397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:41.254772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:41.257126 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c59dd1c1-8cbb-4d60-8ccb-bce4287f0276 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1362 microversion: 2.26 time: 1.972503 Oct 17 16:05:41.262975 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2915/6070] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:39 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1362 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 16:05:42.229084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dba476a8-5c9c-493a-9d29-d7407fae1a1e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:42.233234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dba476a8-5c9c-493a-9d29-d7407fae1a1e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:42.255647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dba476a8-5c9c-493a-9d29-d7407fae1a1e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:42.261060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dba476a8-5c9c-493a-9d29-d7407fae1a1e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:42.264076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dba476a8-5c9c-493a-9d29-d7407fae1a1e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:42.265579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dba476a8-5c9c-493a-9d29-d7407fae1a1e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:42.274344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dba476a8-5c9c-493a-9d29-d7407fae1a1e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:42.275150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dba476a8-5c9c-493a-9d29-d7407fae1a1e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:42.320454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:42.321887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:42.343572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:42.352257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:42.359365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:42.361566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:42.366459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:42.367229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:42.630793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:43.108828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:43.118875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:43.120816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:43.122342 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-45015356-99ae-406b-a309-b97d66387386 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1362 microversion: 2.26 time: 0.806993 Oct 17 16:05:43.139119 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2916/6071] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:42 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1362 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 16:05:43.637889 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dba476a8-5c9c-493a-9d29-d7407fae1a1e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1465 microversion: 2.1 time: 1.420712 Oct 17 16:05:43.640446 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3156/6072] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:42 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1465 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:44.151465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:44.152273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:44.169492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:44.170005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:44.170619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:44.171325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:44.171872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:44.172231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:44.676029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9773858-795e-489b-8d22-5c8fac542c0c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:44.684585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9773858-795e-489b-8d22-5c8fac542c0c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:44.780057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9773858-795e-489b-8d22-5c8fac542c0c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:44.784180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9773858-795e-489b-8d22-5c8fac542c0c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:44.794262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9773858-795e-489b-8d22-5c8fac542c0c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:44.802996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9773858-795e-489b-8d22-5c8fac542c0c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:44.806594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9773858-795e-489b-8d22-5c8fac542c0c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:44.811710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9773858-795e-489b-8d22-5c8fac542c0c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:45.103601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:45.151997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:45.167937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:45.179447 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9aa6551-78f0-43e8-bcb1-acfb4c87c786 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1362 microversion: 2.26 time: 1.024296 Oct 17 16:05:45.182959 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2917/6073] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:44 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1362 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:45.493926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-940ae6e3-279c-4373-ad0d-075b1102e48d req-013fb681-9592-4d21-a9ff-d3b4c67f986f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62584422-5f2f-49ba-898c-917b512f3034", "tag": "143c30c1-7da4-4b67-b79e-a73f3278781c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:45.510582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:45.512386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:45.529907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-940ae6e3-279c-4373-ad0d-075b1102e48d req-013fb681-9592-4d21-a9ff-d3b4c67f986f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:45.532964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-940ae6e3-279c-4373-ad0d-075b1102e48d req-013fb681-9592-4d21-a9ff-d3b4c67f986f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:45.534216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-940ae6e3-279c-4373-ad0d-075b1102e48d req-013fb681-9592-4d21-a9ff-d3b4c67f986f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:45.565593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-940ae6e3-279c-4373-ad0d-075b1102e48d req-013fb681-9592-4d21-a9ff-d3b4c67f986f service nova] Creating event network-changed:143c30c1-7da4-4b67-b79e-a73f3278781c for instance 62584422-5f2f-49ba-898c-917b512f3034 on n-h2-854441-12 Oct 17 16:05:45.580302 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-940ae6e3-279c-4373-ad0d-075b1102e48d req-013fb681-9592-4d21-a9ff-d3b4c67f986f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091383 Oct 17 16:05:45.584288 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2918/6074] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:05:46.202483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:46.216941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:46.219195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:46.253217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:46.253782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:46.256937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:46.257824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:46.263141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:46.268281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:46.459396 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9773858-795e-489b-8d22-5c8fac542c0c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1465 microversion: 2.1 time: 1.794757 Oct 17 16:05:46.461911 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3157/6075] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:44 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1465 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:46.483082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7a242625-bf29-45d7-a8a1-0bb804f914bd req-26495687-9dae-45f1-a179-eb0d1c3243ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cf4211-fb38-441c-963b-8021fb0d83c2", "name": "network-vif-plugged", "status": "completed", "tag": "6dcf2d57-53a7-4d31-84b7-074dfc475548"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:46.532613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a242625-bf29-45d7-a8a1-0bb804f914bd req-26495687-9dae-45f1-a179-eb0d1c3243ec service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:46.534487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a242625-bf29-45d7-a8a1-0bb804f914bd req-26495687-9dae-45f1-a179-eb0d1c3243ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:46.539301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7a242625-bf29-45d7-a8a1-0bb804f914bd req-26495687-9dae-45f1-a179-eb0d1c3243ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:46.642135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=86 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:46.662479 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7a242625-bf29-45d7-a8a1-0bb804f914bd req-26495687-9dae-45f1-a179-eb0d1c3243ec service nova] Creating event network-vif-plugged:6dcf2d57-53a7-4d31-84b7-074dfc475548 for instance c5cf4211-fb38-441c-963b-8021fb0d83c2 on n-h1-854441-12 Oct 17 16:05:46.685403 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7a242625-bf29-45d7-a8a1-0bb804f914bd req-26495687-9dae-45f1-a179-eb0d1c3243ec service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219035 Oct 17 16:05:46.689765 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3158/6076] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:05:47.170570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:47.208439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:47.220057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:47.223681 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-51919a8f-0efb-4a46-9662-81f2104fa9b4 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1362 microversion: 2.26 time: 1.012534 Oct 17 16:05:47.225088 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2919/6077] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:46 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1362 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:47.521417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ead9f836-de88-47bd-9ab6-4b75a854352e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:47.528970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ead9f836-de88-47bd-9ab6-4b75a854352e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:47.553388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ead9f836-de88-47bd-9ab6-4b75a854352e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:47.554646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ead9f836-de88-47bd-9ab6-4b75a854352e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:47.555655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ead9f836-de88-47bd-9ab6-4b75a854352e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:47.557770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ead9f836-de88-47bd-9ab6-4b75a854352e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:47.559328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ead9f836-de88-47bd-9ab6-4b75a854352e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:47.560412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ead9f836-de88-47bd-9ab6-4b75a854352e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:48.045216 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ead9f836-de88-47bd-9ab6-4b75a854352e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1465 microversion: 2.1 time: 0.543981 Oct 17 16:05:48.045859 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3159/6078] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:47 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1465 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:48.265978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:48.268730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:48.307101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:48.308354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:48.309486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:48.311459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:48.312854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:48.313866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:49.077968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96261775-ae28-42a2-a5df-2d9291d571cb tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:49.081708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96261775-ae28-42a2-a5df-2d9291d571cb tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:49.100259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:49.116442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96261775-ae28-42a2-a5df-2d9291d571cb tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:49.122163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96261775-ae28-42a2-a5df-2d9291d571cb tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:49.123895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96261775-ae28-42a2-a5df-2d9291d571cb tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:49.126057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96261775-ae28-42a2-a5df-2d9291d571cb tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:49.132746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96261775-ae28-42a2-a5df-2d9291d571cb tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:49.133587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96261775-ae28-42a2-a5df-2d9291d571cb tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:49.455556 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96261775-ae28-42a2-a5df-2d9291d571cb tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1465 microversion: 2.1 time: 0.382548 Oct 17 16:05:49.459741 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3160/6079] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:49 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1465 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:05:49.582624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:49.594089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:49.621683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:49.628570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:49.630408 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-52e5f1ca-680f-484f-af90-bd67eb51e099 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1362 microversion: 2.26 time: 1.375507 Oct 17 16:05:49.632801 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2920/6080] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:48 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1362 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:50.504887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c22e0d32-6a46-42cc-b88a-1a499059e3b7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:50.507201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c22e0d32-6a46-42cc-b88a-1a499059e3b7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:50.521530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c22e0d32-6a46-42cc-b88a-1a499059e3b7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:50.526298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c22e0d32-6a46-42cc-b88a-1a499059e3b7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:50.527383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c22e0d32-6a46-42cc-b88a-1a499059e3b7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:50.528902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c22e0d32-6a46-42cc-b88a-1a499059e3b7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:50.529658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c22e0d32-6a46-42cc-b88a-1a499059e3b7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:50.530272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c22e0d32-6a46-42cc-b88a-1a499059e3b7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:50.673268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:50.674906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:50.705907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:50.709693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:50.710907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:50.715046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:50.716481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:50.725106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:51.041842 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c22e0d32-6a46-42cc-b88a-1a499059e3b7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1465 microversion: 2.1 time: 0.537255 Oct 17 16:05:51.042947 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3161/6081] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:50 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1465 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:51.687609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:51.709854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:51.711253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:51.714858 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2fe883cc-584a-4610-92c4-624e5f2f83bb tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1545 microversion: 2.26 time: 1.046695 Oct 17 16:05:51.717710 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2921/6082] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:50 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1545 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:51.777955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28bdc63310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:51.819606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:51.819790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:51.820110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:51.820816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:51.843567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:51.846609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:51.849584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:51.851741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:51.853748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:51.854591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:51.936583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:51.937092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:51.943187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:51.983756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:51.984481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:51.985097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.074937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a0d2785-3195-4c22-ac6d-1fb39d14492d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:52.075632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a0d2785-3195-4c22-ac6d-1fb39d14492d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:52.082701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:52.088294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0d2785-3195-4c22-ac6d-1fb39d14492d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.094424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0d2785-3195-4c22-ac6d-1fb39d14492d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.097325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0d2785-3195-4c22-ac6d-1fb39d14492d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.098530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0d2785-3195-4c22-ac6d-1fb39d14492d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.105440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0d2785-3195-4c22-ac6d-1fb39d14492d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.112909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a0d2785-3195-4c22-ac6d-1fb39d14492d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.154201 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-821bc3f5-59dc-4755-a26b-749d8cff0638 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-434963989" status: 201 len: 0 microversion: 2.26 time: 0.380904 Oct 17 16:05:52.155602 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3162/6083] 10.222.0.87 () {62 vars in 1377 bytes} [Mon Oct 17 16:05:51 2022] PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-434963989 => generated 0 bytes in 383 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 16:05:52.168198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec9a55c9-bb4e-4a2e-8cbf-03a0d000b53f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28be3ef280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:52.184781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec9a55c9-bb4e-4a2e-8cbf-03a0d000b53f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.188084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec9a55c9-bb4e-4a2e-8cbf-03a0d000b53f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.188962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec9a55c9-bb4e-4a2e-8cbf-03a0d000b53f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.212618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec9a55c9-bb4e-4a2e-8cbf-03a0d000b53f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-434963989" status: 204 len: 0 microversion: 2.26 time: 0.048649 Oct 17 16:05:52.215929 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3163/6084] 10.222.0.87 () {60 vars in 1358 bytes} [Mon Oct 17 16:05:52 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-434963989 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 16:05:52.230637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28bdc63670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:52.252772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.255194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.255957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.258701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:52.292057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.292887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.303422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.304791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.307210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.310656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.413761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.416661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.417397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.460830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:52.506245 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1a1dba8e-1fba-4590-b412-90c0f5444f45 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.283418 Oct 17 16:05:52.512827 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3164/6085] 10.222.0.87 () {60 vars in 1295 bytes} [Mon Oct 17 16:05:52 2022] DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 16:05:52.546630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bae82306-28bb-4674-af46-9836c1438ded tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28bead0820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:52.562811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae82306-28bb-4674-af46-9836c1438ded tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.566793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae82306-28bb-4674-af46-9836c1438ded tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.569665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bae82306-28bb-4674-af46-9836c1438ded tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.607346 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bae82306-28bb-4674-af46-9836c1438ded tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 200 len: 12 microversion: 2.26 time: 0.089373 Oct 17 16:05:52.612106 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3165/6086] 10.222.0.87 () {60 vars in 1292 bytes} [Mon Oct 17 16:05:52 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 12 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:52.631895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28be321820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:52.657055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.657578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.658057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.659158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:52.672933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.673915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.675556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.677336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.678115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.678897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.768621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.772277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.775086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.816958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.817929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.822135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:52.886165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:52.923250 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a0d2785-3195-4c22-ac6d-1fb39d14492d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1465 microversion: 2.1 time: 0.842901 Oct 17 16:05:52.925841 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2922/6087] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:52 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1465 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:52.955751 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a8f5015-3c6d-4a45-b39a-7aedfaa523bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-422124054" status: 201 len: 0 microversion: 2.26 time: 0.333379 Oct 17 16:05:52.957707 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3166/6088] 10.222.0.87 () {62 vars in 1377 bytes} [Mon Oct 17 16:05:52 2022] PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-422124054 => generated 0 bytes in 336 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 17 16:05:52.978700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-35b86082-4c01-4aae-b948-ebd571fe8430 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28be03d040>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:52.992061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35b86082-4c01-4aae-b948-ebd571fe8430 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:52.992974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35b86082-4c01-4aae-b948-ebd571fe8430 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:52.993908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35b86082-4c01-4aae-b948-ebd571fe8430 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.014179 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-35b86082-4c01-4aae-b948-ebd571fe8430 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 200 len: 35 microversion: 2.26 time: 0.044336 Oct 17 16:05:53.016975 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2923/6089] 10.222.0.87 () {60 vars in 1292 bytes} [Mon Oct 17 16:05:52 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 35 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:53.046707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28be3c3a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:53.097751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.099633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.100933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.103352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:53.111145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.111828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.112481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.113618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.114201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.114768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.159580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.160379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.160938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.237281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:53.300925 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a9e82e5-f734-4f55-8872-17b4fe04c67d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-422124054" status: 204 len: 0 microversion: 2.26 time: 0.270211 Oct 17 16:05:53.301947 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3167/6090] 10.222.0.87 () {60 vars in 1361 bytes} [Mon Oct 17 16:05:53 2022] DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-422124054 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 16:05:53.341041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4a0d69b3-70e8-4fb9-884b-ae00059883bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28be393940>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:53.369118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:53.404185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a0d69b3-70e8-4fb9-884b-ae00059883bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.405034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a0d69b3-70e8-4fb9-884b-ae00059883bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.411783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a0d69b3-70e8-4fb9-884b-ae00059883bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.475152 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4a0d69b3-70e8-4fb9-884b-ae00059883bf tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 200 len: 12 microversion: 2.26 time: 0.135651 Oct 17 16:05:53.476510 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2924/6091] 10.222.0.87 () {60 vars in 1292 bytes} [Mon Oct 17 16:05:53 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 12 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:53.488631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28be321820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:53.514170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.514170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.514170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.514170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:53.547225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.548185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.549049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.550422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.553645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.557071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.615040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.615543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.616237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.630542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:53.653416 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8437e243-07ce-48e5-9a3c-f7f750c21097 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.169410 Oct 17 16:05:53.659519 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3168/6092] 10.222.0.87 () {60 vars in 1295 bytes} [Mon Oct 17 16:05:53 2022] DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 16:05:53.672936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28be426310>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:53.700121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.701111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.701910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.702786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:53.720097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.721184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.721892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.724856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.725852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.726653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.790978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.791486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.791937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.806101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.807714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.809228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.853617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:53.889446 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee3586e0-6767-49fb-955d-6ec2490e8eb5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-786887430" status: 201 len: 0 microversion: 2.26 time: 0.228544 Oct 17 16:05:53.896374 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2925/6093] 10.222.0.87 () {62 vars in 1377 bytes} [Mon Oct 17 16:05:53 2022] PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-786887430 => generated 0 bytes in 235 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 16:05:53.905113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28c2e82940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:53.925265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.926221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.926968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.928114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:53.938629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.940377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.941365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.943630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.945519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.946315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.960224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2fb4c4be-fa34-4e26-9bf3-3c6b9e30c5db tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:53.960852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2fb4c4be-fa34-4e26-9bf3-3c6b9e30c5db tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:53.983516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4be-fa34-4e26-9bf3-3c6b9e30c5db tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.984075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4be-fa34-4e26-9bf3-3c6b9e30c5db tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.984530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4be-fa34-4e26-9bf3-3c6b9e30c5db tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.991217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4be-fa34-4e26-9bf3-3c6b9e30c5db tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.991840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4be-fa34-4e26-9bf3-3c6b9e30c5db tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:53.997464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:53.998157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2fb4c4be-fa34-4e26-9bf3-3c6b9e30c5db tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:53.998678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.000108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.025947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.026971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.028445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.049282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:54.114403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:54.136351 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e892bd0b-1c74-4ef9-9569-30c87f36dc88 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-348473129" status: 201 len: 0 microversion: 2.26 time: 0.236843 Oct 17 16:05:54.137575 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3169/6094] 10.222.0.87 () {62 vars in 1377 bytes} [Mon Oct 17 16:05:53 2022] PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-348473129 => generated 0 bytes in 239 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 16:05:54.149968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28be3ef940>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:54.163611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.164553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.165827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.166980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:54.181500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.182016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.182465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.183267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.183745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.184190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.211410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.211935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.212391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.234117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:54.254771 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c4d7b9d-93ce-48d5-afa0-65332ba210b5 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.110640 Oct 17 16:05:54.255835 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3170/6095] 10.222.0.87 () {60 vars in 1295 bytes} [Mon Oct 17 16:05:54 2022] DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 16:05:54.265358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0bdde33c-8a77-4750-8afc-4a7b533541b0 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28bedde0d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:54.283756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bdde33c-8a77-4750-8afc-4a7b533541b0 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.284547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bdde33c-8a77-4750-8afc-4a7b533541b0 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.287950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bdde33c-8a77-4750-8afc-4a7b533541b0 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.312787 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0bdde33c-8a77-4750-8afc-4a7b533541b0 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 200 len: 12 microversion: 2.26 time: 0.052175 Oct 17 16:05:54.313643 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3171/6096] 10.222.0.87 () {60 vars in 1292 bytes} [Mon Oct 17 16:05:54 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 12 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:54.327192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f0917045-3fac-44c1-bfdc-d4ec9b56152b req-a7e29036-27df-407f-af8c-68d0e0e591d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62584422-5f2f-49ba-898c-917b512f3034", "name": "network-vif-plugged", "status": "completed", "tag": "143c30c1-7da4-4b67-b79e-a73f3278781c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:54.369047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f0917045-3fac-44c1-bfdc-d4ec9b56152b req-a7e29036-27df-407f-af8c-68d0e0e591d9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.370073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f0917045-3fac-44c1-bfdc-d4ec9b56152b req-a7e29036-27df-407f-af8c-68d0e0e591d9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.370946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f0917045-3fac-44c1-bfdc-d4ec9b56152b req-a7e29036-27df-407f-af8c-68d0e0e591d9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.399666 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f0917045-3fac-44c1-bfdc-d4ec9b56152b req-a7e29036-27df-407f-af8c-68d0e0e591d9 service nova] Creating event network-vif-plugged:143c30c1-7da4-4b67-b79e-a73f3278781c for instance 62584422-5f2f-49ba-898c-917b512f3034 on n-h2-854441-12 Oct 17 16:05:54.420100 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f0917045-3fac-44c1-bfdc-d4ec9b56152b req-a7e29036-27df-407f-af8c-68d0e0e591d9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100288 Oct 17 16:05:54.428151 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3172/6097] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:05:54.448758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28be2bd430>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:54.490323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.494771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.495585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.498117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:54.512393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.513322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.514159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.515457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.517204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.517204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.627652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.628946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.630277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.671746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:54.713244 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-34bbb7ec-d41c-4776-a0aa-84b42ace960d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.283286 Oct 17 16:05:54.715559 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3173/6098] 10.222.0.87 () {60 vars in 1295 bytes} [Mon Oct 17 16:05:54 2022] DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 16:05:54.738266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28bef40310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:54.761154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.762251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.764372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.765337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:54.778963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.781053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.781916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.783439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.784603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.785472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.855887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.856756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.857824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.881227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:54.882196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:54.883457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:54.944964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:55.009067 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbf1a292-e72f-434b-b5cd-55fb8c188691 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-74721074" status: 201 len: 0 microversion: 2.26 time: 0.285480 Oct 17 16:05:55.010698 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3174/6099] 10.222.0.87 () {62 vars in 1374 bytes} [Mon Oct 17 16:05:54 2022] PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-74721074 => generated 0 bytes in 289 msecs (HTTP/1.1 201) 10 headers in 484 bytes (2 switches on core 0) Oct 17 16:05:55.036786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28beedd1f0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:55.050438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.051179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.051737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.052374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:55.061662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.062355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.062988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.064128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.065122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.066086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.130089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.130837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.131297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.144272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.144767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.145212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.180741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:55.212608 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-813de1ff-0f9a-40d4-9132-22c7d78a1189 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-1992081567" status: 201 len: 0 microversion: 2.26 time: 0.192948 Oct 17 16:05:55.214187 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3175/6100] 10.222.0.87 () {62 vars in 1380 bytes} [Mon Oct 17 16:05:55 2022] PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags/tempest-tag-1992081567 => generated 0 bytes in 198 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 17 16:05:55.220431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:55.220949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:55.230580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.230919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.231389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.232106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.232571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.233083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.272780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:05:55.515548 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4db02d74-a6e2-436d-b734-4578d0a03980 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "DELETE /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 204 len: 0 microversion: 2.1 time: 0.297779 Oct 17 16:05:55.517027 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3176/6101] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:05:55 2022] DELETE /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:05:55.542108 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2fb4c4be-fa34-4e26-9bf3-3c6b9e30c5db tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1465 microversion: 2.1 time: 1.592653 Oct 17 16:05:55.545513 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2926/6102] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:53 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1465 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:55.561325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Action: 'update_all', calling method: .version_select at 0x7f28be03d430>, body: {"tags": ["tempest-tag-1775508415", "tempest-tag-1920369948"]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:55.632340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.633168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.633946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.634778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:55.675972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.676685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.680385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.690796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.692375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.693580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.766899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.768572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.770174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.817309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:55.857484 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f0cb8e3a-8a80-476c-bb61-05943df7fe7d tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 200 len: 62 microversion: 2.26 time: 0.309788 Oct 17 16:05:55.867771 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2927/6103] 10.222.0.87 () {62 vars in 1312 bytes} [Mon Oct 17 16:05:55 2022] PUT /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 62 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:55.882381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:55.883667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:55.896885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.898159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.899193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:55.901815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:55.903004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:55.904007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.011350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9e4696a0-9961-4459-8d1c-952304b88d87 req-e100e92d-7257-47ce-84f6-ebf8d9618b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a53040-8109-486b-bdb1-1f0a8c4c00f0", "tag": "0d0426cf-e695-4e14-800c-a59e2e138599"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:05:56.033115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9e4696a0-9961-4459-8d1c-952304b88d87 req-e100e92d-7257-47ce-84f6-ebf8d9618b10 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.034543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9e4696a0-9961-4459-8d1c-952304b88d87 req-e100e92d-7257-47ce-84f6-ebf8d9618b10 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.035931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9e4696a0-9961-4459-8d1c-952304b88d87 req-e100e92d-7257-47ce-84f6-ebf8d9618b10 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.062541 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9e4696a0-9961-4459-8d1c-952304b88d87 req-e100e92d-7257-47ce-84f6-ebf8d9618b10 service nova] Creating event network-changed:0d0426cf-e695-4e14-800c-a59e2e138599 for instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 on n-h1-854441-12 Oct 17 16:05:56.074734 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9e4696a0-9961-4459-8d1c-952304b88d87 req-e100e92d-7257-47ce-84f6-ebf8d9618b10 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553749 Oct 17 16:05:56.076383 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3177/6104] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:05:56.086904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00a8c07e-4ecc-42c5-8109-fc5992447736 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28beac6310>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:56.101739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00a8c07e-4ecc-42c5-8109-fc5992447736 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.102841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00a8c07e-4ecc-42c5-8109-fc5992447736 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.103710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00a8c07e-4ecc-42c5-8109-fc5992447736 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.124069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00a8c07e-4ecc-42c5-8109-fc5992447736 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 200 len: 62 microversion: 2.26 time: 0.045110 Oct 17 16:05:56.125625 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3178/6105] 10.222.0.87 () {60 vars in 1292 bytes} [Mon Oct 17 16:05:56 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 62 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:56.144639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '.version_select at 0x7f28bead0280>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:56.177813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.178804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.181471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.182758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:56.200262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.215962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.216887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.218786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.219858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.220803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.292429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.305244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.306423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.350766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'flavor' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:05:56.389322 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f5e5d25-d69d-4e1b-bfd3-095f995db912 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags" status: 204 len: 0 microversion: 2.26 time: 0.252395 Oct 17 16:05:56.392022 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3179/6106] 10.222.0.87 () {60 vars in 1295 bytes} [Mon Oct 17 16:05:56 2022] DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2/tags => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 16:05:56.413097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:56.413908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:56.417085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:56.428534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.429413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.430228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.435439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.447641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.448207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.467515 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d2ff9b01-0539-4a53-a45e-9a615e4f5ccd tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1767 microversion: 2.1 time: 0.585778 Oct 17 16:05:56.469977 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2928/6107] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:55 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1767 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:56.538809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:05:56.590247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5c4e99c-43bd-473d-8cfd-464166288403 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:56.591223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5c4e99c-43bd-473d-8cfd-464166288403 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:56.605686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5c4e99c-43bd-473d-8cfd-464166288403 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.606200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5c4e99c-43bd-473d-8cfd-464166288403 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.609727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5c4e99c-43bd-473d-8cfd-464166288403 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.610631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5c4e99c-43bd-473d-8cfd-464166288403 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.611133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5c4e99c-43bd-473d-8cfd-464166288403 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.611589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5c4e99c-43bd-473d-8cfd-464166288403 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.639739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:RELEASE=3,nova_cell1:SELECT=88,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:05:56.900168 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6df13c05-f557-4afb-8279-867b5aba73ca tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 204 len: 0 microversion: 2.26 time: 0.491920 Oct 17 16:05:56.903684 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3180/6108] 10.222.0.87 () {60 vars in 1280 bytes} [Mon Oct 17 16:05:56 2022] DELETE /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 16:05:56.948879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:56.951289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:56.969039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.969541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.970405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:56.975655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:56.976519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:56.977303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:57.247761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:57.272807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:57.280674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:57.280674 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-215332aa-3f37-4e85-9b6e-4cafba97d3c3 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1551 microversion: 2.26 time: 0.368975 Oct 17 16:05:57.299801 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3181/6109] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:56 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1551 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:57.521333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:57.522583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:57.561185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:57.562118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:57.596978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:57.598320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:57.603936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:57.604390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:58.250192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:58.278652 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ec411e5-ed06-44e9-995a-f22cf6b7952a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1767 microversion: 2.1 time: 0.764763 Oct 17 16:05:58.290530 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3182/6110] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:57 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1767 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:58.311775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:58.314792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:58.333625 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5c4e99c-43bd-473d-8cfd-464166288403 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1465 microversion: 2.1 time: 1.747720 Oct 17 16:05:58.339632 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2929/6111] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:56 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1465 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:05:58.354711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:58.355639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:58.356444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:58.357729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:58.358660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:58.359425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:58.892501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:58.919503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:58.921278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:05:58.922796 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cae4fa8c-4444-4e87-aa7c-8df862ee961e tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1551 microversion: 2.26 time: 0.618377 Oct 17 16:05:58.938534 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3183/6112] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:05:58 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1551 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:05:59.307732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:59.308767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:59.324135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:59.327752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:59.328452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:59.334430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:59.335669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:59.336309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:59.361311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-feceaf36-cc45-4580-9f71-21b68323e97d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:05:59.364486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-feceaf36-cc45-4580-9f71-21b68323e97d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:05:59.385093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feceaf36-cc45-4580-9f71-21b68323e97d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:59.391833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feceaf36-cc45-4580-9f71-21b68323e97d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:59.395490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feceaf36-cc45-4580-9f71-21b68323e97d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:59.398188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feceaf36-cc45-4580-9f71-21b68323e97d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:05:59.403585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feceaf36-cc45-4580-9f71-21b68323e97d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:05:59.405480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-feceaf36-cc45-4580-9f71-21b68323e97d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:05:59.972082 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-feceaf36-cc45-4580-9f71-21b68323e97d tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1651 microversion: 2.1 time: 0.613247 Oct 17 16:05:59.973368 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3184/6113] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:59 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1651 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:05:59.988286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-06ff56cb-615b-4790-aa5d-58bd1bc67dfc req-3d577a22-e5d3-4843-9c90-7be69da0cf61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cf4211-fb38-441c-963b-8021fb0d83c2", "name": "network-vif-deleted", "tag": "6dcf2d57-53a7-4d31-84b7-074dfc475548"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:06:00.016263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-06ff56cb-615b-4790-aa5d-58bd1bc67dfc req-3d577a22-e5d3-4843-9c90-7be69da0cf61 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:00.016783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-06ff56cb-615b-4790-aa5d-58bd1bc67dfc req-3d577a22-e5d3-4843-9c90-7be69da0cf61 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:00.017218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-06ff56cb-615b-4790-aa5d-58bd1bc67dfc req-3d577a22-e5d3-4843-9c90-7be69da0cf61 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:00.066209 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-06ff56cb-615b-4790-aa5d-58bd1bc67dfc req-3d577a22-e5d3-4843-9c90-7be69da0cf61 service nova] Creating event network-vif-deleted:6dcf2d57-53a7-4d31-84b7-074dfc475548 for instance c5cf4211-fb38-441c-963b-8021fb0d83c2 on n-h1-854441-12 Oct 17 16:06:00.076931 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-06ff56cb-615b-4790-aa5d-58bd1bc67dfc req-3d577a22-e5d3-4843-9c90-7be69da0cf61 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100760 Oct 17 16:06:00.078003 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3185/6114] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:06:00.088850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:00.091088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:00.106213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:00.106750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:00.107196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:00.108127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:00.108617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:00.109056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:00.210360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:00.210904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:00.211351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:00.211811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lazy-loading 'fault' on Instance uuid c5cf4211-fb38-441c-963b-8021fb0d83c2 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:06:00.289242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:06:00.313609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:06:00.315203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6071f4123d964b668c4c6361472a849c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daaa81667d441fc8ec7da0edc22b89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:06:00.316485 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7ddf2ad-94e0-4daf-a8b0-7464cc21841f tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 200 len: 1352 microversion: 2.26 time: 0.236773 Oct 17 16:06:00.317080 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3186/6115] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:06:00 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 1352 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 16:06:00.340042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd59bc34-ca92-4fa1-b6da-6f37f60a33c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:00.340650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd59bc34-ca92-4fa1-b6da-6f37f60a33c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:00.367040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd59bc34-ca92-4fa1-b6da-6f37f60a33c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:00.379336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd59bc34-ca92-4fa1-b6da-6f37f60a33c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:00.380440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd59bc34-ca92-4fa1-b6da-6f37f60a33c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:00.381755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd59bc34-ca92-4fa1-b6da-6f37f60a33c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:00.386252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd59bc34-ca92-4fa1-b6da-6f37f60a33c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:00.387284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd59bc34-ca92-4fa1-b6da-6f37f60a33c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:00.733948 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd59bc34-ca92-4fa1-b6da-6f37f60a33c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1651 microversion: 2.1 time: 0.410955 Oct 17 16:06:00.746305 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3187/6116] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:00 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1651 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:00.783653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84d26fb3-75aa-47ec-b27c-9872d4f5736c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:00.784679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84d26fb3-75aa-47ec-b27c-9872d4f5736c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:00.800363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d26fb3-75aa-47ec-b27c-9872d4f5736c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:00.801369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d26fb3-75aa-47ec-b27c-9872d4f5736c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:00.802056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d26fb3-75aa-47ec-b27c-9872d4f5736c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:00.804375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d26fb3-75aa-47ec-b27c-9872d4f5736c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:00.806106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d26fb3-75aa-47ec-b27c-9872d4f5736c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:00.807613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d26fb3-75aa-47ec-b27c-9872d4f5736c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:01.206938 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84d26fb3-75aa-47ec-b27c-9872d4f5736c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1651 microversion: 2.1 time: 0.427442 Oct 17 16:06:01.210888 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3188/6117] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:00 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1651 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:06:01.298312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaef713dfc34b7ba9423de7ff0e541e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb82fb6ad5c34026b9cefcd474f1318a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:06:01.308403 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-049ce270-2dc6-4a32-85a9-ee7eaca64568 tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 200 len: 1767 microversion: 2.1 time: 2.005949 Oct 17 16:06:01.319244 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2930/6118] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:05:59 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 1767 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:06:01.368100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:01.371123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] [instance: c5cf4211-fb38-441c-963b-8021fb0d83c2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:01.390804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:01.395087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:01.395726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:01.397294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:01.397801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:01.398236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:01.448215 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] HTTP exception thrown: Instance c5cf4211-fb38-441c-963b-8021fb0d83c2 could not be found. Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Request method failure captured: Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 HTTP/1.1 Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX1BZaxbwE1dYawQ2abK6tl9MNVWhK5zLhRFBbrcjsVk12DIb8Qkj0s_gslLtqDRaa8_n8BPR1f0gHVRe8C-YZfsR4gV9vRMAcxefTDmxlUnzuredY0SHF1vVNdaP9px0CbR2l_mNVT2HGkVXl--n0BsO78qzJorY5Sr6pwopj9WJc4 Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Openstack-Nova-Api-Version: 2.26 Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8daaa81667d441fc8ec7da0edc22b89b Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerTagsTestJSON-1631782497 Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8daaa81667d441fc8ec7da0edc22b89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8daaa81667d441fc8ec7da0edc22b89b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8daaa81667d441fc8ec7da0edc22b89b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8daaa81667d441fc8ec7da0edc22b89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerTagsTestJSON-1631782497 Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8daaa81667d441fc8ec7da0edc22b89b Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerTagsTestJSON-1631782497 Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerTagsTestJSON-1631782497-project Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6071f4123d964b668c4c6361472a849c Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerTagsTestJSON-1631782497-project Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance c5cf4211-fb38-441c-963b-8021fb0d83c2 could not be found. Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'c5cf4211-fb38-441c-963b-8021fb0d83c2'} Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cf4211-fb38-441c-963b-8021fb0d83c2 could not be found. Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cf4211-fb38-441c-963b-8021fb0d83c2 could not be found. Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:06:01.450050 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:01.458726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:01.458726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:06:01.458726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:06:01.458726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:06:01.458726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:06:01.458726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cf4211-fb38-441c-963b-8021fb0d83c2 could not be found. Oct 17 16:06:01.458726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:01.478529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] Returning 404 to user: Instance c5cf4211-fb38-441c-963b-8021fb0d83c2 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:06:01.478529 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-749df93b-d8ac-4668-ae1d-b7fb91abb438 tempest-ServerTagsTestJSON-1631782497 tempest-ServerTagsTestJSON-1631782497-project] 10.222.0.87 "GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2" status: 404 len: 111 microversion: 2.26 time: 0.105577 Oct 17 16:06:01.478529 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3189/6119] 10.222.0.87 () {60 vars in 1277 bytes} [Mon Oct 17 16:06:01 2022] GET /compute/v2.1/servers/c5cf4211-fb38-441c-963b-8021fb0d83c2 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 16:06:01.669694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1359146061", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "availability_zone": "nova:n-h1-854441-12", "networks": [{"uuid": "f33a17ba-528c-47b4-b0f5-299cf38dd924"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:06:01.826979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] validate_networks() for [('f33a17ba-528c-47b4-b0f5-299cf38dd924', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:06:02.120423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-59d3c30c-0f67-4936-81f4-32a0d0c4d6c4 req-884e7a2a-487b-45a3-8546-67316586eecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a53040-8109-486b-bdb1-1f0a8c4c00f0", "name": "network-vif-deleted", "tag": "0d0426cf-e695-4e14-800c-a59e2e138599"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:06:02.143261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59d3c30c-0f67-4936-81f4-32a0d0c4d6c4 req-884e7a2a-487b-45a3-8546-67316586eecb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:02.143769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59d3c30c-0f67-4936-81f4-32a0d0c4d6c4 req-884e7a2a-487b-45a3-8546-67316586eecb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:02.144203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59d3c30c-0f67-4936-81f4-32a0d0c4d6c4 req-884e7a2a-487b-45a3-8546-67316586eecb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:02.176111 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-59d3c30c-0f67-4936-81f4-32a0d0c4d6c4 req-884e7a2a-487b-45a3-8546-67316586eecb service nova] Creating event network-vif-deleted:0d0426cf-e695-4e14-800c-a59e2e138599 for instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 on n-h1-854441-12 Oct 17 16:06:02.186796 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-59d3c30c-0f67-4936-81f4-32a0d0c4d6c4 req-884e7a2a-487b-45a3-8546-67316586eecb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070757 Oct 17 16:06:02.187722 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3190/6120] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:06:02.349488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:02.350212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] [instance: 63a53040-8109-486b-bdb1-1f0a8c4c00f0] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:02.369829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:02.370574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:02.370774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:02.374449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:02.376611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:02.378022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:02.426030 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] HTTP exception thrown: Instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 could not be found. Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Request method failure captured: Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 HTTP/1.1 Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTXx-nV-Nb_yvjLJ08-3Axgyptfg-GV3bu5Ef8895NZJZsK2LzhDKQqMV1oru8FLzpE2p0OejZJd_tBu4zN83wYmbHVsPmumWhTBG0xXM43-R2tYDTCy0fk0EPMjMMSRtvTUNQbi00RXyPHUuQRmR2WCO7FgsLz4j24VpcOOA6XolqR0 Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: eb82fb6ad5c34026b9cefcd474f1318a Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-288841089 Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/eb82fb6ad5c34026b9cefcd474f1318a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/eb82fb6ad5c34026b9cefcd474f1318a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_eb82fb6ad5c34026b9cefcd474f1318a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/eb82fb6ad5c34026b9cefcd474f1318a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestSecurityGroupsBasicOps-288841089 Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: eb82fb6ad5c34026b9cefcd474f1318a Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-288841089 Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestSecurityGroupsBasicOps-288841089-project Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 0aaef713dfc34b7ba9423de7ff0e541e Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestSecurityGroupsBasicOps-288841089-project Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 could not be found. Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '63a53040-8109-486b-bdb1-1f0a8c4c00f0'} Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 could not be found. Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 could not be found. Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:06:02.427805 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:02.438707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:02.438707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:06:02.438707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:06:02.438707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:06:02.438707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:06:02.438707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 could not be found. Oct 17 16:06:02.438707 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:06:02.441111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Returning 404 to user: Instance 63a53040-8109-486b-bdb1-1f0a8c4c00f0 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:06:02.442033 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb1bbfd1-fea2-4bce-8155-d3044793c32a tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0" status: 404 len: 111 microversion: 2.1 time: 0.097681 Oct 17 16:06:02.442972 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3191/6121] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:02 2022] GET /compute/v2.1/servers/63a53040-8109-486b-bdb1-1f0a8c4c00f0 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:06:04.603360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:06:04.604600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:06:04.605313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:06:04.605946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:06:04.606650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:06:04.631250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:04.631991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:04.632516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:04.633432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:04.634105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:04.634713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:04.686158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Getting quotas for project 0b113393c1ca4f99b530ce65f45c9a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:06:04.701308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Getting quotas for user e511a2b4568445659ac9e83193c8a825 and project 0b113393c1ca4f99b530ce65f45c9a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:06:04.731038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:06:04.733938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:06:04.867122 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-303912cd-b6a9-4292-b13d-3304add94bdd tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.200849 Oct 17 16:06:04.868244 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2931/6122] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:06:04.881448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f949504-bfea-458f-a1fc-69feb5837b4c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:04.882109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f949504-bfea-458f-a1fc-69feb5837b4c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:04.885764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:06:05.018211 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f949504-bfea-458f-a1fc-69feb5837b4c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1329 microversion: 2.1 time: 0.141013 Oct 17 16:06:05.023293 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3192/6123] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:04 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1329 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:06.051418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e4a00fbd-c6d9-46f8-b10d-3085772b83a7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:06.052161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e4a00fbd-c6d9-46f8-b10d-3085772b83a7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:06.082357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4a00fbd-c6d9-46f8-b10d-3085772b83a7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:06.083006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4a00fbd-c6d9-46f8-b10d-3085772b83a7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:06.083471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4a00fbd-c6d9-46f8-b10d-3085772b83a7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:06.084289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4a00fbd-c6d9-46f8-b10d-3085772b83a7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:06.084759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4a00fbd-c6d9-46f8-b10d-3085772b83a7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:06.085193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4a00fbd-c6d9-46f8-b10d-3085772b83a7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:06.723507 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e4a00fbd-c6d9-46f8-b10d-3085772b83a7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1338 microversion: 2.1 time: 0.671206 Oct 17 16:06:06.738795 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2932/6124] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:06 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1338 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:06:07.773486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b7a30c7-dbe3-4b47-8bdb-0239d10ea241 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:07.786777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b7a30c7-dbe3-4b47-8bdb-0239d10ea241 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:07.824257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7a30c7-dbe3-4b47-8bdb-0239d10ea241 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:07.825064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7a30c7-dbe3-4b47-8bdb-0239d10ea241 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:07.825853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7a30c7-dbe3-4b47-8bdb-0239d10ea241 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:07.845150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7a30c7-dbe3-4b47-8bdb-0239d10ea241 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:07.846269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7a30c7-dbe3-4b47-8bdb-0239d10ea241 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:07.847088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b7a30c7-dbe3-4b47-8bdb-0239d10ea241 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:08.606181 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b7a30c7-dbe3-4b47-8bdb-0239d10ea241 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1424 microversion: 2.1 time: 0.844115 Oct 17 16:06:08.611141 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3193/6125] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:07 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1424 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:09.646835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fdf5ee4c-22f8-46c0-b457-3fa468f9a1f9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:09.652167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fdf5ee4c-22f8-46c0-b457-3fa468f9a1f9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:09.697903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdf5ee4c-22f8-46c0-b457-3fa468f9a1f9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:09.704470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdf5ee4c-22f8-46c0-b457-3fa468f9a1f9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:09.705711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdf5ee4c-22f8-46c0-b457-3fa468f9a1f9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:09.710609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdf5ee4c-22f8-46c0-b457-3fa468f9a1f9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:09.711988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdf5ee4c-22f8-46c0-b457-3fa468f9a1f9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:09.724196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdf5ee4c-22f8-46c0-b457-3fa468f9a1f9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:10.040695 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fdf5ee4c-22f8-46c0-b457-3fa468f9a1f9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1424 microversion: 2.1 time: 0.400932 Oct 17 16:06:10.042625 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2933/6126] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:09 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1424 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:11.070170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2da56aad-462e-4006-b2ce-697a7d3203ae tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:11.071602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2da56aad-462e-4006-b2ce-697a7d3203ae tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:11.085906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da56aad-462e-4006-b2ce-697a7d3203ae tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:11.094035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da56aad-462e-4006-b2ce-697a7d3203ae tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:11.094911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da56aad-462e-4006-b2ce-697a7d3203ae tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:11.096453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da56aad-462e-4006-b2ce-697a7d3203ae tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:11.097642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da56aad-462e-4006-b2ce-697a7d3203ae tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:11.101291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da56aad-462e-4006-b2ce-697a7d3203ae tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:13.624459 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2da56aad-462e-4006-b2ce-697a7d3203ae tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1466 microversion: 2.1 time: 2.558100 Oct 17 16:06:13.630136 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3194/6127] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:11 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1466 bytes in 2564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:06:14.659584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3174b20-bf36-4393-8550-361f0c1db37c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:14.660485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b3174b20-bf36-4393-8550-361f0c1db37c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:14.664531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:06:14.675192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3174b20-bf36-4393-8550-361f0c1db37c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:14.675712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3174b20-bf36-4393-8550-361f0c1db37c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:14.676161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3174b20-bf36-4393-8550-361f0c1db37c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:14.676932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3174b20-bf36-4393-8550-361f0c1db37c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:14.677649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3174b20-bf36-4393-8550-361f0c1db37c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:14.685782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3174b20-bf36-4393-8550-361f0c1db37c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:14.713174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:06:15.835206 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3174b20-bf36-4393-8550-361f0c1db37c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1466 microversion: 2.1 time: 1.176268 Oct 17 16:06:15.851857 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2934/6128] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:14 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1466 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:16.865866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1aa6ad2e-9ac8-4cd1-ab43-92f23efca283 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:16.866720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1aa6ad2e-9ac8-4cd1-ab43-92f23efca283 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:16.881717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:06:16.894894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa6ad2e-9ac8-4cd1-ab43-92f23efca283 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:16.897164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa6ad2e-9ac8-4cd1-ab43-92f23efca283 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:16.897707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa6ad2e-9ac8-4cd1-ab43-92f23efca283 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:16.898493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa6ad2e-9ac8-4cd1-ab43-92f23efca283 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:16.899015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa6ad2e-9ac8-4cd1-ab43-92f23efca283 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:16.899461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1aa6ad2e-9ac8-4cd1-ab43-92f23efca283 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:18.363561 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1aa6ad2e-9ac8-4cd1-ab43-92f23efca283 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1466 microversion: 2.1 time: 1.503956 Oct 17 16:06:18.369271 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3195/6129] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:16 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1466 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:19.219571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d275083d-0465-4145-b237-06292de2c38c req-188ea928-3799-4867-9a23-1d533dc994f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68", "tag": "c7b33149-9808-4fa6-9faa-c37bd289b169"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:06:19.296442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d275083d-0465-4145-b237-06292de2c38c req-188ea928-3799-4867-9a23-1d533dc994f7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:19.296945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d275083d-0465-4145-b237-06292de2c38c req-188ea928-3799-4867-9a23-1d533dc994f7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:19.297391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d275083d-0465-4145-b237-06292de2c38c req-188ea928-3799-4867-9a23-1d533dc994f7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:19.320187 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d275083d-0465-4145-b237-06292de2c38c req-188ea928-3799-4867-9a23-1d533dc994f7 service nova] Creating event network-changed:c7b33149-9808-4fa6-9faa-c37bd289b169 for instance c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 on n-h1-854441-12 Oct 17 16:06:19.331050 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d275083d-0465-4145-b237-06292de2c38c req-188ea928-3799-4867-9a23-1d533dc994f7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127496 Oct 17 16:06:19.349635 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2935/6130] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:06:19.396696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68a4358d-09c2-40ad-bf7e-6019a94081cc tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:19.400270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68a4358d-09c2-40ad-bf7e-6019a94081cc tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:19.460057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a4358d-09c2-40ad-bf7e-6019a94081cc tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:19.461007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a4358d-09c2-40ad-bf7e-6019a94081cc tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:19.461695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a4358d-09c2-40ad-bf7e-6019a94081cc tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:19.479871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a4358d-09c2-40ad-bf7e-6019a94081cc tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:19.480837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a4358d-09c2-40ad-bf7e-6019a94081cc tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:19.481630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68a4358d-09c2-40ad-bf7e-6019a94081cc tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:20.599219 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68a4358d-09c2-40ad-bf7e-6019a94081cc tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1466 microversion: 2.1 time: 1.203250 Oct 17 16:06:20.603101 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3196/6131] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:19 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1466 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:21.637473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9c6aed2b-371e-4972-a4e1-e154670bdeff tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:21.639359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9c6aed2b-371e-4972-a4e1-e154670bdeff tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:21.683799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c6aed2b-371e-4972-a4e1-e154670bdeff tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:21.683799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c6aed2b-371e-4972-a4e1-e154670bdeff tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:21.683799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c6aed2b-371e-4972-a4e1-e154670bdeff tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:21.687419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c6aed2b-371e-4972-a4e1-e154670bdeff tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:21.688274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c6aed2b-371e-4972-a4e1-e154670bdeff tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:21.689047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9c6aed2b-371e-4972-a4e1-e154670bdeff tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:21.797405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:06:21.860142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-80d50c0b-9d29-4f3e-97c0-dbec41ddd46d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] Calling method '.version_select at 0x7f28bd72f5e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:21.911623 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-80d50c0b-9d29-4f3e-97c0-dbec41ddd46d tempest-TestSecurityGroupsBasicOps-288841089 tempest-TestSecurityGroupsBasicOps-288841089-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1204053788" status: 202 len: 0 microversion: 2.1 time: 0.059972 Oct 17 16:06:21.917741 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3197/6132] 10.222.0.87 () {58 vars in 1278 bytes} [Mon Oct 17 16:06:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1204053788 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 16:06:22.310067 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9c6aed2b-371e-4972-a4e1-e154670bdeff tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1466 microversion: 2.1 time: 0.680309 Oct 17 16:06:22.334807 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2936/6133] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:21 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1466 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:23.340450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6c97204-a9cf-404c-ae66-5f1ba7236dc4 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:23.341468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6c97204-a9cf-404c-ae66-5f1ba7236dc4 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:23.355893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c97204-a9cf-404c-ae66-5f1ba7236dc4 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:23.356404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c97204-a9cf-404c-ae66-5f1ba7236dc4 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:23.356848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c97204-a9cf-404c-ae66-5f1ba7236dc4 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:23.371113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c97204-a9cf-404c-ae66-5f1ba7236dc4 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:23.371618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c97204-a9cf-404c-ae66-5f1ba7236dc4 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:23.372066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6c97204-a9cf-404c-ae66-5f1ba7236dc4 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:24.059625 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6c97204-a9cf-404c-ae66-5f1ba7236dc4 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1466 microversion: 2.1 time: 0.716521 Oct 17 16:06:24.060321 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3198/6134] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:23 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1466 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:25.094903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-feb77eaa-5f1b-46e6-96dd-7bbb1e6b1bc7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:25.096529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-feb77eaa-5f1b-46e6-96dd-7bbb1e6b1bc7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:25.100355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:06:25.109736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-feb77eaa-5f1b-46e6-96dd-7bbb1e6b1bc7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:25.110657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-feb77eaa-5f1b-46e6-96dd-7bbb1e6b1bc7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:25.111372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-feb77eaa-5f1b-46e6-96dd-7bbb1e6b1bc7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:25.112422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-feb77eaa-5f1b-46e6-96dd-7bbb1e6b1bc7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:25.113324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-feb77eaa-5f1b-46e6-96dd-7bbb1e6b1bc7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:25.113970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-feb77eaa-5f1b-46e6-96dd-7bbb1e6b1bc7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:25.343453 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-feb77eaa-5f1b-46e6-96dd-7bbb1e6b1bc7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1466 microversion: 2.1 time: 0.258836 Oct 17 16:06:25.366878 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2937/6135] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:25 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1466 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:25.760127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1bf4d18b-d488-41fa-86d2-e4acf219e340 req-4bc8f3e7-f475-47fc-b5dc-ce102f28d2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68", "name": "network-vif-plugged", "status": "completed", "tag": "c7b33149-9808-4fa6-9faa-c37bd289b169"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:06:25.782168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1bf4d18b-d488-41fa-86d2-e4acf219e340 req-4bc8f3e7-f475-47fc-b5dc-ce102f28d2ce service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:25.782744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1bf4d18b-d488-41fa-86d2-e4acf219e340 req-4bc8f3e7-f475-47fc-b5dc-ce102f28d2ce service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:25.783186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1bf4d18b-d488-41fa-86d2-e4acf219e340 req-4bc8f3e7-f475-47fc-b5dc-ce102f28d2ce service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:25.800191 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1bf4d18b-d488-41fa-86d2-e4acf219e340 req-4bc8f3e7-f475-47fc-b5dc-ce102f28d2ce service nova] Creating event network-vif-plugged:c7b33149-9808-4fa6-9faa-c37bd289b169 for instance c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 on n-h1-854441-12 Oct 17 16:06:25.806237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1bf4d18b-d488-41fa-86d2-e4acf219e340 req-4bc8f3e7-f475-47fc-b5dc-ce102f28d2ce service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049939 Oct 17 16:06:25.807510 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3199/6136] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:06:26.376341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bcb9fd40-752b-44fe-86ee-7342ce3cf098 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:26.378381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bcb9fd40-752b-44fe-86ee-7342ce3cf098 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:26.412912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcb9fd40-752b-44fe-86ee-7342ce3cf098 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:26.415094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcb9fd40-752b-44fe-86ee-7342ce3cf098 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:26.417760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcb9fd40-752b-44fe-86ee-7342ce3cf098 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:26.423300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcb9fd40-752b-44fe-86ee-7342ce3cf098 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:26.432623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcb9fd40-752b-44fe-86ee-7342ce3cf098 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:26.434015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bcb9fd40-752b-44fe-86ee-7342ce3cf098 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:26.962938 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bcb9fd40-752b-44fe-86ee-7342ce3cf098 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1466 microversion: 2.1 time: 0.592150 Oct 17 16:06:26.964689 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2938/6137] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:26 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1466 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:28.006193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b41f331-f082-496a-b047-86fa273111b9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:28.008235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b41f331-f082-496a-b047-86fa273111b9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:28.040595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b41f331-f082-496a-b047-86fa273111b9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:28.042650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b41f331-f082-496a-b047-86fa273111b9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:28.044083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b41f331-f082-496a-b047-86fa273111b9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:28.045271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b41f331-f082-496a-b047-86fa273111b9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:28.047930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b41f331-f082-496a-b047-86fa273111b9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:28.050556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b41f331-f082-496a-b047-86fa273111b9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:28.064560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:06:28.738327 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b41f331-f082-496a-b047-86fa273111b9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1651 microversion: 2.1 time: 0.746622 Oct 17 16:06:28.763454 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3200/6138] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:27 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1651 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:28.801913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f13d7faa-c402-4771-8f2f-a21d363f5425 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:28.806178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f13d7faa-c402-4771-8f2f-a21d363f5425 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:28.825617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13d7faa-c402-4771-8f2f-a21d363f5425 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:28.829785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13d7faa-c402-4771-8f2f-a21d363f5425 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:28.835627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13d7faa-c402-4771-8f2f-a21d363f5425 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:28.837872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13d7faa-c402-4771-8f2f-a21d363f5425 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:28.844608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13d7faa-c402-4771-8f2f-a21d363f5425 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:28.847662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f13d7faa-c402-4771-8f2f-a21d363f5425 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:29.406134 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f13d7faa-c402-4771-8f2f-a21d363f5425 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1651 microversion: 2.1 time: 0.633723 Oct 17 16:06:29.423301 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2939/6139] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:28 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1651 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:29.431176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ae67341-6da9-4ef7-a83d-d087a7e05626 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:29.433041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ae67341-6da9-4ef7-a83d-d087a7e05626 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:29.450965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ae67341-6da9-4ef7-a83d-d087a7e05626 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:29.452069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ae67341-6da9-4ef7-a83d-d087a7e05626 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:29.453062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ae67341-6da9-4ef7-a83d-d087a7e05626 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:29.454000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ae67341-6da9-4ef7-a83d-d087a7e05626 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:29.455175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ae67341-6da9-4ef7-a83d-d087a7e05626 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:29.457111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ae67341-6da9-4ef7-a83d-d087a7e05626 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:29.692738 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ae67341-6da9-4ef7-a83d-d087a7e05626 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1651 microversion: 2.1 time: 0.266771 Oct 17 16:06:29.693848 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3201/6140] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:29 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1651 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:29.736574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:29.741402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:29.770112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:29.771536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:29.772589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:29.777660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:29.778895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:29.780003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:29.861466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:06:30.173734 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-05ffedd0-f7eb-430a-a890-343442aaa230 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "DELETE /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 204 len: 0 microversion: 2.1 time: 0.453937 Oct 17 16:06:30.180098 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2940/6141] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:06:29 2022] DELETE /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:06:30.190624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9be7aaad-76cd-4b60-adeb-3af983ba746c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:30.191337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9be7aaad-76cd-4b60-adeb-3af983ba746c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:30.206945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9be7aaad-76cd-4b60-adeb-3af983ba746c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:30.207655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9be7aaad-76cd-4b60-adeb-3af983ba746c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:30.208262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9be7aaad-76cd-4b60-adeb-3af983ba746c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:30.209204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9be7aaad-76cd-4b60-adeb-3af983ba746c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:30.209845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9be7aaad-76cd-4b60-adeb-3af983ba746c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:30.210429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9be7aaad-76cd-4b60-adeb-3af983ba746c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:30.520172 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9be7aaad-76cd-4b60-adeb-3af983ba746c tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1657 microversion: 2.1 time: 0.333712 Oct 17 16:06:30.525261 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3202/6142] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:30 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1657 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:31.571473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bf5b0da5-beb0-4241-8b01-bbc342e6cbd7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:31.574094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bf5b0da5-beb0-4241-8b01-bbc342e6cbd7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:31.590098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0da5-beb0-4241-8b01-bbc342e6cbd7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:31.591383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0da5-beb0-4241-8b01-bbc342e6cbd7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:31.592520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0da5-beb0-4241-8b01-bbc342e6cbd7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:31.594199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0da5-beb0-4241-8b01-bbc342e6cbd7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:31.599817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0da5-beb0-4241-8b01-bbc342e6cbd7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:31.606787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0da5-beb0-4241-8b01-bbc342e6cbd7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:32.538719 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bf5b0da5-beb0-4241-8b01-bbc342e6cbd7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1657 microversion: 2.1 time: 0.975945 Oct 17 16:06:32.539370 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2941/6143] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:31 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1657 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:33.585917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a0e9bee-b93d-41bb-aa43-3b3b751e2a58 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:33.586640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a0e9bee-b93d-41bb-aa43-3b3b751e2a58 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:33.614086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a0e9bee-b93d-41bb-aa43-3b3b751e2a58 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:33.617039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a0e9bee-b93d-41bb-aa43-3b3b751e2a58 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:33.617513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a0e9bee-b93d-41bb-aa43-3b3b751e2a58 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:33.621084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a0e9bee-b93d-41bb-aa43-3b3b751e2a58 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:33.624128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a0e9bee-b93d-41bb-aa43-3b3b751e2a58 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:33.625246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a0e9bee-b93d-41bb-aa43-3b3b751e2a58 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:33.926455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c00cbe90-8bdf-4e36-94ec-ff3c034e8e76 req-66be077f-823d-44d3-a069-ac3f9a31fe02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68", "name": "network-vif-deleted", "tag": "c7b33149-9808-4fa6-9faa-c37bd289b169"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:06:33.963208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c00cbe90-8bdf-4e36-94ec-ff3c034e8e76 req-66be077f-823d-44d3-a069-ac3f9a31fe02 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:33.963719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c00cbe90-8bdf-4e36-94ec-ff3c034e8e76 req-66be077f-823d-44d3-a069-ac3f9a31fe02 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:33.964325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c00cbe90-8bdf-4e36-94ec-ff3c034e8e76 req-66be077f-823d-44d3-a069-ac3f9a31fe02 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:34.006637 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c00cbe90-8bdf-4e36-94ec-ff3c034e8e76 req-66be077f-823d-44d3-a069-ac3f9a31fe02 service nova] Creating event network-vif-deleted:c7b33149-9808-4fa6-9faa-c37bd289b169 for instance c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 on n-h1-854441-12 Oct 17 16:06:34.023373 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c00cbe90-8bdf-4e36-94ec-ff3c034e8e76 req-66be077f-823d-44d3-a069-ac3f9a31fe02 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097998 Oct 17 16:06:34.025764 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2942/6144] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:06:34.066548 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a0e9bee-b93d-41bb-aa43-3b3b751e2a58 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 200 len: 1615 microversion: 2.1 time: 0.475538 Oct 17 16:06:34.081744 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3203/6145] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:33 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 1615 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:35.091947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:35.092984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:35.110277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:35.110913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:35.111569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:35.113297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:35.119265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:35.124749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:35.196579 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] HTTP exception thrown: Instance c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 could not be found. Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Request method failure captured: Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 HTTP/1.1 Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX1LYjp1g3y3-ijkkQNdh5PAQ3APw3izQ73QywZFqZDpEh8i51J_bZIex0y9IkDyzTqsVm0o0oN_4uldt_HlxQnZNfxefTPrinwJTr570jRRrrAx4cXjXGUlOcJii8Q0nx23KGXn12iR_eM6Jty--aJR61U06omhnr3Ph_lD3kumuwg Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 0b113393c1ca4f99b530ce65f45c9a0b Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestServerMultinode-356781184 Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0b113393c1ca4f99b530ce65f45c9a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0b113393c1ca4f99b530ce65f45c9a0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0b113393c1ca4f99b530ce65f45c9a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0b113393c1ca4f99b530ce65f45c9a0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestServerMultinode-356781184 Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 0b113393c1ca4f99b530ce65f45c9a0b Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestServerMultinode-356781184 Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestServerMultinode-356781184-project-admin Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e511a2b4568445659ac9e83193c8a825 Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestServerMultinode-356781184-project-admin Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 could not be found. Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68'} Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 could not be found. Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 could not be found. Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:06:35.198411 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:35.202397 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:35.202397 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:06:35.202397 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:06:35.202397 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:06:35.202397 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:06:35.202397 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 could not be found. Oct 17 16:06:35.202397 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:35.202397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Returning 404 to user: Instance c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:06:35.202397 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff6eee78-34cf-46cc-b6b1-8b153913c5f7 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68" status: 404 len: 111 microversion: 2.1 time: 0.112842 Oct 17 16:06:35.203153 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2943/6146] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:35 2022] GET /compute/v2.1/servers/c2cdf629-2dad-4ff2-81a6-a0dcd6fdac68 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:06:35.219763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:35.221724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:35.228504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:06:35.236712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:35.237499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:35.238123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:35.239087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:35.239768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:35.240363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:35.274305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:06:35.439266 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bde40750-841a-4676-8242-5a75cc3a4e0b tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "DELETE /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 204 len: 0 microversion: 2.1 time: 0.229884 Oct 17 16:06:35.441787 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3204/6147] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:06:35 2022] DELETE /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:06:35.453269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c606d8e7-8f38-46e0-8ac6-9a19aad1167e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:35.454213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c606d8e7-8f38-46e0-8ac6-9a19aad1167e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:35.473256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c606d8e7-8f38-46e0-8ac6-9a19aad1167e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:35.475378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c606d8e7-8f38-46e0-8ac6-9a19aad1167e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:35.475767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c606d8e7-8f38-46e0-8ac6-9a19aad1167e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:35.476809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c606d8e7-8f38-46e0-8ac6-9a19aad1167e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:35.477329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c606d8e7-8f38-46e0-8ac6-9a19aad1167e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:35.487417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c606d8e7-8f38-46e0-8ac6-9a19aad1167e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:35.697231 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c606d8e7-8f38-46e0-8ac6-9a19aad1167e tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1657 microversion: 2.1 time: 0.248283 Oct 17 16:06:35.698990 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2944/6148] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:35 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1657 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:36.751126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-81117b14-2c8a-49b2-9bcc-f228500e9550 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:36.752544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-81117b14-2c8a-49b2-9bcc-f228500e9550 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:36.766326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81117b14-2c8a-49b2-9bcc-f228500e9550 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:36.770327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81117b14-2c8a-49b2-9bcc-f228500e9550 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:36.771909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81117b14-2c8a-49b2-9bcc-f228500e9550 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:36.773722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81117b14-2c8a-49b2-9bcc-f228500e9550 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:36.775790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81117b14-2c8a-49b2-9bcc-f228500e9550 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:36.779342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-81117b14-2c8a-49b2-9bcc-f228500e9550 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:37.951442 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-81117b14-2c8a-49b2-9bcc-f228500e9550 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1657 microversion: 2.1 time: 1.201301 Oct 17 16:06:37.970190 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3205/6149] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:36 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1657 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:38.345227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-64f7f764-ca2c-4e64-bf29-ca4007a05b54 req-b79bc2dd-9edc-483b-9f6b-c37dfe3e2402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62584422-5f2f-49ba-898c-917b512f3034", "name": "network-vif-deleted", "tag": "143c30c1-7da4-4b67-b79e-a73f3278781c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:06:38.392449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-64f7f764-ca2c-4e64-bf29-ca4007a05b54 req-b79bc2dd-9edc-483b-9f6b-c37dfe3e2402 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:38.393756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-64f7f764-ca2c-4e64-bf29-ca4007a05b54 req-b79bc2dd-9edc-483b-9f6b-c37dfe3e2402 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:38.398774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-64f7f764-ca2c-4e64-bf29-ca4007a05b54 req-b79bc2dd-9edc-483b-9f6b-c37dfe3e2402 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:38.480482 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-64f7f764-ca2c-4e64-bf29-ca4007a05b54 req-b79bc2dd-9edc-483b-9f6b-c37dfe3e2402 service nova] Creating event network-vif-deleted:143c30c1-7da4-4b67-b79e-a73f3278781c for instance 62584422-5f2f-49ba-898c-917b512f3034 on n-h2-854441-12 Oct 17 16:06:38.509303 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-64f7f764-ca2c-4e64-bf29-ca4007a05b54 req-b79bc2dd-9edc-483b-9f6b-c37dfe3e2402 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163806 Oct 17 16:06:38.526686 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2945/6150] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:06:39.010641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:39.011937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:39.057252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:39.059920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:39.060860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:39.065516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:39.066440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:39.081231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:39.154641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:39.155740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:39.157311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:39.158748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lazy-loading 'fault' on Instance uuid 62584422-5f2f-49ba-898c-917b512f3034 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:06:39.250159 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bea42032-705b-4a32-8b83-9ef35f7c2021 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 200 len: 1455 microversion: 2.1 time: 0.243318 Oct 17 16:06:39.286490 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3206/6151] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:39 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 1455 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:06:40.312084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:06:40.313405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] [instance: 62584422-5f2f-49ba-898c-917b512f3034] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:06:40.348439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:40.359799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:40.360508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:40.361886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:06:40.362792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:06:40.363583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:06:40.441373 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] HTTP exception thrown: Instance 62584422-5f2f-49ba-898c-917b512f3034 could not be found. Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Request method failure captured: Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 HTTP/1.1 Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX1LYjp1g3y3-ijkkQNdh5PAQ3APw3izQ73QywZFqZDpEh8i51J_bZIex0y9IkDyzTqsVm0o0oN_4uldt_HlxQnZNfxefTPrinwJTr570jRRrrAx4cXjXGUlOcJii8Q0nx23KGXn12iR_eM6Jty--aJR61U06omhnr3Ph_lD3kumuwg Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 0b113393c1ca4f99b530ce65f45c9a0b Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestServerMultinode-356781184 Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0b113393c1ca4f99b530ce65f45c9a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0b113393c1ca4f99b530ce65f45c9a0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0b113393c1ca4f99b530ce65f45c9a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0b113393c1ca4f99b530ce65f45c9a0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestServerMultinode-356781184 Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 0b113393c1ca4f99b530ce65f45c9a0b Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestServerMultinode-356781184 Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestServerMultinode-356781184-project-admin Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: e511a2b4568445659ac9e83193c8a825 Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestServerMultinode-356781184-project-admin Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 62584422-5f2f-49ba-898c-917b512f3034 could not be found. Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '62584422-5f2f-49ba-898c-917b512f3034'} Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62584422-5f2f-49ba-898c-917b512f3034 could not be found. Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62584422-5f2f-49ba-898c-917b512f3034 could not be found. Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:06:40.444583 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:40.449200 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:06:40.449200 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:06:40.449200 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:06:40.449200 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:06:40.449200 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:06:40.449200 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62584422-5f2f-49ba-898c-917b512f3034 could not be found. Oct 17 16:06:40.449200 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:06:40.449200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] Returning 404 to user: Instance 62584422-5f2f-49ba-898c-917b512f3034 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:06:40.449200 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f92666d-1dfe-4e04-b550-89e9adae41c9 tempest-TestServerMultinode-356781184 tempest-TestServerMultinode-356781184-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034" status: 404 len: 111 microversion: 2.1 time: 0.143731 Oct 17 16:06:40.468136 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2946/6152] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:06:40 2022] GET /compute/v2.1/servers/62584422-5f2f-49ba-898c-917b512f3034 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:07:55.836522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:07:55.837230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:07:55.838873 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 17 16:07:55.860363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1083916597", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "43296f67-cb84-4075-bb4e-d813bf7c1a3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "916c7d18-0cf6-4aa6-bd9b-213b6c12b936"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:07:56.814893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] validate_networks() for [('916c7d18-0cf6-4aa6-bd9b-213b6c12b936', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:07:59.333558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:07:59.334242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:07:59.334528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:07:59.335467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:07:59.336177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:07:59.372548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:07:59.374309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:07:59.376132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:07:59.377319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:07:59.379486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:07:59.379972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:07:59.410855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:07:59.419119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for user a7647fbb42444923aa218f5579dd30a0 and project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:07:59.631903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:07:59.635151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43296f67-cb84-4075-bb4e-d813bf7c1a3d',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:08:00.189359 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a8e5d1d-2e1d-43f8-912e-ec56ad1b0fde tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.354942 Oct 17 16:08:00.191400 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3207/6153] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:07:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:08:00.202829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:08:00.204529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:08:00.210222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b40faaf-21a0-46e2-8b52-a88f4c6c6362 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:00.215755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0b40faaf-21a0-46e2-8b52-a88f4c6c6362 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:01.098823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0b40faaf-21a0-46e2-8b52-a88f4c6c6362 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:01.126165 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b40faaf-21a0-46e2-8b52-a88f4c6c6362 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1057 microversion: 2.1 time: 0.927082 Oct 17 16:08:01.132845 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2947/6154] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:00 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1057 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:08:02.162457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:02.163580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:02.181563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:02.183039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:02.184069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:02.185229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:02.186152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:02.186879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:02.469016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:02.485555 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfb3f5dd-ee9b-4677-8977-02a83f63b9c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1155 microversion: 2.1 time: 0.326147 Oct 17 16:08:02.486262 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3208/6155] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:02 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1155 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:03.533075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:03.534214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:03.575601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:03.585297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:03.588822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:03.589912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:03.590805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:03.593725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:04.555522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:04.588980 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d90188ef-9a17-44e8-b1ee-0c74d63b33c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1173 microversion: 2.1 time: 1.063405 Oct 17 16:08:04.592410 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2948/6156] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:03 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1173 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:05.635673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:05.637096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:05.653848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:05.666753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:05.667345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:05.668297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:05.672027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:05.672825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:06.329970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:06.339509 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-519c0ab4-1fb0-4b28-b764-ccd122b15ffe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1215 microversion: 2.1 time: 0.707841 Oct 17 16:08:06.352181 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3209/6157] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:05 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1215 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:07.375677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:07.376434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:07.389297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:07.391412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:07.392502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:07.393996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:07.397102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:07.397749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:08.035044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-1d692c3d-21c9-4c6e-8094-90beafc351e9 req-a356b12b-b174-40ef-8e1e-da7badc8287a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c8bb46-ac22-4d89-ab14-e2db091e554c", "tag": "3356efbc-e06a-4990-9463-dc4c8920d3da"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:08:08.074579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1d692c3d-21c9-4c6e-8094-90beafc351e9 req-a356b12b-b174-40ef-8e1e-da7badc8287a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:08.075525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1d692c3d-21c9-4c6e-8094-90beafc351e9 req-a356b12b-b174-40ef-8e1e-da7badc8287a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:08.083289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-1d692c3d-21c9-4c6e-8094-90beafc351e9 req-a356b12b-b174-40ef-8e1e-da7badc8287a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:08.116995 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-1d692c3d-21c9-4c6e-8094-90beafc351e9 req-a356b12b-b174-40ef-8e1e-da7badc8287a service nova] Creating event network-changed:3356efbc-e06a-4990-9463-dc4c8920d3da for instance f0c8bb46-ac22-4d89-ab14-e2db091e554c on n-h1-854441-12 Oct 17 16:08:08.131882 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-1d692c3d-21c9-4c6e-8094-90beafc351e9 req-a356b12b-b174-40ef-8e1e-da7badc8287a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100891 Oct 17 16:08:08.139779 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3210/6158] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:08:08.196014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:08.215095 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0236e41d-dfcd-4c7e-a076-a1b9c20def03 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1215 microversion: 2.1 time: 0.843273 Oct 17 16:08:08.220347 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2949/6159] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:07 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1215 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:09.255002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:09.269942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:09.317686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:09.322080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:09.323943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:09.333170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:09.337022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:09.338876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:09.422074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:08:09.457400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:08:10.802229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:10.821522 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9086f325-168f-43e6-8311-5cb446ebc9b5 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1215 microversion: 2.1 time: 1.581620 Oct 17 16:08:10.823841 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3211/6160] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:09 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1215 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:08:11.884245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:11.888079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:11.911183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:08:11.927237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:11.929771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:11.931902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:11.935432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:11.944909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:11.945693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:12.534003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:12.564461 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6a8c45e9-d986-4c28-89e4-2c03d2569b4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1215 microversion: 2.1 time: 0.697796 Oct 17 16:08:12.570803 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2950/6161] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:11 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1215 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:08:13.594887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:13.596165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:13.609263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:13.610110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:13.616398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:13.619889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:13.621188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:13.624317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:14.207018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:14.244738 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-260840a8-0d45-42d9-a1fb-f0746f023eb7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1215 microversion: 2.1 time: 0.648055 Oct 17 16:08:14.247530 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3212/6162] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:13 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1215 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:15.271396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:15.273035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:15.301390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:15.303400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:15.303921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:15.307562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:15.308571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:15.309752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:16.216358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:16.229580 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8456a341-109b-485b-8675-9e76f36fc919 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1215 microversion: 2.1 time: 0.963808 Oct 17 16:08:16.232368 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2951/6163] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:15 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1215 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:08:17.256629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:17.257564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:17.274458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:17.275084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:17.275531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:17.276397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:17.276871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:17.277296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:17.723261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:17.765201 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b76a886-3192-43b7-ae05-d4331f4ff36d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1203 microversion: 2.1 time: 0.511873 Oct 17 16:08:17.769914 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3213/6164] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:17 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1203 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:18.794085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:18.794800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:18.812551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:18.813081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:18.813537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:18.814290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:18.818249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:18.818765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:19.159069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:19.170329 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a4430b96-1678-4db7-8cae-538828239c26 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1203 microversion: 2.1 time: 0.380803 Oct 17 16:08:19.189727 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2952/6165] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:18 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1203 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:20.206617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:20.208563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:20.227297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:20.229641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:20.231399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:20.232864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:20.234426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:20.238002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:20.551792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:20.584525 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-968783b7-45e9-4d96-b901-896676ff40a3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1203 microversion: 2.1 time: 0.389128 Oct 17 16:08:20.603336 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3214/6166] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:20 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1203 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:21.653103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:21.663121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:21.711603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:21.713157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:21.720087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:21.722381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:21.723588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:21.724796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:22.030723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:22.058992 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-088bb68b-fc5a-4709-9acf-26e959b4d87e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1203 microversion: 2.1 time: 0.430767 Oct 17 16:08:22.072855 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2953/6167] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:21 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1203 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:23.120876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:23.135580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:23.160177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:23.168377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:23.169621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:23.172866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:23.174219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:23.177816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:24.302022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:24.323061 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09924a71-1ace-4afc-ab9e-8738fd6a8d5b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1203 microversion: 2.1 time: 1.202679 Oct 17 16:08:24.324576 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3215/6168] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:23 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1203 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:25.349153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:25.350220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:25.364251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:25.365199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:25.368713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:25.370482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:25.371171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:25.375718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:26.500579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:26.528862 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95618e7a-dfd7-4241-9821-3fb580b7b545 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1203 microversion: 2.1 time: 1.179246 Oct 17 16:08:26.533925 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2954/6169] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:25 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1203 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:27.569473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:27.570299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:27.578556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:08:27.609348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:27.613954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:27.617493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:27.619444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:27.624184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:27.627285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:27.733425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=47 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:08:28.089009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:28.129309 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa1f76a8-bfa2-4175-b9bd-63bdf1c4d501 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1203 microversion: 2.1 time: 0.558429 Oct 17 16:08:28.139837 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3216/6170] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:27 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1203 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:28.641459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2b5a6074-30e7-4444-be50-1b7b2f8f45d9 req-a1a0e01a-9053-4903-8689-603ea88eabfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c8bb46-ac22-4d89-ab14-e2db091e554c", "name": "network-vif-plugged", "status": "completed", "tag": "3356efbc-e06a-4990-9463-dc4c8920d3da"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:08:28.688162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2b5a6074-30e7-4444-be50-1b7b2f8f45d9 req-a1a0e01a-9053-4903-8689-603ea88eabfb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:28.689713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2b5a6074-30e7-4444-be50-1b7b2f8f45d9 req-a1a0e01a-9053-4903-8689-603ea88eabfb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:28.690591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2b5a6074-30e7-4444-be50-1b7b2f8f45d9 req-a1a0e01a-9053-4903-8689-603ea88eabfb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:28.738851 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2b5a6074-30e7-4444-be50-1b7b2f8f45d9 req-a1a0e01a-9053-4903-8689-603ea88eabfb service nova] Creating event network-vif-plugged:3356efbc-e06a-4990-9463-dc4c8920d3da for instance f0c8bb46-ac22-4d89-ab14-e2db091e554c on n-h1-854441-12 Oct 17 16:08:28.759080 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2b5a6074-30e7-4444-be50-1b7b2f8f45d9 req-a1a0e01a-9053-4903-8689-603ea88eabfb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132685 Oct 17 16:08:28.761316 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2955/6171] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:08:29.178994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:29.179850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:29.189483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:29.192525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:29.193370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:29.194586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:29.196297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:29.197006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:29.700131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:29.722026 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40e394d6-1f9f-4a2f-80ea-791befd2edbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1203 microversion: 2.1 time: 0.550936 Oct 17 16:08:29.753139 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3217/6172] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:29 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1203 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:08:30.784018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:30.785137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:30.794938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=21 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:08:30.834985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:30.837105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:30.838834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:30.840567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:30.845031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:30.846746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:30.913312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=45 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:08:32.061304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:32.073941 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92461aa7-e023-44a0-b482-02b0cf63cd60 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1389 microversion: 2.1 time: 1.305967 Oct 17 16:08:32.086205 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2956/6173] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:30 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1389 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:32.116733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:32.118430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:32.130491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:32.131355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:32.132346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:32.133631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:32.134710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:32.135419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:32.499649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:32.519328 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7dc32009-3bfc-4101-9917-86a4b5dc3f37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1389 microversion: 2.1 time: 0.410591 Oct 17 16:08:32.548596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:32.549187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:32.553899 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3218/6174] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:32 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1389 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:08:32.575150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:32.577439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:32.578115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:32.582403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:32.583195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:32.588572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:33.119325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:33.137243 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fa100ef3-ef3b-4874-adc4-9cb9610a497c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1389 microversion: 2.1 time: 0.594149 Oct 17 16:08:33.139954 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2957/6175] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:32 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1389 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:33.167196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:33.168449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:33.185876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:33.188648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:33.190791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:33.195229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:33.196034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:33.198663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:33.290475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:08:33.674133 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e25a3a14-ab8f-485c-815f-fc7bb7013293 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 204 len: 0 microversion: 2.1 time: 0.511192 Oct 17 16:08:33.674800 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3219/6176] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:08:33 2022] DELETE /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:08:33.684495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:33.685401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:33.698247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:33.700581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:33.707384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:33.709853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:33.714052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:33.715922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:35.208925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:35.257052 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad3a46c4-fab4-49c0-9698-9340538ee6cb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1395 microversion: 2.1 time: 1.576896 Oct 17 16:08:35.272012 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2958/6177] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:33 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1395 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:36.318783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:36.322839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:36.334862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:36.335918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:36.336763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:36.339225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:36.339955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:36.340903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:36.884561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:36.896666 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84d7ebd9-4cd8-4eab-b11b-618708056bc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1395 microversion: 2.1 time: 0.587563 Oct 17 16:08:36.897864 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3220/6178] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:36 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1395 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:37.880821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-282ecb16-e2d2-473e-8144-75a33936fc97 req-23449fa5-3d7b-4814-9553-d4e2e0d06542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c8bb46-ac22-4d89-ab14-e2db091e554c", "name": "network-vif-deleted", "tag": "3356efbc-e06a-4990-9463-dc4c8920d3da"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:08:37.904866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-282ecb16-e2d2-473e-8144-75a33936fc97 req-23449fa5-3d7b-4814-9553-d4e2e0d06542 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:37.905353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-282ecb16-e2d2-473e-8144-75a33936fc97 req-23449fa5-3d7b-4814-9553-d4e2e0d06542 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:37.906005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-282ecb16-e2d2-473e-8144-75a33936fc97 req-23449fa5-3d7b-4814-9553-d4e2e0d06542 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:37.926010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:37.926973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:37.935944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-282ecb16-e2d2-473e-8144-75a33936fc97 req-23449fa5-3d7b-4814-9553-d4e2e0d06542 service nova] Creating event network-vif-deleted:3356efbc-e06a-4990-9463-dc4c8920d3da for instance f0c8bb46-ac22-4d89-ab14-e2db091e554c on n-h1-854441-12 Oct 17 16:08:37.953383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:37.953985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:37.954445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:37.955230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:37.955705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:37.956137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:37.963656 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-282ecb16-e2d2-473e-8144-75a33936fc97 req-23449fa5-3d7b-4814-9553-d4e2e0d06542 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088951 Oct 17 16:08:37.971382 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2959/6179] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:08:38.504063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:38.534359 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2c4890c-5727-44bc-8f32-decfc5413902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.614233 Oct 17 16:08:38.539521 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3221/6180] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:37 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:39.581675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:39.583099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:39.600868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:39.601655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:39.613632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:39.614430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:39.614940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:39.617590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:39.823101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:39.837551 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d5bfedfe-9f6d-4c02-b24e-f45e377fabd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.262589 Oct 17 16:08:39.842645 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2960/6181] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:39 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:40.886570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:40.887337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:40.904454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:40.904965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:40.905491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:40.914085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:40.916467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:40.917050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:41.430611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:41.444660 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c44b3ddb-3bbe-44ac-a38c-dd63e70e3c3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.561502 Oct 17 16:08:41.447394 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3222/6182] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:40 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:42.482565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:42.487492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:42.546453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:42.554471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:42.555126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:42.556003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:42.556588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:42.560909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:42.759980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:42.770095 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81eca5df-f026-4483-be4e-9f6828464e41 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.299738 Oct 17 16:08:42.783130 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2961/6183] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:42 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:43.804085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:43.811189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:43.833370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:43.841761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:43.845939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:43.847061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:43.851485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:43.854582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:44.247651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:44.262309 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d24b6d59-dc05-4cb8-be4f-6af77c8d6a0c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.462995 Oct 17 16:08:44.282741 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3223/6184] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:43 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:45.305488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:45.307179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:45.334177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:45.344493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:45.365568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:45.366716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:45.368668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:45.371155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:45.596520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:45.675126 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9e88f976-0788-48e1-b7d2-e61ab2b01b31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.384742 Oct 17 16:08:45.676183 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2962/6185] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:45 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:46.724352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:46.725149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:46.738991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:46.739516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:46.739971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:46.748282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:46.749385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:46.749872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:47.263418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:47.314427 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-adc9b699-71e5-4524-88e6-81903490623b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.572918 Oct 17 16:08:47.315599 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3224/6186] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:46 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:48.365985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:48.367306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:48.394324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:48.395737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:48.403366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:48.405448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:48.412317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:48.415518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:48.721814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:48.739135 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c43af03f-b270-4795-9d65-cfbd44c6958c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.376948 Oct 17 16:08:48.748313 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2963/6187] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:48 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:08:49.793372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:49.794809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:49.850849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:49.856218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:49.861289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:49.863278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:49.865162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:49.866366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:50.217038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:50.235313 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fbb88d2a-b1ed-44a8-b304-822404bca1c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.443703 Oct 17 16:08:50.236531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3225/6188] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:49 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:51.285617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:51.286923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:51.309790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:51.310301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:51.310790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:51.311536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:51.312008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:51.312522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:51.653526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:51.690360 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-00261fb8-d343-4bad-b0bf-a29e7b2693ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.406570 Oct 17 16:08:51.691250 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2964/6189] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:51 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:52.737174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:52.743166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:52.788877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:52.790160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:52.792544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:52.799498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:52.801286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:52.802481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:53.087018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:53.142682 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6027f28d-d52a-4093-9c0a-6b40ab179ebd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1188 microversion: 2.1 time: 0.424239 Oct 17 16:08:53.148317 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3226/6190] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:52 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1188 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:54.200699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:54.201357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:54.224562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:54.232221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:54.232896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:54.240401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:54.242148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:54.244928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:54.427926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:54.430388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:54.434772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:54.435941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lazy-loading 'fault' on Instance uuid f0c8bb46-ac22-4d89-ab14-e2db091e554c {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:08:54.884196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:08:54.913179 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1ac75272-c4a8-4338-8ecc-036029324175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 200 len: 1147 microversion: 2.1 time: 0.716743 Oct 17 16:08:54.935226 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2965/6191] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:54 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 1147 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:08:55.970057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:08:55.971393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: f0c8bb46-ac22-4d89-ab14-e2db091e554c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:08:56.012586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:56.013398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:56.014037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:56.015162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:08:56.015827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:08:56.016505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:08:56.081647 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance f0c8bb46-ac22-4d89-ab14-e2db091e554c could not be found. Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c HTTP/1.1 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance f0c8bb46-ac22-4d89-ab14-e2db091e554c could not be found. Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'f0c8bb46-ac22-4d89-ab14-e2db091e554c'} Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c8bb46-ac22-4d89-ab14-e2db091e554c could not be found. Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c8bb46-ac22-4d89-ab14-e2db091e554c could not be found. Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:08:56.086065 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:08:56.091527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:08:56.091527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:08:56.091527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:08:56.091527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:08:56.091527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:08:56.091527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c8bb46-ac22-4d89-ab14-e2db091e554c could not be found. Oct 17 16:08:56.091527 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:08:56.091527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance f0c8bb46-ac22-4d89-ab14-e2db091e554c could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:08:56.091527 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5e37d6a-ba6c-4b03-aeff-5d599e153319 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c" status: 404 len: 111 microversion: 2.1 time: 0.122593 Oct 17 16:08:56.115014 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3227/6192] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:08:55 2022] GET /compute/v2.1/servers/f0c8bb46-ac22-4d89-ab14-e2db091e554c => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:09:14.623371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1752780913", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d3fa5cbc-06a2-4f09-8f3d-90f9115c8e46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "916c7d18-0cf6-4aa6-bd9b-213b6c12b936"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:09:14.728116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=21 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:14.729397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=57 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:14.870520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] validate_networks() for [('916c7d18-0cf6-4aa6-bd9b-213b6c12b936', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:09:17.041612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:09:17.042880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:09:17.043757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:09:17.044460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:09:17.045164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:09:17.088097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:17.088868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:17.089658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:17.091066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:17.091895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:17.092586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:17.200221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:09:17.212548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for user a7647fbb42444923aa218f5579dd30a0 and project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:09:17.397836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:09:17.405055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3fa5cbc-06a2-4f09-8f3d-90f9115c8e46',volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:09:17.890045 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [4fd6b0cd-3ada-40fc-bd24-4899c09ceebe] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:09:18.903663 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [4fd6b0cd-3ada-40fc-bd24-4899c09ceebe] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 55632. Oct 17 16:09:18.925915 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2d788f5a-eed8-445c-a0be-4fe05cfbcc21 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.310078 Oct 17 16:09:18.931397 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2966/6193] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:09:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:09:18.948550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e88ec37-4ca0-4c5e-90f4-02a555c42706 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:18.949852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e88ec37-4ca0-4c5e-90f4-02a555c42706 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:18.962550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:18.964008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:19.118603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e88ec37-4ca0-4c5e-90f4-02a555c42706 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:19.130435 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e88ec37-4ca0-4c5e-90f4-02a555c42706 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1057 microversion: 2.1 time: 0.185926 Oct 17 16:09:19.131700 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3228/6194] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:18 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1057 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:20.175245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:20.180500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:20.220510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:20.221403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:20.222292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:20.227864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:20.228687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:20.229377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:20.449929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:20.470737 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8bda159-f323-42b6-96d7-045a7a9e97ef tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1107 microversion: 2.1 time: 0.312979 Oct 17 16:09:20.474389 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2967/6195] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:20 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1107 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:21.499126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:21.500748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:21.537423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:21.538300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:21.539137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:21.540441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:21.541258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:21.542022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:21.723566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:21.751647 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-415e7510-04fd-4666-aece-d6a38362a592 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1173 microversion: 2.1 time: 0.259483 Oct 17 16:09:21.767197 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3229/6196] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:21 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1173 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:22.791310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:22.792041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:22.806444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:22.807208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:22.807842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:22.808781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:22.809447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:22.817017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:23.393610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:23.472073 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9423e20f-4c1c-423d-b02c-981f7f763ceb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1173 microversion: 2.1 time: 0.684132 Oct 17 16:09:23.478815 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2968/6197] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:22 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1173 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:24.523459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:24.525948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:24.568929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:24.569763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:24.578068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:24.581118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:24.582551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:24.597708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:25.331621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:25.380917 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42254d2d-75f5-40c2-92ba-45aacb48e76d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1215 microversion: 2.1 time: 0.872099 Oct 17 16:09:25.387156 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3230/6198] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:24 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1215 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:26.408765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:26.410350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:26.423034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:26.428412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:26.429409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:26.433406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:26.434400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:26.437319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:27.173047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:27.231200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:27.712499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:27.739543 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-93ccca84-086b-4c8c-99f2-5ce65532cae9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1215 microversion: 2.1 time: 1.334570 Oct 17 16:09:27.754757 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2969/6199] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:26 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1215 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:28.815334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:28.816678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:28.829808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:28.830742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:28.831505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:28.833292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:28.834768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:28.835891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:29.030864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c8fa502e-74d2-4665-bcba-1af13030a533 req-d7e87ba7-259c-4823-a444-42d3bd678b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ced862-9ff2-408f-a482-76fe3367d33a", "tag": "052b1eee-b4ce-4ea7-8391-b914ba108950"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:09:29.076727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c8fa502e-74d2-4665-bcba-1af13030a533 req-d7e87ba7-259c-4823-a444-42d3bd678b75 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:29.077215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c8fa502e-74d2-4665-bcba-1af13030a533 req-d7e87ba7-259c-4823-a444-42d3bd678b75 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:29.077642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c8fa502e-74d2-4665-bcba-1af13030a533 req-d7e87ba7-259c-4823-a444-42d3bd678b75 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:29.119567 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c8fa502e-74d2-4665-bcba-1af13030a533 req-d7e87ba7-259c-4823-a444-42d3bd678b75 service nova] Creating event network-changed:052b1eee-b4ce-4ea7-8391-b914ba108950 for instance 63ced862-9ff2-408f-a482-76fe3367d33a on n-h1-854441-12 Oct 17 16:09:29.126647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:29.144698 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c8fa502e-74d2-4665-bcba-1af13030a533 req-d7e87ba7-259c-4823-a444-42d3bd678b75 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118934 Oct 17 16:09:29.146623 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2970/6200] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:09:29.572183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:29.603689 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b957a6c7-19ed-4519-af88-0fca718218f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1215 microversion: 2.1 time: 0.826474 Oct 17 16:09:29.606061 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3231/6201] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:28 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1215 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:30.658016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:30.658952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:30.692661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:30.701575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:30.702225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:30.703125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:30.703632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:30.710402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:31.915513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:31.971381 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a42c904-00e9-48df-bd7c-34369da553ce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1215 microversion: 2.1 time: 1.319845 Oct 17 16:09:31.994263 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2971/6202] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:30 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1215 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:33.033832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:33.034467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:33.068247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:33.069174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:33.069976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:33.071336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:33.071977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:33.072359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:33.641882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:33.660214 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a19747c-f9ea-408b-81cd-d179cbbe81d7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1215 microversion: 2.1 time: 0.657128 Oct 17 16:09:33.680763 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3232/6203] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:33 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1215 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:34.690419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:34.692236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:34.728209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:34.728730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:34.729188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:34.730759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:34.731680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:34.732200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:35.284603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:35.316830 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d2790438-3e26-48d9-b12e-6a03ddb87cea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1203 microversion: 2.1 time: 0.630480 Oct 17 16:09:35.318062 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2972/6204] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:34 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1203 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:36.392830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:36.395481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:36.409292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-622101469", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:09:36.431076 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:09:36.431483 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a (ip 10.222.0.87) !!! Oct 17 16:09:36.436350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:36.437993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:36.439454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:36.441437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:36.442911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:36.444285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:36.541994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:09:36.793457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:36.829580 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ceb995f-35e4-4c31-8f90-39aef6f5cff7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1203 microversion: 2.1 time: 0.448616 Oct 17 16:09:36.866295 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3233/6205] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:36 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1203 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:37.735590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:09:37.736393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:09:37.736544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:09:37.736887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:09:37.737531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:09:37.764005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:37.764872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:37.766058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:37.767979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:37.769256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:37.770345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:37.829342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Getting quotas for project d1f2d2e6436b4452b7127893f972fd29. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:09:37.851866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Getting quotas for user 14468d2797eb4966baaf7d6202a2a809 and project d1f2d2e6436b4452b7127893f972fd29. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:09:37.870575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:09:37.874199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:09:37.884205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:37.899728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:37.930713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:37.935797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:37.936829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:37.940627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:37.943263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:37.947001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:37.970699 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2da6a106-ac9e-4316-a760-4daf42ca8086 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.567032 Oct 17 16:09:37.972487 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2973/6206] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:09:37.984602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba13e26a-2967-4589-a44e-33225c58f642 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:37.985244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba13e26a-2967-4589-a44e-33225c58f642 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:38.064369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba13e26a-2967-4589-a44e-33225c58f642 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:38.093180 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba13e26a-2967-4589-a44e-33225c58f642 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1214 microversion: 2.1 time: 0.113328 Oct 17 16:09:38.096054 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2974/6207] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:37 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:38.700597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:38.716263 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d57d661-b191-4bc9-84a1-b42963867480 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1203 microversion: 2.1 time: 0.842808 Oct 17 16:09:38.718150 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3234/6208] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:37 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1203 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:39.122409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-536bdb74-60ac-42f8-8e62-59fd210b7b5f tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:39.123871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-536bdb74-60ac-42f8-8e62-59fd210b7b5f tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:39.314107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-536bdb74-60ac-42f8-8e62-59fd210b7b5f tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:39.327581 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-536bdb74-60ac-42f8-8e62-59fd210b7b5f tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1214 microversion: 2.1 time: 0.211018 Oct 17 16:09:39.351019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2975/6209] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:39 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1214 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:39.795944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:39.797276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:39.830407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:39.841358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:39.842053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:39.864978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:39.871609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:39.872663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:40.367929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:40.370457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:40.435661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:40.447505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:40.451463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:40.454339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:40.456080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:40.456815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:40.459311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:40.462675 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e4c64e7-436f-4f0a-a007-92d0e4a2556c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1203 microversion: 2.1 time: 0.698926 Oct 17 16:09:40.470979 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3235/6210] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:39 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1203 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:40.916206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:40.925200 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bbdff236-cc52-4fc7-be35-2a65ff573fe4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1266 microversion: 2.1 time: 0.571621 Oct 17 16:09:40.925831 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2976/6211] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:40 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1266 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:09:41.516082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:41.518306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:41.534442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:41.535855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:41.536890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:41.538720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:41.539927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:41.540914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:41.965051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:41.966354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:41.984381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:41.985324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:41.985971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:41.994232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:41.995060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:41.995737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:42.214032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:42.231475 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c41a85c-6cea-43ae-a321-053ff41b505e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1203 microversion: 2.1 time: 0.723692 Oct 17 16:09:42.232312 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3236/6212] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:41 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1203 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:42.620488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:42.641709 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bd19e5bc-8938-4d6b-b6fe-adc78a330cfc tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1272 microversion: 2.1 time: 0.680127 Oct 17 16:09:42.642381 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2977/6213] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:41 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1272 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:09:43.264662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:43.266035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:43.286164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:43.287169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:43.287798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:43.291067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:43.291864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:43.292477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:43.554845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:43.572966 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09f75c27-4463-491a-a0c0-e02953951b71 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1203 microversion: 2.1 time: 0.318678 Oct 17 16:09:43.574098 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3237/6214] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:43 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1203 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:43.689781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:43.691686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:43.704934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:43.706139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:43.707439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:43.709336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:43.710459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:43.711566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:43.894324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:43.914422 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-47938daf-53f2-4008-a609-6b7d6f0db912 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1272 microversion: 2.1 time: 0.231594 Oct 17 16:09:43.915651 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2978/6215] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:43 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:09:44.605960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:44.607316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:44.627021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:44.628569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:44.629027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:44.630760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:44.632724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:44.634526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:44.863549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0eeb4f69-da72-4614-8b3d-b532021dddd3 req-fc9d3f41-cdf3-4c9f-ab40-74aca1de07be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ced862-9ff2-408f-a482-76fe3367d33a", "name": "network-vif-plugged", "status": "completed", "tag": "052b1eee-b4ce-4ea7-8391-b914ba108950"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:09:44.870153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:44.894159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0eeb4f69-da72-4614-8b3d-b532021dddd3 req-fc9d3f41-cdf3-4c9f-ab40-74aca1de07be service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:44.894738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0eeb4f69-da72-4614-8b3d-b532021dddd3 req-fc9d3f41-cdf3-4c9f-ab40-74aca1de07be service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:44.896178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0eeb4f69-da72-4614-8b3d-b532021dddd3 req-fc9d3f41-cdf3-4c9f-ab40-74aca1de07be service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:44.926352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=55 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:44.928835 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0eeb4f69-da72-4614-8b3d-b532021dddd3 req-fc9d3f41-cdf3-4c9f-ab40-74aca1de07be service nova] Creating event network-vif-plugged:052b1eee-b4ce-4ea7-8391-b914ba108950 for instance 63ced862-9ff2-408f-a482-76fe3367d33a on n-h1-854441-12 Oct 17 16:09:44.939779 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0eeb4f69-da72-4614-8b3d-b532021dddd3 req-fc9d3f41-cdf3-4c9f-ab40-74aca1de07be service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081263 Oct 17 16:09:44.940429 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2979/6216] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:09:44.954768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:44.955511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:44.994575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:44.995422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:44.996035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:44.996979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:44.997461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:44.997903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:45.049987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:45.062305 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d621afd7-6b8b-4393-98a8-2177933584c7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1203 microversion: 2.1 time: 0.461864 Oct 17 16:09:45.065748 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3238/6217] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:44 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1203 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:45.532952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:45.556065 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2781ab8c-0dc0-4be2-88af-ae69e2a2a994 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1314 microversion: 2.1 time: 0.610295 Oct 17 16:09:45.558077 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2980/6218] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:44 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:46.093300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:46.094734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:46.112030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:46.112825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:46.113439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:46.114373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:46.115088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:46.115687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:46.546214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d9e9ad77-115b-400d-bb8f-11e2e4b32f10 req-3a72460f-be65-49e7-a0eb-21ca7e6480e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d579bde-e347-46eb-a8d5-55f5e54b4de7", "tag": "d451fb66-72e0-4b6b-ad8b-3468c53c2e6e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:09:46.589813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d9e9ad77-115b-400d-bb8f-11e2e4b32f10 req-3a72460f-be65-49e7-a0eb-21ca7e6480e1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:46.592723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d9e9ad77-115b-400d-bb8f-11e2e4b32f10 req-3a72460f-be65-49e7-a0eb-21ca7e6480e1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:46.593592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d9e9ad77-115b-400d-bb8f-11e2e4b32f10 req-3a72460f-be65-49e7-a0eb-21ca7e6480e1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:46.621498 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d9e9ad77-115b-400d-bb8f-11e2e4b32f10 req-3a72460f-be65-49e7-a0eb-21ca7e6480e1 service nova] Creating event network-changed:d451fb66-72e0-4b6b-ad8b-3468c53c2e6e for instance 7d579bde-e347-46eb-a8d5-55f5e54b4de7 on n-h2-854441-12 Oct 17 16:09:46.628814 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d9e9ad77-115b-400d-bb8f-11e2e4b32f10 req-3a72460f-be65-49e7-a0eb-21ca7e6480e1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088851 Oct 17 16:09:46.630771 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2981/6219] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 17 16:09:46.638596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:46.639646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:46.649513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:46.650344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:46.650986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:46.652368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:46.653386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:46.654039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:46.876096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:46.915130 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87534613-796a-47c4-9d1d-9a1058f8379b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1203 microversion: 2.1 time: 0.817451 Oct 17 16:09:46.915764 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3239/6220] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:46 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1203 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:09:47.637392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:47.652815 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-60b42eec-88e8-4e97-8fd3-d4feb2425876 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1314 microversion: 2.1 time: 1.019629 Oct 17 16:09:47.661704 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2982/6221] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:46 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1314 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:47.939477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:47.943018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:47.960524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:47.961703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:47.963892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:47.969047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:47.970445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:47.971121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:48.599676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:48.635149 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08320dae-fccb-435c-b860-6e50f257a250 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1390 microversion: 2.1 time: 0.700037 Oct 17 16:09:48.637522 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3240/6222] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:47 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1390 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:48.689934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:48.694600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:48.709293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:48.712121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:48.715652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:48.721314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:48.722752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:48.724813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:48.726977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:48.728092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:48.729102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:48.752120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:48.755738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:48.757790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:48.761413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:48.774815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:48.776684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:49.092312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:49.119893 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e458751-9aa4-408b-942a-650cbe3fa25c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1390 microversion: 2.1 time: 0.436375 Oct 17 16:09:49.121013 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2983/6223] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:48 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1390 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:49.175664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:49.187685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:49.201450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:49.207989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:49.208670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:49.209513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:49.210176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:49.210975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:49.352654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:49.391520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:49.402571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=77 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:49.425147 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30f88d48-ebd5-4382-9216-80ff124f4b88 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1314 microversion: 2.1 time: 0.723119 Oct 17 16:09:49.429238 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3241/6224] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:48 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:09:50.131261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:50.158592 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb1bf61e-af46-4354-98e6-d78aec94e328 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1390 microversion: 2.1 time: 0.990677 Oct 17 16:09:50.160663 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2984/6225] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:49 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1390 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:50.208106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:50.209355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:50.215011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=31 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:09:50.231479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:50.233526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:50.235134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:50.236578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:50.238542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:50.239402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:50.317197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:09:50.470304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:50.471498 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:50.487026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:50.488005 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d385224-9dc3-470f-abc4-b74d185740e8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 204 len: 0 microversion: 2.1 time: 0.290183 Oct 17 16:09:50.489451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:50.490591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:50.492367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:50.494260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:50.497601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:50.500885 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3242/6226] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:09:50 2022] DELETE /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:09:50.514141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:50.514141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:50.529600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:50.531024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:50.532263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:50.533864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:50.536436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:50.538668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:51.028941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:51.057478 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40a1afdb-bef4-44da-8e65-8ebad88dd2e9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1396 microversion: 2.1 time: 0.553314 Oct 17 16:09:51.067239 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3243/6227] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:50 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1396 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:51.083612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:51.123643 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-967c5388-c7bf-42a6-aecd-b7c0651d20a6 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1314 microversion: 2.1 time: 0.661727 Oct 17 16:09:51.124690 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2985/6228] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:50 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:52.115318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:52.121448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:52.156996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:52.161793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:52.162769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:52.164970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:52.171659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:52.177702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:52.181118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:52.182127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:52.201379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:52.202852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:52.205402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:52.210196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:52.213755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:52.216196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:52.711058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:52.732587 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9e2fc28-316a-4363-b5ad-7cbeab15573d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1396 microversion: 2.1 time: 0.626908 Oct 17 16:09:52.743427 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3244/6229] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:52 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1396 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:52.913658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:52.941980 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a233ed5b-4034-4268-96fa-c122b21cd146 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1314 microversion: 2.1 time: 0.792537 Oct 17 16:09:52.987296 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2986/6230] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:52 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:53.773462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:53.775582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:53.802415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:53.803252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:53.804272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:53.807527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:53.808880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:53.809627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:54.004125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:54.011475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:54.045560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:54.051634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:54.053117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:54.058901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:54.060354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:54.075552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:54.279153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:54.311399 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ada6e4f-cf12-4a91-b845-d0d6aca7007d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1396 microversion: 2.1 time: 0.556392 Oct 17 16:09:54.317170 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3245/6231] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:53 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1396 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:09:54.559689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c7d87823-d28b-4112-b7ee-9997483e4f5b req-bee4fa3d-5f33-4077-8901-77af63985996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ced862-9ff2-408f-a482-76fe3367d33a", "name": "network-vif-deleted", "tag": "052b1eee-b4ce-4ea7-8391-b914ba108950"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:09:54.588796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7d87823-d28b-4112-b7ee-9997483e4f5b req-bee4fa3d-5f33-4077-8901-77af63985996 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:54.591162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7d87823-d28b-4112-b7ee-9997483e4f5b req-bee4fa3d-5f33-4077-8901-77af63985996 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:54.593341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7d87823-d28b-4112-b7ee-9997483e4f5b req-bee4fa3d-5f33-4077-8901-77af63985996 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:54.641686 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c7d87823-d28b-4112-b7ee-9997483e4f5b req-bee4fa3d-5f33-4077-8901-77af63985996 service nova] Creating event network-vif-deleted:052b1eee-b4ce-4ea7-8391-b914ba108950 for instance 63ced862-9ff2-408f-a482-76fe3367d33a on n-h1-854441-12 Oct 17 16:09:54.652676 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c7d87823-d28b-4112-b7ee-9997483e4f5b req-bee4fa3d-5f33-4077-8901-77af63985996 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099671 Oct 17 16:09:54.656088 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3246/6232] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:09:54.847576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:54.898706 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95981634-82e7-4102-abcb-f2b5ff3228d7 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1314 microversion: 2.1 time: 0.905299 Oct 17 16:09:54.901157 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2987/6233] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:53 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:55.386899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:55.409397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:55.474792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:55.475367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:55.480249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:55.482326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:55.490733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:55.493417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:55.623071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c515db6b-0381-45b2-bafd-89300b701f79 req-858bdee3-63c1-4e03-be55-992d1f8f59f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d579bde-e347-46eb-a8d5-55f5e54b4de7", "name": "network-vif-plugged", "status": "completed", "tag": "d451fb66-72e0-4b6b-ad8b-3468c53c2e6e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:09:55.673920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c515db6b-0381-45b2-bafd-89300b701f79 req-858bdee3-63c1-4e03-be55-992d1f8f59f9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:55.674876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c515db6b-0381-45b2-bafd-89300b701f79 req-858bdee3-63c1-4e03-be55-992d1f8f59f9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:55.680464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c515db6b-0381-45b2-bafd-89300b701f79 req-858bdee3-63c1-4e03-be55-992d1f8f59f9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:55.732486 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c515db6b-0381-45b2-bafd-89300b701f79 req-858bdee3-63c1-4e03-be55-992d1f8f59f9 service nova] Creating event network-vif-plugged:d451fb66-72e0-4b6b-ad8b-3468c53c2e6e for instance 7d579bde-e347-46eb-a8d5-55f5e54b4de7 on n-h2-854441-12 Oct 17 16:09:55.752118 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c515db6b-0381-45b2-bafd-89300b701f79 req-858bdee3-63c1-4e03-be55-992d1f8f59f9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144565 Oct 17 16:09:55.755392 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2988/6234] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:09:55.814451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:55.842711 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ddf5d3e-73ad-4bab-8dd4-6d5ed1ed6b0f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1188 microversion: 2.1 time: 0.477532 Oct 17 16:09:55.844195 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3247/6235] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:55 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1188 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:55.925092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:55.926254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:55.940905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:55.941678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:55.942345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:55.943390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:55.944128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:55.946249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:56.506700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:56.574159 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7bddf38c-a3a2-484f-b165-ac9314202c7b tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1314 microversion: 2.1 time: 0.653171 Oct 17 16:09:56.588339 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2989/6236] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:55 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:09:56.943392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:56.948516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:56.985785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:56.993260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:56.994623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:57.017316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:57.018348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:57.030808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:57.207859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:57.220664 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-452bb84b-f5ed-41ed-af5f-e12e3ff63874 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1188 microversion: 2.1 time: 0.354186 Oct 17 16:09:57.234531 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3248/6237] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:56 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1188 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:57.605715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:57.608547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:57.631337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:57.633235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:57.634596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:57.637262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:57.638444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:57.640838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:58.241341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:58.257734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:58.263052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:58.272719 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0792541f-19be-4b88-b788-466d37cee04a tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1464 microversion: 2.1 time: 0.675557 Oct 17 16:09:58.274279 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2990/6238] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:57 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1464 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:58.297438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:58.301817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:58.312390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:58.314730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:58.316925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:58.326598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:58.354596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:58.355327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:58.386117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:58.387288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:58.392167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:58.393369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:58.397592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:58.401168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:58.498250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:09:58.666908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:58.695022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-537feb4c-86ae-4104-8ac9-7a989b72190a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1188 microversion: 2.1 time: 0.444453 Oct 17 16:09:58.701238 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3249/6239] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:58 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1188 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:09:58.754805 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bfb3d5c6-1236-40ab-ba7d-c959a880e5f4 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 204 len: 0 microversion: 2.1 time: 0.408182 Oct 17 16:09:58.757160 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2991/6240] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:09:58 2022] DELETE /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:09:58.771094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:58.778443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:58.799027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:58.804083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:58.809037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:58.813154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:58.817040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:58.818282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:59.591167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:59.619758 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25656400-fdb6-48de-9933-869a0f2a68a9 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1470 microversion: 2.1 time: 0.856999 Oct 17 16:09:59.629272 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3250/6241] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:58 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1470 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:09:59.748084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:09:59.750028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:09:59.775441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:59.777465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:59.778230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:59.779239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:09:59.779911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:09:59.780541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:09:59.959170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:09:59.988161 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c2454981-4084-4b8d-a4fc-68828d73aeed tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1188 microversion: 2.1 time: 0.262624 Oct 17 16:09:59.990017 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2992/6242] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:09:59 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1188 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:00.650895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:00.664102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:00.686096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:00.687705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:00.688887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:00.700551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:00.701934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:00.703078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:01.037378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:01.038365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:01.051286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:01.052640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:01.053618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:01.055017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:01.055966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:01.056926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:01.138420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:01.158653 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33af6782-3beb-4f2a-89e1-3a1f562c4898 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1470 microversion: 2.1 time: 0.514902 Oct 17 16:10:01.168630 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3251/6243] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:00 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1470 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:01.319093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:01.356811 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fe6a507f-c33c-4962-8521-48945fb14577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1188 microversion: 2.1 time: 0.323407 Oct 17 16:10:01.361580 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2993/6244] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:01 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:10:01.749588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-53874617-e81f-4e08-ba17-56a60ed74eed req-b079e88f-4b6e-4bde-8ae7-b0823173f570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d579bde-e347-46eb-a8d5-55f5e54b4de7", "name": "network-vif-deleted", "tag": "d451fb66-72e0-4b6b-ad8b-3468c53c2e6e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:10:01.795083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-53874617-e81f-4e08-ba17-56a60ed74eed req-b079e88f-4b6e-4bde-8ae7-b0823173f570 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:01.796191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-53874617-e81f-4e08-ba17-56a60ed74eed req-b079e88f-4b6e-4bde-8ae7-b0823173f570 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:01.797807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-53874617-e81f-4e08-ba17-56a60ed74eed req-b079e88f-4b6e-4bde-8ae7-b0823173f570 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:01.831018 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-53874617-e81f-4e08-ba17-56a60ed74eed req-b079e88f-4b6e-4bde-8ae7-b0823173f570 service nova] Creating event network-vif-deleted:d451fb66-72e0-4b6b-ad8b-3468c53c2e6e for instance 7d579bde-e347-46eb-a8d5-55f5e54b4de7 on n-h2-854441-12 Oct 17 16:10:01.856294 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-53874617-e81f-4e08-ba17-56a60ed74eed req-b079e88f-4b6e-4bde-8ae7-b0823173f570 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118752 Oct 17 16:10:01.858215 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3252/6245] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:10:02.193094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:02.203072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:02.229551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:02.230268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:02.230820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:02.231583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:02.232041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:02.235054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:02.319811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:02.320736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:02.321558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:02.322270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lazy-loading 'fault' on Instance uuid 7d579bde-e347-46eb-a8d5-55f5e54b4de7 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:10:02.401576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:02.402921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:02.419685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:02.423368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:02.424184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:02.425720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:02.427695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:02.428389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:02.440891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14468d2797eb4966baaf7d6202a2a809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f2d2e6436b4452b7127893f972fd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:02.474490 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a8e48c3-445e-4660-a297-1e7d5efeac10 tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 200 len: 1304 microversion: 2.1 time: 0.285119 Oct 17 16:10:02.478022 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2994/6246] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:02 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 1304 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:02.695084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:02.723604 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f896b484-d9e5-4627-8e42-64ac9a5a9b14 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1188 microversion: 2.1 time: 0.325264 Oct 17 16:10:02.724624 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3253/6247] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:02 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:10:03.508624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:03.509500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] [instance: 7d579bde-e347-46eb-a8d5-55f5e54b4de7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:03.521219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:03.521725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:03.522321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:03.523630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:03.526351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:03.526832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:03.545716 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] HTTP exception thrown: Instance 7d579bde-e347-46eb-a8d5-55f5e54b4de7 could not be found. Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Request method failure captured: Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 HTTP/1.1 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX48KDEA0L7ME22kIZ0HkGTejKHYZbtkBWPhZkdjIf9DWaoaY6HtHiFId16uUPtnMWozBnIVHQopDfhprC768EO0ky__imuBlgn88Z00iWId1D-x5Fkk554zj48ipOlA065yQ2yQcmlnDJFopQnXNigc6MEJ-JZrGsu59-fIsr7ee-s Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: d1f2d2e6436b4452b7127893f972fd29 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesNegativeTest-812754357 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d1f2d2e6436b4452b7127893f972fd29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/d1f2d2e6436b4452b7127893f972fd29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_d1f2d2e6436b4452b7127893f972fd29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/d1f2d2e6436b4452b7127893f972fd29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesNegativeTest-812754357 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: d1f2d2e6436b4452b7127893f972fd29 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesNegativeTest-812754357 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesNegativeTest-812754357-project Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 14468d2797eb4966baaf7d6202a2a809 Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesNegativeTest-812754357-project Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 7d579bde-e347-46eb-a8d5-55f5e54b4de7 could not be found. Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7d579bde-e347-46eb-a8d5-55f5e54b4de7'} Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d579bde-e347-46eb-a8d5-55f5e54b4de7 could not be found. Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d579bde-e347-46eb-a8d5-55f5e54b4de7 could not be found. Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:10:03.548639 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:03.552848 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:10:03.552848 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:10:03.552848 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:10:03.552848 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:10:03.552848 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:10:03.552848 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d579bde-e347-46eb-a8d5-55f5e54b4de7 could not be found. Oct 17 16:10:03.552848 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:03.552848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] Returning 404 to user: Instance 7d579bde-e347-46eb-a8d5-55f5e54b4de7 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:10:03.554193 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22761e2f-963c-4d26-8b9d-ff8aced96f6c tempest-VolumesNegativeTest-812754357 tempest-VolumesNegativeTest-812754357-project] 10.222.0.87 "GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7" status: 404 len: 111 microversion: 2.1 time: 0.050966 Oct 17 16:10:03.554884 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2995/6248] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:03 2022] GET /compute/v2.1/servers/7d579bde-e347-46eb-a8d5-55f5e54b4de7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:10:03.770587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:03.772214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:03.798142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:03.799544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:03.800282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:03.801450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:03.802837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:03.803569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:03.956603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:03.967432 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-021e47c5-0708-427c-8d0f-e644bd3168d3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 200 len: 1188 microversion: 2.1 time: 0.201585 Oct 17 16:10:03.969530 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3254/6249] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:03 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 1188 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:10:05.008332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:05.009273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 63ced862-9ff2-408f-a482-76fe3367d33a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:05.036758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:05.037336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:05.037738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:05.050718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:05.051800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:05.053331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:05.098338 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance 63ced862-9ff2-408f-a482-76fe3367d33a could not be found. Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a HTTP/1.1 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 63ced862-9ff2-408f-a482-76fe3367d33a could not be found. Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '63ced862-9ff2-408f-a482-76fe3367d33a'} Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ced862-9ff2-408f-a482-76fe3367d33a could not be found. Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ced862-9ff2-408f-a482-76fe3367d33a could not be found. Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:10:05.101891 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ced862-9ff2-408f-a482-76fe3367d33a could not be found. Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance 63ced862-9ff2-408f-a482-76fe3367d33a could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-41e9845b-2817-4408-b288-efc9d5b4e9d6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a" status: 404 len: 111 microversion: 2.1 time: 0.110355 Oct 17 16:10:05.116534 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2996/6250] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:04 2022] GET /compute/v2.1/servers/63ced862-9ff2-408f-a482-76fe3367d33a => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:10:37.838211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:10:37.840587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:10:38.044506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1311250876", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "2e7fd51d-034c-4ef4-a919-131519b9ccd3"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:10:38.130116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] validate_networks() for [('2e7fd51d-034c-4ef4-a919-131519b9ccd3', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:10:38.784134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:10:38.784593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:10:38.785124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:10:38.786173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:10:38.786730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:10:38.803555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:38.804495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:38.805153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:38.806291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:38.806842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:38.807505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:38.874683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Getting quotas for project 880f185e3dac4bc9927609d6297191f3. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:10:38.891252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Getting quotas for user 49aa20f13c0e4c06bb65c86f73e3041f and project 880f185e3dac4bc9927609d6297191f3. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:10:38.932902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:10:38.942747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:10:39.033134 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [21803a1b-e1a4-4b0e-800f-a5d69ae60f09] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:10:40.046270 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [21803a1b-e1a4-4b0e-800f-a5d69ae60f09] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 57300. Oct 17 16:10:40.055547 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44c6468f-2109-486d-b208-668d72b0409d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.224126 Oct 17 16:10:40.063841 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3255/6251] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:10:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:10:40.069670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a30a3184-66de-4ca3-8e82-7e1320d373a7 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:40.070963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a30a3184-66de-4ca3-8e82-7e1320d373a7 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:40.093223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:10:40.099453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:10:40.405771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a30a3184-66de-4ca3-8e82-7e1320d373a7 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:40.424786 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a30a3184-66de-4ca3-8e82-7e1320d373a7 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1215 microversion: 2.1 time: 0.359307 Oct 17 16:10:40.427842 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2997/6252] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:40 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1215 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:10:41.459719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf6b2b35-b2d1-47a5-a4d9-37a42ff3a776 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:41.460927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf6b2b35-b2d1-47a5-a4d9-37a42ff3a776 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:41.724522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf6b2b35-b2d1-47a5-a4d9-37a42ff3a776 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:41.742852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf6b2b35-b2d1-47a5-a4d9-37a42ff3a776 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1215 microversion: 2.1 time: 0.287168 Oct 17 16:10:41.760421 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3256/6253] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:41 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:42.783059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:42.786354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:42.838622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:42.842216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:42.843896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:42.845634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:42.846891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:42.849087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:43.181200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:43.237538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb5265c7-e814-4e5e-82a1-eef888df7f38 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1267 microversion: 2.1 time: 0.464400 Oct 17 16:10:43.240924 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2998/6254] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:42 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1267 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:44.272916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:44.273536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:44.285986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:44.287013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:44.287812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:44.294965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:44.295844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:44.296462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:45.510799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:45.543799 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17e14a9f-3729-4324-9b7e-ddd64abd26b0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1273 microversion: 2.1 time: 1.274587 Oct 17 16:10:45.548416 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3257/6255] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:44 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1273 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:46.589230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:46.590386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:46.607977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:46.613232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:46.614696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:46.615677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:46.616330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:46.623368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:47.246066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:47.261666 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5e7d6c1-ada4-4220-9188-af4d89b1c28b tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1315 microversion: 2.1 time: 0.675934 Oct 17 16:10:47.276664 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 2999/6256] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:46 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:48.327873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:48.328699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:48.348308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:48.350636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:48.351112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:48.353940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:48.356212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:48.362874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:48.845922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:10:48.927630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:48.949244 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8509f3f0-34c2-449f-a017-80f2c4e69023 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1315 microversion: 2.1 time: 0.627233 Oct 17 16:10:48.951845 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3258/6257] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:48 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:49.050966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9e328694-8942-4f59-b387-85bddf8d8085 req-032ae666-2a5e-431e-aade-dbc435588c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3716fc6f-677e-4213-8df2-bd36c3997efe", "tag": "afe9b473-d2a5-4ed1-b04d-2e93f9de76e9"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:10:49.067779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e328694-8942-4f59-b387-85bddf8d8085 req-032ae666-2a5e-431e-aade-dbc435588c74 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:49.068332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e328694-8942-4f59-b387-85bddf8d8085 req-032ae666-2a5e-431e-aade-dbc435588c74 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:49.068783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e328694-8942-4f59-b387-85bddf8d8085 req-032ae666-2a5e-431e-aade-dbc435588c74 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:49.084139 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9e328694-8942-4f59-b387-85bddf8d8085 req-032ae666-2a5e-431e-aade-dbc435588c74 service nova] Creating event network-changed:afe9b473-d2a5-4ed1-b04d-2e93f9de76e9 for instance 3716fc6f-677e-4213-8df2-bd36c3997efe on n-h1-854441-12 Oct 17 16:10:49.093426 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9e328694-8942-4f59-b387-85bddf8d8085 req-032ae666-2a5e-431e-aade-dbc435588c74 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389839 Oct 17 16:10:49.095109 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3000/6258] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:10:50.008969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:50.013852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:50.052910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:50.058480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:50.061526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:50.066744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:50.070661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:50.071891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:50.677928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:50.713922 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c6f2b976-3a3b-4137-ba77-c191da489cae tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1315 microversion: 2.1 time: 0.718562 Oct 17 16:10:50.717703 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3259/6259] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:49 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:51.377626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:10:51.760314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:51.769865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:51.802692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:10:51.805618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:51.806665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:51.807303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:51.822345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:51.823466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:51.824189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:52.058312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3df0f7c0-88ab-41c1-a68c-bb83503022b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'create', calling method: .version_select at 0x7f28beca1e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1022756630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgE8aR9OFoLd9wuLDybu28YmfzBa4yWQUP64B98Bqx+oKzN55Fbd+JTBsR0opsmJSiTCf1WtpR5fldETqN/mgY79Dhk0AoX0AftKWvJMUfv1Zh4KFSfgup58HhzW7eSrg=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:10:52.116891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3df0f7c0-88ab-41c1-a68c-bb83503022b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:10:52.124977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3df0f7c0-88ab-41c1-a68c-bb83503022b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for user 6d3c6140894e446a9272e1a9247cbb1b and project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:10:52.162069 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3df0f7c0-88ab-41c1-a68c-bb83503022b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [ea61a45a-9ea1-4441-b009-8bc505706b50] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:10:52.524477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:52.535791 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68ace298-99f0-4766-b165-d162d21efe5d tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1315 microversion: 2.1 time: 0.789182 Oct 17 16:10:52.537074 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3260/6260] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:51 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1315 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:53.174103 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [None req-3df0f7c0-88ab-41c1-a68c-bb83503022b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [ea61a45a-9ea1-4441-b009-8bc505706b50] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 57572. Oct 17 16:10:53.212841 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3df0f7c0-88ab-41c1-a68c-bb83503022b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.838333 Oct 17 16:10:53.213487 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3001/6261] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:10:51 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:10:53.585640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:53.587088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:53.606174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:53.610214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:53.611455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:53.612631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:53.615415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:53.616418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:54.132038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:54.142750 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-982f60a4-ed8a-4476-892c-91ea73242e03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1315 microversion: 2.1 time: 0.563771 Oct 17 16:10:54.146533 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3261/6262] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:53 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:55.196140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:55.199018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:55.218176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:55.220784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:55.223284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:55.227431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:55.229067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:55.231616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:55.663462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:55.685145 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-981b32a4-eca3-49d7-8a0f-f75d6682de20 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1315 microversion: 2.1 time: 0.496063 Oct 17 16:10:55.686930 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3002/6263] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:55 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:10:55.827859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cf9aaafa-685c-4718-a517-5fcdf7b27289 req-53abe8b1-d184-4966-8bc9-6120865d560c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3716fc6f-677e-4213-8df2-bd36c3997efe", "name": "network-vif-plugged", "status": "completed", "tag": "afe9b473-d2a5-4ed1-b04d-2e93f9de76e9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:10:55.851026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf9aaafa-685c-4718-a517-5fcdf7b27289 req-53abe8b1-d184-4966-8bc9-6120865d560c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:55.852574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf9aaafa-685c-4718-a517-5fcdf7b27289 req-53abe8b1-d184-4966-8bc9-6120865d560c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:55.853595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf9aaafa-685c-4718-a517-5fcdf7b27289 req-53abe8b1-d184-4966-8bc9-6120865d560c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:55.876452 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cf9aaafa-685c-4718-a517-5fcdf7b27289 req-53abe8b1-d184-4966-8bc9-6120865d560c service nova] Creating event network-vif-plugged:afe9b473-d2a5-4ed1-b04d-2e93f9de76e9 for instance 3716fc6f-677e-4213-8df2-bd36c3997efe on n-h1-854441-12 Oct 17 16:10:55.890334 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cf9aaafa-685c-4718-a517-5fcdf7b27289 req-53abe8b1-d184-4966-8bc9-6120865d560c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183028 Oct 17 16:10:55.892562 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3262/6264] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:10:56.712252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:56.714250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:56.725461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:56.726033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:56.726528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:56.727337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:56.728184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:56.729111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:57.297486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:57.317731 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-341c860b-7226-48a0-8e0b-36f95958dee5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1315 microversion: 2.1 time: 0.612366 Oct 17 16:10:57.332912 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3003/6265] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:56 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:58.117105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-987216178", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "67c2d407-8ed0-467b-be9f-dd6122a41e65", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "916c7d18-0cf6-4aa6-bd9b-213b6c12b936"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:10:58.353319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] validate_networks() for [('916c7d18-0cf6-4aa6-bd9b-213b6c12b936', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:10:58.364522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:58.365474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:58.412655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:58.412655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:58.412655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:58.412655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:58.412655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:58.412655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:58.867782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:58.902726 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fb53563d-375d-43fb-8288-d7220541eec8 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1501 microversion: 2.1 time: 0.542417 Oct 17 16:10:58.929086 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3004/6266] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:58 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1501 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:10:58.958195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:58.961153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:58.975058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:58.976847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:58.978014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:58.979697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:58.980554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:58.981415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:59.401081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:10:59.423561 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d3eb58cf-a0bb-4bb0-8faa-2a88ea556144 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1501 microversion: 2.1 time: 0.473032 Oct 17 16:10:59.435096 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3005/6267] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:58 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1501 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:10:59.479880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:10:59.481102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:59.507180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:59.508108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:59.508941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:59.511997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:59.513951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:59.515334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:59.606256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lazy-loading 'flavor' on Instance uuid 3716fc6f-677e-4213-8df2-bd36c3997efe {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:10:59.641979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:10:59.642913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:10:59.644201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:10:59.645198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:10:59.646179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:10:59.674234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:59.675297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:59.676181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:59.677858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:59.678817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:59.679498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:59.718788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:10:59.731077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for user a7647fbb42444923aa218f5579dd30a0 and project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:10:59.795158 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6c5a7f57-6171-4761-93ed-5feb12bb3c77 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "POST /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe/action" status: 202 len: 0 microversion: 2.1 time: 0.323919 Oct 17 16:10:59.800365 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3006/6268] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:10:59 2022] POST /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:10:59.810523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:10:59.821743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='67c2d407-8ed0-467b-be9f-dd6122a41e65',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:10:59.825069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:10:59.847363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:10:59.881098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:59.882679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:59.885822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:10:59.888061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:10:59.888888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:10:59.889751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:00.138340 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d408ea0c-d951-48a3-a7e9-be12a6c72d2f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.032706 Oct 17 16:11:00.151554 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3263/6269] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:11:00.162342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2df7a317-b7eb-46aa-ae1b-cb421a90d72e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:00.163872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2df7a317-b7eb-46aa-ae1b-cb421a90d72e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:00.410996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:00.467826 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f8f4c0e8-f6ce-4099-89c7-b0083995a26a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1509 microversion: 2.1 time: 0.663111 Oct 17 16:11:00.469169 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3007/6270] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:10:59 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1509 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:00.947254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2df7a317-b7eb-46aa-ae1b-cb421a90d72e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:00.957674 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2df7a317-b7eb-46aa-ae1b-cb421a90d72e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1056 microversion: 2.1 time: 0.803392 Oct 17 16:11:00.958296 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3264/6271] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:00 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1056 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:01.511055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:01.512473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:01.550068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:01.551683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:01.552916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:01.554543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:01.555715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:01.556872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:02.006484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:02.008088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:02.022533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:02.026316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:02.026822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:02.027605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:02.030393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:02.031217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:02.148400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:02.167342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:02.179264 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7f7e56f-e00d-4717-af39-e672d71e5dc4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1108 microversion: 2.1 time: 0.180839 Oct 17 16:11:02.184684 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3265/6272] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:01 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1108 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:02.298462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:02.326600 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c2a3ed24-acb4-4610-9e14-814ca08fa259 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1492 microversion: 2.1 time: 0.835159 Oct 17 16:11:02.327238 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3008/6273] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:01 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1492 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:02.354083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-381c7c13-c5cc-4815-a289-bbe65de1dcd2 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:02.354697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-381c7c13-c5cc-4815-a289-bbe65de1dcd2 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:02.364065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-381c7c13-c5cc-4815-a289-bbe65de1dcd2 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:02.364573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-381c7c13-c5cc-4815-a289-bbe65de1dcd2 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:02.365023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-381c7c13-c5cc-4815-a289-bbe65de1dcd2 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:02.365921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-381c7c13-c5cc-4815-a289-bbe65de1dcd2 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:02.366217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-381c7c13-c5cc-4815-a289-bbe65de1dcd2 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:02.366690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-381c7c13-c5cc-4815-a289-bbe65de1dcd2 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:02.567154 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-381c7c13-c5cc-4815-a289-bbe65de1dcd2 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "POST /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe/action" status: 202 len: 0 microversion: 2.1 time: 0.208587 Oct 17 16:11:02.572370 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3266/6274] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:11:02 2022] POST /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:11:02.587333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:02.596510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:02.630519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:02.632293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:02.634636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:02.642759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:02.648955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:02.651353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:03.217749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:03.227389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:03.278311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:03.279240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:03.279971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:03.291590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:03.300578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:03.309052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:03.540597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:03.553005 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a78cc5f0-934b-411f-9e67-38c2e26f3c31 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1498 microversion: 2.1 time: 0.978894 Oct 17 16:11:03.559193 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3009/6275] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:02 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1498 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:03.621605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:03.640382 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b540611-f272-45eb-a828-ae077889f01a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1126 microversion: 2.1 time: 0.434528 Oct 17 16:11:03.643578 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3267/6276] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:03 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1126 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:04.612133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:04.613227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:04.634608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:04.635989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:04.637574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:04.639246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:04.640746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:04.643323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:04.670452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:04.671377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:04.687706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:04.688689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:04.689159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:04.690102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:04.690351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:04.695634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:04.963956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:04.979451 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-714af320-4cea-4e53-9c2e-7697571db8bf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1126 microversion: 2.1 time: 0.314469 Oct 17 16:11:04.998534 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3268/6277] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:04 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1126 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:05.627722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:05.664258 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-45b0a0b0-c980-4d80-b657-a0c14471fbdc tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1498 microversion: 2.1 time: 1.055551 Oct 17 16:11:05.672269 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3010/6278] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:04 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1498 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:06.016713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:06.020761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:06.056851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:06.057860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:06.061422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:06.063450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:06.064851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:06.080223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:06.391807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:06.406491 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03c5f7e1-6b98-4128-a97f-050ee42175b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1126 microversion: 2.1 time: 0.397140 Oct 17 16:11:06.420217 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3269/6279] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:06 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1126 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:06.706406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:06.708993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:06.729039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:06.729901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:06.730601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:06.731593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:06.732307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:06.732920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:07.436357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:07.442802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:07.463555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:07.464431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:07.465234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:07.474973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:07.476155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:07.477148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:08.068748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:08.080827 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ec7c855a-1e75-4421-a7d6-b11cf40cbb82 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1501 microversion: 2.1 time: 1.378526 Oct 17 16:11:08.086768 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3011/6280] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:06 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1501 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:08.112341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:08.113390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:08.128645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:08.130537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:08.134406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:08.136256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:08.141390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:08.142129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:08.244867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lazy-loading 'flavor' on Instance uuid 3716fc6f-677e-4213-8df2-bd36c3997efe {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:11:08.517275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:08.538010 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-649fc769-3be6-45c6-948d-5c46c009c97e tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "POST /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe/action" status: 202 len: 0 microversion: 2.1 time: 0.430288 Oct 17 16:11:08.543034 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3012/6281] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:11:08 2022] POST /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:11:08.557919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:08.570279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:08.613343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:08.616129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:08.618270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:08.620178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:08.621586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:08.623438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:08.812945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:08.815953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:08.841267 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b8eb428-a269-428f-b329-9d00774e4a93 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 1.412830 Oct 17 16:11:08.844243 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3270/6282] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:07 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:09.401836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:09.438408 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8768a68b-8e11-4900-b35e-1138ab2f9a03 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1509 microversion: 2.1 time: 0.889086 Oct 17 16:11:09.441371 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3013/6283] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:08 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1509 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:09.867775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:09.868597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:09.874289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:09.878782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:09.907237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:09.907751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:09.908199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:09.908954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:09.909421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:09.924516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:10.466736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:10.469318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:10.479926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:10.485399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:10.488604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:10.489430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:10.490405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:10.491459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:10.492195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:10.785030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:10.799834 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e2e5b754-fb2b-40c1-9a47-7df060a0f6e4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.936732 Oct 17 16:11:10.820002 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3271/6284] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:09 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:10.826052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-796b5dc2-e541-40fc-ad09-865ecd84da42 req-0c1a174f-d4e1-4934-902f-33dee86314b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebdec11-217d-4360-8b73-d5ac9647bb56", "tag": "d257ce78-1e0b-4379-99bd-a36c9cd86622"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:10.857340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-796b5dc2-e541-40fc-ad09-865ecd84da42 req-0c1a174f-d4e1-4934-902f-33dee86314b2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:10.858229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-796b5dc2-e541-40fc-ad09-865ecd84da42 req-0c1a174f-d4e1-4934-902f-33dee86314b2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:10.859512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-796b5dc2-e541-40fc-ad09-865ecd84da42 req-0c1a174f-d4e1-4934-902f-33dee86314b2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:10.899946 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-796b5dc2-e541-40fc-ad09-865ecd84da42 req-0c1a174f-d4e1-4934-902f-33dee86314b2 service nova] Creating event network-changed:d257ce78-1e0b-4379-99bd-a36c9cd86622 for instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 on n-h2-854441-12 Oct 17 16:11:10.911320 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-796b5dc2-e541-40fc-ad09-865ecd84da42 req-0c1a174f-d4e1-4934-902f-33dee86314b2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088707 Oct 17 16:11:10.912807 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3272/6285] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:11:11.633629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:11.645043 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c18fb67-f86a-4071-9421-1f169bdf2a07 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1492 microversion: 2.1 time: 1.183147 Oct 17 16:11:11.645687 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3014/6286] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:10 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1492 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:11.694803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2572c06f-f984-4811-83a6-2a3e686a69a1 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:11.695783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2572c06f-f984-4811-83a6-2a3e686a69a1 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:11.698255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:11.741246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2572c06f-f984-4811-83a6-2a3e686a69a1 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:11.743847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2572c06f-f984-4811-83a6-2a3e686a69a1 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:11.747811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2572c06f-f984-4811-83a6-2a3e686a69a1 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:11.754773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2572c06f-f984-4811-83a6-2a3e686a69a1 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:11.758168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2572c06f-f984-4811-83a6-2a3e686a69a1 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:11.760852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2572c06f-f984-4811-83a6-2a3e686a69a1 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:11.825106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:11.825644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:11.843019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:11.843605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:11.844070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:11.844841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:11.845321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:11.857499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:11.963609 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2572c06f-f984-4811-83a6-2a3e686a69a1 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "POST /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe/action" status: 202 len: 0 microversion: 2.1 time: 0.273646 Oct 17 16:11:11.965370 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3273/6287] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:11:11 2022] POST /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:11:11.989351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:11.991206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:12.008646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:12.009673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:12.010360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:12.013654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:12.019219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:12.020078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:12.646852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:12.669075 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-980ac08c-5af7-4e38-ac4f-291e16c567c0 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1498 microversion: 2.1 time: 0.696526 Oct 17 16:11:12.670371 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3274/6288] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:11 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1498 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:12.849327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:12.882708 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c251e9a8-1e56-4e3b-9eb9-1f979f0f9d6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 1.061584 Oct 17 16:11:12.900503 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3015/6289] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:11 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:13.734794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:13.745646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:13.826136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:13.827231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:13.833511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:13.836262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:13.836977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:13.837437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:13.915359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:13.917559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:13.964695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:13.968623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:13.977301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:13.989335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:13.996748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:13.997695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:14.880586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:14.903802 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2a41f24-1741-4ab2-aeb9-60cf0f2168ac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.990957 Oct 17 16:11:14.905185 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3016/6290] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:13 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:14.948860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-29346175", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "e2df435c-a344-4bbd-a483-6679b0548876"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1022756630", "security_groups": [{"name": "tempest-secgroup-smoke-1359358158"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:14.952537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:14.974928 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c281d51-192e-4bca-bf5c-c57073045f14 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1498 microversion: 2.1 time: 1.262913 Oct 17 16:11:14.982647 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3275/6291] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:13 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1498 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:15.270151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] validate_networks() for [('e2df435c-a344-4bbd-a483-6679b0548876', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:11:15.962698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:15.964735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:15.977864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:15.979396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:15.980407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:15.981955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:15.983127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:15.984212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:16.440245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:16.467141 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1ee8f2e-e3c9-4f13-b4f3-3808fbcccf86 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.516585 Oct 17 16:11:16.494543 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3276/6292] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:15 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:16.494543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:16.494543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:16.510538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:16.511076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:16.511519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:16.512268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:16.512737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:16.513172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:16.777674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:11:16.778472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:11:16.779659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:11:16.780347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:11:16.781178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:11:16.798908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:16.801538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:16.802302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:16.803357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:16.804633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:16.806650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:16.851152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:11:16.861360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for user 6d3c6140894e446a9272e1a9247cbb1b and project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:11:16.894279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:11:16.900993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:11:17.047724 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2de4f574-d5fe-49b0-a6d2-2d1978656172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.125915 Oct 17 16:11:17.059080 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3017/6293] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:11:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:11:17.065779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c6068ac-41fd-4c33-865e-0da16d6eef19 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:17.066415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c6068ac-41fd-4c33-865e-0da16d6eef19 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:17.347273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c6068ac-41fd-4c33-865e-0da16d6eef19 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:17.382676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c6068ac-41fd-4c33-865e-0da16d6eef19 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1265 microversion: 2.1 time: 0.320798 Oct 17 16:11:17.387576 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3018/6294] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:17 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:17.507994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:17.521582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:17.523381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:17.552239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:17.552807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:17.553257 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-272152e9-cf3b-40b0-b3cd-d751e8c6373a tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1501 microversion: 2.1 time: 1.074883 Oct 17 16:11:17.556606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:17.557438 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3277/6295] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:16 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1501 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:17.557641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:17.557972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:17.559443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:17.623389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:17.629303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:17.662166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:17.663910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:17.668465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:17.684315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:17.692498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:17.694703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:17.834342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:11:17.991956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:18.041987 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95b08b38-3494-4aa4-abcb-782125781426 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.523122 Oct 17 16:11:18.059005 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3019/6296] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:17 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:18.070535 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4ecd52f8-1df3-43dc-8f99-29d15dc9e2b5 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 204 len: 0 microversion: 2.1 time: 0.458185 Oct 17 16:11:18.071985 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3278/6297] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:11:17 2022] DELETE /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:11:18.101242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:18.101951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:18.139837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:18.146656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:18.152251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:18.157804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:18.162261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:18.165062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:18.443489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fec1dc2c-67ad-42d3-8148-ed4133cae39b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:18.445970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fec1dc2c-67ad-42d3-8148-ed4133cae39b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:18.568159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fec1dc2c-67ad-42d3-8148-ed4133cae39b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:18.583916 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fec1dc2c-67ad-42d3-8148-ed4133cae39b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1265 microversion: 2.1 time: 0.147249 Oct 17 16:11:18.584806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3279/6298] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:18 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:18.794391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:18.823463 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea1190b8-ff1b-4cbb-ad96-464bfa342f75 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1507 microversion: 2.1 time: 0.737073 Oct 17 16:11:18.854877 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3020/6299] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:18 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1507 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:19.101643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:19.102273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:19.113650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:19.114489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:19.134454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:19.136299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:19.140226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:19.147532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:19.617899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:19.620328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:19.630939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:19.632043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:19.632723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:19.633465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:19.634139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:19.635464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:19.682011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:19.707525 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b3933bc-6f32-4a74-a7ca-b977d1fa67bb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.609829 Oct 17 16:11:19.729123 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3280/6300] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:19 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:19.846092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:19.876581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:19.878029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:19.891659 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-787c5b07-d41d-4ecb-ae4d-f2a7134e4977 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1269 microversion: 2.1 time: 0.284959 Oct 17 16:11:19.894281 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3021/6301] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:19 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1269 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:19.894830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:19.895900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:19.896598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:19.898322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:19.899431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:19.900129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:20.503841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:20.534117 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00f957fc-12b8-49af-bc17-0a7eb7b50e61 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1507 microversion: 2.1 time: 0.661409 Oct 17 16:11:20.551746 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3281/6302] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:19 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1507 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:20.743335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:20.747598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:20.804649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:20.805789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:20.806824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:20.808310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:20.809334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:20.810210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:20.963465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:20.964787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:20.990764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:20.992301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:20.993824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:20.994904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:20.997854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:20.998680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:21.510522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:21.520718 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b13883c5-e780-474a-b5bb-7085fd643fd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1317 microversion: 2.1 time: 0.561788 Oct 17 16:11:21.537611 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3282/6303] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:20 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:21.581783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:21.588402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:21.623423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:21.624056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:21.624624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:21.628226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:21.628973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:21.629402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:21.958683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:22.024680 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bab55190-da7a-44a9-8b15-22ecb9c42d5a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 1.286024 Oct 17 16:11:22.025842 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3022/6304] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:20 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:22.558990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:22.559529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:22.592657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:22.593485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:22.593955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:22.594754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:22.606537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:22.612935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:22.735942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:22.750470 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5054e79d-10ce-4556-bd8f-cbc05b56e92c tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1507 microversion: 2.1 time: 1.177899 Oct 17 16:11:22.766759 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3283/6305] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:21 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1507 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:22.781655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ee6d6843-ccdd-4ffa-be06-1a7036c76d16 req-3b001257-7826-43ec-bccc-7fd23ca399ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3716fc6f-677e-4213-8df2-bd36c3997efe", "name": "network-vif-deleted", "tag": "afe9b473-d2a5-4ed1-b04d-2e93f9de76e9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:22.809618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ee6d6843-ccdd-4ffa-be06-1a7036c76d16 req-3b001257-7826-43ec-bccc-7fd23ca399ef service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:22.810620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ee6d6843-ccdd-4ffa-be06-1a7036c76d16 req-3b001257-7826-43ec-bccc-7fd23ca399ef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:22.811356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ee6d6843-ccdd-4ffa-be06-1a7036c76d16 req-3b001257-7826-43ec-bccc-7fd23ca399ef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:22.857280 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ee6d6843-ccdd-4ffa-be06-1a7036c76d16 req-3b001257-7826-43ec-bccc-7fd23ca399ef service nova] Creating event network-vif-deleted:afe9b473-d2a5-4ed1-b04d-2e93f9de76e9 for instance 3716fc6f-677e-4213-8df2-bd36c3997efe on n-h1-854441-12 Oct 17 16:11:22.866721 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ee6d6843-ccdd-4ffa-be06-1a7036c76d16 req-3b001257-7826-43ec-bccc-7fd23ca399ef service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098302 Oct 17 16:11:22.867735 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3284/6306] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:11:22.912386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:22.936489 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9f44dfc1-857b-4248-93cd-604563091ecb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1323 microversion: 2.1 time: 0.381094 Oct 17 16:11:22.961060 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3023/6307] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:22 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1323 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:23.083511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:23.084547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:23.110887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:23.111427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:23.111880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:23.112832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:23.113671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:23.114133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:23.522325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:23.541635 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b3fec300-d544-4cd5-8683-ade666604a19 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.464782 Oct 17 16:11:23.563610 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3285/6308] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:23 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:23.784155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:23.784715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:23.819972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:23.824946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:23.829044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:23.833458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:23.834620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:23.841639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:23.984250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:23.987284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:24.029772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:24.039227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:24.039624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:24.040608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:24.042018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:24.044607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:24.046041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:24.048578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:24.049353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:24.054903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lazy-loading 'fault' on Instance uuid 3716fc6f-677e-4213-8df2-bd36c3997efe {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:11:24.258199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49aa20f13c0e4c06bb65c86f73e3041f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f185e3dac4bc9927609d6297191f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:24.271482 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-612317cb-f3b8-47b0-8af4-b2b8ee4b1420 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 200 len: 1305 microversion: 2.1 time: 0.493531 Oct 17 16:11:24.272115 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3024/6309] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:23 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 1305 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:24.590745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:24.591123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:24.682411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:24.696847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:24.698795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:24.708461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:24.709510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:24.715884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:24.975420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:24.995530 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a0ced6c-6132-47a6-8a70-8898f4d044eb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1391 microversion: 2.1 time: 1.029242 Oct 17 16:11:25.019339 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3286/6310] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:23 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1391 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:25.311188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:25.313833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] [instance: 3716fc6f-677e-4213-8df2-bd36c3997efe] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:25.361937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:25.362798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:25.363519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:25.364556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:25.365865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:25.368225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:25.371363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:25.410527 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] HTTP exception thrown: Instance 3716fc6f-677e-4213-8df2-bd36c3997efe could not be found. Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Request method failure captured: Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe HTTP/1.1 Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX56QnB2CpokVsy0ACRke_Cc6xx539xvfy9h_6RfBwKsyKBqzuKMXPTBq7Bd_qoI51XykASDI_JH5yU2hprc5VLyDtIwHedwL-yUFHw79HFrMb5-PWobPSqt-LWUf2WSaiovOM8FoDffHv86T8H2LsGdEDkesij6OZMQqyp71ZcblHM Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 880f185e3dac4bc9927609d6297191f3 Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestServerAdvancedOps-1761012905 Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/880f185e3dac4bc9927609d6297191f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/880f185e3dac4bc9927609d6297191f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_880f185e3dac4bc9927609d6297191f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/880f185e3dac4bc9927609d6297191f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestServerAdvancedOps-1761012905 Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 880f185e3dac4bc9927609d6297191f3 Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestServerAdvancedOps-1761012905 Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestServerAdvancedOps-1761012905-project Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 49aa20f13c0e4c06bb65c86f73e3041f Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestServerAdvancedOps-1761012905-project Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 3716fc6f-677e-4213-8df2-bd36c3997efe could not be found. Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '3716fc6f-677e-4213-8df2-bd36c3997efe'} Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3716fc6f-677e-4213-8df2-bd36c3997efe could not be found. Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3716fc6f-677e-4213-8df2-bd36c3997efe could not be found. Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:11:25.423433 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:11:25.428315 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:11:25.428315 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:11:25.428315 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:11:25.428315 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:11:25.428315 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:11:25.428315 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3716fc6f-677e-4213-8df2-bd36c3997efe could not be found. Oct 17 16:11:25.428315 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:11:25.434718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] Returning 404 to user: Instance 3716fc6f-677e-4213-8df2-bd36c3997efe could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:11:25.436040 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d1e085b-aaff-4066-a042-d00445176f39 tempest-TestServerAdvancedOps-1761012905 tempest-TestServerAdvancedOps-1761012905-project] 10.222.0.87 "GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe" status: 404 len: 111 microversion: 2.1 time: 0.140069 Oct 17 16:11:25.436864 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3287/6311] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:25 2022] GET /compute/v2.1/servers/3716fc6f-677e-4213-8df2-bd36c3997efe => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:11:26.024392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:26.025064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:26.026222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:26.035412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:26.037124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:26.037966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:26.038999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:26.039649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:26.040316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:26.052526 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c55bb606-0c9d-442f-b5d9-f47993828750 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 1.473208 Oct 17 16:11:26.063414 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3025/6312] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:24 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:26.967025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:26.979002 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2305a99b-ffab-4c42-a408-4ffb8e3ee27e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1391 microversion: 2.1 time: 0.957863 Oct 17 16:11:26.997139 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3288/6313] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:26 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1391 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:27.100021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:27.104593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:27.131593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:27.151179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:27.172444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:27.173788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:27.175644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:27.179845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:27.181925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:27.376284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:28.272547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4cc5f0b8-492b-4f8f-9b94-4d6cc9e73557 req-5b2b99b9-52c0-4cd1-b7aa-a9d4adeec28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ff43c5-537d-4956-bcbe-8ee63136f03a", "tag": "6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:28.301917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4cc5f0b8-492b-4f8f-9b94-4d6cc9e73557 req-5b2b99b9-52c0-4cd1-b7aa-a9d4adeec28d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:28.305348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4cc5f0b8-492b-4f8f-9b94-4d6cc9e73557 req-5b2b99b9-52c0-4cd1-b7aa-a9d4adeec28d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:28.306173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4cc5f0b8-492b-4f8f-9b94-4d6cc9e73557 req-5b2b99b9-52c0-4cd1-b7aa-a9d4adeec28d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:28.364246 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4cc5f0b8-492b-4f8f-9b94-4d6cc9e73557 req-5b2b99b9-52c0-4cd1-b7aa-a9d4adeec28d service nova] Creating event network-changed:6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c for instance 53ff43c5-537d-4956-bcbe-8ee63136f03a on n-h1-854441-12 Oct 17 16:11:28.447245 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4cc5f0b8-492b-4f8f-9b94-4d6cc9e73557 req-5b2b99b9-52c0-4cd1-b7aa-a9d4adeec28d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.821168 Oct 17 16:11:28.452775 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3289/6314] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:11:28.493673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:28.500848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:28.546047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:28.547006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:28.547758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:28.550829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:28.557423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:28.557990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:28.576081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:28.667219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:28.699875 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1fa264f2-0e23-4593-bcf8-a6e537969dac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 1.613501 Oct 17 16:11:28.725147 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3026/6315] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:27 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:29.448966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:29.471416 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f804a63e-1d1b-479e-af26-4f997925f07c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1391 microversion: 2.1 time: 1.016487 Oct 17 16:11:29.472047 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3290/6316] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:28 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1391 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:29.760660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:29.765528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:29.787232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:29.788421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:29.789557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:29.791036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:29.795285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:29.796473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:30.382478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:30.405663 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d2a95a8b-8940-4b74-9d02-3a13b20fab3a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.671673 Oct 17 16:11:30.436013 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3027/6317] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:29 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:30.519721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:30.520444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:30.537343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:30.539379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:30.540754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:30.552833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:30.557957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:30.562535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:31.342097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:31.366385 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02abd2c8-025e-4d5c-afdc-82d483d2fc93 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1391 microversion: 2.1 time: 0.851522 Oct 17 16:11:31.367045 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3291/6318] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:30 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1391 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:31.452279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:31.453663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:31.482704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:31.489007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:31.492500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:31.493392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:31.493913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:31.494320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:32.414232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:32.415731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:32.449753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:32.451048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:32.453686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:32.455931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:32.457940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:32.459865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:32.463308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:32.521512 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ea0fbc7-8671-4b74-8a67-e1916f9f7882 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 1.071130 Oct 17 16:11:32.528377 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3028/6319] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:31 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:33.189756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:33.206593 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-69b2d664-fcf9-492d-b867-2fcdc64bf6e1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1391 microversion: 2.1 time: 0.796732 Oct 17 16:11:33.209040 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3292/6320] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:32 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1391 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:33.585332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:33.587713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:33.608989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:33.611297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:33.612440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:33.615236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:33.616505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:33.617589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:34.065534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:34.087473 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-55ec4110-2319-4705-bbe7-5fe027074ab6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.519661 Oct 17 16:11:34.106729 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3029/6321] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:33 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:34.246403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:34.248168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:34.263851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:34.274183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:34.275094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:34.276090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:34.278458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:34.279350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:34.766360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:34.797866 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c3fed24-e86a-4c90-8bba-6a2a64d1bded tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1391 microversion: 2.1 time: 0.555156 Oct 17 16:11:34.799169 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3293/6322] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:34 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1391 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:35.131158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:35.143481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:35.168483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:35.169370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:35.170155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:35.185479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:35.186185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:35.193920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:35.578744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:35.582945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:35.600883 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b588dc14-1897-4227-b8ad-f99d0cad9e4f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.477836 Oct 17 16:11:35.604947 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3030/6323] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:35 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:35.777875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-182063f7-ba8e-4d6d-9a49-766ed0ccb591 req-2f9e7bee-49b9-4c68-bf6d-25875a7f1255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ff43c5-537d-4956-bcbe-8ee63136f03a", "name": "network-vif-plugged", "status": "completed", "tag": "6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:35.811556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-182063f7-ba8e-4d6d-9a49-766ed0ccb591 req-2f9e7bee-49b9-4c68-bf6d-25875a7f1255 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:35.813888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-182063f7-ba8e-4d6d-9a49-766ed0ccb591 req-2f9e7bee-49b9-4c68-bf6d-25875a7f1255 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:35.816450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-182063f7-ba8e-4d6d-9a49-766ed0ccb591 req-2f9e7bee-49b9-4c68-bf6d-25875a7f1255 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:35.841314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:35.842431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:35.884533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:35.891970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:35.893784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:35.895277 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-182063f7-ba8e-4d6d-9a49-766ed0ccb591 req-2f9e7bee-49b9-4c68-bf6d-25875a7f1255 service nova] Creating event network-vif-plugged:6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c for instance 53ff43c5-537d-4956-bcbe-8ee63136f03a on n-h1-854441-12 Oct 17 16:11:35.898155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:35.900912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:35.908529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:35.929790 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-182063f7-ba8e-4d6d-9a49-766ed0ccb591 req-2f9e7bee-49b9-4c68-bf6d-25875a7f1255 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147710 Oct 17 16:11:35.933340 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3294/6324] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:11:36.345803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:36.366892 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6caa2338-bea4-4058-9069-428436ff755d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1391 microversion: 2.1 time: 0.534800 Oct 17 16:11:36.368444 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3031/6325] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:35 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1391 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:36.649671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:36.651653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:36.666086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:36.666968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:36.668965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:36.670781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:36.672154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:36.673990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:37.107365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:37.157401 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0695b38-2910-454c-9d16-7b80998bfb02 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1168 microversion: 2.1 time: 0.518188 Oct 17 16:11:37.161479 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3295/6326] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:36 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1168 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:37.393155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:37.393806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:37.410670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:37.412600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:37.414789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:37.415786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:37.417140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:37.418068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:37.832168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:37.841911 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c527d4b-4284-40f6-a754-12b16d799cc2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1391 microversion: 2.1 time: 0.452901 Oct 17 16:11:37.842565 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3032/6327] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:37 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1391 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:38.202087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:38.203538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:38.225085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:38.226059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:38.226810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:38.229007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:38.229901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:38.230716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:38.578874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:38.596792 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-17317c17-26ec-4407-add9-7f33aacd76c1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 0.402483 Oct 17 16:11:38.611204 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3296/6328] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:38 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:38.905019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:38.909687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:38.955540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:38.956525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:38.959598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:38.963405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:38.964558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:38.970720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:39.625157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:39.626879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:39.637281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:39.638169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:39.638963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:39.641515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:39.642455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:39.643344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:39.979824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:39.991482 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7124f6a8-08cd-4ca0-a9fc-7c7ff1f89b8b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 0.372715 Oct 17 16:11:39.994829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3297/6329] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:39 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:40.301491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:40.316902 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-79fb4549-3c0b-4c78-869a-757020178a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1563 microversion: 2.1 time: 1.430159 Oct 17 16:11:40.317858 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3033/6330] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:38 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1563 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:11:40.365907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:40.367394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:40.373770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:40.380735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:40.381974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:40.383095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:40.384715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:40.385896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:40.386974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:40.697907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:40.714349 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd9d53c1-093e-4bfd-b226-159518f072c3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1563 microversion: 2.1 time: 0.358876 Oct 17 16:11:40.726558 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3298/6331] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:40 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1563 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:41.023354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:41.024583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:41.044146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:41.068933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:41.070263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:41.071005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:41.072704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:41.074069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:41.075360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:41.813987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:41.847774 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-75314c69-cacd-46f8-a939-b665c05bce5c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 0.832013 Oct 17 16:11:41.851354 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3034/6332] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:41 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:42.889920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:42.891633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:42.924725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:42.925705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:42.926994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:42.931677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:42.932524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:42.933179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:44.052714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:44.062399 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d700554f-4f96-484b-ad90-2296ad9513c9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 1.178009 Oct 17 16:11:44.063825 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3299/6333] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:42 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:45.086054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:45.086741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:45.094293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:45.107412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:45.107886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:45.108705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:45.111251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:45.111782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:45.527050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:45.539462 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61268f12-a52e-4325-bbb5-a0e9290b316f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 0.457838 Oct 17 16:11:45.559389 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3035/6334] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:45 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:45.692814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:45.693676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:45.711968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:45.713095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:45.713685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:45.714124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d5cc7bf5-4478-418e-92ce-548344eff3e0 req-d3e876e8-01ae-4d53-aa6c-d85a594ef6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ff43c5-537d-4956-bcbe-8ee63136f03a", "tag": "6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:45.714863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:45.716036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:45.716887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:45.731400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d5cc7bf5-4478-418e-92ce-548344eff3e0 req-d3e876e8-01ae-4d53-aa6c-d85a594ef6af service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:45.731893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d5cc7bf5-4478-418e-92ce-548344eff3e0 req-d3e876e8-01ae-4d53-aa6c-d85a594ef6af service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:45.732330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d5cc7bf5-4478-418e-92ce-548344eff3e0 req-d3e876e8-01ae-4d53-aa6c-d85a594ef6af service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:45.763715 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d5cc7bf5-4478-418e-92ce-548344eff3e0 req-d3e876e8-01ae-4d53-aa6c-d85a594ef6af service nova] Creating event network-changed:6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c for instance 53ff43c5-537d-4956-bcbe-8ee63136f03a on n-h1-854441-12 Oct 17 16:11:45.779531 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d5cc7bf5-4478-418e-92ce-548344eff3e0 req-d3e876e8-01ae-4d53-aa6c-d85a594ef6af service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069183 Oct 17 16:11:45.780910 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3036/6335] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:11:46.272484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:46.293715 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a84b5edf-630d-4b20-b01f-9243313d99e8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1563 microversion: 2.1 time: 0.606299 Oct 17 16:11:46.300806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3300/6336] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:45 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1563 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:46.573843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:46.574696 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:46.596587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:46.599113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:46.602133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:46.603317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:46.607689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:46.608692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:47.758975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:47.771522 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9e720c84-47ac-4e60-840f-6135b9743315 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 1.203509 Oct 17 16:11:47.772597 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3037/6337] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:46 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:48.809841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:48.815802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:48.835602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:48.837283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:48.838632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:48.843311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:48.847419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:48.848826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:49.234807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:49.273801 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f60ba40b-f27c-4515-8d36-449b387d7bc7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 0.471341 Oct 17 16:11:49.275333 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3301/6338] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:48 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:50.324101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:50.325320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:50.384334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:50.385441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:50.386241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:50.387646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:50.399667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:50.400906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:51.023305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:51.062187 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bde9a5ff-be92-410d-9ab0-1707134d9131 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 0.745512 Oct 17 16:11:51.068368 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3038/6339] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:50 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:52.113229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:52.114267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:52.123768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:52.124650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:52.125183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:52.126017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:52.126774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:52.127348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:52.338680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-606fb6c3-c41b-4277-9a9d-5e286dda6992 req-3b4667bd-0489-48b1-9dd8-f96515817a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebdec11-217d-4360-8b73-d5ac9647bb56", "name": "network-vif-plugged", "status": "completed", "tag": "d257ce78-1e0b-4379-99bd-a36c9cd86622"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:11:52.365167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-606fb6c3-c41b-4277-9a9d-5e286dda6992 req-3b4667bd-0489-48b1-9dd8-f96515817a1f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:52.365694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-606fb6c3-c41b-4277-9a9d-5e286dda6992 req-3b4667bd-0489-48b1-9dd8-f96515817a1f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:52.366143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-606fb6c3-c41b-4277-9a9d-5e286dda6992 req-3b4667bd-0489-48b1-9dd8-f96515817a1f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:52.395321 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-606fb6c3-c41b-4277-9a9d-5e286dda6992 req-3b4667bd-0489-48b1-9dd8-f96515817a1f service nova] Creating event network-vif-plugged:d257ce78-1e0b-4379-99bd-a36c9cd86622 for instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 on n-h2-854441-12 Oct 17 16:11:52.426948 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-606fb6c3-c41b-4277-9a9d-5e286dda6992 req-3b4667bd-0489-48b1-9dd8-f96515817a1f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091229 Oct 17 16:11:52.428660 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3039/6340] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:11:52.652307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:52.693181 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfe68b23-4537-40e3-91c3-34b5cef8e23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 0.583967 Oct 17 16:11:52.696054 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3302/6341] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:52 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:53.723041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:53.723784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:53.739212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:53.740114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:53.741335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:53.742400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:53.743111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:53.744780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:54.190836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:54.199929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-98b54087-4b01-4097-b65a-bff72bc324fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1202 microversion: 2.1 time: 0.482911 Oct 17 16:11:54.204720 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3040/6342] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:53 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1202 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:55.230327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:55.231537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:55.245842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:55.246352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:55.246848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:55.247674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:55.248143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:55.248779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:55.676109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:55.678429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=88 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:11:55.687184 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b838cbc0-40c1-450c-b2b9-25db74e15cf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1388 microversion: 2.1 time: 0.461509 Oct 17 16:11:55.706400 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3303/6343] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:55 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1388 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:55.712259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:55.713101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:55.721215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:55.721716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:55.722376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:55.723511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:55.724196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:55.724845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:56.029133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:56.060666 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-34ec079c-8352-4b92-98d0-bb16a8fd90b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1388 microversion: 2.1 time: 0.352528 Oct 17 16:11:56.065097 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3041/6344] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:55 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1388 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:56.106240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:56.113170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:56.125359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:56.126639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:56.128306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:56.131251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:56.134591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:56.136949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:56.753432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:56.774817 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aadb9cb2-cc37-4570-a68b-954632459920 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1388 microversion: 2.1 time: 0.676474 Oct 17 16:11:56.791627 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3304/6345] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:56 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1388 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:56.978190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:56.980724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:57.006760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:57.020233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:57.021058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:57.022439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:57.023373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:57.024784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:57.111034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:11:57.321465 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-23a2b5fa-e2b0-4d51-a3e8-6e6516847cd2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 204 len: 0 microversion: 2.1 time: 0.359895 Oct 17 16:11:57.326824 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3042/6346] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:11:56 2022] DELETE /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:11:57.338151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:57.340667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:57.356964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:57.358321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:57.359437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:57.361495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:57.363062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:57.365391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:57.942831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:57.970271 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21065add-dd44-4948-ade0-04efe3ef8a15 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1394 microversion: 2.1 time: 0.637080 Oct 17 16:11:57.972281 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3305/6347] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:57 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1394 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:11:59.014252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:11:59.017100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:11:59.048076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:59.048950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:59.049579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:59.050530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:11:59.051175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:11:59.051792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:11:59.713113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:11:59.763185 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6b60f59e-842a-4c84-8f9f-e174dc71040a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1394 microversion: 2.1 time: 0.741647 Oct 17 16:11:59.778618 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3043/6348] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:11:59 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1394 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:12:00.412310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4695269f-d29b-413a-8268-1862f504c534 req-380a6fa2-9cdb-49b3-bfc9-1c3da92e2431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebdec11-217d-4360-8b73-d5ac9647bb56", "name": "network-vif-deleted", "tag": "d257ce78-1e0b-4379-99bd-a36c9cd86622"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:12:00.438045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4695269f-d29b-413a-8268-1862f504c534 req-380a6fa2-9cdb-49b3-bfc9-1c3da92e2431 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:00.438600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4695269f-d29b-413a-8268-1862f504c534 req-380a6fa2-9cdb-49b3-bfc9-1c3da92e2431 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:00.439040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4695269f-d29b-413a-8268-1862f504c534 req-380a6fa2-9cdb-49b3-bfc9-1c3da92e2431 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:00.495916 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4695269f-d29b-413a-8268-1862f504c534 req-380a6fa2-9cdb-49b3-bfc9-1c3da92e2431 service nova] Creating event network-vif-deleted:d257ce78-1e0b-4379-99bd-a36c9cd86622 for instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 on n-h2-854441-12 Oct 17 16:12:00.516656 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4695269f-d29b-413a-8268-1862f504c534 req-380a6fa2-9cdb-49b3-bfc9-1c3da92e2431 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109123 Oct 17 16:12:00.518513 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3306/6349] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:12:00.825186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:00.828577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:00.881726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:00.888693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:00.895597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:00.897034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:00.897880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:00.902855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:01.090644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:01.108634 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-88820174-a872-41ef-be63-9e68de07c3c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1187 microversion: 2.1 time: 0.287078 Oct 17 16:12:01.125947 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3044/6350] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:00 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1187 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:02.142380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:02.144883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:02.190695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:02.197709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:02.199263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:02.200819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:02.205383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:02.206558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:02.334134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c508be29-afa9-417c-ac58-fff4c8b487ed tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:12:02.342385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c508be29-afa9-417c-ac58-fff4c8b487ed tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:02.378775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c508be29-afa9-417c-ac58-fff4c8b487ed tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:02.379295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c508be29-afa9-417c-ac58-fff4c8b487ed tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:02.389650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c508be29-afa9-417c-ac58-fff4c8b487ed tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:02.399015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c508be29-afa9-417c-ac58-fff4c8b487ed tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:02.403293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c508be29-afa9-417c-ac58-fff4c8b487ed tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:02.407399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c508be29-afa9-417c-ac58-fff4c8b487ed tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:02.589749 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c508be29-afa9-417c-ac58-fff4c8b487ed tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action" status: 200 len: 24576 microversion: 2.1 time: 0.259455 Oct 17 16:12:02.591044 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3045/6351] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:12:02 2022] POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action => generated 24576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:12:02.603157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:02.638678 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-14c532e4-9eb2-4461-be09-f56dd04afe97 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1187 microversion: 2.1 time: 0.507467 Oct 17 16:12:02.652187 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3307/6352] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:02 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1187 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:03.698288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:03.700681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:03.738826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:03.741959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:03.742705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:03.751207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:03.753740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:03.754338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:03.931715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:03.946275 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e30bcc61-33c6-434f-ab9d-43ae7d9c7ad3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1187 microversion: 2.1 time: 0.265232 Oct 17 16:12:03.949969 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3046/6353] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:03 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1187 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:04.992755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:04.993603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:05.007696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:05.009170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:05.011243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:05.012273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:05.014292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:05.015090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:05.270207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:05.299620 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-07397385-993d-460c-b36f-2b90fa6ebaba tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1187 microversion: 2.1 time: 0.310886 Oct 17 16:12:05.301097 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3308/6354] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:04 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1187 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:06.349688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:06.351005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:06.405488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:06.411430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:06.414231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:06.420304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:06.425373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:06.431223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:06.453200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:12:06.696452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:06.747867 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6a9e539f-009a-4115-9db4-1c654949bf3e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1187 microversion: 2.1 time: 0.405424 Oct 17 16:12:06.751292 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3047/6355] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:06 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1187 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:07.800116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:07.800784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:07.821982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:07.823127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:07.823675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:07.826225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:07.827174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:07.830409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:07.981787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:08.016342 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-817f8a09-bc32-4cec-9faf-a75c00c6215b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1187 microversion: 2.1 time: 0.221066 Oct 17 16:12:08.018098 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3309/6356] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:07 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1187 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:08.964639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e05e4f6-64da-4e6d-be75-4088fe072f36 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:08.969355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e05e4f6-64da-4e6d-be75-4088fe072f36 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:09.010722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e05e4f6-64da-4e6d-be75-4088fe072f36 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:09.014672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e05e4f6-64da-4e6d-be75-4088fe072f36 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:09.018454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e05e4f6-64da-4e6d-be75-4088fe072f36 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:09.023019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e05e4f6-64da-4e6d-be75-4088fe072f36 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:09.024965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e05e4f6-64da-4e6d-be75-4088fe072f36 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:09.027923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e05e4f6-64da-4e6d-be75-4088fe072f36 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:09.041514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:09.043845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:09.056567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:09.060229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:09.060967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:09.064423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:09.066747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:09.067572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:09.196419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:09.211275 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-832c02b0-6548-4872-b701-955399ec6d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1187 microversion: 2.1 time: 0.171420 Oct 17 16:12:09.214751 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3310/6357] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:09 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1187 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:09.890085 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e05e4f6-64da-4e6d-be75-4088fe072f36 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1835 microversion: 2.1 time: 0.933815 Oct 17 16:12:09.895269 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3048/6358] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:08 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1835 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:09.921999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:09.923376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:09.936770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:09.937272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:09.937909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:09.938881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:09.939348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:09.939772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:10.238658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:10.239479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:10.257512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:10.258033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:10.263332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:10.264611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:10.266137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:10.267356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:10.381614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:10.383963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:10.386594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:10.388587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lazy-loading 'fault' on Instance uuid 9ebdec11-217d-4360-8b73-d5ac9647bb56 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:12:10.401617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:10.410747 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-642cae7f-c258-45a5-a13e-6efac62b7597 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1682 microversion: 2.1 time: 0.492625 Oct 17 16:12:10.423054 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3311/6359] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:09 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1682 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:10.530918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:10.546428 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d02f56ef-4b1b-4983-b8c7-590f31bd32ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 200 len: 1192 microversion: 2.1 time: 0.312015 Oct 17 16:12:10.550385 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3049/6360] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:10 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 1192 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:10.965500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-41c4a560-6322-4e4c-a505-8b9c9ff67698 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:12:10.975879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-41c4a560-6322-4e4c-a505-8b9c9ff67698 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:10.978856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=28 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:12:10.992778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41c4a560-6322-4e4c-a505-8b9c9ff67698 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:10.994168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41c4a560-6322-4e4c-a505-8b9c9ff67698 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:10.995011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41c4a560-6322-4e4c-a505-8b9c9ff67698 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:10.995975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41c4a560-6322-4e4c-a505-8b9c9ff67698 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:10.997014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41c4a560-6322-4e4c-a505-8b9c9ff67698 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:10.998285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-41c4a560-6322-4e4c-a505-8b9c9ff67698 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:11.169794 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-41c4a560-6322-4e4c-a505-8b9c9ff67698 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action" status: 200 len: 32646 microversion: 2.1 time: 0.208242 Oct 17 16:12:11.177502 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3312/6361] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:12:10 2022] POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action => generated 32646 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:12:11.328326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:12:11.329076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:11.333050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:12:11.339756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:11.340639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:11.343221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:11.348677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:11.349543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:11.350204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:11.528388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a87be9615f2542c5938c6dbb70e9d83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7720b1e460a4e639067686ccde58a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:11.529366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] flavor_id is None. Assuming migration. {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 16:12:11.530100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:12:11.589018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:11.590429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:11.600456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:11.601306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:11.601935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:11.602884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:11.603519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:11.604112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:11.624462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 HTTP/1.1 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '9ebdec11-217d-4360-8b73-d5ac9647bb56'} Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:12:11.627031 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:11.632680 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:12:11.632680 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:12:11.632680 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:12:11.632680 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:12:11.632680 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:12:11.632680 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:11.632680 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:11.634431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:12:11.636770 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-924b08f7-bb3d-4991-89e9-e892dc6ccbd8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 404 len: 111 microversion: 2.1 time: 0.063906 Oct 17 16:12:11.638079 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3313/6362] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:11 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:12:12.546849 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-897b7718-7147-41d9-9465-af6165f153c5 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action" status: 202 len: 0 microversion: 2.1 time: 1.222485 Oct 17 16:12:12.563025 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3050/6363] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:12:11 2022] POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action => generated 0 bytes in 1235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:12:12.569743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:12.570798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:12.604561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:12.605262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:12.605621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:12.610063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:12.617210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:12.618022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:13.996570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:14.017044 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68f434c9-e840-4949-959d-5058a9b6d0be tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1691 microversion: 2.1 time: 1.452328 Oct 17 16:12:14.022837 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3314/6364] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:12 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1691 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:15.084594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:15.097968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:15.162337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:15.167582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:15.174064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:15.175537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:15.190326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:15.196936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:16.039162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:16.052572 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-593aef5e-0959-483c-94eb-be67d06cc42c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1691 microversion: 2.1 time: 0.986569 Oct 17 16:12:16.053864 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3051/6365] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:15 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1691 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:17.098831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:17.101908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:17.185688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:17.192124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:17.193326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:17.203365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:17.208108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:17.208621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:17.653535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:17.666251 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a5bd8c07-c362-4a91-92e5-888aec99259a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1691 microversion: 2.1 time: 0.576096 Oct 17 16:12:17.674756 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3315/6366] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:17 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1691 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:17.802190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:17.803157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:17.827859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:17.834478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:17.835119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:17.836251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:17.841522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:17.843523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:17.915540 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 HTTP/1.1 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '9ebdec11-217d-4360-8b73-d5ac9647bb56'} Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:12:17.919625 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:12:17.932605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:12:17.947161 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b4a02e61-6491-4ec5-9d32-67a16c631f0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 404 len: 111 microversion: 2.1 time: 0.123994 Oct 17 16:12:17.955817 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3052/6367] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:12:17 2022] DELETE /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:12:17.975732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:17.979737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 9ebdec11-217d-4360-8b73-d5ac9647bb56] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:18.019977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:18.026198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:18.029471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:18.031823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:18.045763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:18.048561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:18.102998 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 HTTP/1.1 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '9ebdec11-217d-4360-8b73-d5ac9647bb56'} Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:12:18.106855 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:18.112611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:12:18.112611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:12:18.112611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:12:18.112611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:12:18.112611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:12:18.112611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. Oct 17 16:12:18.112611 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:12:18.121012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance 9ebdec11-217d-4360-8b73-d5ac9647bb56 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:12:18.125556 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b91d5e1d-8dac-4968-aa9d-be42a69d8843 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56" status: 404 len: 111 microversion: 2.1 time: 0.168062 Oct 17 16:12:18.128920 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3316/6368] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:17 2022] GET /compute/v2.1/servers/9ebdec11-217d-4360-8b73-d5ac9647bb56 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:12:18.695634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:18.697612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:18.713772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:18.714296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:18.714836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:18.719973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:18.721056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:18.721852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:20.025190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:20.037013 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-212afa2d-0ee9-40fa-9598-1c38d65cde05 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1691 microversion: 2.1 time: 1.346978 Oct 17 16:12:20.041398 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3053/6369] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:18 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1691 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:21.066421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:21.078371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:21.095477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:21.095976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:21.096428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:21.097161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:21.097614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:21.098035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:21.471726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:21.500035 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e546f1d-20b0-4549-8406-b05c53767db7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1696 microversion: 2.1 time: 0.438823 Oct 17 16:12:21.500659 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3317/6370] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:21 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1696 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:22.530159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:22.531201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:22.539869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:22.540374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:22.540847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:22.541587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:22.542056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:22.542493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:22.974901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:22.991929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ca067e7-8365-44cb-900f-1db9c12566b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1696 microversion: 2.1 time: 0.467495 Oct 17 16:12:22.999880 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3054/6371] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:22 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1696 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:24.058431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:24.062017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:24.093847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:24.094911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:24.095840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:24.097443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:24.099119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:24.101610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:24.833805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:24.843509 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86dfcbf4-48eb-4376-8401-caeb2c0d19ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1696 microversion: 2.1 time: 0.794484 Oct 17 16:12:24.863549 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3318/6372] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:24 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1696 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:12:25.876584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:25.877239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:25.902912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:25.905485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:25.907802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:25.912554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:25.915485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:25.916307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:26.425384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:26.451525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dceca4ac-fa60-4afa-bf6c-81efa992d5c7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1696 microversion: 2.1 time: 0.569370 Oct 17 16:12:26.464218 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3055/6373] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:25 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1696 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:12:27.474104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:27.476007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:27.526669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:27.528633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:27.546431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:27.575013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:27.592512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:27.612938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:27.848518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=78 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:12:29.464255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:29.503498 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c29fd332-36a6-40ef-be81-66c5bc470795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1696 microversion: 2.1 time: 2.032138 Oct 17 16:12:29.506893 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3319/6374] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:27 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1696 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:30.536455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:30.537872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:30.559986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:30.560720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:30.561448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:30.562428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:30.563132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:30.563790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:31.059193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:31.090038 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-058f27eb-1a66-4fca-9d9a-ccafd76b1c84 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1696 microversion: 2.1 time: 0.551548 Oct 17 16:12:31.091084 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3056/6375] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:30 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1696 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:32.123285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:32.130715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:32.161724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:32.166486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:32.170980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:32.171910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:32.172418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:32.178196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:32.860466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:32.910201 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-19169b4a-8dea-4ae9-ac54-0dfc174aa7f2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1696 microversion: 2.1 time: 0.793933 Oct 17 16:12:32.920190 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3320/6376] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:32 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1696 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:33.962229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:33.963637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:33.990897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:33.996564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:34.000221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:34.006455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:34.012882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:34.014451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:34.502047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:34.572705 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f825a15-e636-4864-8878-6bd6dd52d77d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1695 microversion: 2.1 time: 0.614447 Oct 17 16:12:34.573492 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3057/6377] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:33 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1695 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:12:34.722001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f9698ac3-05da-41d6-ba31-e1e3b8130b0a req-6cdc1db8-16ea-4bf2-820e-b4cdfa592a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ff43c5-537d-4956-bcbe-8ee63136f03a", "name": "network-vif-unplugged", "status": "completed", "tag": "6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:12:34.794972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f9698ac3-05da-41d6-ba31-e1e3b8130b0a req-6cdc1db8-16ea-4bf2-820e-b4cdfa592a0e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:34.796765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f9698ac3-05da-41d6-ba31-e1e3b8130b0a req-6cdc1db8-16ea-4bf2-820e-b4cdfa592a0e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:34.797904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f9698ac3-05da-41d6-ba31-e1e3b8130b0a req-6cdc1db8-16ea-4bf2-820e-b4cdfa592a0e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:34.891815 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f9698ac3-05da-41d6-ba31-e1e3b8130b0a req-6cdc1db8-16ea-4bf2-820e-b4cdfa592a0e service nova] Creating event network-vif-unplugged:6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c for instance 53ff43c5-537d-4956-bcbe-8ee63136f03a on n-h2-854441-12 Oct 17 16:12:34.925705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-f9698ac3-05da-41d6-ba31-e1e3b8130b0a req-6cdc1db8-16ea-4bf2-820e-b4cdfa592a0e service nova] Instance 53ff43c5-537d-4956-bcbe-8ee63136f03a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:12:34.982962 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f9698ac3-05da-41d6-ba31-e1e3b8130b0a req-6cdc1db8-16ea-4bf2-820e-b4cdfa592a0e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.263640 Oct 17 16:12:34.984483 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3321/6378] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:12:35.625970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:35.631675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:35.653228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:35.654821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:35.660648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:35.662340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:35.663569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:35.664396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:36.397757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:36.440021 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b3564e5-acc2-4728-ab85-524dbea7fdbf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1695 microversion: 2.1 time: 0.830486 Oct 17 16:12:36.458099 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3058/6379] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:35 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1695 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:37.393563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-488a3c82-d62a-477a-bcf6-736c5c28b076 req-657f8a73-c762-40f0-9d78-d5c4c3e88f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ff43c5-537d-4956-bcbe-8ee63136f03a", "tag": "6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:12:37.425078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-488a3c82-d62a-477a-bcf6-736c5c28b076 req-657f8a73-c762-40f0-9d78-d5c4c3e88f64 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:37.425913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-488a3c82-d62a-477a-bcf6-736c5c28b076 req-657f8a73-c762-40f0-9d78-d5c4c3e88f64 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:37.426587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-488a3c82-d62a-477a-bcf6-736c5c28b076 req-657f8a73-c762-40f0-9d78-d5c4c3e88f64 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:37.464506 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-488a3c82-d62a-477a-bcf6-736c5c28b076 req-657f8a73-c762-40f0-9d78-d5c4c3e88f64 service nova] Creating event network-changed:6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c for instance 53ff43c5-537d-4956-bcbe-8ee63136f03a on n-h2-854441-12 Oct 17 16:12:37.484606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-488a3c82-d62a-477a-bcf6-736c5c28b076 req-657f8a73-c762-40f0-9d78-d5c4c3e88f64 service nova] Instance 53ff43c5-537d-4956-bcbe-8ee63136f03a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:12:37.493664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:37.495114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:37.525290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:37.526968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:37.528081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:37.529610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:37.530463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:37.531286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:37.545477 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-488a3c82-d62a-477a-bcf6-736c5c28b076 req-657f8a73-c762-40f0-9d78-d5c4c3e88f64 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167649 Oct 17 16:12:37.551725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:12:37.557402 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3322/6380] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:12:39.873384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:39.915102 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-47c6fde3-94ca-4abc-aed9-b2c38ff9b21b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1695 microversion: 2.1 time: 2.424712 Oct 17 16:12:39.953654 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3059/6381] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:37 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1695 bytes in 2465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:12:40.980656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:40.986997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:41.011764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=22 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:12:41.026218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:41.027226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:41.028980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:41.033847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:41.036688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:41.037573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:41.622968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:41.662063 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4163151-7b2c-4e5c-b617-0850b4e77d3f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1695 microversion: 2.1 time: 0.691145 Oct 17 16:12:41.664101 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3323/6382] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:40 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1695 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:42.702363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:42.703111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:42.713459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=22 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:12:42.723504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:42.725788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:42.730593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:42.734315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:42.735356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:42.736032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:43.183666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:43.211896 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cef8612c-70af-42a8-ae68-58561d876299 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1693 microversion: 2.1 time: 0.513363 Oct 17 16:12:43.213070 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3060/6383] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:42 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1693 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:44.238312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:44.240983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:44.274775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:44.276063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:44.279612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:44.280759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:44.282610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:44.283404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:44.634305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:44.646186 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98701ff3-3717-404b-9798-1223f25baa53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1690 microversion: 2.1 time: 0.412849 Oct 17 16:12:44.678178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed4867bd-5906-4766-8aa0-95b98e0173f4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:12:44.680864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed4867bd-5906-4766-8aa0-95b98e0173f4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:44.686677 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3324/6384] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:44 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1690 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:12:44.691215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed4867bd-5906-4766-8aa0-95b98e0173f4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:44.691725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed4867bd-5906-4766-8aa0-95b98e0173f4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:44.692173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed4867bd-5906-4766-8aa0-95b98e0173f4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:44.692953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed4867bd-5906-4766-8aa0-95b98e0173f4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:44.693400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed4867bd-5906-4766-8aa0-95b98e0173f4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:44.693842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed4867bd-5906-4766-8aa0-95b98e0173f4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:44.883570 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed4867bd-5906-4766-8aa0-95b98e0173f4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action" status: 204 len: 0 microversion: 2.1 time: 0.208967 Oct 17 16:12:44.899760 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3061/6385] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:12:44 2022] POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:12:44.911468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:44.912715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:44.924366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:44.925338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:44.926096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:44.927779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:44.928530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:44.929366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:45.558998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:45.573936 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f66d61a4-bb4b-4cce-93d7-e89310034850 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1690 microversion: 2.1 time: 0.668210 Oct 17 16:12:45.576446 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3325/6386] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:44 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1690 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:46.605373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:46.606302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:46.629857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:46.630273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:46.643754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:46.645906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:46.647662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:46.648308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:47.094987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:47.122562 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-21f93bb1-c9e8-4ab8-bef6-b8dd67df390e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1690 microversion: 2.1 time: 0.516329 Oct 17 16:12:47.129811 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3062/6387] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:46 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1690 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:48.174438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:48.182934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:48.220542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:48.230845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:48.235026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:48.239040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:48.244555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:48.246224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:48.705088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:48.720942 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15982106-3682-4479-b1bc-63e5b36f6f6b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1690 microversion: 2.1 time: 0.570704 Oct 17 16:12:48.722475 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3326/6388] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:48 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1690 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:49.748130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:49.749894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:49.780357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:49.782454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:49.784364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:49.786060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:49.790337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:49.792342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:50.489442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:50.536628 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-292ede3c-a050-4068-9847-22bbcb9d9b38 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1682 microversion: 2.1 time: 0.787449 Oct 17 16:12:50.538394 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3063/6389] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:49 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1682 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:12:50.734713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-94bbc773-0de8-47a4-98d7-c1a3938daf86 req-96958e72-fd1b-4faa-a4d9-3bba1d32b214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ff43c5-537d-4956-bcbe-8ee63136f03a", "name": "network-vif-plugged", "status": "completed", "tag": "6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:12:50.763436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-94bbc773-0de8-47a4-98d7-c1a3938daf86 req-96958e72-fd1b-4faa-a4d9-3bba1d32b214 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:50.764294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-94bbc773-0de8-47a4-98d7-c1a3938daf86 req-96958e72-fd1b-4faa-a4d9-3bba1d32b214 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:50.766447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-94bbc773-0de8-47a4-98d7-c1a3938daf86 req-96958e72-fd1b-4faa-a4d9-3bba1d32b214 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:50.805247 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-94bbc773-0de8-47a4-98d7-c1a3938daf86 req-96958e72-fd1b-4faa-a4d9-3bba1d32b214 service nova] Creating event network-vif-plugged:6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c for instance 53ff43c5-537d-4956-bcbe-8ee63136f03a on n-h2-854441-12 Oct 17 16:12:50.816231 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-94bbc773-0de8-47a4-98d7-c1a3938daf86 req-96958e72-fd1b-4faa-a4d9-3bba1d32b214 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088618 Oct 17 16:12:50.817324 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3327/6390] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:12:51.694521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2122969598", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "05a54f74-f434-481c-a44e-9da3bb301a5b"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:12:58.435680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] validate_networks() for [('05a54f74-f434-481c-a44e-9da3bb301a5b', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:12:59.006986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:12:59.008680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:12:59.009881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:12:59.010978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:12:59.011821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:12:59.028124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:59.028977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:59.029747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:59.031199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:12:59.032690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:12:59.033730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:12:59.070186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Getting quotas for project b54c15aee5ad4bd492538242b9feddbb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:12:59.083040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Getting quotas for user 3f8ccabf596f47dd96b9bb2f05582953 and project b54c15aee5ad4bd492538242b9feddbb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:12:59.116658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:12:59.124843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:12:59.223521 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c667e4ba-d6f8-49e8-8e54-ea83f6477e4b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.533060 Oct 17 16:12:59.226699 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3064/6391] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:12:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 7541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 16:12:59.237521 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:12:59.238171 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:12:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 (ip 10.222.0.87) !!! Oct 17 16:12:59.243951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b885c0c-a69a-4d06-88b3-8c43ee2f9972 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:12:59.244670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b885c0c-a69a-4d06-88b3-8c43ee2f9972 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:12:59.882968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b885c0c-a69a-4d06-88b3-8c43ee2f9972 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:12:59.898992 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b885c0c-a69a-4d06-88b3-8c43ee2f9972 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1214 microversion: 2.1 time: 0.665550 Oct 17 16:12:59.901831 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3328/6392] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:12:59 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1214 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:00.930174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:00.932877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:00.952082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:00.953404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:00.958776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:00.960372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:00.961298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:00.962176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:01.802088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:01.825963 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-756bde58-e7cf-4c64-9769-8dd9fb055bf7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1266 microversion: 2.1 time: 0.903040 Oct 17 16:13:01.826999 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3065/6393] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:00 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1266 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:02.882947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:02.883646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:02.894107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=45 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:02.918056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:02.919730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:02.924163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:02.926166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:02.929111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:02.929765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:03.325649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:03.359191 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bec15f69-fea8-4555-83da-18c1bf91f490 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1314 microversion: 2.1 time: 0.492710 Oct 17 16:13:03.361593 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3329/6394] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:02 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:04.310079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d594390c-5ee5-4eb8-ad24-d97d50a3273d req-bbb22917-7785-471c-ae5e-02dc01910e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f993203-5e46-44a6-81d0-47d5081f4339", "tag": "2536e0e5-dcc7-4952-96f2-26da0c7a0ccb"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:04.363917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d594390c-5ee5-4eb8-ad24-d97d50a3273d req-bbb22917-7785-471c-ae5e-02dc01910e22 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:04.364841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d594390c-5ee5-4eb8-ad24-d97d50a3273d req-bbb22917-7785-471c-ae5e-02dc01910e22 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:04.365447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d594390c-5ee5-4eb8-ad24-d97d50a3273d req-bbb22917-7785-471c-ae5e-02dc01910e22 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:04.382066 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d594390c-5ee5-4eb8-ad24-d97d50a3273d req-bbb22917-7785-471c-ae5e-02dc01910e22 service nova] Creating event network-changed:2536e0e5-dcc7-4952-96f2-26da0c7a0ccb for instance 3f993203-5e46-44a6-81d0-47d5081f4339 on n-h2-854441-12 Oct 17 16:13:04.398467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:04.400299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:04.402240 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d594390c-5ee5-4eb8-ad24-d97d50a3273d req-bbb22917-7785-471c-ae5e-02dc01910e22 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105262 Oct 17 16:13:04.404446 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3066/6395] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:04.414995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:04.415499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:04.424136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:04.424961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:04.425440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:04.425864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:04.720774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:04.741913 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd14c2b9-8f21-4a3e-afdc-1d2545348e87 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1314 microversion: 2.1 time: 0.355881 Oct 17 16:13:04.743303 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3330/6396] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:04 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:05.786892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:05.789580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:05.806025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:05.806795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:05.807818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:05.809366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:05.810572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:05.811604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:06.067099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:06.083875 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bbd2eb96-4458-49f3-9d6a-7e438006ef99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1314 microversion: 2.1 time: 0.305351 Oct 17 16:13:06.086298 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3067/6397] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:05 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:07.109726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:07.110530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:07.129106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:07.130566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:07.132494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:07.135970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:07.137374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:07.138778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:07.490643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:07.511863 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bd4e6ec-d160-4fff-9362-9c0a0e17fe48 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1314 microversion: 2.1 time: 0.406188 Oct 17 16:13:07.514032 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3331/6398] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:07 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:08.550566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:08.551883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:08.568845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:08.569685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:08.570299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:08.571333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:08.571804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:08.572483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:08.576579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:08.815105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:08.879786 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ce0b73dd-2f75-4c73-a450-2ebe478a4004 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1314 microversion: 2.1 time: 0.332048 Oct 17 16:13:08.883055 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3068/6399] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:08 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:09.331823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1075257570", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bade7c79-713b-417f-9daa-877b183f78bf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "916c7d18-0cf6-4aa6-bd9b-213b6c12b936"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:09.432882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] validate_networks() for [('916c7d18-0cf6-4aa6-bd9b-213b6c12b936', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:13:09.896466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:09.917532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:09.922539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:09.938692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:09.941872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:09.948125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:09.949465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:09.950622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:09.952265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:09.954952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:09.955768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:10.082039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:13:10.083221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:13:10.084406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:13:10.085631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:13:10.086679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:13:10.137442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:10.139579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:10.140914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:10.143760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:10.145264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:10.146641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:10.189511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:13:10.205323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for user a7647fbb42444923aa218f5579dd30a0 and project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:13:10.278409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:10.290388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d2675806-4c69-45bd-bc21-7dfeb40c0ef3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1314 microversion: 2.1 time: 0.386871 Oct 17 16:13:10.316987 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3069/6400] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:09 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:10.395084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:13:10.401861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bade7c79-713b-417f-9daa-877b183f78bf',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:13:10.537855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5c6c16df-e2ec-4312-9404-b5f0c95d7c6e req-d121314b-8f6d-4b3c-9707-1fc3af7947bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f993203-5e46-44a6-81d0-47d5081f4339", "name": "network-vif-plugged", "status": "completed", "tag": "2536e0e5-dcc7-4952-96f2-26da0c7a0ccb"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:10.558254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5c6c16df-e2ec-4312-9404-b5f0c95d7c6e req-d121314b-8f6d-4b3c-9707-1fc3af7947bf service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:10.559092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5c6c16df-e2ec-4312-9404-b5f0c95d7c6e req-d121314b-8f6d-4b3c-9707-1fc3af7947bf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:10.560505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5c6c16df-e2ec-4312-9404-b5f0c95d7c6e req-d121314b-8f6d-4b3c-9707-1fc3af7947bf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:10.587930 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5c6c16df-e2ec-4312-9404-b5f0c95d7c6e req-d121314b-8f6d-4b3c-9707-1fc3af7947bf service nova] Creating event network-vif-plugged:2536e0e5-dcc7-4952-96f2-26da0c7a0ccb for instance 3f993203-5e46-44a6-81d0-47d5081f4339 on n-h2-854441-12 Oct 17 16:13:10.600241 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5c6c16df-e2ec-4312-9404-b5f0c95d7c6e req-d121314b-8f6d-4b3c-9707-1fc3af7947bf service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073142 Oct 17 16:13:10.602259 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3070/6401] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:10.791085 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8b132b2b-5db7-4287-a08b-57baf026a815 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466445 Oct 17 16:13:10.814026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a5aacbb-b5b1-4eff-a00e-154586f89954 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:10.815100 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3332/6402] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:13:10.816210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a5aacbb-b5b1-4eff-a00e-154586f89954 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:10.956080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8a5aacbb-b5b1-4eff-a00e-154586f89954 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:10.980478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ae669bc-1f9b-490e-99ed-133a7dfef459 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:11.009382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ae669bc-1f9b-490e-99ed-133a7dfef459 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:11.009647 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a5aacbb-b5b1-4eff-a00e-154586f89954 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1071 microversion: 2.1 time: 0.199811 Oct 17 16:13:11.012329 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3071/6403] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:10 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1071 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:11.060886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:11.065131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae669bc-1f9b-490e-99ed-133a7dfef459 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:11.070740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae669bc-1f9b-490e-99ed-133a7dfef459 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:11.071591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae669bc-1f9b-490e-99ed-133a7dfef459 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:11.072845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae669bc-1f9b-490e-99ed-133a7dfef459 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:11.073666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae669bc-1f9b-490e-99ed-133a7dfef459 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:11.074398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1ae669bc-1f9b-490e-99ed-133a7dfef459 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:11.208504 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ae669bc-1f9b-490e-99ed-133a7dfef459 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action" status: 200 len: 24577 microversion: 2.1 time: 0.235173 Oct 17 16:13:11.219877 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3333/6404] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:13:10 2022] POST /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a/action => generated 24577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:13:11.330637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:11.331332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:11.354825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:11.355584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:11.356691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:11.358857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:11.360149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:11.360913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:11.638922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:11.657733 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-03157573-bad4-40fa-a950-82f28897b59b tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1314 microversion: 2.1 time: 0.330917 Oct 17 16:13:11.659385 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3072/6405] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:11 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:12.067280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:12.069597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:12.101256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:12.102115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:12.103302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:12.104540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:12.105651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:12.106350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:12.286322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:12.307793 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4f945b3-b102-4fa3-a0ed-5e7479eb57db tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1169 microversion: 2.1 time: 0.255717 Oct 17 16:13:12.309503 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3334/6406] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:12 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1169 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:12.699253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:12.702803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:12.740989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:12.742025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:12.742531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:12.743557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:12.744348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:12.745712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:13.038145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:13.058253 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0cef0b3c-f6d2-4d73-a34e-45832b2977df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1497 microversion: 2.1 time: 0.367983 Oct 17 16:13:13.060173 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3073/6407] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:12 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1497 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:13.357508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:13.358693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:13.380300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:13.381180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:13.383730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:13.384896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:13.385600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:13.386402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:13.707229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:13.724432 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-435cbb1c-57d2-4087-acc9-77a6fe1ff281 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1187 microversion: 2.1 time: 0.370937 Oct 17 16:13:13.725736 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3335/6408] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:13 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1187 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:14.088344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:14.089555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:14.093813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:14.112365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:14.113377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:14.115342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:14.116318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:14.120344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:14.122311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:14.222715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:13:14.429694 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9d03549b-3adc-4ee7-b825-cc81fe9107df tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 204 len: 0 microversion: 2.1 time: 0.344893 Oct 17 16:13:14.436922 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3074/6409] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:13:14 2022] DELETE /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:13:14.445646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:14.446954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:14.486038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:14.486924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:14.487678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:14.488955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:14.489738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:14.513570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:14.776133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:14.784349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:14.839836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:14.842594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:14.854304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:14.864239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:14.867935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:14.869136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:15.003819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:15.049057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f98c6639-78ed-49dd-9dbd-dd201c16c560 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1503 microversion: 2.1 time: 0.607349 Oct 17 16:13:15.058629 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3336/6410] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:14 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1503 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:15.184699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:15.225687 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92dd861f-be28-4b04-a19f-2089806bc083 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1229 microversion: 2.1 time: 0.458708 Oct 17 16:13:15.231400 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3075/6411] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:14 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1229 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:16.093718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:16.095848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:16.129357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:16.130737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:16.131818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:16.133395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:16.134561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:16.135527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:16.285748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:16.288136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:16.340952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:16.342611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:16.350955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:16.359029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:16.360680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:16.362026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:16.895660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:16.904861 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f214bf18-0a26-46ef-a9c3-5f7fb204ec97 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1503 microversion: 2.1 time: 0.818196 Oct 17 16:13:16.911526 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3337/6412] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:16 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1503 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:17.016283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cc0777ee-bdcd-44a2-a530-1d7004570ede req-63620a0b-26d6-4696-a316-7dc91542f5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63a3f1b-92b5-495d-81d1-ea86638e2534", "tag": "fd5a069d-653d-4625-9618-c10cc0d9eb76"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:17.052370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cc0777ee-bdcd-44a2-a530-1d7004570ede req-63620a0b-26d6-4696-a316-7dc91542f5e2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:17.053388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cc0777ee-bdcd-44a2-a530-1d7004570ede req-63620a0b-26d6-4696-a316-7dc91542f5e2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:17.054071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cc0777ee-bdcd-44a2-a530-1d7004570ede req-63620a0b-26d6-4696-a316-7dc91542f5e2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:17.086720 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cc0777ee-bdcd-44a2-a530-1d7004570ede req-63620a0b-26d6-4696-a316-7dc91542f5e2 service nova] Creating event network-changed:fd5a069d-653d-4625-9618-c10cc0d9eb76 for instance d63a3f1b-92b5-495d-81d1-ea86638e2534 on n-h1-854441-12 Oct 17 16:13:17.099418 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cc0777ee-bdcd-44a2-a530-1d7004570ede req-63620a0b-26d6-4696-a316-7dc91542f5e2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086858 Oct 17 16:13:17.105087 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3338/6413] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:17.128929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:17.162751 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-690a2f4f-896a-4d58-a539-eb0021ef7ba3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1229 microversion: 2.1 time: 0.904922 Oct 17 16:13:17.178558 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3076/6414] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:16 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1229 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:17.587242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2f35be95-7b12-48c9-a65d-0a13beff8d2c tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:17.588241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2b1dcb48-a974-43e3-87ea-ff65047646e5 req-4e1401d3-dcc4-4483-a8a0-58433a7a2ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f993203-5e46-44a6-81d0-47d5081f4339", "name": "network-vif-deleted", "tag": "2536e0e5-dcc7-4952-96f2-26da0c7a0ccb"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:17.591717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2f35be95-7b12-48c9-a65d-0a13beff8d2c tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:17.659392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f35be95-7b12-48c9-a65d-0a13beff8d2c tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:17.664874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f35be95-7b12-48c9-a65d-0a13beff8d2c tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:17.667751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f35be95-7b12-48c9-a65d-0a13beff8d2c tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:17.672812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f35be95-7b12-48c9-a65d-0a13beff8d2c tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:17.681289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f35be95-7b12-48c9-a65d-0a13beff8d2c tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:17.682218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f35be95-7b12-48c9-a65d-0a13beff8d2c tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:17.683282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2b1dcb48-a974-43e3-87ea-ff65047646e5 req-4e1401d3-dcc4-4483-a8a0-58433a7a2ee9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:17.684496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2b1dcb48-a974-43e3-87ea-ff65047646e5 req-4e1401d3-dcc4-4483-a8a0-58433a7a2ee9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:17.688575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2b1dcb48-a974-43e3-87ea-ff65047646e5 req-4e1401d3-dcc4-4483-a8a0-58433a7a2ee9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:17.759567 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2b1dcb48-a974-43e3-87ea-ff65047646e5 req-4e1401d3-dcc4-4483-a8a0-58433a7a2ee9 service nova] Creating event network-vif-deleted:2536e0e5-dcc7-4952-96f2-26da0c7a0ccb for instance 3f993203-5e46-44a6-81d0-47d5081f4339 on n-h2-854441-12 Oct 17 16:13:17.798047 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2b1dcb48-a974-43e3-87ea-ff65047646e5 req-4e1401d3-dcc4-4483-a8a0-58433a7a2ee9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230367 Oct 17 16:13:17.805389 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3339/6415] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:13:17.954348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:17.955289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:17.972645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:17.976568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:17.977233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:17.979520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:17.981570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:17.984949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:18.066717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:18.068053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:18.075318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:18.076553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lazy-loading 'fault' on Instance uuid 3f993203-5e46-44a6-81d0-47d5081f4339 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:13:18.201730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:18.247727 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee96b915-4446-4c21-9c73-caf8e2525466 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 200 len: 1304 microversion: 2.1 time: 0.291227 Oct 17 16:13:18.249217 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3340/6416] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:17 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 1304 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:18.264337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:18.265792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:18.294901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:18.295814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:18.296553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:18.297779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:18.308985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:18.310080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:18.710690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:18.732939 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c78c0c3-442e-454f-afa4-b2daa0ee38f6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1229 microversion: 2.1 time: 0.481620 Oct 17 16:13:18.733950 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3341/6417] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:18 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1229 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:18.758696 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2f35be95-7b12-48c9-a65d-0a13beff8d2c tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1835 microversion: 2.1 time: 1.180783 Oct 17 16:13:18.759747 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3077/6418] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:17 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1835 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:19.282349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:19.286980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 3f993203-5e46-44a6-81d0-47d5081f4339] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:19.308602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:19.310540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:19.313091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:19.315272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:19.315899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:19.317124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:19.358582 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] HTTP exception thrown: Instance 3f993203-5e46-44a6-81d0-47d5081f4339 could not be found. Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Request method failure captured: Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 HTTP/1.1 Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX7-RJ4_EcrXqJu2uBEb6dZ8JAXjL6_CudOZ7Vc4_AwDFy1CSK2B8sVPFfBHE_vkPgn5JwmzLT4SXHPTvbz6C5IKzGYrXedoGOf2rrYkqT4ImJjcUVB4jfMn-TE5bktyr9XfOMzgHhdXiRApT3btv9aNB8OGG5PuiuH5pzsRTb3fbQc Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: b54c15aee5ad4bd492538242b9feddbb Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesActionsTest-604204103 Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b54c15aee5ad4bd492538242b9feddbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b54c15aee5ad4bd492538242b9feddbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b54c15aee5ad4bd492538242b9feddbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b54c15aee5ad4bd492538242b9feddbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesActionsTest-604204103 Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: b54c15aee5ad4bd492538242b9feddbb Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesActionsTest-604204103 Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-VolumesActionsTest-604204103-project Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 3f8ccabf596f47dd96b9bb2f05582953 Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesActionsTest-604204103-project Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 3f993203-5e46-44a6-81d0-47d5081f4339 could not be found. Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '3f993203-5e46-44a6-81d0-47d5081f4339'} Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f993203-5e46-44a6-81d0-47d5081f4339 could not be found. Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f993203-5e46-44a6-81d0-47d5081f4339 could not be found. Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:13:19.361396 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f993203-5e46-44a6-81d0-47d5081f4339 could not be found. Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Returning 404 to user: Instance 3f993203-5e46-44a6-81d0-47d5081f4339 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00d58134-64ec-49ba-aa08-7696905cb2f2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339" status: 404 len: 111 microversion: 2.1 time: 0.089339 Oct 17 16:13:19.371713 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3342/6419] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:19 2022] GET /compute/v2.1/servers/3f993203-5e46-44a6-81d0-47d5081f4339 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:13:19.733295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-610525", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "05a54f74-f434-481c-a44e-9da3bb301a5b"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:19.783386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:19.784890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:19.832704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:19.836372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:19.838362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:19.843981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:19.850032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:19.862970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:19.978645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] validate_networks() for [('05a54f74-f434-481c-a44e-9da3bb301a5b', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:13:20.167994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:20.227848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:20.263168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:20.282353 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28301d87-52e5-4a7b-a00f-717b2f82159a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1229 microversion: 2.1 time: 0.514359 Oct 17 16:13:20.284770 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3343/6420] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:19 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1229 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:20.963424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:21.314949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:21.318401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:21.342670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:21.345938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:21.349181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:21.351762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:21.353757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:21.355369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:21.531159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:13:21.532981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:13:21.534193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:13:21.535756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:13:21.536833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:13:21.590657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:21.591187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:21.592278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:21.593226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:21.593716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:21.594164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:21.626091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Getting quotas for project b54c15aee5ad4bd492538242b9feddbb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:13:21.631594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:21.634363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Getting quotas for user 3f8ccabf596f47dd96b9bb2f05582953 and project b54c15aee5ad4bd492538242b9feddbb. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:13:21.649319 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3632b9d3-5bde-451d-9220-7d93caf23062 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1229 microversion: 2.1 time: 0.341747 Oct 17 16:13:21.650120 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3344/6421] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:21 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1229 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:21.670087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:13:21.673292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:13:21.718738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:21.719418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:21.736417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:21.737423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:21.741752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:21.746757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:21.747934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:21.748897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:21.759695 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e21a050e-094a-45a1-832e-a8665d26b4f4 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.038964 Oct 17 16:13:21.760329 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3078/6422] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:13:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 16:13:21.765580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e134392c-d0fc-4c4c-bbe9-0686fdb7d16e req-8d144e3f-3eb6-4b24-a746-5347b86ab06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ff43c5-537d-4956-bcbe-8ee63136f03a", "tag": "6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:21.787316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e134392c-d0fc-4c4c-bbe9-0686fdb7d16e req-8d144e3f-3eb6-4b24-a746-5347b86ab06d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:21.787964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e134392c-d0fc-4c4c-bbe9-0686fdb7d16e req-8d144e3f-3eb6-4b24-a746-5347b86ab06d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:21.788416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e134392c-d0fc-4c4c-bbe9-0686fdb7d16e req-8d144e3f-3eb6-4b24-a746-5347b86ab06d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:21.812397 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e134392c-d0fc-4c4c-bbe9-0686fdb7d16e req-8d144e3f-3eb6-4b24-a746-5347b86ab06d service nova] Creating event network-changed:6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c for instance 53ff43c5-537d-4956-bcbe-8ee63136f03a on n-h2-854441-12 Oct 17 16:13:21.825150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:13:21.827555 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e134392c-d0fc-4c4c-bbe9-0686fdb7d16e req-8d144e3f-3eb6-4b24-a746-5347b86ab06d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065968 Oct 17 16:13:21.830379 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3079/6423] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:21.855387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f7f31b39-c7a9-4e2d-b1ec-0e82d4440f4e tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:21.856199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f7f31b39-c7a9-4e2d-b1ec-0e82d4440f4e tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:22.023905 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4955c9b1-dd6d-401d-abe8-0e1d6762ea1e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "DELETE /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 204 len: 0 microversion: 2.1 time: 0.309590 Oct 17 16:13:22.026990 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3345/6424] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:13:21 2022] DELETE /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:13:22.038038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:22.043227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:22.057681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:22.058681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:22.060551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:22.061824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:22.062782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:22.063553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:22.119433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:22.164749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f7f31b39-c7a9-4e2d-b1ec-0e82d4440f4e tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:22.175610 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f7f31b39-c7a9-4e2d-b1ec-0e82d4440f4e tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1210 microversion: 2.1 time: 0.341472 Oct 17 16:13:22.182655 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3080/6425] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:21 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1210 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:22.429839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:22.448087 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a76fc65e-d47d-428c-adca-5c1bd18873dd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1688 microversion: 2.1 time: 0.409736 Oct 17 16:13:22.449229 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3346/6426] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:22 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1688 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:22.674213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:22.675087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:22.689388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:22.690140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:22.690736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:22.691550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:22.714227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:22.723945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:23.000849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:23.018160 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b71ab8c-b191-4645-a820-a914bdaa4081 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1229 microversion: 2.1 time: 0.348057 Oct 17 16:13:23.036641 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3081/6427] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:22 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1229 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:23.223098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:23.224501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:23.259938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:23.263006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:23.264185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:23.278718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:23.280230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:23.281505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:23.494709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:23.495874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:23.518293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:23.518834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:23.519282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:23.520008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:23.520477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:23.520911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:23.541235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:23.600180 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7f7ca05-659a-4ab8-ae77-26702948674f tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1214 microversion: 2.1 time: 0.382529 Oct 17 16:13:23.614539 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3347/6428] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:23 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1214 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:24.056593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:24.063146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:24.093792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:24.094928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:24.095878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:24.097608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:24.098617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:24.099539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:24.174108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:24.186318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba08596d-4abf-4dc8-bd45-c1e9de4da6cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1688 microversion: 2.1 time: 0.699698 Oct 17 16:13:24.189390 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3082/6429] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:23 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1688 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:24.628288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:24.629634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:24.645801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:24.648477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:24.651599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:24.654994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:24.657314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:24.658077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:24.896786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:24.939893 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-602f3c04-4207-40e5-b0b3-0241e62bb930 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1217 microversion: 2.1 time: 0.890485 Oct 17 16:13:24.944915 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3348/6430] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:24 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1217 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:25.034905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4d4040be-8524-4587-bcd6-f2c9606bd0b8 req-a5f41a5b-1458-4caf-aea9-4dbd32c3f0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ff43c5-537d-4956-bcbe-8ee63136f03a", "name": "network-vif-deleted", "tag": "6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:25.051044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:25.076123 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-51ed9377-2494-40fc-af3c-6defdc5f4ba1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1280 microversion: 2.1 time: 0.451564 Oct 17 16:13:25.079834 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3083/6431] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:24 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1280 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:25.088551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4d4040be-8524-4587-bcd6-f2c9606bd0b8 req-a5f41a5b-1458-4caf-aea9-4dbd32c3f0bd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:25.095700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4d4040be-8524-4587-bcd6-f2c9606bd0b8 req-a5f41a5b-1458-4caf-aea9-4dbd32c3f0bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:25.103252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4d4040be-8524-4587-bcd6-f2c9606bd0b8 req-a5f41a5b-1458-4caf-aea9-4dbd32c3f0bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:25.150914 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4d4040be-8524-4587-bcd6-f2c9606bd0b8 req-a5f41a5b-1458-4caf-aea9-4dbd32c3f0bd service nova] Creating event network-vif-deleted:6f40ddc3-f4e7-46c7-ae55-0c03cd2ca28c for instance 53ff43c5-537d-4956-bcbe-8ee63136f03a on n-h2-854441-12 Oct 17 16:13:25.169642 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4d4040be-8524-4587-bcd6-f2c9606bd0b8 req-a5f41a5b-1458-4caf-aea9-4dbd32c3f0bd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142139 Oct 17 16:13:25.177969 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3349/6432] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:25.230641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:25.232329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:25.267918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:25.269184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:25.270857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:25.287883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:25.289618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:25.291991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:25.402412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:25.403629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:25.404817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:25.406134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lazy-loading 'fault' on Instance uuid 53ff43c5-537d-4956-bcbe-8ee63136f03a {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:13:25.483555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:25.493234 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0f6d9234-13b5-4e65-8012-aef59207477d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 200 len: 1355 microversion: 2.1 time: 0.268792 Oct 17 16:13:25.494591 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3084/6433] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:25 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 1355 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:25.983753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:25.984629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:25.997028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:25.997433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:25.997871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:25.998676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:25.999141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:25.999573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:26.120829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:26.121715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:26.141211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:26.143626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:26.144112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:26.144887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:26.145365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:26.145804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:26.281666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:26.305146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d3e9cfb-5589-4a89-9ec6-0c5144cb2c6e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1217 microversion: 2.1 time: 0.321442 Oct 17 16:13:26.306591 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3350/6434] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:25 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:26.524665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:26.535695 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-75f33bab-174d-46f6-baf9-00d56de65be7 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1310 microversion: 2.1 time: 0.420510 Oct 17 16:13:26.545195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:26.549437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 53ff43c5-537d-4956-bcbe-8ee63136f03a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:26.553217 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3085/6435] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:26 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1310 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:26.560273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:26.561151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:26.561779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:26.563378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:26.564043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:26.564676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:26.590344 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] HTTP exception thrown: Instance 53ff43c5-537d-4956-bcbe-8ee63136f03a could not be found. Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Request method failure captured: Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a HTTP/1.1 Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX6JzVteHpYsi1D8rtpfL_oxwZ0lNzSfAyclZrJa7nZMw7HEkOi0WpbQmGdmXXk4CJJ1m6_Lh-rtNT3Hb5Dl3ZmA5fU2LekXOChdpwgzlw04g6yjpCYmDMcnf0VTmocaMWCNEr8bZCQcvb7VhsaicWh4CY_ie470QWOh_IWzucQey3c Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 176e8f23ffdb4cf2941eca94a577375b Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 176e8f23ffdb4cf2941eca94a577375b Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestNetworkAdvancedServerOps-734931086-project Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6d3c6140894e446a9272e1a9247cbb1b Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-734931086-project Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 53ff43c5-537d-4956-bcbe-8ee63136f03a could not be found. Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '53ff43c5-537d-4956-bcbe-8ee63136f03a'} Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ff43c5-537d-4956-bcbe-8ee63136f03a could not be found. Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ff43c5-537d-4956-bcbe-8ee63136f03a could not be found. Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:26.592378 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:13:26.597596 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:26.597596 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:13:26.597596 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:13:26.597596 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:13:26.597596 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:13:26.597596 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:13:26.597596 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ff43c5-537d-4956-bcbe-8ee63136f03a could not be found. Oct 17 16:13:26.597596 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:13:26.600356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Returning 404 to user: Instance 53ff43c5-537d-4956-bcbe-8ee63136f03a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:13:26.602006 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-441b99df-84c8-4204-8b76-dd7fe70bd4d8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a" status: 404 len: 111 microversion: 2.1 time: 0.070012 Oct 17 16:13:26.606859 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3351/6436] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:26 2022] GET /compute/v2.1/servers/53ff43c5-537d-4956-bcbe-8ee63136f03a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:13:27.349669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:27.351169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:27.396148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:27.403861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:27.406374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:27.409738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:27.416569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:27.421099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:27.586619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:27.588857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:27.615947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:27.618643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:27.619908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:27.622565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:27.623781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:27.625938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:28.097883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:28.101943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:28.136722 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b9ce4337-2266-43aa-a2bf-b3346f7f4f6b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1217 microversion: 2.1 time: 0.778313 Oct 17 16:13:28.139788 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3086/6437] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:27 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1217 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:28.238925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d4476fdc-b217-458e-b2c2-e669c02f3471 req-d31c37dc-58e0-4957-904b-0bea72af1bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878a4d69-843e-4fbc-967f-a569d9762dde", "tag": "c200dbc9-d35b-4232-996f-428428d0aa5e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:28.315691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:28.342263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d4476fdc-b217-458e-b2c2-e669c02f3471 req-d31c37dc-58e0-4957-904b-0bea72af1bb2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:28.350563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d4476fdc-b217-458e-b2c2-e669c02f3471 req-d31c37dc-58e0-4957-904b-0bea72af1bb2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:28.351108 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5256567b-de9a-4464-9741-0ba78074625a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1310 microversion: 2.1 time: 0.794971 Oct 17 16:13:28.353215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d4476fdc-b217-458e-b2c2-e669c02f3471 req-d31c37dc-58e0-4957-904b-0bea72af1bb2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:28.359261 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3352/6438] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:27 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1310 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:28.403762 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d4476fdc-b217-458e-b2c2-e669c02f3471 req-d31c37dc-58e0-4957-904b-0bea72af1bb2 service nova] Creating event network-changed:c200dbc9-d35b-4232-996f-428428d0aa5e for instance 878a4d69-843e-4fbc-967f-a569d9762dde on n-h2-854441-12 Oct 17 16:13:28.416804 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d4476fdc-b217-458e-b2c2-e669c02f3471 req-d31c37dc-58e0-4957-904b-0bea72af1bb2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185675 Oct 17 16:13:28.419019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3087/6439] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:29.187361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:29.188420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:29.228180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:29.229741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:29.231006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:29.232898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:29.234283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:29.241286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:29.383136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:29.387368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:29.403884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:29.405970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:29.407033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:29.408422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:29.409629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:29.410603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:29.551381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:29.567508 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57e1b071-72b3-4677-b2a1-76860cb44611 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1217 microversion: 2.1 time: 0.387779 Oct 17 16:13:29.568386 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3353/6440] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:29 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1217 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:29.651155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:29.664884 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92457c92-610c-42b8-ad6a-898bce0cddc3 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1310 microversion: 2.1 time: 0.291167 Oct 17 16:13:29.666191 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3088/6441] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:29 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1310 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:30.597243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:30.598384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:30.628065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:30.629217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:30.635550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:30.637310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:30.638435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:30.639532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:30.692861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:30.695911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:30.735668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:30.736569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:30.737344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:30.738668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:30.750195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:30.752773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:31.195021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:31.205098 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ad49304-f3c5-447a-a12b-b13f559312bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1217 microversion: 2.1 time: 0.615606 Oct 17 16:13:31.210198 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3354/6442] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:30 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1217 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:31.326751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:31.342289 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-58bde6e2-fd0b-46cb-93dc-2909bc7e3a81 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1310 microversion: 2.1 time: 0.656975 Oct 17 16:13:31.348308 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3089/6443] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:30 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1310 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:32.257073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:32.257633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:32.266626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:32.267137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:32.267591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:32.268680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:32.269695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:32.270140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:32.391642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:32.394274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:32.397081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:32.400998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:32.411383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:32.412982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:32.413982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:32.416131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:32.417250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:32.418371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:32.632557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:32.649409 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd00510c-7df0-4012-89f7-fe15de055a4d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1217 microversion: 2.1 time: 0.397324 Oct 17 16:13:32.657915 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3355/6444] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:32 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1217 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:32.748068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:32.767516 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c893ea8f-b4ff-41fb-bc7d-9ff738a1beb2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1310 microversion: 2.1 time: 0.383831 Oct 17 16:13:32.768269 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3090/6445] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:32 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1310 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:33.685382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:33.687689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:33.709574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:33.723303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:33.724413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:33.725731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:33.726571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:33.727333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:33.820067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:33.820923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:33.836418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:33.837784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:33.851588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:33.852717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:33.858974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:33.859904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:34.220056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:34.236448 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d4a580f1-0874-4b92-a244-7a828ab51ef0 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1310 microversion: 2.1 time: 0.420577 Oct 17 16:13:34.240850 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3091/6446] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:33 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1310 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:34.335524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:34.365770 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5e9df95-ace7-41da-9927-5b4fa4298bec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1217 microversion: 2.1 time: 0.685466 Oct 17 16:13:34.373543 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3356/6447] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:33 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1217 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:34.575026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c0cc7fdb-8bd0-47e8-8d23-f7bde1f5a5a9 req-4e421057-3e12-4212-842c-3936647e3a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63a3f1b-92b5-495d-81d1-ea86638e2534", "name": "network-vif-plugged", "status": "completed", "tag": "fd5a069d-653d-4625-9618-c10cc0d9eb76"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:34.606328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c0cc7fdb-8bd0-47e8-8d23-f7bde1f5a5a9 req-4e421057-3e12-4212-842c-3936647e3a26 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:34.607228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c0cc7fdb-8bd0-47e8-8d23-f7bde1f5a5a9 req-4e421057-3e12-4212-842c-3936647e3a26 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:34.607957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c0cc7fdb-8bd0-47e8-8d23-f7bde1f5a5a9 req-4e421057-3e12-4212-842c-3936647e3a26 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:34.646246 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c0cc7fdb-8bd0-47e8-8d23-f7bde1f5a5a9 req-4e421057-3e12-4212-842c-3936647e3a26 service nova] Creating event network-vif-plugged:fd5a069d-653d-4625-9618-c10cc0d9eb76 for instance d63a3f1b-92b5-495d-81d1-ea86638e2534 on n-h1-854441-12 Oct 17 16:13:34.662016 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c0cc7fdb-8bd0-47e8-8d23-f7bde1f5a5a9 req-4e421057-3e12-4212-842c-3936647e3a26 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088025 Oct 17 16:13:34.663200 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3092/6448] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:35.270838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:35.271832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:35.295851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:35.302541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:35.303421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:35.304445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:35.305120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:35.305764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:35.404147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:35.406878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:35.422215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:35.424206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:35.425736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:35.434102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:35.435189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:35.438769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:35.809218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:35.824938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:35.834630 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1452b590-0675-4705-b8a4-cfd23f59fcf4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1217 microversion: 2.1 time: 0.440413 Oct 17 16:13:35.836016 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3093/6449] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:35 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1217 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:35.855834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5e2de6a6-fd2b-4f10-8c82-0690f77af281 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '.version_select at 0x7f28c2eaf670>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:35.863348 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-879eb661-e605-426c-8ba2-431caafbffd2 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1310 microversion: 2.1 time: 0.599146 Oct 17 16:13:35.872354 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3357/6450] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:35 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1310 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:35.927290 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5e2de6a6-fd2b-4f10-8c82-0690f77af281 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1022756630" status: 202 len: 0 microversion: 2.1 time: 0.088315 Oct 17 16:13:35.935845 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3094/6451] 10.222.0.87 () {58 vars in 1284 bytes} [Mon Oct 17 16:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1022756630 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:13:35.977770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-438c511f-afe3-4604-9c6f-6246ee619791 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'create', calling method: .version_select at 0x7f28bd60b280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-526504184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOvaQoyqF5tTRPQUhXksXHvXLhbZ07w0iKfRlG1z07wUbo5cFd80CjCGBW08DWKqcYtY6gCc4mmL7+KG/nfs6JpvMY8N2+jFB6WlwZDn162ov15srSc3J2rjiC2nO9lqA=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:36.008340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-438c511f-afe3-4604-9c6f-6246ee619791 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:13:36.021004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-438c511f-afe3-4604-9c6f-6246ee619791 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for user 6d3c6140894e446a9272e1a9247cbb1b and project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:13:36.076571 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-438c511f-afe3-4604-9c6f-6246ee619791 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.106136 Oct 17 16:13:36.078864 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3358/6452] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:13:35 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:36.879900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:36.881446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:36.895054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:36.896302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:36.898012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:36.902010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:36.902946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:36.903659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:36.905718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:36.909319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:36.924152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:36.925974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:36.927023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:36.928772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:36.929933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:36.931352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:37.234178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:37.258006 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe1fc3ec-c07f-479d-bd39-8d884c3d9157 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1310 microversion: 2.1 time: 0.369270 Oct 17 16:13:37.260098 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3359/6453] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:36 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1310 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:37.274020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6866ba28-ca82-4677-beda-4cbe999e19b3 req-a3d65990-38f3-4b77-b739-18b1a43e259f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878a4d69-843e-4fbc-967f-a569d9762dde", "name": "network-vif-plugged", "status": "completed", "tag": "c200dbc9-d35b-4232-996f-428428d0aa5e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:37.309095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6866ba28-ca82-4677-beda-4cbe999e19b3 req-a3d65990-38f3-4b77-b739-18b1a43e259f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:37.310043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6866ba28-ca82-4677-beda-4cbe999e19b3 req-a3d65990-38f3-4b77-b739-18b1a43e259f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:37.311052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6866ba28-ca82-4677-beda-4cbe999e19b3 req-a3d65990-38f3-4b77-b739-18b1a43e259f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:37.338081 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6866ba28-ca82-4677-beda-4cbe999e19b3 req-a3d65990-38f3-4b77-b739-18b1a43e259f service nova] Creating event network-vif-plugged:c200dbc9-d35b-4232-996f-428428d0aa5e for instance 878a4d69-843e-4fbc-967f-a569d9762dde on n-h2-854441-12 Oct 17 16:13:37.353967 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6866ba28-ca82-4677-beda-4cbe999e19b3 req-a3d65990-38f3-4b77-b739-18b1a43e259f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087073 Oct 17 16:13:37.353967 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3360/6454] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:37.415300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:37.427730 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0e5e5076-abe8-4350-b7a8-9f946fb806b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1404 microversion: 2.1 time: 0.559408 Oct 17 16:13:37.429828 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3095/6455] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:36 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1404 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:37.472360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:37.473524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:37.485781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:37.487191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:37.488257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:37.489841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:37.491014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:37.492082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:37.814541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:37.831968 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b59c1065-c4f4-4ae2-8400-9ce5fbb68e5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1404 microversion: 2.1 time: 0.367409 Oct 17 16:13:37.833448 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3361/6456] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:37 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1404 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:37.857312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1254300597"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:37.860977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:37.874128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:37.874774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:37.875469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:37.877172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:37.877864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:37.878557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:38.119430 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.api [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Attempting to quiesce instance before volume snapshot. Oct 17 16:13:38.184781 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.api [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 17 16:13:38.290233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:38.292798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:38.310196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:38.310847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:38.323019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:38.323972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:38.324486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:38.324914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:38.340356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Creating snapshot from volume bade7c79-713b-417f-9daa-877b183f78bf. {{(pid=120407) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 17 16:13:38.837726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:38.877679 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a75f69cb-0462-45f8-9c12-a8b833b83ac1 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1310 microversion: 2.1 time: 0.584381 Oct 17 16:13:38.882192 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3362/6457] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:38 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1310 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:39.928179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:39.931407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:39.957286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:39.958121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:39.966240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:39.968453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:39.969653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:39.970729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:40.738295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:40.771640 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab0e6346-bd8f-403d-bcfa-2758f7aa867a tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1493 microversion: 2.1 time: 0.832401 Oct 17 16:13:40.776045 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3363/6458] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:39 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1493 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:40.928708 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5df8e19c-130b-4463-b2b3-3f2788f789c0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534/action" status: 202 len: 0 microversion: 2.1 time: 3.074289 Oct 17 16:13:40.934182 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3096/6459] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:13:37 2022] POST /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534/action => generated 0 bytes in 3081 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 16:13:41.824575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:41.825780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:41.832905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:41.834961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:41.835845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:41.836609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:41.837633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:41.838356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:41.839060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:41.873485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:13:41.989832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:42.071785 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e8f0188-efe0-4ece-ab73-bdde0a9c4ffd tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "DELETE /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 204 len: 0 microversion: 2.1 time: 0.259513 Oct 17 16:13:42.075526 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3364/6460] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:13:41 2022] DELETE /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:13:42.087848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:42.092405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:42.099898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:42.102461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:42.102988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:42.103848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:42.104315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:42.104944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:42.435419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:42.463914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ecdf7495-c03b-432e-9156-6f771e328103 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1499 microversion: 2.1 time: 0.382538 Oct 17 16:13:42.478539 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3097/6461] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:42 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1499 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:43.489703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-186839839", "imageRef": "77662b0c-a590-4bdd-945f-1207810d706c", "flavorRef": "452", "networks": [{"uuid": "916c7d18-0cf6-4aa6-bd9b-213b6c12b936"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:43.490727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:43.491385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:43.505063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:43.505582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:43.507339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:43.508965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:43.509469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:43.509941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:43.661094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] validate_networks() for [('916c7d18-0cf6-4aa6-bd9b-213b6c12b936', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:13:43.877510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:43.895407 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f9eba9e0-97e5-42f8-b603-f52b06209d99 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1499 microversion: 2.1 time: 0.409725 Oct 17 16:13:43.896586 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3098/6462] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:43 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1499 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:44.944489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:44.952718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:44.966489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:45.012275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:45.013126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:45.014270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:45.020720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:45.021775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:45.027778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:45.509436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8ccabf596f47dd96b9bb2f05582953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54c15aee5ad4bd492538242b9feddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:45.530927 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff2da016-79c1-4b2f-98eb-673b9db80264 tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 200 len: 1457 microversion: 2.1 time: 0.608540 Oct 17 16:13:45.548030 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3099/6463] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:44 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 1457 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:45.610590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-78c2b09f-3b89-4f21-8d38-ce5bc8d25a2f req-a8298f3c-a115-41ef-bbbf-2495bc5fd29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878a4d69-843e-4fbc-967f-a569d9762dde", "name": "network-vif-deleted", "tag": "c200dbc9-d35b-4232-996f-428428d0aa5e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:45.631870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-78c2b09f-3b89-4f21-8d38-ce5bc8d25a2f req-a8298f3c-a115-41ef-bbbf-2495bc5fd29c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:45.633010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-78c2b09f-3b89-4f21-8d38-ce5bc8d25a2f req-a8298f3c-a115-41ef-bbbf-2495bc5fd29c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:45.633889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-78c2b09f-3b89-4f21-8d38-ce5bc8d25a2f req-a8298f3c-a115-41ef-bbbf-2495bc5fd29c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:45.673888 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-78c2b09f-3b89-4f21-8d38-ce5bc8d25a2f req-a8298f3c-a115-41ef-bbbf-2495bc5fd29c service nova] Creating event network-vif-deleted:c200dbc9-d35b-4232-996f-428428d0aa5e for instance 878a4d69-843e-4fbc-967f-a569d9762dde on n-h2-854441-12 Oct 17 16:13:45.692395 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-78c2b09f-3b89-4f21-8d38-ce5bc8d25a2f req-a8298f3c-a115-41ef-bbbf-2495bc5fd29c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141711 Oct 17 16:13:45.693382 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3100/6464] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:46.038826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:46.252971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:13:46.254749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:13:46.258073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:13:46.268533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:13:46.269895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:13:46.310126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:46.311652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:46.313019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:46.315735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:46.317228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:46.318691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:46.375242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:13:46.389990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for user a7647fbb42444923aa218f5579dd30a0 and project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:13:46.443894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:13:46.451360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='bdfa7030-d557-4af1-bc9e-e7ac45addaf0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:13:46.589921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:46.600202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] [instance: 878a4d69-843e-4fbc-967f-a569d9762dde] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:46.646382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:46.647812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:46.667109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:46.668824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:46.670001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:46.671024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:46.701451 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] HTTP exception thrown: Instance 878a4d69-843e-4fbc-967f-a569d9762dde could not be found. Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Request method failure captured: Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde HTTP/1.1 Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX7-RJ4_EcrXqJu2uBEb6dZ8JAXjL6_CudOZ7Vc4_AwDFy1CSK2B8sVPFfBHE_vkPgn5JwmzLT4SXHPTvbz6C5IKzGYrXedoGOf2rrYkqT4ImJjcUVB4jfMn-TE5bktyr9XfOMzgHhdXiRApT3btv9aNB8OGG5PuiuH5pzsRTb3fbQc Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: b54c15aee5ad4bd492538242b9feddbb Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-VolumesActionsTest-604204103 Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b54c15aee5ad4bd492538242b9feddbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b54c15aee5ad4bd492538242b9feddbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b54c15aee5ad4bd492538242b9feddbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b54c15aee5ad4bd492538242b9feddbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-VolumesActionsTest-604204103 Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: b54c15aee5ad4bd492538242b9feddbb Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-VolumesActionsTest-604204103 Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-VolumesActionsTest-604204103-project Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 3f8ccabf596f47dd96b9bb2f05582953 Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-VolumesActionsTest-604204103-project Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 878a4d69-843e-4fbc-967f-a569d9762dde could not be found. Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '878a4d69-843e-4fbc-967f-a569d9762dde'} Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878a4d69-843e-4fbc-967f-a569d9762dde could not be found. Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878a4d69-843e-4fbc-967f-a569d9762dde could not be found. Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:13:46.706308 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:13:46.715041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:13:46.715041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:13:46.715041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:13:46.715041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:13:46.715041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:13:46.715041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878a4d69-843e-4fbc-967f-a569d9762dde could not be found. Oct 17 16:13:46.715041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:13:46.717370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] Returning 404 to user: Instance 878a4d69-843e-4fbc-967f-a569d9762dde could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:13:46.719044 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-14beb3e1-b71f-424a-bbd2-9af7f323ff3c tempest-VolumesActionsTest-604204103 tempest-VolumesActionsTest-604204103-project] 10.222.0.87 "GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde" status: 404 len: 111 microversion: 2.1 time: 0.137349 Oct 17 16:13:46.720629 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3101/6465] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:46 2022] GET /compute/v2.1/servers/878a4d69-843e-4fbc-967f-a569d9762dde => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:13:46.744588 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a17c347-57c1-4f2c-b158-286755b9593c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.274396 Oct 17 16:13:46.756129 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3365/6466] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:13:46.770275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b88c11c4-0b9f-4c78-a3e8-ddb8a506f468 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:46.772014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b88c11c4-0b9f-4c78-a3e8-ddb8a506f468 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:47.064395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b88c11c4-0b9f-4c78-a3e8-ddb8a506f468 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:47.091729 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b88c11c4-0b9f-4c78-a3e8-ddb8a506f468 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1229 microversion: 2.1 time: 0.328809 Oct 17 16:13:47.132657 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3102/6467] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:46 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1229 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:48.173217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c38d229-fb11-4d2e-a1d1-6e239d8d69a6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:48.175339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c38d229-fb11-4d2e-a1d1-6e239d8d69a6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:48.508044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c38d229-fb11-4d2e-a1d1-6e239d8d69a6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:48.520097 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c38d229-fb11-4d2e-a1d1-6e239d8d69a6 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1229 microversion: 2.1 time: 0.371398 Oct 17 16:13:48.524795 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3366/6468] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:48 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1229 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:49.595582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:49.596998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:49.624741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:49.625988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:49.627113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:49.629436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:49.630451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:49.631824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:49.847449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:49.895133 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e1b83585-64cb-45a7-95ff-a1f78dbc0780 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1281 microversion: 2.1 time: 0.331630 Oct 17 16:13:49.899999 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3103/6469] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:49 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1281 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:50.951816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:50.957805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:50.986839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:50.988840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:50.992872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:50.994980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:50.999448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:51.003468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:51.533757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:51.556197 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c10cb83-0210-4962-9faa-5393b0741a9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1299 microversion: 2.1 time: 0.614919 Oct 17 16:13:51.586989 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3367/6470] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:50 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1299 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:52.627439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:52.628551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:52.736560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:52.749864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:52.752954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:52.756879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:52.770034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:52.773265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:52.916755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1540540045", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "500dc153-65e4-4fa5-bcf4-675e07601868"}], "key_name": "tempest-TestNetworkAdvancedServerOps-526504184", "security_groups": [{"name": "tempest-secgroup-smoke-253882291"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:53.414543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] validate_networks() for [('500dc153-65e4-4fa5-bcf4-675e07601868', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:13:53.703459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:53.733666 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-91303fb3-4ed9-4b50-85e3-952481d9a23b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 1.115313 Oct 17 16:13:53.736703 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3104/6471] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:52 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:54.763253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:13:54.765208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:54.765900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:54.767566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:13:54.768979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:13:54.771184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:13:54.774418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:13:54.783166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:54.783889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:54.787954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:54.791358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:54.791886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:54.792355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:54.801968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:54.803534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:54.804766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:54.811176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:54.812718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:54.817837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:54.906094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:13:54.919122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for user 6d3c6140894e446a9272e1a9247cbb1b and project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:13:54.977611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:13:54.982044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:13:55.169019 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd17e398-2ac5-4996-a586-d4754259e3fa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.256508 Oct 17 16:13:55.170608 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3368/6472] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:13:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:13:55.192251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1ae12355-ffa2-4aca-ab40-7e50fbe3cee9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:55.193529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1ae12355-ffa2-4aca-ab40-7e50fbe3cee9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:55.340656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1ae12355-ffa2-4aca-ab40-7e50fbe3cee9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:55.355967 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1ae12355-ffa2-4aca-ab40-7e50fbe3cee9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1266 microversion: 2.1 time: 0.164912 Oct 17 16:13:55.358731 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3369/6473] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:55 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:55.433011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:55.442172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:13:55.456991 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef87a773-ba9e-4628-bd50-1429e8f607e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 0.696769 Oct 17 16:13:55.457619 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3105/6474] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:54 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:55.709006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0ea20a8c-72ef-4766-960e-ff5df7eeee21 req-e97979be-51e2-4f86-80c8-b57eca8e7119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63f04ce-6161-4b82-9b87-22e382ae63ae", "tag": "a7edad1e-760d-4c07-9699-a20fc91d29c6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:13:55.807798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0ea20a8c-72ef-4766-960e-ff5df7eeee21 req-e97979be-51e2-4f86-80c8-b57eca8e7119 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:55.808824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0ea20a8c-72ef-4766-960e-ff5df7eeee21 req-e97979be-51e2-4f86-80c8-b57eca8e7119 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:55.809514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0ea20a8c-72ef-4766-960e-ff5df7eeee21 req-e97979be-51e2-4f86-80c8-b57eca8e7119 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:55.911174 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0ea20a8c-72ef-4766-960e-ff5df7eeee21 req-e97979be-51e2-4f86-80c8-b57eca8e7119 service nova] Creating event network-changed:a7edad1e-760d-4c07-9699-a20fc91d29c6 for instance d63f04ce-6161-4b82-9b87-22e382ae63ae on n-h2-854441-12 Oct 17 16:13:55.975585 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0ea20a8c-72ef-4766-960e-ff5df7eeee21 req-e97979be-51e2-4f86-80c8-b57eca8e7119 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263602 Oct 17 16:13:55.987105 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3370/6475] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:13:56.406226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4dfa2f1c-73c6-494b-875b-a049c5a54795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:56.417421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4dfa2f1c-73c6-494b-875b-a049c5a54795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:56.508745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:56.510026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:56.597362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:56.623178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:56.632173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:56.637950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:56.640838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:56.644855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:56.810608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4dfa2f1c-73c6-494b-875b-a049c5a54795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:56.824925 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4dfa2f1c-73c6-494b-875b-a049c5a54795 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1266 microversion: 2.1 time: 0.423071 Oct 17 16:13:56.828479 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3106/6476] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:56 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:13:57.653661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:57.689171 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d243061b-42eb-4a5b-bbfd-b88d606129b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 1.185052 Oct 17 16:13:57.708168 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3371/6477] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:56 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:57.880602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:57.882240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:57.916633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:57.928657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:57.935446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:57.943983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:57.945878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:57.952133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:58.433566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:58.449367 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-51ef0053-42a1-4ea3-a88c-a214ea233eb6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1318 microversion: 2.1 time: 0.573712 Oct 17 16:13:58.452774 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3107/6478] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:57 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:58.761371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:58.762394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:58.897270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:58.900473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:58.905910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:58.914992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:58.920221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:58.922966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:59.378476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:59.404940 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-43f50a5a-b08b-4af8-8120-712eb057d61d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 0.665513 Oct 17 16:13:59.411336 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3372/6479] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:58 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:13:59.502996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:13:59.505269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:13:59.533658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:59.534831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:59.535583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:59.538340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:13:59.541896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:13:59.546435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:13:59.787533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:13:59.809622 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c51c6af7-4319-41cd-ae3d-f2e3fc5ab031 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1326 microversion: 2.1 time: 0.308905 Oct 17 16:13:59.810419 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3108/6480] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:13:59 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1326 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:00.456297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:00.458121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:00.472265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:00.478730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:00.479614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:00.480637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:00.481362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:00.482105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:00.855317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:00.857236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:00.872045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:00.875563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:00.885345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:00.889110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:00.890169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:00.890963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:01.878871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:01.902237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8b3366d-e87f-4718-a09f-8aca761744bc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 1.450130 Oct 17 16:14:01.928482 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3373/6481] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:00 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:01.973172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:02.010066 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff9bb605-94d2-46dd-b34e-1a6c48145361 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1324 microversion: 2.1 time: 1.158584 Oct 17 16:14:02.033525 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3109/6482] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:00 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1324 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:02.978027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:02.979562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:02.997501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:02.998466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:02.999227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:03.000315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:03.001042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:03.001757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:03.078349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:03.080011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:03.110334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:03.111598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:03.112385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:03.113470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:03.114236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:03.115131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:03.535701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:03.547649 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-235a33bd-4f6a-4076-8d18-b54e3c6e84a2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 0.474339 Oct 17 16:14:03.549601 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3110/6483] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:03 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:04.606291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:04.611224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:04.644969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:04.645844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:04.646333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:04.647132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:04.647615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:04.648302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:04.851831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:05.221435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:05.249783 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c7cdfba-d42c-4f8c-aa0e-19e828d2e2c8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 0.676606 Oct 17 16:14:05.259734 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3111/6484] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:04 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:05.270670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:05.280149 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4257bfc-3225-4d9b-9e95-974054fb0107 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 2.305939 Oct 17 16:14:05.281518 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3374/6485] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:02 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:06.276708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:06.277433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:06.294598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:06.295858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:06.299683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:06.301795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:06.303205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:06.307320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:06.330408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:06.332539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:06.386394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:06.550961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:06.551797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.046s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:06.552310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:06.578678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:06.579825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:06.587666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:06.816812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:07.273640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:07.297602 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7fdbf7b-dcbf-40d2-8787-9295fa358555 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 1.024556 Oct 17 16:14:07.322089 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3112/6486] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:06 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:07.958314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:08.012527 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ee4115f-b16b-4c7b-81d6-a8f159a14f44 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 1.694473 Oct 17 16:14:08.013649 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3375/6487] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:06 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:08.329992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:08.331503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:08.366873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:08.368129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:08.369010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:08.373344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:08.374383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:08.375166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:08.441719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-297572ac-ebc3-4171-9df6-40ac40668fae req-64e4bed2-d63f-4c75-bf60-f94516992f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:14:08.525421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-297572ac-ebc3-4171-9df6-40ac40668fae req-64e4bed2-d63f-4c75-bf60-f94516992f5f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:08.547781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-297572ac-ebc3-4171-9df6-40ac40668fae req-64e4bed2-d63f-4c75-bf60-f94516992f5f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:08.552314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-297572ac-ebc3-4171-9df6-40ac40668fae req-64e4bed2-d63f-4c75-bf60-f94516992f5f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:08.675059 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-297572ac-ebc3-4171-9df6-40ac40668fae req-64e4bed2-d63f-4c75-bf60-f94516992f5f service nova] Creating event network-changed:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h1-854441-12 Oct 17 16:14:08.691606 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-297572ac-ebc3-4171-9df6-40ac40668fae req-64e4bed2-d63f-4c75-bf60-f94516992f5f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258957 Oct 17 16:14:08.697344 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3376/6488] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:14:08.772001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:08.788531 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7abebd7c-a729-4cca-85d3-1b3bcca10365 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 0.465765 Oct 17 16:14:08.813639 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3113/6489] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:08 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:09.044712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:09.049783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:09.070410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:09.071316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:09.072162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:09.074790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:09.079471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:09.081412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:09.822728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:09.824060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:09.840101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:09.841214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:09.841995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:09.843112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:09.845987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:09.854906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:10.278820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:10.307900 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e59b2400-60f3-42d5-afec-6cbaa695fbca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 1.271092 Oct 17 16:14:10.325807 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3377/6490] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:09 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:10.416551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:10.462055 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-891f2f0b-8ad1-4daa-b63e-46f42780775a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 0.639208 Oct 17 16:14:10.485140 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3114/6491] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:09 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:11.356149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:11.357237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:11.405138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:11.406440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:11.409915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:11.415213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:11.416366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:11.417379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:11.521330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:11.525542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:11.558583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:11.577645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:11.597532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:11.599291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:11.600483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:11.601481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:11.976017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:12.031080 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ebd0cbd6-32b8-4b60-a96b-81b8a2fb17b6 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 0.498514 Oct 17 16:14:12.032233 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3115/6492] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:11 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:12.494897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:12.502692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:12.513198 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1cbfd000-5ffa-4012-a496-39b68cf56dbd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 1.166344 Oct 17 16:14:12.514812 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3378/6493] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:11 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:13.072093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:13.073626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:13.089118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:13.092820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:13.093866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:13.095455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:13.098680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:13.099444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:13.546229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:13.547094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:13.571777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:13.604252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:13.626538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f0af8eb2-c9a6-42e2-878d-453eed64e95a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 0.558413 Oct 17 16:14:13.645603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:13.646261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:13.653036 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3116/6494] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:13 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:13.653329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:13.654148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:13.654759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:13.658543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:13.991375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:14.000445 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d984ab51-c9b5-4405-918f-9b674e3b4d4c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 0.458553 Oct 17 16:14:14.010825 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3379/6495] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:13 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:14.656876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:14.657739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:14.674142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:14.674720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:14.675194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:14.675966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:14.676452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:14.676912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:15.046014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:15.046884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:15.060238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:15.060945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:15.061205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:15.067076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:15.067866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:15.068498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:15.195924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:15.236525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ecea3cfe-0b6e-4959-80db-3a5c574aec91 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 0.581377 Oct 17 16:14:15.239859 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3117/6496] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:14 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:15.517602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:15.527769 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-739b7e47-3ea6-43e2-ad02-f864815bc3f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 0.491396 Oct 17 16:14:15.539858 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3380/6497] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:15 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:16.262063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:16.263408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:16.274563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=42 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:16.296410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:16.297570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:16.298042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:16.306627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:16.308595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:16.310089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:16.396839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f8708f39-6960-406a-a95f-d6fbf2b31354 req-6194c258-b5db-42ab-8238-3583e2dd091a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "name": "network-vif-plugged", "status": "completed", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:14:16.441244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f8708f39-6960-406a-a95f-d6fbf2b31354 req-6194c258-b5db-42ab-8238-3583e2dd091a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:16.441774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f8708f39-6960-406a-a95f-d6fbf2b31354 req-6194c258-b5db-42ab-8238-3583e2dd091a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:16.442318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f8708f39-6960-406a-a95f-d6fbf2b31354 req-6194c258-b5db-42ab-8238-3583e2dd091a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:16.520045 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f8708f39-6960-406a-a95f-d6fbf2b31354 req-6194c258-b5db-42ab-8238-3583e2dd091a service nova] Creating event network-vif-plugged:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h1-854441-12 Oct 17 16:14:16.540124 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f8708f39-6960-406a-a95f-d6fbf2b31354 req-6194c258-b5db-42ab-8238-3583e2dd091a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150423 Oct 17 16:14:16.543811 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3381/6498] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:14:16.592014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:16.593093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:16.602687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:16.603535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:16.604455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:16.605663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:16.606356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:16.607207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:16.817165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:16.857664 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ae7d23ef-0c2b-47cf-9191-e167f198d4ca tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 0.598772 Oct 17 16:14:16.860482 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3118/6499] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:16 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:17.026547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:17.055539 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4f39de37-0869-4368-859f-c1822ee51fb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 0.481789 Oct 17 16:14:17.059171 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3382/6500] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:16 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:17.889538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:17.904219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:17.921429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:17.926580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:17.930224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:17.933928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:17.939800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:17.941084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:18.090390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:18.092008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:18.111458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:18.116174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:18.118959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:18.120543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:18.123945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:18.150085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:18.512931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:18.528918 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-34ad73e8-1372-4030-b8a5-e99548e0d223 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1391 microversion: 2.1 time: 0.648385 Oct 17 16:14:18.530836 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3119/6501] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:17 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1391 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:18.794085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:18.846011 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e02a9d33-01be-49bf-a848-bb9286d1458d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 0.760459 Oct 17 16:14:18.862649 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3383/6502] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:18 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:19.577955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:19.579929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:19.608715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:19.610138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:19.628727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:19.633582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:19.642650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:19.647348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:19.874993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:19.875851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:19.889684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:19.901116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:19.903018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:19.905959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:19.907198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:19.915142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:20.178284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:20.191764 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-acbd92cf-16bd-4844-80c7-a3071fa649af tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1563 microversion: 2.1 time: 0.620969 Oct 17 16:14:20.202858 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3120/6503] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:19 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1563 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:20.231717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:20.234555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:20.243533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:20.244471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:20.245190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:20.248248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:20.249361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:20.251844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:20.301025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:20.343221 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9a464cfd-af9c-47fa-9444-4621274eba37 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 0.471061 Oct 17 16:14:20.347890 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3384/6504] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:19 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:20.824668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:20.847518 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d25e1584-0268-405e-81b8-8ac0a3b7c983 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1563 microversion: 2.1 time: 0.622232 Oct 17 16:14:20.851026 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3121/6505] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:20 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1563 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:21.391907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:21.393481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:21.414135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:21.418788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:21.419660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:21.426759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:21.427813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:21.428734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:21.791700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:21.850460 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3c950bf-b4af-4979-9c26-233313d94f92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 0.463288 Oct 17 16:14:21.867814 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3385/6506] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:21 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:22.901012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:22.902153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:22.922563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:22.937777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:22.941876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:22.946020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:22.959596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:22.969299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:24.335943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:24.377290 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-18c76a26-012c-46f1-b7af-2f56531f2058 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 1.470619 Oct 17 16:14:24.380820 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3122/6507] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:22 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:25.467052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:25.469189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:25.589644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:25.595689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:25.601711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:25.603440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:25.607658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:25.613586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:26.006137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:26.023284 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d293037-e0bc-4ece-8906-a37bf748c368 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 0.618298 Oct 17 16:14:26.023911 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3386/6508] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:25 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:26.700546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:26.703271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:26.722532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:26.723084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:26.723567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:26.724346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:26.724836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:26.725290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:26.727319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-07535380-61ae-446a-b522-ce19de7ecff9 req-642ebd9b-e5a6-424e-8f91-1887b428358c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:14:26.737412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:26.768079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07535380-61ae-446a-b522-ce19de7ecff9 req-642ebd9b-e5a6-424e-8f91-1887b428358c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:26.768651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07535380-61ae-446a-b522-ce19de7ecff9 req-642ebd9b-e5a6-424e-8f91-1887b428358c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:26.769184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07535380-61ae-446a-b522-ce19de7ecff9 req-642ebd9b-e5a6-424e-8f91-1887b428358c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:26.841006 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-07535380-61ae-446a-b522-ce19de7ecff9 req-642ebd9b-e5a6-424e-8f91-1887b428358c service nova] Creating event network-changed:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h1-854441-12 Oct 17 16:14:26.864847 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-07535380-61ae-446a-b522-ce19de7ecff9 req-642ebd9b-e5a6-424e-8f91-1887b428358c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140537 Oct 17 16:14:26.871586 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3387/6509] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:14:27.056165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:27.069791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:27.120234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:27.129670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:27.132771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:27.142888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:27.143966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:27.148817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:27.250486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:27.274544 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b748b9c-693b-4a54-8edb-31667b76af60 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1563 microversion: 2.1 time: 0.578778 Oct 17 16:14:27.278185 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3123/6510] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:26 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1563 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:28.453774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:28.482811 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-06cff76d-b535-4e10-8b33-a9df3011260a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 1.437998 Oct 17 16:14:28.498679 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3388/6511] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:27 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:29.511378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:29.513110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:29.527890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:29.531476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:29.536904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:29.538042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:29.540740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:29.541728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:30.719854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:30.745610 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-44f9dd9e-ef87-4d61-80d6-fded8450cc13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1341 microversion: 2.1 time: 1.237979 Oct 17 16:14:30.747228 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3124/6512] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:29 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1341 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:31.778058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:31.779717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:31.798193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:31.799362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:31.803848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:31.805822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:31.809907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:31.811085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:32.447521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:32.474861 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b9935a8-8fc9-4e00-acec-17226a183dca tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1387 microversion: 2.1 time: 0.700788 Oct 17 16:14:32.491681 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3389/6513] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:31 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1387 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:33.526783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:33.531127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:33.550519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:33.552712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:33.553793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:33.556718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:33.559367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:33.560938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:34.072270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:34.117809 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-beee0d95-fcc8-448c-9dd8-e179be213435 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1375 microversion: 2.1 time: 0.595601 Oct 17 16:14:34.121575 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3125/6514] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:33 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1375 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:35.149457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:35.150327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:35.164936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:35.165444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:35.165892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:35.166775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:35.167457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:35.168064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:35.532262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:35.561252 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6c755136-dfa2-421c-a682-879c9111c34a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1375 microversion: 2.1 time: 0.413824 Oct 17 16:14:35.563160 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3390/6515] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:35 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1375 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:36.606704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:36.608034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:36.640674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:36.641197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:36.641952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:36.642936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:36.643490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:36.644154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:37.050789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:37.065070 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1fdc490-9a1d-4d65-b296-e3afd3894cce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1375 microversion: 2.1 time: 0.462341 Oct 17 16:14:37.066161 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3126/6516] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:36 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1375 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:38.119323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:38.121714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:38.158355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:38.163035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:38.168947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:38.173312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:38.194716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:38.198089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:38.695632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:38.728984 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95cb8da0-a69a-4b22-88c3-b8c4a4bab211 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1375 microversion: 2.1 time: 0.613062 Oct 17 16:14:38.734046 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3391/6517] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:38 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1375 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:39.780707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:39.781577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:39.799659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:39.801495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:39.802490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:39.803978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:39.805710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:39.807013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:40.042811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:40.063381 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0a7eeb8a-31d4-416a-8b62-d3efac46f1d1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1375 microversion: 2.1 time: 0.287004 Oct 17 16:14:40.079611 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3127/6518] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:39 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1375 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:41.113060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:41.114149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:41.130028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:41.131357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:41.132278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:41.135154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:41.136208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:41.137256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:41.559660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:41.598274 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a37cbcb5-9cb6-4b41-9603-f38548a9cfe4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1375 microversion: 2.1 time: 0.496340 Oct 17 16:14:41.615453 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3392/6519] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:41 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1375 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:42.638389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:42.639807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:42.654636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:42.655543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:42.656381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:42.657347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:42.658035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:42.658688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:42.871844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-16385844-32d0-475d-acbf-e27d4596f760 req-4b7d2f60-90b8-4692-9556-b310d44c471d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63f04ce-6161-4b82-9b87-22e382ae63ae", "name": "network-vif-plugged", "status": "completed", "tag": "a7edad1e-760d-4c07-9699-a20fc91d29c6"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:14:42.898026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-16385844-32d0-475d-acbf-e27d4596f760 req-4b7d2f60-90b8-4692-9556-b310d44c471d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:42.900966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-16385844-32d0-475d-acbf-e27d4596f760 req-4b7d2f60-90b8-4692-9556-b310d44c471d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:42.901737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-16385844-32d0-475d-acbf-e27d4596f760 req-4b7d2f60-90b8-4692-9556-b310d44c471d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:42.934562 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-16385844-32d0-475d-acbf-e27d4596f760 req-4b7d2f60-90b8-4692-9556-b310d44c471d service nova] Creating event network-vif-plugged:a7edad1e-760d-4c07-9699-a20fc91d29c6 for instance d63f04ce-6161-4b82-9b87-22e382ae63ae on n-h2-854441-12 Oct 17 16:14:42.950634 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-16385844-32d0-475d-acbf-e27d4596f760 req-4b7d2f60-90b8-4692-9556-b310d44c471d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083514 Oct 17 16:14:42.959990 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3393/6520] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:14:43.035758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e4f44c8-6f13-49ba-9a56-ff9c2ebc0007 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:14:43.039785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e4f44c8-6f13-49ba-9a56-ff9c2ebc0007 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:43.086075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4f44c8-6f13-49ba-9a56-ff9c2ebc0007 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:43.086984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4f44c8-6f13-49ba-9a56-ff9c2ebc0007 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:43.087759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4f44c8-6f13-49ba-9a56-ff9c2ebc0007 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:43.089050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4f44c8-6f13-49ba-9a56-ff9c2ebc0007 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:43.089891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4f44c8-6f13-49ba-9a56-ff9c2ebc0007 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:43.090701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e4f44c8-6f13-49ba-9a56-ff9c2ebc0007 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:43.279755 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e4f44c8-6f13-49ba-9a56-ff9c2ebc0007 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action" status: 200 len: 24575 microversion: 2.1 time: 0.255773 Oct 17 16:14:43.283937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:43.294944 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3394/6521] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:14:43 2022] POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action => generated 24575 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:14:43.302846 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6fc60f50-64da-49ef-94fa-5e9faada74b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1375 microversion: 2.1 time: 0.669100 Oct 17 16:14:43.304438 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3128/6522] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:42 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1375 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:44.345736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:44.346881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:44.350154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:44.357870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:44.358967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:44.359706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:44.360664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:44.361262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:44.361706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:44.369207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=84 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:44.539843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:44.549973 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e8ff1e2b-dcc0-4dce-b30c-b313f08ca2a1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1375 microversion: 2.1 time: 0.208556 Oct 17 16:14:44.551226 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3395/6523] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:44 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1375 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:45.577433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:45.579254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:45.591594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:45.592951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:45.594238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:45.596855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:45.597554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:45.598212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:45.828117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:45.848107 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ac052c46-9b25-4ef4-9fba-d15a4b4307e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1562 microversion: 2.1 time: 0.275125 Oct 17 16:14:45.848970 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3129/6524] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:45 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1562 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:45.875313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:45.876044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:45.888983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:45.889480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:45.890146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:45.890901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:45.891540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:45.892164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:46.094704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:46.105285 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9ab9c8d-8044-4e46-bc4a-1d66b61321ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1562 microversion: 2.1 time: 0.234330 Oct 17 16:14:46.123592 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3396/6525] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:45 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:46.235092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:46.235689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:46.242850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:46.243709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:46.244381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:46.245396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:46.246319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:46.247078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:46.323383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:14:46.424515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=26 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:46.459683 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-af368fd1-bfde-4984-9084-6cd00741853b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 204 len: 0 microversion: 2.1 time: 0.230500 Oct 17 16:14:46.460626 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3130/6526] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:14:46 2022] DELETE /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:14:46.469943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:46.471020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:46.479454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:46.480233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:46.480870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:46.481928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:46.482596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:46.483197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:46.688270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:46.702914 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10fcbacb-f984-4d5c-9bbf-628108a05d13 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1568 microversion: 2.1 time: 0.237161 Oct 17 16:14:46.703866 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3397/6527] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:46 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:47.740040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:47.772002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:47.785716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:47.787047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:47.788129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:47.789744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:47.790808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:47.791881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:48.008797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:48.017671 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-94ae70b0-7172-4d87-9418-5c185482a86f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1568 microversion: 2.1 time: 0.292727 Oct 17 16:14:48.022228 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3131/6528] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:47 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:49.044198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:49.044936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:49.056647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:49.061618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:49.062573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:49.064047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:49.064835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:49.065706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:49.342555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:49.374688 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7f982a4-a887-4fec-87ad-f8078a593351 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1526 microversion: 2.1 time: 0.335554 Oct 17 16:14:49.383215 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3398/6529] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:49 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1526 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:49.457283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a36293a5-734b-4d56-904c-69557076250e req-25ece7b0-2ca2-46f6-af57-37c73c1e1b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63f04ce-6161-4b82-9b87-22e382ae63ae", "name": "network-vif-deleted", "tag": "a7edad1e-760d-4c07-9699-a20fc91d29c6"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:14:49.487178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a36293a5-734b-4d56-904c-69557076250e req-25ece7b0-2ca2-46f6-af57-37c73c1e1b01 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:49.488400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a36293a5-734b-4d56-904c-69557076250e req-25ece7b0-2ca2-46f6-af57-37c73c1e1b01 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:49.489312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a36293a5-734b-4d56-904c-69557076250e req-25ece7b0-2ca2-46f6-af57-37c73c1e1b01 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:49.522998 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a36293a5-734b-4d56-904c-69557076250e req-25ece7b0-2ca2-46f6-af57-37c73c1e1b01 service nova] Creating event network-vif-deleted:a7edad1e-760d-4c07-9699-a20fc91d29c6 for instance d63f04ce-6161-4b82-9b87-22e382ae63ae on n-h2-854441-12 Oct 17 16:14:49.532945 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a36293a5-734b-4d56-904c-69557076250e req-25ece7b0-2ca2-46f6-af57-37c73c1e1b01 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081117 Oct 17 16:14:49.534259 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3132/6530] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:14:49.719876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b3c0368-abd5-47ed-9217-4abb2c197ed3 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:49.720670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b3c0368-abd5-47ed-9217-4abb2c197ed3 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:49.756494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b3c0368-abd5-47ed-9217-4abb2c197ed3 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:49.757641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b3c0368-abd5-47ed-9217-4abb2c197ed3 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:49.759566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b3c0368-abd5-47ed-9217-4abb2c197ed3 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:49.771167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b3c0368-abd5-47ed-9217-4abb2c197ed3 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:49.772358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b3c0368-abd5-47ed-9217-4abb2c197ed3 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:49.789310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b3c0368-abd5-47ed-9217-4abb2c197ed3 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:50.058384 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b3c0368-abd5-47ed-9217-4abb2c197ed3 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1834 microversion: 2.1 time: 0.343625 Oct 17 16:14:50.060585 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3399/6531] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:49 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1834 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:50.089631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:50.090262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:50.108902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:50.109735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:50.113315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:50.114634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:50.115312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:50.120545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:50.438608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:50.440483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:50.456748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:50.459681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:50.460649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:50.463530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:50.464503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:50.467158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:50.497734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:50.547001 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba26deb9-fa1e-4cf3-b832-0eca3a538382 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1681 microversion: 2.1 time: 0.458577 Oct 17 16:14:50.553564 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3133/6532] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:50 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1681 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:50.600036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:50.620094 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59768b00-b69f-4695-b576-86d30fca4e28 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1360 microversion: 2.1 time: 0.187329 Oct 17 16:14:50.623549 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3400/6533] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:50 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1360 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:50.749573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2eca5ead-02a0-498e-a7bb-7f08c48d4e6d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:14:50.752695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2eca5ead-02a0-498e-a7bb-7f08c48d4e6d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:50.769664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2eca5ead-02a0-498e-a7bb-7f08c48d4e6d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:50.772884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2eca5ead-02a0-498e-a7bb-7f08c48d4e6d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:50.773443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2eca5ead-02a0-498e-a7bb-7f08c48d4e6d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:50.774238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2eca5ead-02a0-498e-a7bb-7f08c48d4e6d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:50.774776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2eca5ead-02a0-498e-a7bb-7f08c48d4e6d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:50.775231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2eca5ead-02a0-498e-a7bb-7f08c48d4e6d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:50.891516 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2eca5ead-02a0-498e-a7bb-7f08c48d4e6d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action" status: 200 len: 32644 microversion: 2.1 time: 0.146669 Oct 17 16:14:50.892966 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3134/6534] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:14:50 2022] POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action => generated 32644 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 16:14:51.123544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:14:51.124377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:51.138126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:51.138677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:51.139128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:51.139890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:51.140459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:51.143041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:51.240798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a87be9615f2542c5938c6dbb70e9d83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7720b1e460a4e639067686ccde58a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:51.242338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] flavor_id is None. Assuming migration. {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 16:14:51.243095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:14:51.660998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:51.662033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:51.692804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:51.693373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:51.693793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:51.694680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:51.695415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:51.696220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:51.821025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:51.834300 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a42f52ea-8442-42ea-b94b-7119ba41f996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1360 microversion: 2.1 time: 0.185072 Oct 17 16:14:51.835248 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3135/6535] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:51 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1360 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:52.866221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:52.867461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:52.932710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:52.935512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:52.936265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:52.938039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:52.938716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:52.943340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:52.988539 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-534aec7e-88f3-45be-b570-24791d7e12f8 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action" status: 202 len: 0 microversion: 2.1 time: 1.870844 Oct 17 16:14:52.992984 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3401/6536] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:14:51 2022] POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action => generated 0 bytes in 1876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 16:14:53.017648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:53.027443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:53.057443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:53.058960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:53.061072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:53.062091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:53.064633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:53.067435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:53.160443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:53.208849 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a399b2bf-ede8-47ee-93ab-071add3d4346 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1360 microversion: 2.1 time: 0.346390 Oct 17 16:14:53.231386 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3136/6537] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:52 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1360 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:53.401782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:53.411380 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e5b41d68-da5b-4042-b117-f916ff539f11 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1690 microversion: 2.1 time: 0.411980 Oct 17 16:14:53.424237 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3402/6538] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:52 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1690 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:14:54.239034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:54.243430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:54.280989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:54.282064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:54.283929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:54.289010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:54.293436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:54.294180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:54.440661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:54.441511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:54.465555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:54.466140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:54.474560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:54.477725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:54.482002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:54.482660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:54.492112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:54.511503 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b02ec928-1250-4acd-9384-36028601e90b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1360 microversion: 2.1 time: 0.279763 Oct 17 16:14:54.523476 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3137/6539] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:54 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1360 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:54.906486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:54.926453 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33806724-a8b1-4fc0-8615-c13111caa210 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1690 microversion: 2.1 time: 0.493462 Oct 17 16:14:54.931222 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3403/6540] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:54 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1690 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:55.555031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:55.556063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:55.599597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:55.600510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:55.601253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:55.602609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:55.603421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:55.604186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:55.790729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:55.800498 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7a527905-0ce3-4b0b-919c-a567bf654947 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1360 microversion: 2.1 time: 0.252122 Oct 17 16:14:55.809873 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3138/6541] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:55 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1360 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:55.963265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:55.966123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:55.986025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:55.987588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:55.988846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:55.990490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:55.992023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:55.993530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:56.347798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:56.376936 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c366b54-5d03-4724-b839-bfe40a747822 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1690 microversion: 2.1 time: 0.427037 Oct 17 16:14:56.383021 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3404/6542] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:55 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1690 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:56.846176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:56.850748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:56.873625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:56.875160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:56.876205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:56.877805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:56.879030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:56.881066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:56.892994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:14:57.134807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:57.150386 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a7a28c1-c4ee-4e6e-9dd6-4d92ef430c46 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1360 microversion: 2.1 time: 0.313082 Oct 17 16:14:57.163073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3139/6543] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:56 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1360 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:57.416036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:57.420869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:57.449212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:57.452317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:57.455337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:57.456061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:57.456419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:57.456866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:57.745223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:57.755485 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f6618ca7-251b-4e21-b1ed-1a9ec1a18783 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.352880 Oct 17 16:14:57.756940 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3405/6544] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:57 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:58.212820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:58.246552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:58.273579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:58.274920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:58.277014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:58.280129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:58.281679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:58.282607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:58.450701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:58.468828 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5814e3e-cbe9-4e77-8277-3401b1fa76a8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1360 microversion: 2.1 time: 0.278050 Oct 17 16:14:58.484769 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3140/6545] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:58 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1360 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:58.783969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:58.785950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:58.799307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:58.804074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:58.805492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:58.809203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:58.811086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:58.812884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:59.056992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:59.073812 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8cc831e-294d-412f-92be-2f3866c88ecc tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.296010 Oct 17 16:14:59.076392 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3406/6546] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:58 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:14:59.523309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:14:59.526764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:14:59.542131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:59.543728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:59.545060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:59.550538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:59.551684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:59.552685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:59.657948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:14:59.658586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:14:59.659114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:14:59.659818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lazy-loading 'fault' on Instance uuid d63f04ce-6161-4b82-9b87-22e382ae63ae {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:14:59.715157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:14:59.730953 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc702b4c-5ccc-4db4-b8da-7ddd162218e2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 200 len: 1365 microversion: 2.1 time: 0.219147 Oct 17 16:14:59.731695 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3141/6547] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:14:59 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:15:00.104382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:00.106988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:00.126469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:00.131792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:00.134652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:00.135795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:00.136542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:00.137660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:00.383145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:00.395300 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f32d9c01-32a6-468b-88c2-8204f71b60cb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.298578 Oct 17 16:15:00.400370 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3407/6548] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:00 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:00.756002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:00.757354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:00.766067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:00.767080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:00.767741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:00.769097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:00.769894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:00.770598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:00.788517 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae HTTP/1.1 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd63f04ce-6161-4b82-9b87-22e382ae63ae'} Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:00.790986 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:00.796867 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:00.796867 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:00.796867 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:00.796867 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:15:00.796867 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:15:00.796867 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:00.796867 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:00.799097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:15:00.800414 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-280bcf50-9b45-458e-9040-43c441a2533e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 404 len: 111 microversion: 2.1 time: 0.048589 Oct 17 16:15:00.801679 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3142/6549] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:00 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:15:01.432641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:01.438612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:01.457722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:01.458841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:01.459919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:01.461257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:01.462082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:01.462891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:01.730595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:01.745416 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac98c395-783b-47c1-bff6-72a89f8889b2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.324674 Oct 17 16:15:01.747211 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3408/6550] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:01 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:15:02.786619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:02.787835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:02.797674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:02.798185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:02.798972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:02.799730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:02.800198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:02.800803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:03.073055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:03.084160 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7a1dda48-0c5c-466f-832c-c930f96c524e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.301390 Oct 17 16:15:03.116137 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3143/6551] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:02 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:15:04.132396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:04.133213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:04.141113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:04.141619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:04.142073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:04.142890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:04.143359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:04.143799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:04.317403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:04.334606 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b4192157-4dae-47ba-b07e-ecfa44198d7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.206120 Oct 17 16:15:04.354184 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3409/6552] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:04 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:05.362826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:05.363907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:05.382404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:05.384156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:05.385485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:05.387600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:05.388904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:05.389596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:05.681068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:05.692192 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e60c3b10-6cb7-42c7-92f0-8340b52e7ce1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.334888 Oct 17 16:15:05.706801 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3144/6553] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:05 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:06.427763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:06.429475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:06.447289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:06.448444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:06.449058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:06.450323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:06.450999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:06.451610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:06.456092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:06.509719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:15:06.663668 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e408c40-4079-4fab-9f3d-992577636495 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 204 len: 0 microversion: 2.1 time: 0.240711 Oct 17 16:15:06.664321 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3410/6554] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:15:06 2022] DELETE /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:15:06.674417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:06.675261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:06.685368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:06.685940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:06.686601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:06.687372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:06.687858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:06.688307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:06.735391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:06.735977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:06.747340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:06.747706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:06.749907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:06.749907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:06.749907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:06.750471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:06.938823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:06.949148 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-96f04c93-c99a-4e7e-bc5a-9a74ca57863e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1410 microversion: 2.1 time: 0.279325 Oct 17 16:15:06.966218 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3145/6555] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:06 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1410 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:07.059562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:07.071517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02962ae3-d0d6-4177-927e-737268dbdd7b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.342345 Oct 17 16:15:07.072285 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3411/6556] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:06 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:07.985255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:07.987010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:08.009437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:08.010772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:08.012176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:08.014352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:08.015685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:08.017056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:08.106333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:08.107810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:08.117391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:08.117928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:08.118377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:08.119193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:08.119684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:08.120116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:08.295939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:08.307171 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6906e22b-d700-465e-807c-a448d394bcee tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1410 microversion: 2.1 time: 0.329060 Oct 17 16:15:08.323520 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3146/6557] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:07 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1410 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:08.346798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:08.356999 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ea417c0-9efb-43ae-913f-f80eafdb7f21 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.258621 Oct 17 16:15:08.357724 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3412/6558] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:08 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:15:09.352991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:09.353990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:09.378278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:09.379299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:09.381963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:09.387741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:09.389262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:09.390368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:09.405411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:09.407552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:09.446415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:09.449239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:09.450318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:09.455167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:09.459285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:09.460613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:09.749998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:09.766964 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ec9779b9-c77a-4f33-a5db-1a263992675b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1410 microversion: 2.1 time: 0.418451 Oct 17 16:15:09.767787 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3147/6559] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:09 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1410 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:09.946069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:09.957425 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d8cb92d6-4987-4f41-95d4-b2e1fdcafb85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1695 microversion: 2.1 time: 0.578352 Oct 17 16:15:09.976235 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3413/6560] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:09 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1695 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:10.518163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-97c84192-6dfc-4e34-86e0-eb776ba8bfcb req-52e1dedf-8b70-4849-bbc8-9cabd75094d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63a3f1b-92b5-495d-81d1-ea86638e2534", "name": "network-vif-deleted", "tag": "fd5a069d-653d-4625-9618-c10cc0d9eb76"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:15:10.535115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-97c84192-6dfc-4e34-86e0-eb776ba8bfcb req-52e1dedf-8b70-4849-bbc8-9cabd75094d2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:10.535897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-97c84192-6dfc-4e34-86e0-eb776ba8bfcb req-52e1dedf-8b70-4849-bbc8-9cabd75094d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:10.536521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-97c84192-6dfc-4e34-86e0-eb776ba8bfcb req-52e1dedf-8b70-4849-bbc8-9cabd75094d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:10.554900 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-97c84192-6dfc-4e34-86e0-eb776ba8bfcb req-52e1dedf-8b70-4849-bbc8-9cabd75094d2 service nova] Creating event network-vif-deleted:fd5a069d-653d-4625-9618-c10cc0d9eb76 for instance d63a3f1b-92b5-495d-81d1-ea86638e2534 on n-h1-854441-12 Oct 17 16:15:10.562188 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-97c84192-6dfc-4e34-86e0-eb776ba8bfcb req-52e1dedf-8b70-4849-bbc8-9cabd75094d2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048031 Oct 17 16:15:10.563675 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3148/6561] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:15:10.818209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:10.822437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:10.850130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:10.851567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:10.852976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:10.856039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:10.857350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:10.858232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:10.988864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:10.989984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:11.009275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:11.010817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:11.011316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:11.012101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:11.012634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:11.013094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:11.174625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:11.219535 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a7273e9-4659-426f-bb87-00534fb317e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1202 microversion: 2.1 time: 0.411480 Oct 17 16:15:11.259820 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3414/6562] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:10 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1202 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:11.994648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:12.007777 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fbb400e0-38c4-408a-8f2d-c223ead94ade tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1694 microversion: 2.1 time: 1.024365 Oct 17 16:15:12.020675 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3149/6563] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:10 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1694 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:12.282145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:12.289578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:12.319155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:12.329520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:12.331686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:12.337407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:12.345487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:12.346939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:12.539156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:12.565769 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8079b8a-e108-4aaa-8544-2ba9453c527d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1202 microversion: 2.1 time: 0.295914 Oct 17 16:15:12.572701 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3415/6564] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:12 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1202 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:12.609261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-20904dfd-8a3c-4ba6-8154-e6e9b2c3c4d1 req-9021ef00-4e82-42ea-a19e-01119a0e1a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "name": "network-vif-unplugged", "status": "completed", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}, {"name": "network-changed", "server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:15:12.626260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20904dfd-8a3c-4ba6-8154-e6e9b2c3c4d1 req-9021ef00-4e82-42ea-a19e-01119a0e1a5e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:12.627309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20904dfd-8a3c-4ba6-8154-e6e9b2c3c4d1 req-9021ef00-4e82-42ea-a19e-01119a0e1a5e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:12.627934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-20904dfd-8a3c-4ba6-8154-e6e9b2c3c4d1 req-9021ef00-4e82-42ea-a19e-01119a0e1a5e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:12.650188 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-20904dfd-8a3c-4ba6-8154-e6e9b2c3c4d1 req-9021ef00-4e82-42ea-a19e-01119a0e1a5e service nova] Creating event network-vif-unplugged:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h2-854441-12 Oct 17 16:15:12.651092 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-20904dfd-8a3c-4ba6-8154-e6e9b2c3c4d1 req-9021ef00-4e82-42ea-a19e-01119a0e1a5e service nova] Creating event network-changed:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h2-854441-12 Oct 17 16:15:12.659708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-20904dfd-8a3c-4ba6-8154-e6e9b2c3c4d1 req-9021ef00-4e82-42ea-a19e-01119a0e1a5e service nova] Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:15:12.675274 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-20904dfd-8a3c-4ba6-8154-e6e9b2c3c4d1 req-9021ef00-4e82-42ea-a19e-01119a0e1a5e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.071913 Oct 17 16:15:12.677222 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3150/6565] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:15:13.039587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:13.040726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:13.070597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:13.071486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:13.072307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:13.073574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:13.086064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:13.086968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:13.502241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:13.519088 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aa67ee02-da7f-4a00-816d-d3f9e5b1b598 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1694 microversion: 2.1 time: 0.486493 Oct 17 16:15:13.521347 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3416/6566] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:13 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1694 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:13.621485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:13.625167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:13.640303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:13.641472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:13.642196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:13.643322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:13.644605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:13.645649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:14.188732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:14.221605 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0231c435-2410-43ed-9322-2001880438c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1202 microversion: 2.1 time: 0.604536 Oct 17 16:15:14.222631 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3151/6567] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:13 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1202 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:14.568127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:14.573469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:14.609036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:14.616785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:14.619489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:14.620459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:14.626431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:14.627457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:14.628253 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:15.128459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:15.157088 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de22841f-d371-45b2-b96a-ea249d46e8c9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1694 microversion: 2.1 time: 0.598876 Oct 17 16:15:15.159986 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3417/6568] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:14 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1694 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:15.265029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:15.266156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:15.307002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:15.307880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:15.308709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:15.310141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:15.322018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:15.322997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:15.498633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:15.514065 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9902beef-0cb8-4a78-bfc3-f4a08cae60d8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1202 microversion: 2.1 time: 0.255817 Oct 17 16:15:15.516024 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3152/6569] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:15 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1202 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:16.200492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:16.201359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:16.238440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:16.241601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:16.242302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:16.243494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:16.247181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:16.249991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:16.576248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:16.577177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:16.587191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:16.595859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:16.597631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:16.599940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:16.600936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:16.602895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:16.605348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:16.690769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:16.715365 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ffa8e88-7fbe-4ac7-98e3-106630ae2137 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1692 microversion: 2.1 time: 0.515857 Oct 17 16:15:16.716922 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3418/6570] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:16 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1692 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:15:16.794944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:16.807289 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-065be949-305b-443b-9615-b722ee8b109b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1202 microversion: 2.1 time: 0.238769 Oct 17 16:15:16.812501 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3153/6571] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:16 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1202 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:17.755969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:17.757193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:17.768709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:17.769518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:17.770284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:17.771527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:17.772356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:17.773180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:17.841635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:17.844543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:17.859143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:17.860369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:17.861434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:17.863010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:17.864091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:17.865149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:18.034632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:18.052099 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a109fd74-d8bd-4845-a3e2-5fe39a480400 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1202 microversion: 2.1 time: 0.219520 Oct 17 16:15:18.052390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:18.054073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3154/6572] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:17 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1202 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:18.067548 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-00163773-b04d-4606-ad4a-fb7e9205f5bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1689 microversion: 2.1 time: 0.316889 Oct 17 16:15:18.068997 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3419/6573] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:17 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1689 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:18.099727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-53139059-4155-4ef8-864c-ba46396fce02 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:15:18.101012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-53139059-4155-4ef8-864c-ba46396fce02 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:18.121247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53139059-4155-4ef8-864c-ba46396fce02 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:18.122231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53139059-4155-4ef8-864c-ba46396fce02 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:18.123274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53139059-4155-4ef8-864c-ba46396fce02 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:18.125809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53139059-4155-4ef8-864c-ba46396fce02 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:18.127886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53139059-4155-4ef8-864c-ba46396fce02 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:18.128772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53139059-4155-4ef8-864c-ba46396fce02 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:18.265640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:18.328812 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-53139059-4155-4ef8-864c-ba46396fce02 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action" status: 202 len: 0 microversion: 2.1 time: 0.237457 Oct 17 16:15:18.333780 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3155/6574] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:15:18 2022] POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:15:18.344126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:18.345286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:18.374802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:18.375572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:18.376329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:18.377605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:18.378355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:18.379958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:18.851725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:18.864807 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec7e2601-7646-4562-a714-03a3c24c0a80 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1688 microversion: 2.1 time: 0.528929 Oct 17 16:15:18.865689 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3420/6575] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:18 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1688 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:15:19.093758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:19.094407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:19.109834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:19.111711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:19.112238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:19.113671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:19.114167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:19.114655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:19.274266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:19.289017 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b02a4ede-34b8-43f4-8581-3c76ab1efddc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 200 len: 1202 microversion: 2.1 time: 0.200125 Oct 17 16:15:19.291175 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3156/6576] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:19 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 1202 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:19.889537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:19.890443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:19.909120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:19.910065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:19.910700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:19.911596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:19.912204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:19.912784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:20.301330 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:20.321126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:20.325929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:20.339418 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7df6080-0aa2-4371-b6e4-a86ce35effe8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1688 microversion: 2.1 time: 0.450641 Oct 17 16:15:20.343086 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3421/6577] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:19 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1688 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:20.358546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:20.359740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:20.360761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:20.362270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:20.366196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:20.367308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:20.388943 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 HTTP/1.1 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd63a3f1b-92b5-495d-81d1-ea86638e2534'} Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:20.390748 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:20.394233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:20.394233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:20.394233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:20.394233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:15:20.394233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:15:20.394233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:20.394233 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:20.394233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:15:20.394233 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f703d2b6-0ba8-418e-a7fb-c8712b8043aa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 404 len: 111 microversion: 2.1 time: 0.080098 Oct 17 16:15:20.398645 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3157/6578] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:20 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:15:21.138430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0f0743c9-7ccd-459b-ad88-ed7e3886cd19 req-9f7207ce-2e1f-4461-85f8-b3f90fe21691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "name": "network-vif-plugged", "status": "completed", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:15:21.187826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0f0743c9-7ccd-459b-ad88-ed7e3886cd19 req-9f7207ce-2e1f-4461-85f8-b3f90fe21691 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:21.188756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0f0743c9-7ccd-459b-ad88-ed7e3886cd19 req-9f7207ce-2e1f-4461-85f8-b3f90fe21691 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:21.190310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0f0743c9-7ccd-459b-ad88-ed7e3886cd19 req-9f7207ce-2e1f-4461-85f8-b3f90fe21691 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:21.241058 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0f0743c9-7ccd-459b-ad88-ed7e3886cd19 req-9f7207ce-2e1f-4461-85f8-b3f90fe21691 service nova] Creating event network-vif-plugged:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h2-854441-12 Oct 17 16:15:21.265113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-0f0743c9-7ccd-459b-ad88-ed7e3886cd19 req-9f7207ce-2e1f-4461-85f8-b3f90fe21691 service nova] Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:15:21.302052 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0f0743c9-7ccd-459b-ad88-ed7e3886cd19 req-9f7207ce-2e1f-4461-85f8-b3f90fe21691 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174227 Oct 17 16:15:21.303004 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3422/6579] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:15:21.368352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:21.371245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:21.382080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:21.383090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:21.383762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:21.384781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:21.385708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:21.386337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:21.704367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:21.717087 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c36c6fbe-4b06-4159-a0c8-d11b15edea53 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1688 microversion: 2.1 time: 0.354878 Oct 17 16:15:21.732706 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3158/6580] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:21 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1688 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:15:22.753653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:22.766584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:22.798355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:22.799673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:22.800640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:22.802089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:22.803130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:22.804110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:23.284356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:23.312317 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dafbaa6f-c5ba-4bec-983f-d9aacc266519 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1688 microversion: 2.1 time: 0.568238 Oct 17 16:15:23.315150 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3423/6581] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:22 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1688 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:24.358805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:24.360370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:24.376534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:24.377545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:24.379958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-dff0f58b-e99e-4d84-a5bf-2920a59acf92 req-ad07a892-caed-4c51-bc30-1b236187bf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "name": "network-vif-unplugged", "status": "completed", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:15:24.381507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:24.382577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:24.383233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:24.387261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:24.411150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dff0f58b-e99e-4d84-a5bf-2920a59acf92 req-ad07a892-caed-4c51-bc30-1b236187bf67 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:24.416221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dff0f58b-e99e-4d84-a5bf-2920a59acf92 req-ad07a892-caed-4c51-bc30-1b236187bf67 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:24.416480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dff0f58b-e99e-4d84-a5bf-2920a59acf92 req-ad07a892-caed-4c51-bc30-1b236187bf67 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:24.467060 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-dff0f58b-e99e-4d84-a5bf-2920a59acf92 req-ad07a892-caed-4c51-bc30-1b236187bf67 service nova] Creating event network-vif-unplugged:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h1-854441-12 Oct 17 16:15:24.486819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-dff0f58b-e99e-4d84-a5bf-2920a59acf92 req-ad07a892-caed-4c51-bc30-1b236187bf67 service nova] Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:15:24.526894 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-dff0f58b-e99e-4d84-a5bf-2920a59acf92 req-ad07a892-caed-4c51-bc30-1b236187bf67 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147201 Oct 17 16:15:24.527360 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3424/6582] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:15:24.873669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:24.885255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3fbc099d-318b-41a1-b563-ffafaf4a2677 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1688 microversion: 2.1 time: 0.533470 Oct 17 16:15:24.885878 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3159/6583] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:24 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1688 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:15:24.941285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:24.942347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:24.953447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:24.954974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:24.958711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:24.959755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:24.960388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:24.961142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:24.979098 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae HTTP/1.1 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'd63f04ce-6161-4b82-9b87-22e382ae63ae'} Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:15:24.981528 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:24.985268 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:15:24.988128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:15:24.990099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0109fe5b-09eb-4907-ae03-4aacb52a28e0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 404 len: 111 microversion: 2.1 time: 0.057687 Oct 17 16:15:24.991327 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3425/6584] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:15:24 2022] DELETE /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:15:25.000750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:25.003550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63f04ce-6161-4b82-9b87-22e382ae63ae] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:25.030332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:25.034032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:25.045625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:25.049195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:25.051862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:25.054492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:25.120831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae HTTP/1.1 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd63f04ce-6161-4b82-9b87-22e382ae63ae'} Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:25.125117 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:25.128394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:25.128394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:25.128394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:25.128394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:15:25.128394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:15:25.128394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. Oct 17 16:15:25.128394 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:25.132265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance d63f04ce-6161-4b82-9b87-22e382ae63ae could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:15:25.134944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4cc2bd55-c137-4e07-8f1a-ae83c59e9632 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae" status: 404 len: 111 microversion: 2.1 time: 0.138733 Oct 17 16:15:25.136151 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3160/6585] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:24 2022] GET /compute/v2.1/servers/d63f04ce-6161-4b82-9b87-22e382ae63ae => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:15:25.914493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:25.915683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:25.952858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:25.956876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:25.960335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:25.964749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:25.965784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:25.974727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:26.064826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:26.415959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:26.421504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:26.449087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:26.455618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:26.457905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:26.461228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:26.462972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:26.469188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:26.511647 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 HTTP/1.1 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd63a3f1b-92b5-495d-81d1-ea86638e2534'} Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:15:26.516247 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-03ef2f17-2b47-450b-a77a-03f80123f2b2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 404 len: 111 microversion: 2.1 time: 0.120903 Oct 17 16:15:26.527692 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3161/6586] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:15:26 2022] DELETE /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:15:26.537246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:26.552703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:26.554689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: d63a3f1b-92b5-495d-81d1-ea86638e2534] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:26.571560 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b1b5993-1ad5-4e85-bb14-e34a25ffad29 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1688 microversion: 2.1 time: 0.665339 Oct 17 16:15:26.572206 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3426/6587] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:25 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1688 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:26.577869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:26.579018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:26.580375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:26.582473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:26.583765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:26.584755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:26.623639 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 HTTP/1.1 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'd63a3f1b-92b5-495d-81d1-ea86638e2534'} Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:15:26.627256 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.634678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:15:26.634678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:15:26.634678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:15:26.634678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:15:26.634678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:15:26.634678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. Oct 17 16:15:26.634678 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:15:26.636777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance d63a3f1b-92b5-495d-81d1-ea86638e2534 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:15:26.638753 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b766a479-ed46-419d-b62b-11ade349ecf1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534" status: 404 len: 111 microversion: 2.1 time: 0.106091 Oct 17 16:15:26.640821 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3162/6588] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:26 2022] GET /compute/v2.1/servers/d63a3f1b-92b5-495d-81d1-ea86638e2534 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:15:26.666022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-beb63272-96df-43de-bbd4-a26fc61e9a73 req-64db081c-3944-4284-9e58-fc59aea1e10e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:15:26.692613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-beb63272-96df-43de-bbd4-a26fc61e9a73 req-64db081c-3944-4284-9e58-fc59aea1e10e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:26.694438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-beb63272-96df-43de-bbd4-a26fc61e9a73 req-64db081c-3944-4284-9e58-fc59aea1e10e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:26.695806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-beb63272-96df-43de-bbd4-a26fc61e9a73 req-64db081c-3944-4284-9e58-fc59aea1e10e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:26.729485 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-beb63272-96df-43de-bbd4-a26fc61e9a73 req-64db081c-3944-4284-9e58-fc59aea1e10e service nova] Creating event network-changed:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h1-854441-12 Oct 17 16:15:26.745438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-beb63272-96df-43de-bbd4-a26fc61e9a73 req-64db081c-3944-4284-9e58-fc59aea1e10e service nova] Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:15:26.801440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5248841e-fad8-45e7-bed3-56f57ca2160a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'create', calling method: .version_select at 0x7f28bdaa5430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-476934204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2ozCcOsU46qYo44R0VyqwmTDhV8zOLyGXeO1Wh5J/ozqufPAecOSZ6MLpU+AeP3BuGmIukD4xOffV/+lfyy0tL8/9AaYMCkcfmnsgSoRUeSXkAzJH+g4n8069j0xyoUw=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:15:26.802553 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-beb63272-96df-43de-bbd4-a26fc61e9a73 req-64db081c-3944-4284-9e58-fc59aea1e10e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150359 Oct 17 16:15:26.805260 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3427/6589] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:15:26.864221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5248841e-fad8-45e7-bed3-56f57ca2160a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for project 3c3c7e65217649918748f9d327a1c930. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:15:26.874775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-5248841e-fad8-45e7-bed3-56f57ca2160a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for user a7647fbb42444923aa218f5579dd30a0 and project 3c3c7e65217649918748f9d327a1c930. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:15:26.998295 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5248841e-fad8-45e7-bed3-56f57ca2160a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.208363 Oct 17 16:15:27.000260 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3163/6590] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:15:26 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:15:27.604237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:27.645737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:27.671585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:27.673457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:27.674302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:27.675790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:27.677349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:27.678153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:28.035078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:28.045943 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-975f72b2-080f-4e50-a08a-7614345e1388 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1688 microversion: 2.1 time: 0.450482 Oct 17 16:15:28.077619 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3428/6591] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:27 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1688 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:29.109594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:29.111000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:29.133320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:29.133842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:29.134388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:29.135258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:29.135758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:29.136209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:29.802870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:15:29.836208 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-01699090-a8f1-4b2b-870a-f7c2d31ebf39 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1681 microversion: 2.1 time: 0.730980 Oct 17 16:15:29.862922 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3164/6592] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:29 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1681 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:15:32.894616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6b61ef50-aac3-45ce-8b79-04a7d8c9575c req-bb5560cc-9a17-4625-9abf-7a4b32a9a0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "name": "network-vif-plugged", "status": "completed", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:15:32.917058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6b61ef50-aac3-45ce-8b79-04a7d8c9575c req-bb5560cc-9a17-4625-9abf-7a4b32a9a0f9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:32.920407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6b61ef50-aac3-45ce-8b79-04a7d8c9575c req-bb5560cc-9a17-4625-9abf-7a4b32a9a0f9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:32.923659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6b61ef50-aac3-45ce-8b79-04a7d8c9575c req-bb5560cc-9a17-4625-9abf-7a4b32a9a0f9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:32.954147 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6b61ef50-aac3-45ce-8b79-04a7d8c9575c req-bb5560cc-9a17-4625-9abf-7a4b32a9a0f9 service nova] Creating event network-vif-plugged:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h1-854441-12 Oct 17 16:15:32.969720 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6b61ef50-aac3-45ce-8b79-04a7d8c9575c req-bb5560cc-9a17-4625-9abf-7a4b32a9a0f9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079274 Oct 17 16:15:32.974392 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3429/6593] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:15:52.330804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:52.332046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:52.335724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:52.710521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-caf1d0d8-0788-498c-9c75-cf752bf265bb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:15:52.720504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-caf1d0d8-0788-498c-9c75-cf752bf265bb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:52.769079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf1d0d8-0788-498c-9c75-cf752bf265bb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:52.770795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf1d0d8-0788-498c-9c75-cf752bf265bb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:52.771783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf1d0d8-0788-498c-9c75-cf752bf265bb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:52.774493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf1d0d8-0788-498c-9c75-cf752bf265bb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:52.782583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf1d0d8-0788-498c-9c75-cf752bf265bb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:52.788279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-caf1d0d8-0788-498c-9c75-cf752bf265bb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:52.904535 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-caf1d0d8-0788-498c-9c75-cf752bf265bb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action" status: 200 len: 63249 microversion: 2.1 time: 0.590640 Oct 17 16:15:52.906876 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3165/6594] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:15:52 2022] POST /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9/action => generated 63249 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 16:15:59.164420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=25 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:59.165239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=15 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:15:59.181883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b348a7a6-68fd-4645-b232-749b1e98a570 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:15:59.189900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b348a7a6-68fd-4645-b232-749b1e98a570 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:15:59.213184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b348a7a6-68fd-4645-b232-749b1e98a570 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:59.227455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b348a7a6-68fd-4645-b232-749b1e98a570 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:59.228206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b348a7a6-68fd-4645-b232-749b1e98a570 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:59.229739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b348a7a6-68fd-4645-b232-749b1e98a570 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:15:59.230399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b348a7a6-68fd-4645-b232-749b1e98a570 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:15:59.231097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b348a7a6-68fd-4645-b232-749b1e98a570 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:15:59.562401 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b348a7a6-68fd-4645-b232-749b1e98a570 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1834 microversion: 2.1 time: 0.400374 Oct 17 16:15:59.591541 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3430/6595] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:15:59 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1834 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:02.881307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:02.887302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:02.917351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:02.923102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:02.944615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:02.946635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:02.948146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:02.949877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:02.951069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:02.952179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:03.142189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:16:03.668400 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-22daf0eb-20f4-438b-b9fe-050d91746d06 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 204 len: 0 microversion: 2.1 time: 0.799938 Oct 17 16:16:03.672148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fc06a077-238a-484a-82da-04ae2cbc5128 req-4b38c2ea-0ce2-455b-a23e-fc0a76340345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:03.680573 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3166/6596] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:16:02 2022] DELETE /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:16:03.708387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:03.709645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:03.751098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fc06a077-238a-484a-82da-04ae2cbc5128 req-4b38c2ea-0ce2-455b-a23e-fc0a76340345 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:03.756209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fc06a077-238a-484a-82da-04ae2cbc5128 req-4b38c2ea-0ce2-455b-a23e-fc0a76340345 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:03.757098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fc06a077-238a-484a-82da-04ae2cbc5128 req-4b38c2ea-0ce2-455b-a23e-fc0a76340345 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:03.766021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:03.767475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:03.768294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:03.769732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:03.770645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:03.771477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:03.870413 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fc06a077-238a-484a-82da-04ae2cbc5128 req-4b38c2ea-0ce2-455b-a23e-fc0a76340345 service nova] Creating event network-changed:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h1-854441-12 Oct 17 16:16:03.914861 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fc06a077-238a-484a-82da-04ae2cbc5128 req-4b38c2ea-0ce2-455b-a23e-fc0a76340345 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.008688 Oct 17 16:16:03.924123 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3431/6597] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:16:04.370964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:04.399439 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b6fca456-ba1d-4f77-b65f-1e4b2a4826cf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1687 microversion: 2.1 time: 0.707818 Oct 17 16:16:04.404654 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3167/6598] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:03 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1687 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:05.473469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:05.477059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:05.506941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:05.507904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:05.508712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:05.521189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:05.524199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:05.525014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:06.610284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:06.651753 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5bf362f3-4a49-4308-a1e1-e8724817da85 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1687 microversion: 2.1 time: 1.207374 Oct 17 16:16:06.684152 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3432/6599] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:05 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1687 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:07.314022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5c076e22-bad3-4303-bc36-e56351551dcb req-7c6c2d59-68a7-404f-a5b0-f54eeb7b12c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e988f33e-abe3-4db9-9716-ec948a86f4c9", "name": "network-vif-deleted", "tag": "c33f541c-d501-4cdd-b28a-63259b7ca1dd"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:07.377709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5c076e22-bad3-4303-bc36-e56351551dcb req-7c6c2d59-68a7-404f-a5b0-f54eeb7b12c3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:07.378722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5c076e22-bad3-4303-bc36-e56351551dcb req-7c6c2d59-68a7-404f-a5b0-f54eeb7b12c3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:07.383823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5c076e22-bad3-4303-bc36-e56351551dcb req-7c6c2d59-68a7-404f-a5b0-f54eeb7b12c3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:07.488880 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5c076e22-bad3-4303-bc36-e56351551dcb req-7c6c2d59-68a7-404f-a5b0-f54eeb7b12c3 service nova] Creating event network-vif-deleted:c33f541c-d501-4cdd-b28a-63259b7ca1dd for instance e988f33e-abe3-4db9-9716-ec948a86f4c9 on n-h1-854441-12 Oct 17 16:16:07.528819 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5c076e22-bad3-4303-bc36-e56351551dcb req-7c6c2d59-68a7-404f-a5b0-f54eeb7b12c3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208163 Oct 17 16:16:07.535637 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3168/6600] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:16:07.708863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:07.716037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:07.767222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:07.767782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:07.768240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:07.768998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:07.769459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:07.769887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:07.930730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:07.931225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:07.937427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:07.938250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lazy-loading 'fault' on Instance uuid e988f33e-abe3-4db9-9716-ec948a86f4c9 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:16:08.045599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:08.056553 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-38851f2d-9e26-409e-85a5-11f23cdd3cad tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 200 len: 1356 microversion: 2.1 time: 0.355126 Oct 17 16:16:08.071983 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3433/6601] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:07 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 1356 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:09.121596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:09.122388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: e988f33e-abe3-4db9-9716-ec948a86f4c9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:09.172014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:09.173222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:09.173702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:09.174616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:09.174973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:09.188705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:09.235798 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] HTTP exception thrown: Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 could not be found. Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Request method failure captured: Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 HTTP/1.1 Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX6JzVteHpYsi1D8rtpfL_oxwZ0lNzSfAyclZrJa7nZMw7HEkOi0WpbQmGdmXXk4CJJ1m6_Lh-rtNT3Hb5Dl3ZmA5fU2LekXOChdpwgzlw04g6yjpCYmDMcnf0VTmocaMWCNEr8bZCQcvb7VhsaicWh4CY_ie470QWOh_IWzucQey3c Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 176e8f23ffdb4cf2941eca94a577375b Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 176e8f23ffdb4cf2941eca94a577375b Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestNetworkAdvancedServerOps-734931086-project Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6d3c6140894e446a9272e1a9247cbb1b Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-734931086-project Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 could not be found. Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'e988f33e-abe3-4db9-9716-ec948a86f4c9'} Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 could not be found. Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 could not be found. Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:16:09.240669 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:16:09.245500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:16:09.245500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:16:09.245500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:16:09.245500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:16:09.245500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:16:09.245500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:16:09.245500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 could not be found. Oct 17 16:16:09.245500 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:16:09.248885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Returning 404 to user: Instance e988f33e-abe3-4db9-9716-ec948a86f4c9 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:16:09.250113 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-137e1dc5-587c-4689-b455-f38c3d4c9ee0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9" status: 404 len: 111 microversion: 2.1 time: 0.134176 Oct 17 16:16:09.263866 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3169/6602] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:09 2022] GET /compute/v2.1/servers/e988f33e-abe3-4db9-9716-ec948a86f4c9 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:16:11.041147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1035685320", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-476934204", "security_groups": [{"name": "tempest-secgroup-smoke-752350876"}], "block_device_mapping_v2": [{"uuid": "9f8c8a3b-04b7-4754-8953-cbb4a62e6937", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "916c7d18-0cf6-4aa6-bd9b-213b6c12b936"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:11.378717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] validate_networks() for [('916c7d18-0cf6-4aa6-bd9b-213b6c12b936', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:16:14.023413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:16:14.025896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:16:14.027119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:16:14.028266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:16:14.029295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:16:14.079636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:14.080533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:14.081323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:14.082860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:14.084059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:14.085340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:14.122936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:16:14.146623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for user a7647fbb42444923aa218f5579dd30a0 and project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:16:14.291142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:16:14.296546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f8c8a3b-04b7-4754-8953-cbb4a62e6937',volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:16:14.932362 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf46f6b6-e6ce-438e-b36c-01a261d6534d tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.899807 Oct 17 16:16:14.941115 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3434/6603] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:16:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 3911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:16:14.961548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab720830-df08-46ac-b59c-c0e99045691a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:14.963100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab720830-df08-46ac-b59c-c0e99045691a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:15.644104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ab720830-df08-46ac-b59c-c0e99045691a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:15.673179 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab720830-df08-46ac-b59c-c0e99045691a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1094 microversion: 2.1 time: 0.731273 Oct 17 16:16:15.675749 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3170/6604] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:14 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1094 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:16.708978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:16.710131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:16.750069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:16.753212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:16.754013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:16.755396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:16.759117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:16.759621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:16.926337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:16.936848 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-881e6742-46cc-4b38-9b3b-a86c0a68c790 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1136 microversion: 2.1 time: 0.237615 Oct 17 16:16:16.937496 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3435/6605] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:16 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1136 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:17.980616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:17.981944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:18.010132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:18.012966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:18.013456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:18.014251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:18.021287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:18.021812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:18.367952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:18.399322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc4ee3db-9154-4e3e-9ec3-5783809b4e95 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1200 microversion: 2.1 time: 0.419555 Oct 17 16:16:18.413306 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3171/6606] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:17 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1200 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:19.457808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:19.460158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:19.498710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:19.500331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:19.515102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:19.516961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:19.518235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:19.519316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:19.712776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:19.726976 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de25ede1-6742-4d8c-9737-55298168ffb4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1210 microversion: 2.1 time: 0.282728 Oct 17 16:16:19.731483 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3436/6607] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:19 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1210 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:20.836336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:20.838359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:20.869427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:20.870698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:20.871940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:20.874741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:20.881005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:20.881857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:22.489204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9e8d9f8f-5c8d-4e04-a6f6-0b09ca643910 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '.version_select at 0x7f28be360670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:22.517157 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e8d9f8f-5c8d-4e04-a6f6-0b09ca643910 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [36474296-f7ff-4acf-9067-e7a2c30eb8a3] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:16:22.655440 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:16:22.655440 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:16:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f (ip 10.222.0.87) !!! Oct 17 16:16:23.091400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:23.123907 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-40a576fe-62de-42d1-ad3a-32a198dce836 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 2.358678 Oct 17 16:16:23.129121 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3172/6608] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:20 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:23.531242 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e8d9f8f-5c8d-4e04-a6f6-0b09ca643910 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [36474296-f7ff-4acf-9067-e7a2c30eb8a3] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 34702. Oct 17 16:16:23.598257 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9e8d9f8f-5c8d-4e04-a6f6-0b09ca643910 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-526504184" status: 202 len: 0 microversion: 2.1 time: 1.128346 Oct 17 16:16:23.598923 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3437/6609] 10.222.0.87 () {58 vars in 1281 bytes} [Mon Oct 17 16:16:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-526504184 => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:16:23.653001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eead075b-9a68-4de6-8b7e-0dafae66be90 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'create', calling method: .version_select at 0x7f28be354a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2066439931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/rmHY5m5UtH+c2Cq6zZNGl8njQ4J+mFVrvnQUDwUAG7xoHCfhmLi0k3Ur3/SmZqD4Dpv0/ED3ZvG0Oj5H0wR0dbxmy4nyCALLMeSpw1mMaQpx6tVhl7q/nCAQmDaogg=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:23.730978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-eead075b-9a68-4de6-8b7e-0dafae66be90 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:16:23.749545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-eead075b-9a68-4de6-8b7e-0dafae66be90 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for user 6d3c6140894e446a9272e1a9247cbb1b and project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:16:23.807126 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eead075b-9a68-4de6-8b7e-0dafae66be90 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.164787 Oct 17 16:16:23.808241 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3173/6610] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:16:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:16:24.173235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:24.178427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:24.200783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:24.207553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:24.211322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:24.212640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:24.215988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:24.217987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:24.223331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:24.224664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:25.688196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:25.705910 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d306ae4b-597e-4fb4-87e1-d55c2eb8a15e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 1.538083 Oct 17 16:16:25.707905 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3438/6611] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:24 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:26.741126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:26.748510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:26.782727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:26.783932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:26.785079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:26.786734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:26.791789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:26.795095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:27.544149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:27.595235 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7cf512d4-b0bd-4244-b620-f7b9cd744692 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 0.864487 Oct 17 16:16:27.605057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7586efd1-d794-449c-a5de-31ed8016adc4 req-bb5081a4-7aaa-42db-8b87-5fef3a1867bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c86145-9837-4081-bf7b-966893f86c4f", "tag": "b071a161-4dad-4b0e-b2c9-06ac1bd0dc2d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:27.631345 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3174/6612] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:26 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:27.644299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7586efd1-d794-449c-a5de-31ed8016adc4 req-bb5081a4-7aaa-42db-8b87-5fef3a1867bb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:27.646073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7586efd1-d794-449c-a5de-31ed8016adc4 req-bb5081a4-7aaa-42db-8b87-5fef3a1867bb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:27.646993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7586efd1-d794-449c-a5de-31ed8016adc4 req-bb5081a4-7aaa-42db-8b87-5fef3a1867bb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:27.674391 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7586efd1-d794-449c-a5de-31ed8016adc4 req-bb5081a4-7aaa-42db-8b87-5fef3a1867bb service nova] Creating event network-changed:b071a161-4dad-4b0e-b2c9-06ac1bd0dc2d for instance 23c86145-9837-4081-bf7b-966893f86c4f on n-h2-854441-12 Oct 17 16:16:27.685799 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7586efd1-d794-449c-a5de-31ed8016adc4 req-bb5081a4-7aaa-42db-8b87-5fef3a1867bb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087399 Oct 17 16:16:27.688861 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3439/6613] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:16:28.639558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:28.640338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:28.657301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:28.657969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:28.658446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:28.659263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:28.659750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:28.660206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:29.302697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:29.316373 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-11d32fad-c6f0-4d72-a0c3-59b152fac175 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 0.682400 Oct 17 16:16:29.317161 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3175/6614] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:28 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:29.909680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b47c61f7-8d25-4998-a965-e298e387c6fa tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Action: 'create', calling method: .version_select at 0x7f28be2f43a0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1772634025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoGeaZtJpayxzOB9XV/cc64Sy4+PHVCffoCV+5NAoKSQtzaN5RBoKAPoSgYXWKqAAWIMKsYcIZQjB0OMtlQmuIcM/6j2rigGyaA0/3TILdCMs9cZgwfJmpyAAUxNyH8jA=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:29.926097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:29.955729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b47c61f7-8d25-4998-a965-e298e387c6fa tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Getting quotas for project bea8b01b2e224f00ab05a2caacc4fa45. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:16:29.969568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b47c61f7-8d25-4998-a965-e298e387c6fa tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Getting quotas for user 8648118cfbbd49c2a76d58dd84f228e5 and project bea8b01b2e224f00ab05a2caacc4fa45. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:16:30.048630 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b47c61f7-8d25-4998-a965-e298e387c6fa tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.892490 Oct 17 16:16:30.049342 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3440/6615] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:16:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:16:30.346548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:30.348739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:30.383375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:30.384267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:30.385066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:30.386435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:30.405253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:30.410394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:31.421049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:31.438127 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-52c65ebf-67e2-4c5e-aaf6-6b478a43beaa tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 1.099018 Oct 17 16:16:31.438988 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3176/6616] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:30 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:32.468210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:32.469872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:32.486694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:32.490866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:32.491607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:32.492541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:32.493181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:32.494627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:32.514098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=45 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:32.828865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:32.845848 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9330a20-3cce-4a50-9bcc-b6216f0f50e1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 0.380970 Oct 17 16:16:32.850334 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3441/6617] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:32 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:33.875797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:33.877284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:33.900423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:33.902487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:33.904720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:33.907200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:33.908089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:33.909036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:33.909743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:33.910378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:33.973653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:34.093612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1932830468", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1772634025", "security_groups": [{"name": "tempest-secgroup-smoke-1687304004"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "ea67a91c-febf-4ee4-9ae3-69e81b48369a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:34.401483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] validate_networks() for [('ea67a91c-febf-4ee4-9ae3-69e81b48369a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:16:34.788212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:34.844770 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2558995a-6be7-47d3-b436-f962b84e8f80 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 0.970643 Oct 17 16:16:34.851067 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3177/6618] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:33 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:35.746104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Getting quotas for project bea8b01b2e224f00ab05a2caacc4fa45. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:16:35.753533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Getting quotas for user 8648118cfbbd49c2a76d58dd84f228e5 and project bea8b01b2e224f00ab05a2caacc4fa45. Resources: dict_keys(['metadata_items']) {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:16:35.774827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:16:35.775654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:16:35.776453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:16:35.777369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:16:35.778001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:16:35.792117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:35.793008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:35.793946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:35.795113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:35.795759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:35.796721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:35.823833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Getting quotas for project bea8b01b2e224f00ab05a2caacc4fa45. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:16:35.836643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Getting quotas for user 8648118cfbbd49c2a76d58dd84f228e5 and project bea8b01b2e224f00ab05a2caacc4fa45. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:16:35.894417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:35.900021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:16:35.902124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:35.907986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:16:35.932497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:35.934232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:35.935287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:35.936780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:35.937790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:35.938785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:36.206481 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b80b0037-a0d5-4954-ac5f-68136a2022ed tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.123358 Oct 17 16:16:36.224659 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3442/6619] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:16:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 16:16:36.234368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b598fb18-3a70-46af-936a-a0adfb4a88c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:36.235546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b598fb18-3a70-46af-936a-a0adfb4a88c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:36.322614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:36.381984 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6413c809-b3b3-4f67-adff-f6bfb48b371e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 0.509506 Oct 17 16:16:36.395850 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3178/6620] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:35 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:36.422204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b598fb18-3a70-46af-936a-a0adfb4a88c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:36.458354 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b598fb18-3a70-46af-936a-a0adfb4a88c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1303 microversion: 2.1 time: 0.231163 Oct 17 16:16:36.471457 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3443/6621] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:36 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1303 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:37.426886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:37.428527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:37.445382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:37.447753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:37.449875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:37.452227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:37.457185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:37.458713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:37.503414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5656c26f-2bb4-4186-ac21-7ea198373cb0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:37.504203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5656c26f-2bb4-4186-ac21-7ea198373cb0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:37.888307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:37.931643 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a02b2a9b-5b83-4109-b2d9-d1f43897a500 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 0.508462 Oct 17 16:16:37.938239 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3179/6622] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:37 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:38.081895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5656c26f-2bb4-4186-ac21-7ea198373cb0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:38.103252 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5656c26f-2bb4-4186-ac21-7ea198373cb0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1303 microversion: 2.1 time: 0.605303 Oct 17 16:16:38.107079 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3444/6623] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:37 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1303 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:38.980236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:38.983979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:39.034153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:39.035724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:39.036760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:39.038347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:39.039695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:39.042689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:39.155953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:39.160754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:39.194672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:39.228778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:39.235755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:39.238964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:39.242472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:39.243209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:39.524521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:39.566364 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-41cc8c2f-6483-456c-b4c0-597219cad902 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 0.581145 Oct 17 16:16:39.568277 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3180/6624] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:38 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:39.745413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c0e0ea29-14c6-46ca-bf9b-838f5d2f63b5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Action: 'create', calling method: .version_select at 0x7f28be0a1ca0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-173076975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9GFsTffBliSNMD78+C85FKQtVJMAryhx5LfJKcurJTHOx77/fqzXr26eD3OZjohQt7LGd7waLg+AF5G76M/D1QZwQMSmuS0JSMchtJjcXdA/CLMJT16iXRcBf2pqGSYA=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:39.774293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c0e0ea29-14c6-46ca-bf9b-838f5d2f63b5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Getting quotas for project 913261047d294e9b81c74230becdbce7. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:16:39.843543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:39.860503 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f47309d9-8f59-4e28-bd56-2aaeb0177b82 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1363 microversion: 2.1 time: 0.718130 Oct 17 16:16:39.875625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c0e0ea29-14c6-46ca-bf9b-838f5d2f63b5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Getting quotas for user 3c08dd9658f545019efd94dab0bc8efb and project 913261047d294e9b81c74230becdbce7. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:16:39.881410 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3445/6625] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:39 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1363 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:39.945109 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c0e0ea29-14c6-46ca-bf9b-838f5d2f63b5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.205555 Oct 17 16:16:39.956860 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3181/6626] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:16:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:16:40.610229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:40.615601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:40.653955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:40.654385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:40.654880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:40.659896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:40.660396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:40.660864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:40.902458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:40.909585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:40.931978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:40.933448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:40.934580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:40.936549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:40.940482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:40.943832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:41.132312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:41.154320 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f1c0dedd-3d0b-4319-951d-21e65ba4b3a0 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1361 microversion: 2.1 time: 0.261627 Oct 17 16:16:41.156649 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3182/6627] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:40 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:42.145703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:42.155253 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de2b10c5-bf15-4775-9e9a-f734aae5f067 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 1.565575 Oct 17 16:16:42.176507 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3446/6628] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:40 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:42.197356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:42.198011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:42.229025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:42.229555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:42.230087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:42.231729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:42.236537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:42.240669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:42.562557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:42.583910 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9481cee6-8f60-4a39-acd1-d2642dc2ec17 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1361 microversion: 2.1 time: 0.391568 Oct 17 16:16:42.587602 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3183/6629] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:42 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1361 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:43.186050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:43.186889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:43.203621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:43.204502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:43.204967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:43.205727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:43.208459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:43.210488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:43.228567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-102794252", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0a4bcd77-b8f2-43c3-8682-fc958efec404", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-173076975", "security_groups": [{"name": "tempest-secgroup-smoke-1522762731"}], "networks": [{"uuid": "fa14b245-6af8-42fc-80d5-aa967faccb04"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:43.544493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] validate_networks() for [('fa14b245-6af8-42fc-80d5-aa967faccb04', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:16:43.867730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:43.899462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1d73456e-0143-4154-9ac8-622060c6f1b3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1277 microversion: 2.1 time: 0.718798 Oct 17 16:16:43.907090 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3447/6630] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:43 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1277 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:43.919905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:43.920694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:43.933165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:43.934087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:43.935622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:43.943559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:43.944502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:43.946054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:44.176177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:44.219775 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f126c5a6-470e-4bfa-a4d3-e8cec0f46aa1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1361 microversion: 2.1 time: 0.309281 Oct 17 16:16:44.222859 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3448/6631] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:43 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1361 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:44.606421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:16:44.608266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:16:44.610185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:16:44.611329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:16:44.612972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:16:44.662247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:44.663884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:44.665792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:44.669065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:44.676940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:44.677608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:44.706579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Getting quotas for project 913261047d294e9b81c74230becdbce7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:16:44.716521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Getting quotas for user 3c08dd9658f545019efd94dab0bc8efb and project 913261047d294e9b81c74230becdbce7. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:16:44.912890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:16:44.915307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a4bcd77-b8f2-43c3-8682-fc958efec404',volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:16:44.941909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:44.949364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:44.970537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:44.971855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:44.973828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:44.977986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:44.979485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:44.980999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:45.185851 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-93facace-6819-4e87-8ded-75f28a7febb6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.964724 Oct 17 16:16:45.192948 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3184/6632] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:16:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:16:45.199486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b2c4d68-a51f-4b3c-b74d-bb7b7b2119f5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:45.201301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2b2c4d68-a51f-4b3c-b74d-bb7b7b2119f5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:45.317487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2b2c4d68-a51f-4b3c-b74d-bb7b7b2119f5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:45.327914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2b2c4d68-a51f-4b3c-b74d-bb7b7b2119f5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1097 microversion: 2.1 time: 0.132623 Oct 17 16:16:45.329605 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3185/6633] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:45 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1097 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:45.335635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:45.336727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:45.345705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:45.346576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:45.348725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:45.350132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:45.350967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:45.351806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:45.477550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:45.499923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-73036421-e89e-447f-bbc2-8850423a1353 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1265 microversion: 2.1 time: 0.577857 Oct 17 16:16:45.516853 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3449/6634] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:44 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1265 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:45.642569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:45.657836 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5b64d94d-c75b-4307-9885-3a91d32df374 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1429 microversion: 2.1 time: 0.326075 Oct 17 16:16:45.658771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-230869635", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "bc5bb2b8-6115-41a2-b757-656378a8fb2e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2066439931", "security_groups": [{"name": "tempest-secgroup-smoke-378558059"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:45.669935 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3186/6635] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:45 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1429 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:45.814768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:45.938225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] validate_networks() for [('bc5bb2b8-6115-41a2-b757-656378a8fb2e', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:16:46.359667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:46.360337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:46.374425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:46.374980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:46.375656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:46.376605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:46.379313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:46.380002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:46.685921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:46.709569 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7ce5d1b7-eb3d-4058-b491-0fcd0712e09e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1147 microversion: 2.1 time: 0.353819 Oct 17 16:16:46.729823 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3187/6636] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:46 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1147 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:46.995694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:16:46.997316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:16:46.998295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:16:46.999241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:16:47.000218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:16:47.041863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:47.044041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:47.046952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:47.049645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:47.052271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-e2cc5e0d-91e6-47fb-9bfe-e09d06006072 req-7a96d3e2-6c88-483d-8886-9eac67430376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fdce32-a449-4977-be0e-afe0facb6e69", "tag": "03ce5a76-214a-4ab4-ab96-7db589c270e8"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:47.055492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:47.061315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:47.064116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e2cc5e0d-91e6-47fb-9bfe-e09d06006072 req-7a96d3e2-6c88-483d-8886-9eac67430376 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:47.065287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e2cc5e0d-91e6-47fb-9bfe-e09d06006072 req-7a96d3e2-6c88-483d-8886-9eac67430376 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:47.066206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-e2cc5e0d-91e6-47fb-9bfe-e09d06006072 req-7a96d3e2-6c88-483d-8886-9eac67430376 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:47.081501 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-e2cc5e0d-91e6-47fb-9bfe-e09d06006072 req-7a96d3e2-6c88-483d-8886-9eac67430376 service nova] Creating event network-changed:03ce5a76-214a-4ab4-ab96-7db589c270e8 for instance 39fdce32-a449-4977-be0e-afe0facb6e69 on n-h1-854441-12 Oct 17 16:16:47.090076 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-e2cc5e0d-91e6-47fb-9bfe-e09d06006072 req-7a96d3e2-6c88-483d-8886-9eac67430376 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355541 Oct 17 16:16:47.091094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3188/6637] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:16:47.098298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:47.099062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:47.108531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:47.109117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:47.109576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:47.111395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:47.112013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:47.112888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:47.118369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:16:47.132766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for user 6d3c6140894e446a9272e1a9247cbb1b and project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:16:47.168816 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:16:47.181639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:16:47.382694 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0977e83a-ffa1-43ad-b11f-ae3ebea10ad7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.740453 Oct 17 16:16:47.390801 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3450/6638] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:16:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:16:47.409161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:47.415196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:47.419080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:47.439628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:47.443550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:47.445957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:47.448685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:47.450889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:47.451713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:47.483338 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b4470760-4d16-4ed8-ac7a-6d488faadcce tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1265 microversion: 2.1 time: 0.383367 Oct 17 16:16:47.501226 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3189/6639] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:47 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1265 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:47.537863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c64589b8-3668-4f9b-b6fa-de01978175cd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:47.545972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c64589b8-3668-4f9b-b6fa-de01978175cd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:47.807742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c64589b8-3668-4f9b-b6fa-de01978175cd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:47.842144 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c64589b8-3668-4f9b-b6fa-de01978175cd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1266 microversion: 2.1 time: 0.337389 Oct 17 16:16:47.860378 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3190/6640] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:47 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:47.880709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:47.882788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:47.901784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:47.902864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:47.903572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:47.904959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:47.906063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:47.908230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:48.050569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:48.063003 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-119419b9-dfb4-4a5e-9946-634f4b3aae46 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1213 microversion: 2.1 time: 0.200705 Oct 17 16:16:48.064571 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3191/6641] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:47 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:48.197827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:48.208078 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fe40536e-5975-401e-ba47-88d653ffc687 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1429 microversion: 2.1 time: 0.815768 Oct 17 16:16:48.223514 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3451/6642] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:47 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1429 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:48.516315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:48.517301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:48.532025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:48.532025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:48.532436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:48.536083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:48.536981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:48.540597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:48.870474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:48.881934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:48.882607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:48.909090 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8403d904-b5a6-4695-865b-947c7bbe647a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1265 microversion: 2.1 time: 0.397956 Oct 17 16:16:48.909731 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3192/6643] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:48 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1265 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:48.915927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:48.919078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:48.921033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:48.924614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:48.931086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:48.946011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:49.107431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:49.108138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:49.127829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:49.136674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:49.137280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:49.138077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:49.140449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:49.140689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:49.145239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:49.160333 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d47f0da-6d09-4621-b9f8-3248d838db4c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1318 microversion: 2.1 time: 0.282549 Oct 17 16:16:49.174727 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3452/6644] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:48 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:49.234562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:49.236187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:49.266701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:49.269608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:49.270989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:49.275081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:49.275591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:49.278410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:49.332156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:49.349346 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f07b7591-b690-4912-85d0-6eed63afc7c6 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1213 microversion: 2.1 time: 0.246197 Oct 17 16:16:49.350911 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3193/6645] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:49 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:49.844110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:49.853143 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77b16a7e-abaf-4bcc-9b69-6a6de9f47ff9 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1429 microversion: 2.1 time: 0.623325 Oct 17 16:16:49.853899 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3453/6646] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:49 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1429 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:49.937301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:49.937953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:49.953630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:49.958379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:49.963028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:49.963881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:49.964471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:49.964921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:50.184789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:50.185430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:50.205540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:50.206054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:50.218732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:50.219999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:50.220660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:50.221111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:50.480633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:50.494912 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-985bc1d7-b149-4f6d-8545-b35cdf6d9a92 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1326 microversion: 2.1 time: 0.314245 Oct 17 16:16:50.498173 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3454/6647] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:50 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1326 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:50.509577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:50.510446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:50.532678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:50.533201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:50.533658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:50.534395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:50.534916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:50.535349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:50.905244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:50.917499 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ea1757f-ae1e-45b2-81ac-569e54119dca tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1281 microversion: 2.1 time: 0.417800 Oct 17 16:16:50.918656 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3455/6648] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:50 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1281 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:50.931952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:50.932435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:50.946582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:50.947174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:50.947623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:50.948532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:50.948973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:50.949406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:51.219815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:51.229918 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44aebc81-fe59-4dcb-b8cd-cc41abaa99d4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1429 microversion: 2.1 time: 0.301929 Oct 17 16:16:51.230564 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3456/6649] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:50 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1429 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:51.468096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:51.479915 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-44fab766-b315-41f3-8919-b822c6d7c74f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1265 microversion: 2.1 time: 1.546567 Oct 17 16:16:51.497585 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3194/6650] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:49 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1265 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:51.523899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:51.524817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:51.539645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:51.542814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:51.546619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:51.547854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:51.553208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:51.554632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:51.593274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f31bebd8-1b75-4853-bad7-53ff4a7346ab req-1610c47f-962c-4433-828b-7be9f7599074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fdce32-a449-4977-be0e-afe0facb6e69", "name": "network-vif-plugged", "status": "completed", "tag": "03ce5a76-214a-4ab4-ab96-7db589c270e8"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:51.618682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f31bebd8-1b75-4853-bad7-53ff4a7346ab req-1610c47f-962c-4433-828b-7be9f7599074 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:51.619503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f31bebd8-1b75-4853-bad7-53ff4a7346ab req-1610c47f-962c-4433-828b-7be9f7599074 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:51.621767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f31bebd8-1b75-4853-bad7-53ff4a7346ab req-1610c47f-962c-4433-828b-7be9f7599074 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:51.642080 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f31bebd8-1b75-4853-bad7-53ff4a7346ab req-1610c47f-962c-4433-828b-7be9f7599074 service nova] Creating event network-vif-plugged:03ce5a76-214a-4ab4-ab96-7db589c270e8 for instance 39fdce32-a449-4977-be0e-afe0facb6e69 on n-h1-854441-12 Oct 17 16:16:51.648597 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f31bebd8-1b75-4853-bad7-53ff4a7346ab req-1610c47f-962c-4433-828b-7be9f7599074 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197085 Oct 17 16:16:51.650300 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3457/6651] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:16:51.735155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:51.754342 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa7ff6aa-c61e-4250-bf6c-a3997b724562 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1324 microversion: 2.1 time: 0.231266 Oct 17 16:16:51.757499 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3195/6652] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:51 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1324 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:51.952780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:51.954679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:51.968069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:51.969490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:51.970643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:51.972309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:51.973501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:51.974607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:52.189531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:52.204625 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0c7cf72-4ed1-4ab0-a8b3-ea8b405d2000 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1281 microversion: 2.1 time: 0.264842 Oct 17 16:16:52.220493 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3458/6653] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:51 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:52.256725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:52.257446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:52.273787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:52.274491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:52.275043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:52.275904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:52.277009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:52.278487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:52.513605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:52.515259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:52.528824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:52.529639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:52.530663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:52.532407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:52.539027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:52.540832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:52.688316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:52.700802 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7115c7a9-dbe7-4696-82b8-c0fc27440e9b tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1429 microversion: 2.1 time: 0.449190 Oct 17 16:16:52.701449 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3196/6654] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:52 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1429 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:52.788428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:52.793231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:52.832193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:52.833267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:52.834183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:52.840952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:52.842664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:52.849727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:52.871207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:52.901887 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b2a9e45-1396-4b13-a1a4-5d91f05f0f8a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1265 microversion: 2.1 time: 0.398077 Oct 17 16:16:52.902902 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3459/6655] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:52 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1265 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:53.008073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:53.042220 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1463ccb5-64bd-4528-b835-56c2fe2cd3d1 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1324 microversion: 2.1 time: 0.263045 Oct 17 16:16:53.067546 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3197/6656] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:52 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:53.166707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6ddfebf2-992b-4bc8-8844-3edd0f53e9c2 req-a7b4d985-dbad-47ac-a1a0-892433664800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3262d93-da68-4312-b9ca-3136fc995343", "tag": "7c453020-0d99-4585-bb75-4fed7099eece"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:53.208415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6ddfebf2-992b-4bc8-8844-3edd0f53e9c2 req-a7b4d985-dbad-47ac-a1a0-892433664800 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:53.209751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6ddfebf2-992b-4bc8-8844-3edd0f53e9c2 req-a7b4d985-dbad-47ac-a1a0-892433664800 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:53.210873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6ddfebf2-992b-4bc8-8844-3edd0f53e9c2 req-a7b4d985-dbad-47ac-a1a0-892433664800 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:53.230377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:53.231195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:53.247543 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6ddfebf2-992b-4bc8-8844-3edd0f53e9c2 req-a7b4d985-dbad-47ac-a1a0-892433664800 service nova] Creating event network-changed:7c453020-0d99-4585-bb75-4fed7099eece for instance a3262d93-da68-4312-b9ca-3136fc995343 on n-h1-854441-12 Oct 17 16:16:53.248676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:53.249310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:53.249891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:53.250871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:53.251458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:53.252004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:53.256209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=100 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:53.264999 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6ddfebf2-992b-4bc8-8844-3edd0f53e9c2 req-a7b4d985-dbad-47ac-a1a0-892433664800 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103921 Oct 17 16:16:53.266196 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3460/6657] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:16:53.681388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-135bb1e9-ff5c-4b2f-a63f-4b8073f2c12b req-ee4ca9c9-4d3d-462f-abf6-78a25b08bea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c86145-9837-4081-bf7b-966893f86c4f", "name": "network-vif-plugged", "status": "completed", "tag": "b071a161-4dad-4b0e-b2c9-06ac1bd0dc2d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:53.698247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-135bb1e9-ff5c-4b2f-a63f-4b8073f2c12b req-ee4ca9c9-4d3d-462f-abf6-78a25b08bea6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:53.699649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-135bb1e9-ff5c-4b2f-a63f-4b8073f2c12b req-ee4ca9c9-4d3d-462f-abf6-78a25b08bea6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:53.700966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-135bb1e9-ff5c-4b2f-a63f-4b8073f2c12b req-ee4ca9c9-4d3d-462f-abf6-78a25b08bea6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:53.729867 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-135bb1e9-ff5c-4b2f-a63f-4b8073f2c12b req-ee4ca9c9-4d3d-462f-abf6-78a25b08bea6 service nova] Creating event network-vif-plugged:b071a161-4dad-4b0e-b2c9-06ac1bd0dc2d for instance 23c86145-9837-4081-bf7b-966893f86c4f on n-h2-854441-12 Oct 17 16:16:53.745428 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-135bb1e9-ff5c-4b2f-a63f-4b8073f2c12b req-ee4ca9c9-4d3d-462f-abf6-78a25b08bea6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070030 Oct 17 16:16:53.746443 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3461/6658] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:16:53.754323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:53.756001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:53.765147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:53.765980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:53.766883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:53.768382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:53.769117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:53.769903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:53.854031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:53.868453 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-77a6ec2e-a869-45d2-bdbd-f46d151e5a73 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1281 microversion: 2.1 time: 0.642034 Oct 17 16:16:53.869749 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3198/6659] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:53 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1281 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:53.941981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:53.943150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:53.953296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:53.954054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:53.954726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:53.955671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:53.956323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:53.956940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:54.084425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:54.093320 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0b8089b-59fc-40dd-bded-18cf5b0b00c2 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1610 microversion: 2.1 time: 0.345196 Oct 17 16:16:54.102674 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3462/6660] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:53 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1610 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:54.102674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:54.102674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:54.106434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:54.109405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:54.110224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:54.110995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:54.112073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:54.112808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:54.113485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:54.121803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:54.329137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:54.339068 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c875da10-5aeb-444b-bda7-77a70bcca575 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1391 microversion: 2.1 time: 0.243433 Oct 17 16:16:54.360588 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3463/6661] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:54 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:54.366553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:54.367616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:54.375145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:54.376025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:54.376750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:54.377776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:54.378534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:54.379242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:54.461626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:54.475771 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95849189-5749-479b-9aac-b6f9df2fb6f2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1265 microversion: 2.1 time: 0.537904 Oct 17 16:16:54.476417 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3199/6662] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:53 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1265 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:16:54.655335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:54.665517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebe43070-47da-4554-aa7d-8277d5e5da31 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1610 microversion: 2.1 time: 0.303242 Oct 17 16:16:54.666996 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3464/6663] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:54 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1610 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:54.691415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:54.692348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:54.702390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:54.709473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:54.710372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:54.711079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:54.712664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:54.715906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:54.716649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:54.899726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:54.900630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:54.908462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:54.908895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:54.909344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:54.910068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:54.910650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:54.911260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:55.114065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:55.126207 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-69044b50-d404-435d-916c-a955a1d29606 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1610 microversion: 2.1 time: 0.439127 Oct 17 16:16:55.127674 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3200/6664] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:54 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1610 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:55.250949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:55.261056 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1083d61c-87ce-4984-a68f-1c0c23cf00c2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1281 microversion: 2.1 time: 0.370087 Oct 17 16:16:55.262091 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3465/6665] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:54 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:55.366647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:55.367663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:55.375735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:55.376253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:55.376794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:55.377445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:55.377925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:55.378348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:55.509838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:55.515496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:55.543702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:55.545605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:55.546845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:55.548736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:55.549920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:55.551061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:56.152294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:56.155792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:56.164128 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-be2485b1-52d2-41fe-a5d8-9d2b55b31351 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1391 microversion: 2.1 time: 0.801449 Oct 17 16:16:56.164762 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3201/6666] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:55 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1391 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:56.177231 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4347e24-978e-448d-aedc-ad2529cff670 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1451 microversion: 2.1 time: 0.674481 Oct 17 16:16:56.192152 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3466/6667] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:55 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1451 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:56.192642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a09f6e90-de21-4e18-ba1d-b6f96ed6d81c req-5fb74fc6-d652-4729-a3ba-253c2b21a819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b12800-c737-42f4-b3b7-7b7d68e65c25", "tag": "bb5d174d-da06-4b93-a05f-403f942a98b3"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:56.198137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a09f6e90-de21-4e18-ba1d-b6f96ed6d81c req-5fb74fc6-d652-4729-a3ba-253c2b21a819 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:56.199299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a09f6e90-de21-4e18-ba1d-b6f96ed6d81c req-5fb74fc6-d652-4729-a3ba-253c2b21a819 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:56.199920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a09f6e90-de21-4e18-ba1d-b6f96ed6d81c req-5fb74fc6-d652-4729-a3ba-253c2b21a819 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:56.215578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:56.216677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:56.225832 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a09f6e90-de21-4e18-ba1d-b6f96ed6d81c req-5fb74fc6-d652-4729-a3ba-253c2b21a819 service nova] Creating event network-changed:bb5d174d-da06-4b93-a05f-403f942a98b3 for instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 on n-h2-854441-12 Oct 17 16:16:56.242420 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a09f6e90-de21-4e18-ba1d-b6f96ed6d81c req-5fb74fc6-d652-4729-a3ba-253c2b21a819 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069403 Oct 17 16:16:56.243515 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3202/6668] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:16:56.251490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:56.253368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:56.254254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:56.256628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:56.257306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:56.257950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:56.294619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:56.298836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:56.318467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:56.319144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:56.319616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:56.320375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:56.320852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:56.322979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:56.671404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:56.698695 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d70c5da3-3c3a-4ad3-95f3-706b88509339 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1451 microversion: 2.1 time: 0.492190 Oct 17 16:16:56.708144 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3467/6669] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:56 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1451 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:56.729281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:56.743444 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8059a1b5-dcb8-4b4c-b3f3-51eb8fd1db16 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1281 microversion: 2.1 time: 0.461637 Oct 17 16:16:56.744422 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3203/6670] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:56 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1281 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:57.190869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:57.191967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:57.211583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:57.213485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=24 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:57.218638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:57.219579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:57.220510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:57.221726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:57.226778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:57.227435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:57.549269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:57.591218 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e04f5db-4824-400f-9449-e19b6a20cfcf tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1391 microversion: 2.1 time: 0.394468 Oct 17 16:16:57.592740 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3468/6671] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:57 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1391 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:57.777299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:57.783027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:57.804124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:57.806579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:57.808429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:57.809979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:57.811061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:57.811768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:57.841069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=14 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:16:58.677024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:58.681309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:58.718459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:58.719158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:58.719622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:58.722791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:58.723447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:58.723906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:58.757461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:58.781954 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0da5d04e-7e03-4407-9431-31d539b04ba2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1281 microversion: 2.1 time: 1.014032 Oct 17 16:16:58.794081 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3204/6672] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:57 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1281 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:58.816252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-82828f80-8824-4cab-8fdf-8c289a86a75c req-40a0bbb8-a3e1-4683-b3b4-52da8bd06166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fdce32-a449-4977-be0e-afe0facb6e69", "tag": "03ce5a76-214a-4ab4-ab96-7db589c270e8"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:16:58.867378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82828f80-8824-4cab-8fdf-8c289a86a75c req-40a0bbb8-a3e1-4683-b3b4-52da8bd06166 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:58.871369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82828f80-8824-4cab-8fdf-8c289a86a75c req-40a0bbb8-a3e1-4683-b3b4-52da8bd06166 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:58.872121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-82828f80-8824-4cab-8fdf-8c289a86a75c req-40a0bbb8-a3e1-4683-b3b4-52da8bd06166 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:58.897273 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-82828f80-8824-4cab-8fdf-8c289a86a75c req-40a0bbb8-a3e1-4683-b3b4-52da8bd06166 service nova] Creating event network-changed:03ce5a76-214a-4ab4-ab96-7db589c270e8 for instance 39fdce32-a449-4977-be0e-afe0facb6e69 on n-h1-854441-12 Oct 17 16:16:58.921794 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-82828f80-8824-4cab-8fdf-8c289a86a75c req-40a0bbb8-a3e1-4683-b3b4-52da8bd06166 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116900 Oct 17 16:16:58.923755 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3205/6673] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:16:59.080420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:16:59.096112 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-076650dd-d089-4c1b-a112-4a3aea1b28bd tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1391 microversion: 2.1 time: 0.457404 Oct 17 16:16:59.098324 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3469/6674] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:58 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1391 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:16:59.825695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:16:59.839427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:16:59.851832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:59.852764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:59.853586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:16:59.867072 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:16:59.868502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:16:59.869129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:00.137377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:00.141411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:00.157799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:00.159953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:00.161854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:00.163717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:00.165465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:00.166940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:00.488905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:00.499110 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d28eb52c-fbeb-4a3b-abe2-6d5b2e5252b7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1391 microversion: 2.1 time: 0.379181 Oct 17 16:17:00.501181 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3470/6675] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:00 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1391 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:00.685174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:00.700266 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-256938ba-ba0b-456c-9e1d-5f1d1f2d9eaf tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1269 microversion: 2.1 time: 0.884531 Oct 17 16:17:00.715143 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3206/6676] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:16:59 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1269 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:01.540548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:01.541902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:01.545682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-3659750b-84fb-485d-a599-ab4c902dc344 req-37fdaab6-98cc-428f-ab5d-81f9a470202b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b12800-c737-42f4-b3b7-7b7d68e65c25", "name": "network-vif-plugged", "status": "completed", "tag": "bb5d174d-da06-4b93-a05f-403f942a98b3"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:01.552963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:01.554566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:01.555337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:01.556410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:01.556965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:01.557666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:01.608224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3659750b-84fb-485d-a599-ab4c902dc344 req-37fdaab6-98cc-428f-ab5d-81f9a470202b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:01.609482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3659750b-84fb-485d-a599-ab4c902dc344 req-37fdaab6-98cc-428f-ab5d-81f9a470202b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:01.610704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3659750b-84fb-485d-a599-ab4c902dc344 req-37fdaab6-98cc-428f-ab5d-81f9a470202b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:01.657529 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-3659750b-84fb-485d-a599-ab4c902dc344 req-37fdaab6-98cc-428f-ab5d-81f9a470202b service nova] Creating event network-vif-plugged:bb5d174d-da06-4b93-a05f-403f942a98b3 for instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 on n-h2-854441-12 Oct 17 16:17:01.665676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-3659750b-84fb-485d-a599-ab4c902dc344 req-37fdaab6-98cc-428f-ab5d-81f9a470202b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126116 Oct 17 16:17:01.669418 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3207/6677] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:01.756050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:01.757035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:01.766903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:01.767736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:01.768203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:01.769079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:01.769630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:01.770079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:01.817389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:01.827230 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ca4f013-cd62-48b5-b241-2bd8ca4e78e4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1391 microversion: 2.1 time: 0.291266 Oct 17 16:17:01.828380 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3471/6678] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:01 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1391 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:02.278479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:02.301830 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3153930-5469-423e-9930-d6601aeb2190 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1269 microversion: 2.1 time: 0.553368 Oct 17 16:17:02.307286 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3208/6679] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:01 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1269 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:02.353095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-59392d19-6a11-48da-9179-98fefd389e3b req-1356bfdf-49ce-4ce1-a79e-6da572e41292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c86145-9837-4081-bf7b-966893f86c4f", "tag": "b071a161-4dad-4b0e-b2c9-06ac1bd0dc2d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:02.372029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59392d19-6a11-48da-9179-98fefd389e3b req-1356bfdf-49ce-4ce1-a79e-6da572e41292 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:02.373029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59392d19-6a11-48da-9179-98fefd389e3b req-1356bfdf-49ce-4ce1-a79e-6da572e41292 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:02.373960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-59392d19-6a11-48da-9179-98fefd389e3b req-1356bfdf-49ce-4ce1-a79e-6da572e41292 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:02.399812 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-59392d19-6a11-48da-9179-98fefd389e3b req-1356bfdf-49ce-4ce1-a79e-6da572e41292 service nova] Creating event network-changed:b071a161-4dad-4b0e-b2c9-06ac1bd0dc2d for instance 23c86145-9837-4081-bf7b-966893f86c4f on n-h2-854441-12 Oct 17 16:17:02.409921 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-59392d19-6a11-48da-9179-98fefd389e3b req-1356bfdf-49ce-4ce1-a79e-6da572e41292 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064827 Oct 17 16:17:02.411530 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3472/6680] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:02.866559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:02.867335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:02.875388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:02.875906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:02.876358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:02.877117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:02.877594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:02.878042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:03.335237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:03.340904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:03.360074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:03.360584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:03.361344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:03.362400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:03.363047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:03.363879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:03.669727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:03.692190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:03.693069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74cba3fb-e5c6-4d6b-a02f-063472dfa9ed tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1269 microversion: 2.1 time: 0.369998 Oct 17 16:17:03.710676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-95e8e3f2-f708-4cca-a5d0-7fc6c18d7bd2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1391 microversion: 2.1 time: 0.847977 Oct 17 16:17:03.726541 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3473/6681] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:03 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1269 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:03.727767 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3209/6682] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:02 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1391 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:17:04.736378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:04.737441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:04.748913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:04.749471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:04.749954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:04.750841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:04.751465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:04.752301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:04.754392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:04.755950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:04.760961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:04.770959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:04.772079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:04.772911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:04.774100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:04.775016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:04.775716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:04.977699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:04.988204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:04.990321 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2822b83d-5888-45a6-aae1-8f8b0e852811 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1269 microversion: 2.1 time: 0.260622 Oct 17 16:17:04.994548 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3474/6683] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:04 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1269 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:04.997663 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b0131264-e9ca-4477-a4da-e6b18ac4515c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1562 microversion: 2.1 time: 0.251821 Oct 17 16:17:04.998359 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3210/6684] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:04 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:05.025460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:05.026010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:05.032856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:05.033373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:05.033801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:05.034557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:05.035029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:05.035454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:05.248427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:05.267407 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-99d48a77-c71f-45a0-b955-273b4b0ae4b3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1562 microversion: 2.1 time: 0.246572 Oct 17 16:17:05.268887 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3475/6685] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:05 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1562 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:06.016582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:06.017501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:06.027026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:06.028324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:06.029014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:06.030334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:06.031047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:06.031933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:06.410853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:06.427766 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e33d5c52-6377-4fd7-840e-6bd985e18ccb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1269 microversion: 2.1 time: 0.416504 Oct 17 16:17:06.441231 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3211/6686] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:06 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1269 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:07.474278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:07.476971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:07.500866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:07.502299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:07.503347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:07.505057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:07.506533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:07.507611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:07.892907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:07.925224 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d063c8c8-5099-4804-80f2-56ac7d89a764 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1269 microversion: 2.1 time: 0.458770 Oct 17 16:17:07.926413 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3476/6687] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:07 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1269 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:17:08.208643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-2ba37549-f8cf-4e36-a219-b2a31f01918e req-7e614af5-ffe0-4c20-86e1-e0b6987a08de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b12800-c737-42f4-b3b7-7b7d68e65c25", "tag": "bb5d174d-da06-4b93-a05f-403f942a98b3"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:08.211597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:08.212590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:08.226051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:08.227010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:08.227783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:08.229164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:08.230364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:08.231680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:08.232876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2ba37549-f8cf-4e36-a219-b2a31f01918e req-7e614af5-ffe0-4c20-86e1-e0b6987a08de service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:08.234067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2ba37549-f8cf-4e36-a219-b2a31f01918e req-7e614af5-ffe0-4c20-86e1-e0b6987a08de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:08.235381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-2ba37549-f8cf-4e36-a219-b2a31f01918e req-7e614af5-ffe0-4c20-86e1-e0b6987a08de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:08.261189 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-2ba37549-f8cf-4e36-a219-b2a31f01918e req-7e614af5-ffe0-4c20-86e1-e0b6987a08de service nova] Creating event network-changed:bb5d174d-da06-4b93-a05f-403f942a98b3 for instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 on n-h2-854441-12 Oct 17 16:17:08.270284 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-2ba37549-f8cf-4e36-a219-b2a31f01918e req-7e614af5-ffe0-4c20-86e1-e0b6987a08de service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069859 Oct 17 16:17:08.271925 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3477/6688] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:08.644508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:08.660772 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9ef9809e-1b47-42b7-ba42-0bd01ef5d5b0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1562 microversion: 2.1 time: 0.467752 Oct 17 16:17:08.662024 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3212/6689] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:08 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1562 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:08.965548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:08.967133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:08.975889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:08.976651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:08.977237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:08.978139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:08.978787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:08.979718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:09.221411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:09.241868 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e258cb55-73cb-44bf-84d2-c18c0f4b9560 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1269 microversion: 2.1 time: 0.280708 Oct 17 16:17:09.243045 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3478/6690] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:08 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1269 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:17:09.483538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cf571784-a8da-41f4-8337-d9eb8bbba485 req-5f5d48fd-0f57-49ab-8bd7-cc600353c2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3262d93-da68-4312-b9ca-3136fc995343", "name": "network-vif-plugged", "status": "completed", "tag": "7c453020-0d99-4585-bb75-4fed7099eece"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:09.513845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cf571784-a8da-41f4-8337-d9eb8bbba485 req-5f5d48fd-0f57-49ab-8bd7-cc600353c2d4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:09.514856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cf571784-a8da-41f4-8337-d9eb8bbba485 req-5f5d48fd-0f57-49ab-8bd7-cc600353c2d4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:09.516068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cf571784-a8da-41f4-8337-d9eb8bbba485 req-5f5d48fd-0f57-49ab-8bd7-cc600353c2d4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:09.547585 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cf571784-a8da-41f4-8337-d9eb8bbba485 req-5f5d48fd-0f57-49ab-8bd7-cc600353c2d4 service nova] Creating event network-vif-plugged:7c453020-0d99-4585-bb75-4fed7099eece for instance a3262d93-da68-4312-b9ca-3136fc995343 on n-h1-854441-12 Oct 17 16:17:09.559307 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cf571784-a8da-41f4-8337-d9eb8bbba485 req-5f5d48fd-0f57-49ab-8bd7-cc600353c2d4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083360 Oct 17 16:17:09.561120 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3213/6691] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:10.285435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:10.286406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:10.297312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:10.298120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:10.298802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:10.299858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:10.300574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:10.301216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:10.506324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:10.518414 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-768eb4e7-ab67-44c7-95e9-7aeeca78bc0e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1269 microversion: 2.1 time: 0.239445 Oct 17 16:17:10.519269 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3479/6692] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:10 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1269 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:11.556028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:11.557632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:11.568539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:11.569054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:11.569511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:11.570242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:11.570983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:11.571298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:11.754080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:11.763969 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-edd093d5-8f92-4f9a-9dc9-a180d78069ab tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1458 microversion: 2.1 time: 0.218328 Oct 17 16:17:11.764780 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3214/6693] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:11 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1458 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:11.791561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:11.792350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:11.799895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:11.800427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:11.800868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:11.801629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:11.802097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:11.802581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:12.018570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:12.027666 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dbc7dd38-df3d-4bf9-ac2f-b4639d34544e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1458 microversion: 2.1 time: 0.240240 Oct 17 16:17:12.028257 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3480/6694] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:11 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1458 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:15.099403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-27ef22c2-257e-49d0-97e4-849025943a5b req-3d2f9cd8-7fb2-4d89-8b88-7a5f327e31b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3262d93-da68-4312-b9ca-3136fc995343", "tag": "7c453020-0d99-4585-bb75-4fed7099eece"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:15.112372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-27ef22c2-257e-49d0-97e4-849025943a5b req-3d2f9cd8-7fb2-4d89-8b88-7a5f327e31b1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:15.112877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-27ef22c2-257e-49d0-97e4-849025943a5b req-3d2f9cd8-7fb2-4d89-8b88-7a5f327e31b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:15.113336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-27ef22c2-257e-49d0-97e4-849025943a5b req-3d2f9cd8-7fb2-4d89-8b88-7a5f327e31b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:15.132791 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-27ef22c2-257e-49d0-97e4-849025943a5b req-3d2f9cd8-7fb2-4d89-8b88-7a5f327e31b1 service nova] Creating event network-changed:7c453020-0d99-4585-bb75-4fed7099eece for instance a3262d93-da68-4312-b9ca-3136fc995343 on n-h1-854441-12 Oct 17 16:17:15.140673 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-27ef22c2-257e-49d0-97e4-849025943a5b req-3d2f9cd8-7fb2-4d89-8b88-7a5f327e31b1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044885 Oct 17 16:17:15.146158 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3215/6695] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:16.992072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c73cba72-a110-42fb-82d3-ff07fbb0165f req-2a181f80-b281-42ae-b901-ca442a132ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3262d93-da68-4312-b9ca-3136fc995343", "tag": "7c453020-0d99-4585-bb75-4fed7099eece"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:17.024404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c73cba72-a110-42fb-82d3-ff07fbb0165f req-2a181f80-b281-42ae-b901-ca442a132ab9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:17.027154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c73cba72-a110-42fb-82d3-ff07fbb0165f req-2a181f80-b281-42ae-b901-ca442a132ab9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:17.028338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c73cba72-a110-42fb-82d3-ff07fbb0165f req-2a181f80-b281-42ae-b901-ca442a132ab9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:17.036161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:17.054237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c73cba72-a110-42fb-82d3-ff07fbb0165f req-2a181f80-b281-42ae-b901-ca442a132ab9 service nova] Creating event network-changed:7c453020-0d99-4585-bb75-4fed7099eece for instance a3262d93-da68-4312-b9ca-3136fc995343 on n-h1-854441-12 Oct 17 16:17:17.065177 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c73cba72-a110-42fb-82d3-ff07fbb0165f req-2a181f80-b281-42ae-b901-ca442a132ab9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080746 Oct 17 16:17:17.070763 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3481/6696] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:17:19.093106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a2a00798-79b3-4605-812d-49e10492307d req-5907c1e7-36d1-4a0b-a536-a465660bf1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3262d93-da68-4312-b9ca-3136fc995343", "tag": "7c453020-0d99-4585-bb75-4fed7099eece"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:19.108971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a2a00798-79b3-4605-812d-49e10492307d req-5907c1e7-36d1-4a0b-a536-a465660bf1a9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:19.109694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a2a00798-79b3-4605-812d-49e10492307d req-5907c1e7-36d1-4a0b-a536-a465660bf1a9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:19.110183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a2a00798-79b3-4605-812d-49e10492307d req-5907c1e7-36d1-4a0b-a536-a465660bf1a9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:19.125054 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a2a00798-79b3-4605-812d-49e10492307d req-5907c1e7-36d1-4a0b-a536-a465660bf1a9 service nova] Creating event network-changed:7c453020-0d99-4585-bb75-4fed7099eece for instance a3262d93-da68-4312-b9ca-3136fc995343 on n-h1-854441-12 Oct 17 16:17:19.131556 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a2a00798-79b3-4605-812d-49e10492307d req-5907c1e7-36d1-4a0b-a536-a465660bf1a9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044137 Oct 17 16:17:19.132497 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3216/6697] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:29.143560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d44057aa-5905-4f29-ae2f-cbec8da4da13 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:29.147921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d44057aa-5905-4f29-ae2f-cbec8da4da13 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:29.154407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=37 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:29.155788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:29.166797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44057aa-5905-4f29-ae2f-cbec8da4da13 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:29.167707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44057aa-5905-4f29-ae2f-cbec8da4da13 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:29.168557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44057aa-5905-4f29-ae2f-cbec8da4da13 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:29.170074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44057aa-5905-4f29-ae2f-cbec8da4da13 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:29.171129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44057aa-5905-4f29-ae2f-cbec8da4da13 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:29.172224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d44057aa-5905-4f29-ae2f-cbec8da4da13 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:29.244684 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d44057aa-5905-4f29-ae2f-cbec8da4da13 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25/action" status: 200 len: 24562 microversion: 2.1 time: 0.107205 Oct 17 16:17:29.247161 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3482/6698] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:17:29 2022] POST /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25/action => generated 24562 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:17:29.781495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-35661e8f-55a3-427c-a423-2b349b8ca499 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:29.782611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-35661e8f-55a3-427c-a423-2b349b8ca499 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:29.794053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=13 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:29.795785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=89 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:29.799206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35661e8f-55a3-427c-a423-2b349b8ca499 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:29.800032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35661e8f-55a3-427c-a423-2b349b8ca499 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:29.800793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35661e8f-55a3-427c-a423-2b349b8ca499 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:29.802137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35661e8f-55a3-427c-a423-2b349b8ca499 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:29.803611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35661e8f-55a3-427c-a423-2b349b8ca499 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:29.804737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-35661e8f-55a3-427c-a423-2b349b8ca499 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:29.855489 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-35661e8f-55a3-427c-a423-2b349b8ca499 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.082509 Oct 17 16:17:29.856451 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3217/6699] 10.222.0.87 () {58 vars in 1293 bytes} [Mon Oct 17 16:17:29 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69/os-server-password => generated 116 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:39.989941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:39.992147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:40.012082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:40.013429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:40.018107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:40.019987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:40.021582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:40.023096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:40.023845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:40.024606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:40.275558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:40.309685 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58772427-6d01-44c4-afe5-4101eb789f51 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1680 microversion: 2.1 time: 0.327791 Oct 17 16:17:40.311014 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3483/6700] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:39 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1680 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:40.494146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-156979db-4409-4a9a-bf92-4a0657167473 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:40.499273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-156979db-4409-4a9a-bf92-4a0657167473 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:40.507129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:40.508594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:40.516471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-156979db-4409-4a9a-bf92-4a0657167473 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:40.517501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-156979db-4409-4a9a-bf92-4a0657167473 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:40.518432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-156979db-4409-4a9a-bf92-4a0657167473 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:40.520146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-156979db-4409-4a9a-bf92-4a0657167473 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:40.521079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-156979db-4409-4a9a-bf92-4a0657167473 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:40.521870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-156979db-4409-4a9a-bf92-4a0657167473 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:40.623233 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-156979db-4409-4a9a-bf92-4a0657167473 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25/action" status: 200 len: 32637 microversion: 2.1 time: 0.137186 Oct 17 16:17:40.625722 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3218/6701] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:17:40 2022] POST /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25/action => generated 32637 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 16:17:40.792235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9803b5b3-a93b-4a22-b61e-4931a6be6e84 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:40.793126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9803b5b3-a93b-4a22-b61e-4931a6be6e84 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:40.807414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9803b5b3-a93b-4a22-b61e-4931a6be6e84 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:40.809013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9803b5b3-a93b-4a22-b61e-4931a6be6e84 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:40.810832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9803b5b3-a93b-4a22-b61e-4931a6be6e84 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:40.811937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9803b5b3-a93b-4a22-b61e-4931a6be6e84 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:40.812745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9803b5b3-a93b-4a22-b61e-4931a6be6e84 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:40.813532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9803b5b3-a93b-4a22-b61e-4931a6be6e84 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:41.089106 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9803b5b3-a93b-4a22-b61e-4931a6be6e84 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1833 microversion: 2.1 time: 0.301944 Oct 17 16:17:41.090635 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3484/6702] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:40 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1833 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:41.147978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:41.152385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:41.162064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:41.162529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:41.163196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:41.164210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:41.164884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:41.165551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:41.198783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lazy-loading 'flavor' on Instance uuid 99b12800-c737-42f4-b3b7-7b7d68e65c25 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:17:41.212927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Going to try to live migrate instance to another host {{(pid=120407) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 16:17:43.297905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-595153211", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "2b153645-eb53-40fa-bbbe-f5c8bb908a6a"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:43.369337 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20b53d18-d8cb-41ac-83c8-552720ba3a15 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25/action" status: 202 len: 0 microversion: 2.1 time: 2.226112 Oct 17 16:17:43.374040 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3219/6703] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:17:41 2022] POST /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25/action => generated 0 bytes in 2228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:17:43.379821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:43.381448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:43.389132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] validate_networks() for [('2b153645-eb53-40fa-bbbe-f5c8bb908a6a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:17:43.391484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:43.392136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:43.392727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:43.393938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:43.394532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:43.395055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:43.780728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:43.790414 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3211d1f1-c21a-46f3-9d4a-7f3ff20d4e12 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1690 microversion: 2.1 time: 0.414758 Oct 17 16:17:43.791073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3220/6704] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:43 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1690 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:43.917587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:17:43.918236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:17:43.918822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:17:43.919304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:17:43.919795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:17:43.931372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:43.932163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:43.932672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:43.933807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:43.934530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:43.934989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:43.959079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Getting quotas for project 289c8c77042d45078166fdc8a5282e2b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:17:43.966539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Getting quotas for user 6b680b39204f44c68b4516e7b1bac76b and project 289c8c77042d45078166fdc8a5282e2b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:17:43.983546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:17:43.986017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:17:44.040298 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d660fa7c-42d1-43d2-9d86-7da1703955e2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746437 Oct 17 16:17:44.052089 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3485/6705] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:17:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 16:17:44.064260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-208c5fa2-beec-41c7-aad2-19565647a00b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:44.065651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-208c5fa2-beec-41c7-aad2-19565647a00b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:44.181727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-208c5fa2-beec-41c7-aad2-19565647a00b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:44.192631 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-208c5fa2-beec-41c7-aad2-19565647a00b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1218 microversion: 2.1 time: 0.136491 Oct 17 16:17:44.193356 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3221/6706] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:44 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:44.824122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:44.825392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:44.840442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:44.841625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:44.842650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:44.844519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:44.845883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:44.846937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:45.098449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-15cc40df-46ed-4ece-a0c5-3307dc3f44ce req-5df90f8e-513c-41be-a6ee-6ab6f7b72511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b12800-c737-42f4-b3b7-7b7d68e65c25", "name": "network-vif-unplugged", "status": "completed", "tag": "bb5d174d-da06-4b93-a05f-403f942a98b3"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:45.104668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:45.110583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-15cc40df-46ed-4ece-a0c5-3307dc3f44ce req-5df90f8e-513c-41be-a6ee-6ab6f7b72511 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:45.111086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-15cc40df-46ed-4ece-a0c5-3307dc3f44ce req-5df90f8e-513c-41be-a6ee-6ab6f7b72511 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:45.111825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-15cc40df-46ed-4ece-a0c5-3307dc3f44ce req-5df90f8e-513c-41be-a6ee-6ab6f7b72511 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:45.124163 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ae1b6edb-0945-4f0f-b38e-18d416fd9543 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1690 microversion: 2.1 time: 0.312690 Oct 17 16:17:45.125806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3486/6707] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:44 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1690 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:45.140216 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-15cc40df-46ed-4ece-a0c5-3307dc3f44ce req-5df90f8e-513c-41be-a6ee-6ab6f7b72511 service nova] Creating event network-vif-unplugged:bb5d174d-da06-4b93-a05f-403f942a98b3 for instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 on n-h2-854441-12 Oct 17 16:17:45.149946 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-15cc40df-46ed-4ece-a0c5-3307dc3f44ce req-5df90f8e-513c-41be-a6ee-6ab6f7b72511 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055261 Oct 17 16:17:45.151467 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3222/6708] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:17:45.227947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:45.228951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:45.239833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:45.240532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:45.241161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:45.242221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:45.243146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:45.243930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:45.343529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:45.355275 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25bdf3a4-d17b-4ce7-ada7-1e764be1d7b6 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1270 microversion: 2.1 time: 0.139903 Oct 17 16:17:45.356250 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3487/6709] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:45 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:17:46.160012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:46.161439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:46.170411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:46.171084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:46.171651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:46.172687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:46.173269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:46.173793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:46.377277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:46.384429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:46.385388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:46.393597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:46.394145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:46.394631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:46.395375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:46.395839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:46.396277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:46.399855 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81c5b589-5b4c-4b91-a5a0-cb75b5ca7340 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1690 microversion: 2.1 time: 0.249711 Oct 17 16:17:46.400787 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3223/6710] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:46 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1690 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:46.757617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:46.771671 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b67a632a-5461-40da-a712-82b55480189f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1318 microversion: 2.1 time: 0.391206 Oct 17 16:17:46.772882 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3488/6711] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:46 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:17:47.198029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d62940f8-fc58-4abb-a5d4-41100f5dafe2 req-a9374301-05e2-4cb1-b9c5-5f69071ac9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b12800-c737-42f4-b3b7-7b7d68e65c25", "tag": "bb5d174d-da06-4b93-a05f-403f942a98b3"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:47.210208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d62940f8-fc58-4abb-a5d4-41100f5dafe2 req-a9374301-05e2-4cb1-b9c5-5f69071ac9ec service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:47.210776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d62940f8-fc58-4abb-a5d4-41100f5dafe2 req-a9374301-05e2-4cb1-b9c5-5f69071ac9ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:47.211426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d62940f8-fc58-4abb-a5d4-41100f5dafe2 req-a9374301-05e2-4cb1-b9c5-5f69071ac9ec service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:47.226787 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d62940f8-fc58-4abb-a5d4-41100f5dafe2 req-a9374301-05e2-4cb1-b9c5-5f69071ac9ec service nova] Creating event network-changed:bb5d174d-da06-4b93-a05f-403f942a98b3 for instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 on n-h2-854441-12 Oct 17 16:17:47.232543 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d62940f8-fc58-4abb-a5d4-41100f5dafe2 req-a9374301-05e2-4cb1-b9c5-5f69071ac9ec service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038438 Oct 17 16:17:47.233472 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3224/6712] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:17:47.429626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:47.430840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:47.444103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:47.444999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:47.445792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:47.447520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:47.448415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:47.449611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:47.804837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:47.805633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:47.814332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:47.814904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:47.815364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:47.816246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:47.816720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:47.817357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:47.826634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:47.850877 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-62bdc95e-1334-491c-bba1-98348664744e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1690 microversion: 2.1 time: 0.429611 Oct 17 16:17:47.859075 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3489/6713] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:47 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1690 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:47.887470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cf2acf69-2f67-4a08-bdbb-30c713702995 req-9cf638db-9459-476c-a75a-6912bc9d30f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a10dff-d514-4962-b4c5-19f59ed21209", "tag": "720e210f-d802-43c0-afe3-0feed330e430"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:47.908678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf2acf69-2f67-4a08-bdbb-30c713702995 req-9cf638db-9459-476c-a75a-6912bc9d30f6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:47.910727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf2acf69-2f67-4a08-bdbb-30c713702995 req-9cf638db-9459-476c-a75a-6912bc9d30f6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:47.911363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cf2acf69-2f67-4a08-bdbb-30c713702995 req-9cf638db-9459-476c-a75a-6912bc9d30f6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:47.925334 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cf2acf69-2f67-4a08-bdbb-30c713702995 req-9cf638db-9459-476c-a75a-6912bc9d30f6 service nova] Creating event network-changed:720e210f-d802-43c0-afe3-0feed330e430 for instance 14a10dff-d514-4962-b4c5-19f59ed21209 on n-h1-854441-12 Oct 17 16:17:47.931932 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cf2acf69-2f67-4a08-bdbb-30c713702995 req-9cf638db-9459-476c-a75a-6912bc9d30f6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070646 Oct 17 16:17:47.932511 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3490/6714] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:48.543672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:48.552433 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3c906d4d-8bd7-456a-bd6e-050e786b31a2 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1318 microversion: 2.1 time: 0.752227 Oct 17 16:17:48.553046 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3225/6715] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:47 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:48.906380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:48.907153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:48.915659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:48.916162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:48.916680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:48.917421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:48.917846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:48.918321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:49.080192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:49.089828 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9da97d65-3d3b-4606-a1c4-e4d388a05d9f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1690 microversion: 2.1 time: 0.188966 Oct 17 16:17:49.090697 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3491/6716] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:48 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1690 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:49.576267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:49.576911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:49.584748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:49.585292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:49.585740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:49.586627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:49.586987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:49.587421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:49.747523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:49.756948 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-757f157c-1325-4bbd-b3e0-13d29b6d5b56 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1318 microversion: 2.1 time: 0.184713 Oct 17 16:17:49.757704 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3226/6717] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:49 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:50.114953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:50.115841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:50.124592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:50.124987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:50.125623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:50.126364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:50.126860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:50.127293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:50.365038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:50.386747 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfe3d51d-fb51-4979-9375-7d8ddd0b410a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1690 microversion: 2.1 time: 0.275096 Oct 17 16:17:50.387946 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3492/6718] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:50 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1690 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:17:50.786160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:50.787493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:50.800974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:50.801859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:50.802716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:50.804087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:50.804978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:50.805775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:51.097858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:51.107288 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-746f9bd6-b430-498f-85d3-e33694606230 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1318 microversion: 2.1 time: 0.328859 Oct 17 16:17:51.107917 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3227/6719] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:50 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:51.417349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:51.418945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:51.429181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:51.430022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:51.430785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:51.431901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:51.432957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:51.433551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:51.535754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:51.537045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:51.553823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:51.555260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:51.556347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:51.558335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:51.559610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:51.560626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:51.617531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:17:51.664651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:51.682252 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9cd1580e-cac8-4602-9578-0e1df53b73c2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1690 microversion: 2.1 time: 0.271291 Oct 17 16:17:51.706254 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3493/6720] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:51 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1690 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:51.727648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-dfd0734c-f907-42a8-8a4b-bf9304e44088 req-f2d17c03-9a9f-4f4e-b3af-3acfe188ec7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3262d93-da68-4312-b9ca-3136fc995343", "tag": "7c453020-0d99-4585-bb75-4fed7099eece"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:51.761107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dfd0734c-f907-42a8-8a4b-bf9304e44088 req-f2d17c03-9a9f-4f4e-b3af-3acfe188ec7b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:51.764289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dfd0734c-f907-42a8-8a4b-bf9304e44088 req-f2d17c03-9a9f-4f4e-b3af-3acfe188ec7b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:51.765747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-dfd0734c-f907-42a8-8a4b-bf9304e44088 req-f2d17c03-9a9f-4f4e-b3af-3acfe188ec7b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:51.812597 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-29040205-9fd6-4acb-a99f-07ff4bf1a6a2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "DELETE /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 204 len: 0 microversion: 2.1 time: 0.281469 Oct 17 16:17:51.813838 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3228/6721] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:17:51 2022] DELETE /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:17:51.828169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:51.829381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:51.829510 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-dfd0734c-f907-42a8-8a4b-bf9304e44088 req-f2d17c03-9a9f-4f4e-b3af-3acfe188ec7b service nova] Creating event network-changed:7c453020-0d99-4585-bb75-4fed7099eece for instance a3262d93-da68-4312-b9ca-3136fc995343 on n-h1-854441-12 Oct 17 16:17:51.838129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:51.839103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:51.839977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:51.841034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:51.841744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:51.842408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:51.854572 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-dfd0734c-f907-42a8-8a4b-bf9304e44088 req-f2d17c03-9a9f-4f4e-b3af-3acfe188ec7b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138752 Oct 17 16:17:51.862625 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3494/6722] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:52.157269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:52.159155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:52.178171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:52.179511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:52.181916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:52.183184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:52.184322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:52.185548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:52.237920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:52.257103 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-707a887b-e956-4ba7-961e-23e52007574a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1582 microversion: 2.1 time: 0.436321 Oct 17 16:17:52.258859 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3229/6723] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:51 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1582 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:17:52.419003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:52.440777 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4de87835-c537-497b-ab74-1b5e77facca1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1318 microversion: 2.1 time: 0.294880 Oct 17 16:17:52.455374 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3495/6724] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:52 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:17:52.726538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:52.727382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:52.736535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:52.737067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:52.739722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:52.739722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:52.740165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:52.740516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:53.008433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:53.018124 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b051ae45-5605-4587-a831-08c919413172 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1690 microversion: 2.1 time: 0.296538 Oct 17 16:17:53.019076 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3230/6725] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:52 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1690 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:53.290465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:53.291708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:53.302925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:53.305177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:53.307539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:53.310543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:53.312015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:53.313252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:53.489597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:53.490640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:53.497972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:53.498837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:53.499469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:53.500770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:53.501431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:53.502830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:53.912913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:53.926544 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e72ee278-f1cd-4da0-bba2-b3a95fa99b2a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1318 microversion: 2.1 time: 0.444829 Oct 17 16:17:53.927565 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3231/6726] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:53 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:53.948975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:53.960896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-3519a430-dc04-48d6-b0d6-8806c47a8b1c req-6fce9a10-0cb7-4550-9b2a-2d1a4c0454b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a10dff-d514-4962-b4c5-19f59ed21209", "name": "network-vif-plugged", "status": "completed", "tag": "720e210f-d802-43c0-afe3-0feed330e430"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:53.981560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3519a430-dc04-48d6-b0d6-8806c47a8b1c req-6fce9a10-0cb7-4550-9b2a-2d1a4c0454b6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:53.982813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3519a430-dc04-48d6-b0d6-8806c47a8b1c req-6fce9a10-0cb7-4550-9b2a-2d1a4c0454b6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:53.983614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3519a430-dc04-48d6-b0d6-8806c47a8b1c req-6fce9a10-0cb7-4550-9b2a-2d1a4c0454b6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:53.985495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:53.998653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:54.007596 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b9c44ce-39e6-4ac8-981b-d1f5d77fb0f2 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1582 microversion: 2.1 time: 0.721295 Oct 17 16:17:54.007964 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-3519a430-dc04-48d6-b0d6-8806c47a8b1c req-6fce9a10-0cb7-4550-9b2a-2d1a4c0454b6 service nova] Creating event network-vif-plugged:720e210f-d802-43c0-afe3-0feed330e430 for instance 14a10dff-d514-4962-b4c5-19f59ed21209 on n-h1-854441-12 Oct 17 16:17:54.010057 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3496/6727] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:53 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1582 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:54.041391 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-3519a430-dc04-48d6-b0d6-8806c47a8b1c req-6fce9a10-0cb7-4550-9b2a-2d1a4c0454b6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093974 Oct 17 16:17:54.044666 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3232/6728] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:54.061222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:54.063277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:54.078616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:54.079567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:54.080959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:54.082285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:54.083358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:54.084228 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:54.925800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:54.942236 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ede16b3-0c96-4f8f-8cd3-08e884620700 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1690 microversion: 2.1 time: 0.888455 Oct 17 16:17:54.943151 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3497/6729] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:54 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1690 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:54.961796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:54.973389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:54.974828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:54.983678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:54.984462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:54.985239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:54.986243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:54.987044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:54.987772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:55.051426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:55.052279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:55.059820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:55.060327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:55.060775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:55.061513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:55.061969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:55.062863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:55.197759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:55.210205 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-277169e1-a888-4459-a8cd-913bc9612afc tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1396 microversion: 2.1 time: 0.163258 Oct 17 16:17:55.211643 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3498/6730] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:55 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1396 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:55.231883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:55.244114 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad71042e-ab1c-4643-a97a-6578e6900209 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1318 microversion: 2.1 time: 0.285100 Oct 17 16:17:55.245338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3233/6731] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:54 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:55.271489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3ebca4cd-05e2-4b24-9ecf-b143ff6c9e9d req-dc676aa3-cc54-43e1-9c83-097c6b4cf4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3262d93-da68-4312-b9ca-3136fc995343", "name": "network-vif-deleted", "tag": "7c453020-0d99-4585-bb75-4fed7099eece"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:55.282927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ebca4cd-05e2-4b24-9ecf-b143ff6c9e9d req-dc676aa3-cc54-43e1-9c83-097c6b4cf4b2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:55.283418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ebca4cd-05e2-4b24-9ecf-b143ff6c9e9d req-dc676aa3-cc54-43e1-9c83-097c6b4cf4b2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:55.283858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3ebca4cd-05e2-4b24-9ecf-b143ff6c9e9d req-dc676aa3-cc54-43e1-9c83-097c6b4cf4b2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:55.297978 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3ebca4cd-05e2-4b24-9ecf-b143ff6c9e9d req-dc676aa3-cc54-43e1-9c83-097c6b4cf4b2 service nova] Creating event network-vif-deleted:7c453020-0d99-4585-bb75-4fed7099eece for instance a3262d93-da68-4312-b9ca-3136fc995343 on n-h1-854441-12 Oct 17 16:17:55.303656 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3ebca4cd-05e2-4b24-9ecf-b143ff6c9e9d req-dc676aa3-cc54-43e1-9c83-097c6b4cf4b2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036544 Oct 17 16:17:55.304301 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3499/6732] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:17:55.986037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:55.988947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:56.002447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.004130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.004887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.006674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.008145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.009284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.050634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:56.252696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:56.254172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:56.260769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:56.267384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.268871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.269911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.271292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.272310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.273210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.276101 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-724d3625-46c1-4f64-ad89-58d229c12e76 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1680 microversion: 2.1 time: 0.300292 Oct 17 16:17:56.277594 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3234/6733] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:55 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1680 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:56.287622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:56.289055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:56.305796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.307023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.308107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.309619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.310910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.311891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.406316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:56.421846 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a0c4648-2bcd-417d-95f3-e52d33d8c87a tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1228 microversion: 2.1 time: 0.179008 Oct 17 16:17:56.434533 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3500/6734] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:56 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1228 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:56.434533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5a5db17c-daa0-43c9-801a-5c337a1a8575 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:56.434533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5a5db17c-daa0-43c9-801a-5c337a1a8575 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:56.451702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a5db17c-daa0-43c9-801a-5c337a1a8575 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.452592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a5db17c-daa0-43c9-801a-5c337a1a8575 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.453372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a5db17c-daa0-43c9-801a-5c337a1a8575 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.454672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a5db17c-daa0-43c9-801a-5c337a1a8575 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.455470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a5db17c-daa0-43c9-801a-5c337a1a8575 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.456214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5a5db17c-daa0-43c9-801a-5c337a1a8575 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.522675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:56.532478 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3af0a594-e07f-4bb3-8e92-b62c1e8c4879 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1508 microversion: 2.1 time: 0.251972 Oct 17 16:17:56.533266 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3235/6735] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:56 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:56.679609 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5a5db17c-daa0-43c9-801a-5c337a1a8575 tempest-TestNetworkAdvancedServerOps-1269108617 tempest-TestNetworkAdvancedServerOps-1269108617-project-admin] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1833 microversion: 2.1 time: 0.254454 Oct 17 16:17:56.680582 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3501/6736] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:56 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1833 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:56.704663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:56.705623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:56.713433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.713952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.714413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.715356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:56.716029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:56.716472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:56.922847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:56.940067 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f0eab3f-0fb3-4c3f-af22-ad3a4e51209e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1680 microversion: 2.1 time: 0.238828 Oct 17 16:17:56.940997 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3236/6737] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:56 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:57.062296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3cf1765-9042-4c9e-b543-87ebb96380ee tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:57.064587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3cf1765-9042-4c9e-b543-87ebb96380ee tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:57.071876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3cf1765-9042-4c9e-b543-87ebb96380ee tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:57.072461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3cf1765-9042-4c9e-b543-87ebb96380ee tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:57.072991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3cf1765-9042-4c9e-b543-87ebb96380ee tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:57.073668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3cf1765-9042-4c9e-b543-87ebb96380ee tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:57.074129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3cf1765-9042-4c9e-b543-87ebb96380ee tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:57.074616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3cf1765-9042-4c9e-b543-87ebb96380ee tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:57.079427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:17:57.135227 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3cf1765-9042-4c9e-b543-87ebb96380ee tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25/action" status: 200 len: 38659 microversion: 2.1 time: 0.076802 Oct 17 16:17:57.135917 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3502/6738] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:17:57 2022] POST /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25/action => generated 38659 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 16:17:57.453814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:57.454493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:57.466876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:57.467390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:57.467873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:57.468605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:57.469073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:57.469510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:57.609347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:57.626991 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-10d86c56-4d53-48ff-9f55-7466ecb5ce06 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1228 microversion: 2.1 time: 0.176823 Oct 17 16:17:57.629047 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3237/6739] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:57 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1228 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:17:58.559779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:58.560697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:58.574211 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b400c869-a367-44e4-a8a3-1932c02039bb req-125e372c-0cd0-467a-8bd0-c0de126fb283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b12800-c737-42f4-b3b7-7b7d68e65c25", "tag": "bb5d174d-da06-4b93-a05f-403f942a98b3"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:17:58.584862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:58.585383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:58.585840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:58.586640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:58.587119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:58.587561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:58.600921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b400c869-a367-44e4-a8a3-1932c02039bb req-125e372c-0cd0-467a-8bd0-c0de126fb283 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:58.601810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b400c869-a367-44e4-a8a3-1932c02039bb req-125e372c-0cd0-467a-8bd0-c0de126fb283 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:58.602444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b400c869-a367-44e4-a8a3-1932c02039bb req-125e372c-0cd0-467a-8bd0-c0de126fb283 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:58.615602 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b400c869-a367-44e4-a8a3-1932c02039bb req-125e372c-0cd0-467a-8bd0-c0de126fb283 service nova] Creating event network-changed:bb5d174d-da06-4b93-a05f-403f942a98b3 for instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 on n-h1-854441-12 Oct 17 16:17:58.623711 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b400c869-a367-44e4-a8a3-1932c02039bb req-125e372c-0cd0-467a-8bd0-c0de126fb283 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053402 Oct 17 16:17:58.624356 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3238/6740] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:17:58.647850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:17:58.654307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:58.655131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:58.667107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:58.667637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:58.668110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:58.668866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:58.679336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:58.680110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:58.853767 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76d8c66e-63bb-4528-b2e1-6b7d2af2086d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "DELETE /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 204 len: 0 microversion: 2.1 time: 0.298073 Oct 17 16:17:58.858879 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3503/6741] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:17:58 2022] DELETE /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:17:58.865539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:58.867858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:58.878349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:58.883194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:58.884761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:58.890148 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a0ae82c0-c043-43a3-80f9-fc3f62d83a2e tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1228 microversion: 2.1 time: 0.240329 Oct 17 16:17:58.890860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:58.891896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:58.892610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:58.893317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:58.895649 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3239/6742] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:58 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1228 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:59.349103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:17:59.365806 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6065b1d-edda-47a5-9cd2-71e045b01692 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1686 microversion: 2.1 time: 0.503736 Oct 17 16:17:59.368252 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3504/6743] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:58 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1686 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:17:59.932486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:17:59.933965 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:17:59.948840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:59.957229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:59.960387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:17:59.964864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:17:59.965384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:17:59.967025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:00.149442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:00.167238 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb7ffc97-a42c-4c0b-b062-9b8eb40fa2c5 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1228 microversion: 2.1 time: 0.240935 Oct 17 16:18:00.168262 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3240/6744] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:17:59 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1228 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:00.414659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:00.418924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:00.475120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:00.478569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:00.482462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:00.484995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:00.486368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:00.488304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:00.529622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-efbcdac4-dae3-4d63-96fb-688cc78d15f0 req-e5eaeb98-c0d3-4975-b77b-eeb69b5de074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b12800-c737-42f4-b3b7-7b7d68e65c25", "name": "network-vif-deleted", "tag": "bb5d174d-da06-4b93-a05f-403f942a98b3"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:18:00.545006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-efbcdac4-dae3-4d63-96fb-688cc78d15f0 req-e5eaeb98-c0d3-4975-b77b-eeb69b5de074 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:00.546088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-efbcdac4-dae3-4d63-96fb-688cc78d15f0 req-e5eaeb98-c0d3-4975-b77b-eeb69b5de074 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:00.546876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-efbcdac4-dae3-4d63-96fb-688cc78d15f0 req-e5eaeb98-c0d3-4975-b77b-eeb69b5de074 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:00.598729 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-efbcdac4-dae3-4d63-96fb-688cc78d15f0 req-e5eaeb98-c0d3-4975-b77b-eeb69b5de074 service nova] Creating event network-vif-deleted:bb5d174d-da06-4b93-a05f-403f942a98b3 for instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 on n-h1-854441-12 Oct 17 16:18:00.618852 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-efbcdac4-dae3-4d63-96fb-688cc78d15f0 req-e5eaeb98-c0d3-4975-b77b-eeb69b5de074 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093093 Oct 17 16:18:00.622362 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3241/6745] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:18:00.693866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:00.714281 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09237c83-c812-4fe6-9899-a4a2e6a0d13e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 200 len: 1501 microversion: 2.1 time: 0.309983 Oct 17 16:18:00.724314 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3505/6746] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:00 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 1501 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:01.190904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:01.191717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:01.200284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:01.200790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:01.201563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:01.202333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:01.203010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:01.203467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:01.376732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:01.397050 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd370e47-09f3-4f95-aeb7-e42075b14ce7 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1228 microversion: 2.1 time: 0.210502 Oct 17 16:18:01.398864 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3242/6747] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:01 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1228 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:18:01.750399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:01.752059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 99b12800-c737-42f4-b3b7-7b7d68e65c25] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:01.762018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:01.762935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:01.763555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:01.764388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:01.764881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:01.765322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:01.785617 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] HTTP exception thrown: Instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 could not be found. Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Request method failure captured: Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 HTTP/1.1 Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX6JzVteHpYsi1D8rtpfL_oxwZ0lNzSfAyclZrJa7nZMw7HEkOi0WpbQmGdmXXk4CJJ1m6_Lh-rtNT3Hb5Dl3ZmA5fU2LekXOChdpwgzlw04g6yjpCYmDMcnf0VTmocaMWCNEr8bZCQcvb7VhsaicWh4CY_ie470QWOh_IWzucQey3c Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 176e8f23ffdb4cf2941eca94a577375b Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 176e8f23ffdb4cf2941eca94a577375b Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestNetworkAdvancedServerOps-734931086-project Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6d3c6140894e446a9272e1a9247cbb1b Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-734931086-project Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 could not be found. Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '99b12800-c737-42f4-b3b7-7b7d68e65c25'} Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 could not be found. Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 could not be found. Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:01.788432 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:18:01.792675 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:01.792675 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:18:01.792675 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:18:01.792675 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:18:01.792675 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:18:01.792675 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:18:01.792675 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 could not be found. Oct 17 16:18:01.792675 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:01.794630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Returning 404 to user: Instance 99b12800-c737-42f4-b3b7-7b7d68e65c25 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:18:01.795837 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fa1a72e0-3a6f-4c3f-a6aa-a14ad7cfb22d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25" status: 404 len: 111 microversion: 2.1 time: 0.050218 Oct 17 16:18:01.797337 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3506/6748] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:01 2022] GET /compute/v2.1/servers/99b12800-c737-42f4-b3b7-7b7d68e65c25 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:18:02.422905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:02.423454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:02.431944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:02.432502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:02.432968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:02.433732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:02.434182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:02.434976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:02.472278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:02.472789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:02.473549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:02.474039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lazy-loading 'fault' on Instance uuid a3262d93-da68-4312-b9ca-3136fc995343 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:18:02.549561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c08dd9658f545019efd94dab0bc8efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913261047d294e9b81c74230becdbce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:02.560331 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e444eab0-d838-4566-9294-b202bf0ce578 tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 200 len: 1233 microversion: 2.1 time: 0.141869 Oct 17 16:18:02.562075 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3243/6749] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:02 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 1233 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:03.596078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:03.598302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] [instance: a3262d93-da68-4312-b9ca-3136fc995343] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:03.615226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:03.619154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:03.620592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:03.622349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:03.623748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:03.624806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:03.656225 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] HTTP exception thrown: Instance a3262d93-da68-4312-b9ca-3136fc995343 could not be found. Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Request method failure captured: Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 HTTP/1.1 Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX7kmDzJ1q1rt2N0dPXss_3kt23H9q1ORq4Cs8Oxf6pF3uClwt7LHB4H73Fw5ozleSc_a5CQH-uPNzrkH0bf80vBrI0epnzRSRzOx44e39uJhweR_stx7i8kGPi5Cax8iLpVYdooTqT0jUYZ3vDUzrub72EO4IoOP3hPKLflALnYF5I Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 913261047d294e9b81c74230becdbce7 Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBackupRestore-1275464060 Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/913261047d294e9b81c74230becdbce7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/913261047d294e9b81c74230becdbce7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_913261047d294e9b81c74230becdbce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/913261047d294e9b81c74230becdbce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBackupRestore-1275464060 Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 913261047d294e9b81c74230becdbce7 Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1275464060 Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBackupRestore-1275464060-project Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 3c08dd9658f545019efd94dab0bc8efb Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBackupRestore-1275464060-project Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance a3262d93-da68-4312-b9ca-3136fc995343 could not be found. Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'a3262d93-da68-4312-b9ca-3136fc995343'} Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3262d93-da68-4312-b9ca-3136fc995343 could not be found. Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3262d93-da68-4312-b9ca-3136fc995343 could not be found. Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:18:03.660733 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:03.667210 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:18:03.667210 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:18:03.667210 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:18:03.667210 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:18:03.667210 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:18:03.667210 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3262d93-da68-4312-b9ca-3136fc995343 could not be found. Oct 17 16:18:03.667210 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:18:03.670964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Returning 404 to user: Instance a3262d93-da68-4312-b9ca-3136fc995343 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:18:03.673057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64d296f5-bae8-4a92-a551-220098dd60cb tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343" status: 404 len: 111 microversion: 2.1 time: 0.084332 Oct 17 16:18:03.674346 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3507/6750] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:03 2022] GET /compute/v2.1/servers/a3262d93-da68-4312-b9ca-3136fc995343 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:18:04.012042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-51ee1d44-ea97-4c2e-818c-d09fa7c542de tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] Calling method '.version_select at 0x7f28bc13e550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:04.085995 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-51ee1d44-ea97-4c2e-818c-d09fa7c542de tempest-TestVolumeBackupRestore-1275464060 tempest-TestVolumeBackupRestore-1275464060-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-173076975" status: 202 len: 0 microversion: 2.1 time: 0.084574 Oct 17 16:18:04.090557 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3244/6751] 10.222.0.87 () {58 vars in 1266 bytes} [Mon Oct 17 16:18:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-173076975 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:18:09.077846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f4fc4218-c333-4218-bd31-072a26006735 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '.version_select at 0x7f28bd6275e0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:09.118369 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f4fc4218-c333-4218-bd31-072a26006735 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2066439931" status: 202 len: 0 microversion: 2.1 time: 0.042265 Oct 17 16:18:09.120426 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3508/6752] 10.222.0.87 () {58 vars in 1284 bytes} [Mon Oct 17 16:18:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2066439931 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 16:18:09.157633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b66dc92f-3ffb-4e30-a1f3-f1fc1b9cb73e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'create', calling method: .version_select at 0x7f28bc0c4dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-286507552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKOCThaeVNV/gntmSaDlY7p+2Fy3YItnm0lsRzkhH4h9BDkPKRKpH+pWSL29PddnNNbY3skzV/9QGy/SqjiBfT6tmPYtjjAY6jt6s4LXlO+PyFpzFGRPdbkzBbxft2PEQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:18:09.189912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b66dc92f-3ffb-4e30-a1f3-f1fc1b9cb73e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:18:09.196724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b66dc92f-3ffb-4e30-a1f3-f1fc1b9cb73e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for user 6d3c6140894e446a9272e1a9247cbb1b and project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:18:09.227427 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b66dc92f-3ffb-4e30-a1f3-f1fc1b9cb73e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.075413 Oct 17 16:18:09.229277 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3245/6753] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:18:09 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:18:20.457847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:20.459589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:20.485255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-701528898", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "1ef28bcb-15d5-43a2-9e17-73de57a058c4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-286507552", "security_groups": [{"name": "tempest-secgroup-smoke-287087000"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:18:20.789156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] validate_networks() for [('1ef28bcb-15d5-43a2-9e17-73de57a058c4', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:18:21.700126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:18:21.700783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:18:21.701177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:18:21.701810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:18:21.702369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:18:21.723803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:21.724322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:21.724765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:21.725664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:21.728582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:21.729113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:21.784777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:18:21.802925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Getting quotas for user 6d3c6140894e446a9272e1a9247cbb1b and project 176e8f23ffdb4cf2941eca94a577375b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:18:21.839686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:18:21.852719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:18:21.974518 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51f69821-3209-4dfb-81a0-62a18e32425d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.521277 Oct 17 16:18:21.976106 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3509/6754] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:18:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:18:21.985973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=50 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:21.988522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:21.989867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:21.998271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9cccbd5-2fbb-4d3b-a58b-215513b8ac01 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:22.004048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a9cccbd5-2fbb-4d3b-a58b-215513b8ac01 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:22.108667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9cccbd5-2fbb-4d3b-a58b-215513b8ac01 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:22.123541 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9cccbd5-2fbb-4d3b-a58b-215513b8ac01 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1265 microversion: 2.1 time: 0.139274 Oct 17 16:18:22.142538 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3246/6755] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:21 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:23.171054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:23.172133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:23.187776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:23.191203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:23.192208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:23.195692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:23.199302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:23.200732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:23.393089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:23.406427 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2bcba4a9-f580-4ebe-b2be-eac8e996877d tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1269 microversion: 2.1 time: 0.259072 Oct 17 16:18:23.409359 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3510/6756] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:23 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1269 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:24.451007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:24.452481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:24.464450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:24.473563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:24.475360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:24.478512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:24.481860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:24.484907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:25.314466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:25.327608 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b00c17ed-d682-4491-980e-9b1a0103d20b tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1335 microversion: 2.1 time: 0.898427 Oct 17 16:18:25.328118 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3247/6757] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:24 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1335 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:26.358735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:26.360038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:26.383021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:26.389063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:26.391363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:26.395758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:26.398275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:26.400951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:26.798346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:26.811514 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e2423f5-478b-4ef0-9a7a-8ab89222f5e2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1390 microversion: 2.1 time: 0.457442 Oct 17 16:18:26.820292 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3511/6758] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:26 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1390 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:27.701393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-067d7dd8-dfdd-458e-b440-69105033bfa9 req-850fc403-f26f-488e-9463-57c18ad29dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2", "tag": "ec9592b2-07c4-48e9-b523-6795181a6d22"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:18:27.722432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-067d7dd8-dfdd-458e-b440-69105033bfa9 req-850fc403-f26f-488e-9463-57c18ad29dba service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:27.722990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-067d7dd8-dfdd-458e-b440-69105033bfa9 req-850fc403-f26f-488e-9463-57c18ad29dba service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:27.723634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-067d7dd8-dfdd-458e-b440-69105033bfa9 req-850fc403-f26f-488e-9463-57c18ad29dba service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:27.739154 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-067d7dd8-dfdd-458e-b440-69105033bfa9 req-850fc403-f26f-488e-9463-57c18ad29dba service nova] Creating event network-changed:ec9592b2-07c4-48e9-b523-6795181a6d22 for instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 on n-h2-854441-12 Oct 17 16:18:27.747267 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-067d7dd8-dfdd-458e-b440-69105033bfa9 req-850fc403-f26f-488e-9463-57c18ad29dba service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049273 Oct 17 16:18:27.748216 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3248/6759] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:18:27.844168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:27.846331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:27.861198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:27.862339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:27.863522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:27.865174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:27.866767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:27.867771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:28.082678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:28.098022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f24a822b-8635-4387-863a-2df9965d9ea2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1390 microversion: 2.1 time: 0.260984 Oct 17 16:18:28.099510 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3512/6760] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:27 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1390 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:28.942987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0d19b542-6e04-44ce-98e5-a41fe1c30c9c tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9136713b-efc8-413b-949a-b50bcb584bea", "device": "/dev/sdb"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:18:28.945764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0d19b542-6e04-44ce-98e5-a41fe1c30c9c tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:28.955452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d19b542-6e04-44ce-98e5-a41fe1c30c9c tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:28.956189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d19b542-6e04-44ce-98e5-a41fe1c30c9c tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:28.956799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d19b542-6e04-44ce-98e5-a41fe1c30c9c tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:28.957961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d19b542-6e04-44ce-98e5-a41fe1c30c9c tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:28.958567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d19b542-6e04-44ce-98e5-a41fe1c30c9c tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:28.959143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d19b542-6e04-44ce-98e5-a41fe1c30c9c tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:29.127944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:29.129002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:29.142445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:29.143324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:29.144177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:29.145301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:29.146134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:29.146931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:29.288209 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0d19b542-6e04-44ce-98e5-a41fe1c30c9c tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "POST /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349448 Oct 17 16:18:29.289433 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3249/6761] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 16:18:28 2022] POST /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:18:29.381903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:29.399774 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-27d11381-41e1-4cdc-8473-7ef0e1f0f5da tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1390 microversion: 2.1 time: 0.278604 Oct 17 16:18:29.414765 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3513/6762] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:29 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1390 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:30.437763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:30.438607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:30.446190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:30.447209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:30.448417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:30.449215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:30.449684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:30.450135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:30.641794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:30.658831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20b979f6-cd8a-4ad6-b1bf-af65a9698c6e tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1390 microversion: 2.1 time: 0.226101 Oct 17 16:18:30.659998 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3250/6763] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:30 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1390 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:31.699589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:31.700431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:31.708322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:31.708829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:31.709272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:31.709996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:31.710452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:31.710910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:31.754964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:31.832925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:31.912266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:31.927626 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d7b5750c-8b0f-4a42-ae6f-fd5d9741baf7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1390 microversion: 2.1 time: 0.233036 Oct 17 16:18:31.928773 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3514/6764] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:31 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1390 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:32.971836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:32.974887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:32.980270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:32.990704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:32.991670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:32.992505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:32.993681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:32.994404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:32.994835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:33.210672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:33.220797 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-21055d6f-6adb-49ca-b899-8f8f0c335fe7 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1390 microversion: 2.1 time: 0.256626 Oct 17 16:18:33.221814 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3251/6765] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:32 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1390 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:34.067817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3c23dbd5-4d6b-4d84-af3c-850dd6ff3fb2 req-dc9146f9-dda1-44b8-8e6a-f7a3ee16306e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2", "name": "network-vif-plugged", "status": "completed", "tag": "ec9592b2-07c4-48e9-b523-6795181a6d22"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:18:34.096208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3c23dbd5-4d6b-4d84-af3c-850dd6ff3fb2 req-dc9146f9-dda1-44b8-8e6a-f7a3ee16306e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:34.097277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3c23dbd5-4d6b-4d84-af3c-850dd6ff3fb2 req-dc9146f9-dda1-44b8-8e6a-f7a3ee16306e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:34.098109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3c23dbd5-4d6b-4d84-af3c-850dd6ff3fb2 req-dc9146f9-dda1-44b8-8e6a-f7a3ee16306e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:34.124980 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3c23dbd5-4d6b-4d84-af3c-850dd6ff3fb2 req-dc9146f9-dda1-44b8-8e6a-f7a3ee16306e service nova] Creating event network-vif-plugged:ec9592b2-07c4-48e9-b523-6795181a6d22 for instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 on n-h2-854441-12 Oct 17 16:18:34.132221 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3c23dbd5-4d6b-4d84-af3c-850dd6ff3fb2 req-dc9146f9-dda1-44b8-8e6a-f7a3ee16306e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076802 Oct 17 16:18:34.133251 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3515/6766] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:18:34.261670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:34.262577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:34.270674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:34.271339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:34.272069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:34.272907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:34.273653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:34.274171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:34.474307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:34.489306 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-01458b37-a747-43e1-8518-ad61b4b7feef tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1390 microversion: 2.1 time: 0.233519 Oct 17 16:18:34.490411 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3252/6767] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:34 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:35.523557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:35.524892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:35.538174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:35.539074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:35.539862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:35.541241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:35.542083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:35.542845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:35.739205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:35.748101 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b89fab3-c508-4d94-b6cf-a01f78b5ecb4 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1390 microversion: 2.1 time: 0.233207 Oct 17 16:18:35.748763 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3516/6768] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:35 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1390 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:36.773666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:36.774302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:36.784254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:36.785074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:36.785792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:36.786974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:36.787706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:36.788418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:36.959879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:36.968795 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0fd87e65-a89d-4ca6-bf2c-76de7a02ba7a tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1562 microversion: 2.1 time: 0.199140 Oct 17 16:18:36.969405 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3253/6769] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:36 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1562 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:36.994967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:36.995583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:37.004315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:37.005014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:37.005895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:37.007219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:37.007837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:37.008391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:37.206598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:37.217382 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7a425b02-a70d-49a7-b802-410617e58709 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1562 microversion: 2.1 time: 0.226552 Oct 17 16:18:37.218278 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3517/6770] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:36 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:39.129430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:39.130170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:39.133464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-60696692-6203-4d26-a3b9-c5c8d66e8ff3 req-2e14498d-256d-4aae-85c1-3c46dabc315a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2", "tag": "ec9592b2-07c4-48e9-b523-6795181a6d22"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:18:39.138446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:39.139289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:39.139760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:39.140687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:39.141152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:39.141610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:39.144962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60696692-6203-4d26-a3b9-c5c8d66e8ff3 req-2e14498d-256d-4aae-85c1-3c46dabc315a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:39.145446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60696692-6203-4d26-a3b9-c5c8d66e8ff3 req-2e14498d-256d-4aae-85c1-3c46dabc315a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:39.145854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60696692-6203-4d26-a3b9-c5c8d66e8ff3 req-2e14498d-256d-4aae-85c1-3c46dabc315a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:39.158754 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-60696692-6203-4d26-a3b9-c5c8d66e8ff3 req-2e14498d-256d-4aae-85c1-3c46dabc315a service nova] Creating event network-changed:ec9592b2-07c4-48e9-b523-6795181a6d22 for instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 on n-h2-854441-12 Oct 17 16:18:39.164715 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-60696692-6203-4d26-a3b9-c5c8d66e8ff3 req-2e14498d-256d-4aae-85c1-3c46dabc315a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035829 Oct 17 16:18:39.166244 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3518/6771] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:18:39.396697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:39.409279 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-612410fe-02c1-41f2-b984-3fd5a239de95 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1562 microversion: 2.1 time: 0.285397 Oct 17 16:18:39.410068 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3254/6772] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:39 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1562 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:18:54.754030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:54.754823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:54.758526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:54.759331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=48 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:54.768523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:54.769185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:54.769733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:54.770615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:54.771176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:54.771756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:54.867709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lazy-loading 'services' on Instance uuid 14a10dff-d514-4962-b4c5-19f59ed21209 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:18:54.965165 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d5d045d-4bcf-4d71-bfea-db238b00b3f0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "DELETE /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209/os-volume_attachments/9136713b-efc8-413b-949a-b50bcb584bea" status: 202 len: 0 microversion: 2.1 time: 0.215761 Oct 17 16:18:54.965990 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3519/6773] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:18:54 2022] DELETE /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209/os-volume_attachments/9136713b-efc8-413b-949a-b50bcb584bea => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:18:57.611546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=20 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:57.612928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:18:57.995546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:57.996076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:58.003360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:58.003875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:58.004327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:58.005070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:58.005910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:58.006383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:58.041420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:18:58.142791 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24062360-2fec-40f8-af70-461f1ec3dc5e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 204 len: 0 microversion: 2.1 time: 0.541277 Oct 17 16:18:58.146765 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3255/6774] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:18:57 2022] DELETE /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:18:58.152902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:58.153622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:58.160937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:58.161432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:58.161869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:58.162642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:58.163070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:58.163496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:58.346714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:58.355781 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-597629e2-19ad-4927-b9cf-fe9caa2f016c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1576 microversion: 2.1 time: 0.207422 Oct 17 16:18:58.356395 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3520/6775] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:58 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:18:59.388829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:18:59.390108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:18:59.403468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:59.406160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:59.407036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:59.408331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:18:59.409455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:18:59.410250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:18:59.578654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:18:59.591152 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-29e346f3-5159-4f8b-b458-c03eeee52a31 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1576 microversion: 2.1 time: 0.211246 Oct 17 16:18:59.592088 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3256/6776] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:18:59 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:00.488100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:00.489117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:00.500445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:00.501020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:00.501613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:00.502411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:00.503188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:00.503664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:00.538575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:19:00.621500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:00.623805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:00.637699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:00.638782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:00.640534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:00.642799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:00.643738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:00.644717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:00.650660 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-528afdf6-1c52-45d7-8c80-5a7ec10dc6e8 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "DELETE /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 204 len: 0 microversion: 2.1 time: 0.170555 Oct 17 16:19:00.651673 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3521/6777] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:19:00 2022] DELETE /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:19:00.663427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:00.664119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:00.672342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:00.672847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:00.673292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:00.674046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:00.674543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:00.674976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:00.865934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:00.877328 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-87cea481-4d5a-4c69-8ea0-73aac9b5e6a0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1514 microversion: 2.1 time: 0.219232 Oct 17 16:19:00.890543 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3522/6778] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:00 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:00.890543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54f8dc4e-3f21-49a4-b1ff-be9819c93f4f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:00.902557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54f8dc4e-3f21-49a4-b1ff-be9819c93f4f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:00.905867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8dc4e-3f21-49a4-b1ff-be9819c93f4f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:00.906828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8dc4e-3f21-49a4-b1ff-be9819c93f4f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:00.907655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8dc4e-3f21-49a4-b1ff-be9819c93f4f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:00.909052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8dc4e-3f21-49a4-b1ff-be9819c93f4f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:00.909931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8dc4e-3f21-49a4-b1ff-be9819c93f4f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:00.910759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54f8dc4e-3f21-49a4-b1ff-be9819c93f4f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:00.976706 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54f8dc4e-3f21-49a4-b1ff-be9819c93f4f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2/action" status: 200 len: 24561 microversion: 2.1 time: 0.096493 Oct 17 16:19:00.978486 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3523/6779] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:19:00 2022] POST /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2/action => generated 24561 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:19:00.996218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:01.007101 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-99f2541d-21bf-4859-ab33-b88bcadd506f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1576 microversion: 2.1 time: 0.394665 Oct 17 16:19:01.007886 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3257/6780] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:00 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1576 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:01.588909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a236f55d-569f-4eee-9d4b-4496478a6211 req-c022cfa9-2b59-4b19-a40a-301775e194c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c86145-9837-4081-bf7b-966893f86c4f", "name": "network-vif-deleted", "tag": "b071a161-4dad-4b0e-b2c9-06ac1bd0dc2d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:01.613515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a236f55d-569f-4eee-9d4b-4496478a6211 req-c022cfa9-2b59-4b19-a40a-301775e194c8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:01.614975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a236f55d-569f-4eee-9d4b-4496478a6211 req-c022cfa9-2b59-4b19-a40a-301775e194c8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:01.616013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a236f55d-569f-4eee-9d4b-4496478a6211 req-c022cfa9-2b59-4b19-a40a-301775e194c8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:01.643331 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a236f55d-569f-4eee-9d4b-4496478a6211 req-c022cfa9-2b59-4b19-a40a-301775e194c8 service nova] Creating event network-vif-deleted:b071a161-4dad-4b0e-b2c9-06ac1bd0dc2d for instance 23c86145-9837-4081-bf7b-966893f86c4f on n-h2-854441-12 Oct 17 16:19:01.656945 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a236f55d-569f-4eee-9d4b-4496478a6211 req-c022cfa9-2b59-4b19-a40a-301775e194c8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091015 Oct 17 16:19:01.658677 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3524/6781] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:19:01.921033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:01.921870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:01.931102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:01.931958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:01.932444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:01.933218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:01.933713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:01.934155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:02.042392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:02.044337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:02.056619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:02.057529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:02.058975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:02.059947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:02.060981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:02.061630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:02.135786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:02.146678 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a41b0714-57d5-4b1a-9896-2672a044a8f3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1225 microversion: 2.1 time: 0.112529 Oct 17 16:19:02.149544 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3525/6782] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:02 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:02.156444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:02.168932 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d31204c-5cbd-4202-b55e-b2f0209ff8fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1514 microversion: 2.1 time: 0.252127 Oct 17 16:19:02.185757 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3258/6783] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:01 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:03.172250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:03.172945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:03.180905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:03.181348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:03.181747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:03.182470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:03.182976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:03.183402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:03.202095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:03.204368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:03.214074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:03.215807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:03.215807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:03.216173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:03.216580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:03.217210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:03.252835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:03.253733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:03.254902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:03.255378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lazy-loading 'fault' on Instance uuid 14a10dff-d514-4962-b4c5-19f59ed21209 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:19:03.257660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:03.267211 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64af8afe-81cf-4ed8-a2b7-1bab014f82c4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1225 microversion: 2.1 time: 0.098985 Oct 17 16:19:03.268064 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3526/6784] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:03 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:03.309027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:03.324487 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a78f7d83-7768-444c-ae9c-f76430bb9a9b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 200 len: 1308 microversion: 2.1 time: 0.130981 Oct 17 16:19:03.325061 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3259/6785] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:03 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:03.674073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b56a4335-a71e-45ac-b38e-fd76d156e574 req-b3254735-b0f7-4968-bec1-d0a38e17b1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a10dff-d514-4962-b4c5-19f59ed21209", "name": "network-vif-deleted", "tag": "720e210f-d802-43c0-afe3-0feed330e430"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:03.684861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b56a4335-a71e-45ac-b38e-fd76d156e574 req-b3254735-b0f7-4968-bec1-d0a38e17b1fd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:03.685419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b56a4335-a71e-45ac-b38e-fd76d156e574 req-b3254735-b0f7-4968-bec1-d0a38e17b1fd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:03.685805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b56a4335-a71e-45ac-b38e-fd76d156e574 req-b3254735-b0f7-4968-bec1-d0a38e17b1fd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:03.702647 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b56a4335-a71e-45ac-b38e-fd76d156e574 req-b3254735-b0f7-4968-bec1-d0a38e17b1fd service nova] Creating event network-vif-deleted:720e210f-d802-43c0-afe3-0feed330e430 for instance 14a10dff-d514-4962-b4c5-19f59ed21209 on n-h1-854441-12 Oct 17 16:19:03.707933 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b56a4335-a71e-45ac-b38e-fd76d156e574 req-b3254735-b0f7-4968-bec1-d0a38e17b1fd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037713 Oct 17 16:19:03.708722 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3527/6786] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:19:04.292366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:04.293033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:04.300749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:04.301499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:04.302331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:04.303752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:04.304515 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:04.305375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:04.363271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:04.365336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14a10dff-d514-4962-b4c5-19f59ed21209] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:04.374968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:04.375826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:04.376442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:04.377392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:04.378025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:04.378641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:04.398089 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] HTTP exception thrown: Instance 14a10dff-d514-4962-b4c5-19f59ed21209 could not be found. Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Request method failure captured: Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 HTTP/1.1 Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX_R21w-MLat8-lxY3iuieTuxSmoNd-JmP-VytQK4FB_P818701I5ChV09TVCWfluYvXO-iiQ7gYTPgysHDwnTNkrNL-UkI0W-jfSpXQQw4b0BHKz11pQ-M0T6VpzlTEyOnVkq_uKpaYHUYJuZMoEW-jn7P4UjtIuEQSfgKY9JDDPyg Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 289c8c77042d45078166fdc8a5282e2b Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2128560560 Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/289c8c77042d45078166fdc8a5282e2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/289c8c77042d45078166fdc8a5282e2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_289c8c77042d45078166fdc8a5282e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/289c8c77042d45078166fdc8a5282e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesSnapshotTestJSON-2128560560 Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 289c8c77042d45078166fdc8a5282e2b Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2128560560 Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-VolumesSnapshotTestJSON-2128560560-project Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6b680b39204f44c68b4516e7b1bac76b Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesSnapshotTestJSON-2128560560-project Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 14a10dff-d514-4962-b4c5-19f59ed21209 could not be found. Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '14a10dff-d514-4962-b4c5-19f59ed21209'} Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a10dff-d514-4962-b4c5-19f59ed21209 could not be found. Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a10dff-d514-4962-b4c5-19f59ed21209 could not be found. Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:19:04.400364 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:04.405350 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:19:04.405350 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:19:04.405350 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:19:04.405350 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:19:04.405350 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:19:04.405350 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a10dff-d514-4962-b4c5-19f59ed21209 could not be found. Oct 17 16:19:04.405350 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:04.407770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Returning 404 to user: Instance 14a10dff-d514-4962-b4c5-19f59ed21209 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:19:04.408533 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4ad61c5-dc7e-4d9d-ade3-11ac384a5e88 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209" status: 404 len: 111 microversion: 2.1 time: 0.052537 Oct 17 16:19:04.409300 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3528/6787] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:04 2022] GET /compute/v2.1/servers/14a10dff-d514-4962-b4c5-19f59ed21209 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:19:04.413534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:04.425176 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92f8b5f7-ec71-4999-9558-2ae4754f24c8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1225 microversion: 2.1 time: 0.136992 Oct 17 16:19:04.426063 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3260/6788] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:04 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:05.452678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:05.453621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:05.462440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:05.462958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:05.463591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:05.464414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:05.464880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:05.465299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:05.543151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:05.556581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a72a0aba-e000-45a2-9687-41087b8befbb tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1225 microversion: 2.1 time: 0.107686 Oct 17 16:19:05.572444 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3529/6789] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:05 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:06.589118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:06.589761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:06.597543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:06.598247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:06.598739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:06.599503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:06.599989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:06.600444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:06.640805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:06.641459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:06.642052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:06.642712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lazy-loading 'fault' on Instance uuid 23c86145-9837-4081-bf7b-966893f86c4f {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:19:06.693309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:06.702938 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf485fbc-5446-42c2-8d22-d0038a53f9f4 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 200 len: 1230 microversion: 2.1 time: 0.119224 Oct 17 16:19:06.703540 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3261/6790] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:06 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:07.727038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:07.727733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:07.736076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:07.736617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:07.737029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:07.737749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:07.738202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:07.738658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:07.753950 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f HTTP/1.1 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '23c86145-9837-4081-bf7b-966893f86c4f'} Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:19:07.756168 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-add0cb67-b32d-483f-b13f-44e079596c96 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 404 len: 111 microversion: 2.1 time: 0.034893 Oct 17 16:19:07.764119 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3530/6791] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:07 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:19:07.826660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-335706948", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-476934204", "security_groups": [{"name": "tempest-secgroup-smoke-752350876"}], "block_device_mapping_v2": [{"uuid": "9f8c8a3b-04b7-4754-8953-cbb4a62e6937", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "916c7d18-0cf6-4aa6-bd9b-213b6c12b936"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:07.949538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] validate_networks() for [('916c7d18-0cf6-4aa6-bd9b-213b6c12b936', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:19:08.418838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:19:08.419725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:19:08.420414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:19:08.421556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:19:08.422382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:19:08.433845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:08.434363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:08.434865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:08.435630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:08.436099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:08.436742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:08.457546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:19:08.463860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for user a7647fbb42444923aa218f5579dd30a0 and project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:19:08.527982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:19:08.530254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f8c8a3b-04b7-4754-8953-cbb4a62e6937',volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:19:08.700334 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3fcdc671-e601-4bd0-8261-5e1bb3f5a4fe tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.877781 Oct 17 16:19:08.701020 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3262/6792] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:19:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:19:08.717553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7fef31c1-a6eb-4cd3-891f-1111bb41d5ab tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:08.718811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7fef31c1-a6eb-4cd3-891f-1111bb41d5ab tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:08.789709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7fef31c1-a6eb-4cd3-891f-1111bb41d5ab tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:08.800708 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7fef31c1-a6eb-4cd3-891f-1111bb41d5ab tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1093 microversion: 2.1 time: 0.091111 Oct 17 16:19:08.801659 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3531/6793] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:08 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1093 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:09.830432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:09.831171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:09.838064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:09.838604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:09.839061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:09.839793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:09.840380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:09.840846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:09.940362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:09.954552 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-37c588f8-a1fd-43e5-9996-59f36072c13b tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1191 microversion: 2.1 time: 0.130052 Oct 17 16:19:09.955489 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3263/6794] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:09 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1191 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:10.980485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:10.981125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:10.998128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:10.999035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:10.999642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:11.000536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:11.001152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:11.001744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:11.181810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:11.190442 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6269d6d8-d167-4718-889d-127b6dbe0d83 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1276 microversion: 2.1 time: 0.215640 Oct 17 16:19:11.191098 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3532/6795] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:10 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:11.488015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1320318", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "2b153645-eb53-40fa-bbbe-f5c8bb908a6a"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:11.553890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] validate_networks() for [('2b153645-eb53-40fa-bbbe-f5c8bb908a6a', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:19:11.683027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:11.686342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:11.693139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:11.693643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:11.694310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:11.695115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:11.695579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:11.696194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:11.808928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:19:11.809365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:19:11.809867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:19:11.810315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:19:11.811016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:19:11.896769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:11.906807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:11.907854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:11.907854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:11.908815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:11.909959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:11.909959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:11.956730 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-827ed964-fc30-4c49-8f5c-397430ef7821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2/action" status: 202 len: 1136 microversion: 2.1 time: 0.277804 Oct 17 16:19:11.958106 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3533/6796] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:19:11 2022] POST /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2/action => generated 1136 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 17 16:19:11.989337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:11.991340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:12.002853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:12.003703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:12.004404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:12.006583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:12.007709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:12.008451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:12.202992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:12.213443 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2fa442cf-787a-41f5-b760-83c721a64ae2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.235116 Oct 17 16:19:12.214323 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3534/6797] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:11 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:12.220985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:12.223020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:12.235576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:12.236332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:12.236797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:12.237787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:12.238614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:12.239325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:12.248164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:12.351236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:19:12.352250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:19:12.353098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:19:12.353743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:19:12.354350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:19:12.401424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:12.421327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:12.421930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:12.423180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:12.423688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:12.424322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:12.455190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Getting quotas for project 289c8c77042d45078166fdc8a5282e2b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:19:12.461932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Getting quotas for user 6b680b39204f44c68b4516e7b1bac76b and project 289c8c77042d45078166fdc8a5282e2b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:19:12.480241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:19:12.482889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:19:12.518695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:12.528336 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67ac87d1-99b0-4171-b468-9f23d114c617 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1276 microversion: 2.1 time: 0.312729 Oct 17 16:19:12.529697 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3535/6798] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:12 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1276 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:12.535726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-cc43edd8-2199-4d73-8d9c-9103fd3fc4de req-ce9644d8-c334-4026-9e86-5c40953bde2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0af9000-8710-45a8-921c-da5b64139c0b", "tag": "17ea7ec8-8e8b-4315-a514-3163a5ff1e68"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:12.552344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cc43edd8-2199-4d73-8d9c-9103fd3fc4de req-ce9644d8-c334-4026-9e86-5c40953bde2d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:12.555278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cc43edd8-2199-4d73-8d9c-9103fd3fc4de req-ce9644d8-c334-4026-9e86-5c40953bde2d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:12.556049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-cc43edd8-2199-4d73-8d9c-9103fd3fc4de req-ce9644d8-c334-4026-9e86-5c40953bde2d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:12.572924 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-29891a2a-7ef7-466a-b51b-7b50d6b880fc tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091023 Oct 17 16:19:12.574645 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3264/6799] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:19:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:19:12.582631 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-cc43edd8-2199-4d73-8d9c-9103fd3fc4de req-ce9644d8-c334-4026-9e86-5c40953bde2d service nova] Creating event network-changed:17ea7ec8-8e8b-4315-a514-3163a5ff1e68 for instance e0af9000-8710-45a8-921c-da5b64139c0b on n-h1-854441-12 Oct 17 16:19:12.596504 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-cc43edd8-2199-4d73-8d9c-9103fd3fc4de req-ce9644d8-c334-4026-9e86-5c40953bde2d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065026 Oct 17 16:19:12.600779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a2507bb5-e4c0-45d8-a24e-52768e2ec60b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:12.602889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a2507bb5-e4c0-45d8-a24e-52768e2ec60b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:12.604371 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3536/6800] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:19:12.705288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a2507bb5-e4c0-45d8-a24e-52768e2ec60b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:12.727140 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a2507bb5-e4c0-45d8-a24e-52768e2ec60b tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1216 microversion: 2.1 time: 0.134413 Oct 17 16:19:12.727799 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3265/6801] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:12 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:13.239337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:13.240214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:13.247367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:13.248095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:13.248697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:13.249597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:13.250358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:13.250962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:13.427560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:13.436805 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d5e8483-bfc3-43e2-9e44-fd074ef9d557 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.202684 Oct 17 16:19:13.437526 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3537/6802] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:13 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:13.553143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:13.553681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:13.562166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:13.562851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:13.563300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:13.564033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:13.564512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:13.564957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:13.739299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:13.751265 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e5449af8-1b80-4f36-ba0e-47f3c1b51541 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1276 microversion: 2.1 time: 0.201546 Oct 17 16:19:13.752205 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3266/6803] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:13 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:13.769764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:13.770799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:13.778081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:13.779132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:13.779581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:13.780673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:13.781309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:13.781929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:13.885586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:13.894077 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2d81c40-3f3a-4774-a244-9dac8b8a7cd1 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1276 microversion: 2.1 time: 0.129158 Oct 17 16:19:13.895112 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3538/6804] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:13 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:14.461136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:14.464248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:14.472517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:14.474404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:14.475136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:14.476470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:14.477674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:14.478069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:14.712886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:14.721535 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-88ad9644-0c14-49e9-8438-74fc7a424ab9 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.264684 Oct 17 16:19:14.722380 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3267/6805] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:14 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:14.781381 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:14.782197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:14.792995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:14.793840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:14.794358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:14.795151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:14.795770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:14.796351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:14.918014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:14.918682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:14.931477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:14.931995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:14.932448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:14.933181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:14.933644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:14.934076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:14.994005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:15.003232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ea7364c3-fe98-47b2-8906-14e917a8a860 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1276 microversion: 2.1 time: 0.226853 Oct 17 16:19:15.003840 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3539/6806] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:14 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1276 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:15.171872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:15.187706 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2ac120e1-02ec-440c-adc6-c505dc139451 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1316 microversion: 2.1 time: 0.273037 Oct 17 16:19:15.189341 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3268/6807] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:14 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:15.745546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:15.746214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:15.752633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:15.753194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:15.753702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:15.754471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:15.755019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:15.755504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:15.885109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-406c4d15-1212-42e1-a00e-d4b2cd52c352 req-4c966a9e-aaa2-4a4d-a542-3113b35aa8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f53586-3b6b-48ff-b2ae-5600c16672a6", "tag": "2169aca4-face-4f04-8533-6bdae8fce810"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:15.903776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-406c4d15-1212-42e1-a00e-d4b2cd52c352 req-4c966a9e-aaa2-4a4d-a542-3113b35aa8c0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:15.904365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-406c4d15-1212-42e1-a00e-d4b2cd52c352 req-4c966a9e-aaa2-4a4d-a542-3113b35aa8c0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:15.904811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-406c4d15-1212-42e1-a00e-d4b2cd52c352 req-4c966a9e-aaa2-4a4d-a542-3113b35aa8c0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:15.906234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:15.919766 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-406c4d15-1212-42e1-a00e-d4b2cd52c352 req-4c966a9e-aaa2-4a4d-a542-3113b35aa8c0 service nova] Creating event network-changed:2169aca4-face-4f04-8533-6bdae8fce810 for instance 14f53586-3b6b-48ff-b2ae-5600c16672a6 on n-h2-854441-12 Oct 17 16:19:15.924746 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4350ee4c-d580-4ef6-b209-962819b40d48 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.183103 Oct 17 16:19:15.925570 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3540/6808] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:15 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:15.927023 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-406c4d15-1212-42e1-a00e-d4b2cd52c352 req-4c966a9e-aaa2-4a4d-a542-3113b35aa8c0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046920 Oct 17 16:19:15.927642 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3269/6809] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:19:16.028516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:16.029517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:16.037680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:16.038581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:16.038726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:16.039497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:16.039975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:16.040487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:16.214050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:16.214812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:16.221537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:16.222168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:16.222716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:16.223501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:16.224051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:16.224482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:16.282571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:16.303376 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e54e421b-2a09-4639-95fb-85fcee666e9a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.279944 Oct 17 16:19:16.304589 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3270/6810] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:16 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:16.390951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:16.400634 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3cb14159-fc31-4753-98ec-385365550cb9 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1316 microversion: 2.1 time: 0.191679 Oct 17 16:19:16.401248 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3541/6811] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:16 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:16.949283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:16.949918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:16.957948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:16.958463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:16.958952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:16.959684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:16.960188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:16.960669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:17.106190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:17.114706 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-06e63e58-7155-47c6-98ca-f78245984060 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.169319 Oct 17 16:19:17.115278 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3271/6812] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:16 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:17.330304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:17.331188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:17.341158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:17.342085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:17.342636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:17.343802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:17.344711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:17.345342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:17.427853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:17.429483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:17.440625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:17.441619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:17.442282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:17.443802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:17.444619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:17.446106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:17.452905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:17.515569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:17.524528 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d587885-a890-46d7-8c28-21daad7e25b9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.199862 Oct 17 16:19:17.525306 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3542/6813] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:17 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:17.737187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:17.745931 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea2bc223-d09f-46a7-add6-46befcb7a2b5 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1316 microversion: 2.1 time: 0.325621 Oct 17 16:19:17.746695 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3272/6814] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:17 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:18.140590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:18.141592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:18.149173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:18.149676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:18.150125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:18.150914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:18.151384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:18.151849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:18.332246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:18.344466 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd3223eb-ac69-4348-916c-423dbae0118f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.208378 Oct 17 16:19:18.345295 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3543/6815] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:18 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:18.558267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:18.559742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:18.571841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:18.572739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:18.573458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:18.574378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:18.575041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:18.575630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:18.766269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:18.775381 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3a457ff-155f-42fc-a304-22e6440b707c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.221955 Oct 17 16:19:18.775659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:18.775961 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3273/6816] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:18 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:18.776637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:18.788022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:18.788895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:18.789890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:18.791205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:18.792054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:18.792831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:18.798616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:18.973085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:18.982078 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-28da8828-6a0f-441d-a3ba-7e5cbf498158 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1316 microversion: 2.1 time: 0.213377 Oct 17 16:19:18.982718 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3544/6817] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:18 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:19.370668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:19.371207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:19.378169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:19.378713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:19.379162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:19.379885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:19.380352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:19.381097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:19.532434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:19.543100 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb96ddf6-dce7-4cb3-9080-9bb89197ebf3 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.176707 Oct 17 16:19:19.543707 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3274/6818] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:19 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:19.799985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:19.801053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:19.810237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:19.810750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:19.811205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:19.811972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:19.812418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:19.812848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:19.977735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:19.985989 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2c312466-1928-45fc-881c-a78c58532262 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.190533 Oct 17 16:19:19.986625 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3545/6819] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:19 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:20.013373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:20.014012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:20.021144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:20.021656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:20.022106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:20.022887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:20.023379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:20.023895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:20.201409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:20.207306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e12c418b-1533-492e-a6c4-f5e0ae7b6908 req-4e682b38-3e47-4e8d-97f6-09390eab2ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f53586-3b6b-48ff-b2ae-5600c16672a6", "name": "network-vif-plugged", "status": "completed", "tag": "2169aca4-face-4f04-8533-6bdae8fce810"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:20.215811 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff5b94ce-8491-4720-b853-17b14ebe479f tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1316 microversion: 2.1 time: 0.206008 Oct 17 16:19:20.217257 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3275/6820] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:20 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:20.225005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e12c418b-1533-492e-a6c4-f5e0ae7b6908 req-4e682b38-3e47-4e8d-97f6-09390eab2ad9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:20.225653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e12c418b-1533-492e-a6c4-f5e0ae7b6908 req-4e682b38-3e47-4e8d-97f6-09390eab2ad9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:20.226209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e12c418b-1533-492e-a6c4-f5e0ae7b6908 req-4e682b38-3e47-4e8d-97f6-09390eab2ad9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:20.240655 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e12c418b-1533-492e-a6c4-f5e0ae7b6908 req-4e682b38-3e47-4e8d-97f6-09390eab2ad9 service nova] Creating event network-vif-plugged:2169aca4-face-4f04-8533-6bdae8fce810 for instance 14f53586-3b6b-48ff-b2ae-5600c16672a6 on n-h2-854441-12 Oct 17 16:19:20.250036 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e12c418b-1533-492e-a6c4-f5e0ae7b6908 req-4e682b38-3e47-4e8d-97f6-09390eab2ad9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055564 Oct 17 16:19:20.251943 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3546/6821] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:19:20.569140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:20.569866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:20.578756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:20.579337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:20.579800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:20.580597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:20.581124 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:20.581627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:20.737878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:20.746485 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d0c16ab6-2409-49ae-928f-484ae93d9ef0 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.183737 Oct 17 16:19:20.747192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3276/6822] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:20 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:21.012305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:21.013009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:21.019828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:21.020324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:21.020760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:21.021469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:21.021929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:21.022358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:21.172150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:21.180961 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec7485d4-6873-41a4-bc13-8c1b9d11fbb9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.174980 Oct 17 16:19:21.181575 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3547/6823] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:21 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:21.258463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:21.259328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:21.267014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:21.267433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:21.267879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:21.268604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:21.269047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:21.269505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:21.418418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:21.426988 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0804ba0f-5483-4b95-9629-6fdf67e7aa18 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1316 microversion: 2.1 time: 0.172816 Oct 17 16:19:21.427581 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3277/6824] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:21 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:21.771705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:21.772307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:21.779343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:21.779851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:21.780289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:21.781035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:21.781481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:21.781920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:21.928630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:21.936904 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b06bd10-b1bf-44b7-9411-89ef239fae0c tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.169561 Oct 17 16:19:21.937496 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3548/6825] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:21 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:22.205691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:22.206312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:22.212862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:22.213363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:22.213823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:22.214560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:22.215028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:22.215462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:22.359287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:22.367747 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aff0b35a-326f-41b8-95b9-9f384248d08f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.165977 Oct 17 16:19:22.368351 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3278/6826] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:22 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:22.450353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:22.451025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:22.458617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:22.459153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:22.459685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:22.460476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:22.461036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:22.461531 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:22.609515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:22.618149 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ddff1c3d-9a88-42ab-8638-d7941e0e9e28 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1505 microversion: 2.1 time: 0.171710 Oct 17 16:19:22.618793 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3549/6827] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:22 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:22.644897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-905d53c9-3d47-42b7-8093-49f5513b676a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17b78345-5129-4c65-8075-1c3fe994fac0", "device": "/dev/sdb"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:22.647570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-905d53c9-3d47-42b7-8093-49f5513b676a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:22.649601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:22.655545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-905d53c9-3d47-42b7-8093-49f5513b676a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:22.656044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-905d53c9-3d47-42b7-8093-49f5513b676a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:22.656486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-905d53c9-3d47-42b7-8093-49f5513b676a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:22.657351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-905d53c9-3d47-42b7-8093-49f5513b676a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:22.657820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-905d53c9-3d47-42b7-8093-49f5513b676a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:22.658253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-905d53c9-3d47-42b7-8093-49f5513b676a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:22.710556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=14 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:22.961664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:22.962555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:22.970034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:22.970578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:22.971032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:22.971776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:22.972318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:22.972756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:23.132557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:23.140647 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c1fcb40-4c55-4e27-9628-90b2b3367cf2 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1689 microversion: 2.1 time: 0.183619 Oct 17 16:19:23.141269 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3550/6828] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:22 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:23.390800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:23.391424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:23.397693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:23.398189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:23.398658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:23.399364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:23.399818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:23.400239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:23.546755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:23.555078 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3db914e6-6378-4c82-bdb2-624c526fc9dc tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.168232 Oct 17 16:19:23.555682 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3551/6829] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:23 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:23.784990 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-905d53c9-3d47-42b7-8093-49f5513b676a tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "POST /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.143857 Oct 17 16:19:23.786450 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3279/6830] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 16:19:22 2022] POST /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6/os-volume_attachments => generated 194 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:19:24.164281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:24.165007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:24.173018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:24.173658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:24.174273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:24.175047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:24.175512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:24.175977 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:24.592069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:24.592834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:24.600564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:24.601090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:24.601556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:24.602478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:24.603184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:24.603835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:24.686908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:24.696604 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc22f262-66b4-445a-aaac-5cf6ce58dda8 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1695 microversion: 2.1 time: 0.536448 Oct 17 16:19:24.697211 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3552/6831] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:24 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1695 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:24.762361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:24.771181 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b41b5f1e-951a-480b-840a-918e872f409a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.195311 Oct 17 16:19:24.771753 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3280/6832] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:24 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:25.721635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:25.722189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:25.725430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:25.732182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:25.732687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:25.733133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:25.733852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:25.734306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:25.734760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:25.740217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:25.795405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:25.796047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:25.804522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:25.805150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:25.805604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:25.806374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:25.807008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:25.807633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:25.891942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:25.901936 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7b4bdb0b-62a9-4726-afb4-6ff298075821 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1695 microversion: 2.1 time: 0.184899 Oct 17 16:19:25.902583 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3553/6833] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:25 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:26.025096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-181c5d7c-7c91-448b-a590-369fbed1b945 req-d8156834-5c54-473f-ab94-8a28da11e3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0af9000-8710-45a8-921c-da5b64139c0b", "name": "network-vif-plugged", "status": "completed", "tag": "17ea7ec8-8e8b-4315-a514-3163a5ff1e68"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:26.046062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-181c5d7c-7c91-448b-a590-369fbed1b945 req-d8156834-5c54-473f-ab94-8a28da11e3c0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:26.048799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-181c5d7c-7c91-448b-a590-369fbed1b945 req-d8156834-5c54-473f-ab94-8a28da11e3c0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:26.049451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-181c5d7c-7c91-448b-a590-369fbed1b945 req-d8156834-5c54-473f-ab94-8a28da11e3c0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:26.086563 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-181c5d7c-7c91-448b-a590-369fbed1b945 req-d8156834-5c54-473f-ab94-8a28da11e3c0 service nova] Creating event network-vif-plugged:17ea7ec8-8e8b-4315-a514-3163a5ff1e68 for instance e0af9000-8710-45a8-921c-da5b64139c0b on n-h1-854441-12 Oct 17 16:19:26.110810 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-181c5d7c-7c91-448b-a590-369fbed1b945 req-d8156834-5c54-473f-ab94-8a28da11e3c0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090671 Oct 17 16:19:26.111470 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3554/6834] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:19:26.120958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:26.161079 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c45769c-e858-421a-92f2-7a512c1f4748 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.369238 Oct 17 16:19:26.162707 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3281/6835] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:25 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:26.929053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:26.929884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:26.940157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:26.941037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:26.941713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:26.942477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:26.943001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:26.943438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:27.102940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:27.111660 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee3f78e9-ebae-4d51-b452-dfd74e4a9f77 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1680 microversion: 2.1 time: 0.188366 Oct 17 16:19:27.112271 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3555/6836] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:26 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:27.186629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:27.187852 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:27.196035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:27.196750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:27.197212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:27.197955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:27.198427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:27.198904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:27.357403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:27.372904 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0c2ffd19-ec0b-41b6-a836-6c7cafe21dcf tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1264 microversion: 2.1 time: 0.191267 Oct 17 16:19:27.374883 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3282/6837] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:27 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:28.254177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c7a674dc-da90-4aa2-93af-981515feca79 req-2ad162d7-3d99-442c-89e3-115618f4d03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2", "name": "network-vif-plugged", "status": "completed", "tag": "ec9592b2-07c4-48e9-b523-6795181a6d22"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:28.275910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7a674dc-da90-4aa2-93af-981515feca79 req-2ad162d7-3d99-442c-89e3-115618f4d03c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:28.276775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7a674dc-da90-4aa2-93af-981515feca79 req-2ad162d7-3d99-442c-89e3-115618f4d03c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:28.277590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c7a674dc-da90-4aa2-93af-981515feca79 req-2ad162d7-3d99-442c-89e3-115618f4d03c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:28.293038 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c7a674dc-da90-4aa2-93af-981515feca79 req-2ad162d7-3d99-442c-89e3-115618f4d03c service nova] Creating event network-vif-plugged:ec9592b2-07c4-48e9-b523-6795181a6d22 for instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 on n-h2-854441-12 Oct 17 16:19:28.298551 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c7a674dc-da90-4aa2-93af-981515feca79 req-2ad162d7-3d99-442c-89e3-115618f4d03c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052046 Oct 17 16:19:28.299713 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3556/6838] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:19:28.415556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:28.416115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:28.419419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:28.428806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:28.429954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:28.431022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:28.456440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:28.457340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:28.458169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:28.660884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:28.670081 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-377ba677-9d78-48fa-9fd9-ff4f5e677a22 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1451 microversion: 2.1 time: 0.258574 Oct 17 16:19:28.670827 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3283/6839] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:28 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1451 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:28.694463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:28.695692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:28.702662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:28.703255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:28.703791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:28.704589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:28.705118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:28.705634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:28.877188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:28.887025 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf0dc6f1-00e8-4dfc-847a-de49e4e8b880 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1451 microversion: 2.1 time: 0.197138 Oct 17 16:19:28.887742 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3557/6840] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:28 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1451 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:19:31.594583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-61e6042f-ac59-4cc9-beab-4756a6358ac8 req-b57327c2-ff63-45c5-8cc3-5579f162086b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0af9000-8710-45a8-921c-da5b64139c0b", "tag": "17ea7ec8-8e8b-4315-a514-3163a5ff1e68"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:31.614414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-61e6042f-ac59-4cc9-beab-4756a6358ac8 req-b57327c2-ff63-45c5-8cc3-5579f162086b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:31.615733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-61e6042f-ac59-4cc9-beab-4756a6358ac8 req-b57327c2-ff63-45c5-8cc3-5579f162086b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:31.616740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-61e6042f-ac59-4cc9-beab-4756a6358ac8 req-b57327c2-ff63-45c5-8cc3-5579f162086b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:31.639377 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-61e6042f-ac59-4cc9-beab-4756a6358ac8 req-b57327c2-ff63-45c5-8cc3-5579f162086b service nova] Creating event network-changed:17ea7ec8-8e8b-4315-a514-3163a5ff1e68 for instance e0af9000-8710-45a8-921c-da5b64139c0b on n-h1-854441-12 Oct 17 16:19:31.650705 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-61e6042f-ac59-4cc9-beab-4756a6358ac8 req-b57327c2-ff63-45c5-8cc3-5579f162086b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061950 Oct 17 16:19:31.653603 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3284/6841] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:19:46.293639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:46.294205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:46.297424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:46.298206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=20 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:46.305535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:46.306049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:46.306490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:46.307233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:46.307694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:46.308125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:46.412811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lazy-loading 'services' on Instance uuid 14f53586-3b6b-48ff-b2ae-5600c16672a6 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:19:46.501901 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d8ba046-e7ec-4756-ae7a-76a647f84204 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "DELETE /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6/os-volume_attachments/17b78345-5129-4c65-8075-1c3fe994fac0" status: 202 len: 0 microversion: 2.1 time: 0.212251 Oct 17 16:19:46.502716 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3558/6842] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:19:46 2022] DELETE /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6/os-volume_attachments/17b78345-5129-4c65-8075-1c3fe994fac0 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:19:52.032378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:52.033258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:19:52.039033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:52.039733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:52.049662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:52.050251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:52.050759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:52.051589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:52.052066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:52.052510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:52.084430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:19:52.189919 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b842c937-ebf9-4448-abe2-b3f8f8e0bb17 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "DELETE /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 204 len: 0 microversion: 2.1 time: 0.159039 Oct 17 16:19:52.191123 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3285/6843] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:19:52 2022] DELETE /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:19:52.203728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:52.204403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:52.211447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:52.211947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:52.212391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:52.213109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:52.213566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:52.214013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:52.361544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:52.370150 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a544fcf4-f19e-484c-b9e9-fbd544e3e132 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1511 microversion: 2.1 time: 0.171901 Oct 17 16:19:52.370753 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3559/6844] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:52 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:53.367144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b6afb62-ab9b-4def-b8eb-ba90723115db tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:53.369623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0b6afb62-ab9b-4def-b8eb-ba90723115db tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:53.378147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b6afb62-ab9b-4def-b8eb-ba90723115db tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:53.378691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b6afb62-ab9b-4def-b8eb-ba90723115db tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:53.379148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b6afb62-ab9b-4def-b8eb-ba90723115db tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:53.379874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b6afb62-ab9b-4def-b8eb-ba90723115db tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:53.380351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b6afb62-ab9b-4def-b8eb-ba90723115db tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:53.381100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b6afb62-ab9b-4def-b8eb-ba90723115db tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:53.399392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:53.400578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:53.412553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:53.413451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:53.414332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:53.415596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:53.416407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:53.416961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:53.625169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:53.641164 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2aea66c6-19e2-4686-b56f-94b3f2889c04 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1511 microversion: 2.1 time: 0.249333 Oct 17 16:19:53.642283 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3560/6845] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:53 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:53.742290 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b6afb62-ab9b-4def-b8eb-ba90723115db tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "POST /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2/action" status: 200 len: 24571 microversion: 2.1 time: 0.379804 Oct 17 16:19:53.744139 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3286/6846] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:19:53 2022] POST /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2/action => generated 24571 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:19:54.486790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-189e4bbb-0627-4f8c-9876-2c22fed0a9ea req-2cf1a606-d062-46a6-abac-b660d793d1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f53586-3b6b-48ff-b2ae-5600c16672a6", "name": "network-vif-deleted", "tag": "2169aca4-face-4f04-8533-6bdae8fce810"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:19:54.507247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-189e4bbb-0627-4f8c-9876-2c22fed0a9ea req-2cf1a606-d062-46a6-abac-b660d793d1bd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:54.507759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-189e4bbb-0627-4f8c-9876-2c22fed0a9ea req-2cf1a606-d062-46a6-abac-b660d793d1bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:54.508537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-189e4bbb-0627-4f8c-9876-2c22fed0a9ea req-2cf1a606-d062-46a6-abac-b660d793d1bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:54.531326 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-189e4bbb-0627-4f8c-9876-2c22fed0a9ea req-2cf1a606-d062-46a6-abac-b660d793d1bd service nova] Creating event network-vif-deleted:2169aca4-face-4f04-8533-6bdae8fce810 for instance 14f53586-3b6b-48ff-b2ae-5600c16672a6 on n-h2-854441-12 Oct 17 16:19:54.542479 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-189e4bbb-0627-4f8c-9876-2c22fed0a9ea req-2cf1a606-d062-46a6-abac-b660d793d1bd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062938 Oct 17 16:19:54.543637 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3561/6847] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:19:54.667527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:54.668378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:54.677720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:54.678243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:54.678755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:54.679574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:54.680050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:54.680499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:54.720226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:54.720784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:54.721257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:54.721761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lazy-loading 'fault' on Instance uuid 14f53586-3b6b-48ff-b2ae-5600c16672a6 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:19:54.771109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b680b39204f44c68b4516e7b1bac76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289c8c77042d45078166fdc8a5282e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:19:54.781686 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9643e500-1ddc-4ef6-a5ed-2d8bae8eb185 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 200 len: 1306 microversion: 2.1 time: 0.119232 Oct 17 16:19:54.782705 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3287/6848] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:54 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 1306 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:19:55.822640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:19:55.823346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] [instance: 14f53586-3b6b-48ff-b2ae-5600c16672a6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:19:55.830722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:55.831250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:55.831702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:55.832436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:19:55.832890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:19:55.833377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:19:55.848819 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] HTTP exception thrown: Instance 14f53586-3b6b-48ff-b2ae-5600c16672a6 could not be found. Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Request method failure captured: Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 HTTP/1.1 Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX_R21w-MLat8-lxY3iuieTuxSmoNd-JmP-VytQK4FB_P818701I5ChV09TVCWfluYvXO-iiQ7gYTPgysHDwnTNkrNL-UkI0W-jfSpXQQw4b0BHKz11pQ-M0T6VpzlTEyOnVkq_uKpaYHUYJuZMoEW-jn7P4UjtIuEQSfgKY9JDDPyg Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 289c8c77042d45078166fdc8a5282e2b Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2128560560 Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/289c8c77042d45078166fdc8a5282e2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/289c8c77042d45078166fdc8a5282e2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_289c8c77042d45078166fdc8a5282e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/289c8c77042d45078166fdc8a5282e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-VolumesSnapshotTestJSON-2128560560 Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 289c8c77042d45078166fdc8a5282e2b Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2128560560 Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-VolumesSnapshotTestJSON-2128560560-project Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6b680b39204f44c68b4516e7b1bac76b Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-VolumesSnapshotTestJSON-2128560560-project Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 14f53586-3b6b-48ff-b2ae-5600c16672a6 could not be found. Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '14f53586-3b6b-48ff-b2ae-5600c16672a6'} Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f53586-3b6b-48ff-b2ae-5600c16672a6 could not be found. Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f53586-3b6b-48ff-b2ae-5600c16672a6 could not be found. Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:19:55.850398 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f53586-3b6b-48ff-b2ae-5600c16672a6 could not be found. Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] Returning 404 to user: Instance 14f53586-3b6b-48ff-b2ae-5600c16672a6 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3649e17-63c4-481e-8e5f-3a03d6101ff0 tempest-VolumesSnapshotTestJSON-2128560560 tempest-VolumesSnapshotTestJSON-2128560560-project] 10.222.0.87 "GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6" status: 404 len: 111 microversion: 2.1 time: 0.034832 Oct 17 16:19:55.856776 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3562/6849] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:19:55 2022] GET /compute/v2.1/servers/14f53586-3b6b-48ff-b2ae-5600c16672a6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:20:01.095672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:20:01.096377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:20:01.103744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:01.104176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:01.104924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:01.105923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:01.106657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:01.107358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:01.114196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f3114748-746d-4073-af52-df4c9efabc53 req-2341c8f6-5ba6-48a1-93e3-951e55ef9f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2", "tag": "ec9592b2-07c4-48e9-b523-6795181a6d22"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:20:01.124698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f3114748-746d-4073-af52-df4c9efabc53 req-2341c8f6-5ba6-48a1-93e3-951e55ef9f53 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:01.125540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f3114748-746d-4073-af52-df4c9efabc53 req-2341c8f6-5ba6-48a1-93e3-951e55ef9f53 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:01.126196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f3114748-746d-4073-af52-df4c9efabc53 req-2341c8f6-5ba6-48a1-93e3-951e55ef9f53 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:01.142135 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f3114748-746d-4073-af52-df4c9efabc53 req-2341c8f6-5ba6-48a1-93e3-951e55ef9f53 service nova] Creating event network-changed:ec9592b2-07c4-48e9-b523-6795181a6d22 for instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 on n-h2-854441-12 Oct 17 16:20:01.148576 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f3114748-746d-4073-af52-df4c9efabc53 req-2341c8f6-5ba6-48a1-93e3-951e55ef9f53 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038366 Oct 17 16:20:01.150199 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3563/6850] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:20:01.172674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:20:01.298004 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3c50789-d635-462c-b2f4-39b1d47b0715 tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 204 len: 0 microversion: 2.1 time: 0.205654 Oct 17 16:20:01.300094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3288/6851] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:20:01 2022] DELETE /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:20:01.316873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:20:01.318453 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:20:01.329137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:01.332997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:01.333740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:01.334745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:01.335596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:01.336355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:01.694967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:20:01.705071 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-30a37bdf-2f51-4397-a67d-748b4fce4dfb tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1686 microversion: 2.1 time: 0.398250 Oct 17 16:20:01.706035 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3564/6852] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:20:01 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1686 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:20:02.752438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:20:02.753355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:20:02.764611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:02.765509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:02.766198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:02.767250 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:02.767948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:02.769491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:03.013647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3c6140894e446a9272e1a9247cbb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e8f23ffdb4cf2941eca94a577375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:20:03.028158 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-01f2e0de-075c-4206-a96f-73d55780befa tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 200 len: 1686 microversion: 2.1 time: 0.281249 Oct 17 16:20:03.030027 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3289/6853] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:20:02 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 1686 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:20:03.337005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a43b82c5-4d23-474a-aae9-e2c29b2bdce7 req-5aeb1a72-5cdc-49ec-8966-f143cda167c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2", "name": "network-vif-deleted", "tag": "ec9592b2-07c4-48e9-b523-6795181a6d22"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:20:03.348772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a43b82c5-4d23-474a-aae9-e2c29b2bdce7 req-5aeb1a72-5cdc-49ec-8966-f143cda167c3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:03.349372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a43b82c5-4d23-474a-aae9-e2c29b2bdce7 req-5aeb1a72-5cdc-49ec-8966-f143cda167c3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:03.349877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a43b82c5-4d23-474a-aae9-e2c29b2bdce7 req-5aeb1a72-5cdc-49ec-8966-f143cda167c3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:03.363052 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a43b82c5-4d23-474a-aae9-e2c29b2bdce7 req-5aeb1a72-5cdc-49ec-8966-f143cda167c3 service nova] Creating event network-vif-deleted:ec9592b2-07c4-48e9-b523-6795181a6d22 for instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 on n-h2-854441-12 Oct 17 16:20:03.372960 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a43b82c5-4d23-474a-aae9-e2c29b2bdce7 req-5aeb1a72-5cdc-49ec-8966-f143cda167c3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037003 Oct 17 16:20:03.374047 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3565/6854] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:20:04.062104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:20:04.062746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] [instance: 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:20:04.071324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:04.071945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:04.072604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:04.073457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:20:04.073996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:20:04.074542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:20:04.095486 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] HTTP exception thrown: Instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 could not be found. Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Request method failure captured: Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 HTTP/1.1 Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX6JzVteHpYsi1D8rtpfL_oxwZ0lNzSfAyclZrJa7nZMw7HEkOi0WpbQmGdmXXk4CJJ1m6_Lh-rtNT3Hb5Dl3ZmA5fU2LekXOChdpwgzlw04g6yjpCYmDMcnf0VTmocaMWCNEr8bZCQcvb7VhsaicWh4CY_ie470QWOh_IWzucQey3c Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 176e8f23ffdb4cf2941eca94a577375b Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/176e8f23ffdb4cf2941eca94a577375b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 176e8f23ffdb4cf2941eca94a577375b Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-734931086 Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestNetworkAdvancedServerOps-734931086-project Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6d3c6140894e446a9272e1a9247cbb1b Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-734931086-project Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 could not be found. Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2'} Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 could not be found. Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 could not be found. Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:20:04.098281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 could not be found. Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Returning 404 to user: Instance 0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-14f40b93-ddce-4773-a616-d12fcbbff66f tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2" status: 404 len: 111 microversion: 2.1 time: 0.044440 Oct 17 16:20:04.105593 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3290/6855] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:20:04 2022] GET /compute/v2.1/servers/0b99182e-edd6-4e64-a6ff-5e9c6ad4bbe2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:20:09.098901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c89ecb97-f075-4771-afb0-3f9c40a8ebff tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] Calling method '.version_select at 0x7f28beb53790>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:20:09.121868 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c89ecb97-f075-4771-afb0-3f9c40a8ebff tempest-TestNetworkAdvancedServerOps-734931086 tempest-TestNetworkAdvancedServerOps-734931086-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-286507552" status: 202 len: 0 microversion: 2.1 time: 0.028178 Oct 17 16:20:09.122436 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3566/6856] 10.222.0.87 () {58 vars in 1281 bytes} [Mon Oct 17 16:20:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-286507552 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:21:12.267757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:21:12.268605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:21:12.275042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1279869193", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-476934204", "security_groups": [{"name": "tempest-secgroup-smoke-752350876"}], "block_device_mapping_v2": [{"uuid": "201ed300-6ce4-4c50-8db9-0cc2b71d6759", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "916c7d18-0cf6-4aa6-bd9b-213b6c12b936"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:21:12.604661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] validate_networks() for [('916c7d18-0cf6-4aa6-bd9b-213b6c12b936', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:21:13.149220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:21:13.149652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:21:13.150137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:21:13.150552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:21:13.150979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:21:13.161132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:13.161634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:13.162084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:13.162879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:13.163362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:13.163807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:13.181663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:21:13.187189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Getting quotas for user a7647fbb42444923aa218f5579dd30a0 and project 3c3c7e65217649918748f9d327a1c930. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:21:13.249545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:21:13.251774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='201ed300-6ce4-4c50-8db9-0cc2b71d6759',volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:21:13.391430 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-efcabe50-b658-44d8-bb3a-66a89522edf2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.127264 Oct 17 16:21:13.394689 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3291/6857] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:21:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:21:13.402468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:21:13.403282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:21:13.407947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c29256f-9734-4203-a7c1-0943b8efebc1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:13.408680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c29256f-9734-4203-a7c1-0943b8efebc1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:13.577429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c29256f-9734-4203-a7c1-0943b8efebc1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:13.590154 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c29256f-9734-4203-a7c1-0943b8efebc1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1094 microversion: 2.1 time: 0.190453 Oct 17 16:21:13.605713 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3567/6858] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:13 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1094 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:14.620692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:14.621357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:14.628374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:14.629176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:14.629632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:14.630362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:14.631194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:14.631761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:14.706269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:14.714930 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-de3d61fd-f79d-4f48-9cd5-4a17d1147a92 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1210 microversion: 2.1 time: 0.098988 Oct 17 16:21:14.715901 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3292/6859] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:14 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:15.739558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:15.740220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:15.748247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:15.748749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:15.749407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:15.750143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:15.750831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:15.751290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:15.961645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:15.971808 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-deb4a49e-4efd-4854-b378-2ebcf2bd2ede tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1277 microversion: 2.1 time: 0.235988 Oct 17 16:21:15.972881 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3568/6860] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:15 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:16.216548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9beb0ba1-b116-47bc-9a38-ab4b570f0be6 req-f0eaac83-9bbf-47a0-ae71-e4bbac2eba9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccb897b-61b9-40a2-925a-f27243f95f70", "tag": "50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:21:16.226718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9beb0ba1-b116-47bc-9a38-ab4b570f0be6 req-f0eaac83-9bbf-47a0-ae71-e4bbac2eba9d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:16.227213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9beb0ba1-b116-47bc-9a38-ab4b570f0be6 req-f0eaac83-9bbf-47a0-ae71-e4bbac2eba9d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:16.227652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9beb0ba1-b116-47bc-9a38-ab4b570f0be6 req-f0eaac83-9bbf-47a0-ae71-e4bbac2eba9d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:16.240455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9beb0ba1-b116-47bc-9a38-ab4b570f0be6 req-f0eaac83-9bbf-47a0-ae71-e4bbac2eba9d service nova] Creating event network-changed:50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5 for instance dccb897b-61b9-40a2-925a-f27243f95f70 on n-h2-854441-12 Oct 17 16:21:16.245711 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9beb0ba1-b116-47bc-9a38-ab4b570f0be6 req-f0eaac83-9bbf-47a0-ae71-e4bbac2eba9d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113224 Oct 17 16:21:16.246720 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3293/6861] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:21:16.999406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:16.999988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:17.011101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:17.011681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:17.012286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:17.013028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:17.013496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:17.014165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:17.230239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:17.239497 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7a362ce-c9c2-4dcd-a410-c35752fdb858 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1277 microversion: 2.1 time: 0.244671 Oct 17 16:21:17.240091 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3569/6862] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:16 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:18.265814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:18.266597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:18.274318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:18.274901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:18.275375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:18.276081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:18.276565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:18.277036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:18.427497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:18.436695 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c09079fd-793f-4615-898e-e8314fa459ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1277 microversion: 2.1 time: 0.175377 Oct 17 16:21:18.438094 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3294/6863] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:18 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:19.461885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:19.462528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:19.470110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:19.470653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:19.471226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:19.472102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:19.472558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:19.473020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:19.635828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:19.646208 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-21946307-2bb7-4773-a5b4-c29fdf4a98a2 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1277 microversion: 2.1 time: 0.188328 Oct 17 16:21:19.646912 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3570/6864] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:19 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:20.670247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:20.670937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:20.681049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:20.681570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:20.682025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:20.682803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:20.683284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:20.683740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:20.828177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:20.836452 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e75946f1-355f-476c-9e15-3f47da7e35b8 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1265 microversion: 2.1 time: 0.170252 Oct 17 16:21:20.837062 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3295/6865] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:20 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:21.860431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:21.861002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:21.868792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:21.869635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:21.870587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:21.871821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:21.872636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:21.873218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:22.027524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:22.035918 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94f1e533-43b4-420c-a25e-f793e5b69876 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1265 microversion: 2.1 time: 0.179626 Oct 17 16:21:22.036545 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3571/6866] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:21 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:23.060999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:23.061698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:23.071012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:23.071582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:23.072051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:23.072989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:23.073601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:23.074051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:23.174598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:21:23.194426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:21:23.229703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:23.238676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3bba801e-3a69-46a3-93b7-ae3734e7f3ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1265 microversion: 2.1 time: 0.182239 Oct 17 16:21:23.239334 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3296/6867] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:23 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:24.266047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:24.267279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:24.272095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:21:24.280944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:24.281780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:24.282552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:24.283757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:24.284517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:24.285235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:24.429254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:24.437513 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8e49cdbc-a92f-44d8-ab8f-233c6d84a136 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1265 microversion: 2.1 time: 0.178093 Oct 17 16:21:24.438118 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3572/6868] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:24 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:25.462152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:25.462808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:25.469744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:25.470255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:25.470788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:25.471477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:25.471978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:25.472393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:25.612557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:25.621036 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a4e6fbf-9458-49d0-9c03-7561ede0b613 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1265 microversion: 2.1 time: 0.163186 Oct 17 16:21:25.621614 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3297/6869] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:25 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:26.649824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:26.650432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:26.658292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:26.658795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:26.659238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:26.659941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:26.660385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:26.660808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:26.805048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:26.814255 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2623ffa9-f7b9-49d9-9f08-379063bb05a7 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1265 microversion: 2.1 time: 0.168548 Oct 17 16:21:26.814953 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3573/6870] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:26 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:27.837842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:27.838463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:27.845642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:27.846149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:27.846658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:27.847393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:27.847887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:27.848362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:28.007745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:28.016427 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ef6daf91-fb01-49b7-b5b2-8c9481fb09b0 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1265 microversion: 2.1 time: 0.182739 Oct 17 16:21:28.017048 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3298/6871] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:27 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:28.839634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ded15208-ea2b-49e2-be68-5032404b3cc9 req-7cbb2956-2e4e-4c53-b496-02b65b38dbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccb897b-61b9-40a2-925a-f27243f95f70", "name": "network-vif-plugged", "status": "completed", "tag": "50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:21:28.854830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ded15208-ea2b-49e2-be68-5032404b3cc9 req-7cbb2956-2e4e-4c53-b496-02b65b38dbdf service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:28.855320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ded15208-ea2b-49e2-be68-5032404b3cc9 req-7cbb2956-2e4e-4c53-b496-02b65b38dbdf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:28.855762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ded15208-ea2b-49e2-be68-5032404b3cc9 req-7cbb2956-2e4e-4c53-b496-02b65b38dbdf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:28.868402 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ded15208-ea2b-49e2-be68-5032404b3cc9 req-7cbb2956-2e4e-4c53-b496-02b65b38dbdf service nova] Creating event network-vif-plugged:50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5 for instance dccb897b-61b9-40a2-925a-f27243f95f70 on n-h2-854441-12 Oct 17 16:21:28.874432 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ded15208-ea2b-49e2-be68-5032404b3cc9 req-7cbb2956-2e4e-4c53-b496-02b65b38dbdf service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102621 Oct 17 16:21:28.875101 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3574/6872] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:21:29.039401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:29.040136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:29.047235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:29.047742 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:29.048179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:29.048887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:29.049352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:29.049783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:29.189052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:29.197464 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7cb850b6-bbe8-43f1-8f72-00e352909e4e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1265 microversion: 2.1 time: 0.162006 Oct 17 16:21:29.198068 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3299/6873] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:29 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:30.222889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:30.223605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:30.231820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:30.232447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:30.232918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:30.233862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:30.234317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:30.234770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:30.376246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:30.385110 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ecbe9d5c-e7df-492b-b944-7b3f64c9fb61 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1451 microversion: 2.1 time: 0.167659 Oct 17 16:21:30.385685 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3575/6874] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:30 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:30.409206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:30.409817 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:30.417223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:30.417707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:30.418167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:30.418952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:30.419424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:30.419850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:30.565414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:30.574374 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca00b970-336e-484b-aed2-8dfb47f5e996 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1451 microversion: 2.1 time: 0.169059 Oct 17 16:21:30.575027 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3300/6875] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:30 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:32.802100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-35e4a469-73b4-4c64-a0a9-879a051428c1 req-b3920fb1-8688-46ab-a5d5-803c44e13ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccb897b-61b9-40a2-925a-f27243f95f70", "tag": "50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:21:32.816603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-35e4a469-73b4-4c64-a0a9-879a051428c1 req-b3920fb1-8688-46ab-a5d5-803c44e13ded service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:32.817647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-35e4a469-73b4-4c64-a0a9-879a051428c1 req-b3920fb1-8688-46ab-a5d5-803c44e13ded service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:32.818172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-35e4a469-73b4-4c64-a0a9-879a051428c1 req-b3920fb1-8688-46ab-a5d5-803c44e13ded service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:32.832729 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-35e4a469-73b4-4c64-a0a9-879a051428c1 req-b3920fb1-8688-46ab-a5d5-803c44e13ded service nova] Creating event network-changed:50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5 for instance dccb897b-61b9-40a2-925a-f27243f95f70 on n-h2-854441-12 Oct 17 16:21:32.839351 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-35e4a469-73b4-4c64-a0a9-879a051428c1 req-b3920fb1-8688-46ab-a5d5-803c44e13ded service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040934 Oct 17 16:21:32.840081 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3576/6876] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:21:33.567391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:33.567943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:33.575214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:33.575733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:33.576185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:33.577140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:33.577602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:33.578048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:33.607670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:21:33.758070 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8a66cc0-13a9-4fc2-a17b-ed6a433ce877 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "DELETE /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 204 len: 0 microversion: 2.1 time: 0.351382 Oct 17 16:21:33.759307 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3301/6877] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:21:33 2022] DELETE /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:21:33.770262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:33.771046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:33.779863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:33.780541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:33.781236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:33.782083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:33.782702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:33.783299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:33.952761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:33.964334 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fc65d8f8-b31d-4645-acaa-40139aac9ba4 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1735 microversion: 2.1 time: 0.199102 Oct 17 16:21:33.965155 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3577/6878] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:33 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:34.997255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:34.998046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:35.006342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:35.006941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:35.007418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:35.008277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:35.008744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:35.009205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:35.161689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:35.170399 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c61f18e1-1c7f-4650-91f5-a9ebf14fcb79 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1735 microversion: 2.1 time: 0.177680 Oct 17 16:21:35.170998 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3302/6879] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:34 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:21:35.937331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b8c60bf5-fd9d-493e-a251-c05e02fe0198 req-08843259-9360-4961-b08e-f22f0ed05546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fdce32-a449-4977-be0e-afe0facb6e69", "name": "network-vif-deleted", "tag": "03ce5a76-214a-4ab4-ab96-7db589c270e8"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:21:35.951097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b8c60bf5-fd9d-493e-a251-c05e02fe0198 req-08843259-9360-4961-b08e-f22f0ed05546 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:35.951523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b8c60bf5-fd9d-493e-a251-c05e02fe0198 req-08843259-9360-4961-b08e-f22f0ed05546 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:35.951959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b8c60bf5-fd9d-493e-a251-c05e02fe0198 req-08843259-9360-4961-b08e-f22f0ed05546 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:35.964496 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b8c60bf5-fd9d-493e-a251-c05e02fe0198 req-08843259-9360-4961-b08e-f22f0ed05546 service nova] Creating event network-vif-deleted:03ce5a76-214a-4ab4-ab96-7db589c270e8 for instance 39fdce32-a449-4977-be0e-afe0facb6e69 on n-h1-854441-12 Oct 17 16:21:35.969960 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b8c60bf5-fd9d-493e-a251-c05e02fe0198 req-08843259-9360-4961-b08e-f22f0ed05546 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036508 Oct 17 16:21:35.970613 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3578/6880] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:21:36.193907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:36.194547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:36.201633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:36.202148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:36.202633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:36.203589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:36.204057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:36.204533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:36.239714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:36.240215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:36.240662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:36.241135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lazy-loading 'fault' on Instance uuid 39fdce32-a449-4977-be0e-afe0facb6e69 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:21:36.288751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8648118cfbbd49c2a76d58dd84f228e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8b01b2e224f00ab05a2caacc4fa45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:21:36.304161 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f8651062-9f05-4add-905b-27dd90c165c1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 200 len: 1389 microversion: 2.1 time: 0.113845 Oct 17 16:21:36.305265 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3303/6881] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:36 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 1389 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:21:37.338336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:37.339093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:37.345963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:37.346483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:37.346956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:37.347632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:37.348120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:37.348546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:37.365150 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] HTTP exception thrown: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Request method failure captured: Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 HTTP/1.1 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX_Jc_900zcJYPP6xj1PuNIHDleJEeBpASbMGymgb3rMoXaRFUaHEwMKOy-vXWJPKSJdpJNvGle7vPgRRBLmqTDsYb7CV09T_mkq8fgRRBps9P27B9pIQLGOlFKbBBOYhe0N67ErbD5L4QR_iyBCcJy0ZwM5v65Fj6nq832lZd8aCvs Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: bea8b01b2e224f00ab05a2caacc4fa45 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestServerBasicOps-1426452763 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestServerBasicOps-1426452763 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: bea8b01b2e224f00ab05a2caacc4fa45 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestServerBasicOps-1426452763 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestServerBasicOps-1426452763-project Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8648118cfbbd49c2a76d58dd84f228e5 Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestServerBasicOps-1426452763-project Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '39fdce32-a449-4977-be0e-afe0facb6e69'} Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:21:37.366906 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Returning 404 to user: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-26ad07ef-c908-471f-8057-aec4dc1fffe1 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 404 len: 111 microversion: 2.1 time: 0.035377 Oct 17 16:21:37.371597 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3579/6882] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:37 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:21:37.851891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:37.852437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:37.859674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:37.860448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:37.860978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:37.862469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:37.863034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:37.863543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:37.881018 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] HTTP exception thrown: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Request method failure captured: Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 HTTP/1.1 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX_Jc_900zcJYPP6xj1PuNIHDleJEeBpASbMGymgb3rMoXaRFUaHEwMKOy-vXWJPKSJdpJNvGle7vPgRRBLmqTDsYb7CV09T_mkq8fgRRBps9P27B9pIQLGOlFKbBBOYhe0N67ErbD5L4QR_iyBCcJy0ZwM5v65Fj6nq832lZd8aCvs Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: bea8b01b2e224f00ab05a2caacc4fa45 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestServerBasicOps-1426452763 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestServerBasicOps-1426452763 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: bea8b01b2e224f00ab05a2caacc4fa45 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestServerBasicOps-1426452763 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestServerBasicOps-1426452763-project Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 8648118cfbbd49c2a76d58dd84f228e5 Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestServerBasicOps-1426452763-project Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '39fdce32-a449-4977-be0e-afe0facb6e69'} Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:21:37.883055 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Returning 404 to user: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9d519cc6-b388-4d4e-8223-7250e6e47ee6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "DELETE /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 404 len: 111 microversion: 2.1 time: 0.036724 Oct 17 16:21:37.887569 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3304/6883] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:21:37 2022] DELETE /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:21:37.895486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:37.896118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] [instance: 39fdce32-a449-4977-be0e-afe0facb6e69] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:21:37.903670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:37.904162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:37.904953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:37.905763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:21:37.906353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:21:37.906811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:21:37.922059 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] HTTP exception thrown: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Request method failure captured: Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 HTTP/1.1 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX_Jc_900zcJYPP6xj1PuNIHDleJEeBpASbMGymgb3rMoXaRFUaHEwMKOy-vXWJPKSJdpJNvGle7vPgRRBLmqTDsYb7CV09T_mkq8fgRRBps9P27B9pIQLGOlFKbBBOYhe0N67ErbD5L4QR_iyBCcJy0ZwM5v65Fj6nq832lZd8aCvs Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: bea8b01b2e224f00ab05a2caacc4fa45 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestServerBasicOps-1426452763 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/bea8b01b2e224f00ab05a2caacc4fa45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestServerBasicOps-1426452763 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: bea8b01b2e224f00ab05a2caacc4fa45 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestServerBasicOps-1426452763 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestServerBasicOps-1426452763-project Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 8648118cfbbd49c2a76d58dd84f228e5 Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestServerBasicOps-1426452763-project Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '39fdce32-a449-4977-be0e-afe0facb6e69'} Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:21:37.923684 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.928122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:21:37.928122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:21:37.928122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:21:37.928122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:21:37.928122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:21:37.928122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. Oct 17 16:21:37.928122 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:21:37.928122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Returning 404 to user: Instance 39fdce32-a449-4977-be0e-afe0facb6e69 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:21:37.928122 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4a6651fe-b260-4adc-adb4-f0500c23b6f6 tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69" status: 404 len: 111 microversion: 2.1 time: 0.034330 Oct 17 16:21:37.928927 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3580/6884] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:21:37 2022] GET /compute/v2.1/servers/39fdce32-a449-4977-be0e-afe0facb6e69 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:21:38.102681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c82f38f-eefc-4a48-bc80-9250661d159f tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] Calling method '.version_select at 0x7f28bc119700>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:21:38.124157 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c82f38f-eefc-4a48-bc80-9250661d159f tempest-TestServerBasicOps-1426452763 tempest-TestServerBasicOps-1426452763-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1772634025" status: 202 len: 0 microversion: 2.1 time: 0.025614 Oct 17 16:21:38.124715 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3305/6885] 10.222.0.87 () {58 vars in 1254 bytes} [Mon Oct 17 16:21:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1772634025 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:23:05.420682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=30 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:23:05.421932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=58 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:23:05.426478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:05.427033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:05.434627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:05.435146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:05.435593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:05.436343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:05.436807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:05.437654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:05.468329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:23:05.574078 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be727f91-d7ba-4ad5-bf0f-3d2850a44275 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 204 len: 0 microversion: 2.1 time: 0.155254 Oct 17 16:23:05.574834 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3581/6886] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:23:05 2022] DELETE /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:23:05.585844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:23:05.586992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:23:05.604462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:05.605300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:05.614638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:05.615122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:05.615663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:05.616484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:05.617059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:05.617571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:05.700891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-d5986019-85b5-43aa-b6d3-8833664ad3b1 req-fbd0a384-8f1c-4ee4-9656-75e91b78362a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccb897b-61b9-40a2-925a-f27243f95f70", "tag": "50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:23:05.712151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d5986019-85b5-43aa-b6d3-8833664ad3b1 req-fbd0a384-8f1c-4ee4-9656-75e91b78362a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:05.712667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d5986019-85b5-43aa-b6d3-8833664ad3b1 req-fbd0a384-8f1c-4ee4-9656-75e91b78362a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:05.713123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-d5986019-85b5-43aa-b6d3-8833664ad3b1 req-fbd0a384-8f1c-4ee4-9656-75e91b78362a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:05.726537 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-d5986019-85b5-43aa-b6d3-8833664ad3b1 req-fbd0a384-8f1c-4ee4-9656-75e91b78362a service nova] Creating event network-changed:50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5 for instance dccb897b-61b9-40a2-925a-f27243f95f70 on n-h2-854441-12 Oct 17 16:23:05.732247 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-d5986019-85b5-43aa-b6d3-8833664ad3b1 req-fbd0a384-8f1c-4ee4-9656-75e91b78362a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097187 Oct 17 16:23:05.733220 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3582/6887] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:23:05.802774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:05.813184 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7054bec2-35c4-4a3d-bfeb-6475dbcc6e65 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1574 microversion: 2.1 time: 0.232055 Oct 17 16:23:05.814085 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3306/6888] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:05 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:06.836295 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:23:06.837021 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:23:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 (ip 10.222.0.87) !!! Oct 17 16:23:06.842252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:06.843417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:06.853168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:06.853667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:06.854123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:06.854895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:06.855356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:06.855768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:07.049945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:07.059009 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd1910f9-38cd-483e-a7d9-c7ef291d5dd1 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1574 microversion: 2.1 time: 0.225251 Oct 17 16:23:07.059703 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3583/6889] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:06 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1574 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:08.089631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:08.090370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:08.097909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:08.098617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:08.099142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:08.099961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:08.100506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:08.101015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:08.124551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8427b054-1a52-456f-af53-feb36c5a6af1 req-ec684b29-2853-4e94-a96c-d020a38702ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccb897b-61b9-40a2-925a-f27243f95f70", "name": "network-vif-deleted", "tag": "50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:23:08.144964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8427b054-1a52-456f-af53-feb36c5a6af1 req-ec684b29-2853-4e94-a96c-d020a38702ee service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:08.145887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8427b054-1a52-456f-af53-feb36c5a6af1 req-ec684b29-2853-4e94-a96c-d020a38702ee service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:08.146671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8427b054-1a52-456f-af53-feb36c5a6af1 req-ec684b29-2853-4e94-a96c-d020a38702ee service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:08.172062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:08.182748 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80ef5442-68ca-4b90-9ee9-5616ab110c0e tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1390 microversion: 2.1 time: 0.102087 Oct 17 16:23:08.183426 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3307/6890] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:08 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1390 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:08.185284 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8427b054-1a52-456f-af53-feb36c5a6af1 req-ec684b29-2853-4e94-a96c-d020a38702ee service nova] Creating event network-vif-deleted:50e5ebbb-613d-4aa3-a55d-c8ae4ea62ff5 for instance dccb897b-61b9-40a2-925a-f27243f95f70 on n-h2-854441-12 Oct 17 16:23:08.202152 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8427b054-1a52-456f-af53-feb36c5a6af1 req-ec684b29-2853-4e94-a96c-d020a38702ee service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081719 Oct 17 16:23:08.203154 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3584/6891] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:23:09.215782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:09.216428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:09.224410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:09.224931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:09.225386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:09.226122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:09.226620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:09.227062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:09.305474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:09.314048 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3c3a19d-eefc-4f2c-ba24-308b5d9c970c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1225 microversion: 2.1 time: 0.102349 Oct 17 16:23:09.314681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3308/6892] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:09 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:10.341321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:10.342028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:10.348955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:10.349447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:10.349885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:10.350635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:10.351090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:10.351515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:10.421850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:10.430896 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bdbd0aa1-5d52-4348-b1b8-e6b36d5ad1ea tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1225 microversion: 2.1 time: 0.094617 Oct 17 16:23:10.431588 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3585/6893] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:10 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:11.469835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:11.470463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:11.482933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:11.483494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:11.483991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:11.484863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:11.485466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:11.485911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:11.560971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:11.571221 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-72b3391c-2a30-42f8-8fe1-1e777c3ca577 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1225 microversion: 2.1 time: 0.105504 Oct 17 16:23:11.572123 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3309/6894] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:11 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:12.594855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:12.595473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:12.602933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:12.603421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:12.603870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:12.604592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:12.605044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:12.605461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:12.641125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:12.641646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:12.642127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:12.642641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lazy-loading 'fault' on Instance uuid dccb897b-61b9-40a2-925a-f27243f95f70 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:23:12.686129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:12.694408 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3367c36-a61d-4bc6-bd1f-2dd71f13f9e3 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 200 len: 1230 microversion: 2.1 time: 0.103909 Oct 17 16:23:12.695322 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3586/6895] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:12 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:13.721389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:13.722047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: dccb897b-61b9-40a2-925a-f27243f95f70] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:13.731234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:13.731729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:13.732550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:13.733913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:13.734843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:13.735661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:13.762545 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance dccb897b-61b9-40a2-925a-f27243f95f70 could not be found. Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 HTTP/1.1 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance dccb897b-61b9-40a2-925a-f27243f95f70 could not be found. Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'dccb897b-61b9-40a2-925a-f27243f95f70'} Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dccb897b-61b9-40a2-925a-f27243f95f70 could not be found. Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dccb897b-61b9-40a2-925a-f27243f95f70 could not be found. Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:23:13.765695 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dccb897b-61b9-40a2-925a-f27243f95f70 could not be found. Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance dccb897b-61b9-40a2-925a-f27243f95f70 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-83e12ec2-7c90-4eb4-8019-eecead963fe9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70" status: 404 len: 111 microversion: 2.1 time: 0.051110 Oct 17 16:23:13.770205 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3310/6896] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:13 2022] GET /compute/v2.1/servers/dccb897b-61b9-40a2-925a-f27243f95f70 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:23:20.140727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:20.141363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:20.144970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d62bba5f-fd9e-4a95-9200-dbda574144aa req-71be4703-9dbc-4b6d-adc7-5f966dac9bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0af9000-8710-45a8-921c-da5b64139c0b", "tag": "17ea7ec8-8e8b-4315-a514-3163a5ff1e68"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:23:20.151157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:20.151672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:20.152141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:20.152858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:20.153315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:20.153742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:20.156357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d62bba5f-fd9e-4a95-9200-dbda574144aa req-71be4703-9dbc-4b6d-adc7-5f966dac9bd1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:20.156873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d62bba5f-fd9e-4a95-9200-dbda574144aa req-71be4703-9dbc-4b6d-adc7-5f966dac9bd1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:20.157328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d62bba5f-fd9e-4a95-9200-dbda574144aa req-71be4703-9dbc-4b6d-adc7-5f966dac9bd1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:20.168813 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d62bba5f-fd9e-4a95-9200-dbda574144aa req-71be4703-9dbc-4b6d-adc7-5f966dac9bd1 service nova] Creating event network-changed:17ea7ec8-8e8b-4315-a514-3163a5ff1e68 for instance e0af9000-8710-45a8-921c-da5b64139c0b on n-h1-854441-12 Oct 17 16:23:20.175050 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d62bba5f-fd9e-4a95-9200-dbda574144aa req-71be4703-9dbc-4b6d-adc7-5f966dac9bd1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035020 Oct 17 16:23:20.176000 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3311/6897] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:23:20.197423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:23:20.322258 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b6198f8c-88f5-4c9c-963f-c81e4aa1ab40 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 204 len: 0 microversion: 2.1 time: 0.184731 Oct 17 16:23:20.327738 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3587/6898] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:23:20 2022] DELETE /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:23:20.337213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:20.338235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:20.346586 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:20.347518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:20.348235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:20.348979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:20.349603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:20.350210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:20.523667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:20.532601 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6352568-c7c5-44e1-aa18-82083a6f2c4a tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1575 microversion: 2.1 time: 0.202033 Oct 17 16:23:20.533242 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3312/6899] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:20 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:21.567668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:21.568551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:21.579813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:21.580727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:21.581548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:21.583032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:21.583854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:21.584659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:21.774801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:21.783655 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0f6865a2-7bcc-4d2e-a661-119e788d308c tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1575 microversion: 2.1 time: 0.221618 Oct 17 16:23:21.784279 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3588/6900] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:21 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:22.480446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-042886a2-05f0-44a4-9501-2690f917ea5f req-43cbbf09-0e5b-4909-a220-5174077e33e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0af9000-8710-45a8-921c-da5b64139c0b", "name": "network-vif-deleted", "tag": "17ea7ec8-8e8b-4315-a514-3163a5ff1e68"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:23:22.508195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-042886a2-05f0-44a4-9501-2690f917ea5f req-43cbbf09-0e5b-4909-a220-5174077e33e4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:22.509129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-042886a2-05f0-44a4-9501-2690f917ea5f req-43cbbf09-0e5b-4909-a220-5174077e33e4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:22.509987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-042886a2-05f0-44a4-9501-2690f917ea5f req-43cbbf09-0e5b-4909-a220-5174077e33e4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:22.530269 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-042886a2-05f0-44a4-9501-2690f917ea5f req-43cbbf09-0e5b-4909-a220-5174077e33e4 service nova] Creating event network-vif-deleted:17ea7ec8-8e8b-4315-a514-3163a5ff1e68 for instance e0af9000-8710-45a8-921c-da5b64139c0b on n-h1-854441-12 Oct 17 16:23:22.536678 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-042886a2-05f0-44a4-9501-2690f917ea5f req-43cbbf09-0e5b-4909-a220-5174077e33e4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062949 Oct 17 16:23:22.537584 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3313/6901] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:23:22.808457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:22.809715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:22.818454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:22.818982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:22.819607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:22.820503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:22.820979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:22.821416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:22.896907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:22.907653 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5f52f654-13b1-41bb-afeb-ded9316c4358 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1224 microversion: 2.1 time: 0.103273 Oct 17 16:23:22.908284 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3589/6902] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:22 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:23.933306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:23.934122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:23.942709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:23.943251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:23.943722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:23.944496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:23.944987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:23.945466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:24.018424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:24.026874 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e922c65f-2343-40ee-a03d-44a8a22ad53f tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1224 microversion: 2.1 time: 0.098622 Oct 17 16:23:24.027480 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3314/6903] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:23 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:25.051423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:25.052214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:25.061067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:25.061665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:25.062092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:25.062971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:25.063612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:25.064044 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:25.131604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:25.140705 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1637d2d9-6a40-493d-92e6-6894cc8a36f9 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1224 microversion: 2.1 time: 0.093754 Oct 17 16:23:25.141655 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3590/6904] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:25 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:26.165527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:26.166359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:26.176857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:26.177373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:26.177834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:26.178619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:26.179112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:26.179552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:26.253198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:26.262128 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bb696666-6961-4321-a1a7-80af79073432 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1224 microversion: 2.1 time: 0.101086 Oct 17 16:23:26.262764 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3315/6905] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:26 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:23:27.286466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:27.287239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:27.295076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:27.295581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:27.296011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:27.296712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:27.297172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:27.297619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:27.336430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:27.336924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:27.337367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:27.337830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lazy-loading 'fault' on Instance uuid e0af9000-8710-45a8-921c-da5b64139c0b {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:23:27.386646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7647fbb42444923aa218f5579dd30a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3c7e65217649918748f9d327a1c930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:27.395052 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-786a7533-0787-4bc6-a3ec-eb9c5a2b50cd tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 200 len: 1183 microversion: 2.1 time: 0.113183 Oct 17 16:23:27.395673 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3591/6906] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:27 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 1183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:23:28.419057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:28.419669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: e0af9000-8710-45a8-921c-da5b64139c0b] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:28.427026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:28.427543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:28.428020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:28.428727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:28.429655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:28.429655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:28.444394 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance e0af9000-8710-45a8-921c-da5b64139c0b could not be found. Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b HTTP/1.1 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance e0af9000-8710-45a8-921c-da5b64139c0b could not be found. Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'e0af9000-8710-45a8-921c-da5b64139c0b'} Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0af9000-8710-45a8-921c-da5b64139c0b could not be found. Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0af9000-8710-45a8-921c-da5b64139c0b could not be found. Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:23:28.446138 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0af9000-8710-45a8-921c-da5b64139c0b could not be found. Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance e0af9000-8710-45a8-921c-da5b64139c0b could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1491fb7e-8c4f-4585-9ae3-cfa4e0d2b438 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b" status: 404 len: 111 microversion: 2.1 time: 0.032726 Oct 17 16:23:28.453037 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3316/6907] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:28 2022] GET /compute/v2.1/servers/e0af9000-8710-45a8-921c-da5b64139c0b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:23:28.996858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:28.997491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:29.004745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:29.005254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:29.006019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:29.006770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:29.007232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:29.007663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:29.022721 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f HTTP/1.1 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '23c86145-9837-4081-bf7b-966893f86c4f'} Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:23:29.024454 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3be1f926-04d5-4c10-a0aa-193aa93263ec tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 404 len: 111 microversion: 2.1 time: 0.033247 Oct 17 16:23:29.028664 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3592/6908] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:23:28 2022] DELETE /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:23:29.035073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:29.035737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] [instance: 23c86145-9837-4081-bf7b-966893f86c4f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:29.041971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:29.042475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:29.042948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:29.043659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:29.044123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:29.044558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:29.060763 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] HTTP exception thrown: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Request method failure captured: Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f HTTP/1.1 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTX3CqxwTA4ejn6wCmYpcCPzw6nLXmMkisq5wV8Kr3cFiYnT7dQsymPux05hlDvnpAY5tFgztESwdfRL6LhyisTlHNtrFvAuU36K-4D71eQQHNXOdDVjb7kBadfgH8SeFWK6mQkv-SEhzcjEABFOZUh5z9iXZTnO2ShsGN6w1PimMVGE Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c3c7e65217649918748f9d327a1c930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c3c7e65217649918748f9d327a1c930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 3c3c7e65217649918748f9d327a1c930 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1101952005 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: a7647fbb42444923aa218f5579dd30a0 Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestVolumeBootPattern-1101952005-project Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '23c86145-9837-4081-bf7b-966893f86c4f'} Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:23:29.062458 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Returning 404 to user: Instance 23c86145-9837-4081-bf7b-966893f86c4f could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e69addf3-f4d7-4b81-8bc5-507784e18cac tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f" status: 404 len: 111 microversion: 2.1 time: 0.033135 Oct 17 16:23:29.069559 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3317/6909] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:29 2022] GET /compute/v2.1/servers/23c86145-9837-4081-bf7b-966893f86c4f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:23:32.625304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-082ad3df-2e1c-4fba-90fe-2078a68f4529 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] Calling method '.version_select at 0x7f28be99a820>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:32.683144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-082ad3df-2e1c-4fba-90fe-2078a68f4529 tempest-TestVolumeBootPattern-1101952005 tempest-TestVolumeBootPattern-1101952005-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-476934204" status: 202 len: 0 microversion: 2.1 time: 0.063297 Oct 17 16:23:32.684388 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3593/6910] 10.222.0.87 () {58 vars in 1260 bytes} [Mon Oct 17 16:23:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-476934204 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 16:23:54.128801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=24 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:23:54.129667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=52 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:23:54.283001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1656638800", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:23:54.344013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] validate_networks() for None {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:23:54.697614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:23:54.698057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:23:54.698600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:23:54.699063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:23:54.699689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:23:54.712983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:54.713490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:54.713955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:54.714772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:54.715254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:54.715709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:54.740567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Getting quotas for project f7285bd547aa4f95b011b5097c7d9b49. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:23:54.747197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Getting quotas for user facf0349d91c4f928f9e32066677bea8 and project f7285bd547aa4f95b011b5097c7d9b49. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:23:54.762441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:23:54.764875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:23:54.814840 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-122df1ac-ba3f-493f-9caa-2a3a7410f370 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692003 Oct 17 16:23:54.815507 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3318/6911] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:23:54.827351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:23:54.828711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:23:54.835435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-058c58cb-21d1-4a28-ae80-7a1ffdd6ea0f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:54.836208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-058c58cb-21d1-4a28-ae80-7a1ffdd6ea0f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:54.906874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-058c58cb-21d1-4a28-ae80-7a1ffdd6ea0f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:54.917704 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-058c58cb-21d1-4a28-ae80-7a1ffdd6ea0f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1222 microversion: 2.1 time: 0.092352 Oct 17 16:23:54.918306 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3594/6912] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:54 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:55.944920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:55.945566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:55.954908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:55.955406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:55.955866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:55.956681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:55.957185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:55.957625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:56.031626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:56.044983 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1fd7f828-f8de-49ef-9614-e4f5c921969d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1274 microversion: 2.1 time: 0.104366 Oct 17 16:23:56.046054 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3319/6913] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:55 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:57.087543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:57.088329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:57.096832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:57.097529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:57.098048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:57.098910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:57.099439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:57.099959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:57.195226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:57.210118 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff7ecb9d-a517-4918-8233-8fa4a58ac400 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1280 microversion: 2.1 time: 0.127151 Oct 17 16:23:57.211265 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3595/6914] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:57 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:58.245521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:58.246636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:58.256136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:58.256708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:58.257281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:58.258273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:58.258902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:58.259499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:58.491684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ed148f12-c59f-4af4-b754-b907f46e13eb req-4b3e6094-5d84-49b4-a26f-c25668b6e3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c914db6-c238-4a9d-9e03-c47be82059cc", "tag": "b50bd0f1-e264-4fab-b4ef-0c9fbcd2740b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:23:58.513992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ed148f12-c59f-4af4-b754-b907f46e13eb req-4b3e6094-5d84-49b4-a26f-c25668b6e3a8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:58.515307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ed148f12-c59f-4af4-b754-b907f46e13eb req-4b3e6094-5d84-49b4-a26f-c25668b6e3a8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:58.516093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ed148f12-c59f-4af4-b754-b907f46e13eb req-4b3e6094-5d84-49b4-a26f-c25668b6e3a8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:58.541999 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ed148f12-c59f-4af4-b754-b907f46e13eb req-4b3e6094-5d84-49b4-a26f-c25668b6e3a8 service nova] Creating event network-changed:b50bd0f1-e264-4fab-b4ef-0c9fbcd2740b for instance 2c914db6-c238-4a9d-9e03-c47be82059cc on n-h1-854441-12 Oct 17 16:23:58.552386 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ed148f12-c59f-4af4-b754-b907f46e13eb req-4b3e6094-5d84-49b4-a26f-c25668b6e3a8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068311 Oct 17 16:23:58.553231 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3596/6915] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:23:58.585277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:58.601179 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-382a4db9-66c6-4d7f-8780-ebcc49079b19 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1322 microversion: 2.1 time: 0.359762 Oct 17 16:23:58.602767 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3320/6916] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:58 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:23:59.633932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:23:59.634681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:23:59.643795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:59.644448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:59.644921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:59.645769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:23:59.646404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:23:59.646960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:23:59.809758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:23:59.820424 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed305c60-3d72-4e46-b67a-1739cbc36693 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1322 microversion: 2.1 time: 0.191376 Oct 17 16:23:59.821317 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3597/6917] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:23:59 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:00.846167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:00.846832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:00.855088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:00.855601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:00.856049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:00.856800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:00.857277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:00.857724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:01.008278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:01.017063 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b21b6cd-452d-47d5-9c01-2f9439cda01a tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1322 microversion: 2.1 time: 0.175128 Oct 17 16:24:01.017681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3321/6918] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:00 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:02.041284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:02.041959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:02.049971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:02.050745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:02.051472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:02.053108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:02.054019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:02.054879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:02.247892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:02.257722 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bd28e8f0-c4c8-4bf1-8f03-5d2d861c95d1 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1322 microversion: 2.1 time: 0.220688 Oct 17 16:24:02.258356 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3598/6919] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:02 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:03.286440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:03.287661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:03.302264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:03.303255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:03.304104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:03.305474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:03.306371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:03.307303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:03.444809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-a4720396-cb5b-4987-b702-7060331a8c86 req-746f777e-c1da-4e6c-a665-d2b5f07797d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c914db6-c238-4a9d-9e03-c47be82059cc", "name": "network-vif-plugged", "status": "completed", "tag": "b50bd0f1-e264-4fab-b4ef-0c9fbcd2740b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:03.461704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4720396-cb5b-4987-b702-7060331a8c86 req-746f777e-c1da-4e6c-a665-d2b5f07797d8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:03.462544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4720396-cb5b-4987-b702-7060331a8c86 req-746f777e-c1da-4e6c-a665-d2b5f07797d8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:03.463137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-a4720396-cb5b-4987-b702-7060331a8c86 req-746f777e-c1da-4e6c-a665-d2b5f07797d8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:03.479438 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-a4720396-cb5b-4987-b702-7060331a8c86 req-746f777e-c1da-4e6c-a665-d2b5f07797d8 service nova] Creating event network-vif-plugged:b50bd0f1-e264-4fab-b4ef-0c9fbcd2740b for instance 2c914db6-c238-4a9d-9e03-c47be82059cc on n-h1-854441-12 Oct 17 16:24:03.485168 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-a4720396-cb5b-4987-b702-7060331a8c86 req-746f777e-c1da-4e6c-a665-d2b5f07797d8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048618 Oct 17 16:24:03.486134 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3599/6920] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:24:03.520186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:03.533852 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bab0910c-9623-43dd-bec2-4852b64bd42c tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1322 microversion: 2.1 time: 0.254757 Oct 17 16:24:03.534571 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3322/6921] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:03 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:04.559240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:04.559973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:04.567695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:04.568233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:04.568684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:04.569449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:04.569916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:04.570421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:04.749047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:04.760617 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03a2bf49-ccd3-4db4-acf7-101c64271489 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1322 microversion: 2.1 time: 0.206874 Oct 17 16:24:04.761707 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3600/6922] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:04 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:05.784950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:05.785663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:05.788465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:05.789177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:05.795768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:05.796290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:05.796753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:05.797511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:05.797992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:05.798445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:05.983447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:05.997972 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb1bf294-8076-4f8d-89a6-ba67a61d9993 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1472 microversion: 2.1 time: 0.217393 Oct 17 16:24:05.998827 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3323/6923] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:05 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:06.027870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:06.100352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e29585a-e4df-4580-bc18-1a93256b892d tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Calling method '.version_select at 0x7f28be280d30>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:06.203039 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e29585a-e4df-4580-bc18-1a93256b892d tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/5da1622ffc1644549e0b72948df5fdb1" status: 200 len: 371 microversion: 2.1 time: 0.180152 Oct 17 16:24:06.203982 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3601/6924] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 16:24:06 2022] GET /compute/v2.1/os-quota-sets/5da1622ffc1644549e0b72948df5fdb1 => generated 371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:24:06.221688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ae919536-1554-41d4-aaac-254e0b6328d6 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1524232554", "id": 638164776, "os-flavor-access:is_public": "True"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:06.250342 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ae919536-1554-41d4-aaac-254e0b6328d6 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.035547 Oct 17 16:24:06.251604 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3324/6925] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:24:06 2022] POST /compute/v2.1/flavors => generated 435 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:24:06.266273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "638164776"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:06.269089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:06.276964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:06.277599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:06.278159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:06.279149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:06.279779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:06.280362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:06.591464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '03a6efd9704d4d7198cedb8dea544b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1622ffc1644549e0b72948df5fdb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:06.598464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1524232554 {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:24:06.607818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:06.608352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:06.608828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:06.609602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:06.610100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:06.610620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:06.638131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Getting quotas for project f7285bd547aa4f95b011b5097c7d9b49. Resources: {'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:24:06.644978 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Getting quotas for user facf0349d91c4f928f9e32066677bea8 and project f7285bd547aa4f95b011b5097c7d9b49. Resources: {'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:24:06.667867 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.compute.api [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] ram quota exceeded for 5da1622ffc1644549e0b72948df5fdb1, tried to resize instance. Oct 17 16:24:06.668846 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Request method failure captured: Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc/action HTTP/1.1 Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 38 Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYGZ6KcKgcMwPgV-xS7hxEE8iQc-Nqu4QhVCNUmc2nPx_eK_jR9nKF0SJKexVSbru9peBDg-YFmIOV5_HoxWZO7Pl20pfuOlUa5_unugJO9cfJOx7vcb2HKCT-eEs5q0NJKMZ7cq8jMNe13QTfCrzHIb8etAC9QLc136aISViC9UrRQ Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 5da1622ffc1644549e0b72948df5fdb1 Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1708157031 Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader,admin Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader,admin Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5da1622ffc1644549e0b72948df5fdb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5da1622ffc1644549e0b72948df5fdb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5da1622ffc1644549e0b72948df5fdb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5da1622ffc1644549e0b72948df5fdb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1708157031 Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 5da1622ffc1644549e0b72948df5fdb1 Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1708157031 Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersAdminNegativeTestJSON-1708157031-project-admin Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 03a6efd9704d4d7198cedb8dea544b9f Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1708157031-project-admin Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: {"resize": {"flavorRef": "638164776"}} Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '2c914db6-c238-4a9d-9e03-c47be82059cc', 'body': {'resize': {'flavorRef': '638164776'}}} Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 16:24:06.678298 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e3384d60-19e7-4134-8c09-0f2cc3756bf8 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc/action" status: 403 len: 118 microversion: 2.1 time: 0.419238 Oct 17 16:24:06.686923 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3602/6926] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:24:06 2022] POST /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc/action => generated 118 bytes in 422 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:24:06.693071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-549d8414-c836-4f93-82da-ddb310a7c78a tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:06.717336 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-549d8414-c836-4f93-82da-ddb310a7c78a tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/638164776" status: 202 len: 0 microversion: 2.1 time: 0.027937 Oct 17 16:24:06.718160 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3325/6927] 10.222.0.87 () {58 vars in 1158 bytes} [Mon Oct 17 16:24:06 2022] DELETE /compute/v2.1/flavors/638164776 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 16:24:06.730973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb42af5c-51e6-40ce-9e31-6be8a5aba09b tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:06.777756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb42af5c-51e6-40ce-9e31-6be8a5aba09b tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046371 Oct 17 16:24:06.777756 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3603/6928] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 16:24:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:06.809044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dc114cd2-763b-4a85-9389-8bf9138bf089 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Calling method '.version_select at 0x7f28bc0c5160>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:06.898206 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dc114cd2-763b-4a85-9389-8bf9138bf089 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "GET /compute/v2.1/os-quota-sets/5da1622ffc1644549e0b72948df5fdb1" status: 200 len: 371 microversion: 2.1 time: 0.095879 Oct 17 16:24:06.898769 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3326/6929] 10.222.0.87 () {58 vars in 1242 bytes} [Mon Oct 17 16:24:06 2022] GET /compute/v2.1/os-quota-sets/5da1622ffc1644549e0b72948df5fdb1 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:24:06.920403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5db7ec47-5ae3-452c-8966-a339d52fb05f tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2008553472", "id": 1853183053, "os-flavor-access:is_public": "True"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:06.955733 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5db7ec47-5ae3-452c-8966-a339d52fb05f tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.042199 Oct 17 16:24:06.956805 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3604/6930] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:24:06 2022] POST /compute/v2.1/flavors => generated 437 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:24:06.978759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1853183053"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:06.983254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:06.994589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:06.995245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:06.995766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:06.996652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:06.997357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:06.997972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:07.105242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '03a6efd9704d4d7198cedb8dea544b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1622ffc1644549e0b72948df5fdb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:07.113814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2008553472 {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:24:07.122959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:07.123577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:07.124113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:07.125055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:07.125676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:07.126197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:07.152831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Getting quotas for project f7285bd547aa4f95b011b5097c7d9b49. Resources: {'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:24:07.160126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Getting quotas for user facf0349d91c4f928f9e32066677bea8 and project f7285bd547aa4f95b011b5097c7d9b49. Resources: {'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:24:07.177033 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.api [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] cores quota exceeded for 5da1622ffc1644549e0b72948df5fdb1, tried to resize instance. Oct 17 16:24:07.177733 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Request method failure captured: Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc/action HTTP/1.1 Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 39 Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYGZ6KcKgcMwPgV-xS7hxEE8iQc-Nqu4QhVCNUmc2nPx_eK_jR9nKF0SJKexVSbru9peBDg-YFmIOV5_HoxWZO7Pl20pfuOlUa5_unugJO9cfJOx7vcb2HKCT-eEs5q0NJKMZ7cq8jMNe13QTfCrzHIb8etAC9QLc136aISViC9UrRQ Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 5da1622ffc1644549e0b72948df5fdb1 Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1708157031 Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader,admin Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader,admin Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5da1622ffc1644549e0b72948df5fdb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5da1622ffc1644549e0b72948df5fdb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5da1622ffc1644549e0b72948df5fdb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5da1622ffc1644549e0b72948df5fdb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1708157031 Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 5da1622ffc1644549e0b72948df5fdb1 Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1708157031 Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersAdminNegativeTestJSON-1708157031-project-admin Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 03a6efd9704d4d7198cedb8dea544b9f Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1708157031-project-admin Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: {"resize": {"flavorRef": "1853183053"}} Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '2c914db6-c238-4a9d-9e03-c47be82059cc', 'body': {'resize': {'flavorRef': '1853183053'}}} Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 16:24:07.180196 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:24:07.188253 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7243d6a8-be69-4bf1-82ae-c61fa6661950 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "POST /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc/action" status: 403 len: 113 microversion: 2.1 time: 0.211670 Oct 17 16:24:07.193380 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3327/6931] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:24:06 2022] POST /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc/action => generated 113 bytes in 219 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:24:07.196735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a0033e2a-3760-4757-8cc7-0fbecd24feb5 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:07.221055 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a0033e2a-3760-4757-8cc7-0fbecd24feb5 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "DELETE /compute/v2.1/flavors/1853183053" status: 202 len: 0 microversion: 2.1 time: 0.029343 Oct 17 16:24:07.221692 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3605/6932] 10.222.0.87 () {58 vars in 1161 bytes} [Mon Oct 17 16:24:07 2022] DELETE /compute/v2.1/flavors/1853183053 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:24:07.242015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4297d5a-4697-4451-b6fc-dfc9d1a09870 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:07.270455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d4297d5a-4697-4451-b6fc-dfc9d1a09870 tempest-ServersAdminNegativeTestJSON-1708157031 tempest-ServersAdminNegativeTestJSON-1708157031-project-admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042020 Oct 17 16:24:07.271270 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3328/6933] 10.222.0.87 () {58 vars in 1146 bytes} [Mon Oct 17 16:24:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:07.310802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:07.311659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:07.323510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:07.324475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:07.325317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:07.326695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:07.327566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:07.328505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:07.363127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:24:07.464922 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-38f86138-5646-49ec-818b-a6c8cb6e9f33 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "DELETE /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 204 len: 0 microversion: 2.1 time: 0.161923 Oct 17 16:24:07.465697 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3606/6934] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:24:07 2022] DELETE /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:24:07.478633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:07.479678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:07.491778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:07.492599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:07.493343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:07.494619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:07.495450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:07.496157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:07.692553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:07.706639 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-649c7e81-441e-456f-ba76-8cb4b61ad74d tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1478 microversion: 2.1 time: 0.234659 Oct 17 16:24:07.707612 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3329/6935] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:07 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:08.735859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:08.736913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:08.747709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:08.748546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:08.749104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:08.750289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:08.751141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:08.751898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:08.932970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:08.942333 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-515e639f-688a-480f-b27f-05e1b7010d38 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1478 microversion: 2.1 time: 0.214479 Oct 17 16:24:08.943086 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3607/6936] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:08 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1478 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:09.338088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-186d2c67-5ac6-4aad-815c-09d11616aed6 req-ef8d2f6e-fd2e-4558-8446-cc71f0e35914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c914db6-c238-4a9d-9e03-c47be82059cc", "name": "network-vif-deleted", "tag": "b50bd0f1-e264-4fab-b4ef-0c9fbcd2740b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:09.351054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-186d2c67-5ac6-4aad-815c-09d11616aed6 req-ef8d2f6e-fd2e-4558-8446-cc71f0e35914 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:09.351688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-186d2c67-5ac6-4aad-815c-09d11616aed6 req-ef8d2f6e-fd2e-4558-8446-cc71f0e35914 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:09.352143 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-186d2c67-5ac6-4aad-815c-09d11616aed6 req-ef8d2f6e-fd2e-4558-8446-cc71f0e35914 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:09.367303 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-186d2c67-5ac6-4aad-815c-09d11616aed6 req-ef8d2f6e-fd2e-4558-8446-cc71f0e35914 service nova] Creating event network-vif-deleted:b50bd0f1-e264-4fab-b4ef-0c9fbcd2740b for instance 2c914db6-c238-4a9d-9e03-c47be82059cc on n-h1-854441-12 Oct 17 16:24:09.373693 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-186d2c67-5ac6-4aad-815c-09d11616aed6 req-ef8d2f6e-fd2e-4558-8446-cc71f0e35914 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039823 Oct 17 16:24:09.374811 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3330/6937] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:24:09.969439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:09.970487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:09.983052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:09.983942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:09.984709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:09.986017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:09.986909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:09.989589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:10.050929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:10.051530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:10.052046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:10.052617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lazy-loading 'fault' on Instance uuid 2c914db6-c238-4a9d-9e03-c47be82059cc {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:24:10.105913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0349d91c4f928f9e32066677bea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7285bd547aa4f95b011b5097c7d9b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:10.115014 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10934708-6cd5-44bc-9de0-dc4164f2b5c2 tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 200 len: 1312 microversion: 2.1 time: 0.152112 Oct 17 16:24:10.115625 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3608/6938] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:09 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:11.145982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:11.147247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] [instance: 2c914db6-c238-4a9d-9e03-c47be82059cc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:11.158193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:11.159111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:11.160217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:11.161475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:11.162518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:11.163263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:11.182187 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] HTTP exception thrown: Instance 2c914db6-c238-4a9d-9e03-c47be82059cc could not be found. Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Request method failure captured: Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc HTTP/1.1 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYGZ47PiMd7m9JPtzlzHi17W2NKjb7M6Y5mxlaUlyYZ2VXIKn99V9GKahmt5_H3FpdCfoxNCmhnhmnh_h6zJ7cvrC3qUymuh_pl662fYi-Q2HmknUzr7cYpx7ayIhkn6Cm9c86kMLB3ym8WtIInsC-ugsGkhA6TWD8ptI_a9E66Ydo8 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: f7285bd547aa4f95b011b5097c7d9b49 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1953186996 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f7285bd547aa4f95b011b5097c7d9b49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/f7285bd547aa4f95b011b5097c7d9b49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_f7285bd547aa4f95b011b5097c7d9b49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/f7285bd547aa4f95b011b5097c7d9b49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1953186996 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: f7285bd547aa4f95b011b5097c7d9b49 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1953186996 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersAdminNegativeTestJSON-1953186996-project Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: facf0349d91c4f928f9e32066677bea8 Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1953186996-project Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 2c914db6-c238-4a9d-9e03-c47be82059cc could not be found. Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '2c914db6-c238-4a9d-9e03-c47be82059cc'} Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c914db6-c238-4a9d-9e03-c47be82059cc could not be found. Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c914db6-c238-4a9d-9e03-c47be82059cc could not be found. Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:11.184118 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c914db6-c238-4a9d-9e03-c47be82059cc could not be found. Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] Returning 404 to user: Instance 2c914db6-c238-4a9d-9e03-c47be82059cc could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f3fae7f9-9eae-4f30-8b51-9d2d76363c4f tempest-ServersAdminNegativeTestJSON-1953186996 tempest-ServersAdminNegativeTestJSON-1953186996-project] 10.222.0.87 "GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc" status: 404 len: 111 microversion: 2.1 time: 0.050020 Oct 17 16:24:11.191392 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3331/6939] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:11 2022] GET /compute/v2.1/servers/2c914db6-c238-4a9d-9e03-c47be82059cc => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:24:19.328129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:19.330416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:19.478082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1055503387", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "eb990ebd-21c6-4276-8a83-0fd204d49ee8"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:19.559830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] validate_networks() for [('eb990ebd-21c6-4276-8a83-0fd204d49ee8', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:24:20.093040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:24:20.093666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:24:20.094243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:24:20.094800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:24:20.095318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:24:20.105906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:20.106398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:20.106895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:20.107633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:20.108091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:20.108519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:20.115098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:20.132942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Getting quotas for project 79b59c23edd5468bb72cd3a7dd0dd717. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:24:20.139960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Getting quotas for user 427a17e14e0c41cf9b46d52e429a969a and project 79b59c23edd5468bb72cd3a7dd0dd717. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:24:20.156383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:24:20.158950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:24:20.210186 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [21803a1b-e1a4-4b0e-800f-a5d69ae60f09] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:24:21.219437 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [21803a1b-e1a4-4b0e-800f-a5d69ae60f09] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 38484. Oct 17 16:24:21.226074 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-daaecc7d-214b-4e43-ac4b-67d2b44843f7 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.908991 Oct 17 16:24:21.229289 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3609/6940] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:24:21.246854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-00cdb185-5cd4-48c3-b581-6c572497c276 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:21.248755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-00cdb185-5cd4-48c3-b581-6c572497c276 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:21.257564 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:21.260856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:21.264948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:21.266329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=55 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:21.369752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-00cdb185-5cd4-48c3-b581-6c572497c276 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:21.384078 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-00cdb185-5cd4-48c3-b581-6c572497c276 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1215 microversion: 2.1 time: 0.143442 Oct 17 16:24:21.385164 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3332/6941] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:21 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:22.425476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:22.426564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:22.435347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:22.435972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:22.437071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:22.438167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:22.438679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:22.439181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:22.516610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:22.524883 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fed58de-5e0b-437f-8e30-587db8d00786 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1267 microversion: 2.1 time: 0.107226 Oct 17 16:24:22.525744 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3610/6942] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:22 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:23.551677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:23.553099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:23.567113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:23.568076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:23.568876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:23.570409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:23.571323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:23.572126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:23.886238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:23.910611 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c2c826c9-199e-49ba-9d67-fdd3fb211a39 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1315 microversion: 2.1 time: 0.365049 Oct 17 16:24:23.912075 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3333/6943] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:23 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:24.655151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9c0a6c1f-fce6-4d40-a089-7cbc2949d057 req-eac9c831-2661-4678-b8ee-9a933c914c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f77fadd-7385-4c0c-adda-dde9bcf4a47a", "tag": "6444656b-963f-4b5d-9b23-d4d430abc293"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:24.669576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c0a6c1f-fce6-4d40-a089-7cbc2949d057 req-eac9c831-2661-4678-b8ee-9a933c914c7c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:24.670202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c0a6c1f-fce6-4d40-a089-7cbc2949d057 req-eac9c831-2661-4678-b8ee-9a933c914c7c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:24.670823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9c0a6c1f-fce6-4d40-a089-7cbc2949d057 req-eac9c831-2661-4678-b8ee-9a933c914c7c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:24.685213 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9c0a6c1f-fce6-4d40-a089-7cbc2949d057 req-eac9c831-2661-4678-b8ee-9a933c914c7c service nova] Creating event network-changed:6444656b-963f-4b5d-9b23-d4d430abc293 for instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a on n-h1-854441-12 Oct 17 16:24:24.691307 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9c0a6c1f-fce6-4d40-a089-7cbc2949d057 req-eac9c831-2661-4678-b8ee-9a933c914c7c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046692 Oct 17 16:24:24.692403 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3611/6944] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:24:24.935376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:24.936660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:24.945752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:24.946625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:24.947239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:24.948706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:24.949194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:24.949767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:25.552036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:25.562726 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a9be4071-f43f-44b1-ba2d-f3937253a797 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1315 microversion: 2.1 time: 0.631374 Oct 17 16:24:25.563627 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3334/6945] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:24 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:26.593250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:26.594404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:26.602298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:26.613262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:26.613822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:26.614391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:26.615367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:26.615972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:26.616579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:26.791992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:26.801434 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad8d30c3-a4f7-48e9-82d7-8b31357e020c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1315 microversion: 2.1 time: 0.216813 Oct 17 16:24:26.805055 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3612/6946] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:26 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:27.840597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:27.841752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:27.853775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:27.854477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:27.855214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:27.856349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:27.857172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:27.857926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:28.049768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:28.059101 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-74478871-ca5b-44f9-87cc-5ef2ada91429 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1315 microversion: 2.1 time: 0.227073 Oct 17 16:24:28.059706 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3335/6947] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:27 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:29.086485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:29.087206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:29.094682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:29.095174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:29.095613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:29.096332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:29.096785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:29.097233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:29.245971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:29.256223 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63262c30-3bbd-4e43-a451-91e5e8e10a75 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1315 microversion: 2.1 time: 0.172986 Oct 17 16:24:29.256896 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3613/6948] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:29 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:29.516609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-1568d33e-b014-4270-a263-22d3e89e4401 req-81c2befb-8e3a-43ef-becc-6781eb5809c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f77fadd-7385-4c0c-adda-dde9bcf4a47a", "name": "network-vif-plugged", "status": "completed", "tag": "6444656b-963f-4b5d-9b23-d4d430abc293"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:29.530830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1568d33e-b014-4270-a263-22d3e89e4401 req-81c2befb-8e3a-43ef-becc-6781eb5809c5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:29.531174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1568d33e-b014-4270-a263-22d3e89e4401 req-81c2befb-8e3a-43ef-becc-6781eb5809c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:29.531844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-1568d33e-b014-4270-a263-22d3e89e4401 req-81c2befb-8e3a-43ef-becc-6781eb5809c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:29.557578 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-1568d33e-b014-4270-a263-22d3e89e4401 req-81c2befb-8e3a-43ef-becc-6781eb5809c5 service nova] Creating event network-vif-plugged:6444656b-963f-4b5d-9b23-d4d430abc293 for instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a on n-h1-854441-12 Oct 17 16:24:29.568525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-1568d33e-b014-4270-a263-22d3e89e4401 req-81c2befb-8e3a-43ef-becc-6781eb5809c5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055595 Oct 17 16:24:29.570006 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3336/6949] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:24:30.279861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:30.280472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:30.283286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:30.283973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:30.290194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:30.290749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:30.291188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:30.291892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:30.292342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:30.292759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:30.433501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:30.441696 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3973bb59-86e9-4f71-8316-5c75a0627814 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1315 microversion: 2.1 time: 0.165834 Oct 17 16:24:30.442301 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3614/6950] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:30 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:31.466917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:31.467706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:31.470930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:31.477744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:31.478335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:31.478856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:31.479628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:31.480133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:31.480604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:31.637298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:31.646792 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a0d297b4-8f7c-4657-bbe5-6af487dcfbca tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1501 microversion: 2.1 time: 0.184417 Oct 17 16:24:31.647583 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3337/6951] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:31 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:31.674603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:24:31.677168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:31.684616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:31.685151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:31.685562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:31.686285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:31.686775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:31.687212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:31.718356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:31.725171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:24:31.732810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:24:31.733234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:24:31.733711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:24:31.734128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:24:31.734573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:24:31.805998 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8aabf987-fdc9-4c24-91f0-3649f3fbb3a9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "POST /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a/action" status: 202 len: 0 microversion: 2.1 time: 0.136079 Oct 17 16:24:31.806664 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3615/6952] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:24:31 2022] POST /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:24:31.821094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:31.822380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:31.834467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:31.835610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:31.836468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:31.837779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:31.838754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:31.839542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:32.050242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:32.078432 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e9291e6-1000-4626-824c-b5c7d53c43c2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1510 microversion: 2.1 time: 0.266277 Oct 17 16:24:32.094537 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3338/6953] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:31 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:24:33.125885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:33.127013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:33.148213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:33.148975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:33.149581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:33.150486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:33.151377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:33.151887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:33.327992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:33.342193 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3e24da0a-772d-45d2-a605-6bb39111c36a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1510 microversion: 2.1 time: 0.227435 Oct 17 16:24:33.343519 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3616/6954] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:33 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:34.376022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:34.376673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:34.384533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:34.385054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:34.385524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:34.386263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:34.386777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:34.387232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:34.544518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:34.559152 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-107ea4c8-e542-4413-9ede-cef35c1ee691 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.186709 Oct 17 16:24:34.560252 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3339/6955] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:34 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:35.586298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:35.587268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:35.596008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:35.596504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:35.596937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:35.597642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:35.598096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:35.598537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:35.748120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:35.757372 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3515a2f6-59ef-49fe-8c88-64f29f1b8717 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.177395 Oct 17 16:24:35.758007 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3617/6956] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:35 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:36.782215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:36.783070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:36.790842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:36.791367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:36.791846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:36.792593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:36.793076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:36.793527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:36.978522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:36.988361 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-88075bf2-adf8-401e-a143-5100c9a1ecaf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.210395 Oct 17 16:24:36.988994 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3340/6957] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:36 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:38.014566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:38.016008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:38.025025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:38.025835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:38.026759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:38.028076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:38.028908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:38.029545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:38.221316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:38.232594 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-201aee9c-1997-490b-ae4e-ad08a41c331b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.222470 Oct 17 16:24:38.233264 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3618/6958] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:38 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:39.259473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:39.260179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:39.268714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:39.269263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:39.269723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:39.270779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:39.271287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:39.271889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:39.427812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:39.440109 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c63be2b0-c6ef-463e-89d2-e7378db768bc tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.185175 Oct 17 16:24:39.440750 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3341/6959] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:39 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:40.465839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:40.466588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:40.473992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:40.474479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:40.474935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:40.475644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:40.476095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:40.476510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:40.621919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:40.631562 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-389adccc-40cc-4b63-a5eb-e280a89ffdf9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.170649 Oct 17 16:24:40.632148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3619/6960] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:40 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:41.654812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:41.655432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:41.663770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:41.664337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:41.664802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:41.665570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:41.666045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:41.666492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:41.812656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:41.821495 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3dc6d439-0d92-4f86-8509-f09c84ce36df tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.170826 Oct 17 16:24:41.822127 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3342/6961] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:41 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:42.846562 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:42.847363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:42.855549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:42.856048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:42.856483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:42.857191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:42.857623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:42.858061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:43.009213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:43.018041 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90cb52df-d67c-4863-900f-d29eba118b4a tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.175545 Oct 17 16:24:43.018684 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3620/6962] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:42 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:44.042252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:44.043359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:44.051745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:44.052280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:44.052819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:44.053891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:44.054475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:44.054957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:44.212419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:44.222171 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9cea24a4-898f-47f5-84ca-70e7a34302d0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.184057 Oct 17 16:24:44.222981 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3343/6963] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:44 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:45.248236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:45.248867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:45.258686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:45.259204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:45.259663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:45.260435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:45.260884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:45.261320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:45.410734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:45.419575 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-faa0a7a1-c261-43ce-8b23-a8f4a82540ad tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.177388 Oct 17 16:24:45.420203 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3621/6964] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:45 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:46.444079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:46.444709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:46.447755 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:24:46.447934 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:24:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a (ip 10.222.0.87) !!! Oct 17 16:24:46.454953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:46.455578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:46.456226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:46.457113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:46.457787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:46.458532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:46.633327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:46.642429 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-113ced6e-6db1-4d5a-bae8-2c80248f7b8c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.202559 Oct 17 16:24:46.643141 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3344/6965] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:46 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:47.670519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:47.671247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:47.679560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:47.680092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:47.680567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:47.681349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:47.681798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:47.682216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:47.853241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:47.861462 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2d4bf6ac-b907-45c6-b0ac-7a179ffb2cf6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.195107 Oct 17 16:24:47.862127 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3622/6966] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:47 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:48.885797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:48.886393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:48.894398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:48.894991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:48.895447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:48.896199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:48.896747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:48.897201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:49.077626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:49.086805 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1bfaa8a0-b76a-4b37-8b48-ec341132e4a5 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.205127 Oct 17 16:24:49.087450 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3345/6967] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:48 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:24:50.111316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:50.112135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:50.119666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:50.120161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:50.120590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:50.121302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:50.121756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:50.122182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:50.139697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:50.278178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:50.293069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed2adece-1e7e-40ab-962a-599cd52a93cb tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.185676 Oct 17 16:24:50.294164 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3623/6968] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:50 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:51.336373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:51.337471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:51.341511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=31 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:51.348795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:51.349328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:51.349793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:51.350686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:51.351192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:51.351709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:51.355262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=75 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:51.516283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:51.525487 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7b660709-b318-45de-9b4e-c2974c798fc4 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.195320 Oct 17 16:24:51.526103 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3346/6969] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:51 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:52.553884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:52.554911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:52.567276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:52.568164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:52.568927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:52.570173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:52.570956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:52.571654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:52.720854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:52.729549 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e86a438-2f33-46c0-bdfd-575cd1f3e2d9 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.183125 Oct 17 16:24:52.730139 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3624/6970] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:52 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:53.756057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:53.756930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:53.767004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:53.767525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:53.767990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:53.768946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:53.769462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:53.769922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:53.924800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:53.933791 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0ed0f949-a8fa-444a-a9da-e27505248c6d tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.181976 Oct 17 16:24:53.934431 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3347/6971] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:53 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:54.957788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:54.958464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:54.966421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:54.966960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:54.967440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:54.968167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:54.968628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:54.969058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:55.125517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:55.135499 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-57395fed-d7f6-44a3-9158-2203a2c34a46 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.181778 Oct 17 16:24:55.136208 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3625/6972] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:54 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:56.162103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:56.162791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:56.170382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:56.170948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:56.171420 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:56.172171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:56.172677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:56.173140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:56.365745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:56.374555 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-667a75c4-050b-42db-88dc-2fbd935622bf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.217046 Oct 17 16:24:56.375195 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3348/6973] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:56 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:57.400361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:57.401163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:57.403834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:24:57.409690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:57.410182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:57.410646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:57.411362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:57.411814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:57.412236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:57.568586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:57.577699 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a05c714-5797-4671-8e21-8c386ffd40d2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.182051 Oct 17 16:24:57.578614 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3626/6974] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:57 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:58.603862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:58.604720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:58.612623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:58.613161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:58.613619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:58.614376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:58.614906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:58.615391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:58.764165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:58.773499 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2f75799-be4c-469b-8a4e-8ea56576f14c tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.173584 Oct 17 16:24:58.774090 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3349/6975] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:58 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:24:59.798183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:24:59.798905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:24:59.810130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:59.810671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:59.811114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:59.811844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:24:59.812300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:24:59.812724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:24:59.972832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:24:59.981640 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb47df66-f9f8-483a-a2b4-bfb2bc528131 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.188027 Oct 17 16:24:59.982252 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3627/6976] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:24:59 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:01.006175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:01.006935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:01.014633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:01.015165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:01.015626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:01.016375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:01.016849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:01.017301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:01.220761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:01.231527 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e9258e9a-c996-463c-a9be-cd56c51c13cf tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1515 microversion: 2.1 time: 0.229851 Oct 17 16:25:01.232463 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3350/6977] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:01 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1515 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:01.827412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-96187f35-f0d5-4e69-bf50-157c430c6b64 req-654314a2-83ec-4460-bd37-e7494e3bc44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f77fadd-7385-4c0c-adda-dde9bcf4a47a", "name": "network-vif-unplugged", "status": "completed", "tag": "6444656b-963f-4b5d-9b23-d4d430abc293"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:25:01.841079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-96187f35-f0d5-4e69-bf50-157c430c6b64 req-654314a2-83ec-4460-bd37-e7494e3bc44b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:01.841778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-96187f35-f0d5-4e69-bf50-157c430c6b64 req-654314a2-83ec-4460-bd37-e7494e3bc44b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:01.842336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-96187f35-f0d5-4e69-bf50-157c430c6b64 req-654314a2-83ec-4460-bd37-e7494e3bc44b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:01.860707 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-96187f35-f0d5-4e69-bf50-157c430c6b64 req-654314a2-83ec-4460-bd37-e7494e3bc44b service nova] Creating event network-vif-unplugged:6444656b-963f-4b5d-9b23-d4d430abc293 for instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a on n-h2-854441-12 Oct 17 16:25:01.868099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-96187f35-f0d5-4e69-bf50-157c430c6b64 req-654314a2-83ec-4460-bd37-e7494e3bc44b service nova] Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:25:01.881029 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-96187f35-f0d5-4e69-bf50-157c430c6b64 req-654314a2-83ec-4460-bd37-e7494e3bc44b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057975 Oct 17 16:25:01.881657 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3628/6978] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:25:02.277339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:02.278372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:02.288044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:02.288730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:02.289286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:02.290168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:02.290938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:02.291493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:02.544207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:02.553119 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-75c3626f-d5db-480e-b992-3f657270e1b6 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1514 microversion: 2.1 time: 0.281211 Oct 17 16:25:02.553743 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3351/6979] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:02 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1514 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:03.586440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:03.587291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:03.601050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:03.601934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:03.602752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:03.604102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:03.604972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:03.605762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:03.777052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:03.786687 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f418fa4-4f73-4ac4-984e-3738828ddda8 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1512 microversion: 2.1 time: 0.209577 Oct 17 16:25:03.787326 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3629/6980] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:03 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:03.896937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-bec202a4-8614-4d64-bcd3-392e0dd1db19 req-d2ed825c-8f74-45ec-9656-a5b4de92da05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f77fadd-7385-4c0c-adda-dde9bcf4a47a", "tag": "6444656b-963f-4b5d-9b23-d4d430abc293"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:25:03.908952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bec202a4-8614-4d64-bcd3-392e0dd1db19 req-d2ed825c-8f74-45ec-9656-a5b4de92da05 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:03.909456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bec202a4-8614-4d64-bcd3-392e0dd1db19 req-d2ed825c-8f74-45ec-9656-a5b4de92da05 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:03.909905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bec202a4-8614-4d64-bcd3-392e0dd1db19 req-d2ed825c-8f74-45ec-9656-a5b4de92da05 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:03.923675 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bec202a4-8614-4d64-bcd3-392e0dd1db19 req-d2ed825c-8f74-45ec-9656-a5b4de92da05 service nova] Creating event network-changed:6444656b-963f-4b5d-9b23-d4d430abc293 for instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a on n-h2-854441-12 Oct 17 16:25:03.930427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-bec202a4-8614-4d64-bcd3-392e0dd1db19 req-d2ed825c-8f74-45ec-9656-a5b4de92da05 service nova] Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:25:03.942829 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-bec202a4-8614-4d64-bcd3-392e0dd1db19 req-d2ed825c-8f74-45ec-9656-a5b4de92da05 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049695 Oct 17 16:25:03.943560 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3352/6981] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:25:04.812867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:04.814603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:04.823302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:04.823919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:04.824543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:04.825341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:04.825865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:04.826431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:05.014984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:05.024181 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aed23f21-d5ef-4d4f-b7cc-9a0a01cd1850 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1509 microversion: 2.1 time: 0.215827 Oct 17 16:25:05.024788 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3630/6982] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:04 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:05.049429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:05.050040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:05.057300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:05.057823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:05.058266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:05.059081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:05.059552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:05.059978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:05.091196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:25:05.151389 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.compute.api [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Found an unconfirmed migration during delete, id: 16, status: finished Oct 17 16:25:06.798676 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab3e4170-948b-4d51-a968-03493398e00b tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 204 len: 0 microversion: 2.1 time: 1.754467 Oct 17 16:25:06.800038 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3353/6983] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:25:05 2022] DELETE /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 0 bytes in 1757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:25:06.808727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:06.810039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:06.817942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:06.818442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:06.818935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:06.819710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:06.820185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:06.820613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:07.017060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:07.027204 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2eb282b4-699a-4e22-b9a9-1cb0d2ba1fd0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1501 microversion: 2.1 time: 0.222461 Oct 17 16:25:07.027835 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3631/6984] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:06 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:25:07.861507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-4ec7c415-367d-47c2-99f9-66a8f3788766 req-344a6027-7afe-4281-b3ad-5b2a8f60184b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f77fadd-7385-4c0c-adda-dde9bcf4a47a", "name": "network-vif-plugged", "status": "completed", "tag": "6444656b-963f-4b5d-9b23-d4d430abc293"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:25:07.883876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4ec7c415-367d-47c2-99f9-66a8f3788766 req-344a6027-7afe-4281-b3ad-5b2a8f60184b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:07.886036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4ec7c415-367d-47c2-99f9-66a8f3788766 req-344a6027-7afe-4281-b3ad-5b2a8f60184b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:07.889038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4ec7c415-367d-47c2-99f9-66a8f3788766 req-344a6027-7afe-4281-b3ad-5b2a8f60184b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:07.906653 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-4ec7c415-367d-47c2-99f9-66a8f3788766 req-344a6027-7afe-4281-b3ad-5b2a8f60184b service nova] Creating event network-vif-plugged:6444656b-963f-4b5d-9b23-d4d430abc293 for instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a on n-h2-854441-12 Oct 17 16:25:07.914113 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-4ec7c415-367d-47c2-99f9-66a8f3788766 req-344a6027-7afe-4281-b3ad-5b2a8f60184b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057572 Oct 17 16:25:07.915026 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3354/6985] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:25:08.052830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:08.053515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:08.063214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:08.063989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:08.064675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:08.065796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:08.066325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:08.066924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:08.241620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:08.254126 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4e574245-fd3e-463a-8d91-5179d49363a0 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1501 microversion: 2.1 time: 0.206784 Oct 17 16:25:08.254818 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3632/6986] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:08 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:09.054557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9e0e6802-e358-42a9-9050-8e0dc6830389 req-11e3af69-d993-47d2-b5c2-6709c792f070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f77fadd-7385-4c0c-adda-dde9bcf4a47a", "name": "network-vif-deleted", "tag": "6444656b-963f-4b5d-9b23-d4d430abc293"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:25:09.068308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e0e6802-e358-42a9-9050-8e0dc6830389 req-11e3af69-d993-47d2-b5c2-6709c792f070 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:09.068818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e0e6802-e358-42a9-9050-8e0dc6830389 req-11e3af69-d993-47d2-b5c2-6709c792f070 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:09.069313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9e0e6802-e358-42a9-9050-8e0dc6830389 req-11e3af69-d993-47d2-b5c2-6709c792f070 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:09.087524 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9e0e6802-e358-42a9-9050-8e0dc6830389 req-11e3af69-d993-47d2-b5c2-6709c792f070 service nova] Creating event network-vif-deleted:6444656b-963f-4b5d-9b23-d4d430abc293 for instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a on n-h2-854441-12 Oct 17 16:25:09.095841 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9e0e6802-e358-42a9-9050-8e0dc6830389 req-11e3af69-d993-47d2-b5c2-6709c792f070 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045097 Oct 17 16:25:09.097130 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3355/6987] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:25:09.279235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:09.279795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:09.287426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:09.290427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:09.290427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:09.290427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:09.290427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:09.290427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:09.329447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:09.329974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:09.330563 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:09.331230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lazy-loading 'fault' on Instance uuid 6f77fadd-7385-4c0c-adda-dde9bcf4a47a {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:25:09.402418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427a17e14e0c41cf9b46d52e429a969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b59c23edd5468bb72cd3a7dd0dd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:09.410796 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df0e7a8b-2d84-4f3f-900f-31b762fba142 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 200 len: 1305 microversion: 2.1 time: 0.135217 Oct 17 16:25:09.411472 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3633/6988] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:09 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 1305 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:10.437504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:10.438339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:10.446232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:10.446822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:10.447337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:10.448207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:10.448692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:10.449135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:10.465875 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] HTTP exception thrown: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Request method failure captured: Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a HTTP/1.1 Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYGz6KbtASpPZuh9dhCdTpjJwbaCCEevLpscWNhTVJB6hRu3HG__x3T9SGsdCnaY3yjFLC2g281j8hFEHH-nS6wAIF2QZf7lYb4isoIJb1hsA_8UUVpZ9ZwnCY3F0ldf1PojBeFLgFx2yPZG06lLyvoW22nVKYI3Vk9AHnwEskyZoyw Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 79b59c23edd5468bb72cd3a7dd0dd717 Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersTestJSON-922656205 Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersTestJSON-922656205 Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 79b59c23edd5468bb72cd3a7dd0dd717 Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersTestJSON-922656205 Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersTestJSON-922656205-project Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 427a17e14e0c41cf9b46d52e429a969a Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersTestJSON-922656205-project Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6f77fadd-7385-4c0c-adda-dde9bcf4a47a'} Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:25:10.467872 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Returning 404 to user: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5a902e81-7f34-4703-82c1-f8c96e8d8a4e tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 404 len: 111 microversion: 2.1 time: 0.037648 Oct 17 16:25:10.472739 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3356/6989] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:10 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:25:10.490909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:10.491671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:10.503608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:10.504443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:10.505085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:10.506482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:10.507214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:10.507847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:10.530325 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] HTTP exception thrown: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Request method failure captured: Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a HTTP/1.1 Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYGz6KbtASpPZuh9dhCdTpjJwbaCCEevLpscWNhTVJB6hRu3HG__x3T9SGsdCnaY3yjFLC2g281j8hFEHH-nS6wAIF2QZf7lYb4isoIJb1hsA_8UUVpZ9ZwnCY3F0ldf1PojBeFLgFx2yPZG06lLyvoW22nVKYI3Vk9AHnwEskyZoyw Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 79b59c23edd5468bb72cd3a7dd0dd717 Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-DeleteServersTestJSON-922656205 Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-DeleteServersTestJSON-922656205 Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 79b59c23edd5468bb72cd3a7dd0dd717 Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-DeleteServersTestJSON-922656205 Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-DeleteServersTestJSON-922656205-project Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 427a17e14e0c41cf9b46d52e429a969a Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-DeleteServersTestJSON-922656205-project Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6f77fadd-7385-4c0c-adda-dde9bcf4a47a'} Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:25:10.532096 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Returning 404 to user: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fdb2adc4-5de2-4084-abe6-22b1c11d11b2 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 404 len: 111 microversion: 2.1 time: 0.049901 Oct 17 16:25:10.536893 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3634/6990] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:25:10 2022] DELETE /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:25:10.544427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:10.545262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] [instance: 6f77fadd-7385-4c0c-adda-dde9bcf4a47a] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:10.552196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:10.552725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:10.553178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:10.553918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:10.554386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:10.554877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:10.571154 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] HTTP exception thrown: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Request method failure captured: Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a HTTP/1.1 Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYGz6KbtASpPZuh9dhCdTpjJwbaCCEevLpscWNhTVJB6hRu3HG__x3T9SGsdCnaY3yjFLC2g281j8hFEHH-nS6wAIF2QZf7lYb4isoIJb1hsA_8UUVpZ9ZwnCY3F0ldf1PojBeFLgFx2yPZG06lLyvoW22nVKYI3Vk9AHnwEskyZoyw Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 79b59c23edd5468bb72cd3a7dd0dd717 Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-DeleteServersTestJSON-922656205 Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/79b59c23edd5468bb72cd3a7dd0dd717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-DeleteServersTestJSON-922656205 Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 79b59c23edd5468bb72cd3a7dd0dd717 Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-DeleteServersTestJSON-922656205 Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-DeleteServersTestJSON-922656205-project Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 427a17e14e0c41cf9b46d52e429a969a Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-DeleteServersTestJSON-922656205-project Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6f77fadd-7385-4c0c-adda-dde9bcf4a47a'} Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:25:10.573082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.577381 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:25:10.577381 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:25:10.577381 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:25:10.577381 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:25:10.577381 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:25:10.577381 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. Oct 17 16:25:10.577381 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:25:10.577381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] Returning 404 to user: Instance 6f77fadd-7385-4c0c-adda-dde9bcf4a47a could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:25:10.577921 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9962f046-2ed5-409b-aec3-2bba75f965c3 tempest-DeleteServersTestJSON-922656205 tempest-DeleteServersTestJSON-922656205-project] 10.222.0.87 "GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a" status: 404 len: 111 microversion: 2.1 time: 0.037649 Oct 17 16:25:10.579273 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3357/6991] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:10 2022] GET /compute/v2.1/servers/6f77fadd-7385-4c0c-adda-dde9bcf4a47a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:25:21.753127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=19 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:21.755610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=65 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:21.909012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-410181152", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "bb887643-dcf4-4065-b829-cb15aee7eaf6"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:25:21.975773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] validate_networks() for [('bb887643-dcf4-4065-b829-cb15aee7eaf6', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:25:22.427028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:25:22.427755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:25:22.428653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:25:22.429410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:25:22.430145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:25:22.446162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:22.447094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:22.447853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:22.449170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:22.449965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:22.450755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:22.484236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Getting quotas for project 7fdc55cf759546ff9959237886aec71b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:25:22.491090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Getting quotas for user abbe475c15af46189d55f43817a72c3e and project 7fdc55cf759546ff9959237886aec71b. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:25:22.509752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:25:22.512990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:25:22.574454 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a57b061-7466-4b35-a91b-be56eb4b37e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832361 Oct 17 16:25:22.575466 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3635/6992] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:25:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:25:22.595937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ead3a4a3-9755-414d-bd51-c77fc0ac416a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:22.598099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ead3a4a3-9755-414d-bd51-c77fc0ac416a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:22.604526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:22.605862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:22.747928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ead3a4a3-9755-414d-bd51-c77fc0ac416a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:22.763127 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ead3a4a3-9755-414d-bd51-c77fc0ac416a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1217 microversion: 2.1 time: 0.174333 Oct 17 16:25:22.779633 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3358/6993] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:22 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:23.803128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:23.804308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:23.816583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:23.817252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:23.818210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:23.819614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:23.820554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:23.821335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:23.917725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:23.936883 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f43d3a86-2ab9-49ae-a090-117a7550ca3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1269 microversion: 2.1 time: 0.141493 Oct 17 16:25:23.938657 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3636/6994] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:23 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1269 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:24.977727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:24.978590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:24.992305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:25.002009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:25.003114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:25.004713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:25.006006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:25.006700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:25.445457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:25.460702 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1bc67fdb-515e-431d-be9a-249ac7d1a73b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1317 microversion: 2.1 time: 0.486933 Oct 17 16:25:25.461816 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3359/6995] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:24 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:26.305883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e713a78e-9f76-4c70-b967-e78dfaf650ea req-dd69d81e-b8ff-4f00-b335-bae76bef7c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4b729d-628f-4fb9-9103-ab7fcbde58fc", "tag": "87efcfcd-1192-4027-b66d-cb6abab4d4d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:25:26.328205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e713a78e-9f76-4c70-b967-e78dfaf650ea req-dd69d81e-b8ff-4f00-b335-bae76bef7c98 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:26.329103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e713a78e-9f76-4c70-b967-e78dfaf650ea req-dd69d81e-b8ff-4f00-b335-bae76bef7c98 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:26.330136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e713a78e-9f76-4c70-b967-e78dfaf650ea req-dd69d81e-b8ff-4f00-b335-bae76bef7c98 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:26.359754 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e713a78e-9f76-4c70-b967-e78dfaf650ea req-dd69d81e-b8ff-4f00-b335-bae76bef7c98 service nova] Creating event network-changed:87efcfcd-1192-4027-b66d-cb6abab4d4d9 for instance df4b729d-628f-4fb9-9103-ab7fcbde58fc on n-h2-854441-12 Oct 17 16:25:26.368562 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e713a78e-9f76-4c70-b967-e78dfaf650ea req-dd69d81e-b8ff-4f00-b335-bae76bef7c98 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068030 Oct 17 16:25:26.370275 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3637/6996] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:25:26.488883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:26.489927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:26.501158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:26.502125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:26.502945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:26.504178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:26.504973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:26.506094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:26.858132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:26.874723 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-63d7295d-4498-4039-b70e-822501a281c0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1317 microversion: 2.1 time: 0.391686 Oct 17 16:25:26.876132 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3360/6997] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:26 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:27.910729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:27.911791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:27.919572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:27.920387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:27.920938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:27.921808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:27.922399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:27.922960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:28.105031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:28.119353 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58ce5bbf-0709-4daa-b29e-8001da68891c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1317 microversion: 2.1 time: 0.213014 Oct 17 16:25:28.121379 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3638/6998] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:27 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:29.158205 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:29.158886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:29.166720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:29.167379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:29.167920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:29.168749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:29.169227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:29.169641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:29.322168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:29.331309 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6f084d0-a808-46a1-b455-84a032c8a1e7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1317 microversion: 2.1 time: 0.177302 Oct 17 16:25:29.331922 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3361/6999] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:29 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:29.968747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-38ac4b00-e52b-4ff3-b48a-10ed85956e6c req-52170ff1-e4ee-4349-913b-c95e78419948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4b729d-628f-4fb9-9103-ab7fcbde58fc", "name": "network-vif-plugged", "status": "completed", "tag": "87efcfcd-1192-4027-b66d-cb6abab4d4d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:25:29.980521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38ac4b00-e52b-4ff3-b48a-10ed85956e6c req-52170ff1-e4ee-4349-913b-c95e78419948 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:29.981102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38ac4b00-e52b-4ff3-b48a-10ed85956e6c req-52170ff1-e4ee-4349-913b-c95e78419948 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:29.981747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-38ac4b00-e52b-4ff3-b48a-10ed85956e6c req-52170ff1-e4ee-4349-913b-c95e78419948 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:29.995679 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-38ac4b00-e52b-4ff3-b48a-10ed85956e6c req-52170ff1-e4ee-4349-913b-c95e78419948 service nova] Creating event network-vif-plugged:87efcfcd-1192-4027-b66d-cb6abab4d4d9 for instance df4b729d-628f-4fb9-9103-ab7fcbde58fc on n-h2-854441-12 Oct 17 16:25:30.002282 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-38ac4b00-e52b-4ff3-b48a-10ed85956e6c req-52170ff1-e4ee-4349-913b-c95e78419948 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037645 Oct 17 16:25:30.003013 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3639/7000] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:25:30.356206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:30.356954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:30.364794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:30.365314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:30.365763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:30.366531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:30.367005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:30.367450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:30.523429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:30.533862 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f083096-b742-4fdc-b8cd-1a3eda5896ed tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1317 microversion: 2.1 time: 0.181760 Oct 17 16:25:30.534434 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3362/7001] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:30 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:31.558353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:31.559036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:31.566620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:31.567121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:31.567590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:31.568345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:31.568807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:31.569245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:31.743364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:31.752970 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a508d4b6-b1ff-4c13-b02d-dc2df3b4d6a8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1508 microversion: 2.1 time: 0.200169 Oct 17 16:25:31.753606 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3640/7002] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:31 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:31.777425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:31.778132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:31.787546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:31.788064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:31.788525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:31.789291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:31.789773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:31.790234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:31.945492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:31.954486 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6de5235e-fd44-4bf5-b06e-dad7462e392c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1508 microversion: 2.1 time: 0.181196 Oct 17 16:25:31.955273 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3363/7003] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:31 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:31.978345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33478c7c-9293-447e-bfb5-5b17f8316ed7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:25:31.980999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33478c7c-9293-447e-bfb5-5b17f8316ed7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:31.988249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33478c7c-9293-447e-bfb5-5b17f8316ed7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:31.988889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33478c7c-9293-447e-bfb5-5b17f8316ed7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:31.989436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33478c7c-9293-447e-bfb5-5b17f8316ed7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:31.990292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33478c7c-9293-447e-bfb5-5b17f8316ed7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:31.990918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33478c7c-9293-447e-bfb5-5b17f8316ed7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:31.991518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33478c7c-9293-447e-bfb5-5b17f8316ed7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:32.065126 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33478c7c-9293-447e-bfb5-5b17f8316ed7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "PUT /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1080 microversion: 2.1 time: 0.090781 Oct 17 16:25:32.065813 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3641/7004] 10.222.0.87 () {60 vars in 1256 bytes} [Mon Oct 17 16:25:31 2022] PUT /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1080 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:25:32.089273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:32.091021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:32.098959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:32.099632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:32.100241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:32.101073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:32.101595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:32.102163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:32.260658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:32.276321 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0e551a15-fa96-4875-825a-7b85589c27b3 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1506 microversion: 2.1 time: 0.193564 Oct 17 16:25:32.277543 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3364/7005] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:32 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:32.316156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:32.317309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:32.328423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:32.329310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:32.330106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:32.331783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:32.332668 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:32.333449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:32.466480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:32.500197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:32.504064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:32.513057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-526f03a8-bac9-42ac-917b-1cefcc6c0f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1506 microversion: 2.1 time: 0.204638 Oct 17 16:25:32.513679 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3642/7006] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:32 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:32.556425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:25:32.560675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:32.571768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:32.572646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:32.573439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:32.574744 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:32.575583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:32.576374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:32.634844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:32.646786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Old instance type m1.heat2, new instance type m1.heat {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:25:32.660580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:25:32.661380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:25:32.662291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:25:32.663088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:25:32.663856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:25:32.753483 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9096df99-453f-45b2-be33-b2b106b77798 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "POST /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc/action" status: 202 len: 0 microversion: 2.1 time: 0.204077 Oct 17 16:25:32.754052 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3365/7007] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:25:32 2022] POST /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:25:32.763682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:32.764554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:32.772498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:32.773001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:32.773440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:32.774178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:32.774691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:32.775121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:32.935820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:32.949459 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54756c2d-e725-43bb-8171-843252c8dcda tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1517 microversion: 2.1 time: 0.190147 Oct 17 16:25:32.950282 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3643/7008] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:32 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1517 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:25:33.976232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:33.982925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:33.983795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:33.993671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:33.994333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:33.996333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:33.997146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:33.997632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:33.998259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:34.169527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:34.178268 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2cf3cf57-cbca-44cd-b187-7fb08f570a14 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1517 microversion: 2.1 time: 0.202950 Oct 17 16:25:34.178919 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3366/7009] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:33 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:35.201867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:35.202760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:35.210597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:35.211098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:35.211539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:35.212268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:35.212725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:35.213148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:35.370919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:35.380697 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1e750986-f73f-4100-ac8c-b830937bd68a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.182653 Oct 17 16:25:35.381310 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3644/7010] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:35 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:36.406483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:36.407234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:36.415516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:36.416074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:36.416530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:36.417257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:36.417768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:36.418258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:36.575644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:36.590159 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e6a2200d-62ec-4b89-bf7e-59bf388aadd6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.187737 Oct 17 16:25:36.591020 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3367/7011] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:36 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:37.618122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:37.618823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:37.627158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:37.627676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:37.628120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:37.628857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:37.629324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:37.629781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:37.783754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:37.792529 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45e14ea2-4f79-4bda-9ede-badc1450939d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.178602 Oct 17 16:25:37.793169 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3645/7012] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:37 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:38.818267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:38.819093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:38.827825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:38.828374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:38.828842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:38.829772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:38.830251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:38.830737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:38.988136 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:38.997143 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-25972137-498f-4f99-af8c-4687f9ed65e6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.183536 Oct 17 16:25:38.997847 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3368/7013] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:38 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:40.041092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:40.042231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:40.056083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:40.056965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:40.057728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:40.059040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:40.059867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:40.060690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:40.222451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:40.231065 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93bc4cc0-6e37-434e-83aa-9e5c4db49c3c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.197672 Oct 17 16:25:40.231771 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3646/7014] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:40 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:41.257621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:41.258606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:41.266859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:41.267416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:41.267874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:41.268645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:41.269123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:41.269580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:41.432320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:41.441637 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-24f3d0a8-e87d-4d71-beb3-6391be730cd1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.188567 Oct 17 16:25:41.442251 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3369/7015] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:41 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:42.466894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:42.467697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:42.475850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:42.476356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:42.476806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:42.477560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:42.478034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:42.478447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:42.647344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:42.657139 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d9e820ea-7865-49df-9053-4e3db17cb4a4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.195427 Oct 17 16:25:42.658052 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3647/7016] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:42 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:43.681789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:43.682472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:43.690936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:43.691496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:43.691961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:43.692709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:43.693188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:43.693638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:43.873934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:43.883443 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee64f5e6-84f0-4fa9-a2d0-0fcbc2b367ee tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.205644 Oct 17 16:25:43.884077 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3370/7017] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:43 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:25:44.909720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:44.910334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:44.918082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:44.918595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:44.919032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:44.919762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:44.920220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:44.920639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:45.110026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:45.122992 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0b30b666-0d98-47e8-aa20-c6c630db291c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.217574 Oct 17 16:25:45.124030 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3648/7018] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:44 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:25:46.148886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:46.149589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:46.158003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:46.158530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:46.159001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:46.159733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:46.160194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:46.160630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:46.314735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:46.323585 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5feec83-82d3-4676-b685-6588e47dda63 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.178794 Oct 17 16:25:46.324416 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3371/7019] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:46 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:25:47.352391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:47.353145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:47.360779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:47.361295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:47.361734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:47.362431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:47.362933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:47.363362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:47.527969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:47.536616 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89e4a420-f882-46a6-91ad-d2a33f22b525 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.188163 Oct 17 16:25:47.537213 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3649/7020] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:47 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:48.560973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:48.562002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:48.572288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:48.572865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:48.573346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:48.574172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:48.574905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:48.575456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:48.735362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:48.744973 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-71f57223-f40d-4b06-ad9e-73f803158c29 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.188653 Oct 17 16:25:48.745584 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3372/7021] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:48 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:49.770369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:49.771277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:49.780336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:49.780904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:49.781389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:49.782225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:49.782764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:49.783224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:49.955115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:49.967219 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-647711e5-12e9-445d-9ccf-9e7d95e668f6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.201793 Oct 17 16:25:49.967819 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3650/7022] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:49 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:50.992021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:50.993091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:51.002462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:51.003131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:51.003695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:51.004495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:51.005336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:51.005830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:51.161135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:51.170644 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ecabc72-3c53-4227-a3d5-cb7dff904f80 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.182790 Oct 17 16:25:51.171252 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3373/7023] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:50 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:52.196103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:52.196763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:52.199772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:52.206936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:52.207581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:52.208045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:52.208812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:52.209258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:52.209705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:52.213812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:52.371422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:52.379696 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31524b97-8a25-497a-8213-a4a321a4c14c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.187693 Oct 17 16:25:52.380677 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3651/7024] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:52 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:53.405238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:53.406060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:53.409254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=39 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:53.418818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:53.419667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:53.420384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:53.421657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:53.422448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:53.423203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:53.431012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:25:53.606231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:53.615033 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-25bd3294-c823-4a5a-8a1c-289e90297a15 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.214296 Oct 17 16:25:53.615643 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3374/7025] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:53 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:54.642529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:54.643539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:54.657306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:54.658359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:54.659396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:54.660931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:54.661765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:54.662551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:54.845216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:54.854905 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-aac1ebdb-dec7-495f-a503-d7b2cafaa68b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.219560 Oct 17 16:25:54.855529 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3652/7026] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:54 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:55.879645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:55.880715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:55.888403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:55.889006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:55.889508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:55.890408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:55.890988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:55.891529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:56.049672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:56.064249 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-54a7351d-d1a6-4636-82cc-89b72e5ebe34 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.188519 Oct 17 16:25:56.065420 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3375/7027] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:55 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:57.088828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:57.089496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:57.097035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:57.097507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:57.097971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:57.098730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:57.099187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:57.099615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:57.243584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:57.252416 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-77a4b8d3-387e-4fbc-8345-09558c11ed8b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.167729 Oct 17 16:25:57.253032 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3653/7028] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:57 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:58.277724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:58.278529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:58.286520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:58.287127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:58.287599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:58.288362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:58.288951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:58.289414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:58.450850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:58.459946 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-56defa0c-4ec1-4fd8-8eb8-ce2338e932a5 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.186919 Oct 17 16:25:58.460567 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3376/7029] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:58 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:25:59.487288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:25:59.488385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:25:59.500199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:59.501204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:59.501890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:59.503059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:25:59.503786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:25:59.504452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:25:59.683048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:25:59.692796 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-deadcfa1-e36c-449f-b51d-c74d4de1738d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.212060 Oct 17 16:25:59.693425 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3654/7030] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:25:59 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:00.717257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:00.717884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:00.726103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:00.726663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:00.727128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:00.727895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:00.728410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:00.728844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:00.881843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:00.891950 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fdc31ec6-f2d4-4c88-8b80-a1a1bc4df851 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.178801 Oct 17 16:26:00.892623 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3377/7031] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:00 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:01.932766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:01.933372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:01.941021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:01.941526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:01.941972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:01.942757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:01.943220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:01.943651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:02.093602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:02.107028 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-88b37dcb-e415-4cd3-837e-cb6340e6cc65 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.177982 Oct 17 16:26:02.108022 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3655/7032] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:01 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:03.132102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:03.132832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:03.141483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:03.142010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:03.142468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:03.143262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:03.143740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:03.144187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:03.316950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:03.326238 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b60b30ea-0f23-459c-b4af-e8e9395b2302 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.198565 Oct 17 16:26:03.326904 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3378/7033] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:03 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:04.362028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:04.362933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:04.370692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:04.371199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:04.371632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:04.372357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:04.372821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:04.373258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:04.539298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:04.548388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ac61739f-0625-46d3-abcd-786877946bfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.190481 Oct 17 16:26:04.549102 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3656/7034] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:04 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:05.577557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:05.578875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:05.587869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:05.588390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:05.588876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:05.589877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:05.590119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:05.590591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:05.738890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:05.748034 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f8eb04f3-b6fd-4347-b8b1-4d994c64567e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.178517 Oct 17 16:26:05.748682 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3379/7035] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:05 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:06.772721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:06.773496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:06.781295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:06.781798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:06.782342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:06.783093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:06.783537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:06.783948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:06.936472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:06.945357 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b09bea4-42e1-421f-a78b-2aab080712ec tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1522 microversion: 2.1 time: 0.176578 Oct 17 16:26:06.946649 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3657/7036] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:06 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:07.708684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c023b1d9-6e7e-4e6f-9c4a-5e7486cf0b12 req-983f4ee2-6466-4b47-9b34-8d827103f2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4b729d-628f-4fb9-9103-ab7fcbde58fc", "name": "network-vif-unplugged", "status": "completed", "tag": "87efcfcd-1192-4027-b66d-cb6abab4d4d9"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:07.729074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c023b1d9-6e7e-4e6f-9c4a-5e7486cf0b12 req-983f4ee2-6466-4b47-9b34-8d827103f2b2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:07.729926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c023b1d9-6e7e-4e6f-9c4a-5e7486cf0b12 req-983f4ee2-6466-4b47-9b34-8d827103f2b2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:07.730771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c023b1d9-6e7e-4e6f-9c4a-5e7486cf0b12 req-983f4ee2-6466-4b47-9b34-8d827103f2b2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:07.751734 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c023b1d9-6e7e-4e6f-9c4a-5e7486cf0b12 req-983f4ee2-6466-4b47-9b34-8d827103f2b2 service nova] Creating event network-vif-unplugged:87efcfcd-1192-4027-b66d-cb6abab4d4d9 for instance df4b729d-628f-4fb9-9103-ab7fcbde58fc on n-h1-854441-12 Oct 17 16:26:07.759664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-c023b1d9-6e7e-4e6f-9c4a-5e7486cf0b12 req-983f4ee2-6466-4b47-9b34-8d827103f2b2 service nova] Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:26:07.774351 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c023b1d9-6e7e-4e6f-9c4a-5e7486cf0b12 req-983f4ee2-6466-4b47-9b34-8d827103f2b2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070511 Oct 17 16:26:07.775273 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3380/7037] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:26:07.970275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:07.971227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:07.980211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:07.980756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:07.981206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:07.981958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:07.982435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:07.982901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:08.197729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:08.206463 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2de521c5-65fe-4962-a445-6f6f35b27633 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1521 microversion: 2.1 time: 0.240547 Oct 17 16:26:08.207116 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3658/7038] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:07 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:09.245375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:09.246753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:09.256073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:09.256713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:09.257204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:09.258027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:09.258545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:09.259138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:09.411485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:09.420498 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ffb7924c-ba8d-4c25-acea-a4f9da92c598 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1519 microversion: 2.1 time: 0.179653 Oct 17 16:26:09.421128 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3381/7039] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:09 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:09.793508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f2929bf0-c204-4a82-81a0-1400a97634ae req-6b8f36c1-c0a3-454e-8301-3bfcd2522ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4b729d-628f-4fb9-9103-ab7fcbde58fc", "tag": "87efcfcd-1192-4027-b66d-cb6abab4d4d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:09.805553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f2929bf0-c204-4a82-81a0-1400a97634ae req-6b8f36c1-c0a3-454e-8301-3bfcd2522ad0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:09.806048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f2929bf0-c204-4a82-81a0-1400a97634ae req-6b8f36c1-c0a3-454e-8301-3bfcd2522ad0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:09.806490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f2929bf0-c204-4a82-81a0-1400a97634ae req-6b8f36c1-c0a3-454e-8301-3bfcd2522ad0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:09.820561 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f2929bf0-c204-4a82-81a0-1400a97634ae req-6b8f36c1-c0a3-454e-8301-3bfcd2522ad0 service nova] Creating event network-changed:87efcfcd-1192-4027-b66d-cb6abab4d4d9 for instance df4b729d-628f-4fb9-9103-ab7fcbde58fc on n-h1-854441-12 Oct 17 16:26:09.827212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-f2929bf0-c204-4a82-81a0-1400a97634ae req-6b8f36c1-c0a3-454e-8301-3bfcd2522ad0 service nova] Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:26:09.839908 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f2929bf0-c204-4a82-81a0-1400a97634ae req-6b8f36c1-c0a3-454e-8301-3bfcd2522ad0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050261 Oct 17 16:26:09.840554 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3659/7040] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:26:10.466038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:10.467185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:10.480279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:10.481232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:10.481943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:10.483116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:10.483856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:10.484622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:10.687310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:10.706060 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bbddc473-9128-42c4-badf-99be412875bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1519 microversion: 2.1 time: 0.247387 Oct 17 16:26:10.707628 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3382/7041] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:10 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:11.750064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:11.751256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:11.762151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:11.763042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:11.763809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:11.765058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:11.765886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:11.766764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:11.951778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:11.960604 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78f418cd-4a8a-40db-9315-f04e240c34df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1516 microversion: 2.1 time: 0.219314 Oct 17 16:26:11.961207 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3660/7042] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:11 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:12.004132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c2380a6c-860f-4c88-87b7-79b604a8ad83 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:12.005435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c2380a6c-860f-4c88-87b7-79b604a8ad83 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:12.018248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2380a6c-860f-4c88-87b7-79b604a8ad83 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:12.019168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2380a6c-860f-4c88-87b7-79b604a8ad83 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:12.019951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2380a6c-860f-4c88-87b7-79b604a8ad83 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:12.021246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2380a6c-860f-4c88-87b7-79b604a8ad83 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:12.022065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2380a6c-860f-4c88-87b7-79b604a8ad83 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:12.022875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c2380a6c-860f-4c88-87b7-79b604a8ad83 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:12.095369 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c2380a6c-860f-4c88-87b7-79b604a8ad83 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "POST /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc/action" status: 204 len: 0 microversion: 2.1 time: 0.099380 Oct 17 16:26:12.096069 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3383/7043] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:26:11 2022] POST /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc/action => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:26:12.104826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:12.105462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:12.112198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:12.112700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:12.113143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:12.113857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:12.114310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:12.114756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:12.319817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:12.329585 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dea42f3d-e567-4ca5-8b3b-09bd63bc2b05 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1516 microversion: 2.1 time: 0.228726 Oct 17 16:26:12.330220 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3661/7044] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:12 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:13.355612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:13.356213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:13.364402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:13.364909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:13.365497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:13.366272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:13.366797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:13.367208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:13.614721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:13.630461 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-75bedcfa-2655-4a2e-b559-c2b7bbe253bc tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1516 microversion: 2.1 time: 0.279094 Oct 17 16:26:13.631555 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3384/7045] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:13 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:26:14.660359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:14.661010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:14.669079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:14.669577 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:14.670023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:14.670796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:14.671273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:14.671709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:14.917427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:14.926289 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1e3cf27-83e2-46f7-a6bf-a008ab7a5080 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1508 microversion: 2.1 time: 0.270193 Oct 17 16:26:14.927042 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3662/7046] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:14 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:14.953337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:14.954121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:14.963217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:14.964039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:14.964747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:14.965807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:14.966490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:14.967182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:15.124337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:15.135690 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e78a5e95-cb9f-4ebc-9798-d110a4d3c56f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1508 microversion: 2.1 time: 0.186321 Oct 17 16:26:15.136552 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3385/7047] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:14 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:26:15.168590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b34e5eef-bdde-41b4-bd49-80f7d5ac0e0f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Action: 'create', calling method: .version_select at 0x7f28be029f70>, body: {"keypair": {"name": "tempest-keypair-1525508430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7NBDqa2rvf87ihjdTbAyDjDGxeJHzwfLu4DHyIXUdPBI4sP6n8Em9qVA8omwOnzctHzsVuNWOjYmaTCcoTBLYqlkZ7US9u2sFtBEu0HP8UtfBCzk8k88p0xAslhtMSxg=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:15.188196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b34e5eef-bdde-41b4-bd49-80f7d5ac0e0f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Getting quotas for project 7fdc55cf759546ff9959237886aec71b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:26:15.194185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-b34e5eef-bdde-41b4-bd49-80f7d5ac0e0f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Getting quotas for user abbe475c15af46189d55f43817a72c3e and project 7fdc55cf759546ff9959237886aec71b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:26:15.210461 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b34e5eef-bdde-41b4-bd49-80f7d5ac0e0f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [36474296-f7ff-4acf-9067-e7a2c30eb8a3] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:26:16.105872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-7ef4abfc-0c54-4882-989b-e6f65b9df13a req-2f782305-ce5f-4382-ad4a-8a6b93963a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4b729d-628f-4fb9-9103-ab7fcbde58fc", "name": "network-vif-plugged", "status": "completed", "tag": "87efcfcd-1192-4027-b66d-cb6abab4d4d9"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:16.125343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7ef4abfc-0c54-4882-989b-e6f65b9df13a req-2f782305-ce5f-4382-ad4a-8a6b93963a9f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:16.126247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7ef4abfc-0c54-4882-989b-e6f65b9df13a req-2f782305-ce5f-4382-ad4a-8a6b93963a9f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:16.127077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-7ef4abfc-0c54-4882-989b-e6f65b9df13a req-2f782305-ce5f-4382-ad4a-8a6b93963a9f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:16.148724 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-7ef4abfc-0c54-4882-989b-e6f65b9df13a req-2f782305-ce5f-4382-ad4a-8a6b93963a9f service nova] Creating event network-vif-plugged:87efcfcd-1192-4027-b66d-cb6abab4d4d9 for instance df4b729d-628f-4fb9-9103-ab7fcbde58fc on n-h1-854441-12 Oct 17 16:26:16.157186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-7ef4abfc-0c54-4882-989b-e6f65b9df13a req-2f782305-ce5f-4382-ad4a-8a6b93963a9f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058379 Oct 17 16:26:16.158196 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3386/7048] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:26:16.221135 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-b34e5eef-bdde-41b4-bd49-80f7d5ac0e0f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [36474296-f7ff-4acf-9067-e7a2c30eb8a3] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 38848. Oct 17 16:26:16.241602 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b34e5eef-bdde-41b4-bd49-80f7d5ac0e0f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.079425 Oct 17 16:26:16.242251 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3663/7049] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:26:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:26:17.827721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:17.828615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:17.836812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:17.837646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:17.838149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:17.838980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:17.839573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:17.840062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:18.025052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:18.034230 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0ec9e60d-a20e-4b1d-8472-076b436d9fa1 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 200 len: 1508 microversion: 2.1 time: 0.211924 Oct 17 16:26:18.034883 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3387/7050] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:17 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:18.059665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:18.060277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:18.067561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:18.068069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:18.068543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:18.069272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:18.069735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:18.070167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:18.102642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:26:18.202376 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-107a3946-a43b-4234-a05f-112ab849a76c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "DELETE /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 204 len: 0 microversion: 2.1 time: 0.148075 Oct 17 16:26:18.203501 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3664/7051] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:26:18 2022] DELETE /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:26:18.277540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1055271798", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "bb887643-dcf4-4065-b829-cb15aee7eaf6"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:18.339942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] validate_networks() for [('bb887643-dcf4-4065-b829-cb15aee7eaf6', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:26:18.841954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:26:18.842654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:26:18.842944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:26:18.843369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:26:18.843801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:26:18.854626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:18.855146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:18.855610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:18.856359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:18.856829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:18.857271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:18.877632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Getting quotas for project 7fdc55cf759546ff9959237886aec71b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:26:18.884208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Getting quotas for user abbe475c15af46189d55f43817a72c3e and project 7fdc55cf759546ff9959237886aec71b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:26:18.898460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:26:18.900907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:26:18.952831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a06be4e-00a2-427f-858b-c3e827c3c5c6 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679622 Oct 17 16:26:18.958031 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3388/7052] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:26:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:26:18.967249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d9df261-74ab-41bc-a295-8687fb860ce9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:18.968137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d9df261-74ab-41bc-a295-8687fb860ce9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:19.041837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d9df261-74ab-41bc-a295-8687fb860ce9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:19.050892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d9df261-74ab-41bc-a295-8687fb860ce9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1218 microversion: 2.1 time: 0.089159 Oct 17 16:26:19.051867 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3665/7053] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:18 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:20.082910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:20.085078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:20.111926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:20.113258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:20.114763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:20.115978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:20.116645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:20.117269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:20.126094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-190e2b09-f460-4af5-8ec1-07f42b98205e req-70d280ed-13ba-4697-9ad9-9df87ccc7416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4b729d-628f-4fb9-9103-ab7fcbde58fc", "name": "network-vif-deleted", "tag": "87efcfcd-1192-4027-b66d-cb6abab4d4d9"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:20.164406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-190e2b09-f460-4af5-8ec1-07f42b98205e req-70d280ed-13ba-4697-9ad9-9df87ccc7416 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:20.171315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-190e2b09-f460-4af5-8ec1-07f42b98205e req-70d280ed-13ba-4697-9ad9-9df87ccc7416 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:20.172089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-190e2b09-f460-4af5-8ec1-07f42b98205e req-70d280ed-13ba-4697-9ad9-9df87ccc7416 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:20.199977 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-190e2b09-f460-4af5-8ec1-07f42b98205e req-70d280ed-13ba-4697-9ad9-9df87ccc7416 service nova] Creating event network-vif-deleted:87efcfcd-1192-4027-b66d-cb6abab4d4d9 for instance df4b729d-628f-4fb9-9103-ab7fcbde58fc on n-h1-854441-12 Oct 17 16:26:20.210851 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-190e2b09-f460-4af5-8ec1-07f42b98205e req-70d280ed-13ba-4697-9ad9-9df87ccc7416 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093244 Oct 17 16:26:20.212589 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3666/7054] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:26:20.247673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:20.259532 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5de10644-bd29-4a5a-b04b-540742e70064 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1270 microversion: 2.1 time: 0.186412 Oct 17 16:26:20.261021 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3389/7055] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:20 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1270 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:21.298555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:21.299374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:21.306262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:21.306895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:21.307412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:21.308215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:21.308796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:21.309269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:21.496060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:21.513348 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6513ca1f-d04f-4114-82fd-80974425d10b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1318 microversion: 2.1 time: 0.220233 Oct 17 16:26:21.515139 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3667/7056] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:21 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:26:22.256190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-01622f26-b9c5-4186-9c7b-2a3efd9705f4 req-506f5936-8686-471d-ad62-27f408c78b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9f76089-e7f2-44e5-9541-50154a0dc9ef", "tag": "60cd2089-26f4-47e7-8c1b-bb177802f96c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:22.274313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-01622f26-b9c5-4186-9c7b-2a3efd9705f4 req-506f5936-8686-471d-ad62-27f408c78b6c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:22.274861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-01622f26-b9c5-4186-9c7b-2a3efd9705f4 req-506f5936-8686-471d-ad62-27f408c78b6c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:22.275310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-01622f26-b9c5-4186-9c7b-2a3efd9705f4 req-506f5936-8686-471d-ad62-27f408c78b6c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:22.288717 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-01622f26-b9c5-4186-9c7b-2a3efd9705f4 req-506f5936-8686-471d-ad62-27f408c78b6c service nova] Creating event network-changed:60cd2089-26f4-47e7-8c1b-bb177802f96c for instance f9f76089-e7f2-44e5-9541-50154a0dc9ef on n-h1-854441-12 Oct 17 16:26:22.294653 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-01622f26-b9c5-4186-9c7b-2a3efd9705f4 req-506f5936-8686-471d-ad62-27f408c78b6c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046263 Oct 17 16:26:22.295508 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3390/7057] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:26:22.541428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:22.542739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:22.550206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:22.557961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:22.558831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:22.559644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:22.561068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:22.561722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:22.562469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:22.573526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:22.815106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:22.825974 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b999f5f-d42b-4572-af46-14b4ccc8870e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1318 microversion: 2.1 time: 0.291965 Oct 17 16:26:22.826923 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3668/7058] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:22 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:23.854638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:23.855376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:23.857567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:23.867679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:23.868576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:23.869796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:23.870732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:23.871640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:23.872443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:23.882863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:24.135460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:24.144628 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0db3318e-4b90-42e3-87da-fa57e10ea36f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1318 microversion: 2.1 time: 0.295742 Oct 17 16:26:24.145294 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3391/7059] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:23 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:25.187026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:25.188109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:25.200508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:25.201360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:25.202127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:25.203483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:25.204272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:25.205029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:25.745109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:25.754298 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b8a9ea00-afa5-4f3f-a0c4-d7a87a903c39 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1318 microversion: 2.1 time: 0.574801 Oct 17 16:26:25.755323 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3669/7060] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:25 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:26.792553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:26.793395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:26.801426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:26.801967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:26.802423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:26.803215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:26.803713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:26.804161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:26.961181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:26.970397 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f8d081a9-8c4c-4855-810d-d56ffe2c99e8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1318 microversion: 2.1 time: 0.181869 Oct 17 16:26:26.971081 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3392/7061] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:26 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:27.994287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:27.995080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:28.003606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:28.004119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:28.004568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:28.005828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:28.006654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:28.007133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:28.099406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-60343e91-d002-43b1-b2b8-36c5b0af937b req-818a18c9-831c-4a80-82b9-bf5c0ba710bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f76089-e7f2-44e5-9541-50154a0dc9ef", "name": "network-vif-plugged", "status": "completed", "tag": "60cd2089-26f4-47e7-8c1b-bb177802f96c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:28.112222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-60343e91-d002-43b1-b2b8-36c5b0af937b req-818a18c9-831c-4a80-82b9-bf5c0ba710bb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:28.112732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-60343e91-d002-43b1-b2b8-36c5b0af937b req-818a18c9-831c-4a80-82b9-bf5c0ba710bb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:28.113188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-60343e91-d002-43b1-b2b8-36c5b0af937b req-818a18c9-831c-4a80-82b9-bf5c0ba710bb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:28.129044 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-60343e91-d002-43b1-b2b8-36c5b0af937b req-818a18c9-831c-4a80-82b9-bf5c0ba710bb service nova] Creating event network-vif-plugged:60cd2089-26f4-47e7-8c1b-bb177802f96c for instance f9f76089-e7f2-44e5-9541-50154a0dc9ef on n-h1-854441-12 Oct 17 16:26:28.136054 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-60343e91-d002-43b1-b2b8-36c5b0af937b req-818a18c9-831c-4a80-82b9-bf5c0ba710bb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040259 Oct 17 16:26:28.137131 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3393/7062] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:26:28.197653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:28.214599 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f9fbafb1-9031-4c02-a8c9-bf5edd1e41df tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1318 microversion: 2.1 time: 0.224301 Oct 17 16:26:28.215599 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3670/7063] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:27 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:29.237901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:29.239216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:29.246305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:29.247274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:29.257703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:29.258294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:29.258867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:29.259730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:29.260255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:29.260747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:29.445369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:29.459322 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-41d0f7ee-6e88-4878-a70e-bdc24b5c70b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1318 microversion: 2.1 time: 0.221905 Oct 17 16:26:29.460540 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3394/7064] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:29 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:30.485433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:30.486213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:30.489023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:30.495083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:30.495612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:30.496050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:30.496779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:30.497233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:30.497643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:30.658169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:30.667178 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e669f9c-0617-44f4-95aa-2233af8bb622 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1508 microversion: 2.1 time: 0.185709 Oct 17 16:26:30.667699 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3671/7065] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:30 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:30.690784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:30.691680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:30.699661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:30.700174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:30.700617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:30.701354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:30.701849 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:30.702291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:30.853916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:30.863442 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0803b7c9-a728-4c5e-8551-e435ff04c638 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1508 microversion: 2.1 time: 0.177010 Oct 17 16:26:30.864062 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3395/7066] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:30 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:30.887633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:26:30.890030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:30.897068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:30.897573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:30.898017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:30.898791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:30.899250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:30.899679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:30.931497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:30.938028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:26:30.947291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:26:30.948046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:26:30.948882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:26:30.949622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:26:30.950332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:26:31.031045 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab747143-169f-4df7-9e11-683c27de6d09 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "POST /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef/action" status: 202 len: 0 microversion: 2.1 time: 0.147540 Oct 17 16:26:31.031910 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3672/7067] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:26:30 2022] POST /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:26:31.044629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:31.045599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:31.054334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:31.055471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:31.056427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:31.057648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:31.058398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:31.059144 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:31.262452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:31.271926 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ee3871a-7972-4f31-86ba-9902b1fbde3e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1515 microversion: 2.1 time: 0.234763 Oct 17 16:26:31.272550 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3396/7068] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:31 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:32.301173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:32.301837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:32.309639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:32.310136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:32.310609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:32.311331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:32.311803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:32.312230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:32.479758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:32.489449 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cdaea507-86b3-4472-9a49-a30cce61c05b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1515 microversion: 2.1 time: 0.193222 Oct 17 16:26:32.490269 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3673/7069] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:32 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:33.526567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:33.527490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:33.535486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:33.535999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:33.536451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:33.537194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:33.537665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:33.538090 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:33.684741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:33.693164 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6338072e-f321-4a75-8328-e4fbf7bcfd4a tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.170645 Oct 17 16:26:33.693775 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3397/7070] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:33 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:34.716451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:34.717121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:34.724969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:34.725490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:34.725929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:34.726836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:34.727300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:34.727725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:34.888242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:34.901507 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f977d411-73bc-42e8-a39f-83f48e69566e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.188745 Oct 17 16:26:34.902532 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3674/7071] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:34 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:35.938041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:35.938719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:35.946902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:35.947419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:35.947877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:35.948600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:35.949065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:35.949507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:36.099063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:36.107535 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fa3bab69-0762-4e85-b62d-c72f33018b1b tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.173755 Oct 17 16:26:36.108138 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3398/7072] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:35 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:37.132640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:37.133329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:37.141121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:37.141618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:37.142055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:37.142805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:37.143259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:37.143685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:37.294411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:37.304405 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-564e8c2c-91c8-49ab-84b7-c34cad7011e4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.176361 Oct 17 16:26:37.305025 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3675/7073] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:37 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:38.328650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:38.329353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:38.336538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:38.337061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:38.337514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:38.338245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:38.338758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:38.339202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:38.486946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:38.496345 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fae2b715-5322-4205-9a73-0e7bc42f1b33 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.171827 Oct 17 16:26:38.496943 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3399/7074] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:38 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:39.524776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:39.525614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:39.536152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:39.536872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:39.537532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:39.538637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:39.539296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:39.540092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:39.708432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:39.717148 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6120171c-77c7-4ddc-a767-34ccdc67ed3f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.199541 Oct 17 16:26:39.717756 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3676/7075] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:39 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:40.741452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:40.742095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:40.750130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:40.750703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:40.751174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:40.752021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:40.752529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:40.752990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:40.908563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:40.921094 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b422a64e-d588-4347-9041-8c5abdd633a9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.183228 Oct 17 16:26:40.922177 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3400/7076] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:40 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:41.957132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:41.958230 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:41.967412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:41.968478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:41.968698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:41.969597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:41.970214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:41.970797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:42.144369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:42.153477 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-058838eb-ec95-411b-9a8c-fba3d5c687da tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.202039 Oct 17 16:26:42.154617 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3677/7077] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:41 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:43.185745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:43.186336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:43.194040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:43.194545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:43.195029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:43.195760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:43.196232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:43.196670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:43.340611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:43.350131 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-37953e17-bc47-4c1d-87d5-819cb278b0d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.168321 Oct 17 16:26:43.350788 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3401/7078] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:43 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:44.375141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:44.375752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:44.383517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:44.384058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:44.384526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:44.385300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:44.385790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:44.386295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:44.534363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:44.549783 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ed9456e-c4b0-42ea-a701-0e905c16a936 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.178475 Oct 17 16:26:44.550894 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3678/7079] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:44 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:45.581634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:45.582240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:45.590249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:45.591013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:45.591781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:45.592711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:45.593179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:45.593830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:45.744684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:45.753622 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aea15831-d117-498b-b908-440c2b358872 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.176165 Oct 17 16:26:45.754264 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3402/7080] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:45 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:46.778147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:46.778891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:46.786487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:46.787152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:46.787547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:46.788273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:46.788710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:46.789164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:46.937507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:46.945942 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8709a87e-be82-48ba-bad2-fdd593778231 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.171698 Oct 17 16:26:46.946536 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3679/7081] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:46 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:47.970126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:47.970778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:47.978110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:47.978623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:47.979073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:47.979800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:47.980248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:47.980685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:48.139577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:48.148937 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dcfa995e-770f-4d4b-b914-d0f505d14e5c tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.183197 Oct 17 16:26:48.149615 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3403/7082] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:47 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:49.173444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:49.174081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:49.181613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:49.182100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:49.182539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:49.183269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:49.183720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:49.184142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:49.329931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:49.337991 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5da4c561-3df2-4eea-9ca7-62d8baecf67d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.168634 Oct 17 16:26:49.338627 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3680/7083] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:49 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:50.364290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:50.365052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:50.372914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:50.373501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:50.373987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:50.375010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:50.375520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:50.376052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:50.524732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:50.533430 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4ea24712-7fa9-4cdf-a6d7-406660d132b7 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.174892 Oct 17 16:26:50.534036 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3404/7084] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:50 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:51.557716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:51.558452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:51.566758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:51.567234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:51.567697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:51.568392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:51.568872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:51.569272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:51.727354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:51.736674 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32f65132-11f7-468c-ad1f-aac13cd143bd tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.182921 Oct 17 16:26:51.737310 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3681/7085] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:51 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:52.761063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:52.761734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:52.769895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:52.770437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:52.770924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:52.771667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:52.772138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:52.772582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:52.912190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:52.922658 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-de25068b-0956-4e22-a590-13e2050a044f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.165472 Oct 17 16:26:52.923479 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3405/7086] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:52 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:53.947236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:53.947891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:53.950793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:53.956741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:53.957246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:53.957690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:53.958406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:53.958891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:53.959323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:53.962413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:54.112459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:54.121546 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5872acb7-02ef-4463-aa09-c875f73aa767 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.178240 Oct 17 16:26:54.122167 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3682/7087] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:53 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:55.162332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:55.163505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:55.168034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=30 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:55.174571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:55.175091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:55.175551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:55.176291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:55.176766 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:55.177216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:55.180185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=86 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:26:55.354652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:55.363012 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-98a5e9bb-7f77-4498-9256-e25f228fa72d tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.207222 Oct 17 16:26:55.363603 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3406/7088] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:55 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:56.389565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:56.390197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:56.398293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:56.398825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:56.399276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:56.400011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:56.400467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:56.400908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:56.578336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:56.588324 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ee226272-0903-4cfc-a5b2-99d0643cdc54 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.202950 Oct 17 16:26:56.588913 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3683/7089] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:56 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:57.613282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:57.614048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:57.621667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:57.622225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:57.622769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:57.623548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:57.624152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:57.625109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:57.768824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:57.777916 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-082150a0-473a-4d2f-bef6-93784dcd4f8e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.168866 Oct 17 16:26:57.778636 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3407/7090] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:57 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:26:58.820036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:26:58.820834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:26:58.828428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:58.829188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:58.829855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:58.830754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:26:58.831328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:26:58.831868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:26:58.989965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:26:58.998748 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ca36677d-03bd-4523-ae36-42adea8bc140 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1520 microversion: 2.1 time: 0.182944 Oct 17 16:26:58.999377 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3684/7091] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:26:58 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:00.024279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:00.024926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:00.034740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:00.035290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:00.035760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:00.036531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:00.037108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:00.037563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:00.291477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:00.302130 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f63cdee9-8041-4d5a-af5b-87b7989375f0 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1519 microversion: 2.1 time: 0.283446 Oct 17 16:27:00.302942 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3408/7092] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:00 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:00.595224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-f9f12059-32c0-441d-8f2c-b9b300915180 req-58c5fad7-c6fb-4a5d-ad2f-f94479554572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f76089-e7f2-44e5-9541-50154a0dc9ef", "name": "network-vif-unplugged", "status": "completed", "tag": "60cd2089-26f4-47e7-8c1b-bb177802f96c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:27:00.615502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f9f12059-32c0-441d-8f2c-b9b300915180 req-58c5fad7-c6fb-4a5d-ad2f-f94479554572 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:00.616183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f9f12059-32c0-441d-8f2c-b9b300915180 req-58c5fad7-c6fb-4a5d-ad2f-f94479554572 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:00.616737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-f9f12059-32c0-441d-8f2c-b9b300915180 req-58c5fad7-c6fb-4a5d-ad2f-f94479554572 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:00.633584 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-f9f12059-32c0-441d-8f2c-b9b300915180 req-58c5fad7-c6fb-4a5d-ad2f-f94479554572 service nova] Creating event network-vif-unplugged:60cd2089-26f4-47e7-8c1b-bb177802f96c for instance f9f76089-e7f2-44e5-9541-50154a0dc9ef on n-h2-854441-12 Oct 17 16:27:00.641329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-f9f12059-32c0-441d-8f2c-b9b300915180 req-58c5fad7-c6fb-4a5d-ad2f-f94479554572 service nova] Instance f9f76089-e7f2-44e5-9541-50154a0dc9ef is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:27:00.658356 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-f9f12059-32c0-441d-8f2c-b9b300915180 req-58c5fad7-c6fb-4a5d-ad2f-f94479554572 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078548 Oct 17 16:27:00.659226 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3685/7093] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:27:01.330790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:01.331776 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:01.343219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:01.343889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:01.344693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:01.345927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:01.346641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:01.347341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:01.603611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:01.615573 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2691755c-5e7e-4372-a546-2950c35031d2 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1519 microversion: 2.1 time: 0.292064 Oct 17 16:27:01.616402 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3409/7094] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:01 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:02.642069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:02.642807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:02.649992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:02.651173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:02.651173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:02.651602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:02.652082 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:02.652507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:02.677548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-42b6605b-7f4a-44c8-9f38-891444ed8c25 req-3f24efd8-08f1-4276-b893-b7fc7f1313e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9f76089-e7f2-44e5-9541-50154a0dc9ef", "tag": "60cd2089-26f4-47e7-8c1b-bb177802f96c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:27:02.690423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-42b6605b-7f4a-44c8-9f38-891444ed8c25 req-3f24efd8-08f1-4276-b893-b7fc7f1313e7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:02.691132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-42b6605b-7f4a-44c8-9f38-891444ed8c25 req-3f24efd8-08f1-4276-b893-b7fc7f1313e7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:02.691704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-42b6605b-7f4a-44c8-9f38-891444ed8c25 req-3f24efd8-08f1-4276-b893-b7fc7f1313e7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:02.705480 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-42b6605b-7f4a-44c8-9f38-891444ed8c25 req-3f24efd8-08f1-4276-b893-b7fc7f1313e7 service nova] Creating event network-changed:60cd2089-26f4-47e7-8c1b-bb177802f96c for instance f9f76089-e7f2-44e5-9541-50154a0dc9ef on n-h2-854441-12 Oct 17 16:27:02.711955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-42b6605b-7f4a-44c8-9f38-891444ed8c25 req-3f24efd8-08f1-4276-b893-b7fc7f1313e7 service nova] Instance f9f76089-e7f2-44e5-9541-50154a0dc9ef is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:27:02.723665 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-42b6605b-7f4a-44c8-9f38-891444ed8c25 req-3f24efd8-08f1-4276-b893-b7fc7f1313e7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051304 Oct 17 16:27:02.724302 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3410/7095] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:27:02.833675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:02.851933 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-967278df-57d1-4632-8e9a-2c8ef83a0cfa tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1517 microversion: 2.1 time: 0.214127 Oct 17 16:27:02.853009 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3686/7096] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:02 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1517 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:03.894625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:03.895653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:03.904243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:03.904804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:03.905296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:03.906272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:03.906796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:03.907253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:04.166710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:04.181035 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf11d600-1f56-460f-a656-70cb77551762 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1514 microversion: 2.1 time: 0.292844 Oct 17 16:27:04.182193 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3411/7097] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:03 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1514 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:04.206643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf7ba6de-8fe6-45fb-aa3b-34045f69d40f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:27:04.207304 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf7ba6de-8fe6-45fb-aa3b-34045f69d40f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:04.214893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf7ba6de-8fe6-45fb-aa3b-34045f69d40f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:04.215394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf7ba6de-8fe6-45fb-aa3b-34045f69d40f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:04.215835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf7ba6de-8fe6-45fb-aa3b-34045f69d40f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:04.216557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf7ba6de-8fe6-45fb-aa3b-34045f69d40f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:04.217011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf7ba6de-8fe6-45fb-aa3b-34045f69d40f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:04.217441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf7ba6de-8fe6-45fb-aa3b-34045f69d40f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:04.284805 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf7ba6de-8fe6-45fb-aa3b-34045f69d40f tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "POST /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef/action" status: 204 len: 0 microversion: 2.1 time: 0.082175 Oct 17 16:27:04.285591 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3687/7098] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:27:04 2022] POST /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:27:04.295293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:04.296423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:04.305600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:04.306221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:04.306741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:04.307679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:04.308173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:04.308611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:04.552409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:04.565028 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-084bb8d1-0703-4b0b-b9db-48e250b78973 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1514 microversion: 2.1 time: 0.274697 Oct 17 16:27:04.565878 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3412/7099] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:04 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1514 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:05.596855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:05.597913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:05.607628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:05.608600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:05.609306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:05.610358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:05.611138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:05.611767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:05.814942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:05.826217 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b13032ae-2db7-48da-a3b4-324cd25c265e tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1506 microversion: 2.1 time: 0.238057 Oct 17 16:27:05.826925 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3688/7100] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:05 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:05.852291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:05.852899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:05.862119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:05.862779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:05.863313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:05.864488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:05.865083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:05.865627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:06.031439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:06.044445 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1bcc88fa-3f99-4298-acdf-af99dcc20841 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1506 microversion: 2.1 time: 0.196295 Oct 17 16:27:06.045321 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3413/7101] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:05 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:06.067840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:06.068482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:06.075585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:06.076085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:06.076516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:06.077268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:06.077721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:06.078145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:06.246364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:06.259655 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b71f7e9-7cbf-486a-a43c-8b3ecda28513 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1506 microversion: 2.1 time: 0.196071 Oct 17 16:27:06.269404 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3689/7102] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:06 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:06.298587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:06.299409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:06.310073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:06.311857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:06.313256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:06.314398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:06.315185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:06.316178 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:06.368378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:27:06.483707 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-68ff582c-5e6d-4684-bd5d-d76131b84786 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 204 len: 0 microversion: 2.1 time: 0.191199 Oct 17 16:27:06.484741 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3414/7103] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:27:06 2022] DELETE /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:27:06.503379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:06.504035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:06.511351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:06.511915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:06.512347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:06.513046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:06.513496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:06.513908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:06.544450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:27:06.604036 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.compute.api [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Instance is already in deleting state, ignoring this request Oct 17 16:27:06.605566 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c5e825d-ecb6-4480-a64d-3895180daac8 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 204 len: 0 microversion: 2.1 time: 0.106215 Oct 17 16:27:06.606913 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3690/7104] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:27:06 2022] DELETE /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:27:06.620576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:06.621897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:06.632988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:06.633921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:06.635057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:06.636435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:06.637367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:06.638218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:06.846173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:06.857363 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b7204e5b-ab37-4072-9690-3fa298eb2b50 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1512 microversion: 2.1 time: 0.244147 Oct 17 16:27:06.871049 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3415/7105] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:06 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:07.880986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:07.881620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:07.890160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:07.890713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:07.891181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:07.891910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:07.892510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:07.893050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:08.066513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbe475c15af46189d55f43817a72c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdc55cf759546ff9959237886aec71b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:08.074730 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f421cf45-c48e-4d0e-aa00-b5160693a7e9 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 200 len: 1512 microversion: 2.1 time: 0.198273 Oct 17 16:27:08.075346 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3691/7106] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:07 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:08.394418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-3ef670bc-b79b-4ea0-8236-a5e3203576d6 req-3d9b4248-6ed2-401c-bc30-33e5cb2e3246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f76089-e7f2-44e5-9541-50154a0dc9ef", "name": "network-vif-deleted", "tag": "60cd2089-26f4-47e7-8c1b-bb177802f96c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:27:08.406243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3ef670bc-b79b-4ea0-8236-a5e3203576d6 req-3d9b4248-6ed2-401c-bc30-33e5cb2e3246 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:08.406788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3ef670bc-b79b-4ea0-8236-a5e3203576d6 req-3d9b4248-6ed2-401c-bc30-33e5cb2e3246 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:08.407232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3ef670bc-b79b-4ea0-8236-a5e3203576d6 req-3d9b4248-6ed2-401c-bc30-33e5cb2e3246 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:08.419716 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-3ef670bc-b79b-4ea0-8236-a5e3203576d6 req-3d9b4248-6ed2-401c-bc30-33e5cb2e3246 service nova] Creating event network-vif-deleted:60cd2089-26f4-47e7-8c1b-bb177802f96c for instance f9f76089-e7f2-44e5-9541-50154a0dc9ef on n-h2-854441-12 Oct 17 16:27:08.425792 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-3ef670bc-b79b-4ea0-8236-a5e3203576d6 req-3d9b4248-6ed2-401c-bc30-33e5cb2e3246 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035199 Oct 17 16:27:08.426769 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3416/7107] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:27:09.098057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:09.098821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: f9f76089-e7f2-44e5-9541-50154a0dc9ef] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:09.106388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:09.106916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:09.107354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:09.108090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:09.108539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:09.108961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:09.124379 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] HTTP exception thrown: Instance f9f76089-e7f2-44e5-9541-50154a0dc9ef could not be found. Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Request method failure captured: Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef HTTP/1.1 Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYHxwBdaeS22eGiuMvsN45enG2GUBi5NfCop4L8-zWgrh3MbrXlProqVwkm38DePpRd3KfM98g_azBOOZ7Rj6zyZLtUfi6_sTSsEg8VlU7LMdNjcvibf9t5dx4mH6l9id1VyNe9KAlqZqOlwWyDLVwtE8Dr6ccHdIc6wnA421H3JD0g Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 7fdc55cf759546ff9959237886aec71b Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2022545502 Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7fdc55cf759546ff9959237886aec71b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7fdc55cf759546ff9959237886aec71b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7fdc55cf759546ff9959237886aec71b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7fdc55cf759546ff9959237886aec71b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiskConfigTestJSON-2022545502 Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 7fdc55cf759546ff9959237886aec71b Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2022545502 Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerDiskConfigTestJSON-2022545502-project Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: abbe475c15af46189d55f43817a72c3e Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiskConfigTestJSON-2022545502-project Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance f9f76089-e7f2-44e5-9541-50154a0dc9ef could not be found. Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'f9f76089-e7f2-44e5-9541-50154a0dc9ef'} Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f76089-e7f2-44e5-9541-50154a0dc9ef could not be found. Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f76089-e7f2-44e5-9541-50154a0dc9ef could not be found. Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:27:09.126133 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f76089-e7f2-44e5-9541-50154a0dc9ef could not be found. Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Returning 404 to user: Instance f9f76089-e7f2-44e5-9541-50154a0dc9ef could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-adf84cc0-ee4a-446d-8a55-a8dd5df32dba tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef" status: 404 len: 111 microversion: 2.1 time: 0.033779 Oct 17 16:27:09.131135 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3692/7108] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:09 2022] GET /compute/v2.1/servers/f9f76089-e7f2-44e5-9541-50154a0dc9ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:27:09.139931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-72bc65d5-8041-46f9-9999-020cfab8f2de tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '.version_select at 0x7f28beb1af70>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:09.168476 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-72bc65d5-8041-46f9-9999-020cfab8f2de tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525508430" status: 202 len: 0 microversion: 2.1 time: 0.033083 Oct 17 16:27:09.169274 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3417/7109] 10.222.0.87 () {58 vars in 1221 bytes} [Mon Oct 17 16:27:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525508430 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:27:09.843233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:09.843748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:09.850374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:09.850899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:09.851332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:09.852036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:09.852486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:09.852906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:09.868050 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] HTTP exception thrown: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Request method failure captured: Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc HTTP/1.1 Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYHxwBdaeS22eGiuMvsN45enG2GUBi5NfCop4L8-zWgrh3MbrXlProqVwkm38DePpRd3KfM98g_azBOOZ7Rj6zyZLtUfi6_sTSsEg8VlU7LMdNjcvibf9t5dx4mH6l9id1VyNe9KAlqZqOlwWyDLVwtE8Dr6ccHdIc6wnA421H3JD0g Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 7fdc55cf759546ff9959237886aec71b Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2022545502 Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7fdc55cf759546ff9959237886aec71b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7fdc55cf759546ff9959237886aec71b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7fdc55cf759546ff9959237886aec71b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7fdc55cf759546ff9959237886aec71b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerDiskConfigTestJSON-2022545502 Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 7fdc55cf759546ff9959237886aec71b Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2022545502 Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerDiskConfigTestJSON-2022545502-project Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: abbe475c15af46189d55f43817a72c3e Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerDiskConfigTestJSON-2022545502-project Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'df4b729d-628f-4fb9-9103-ab7fcbde58fc'} Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:27:09.869648 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Returning 404 to user: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-25fa62ed-3624-44e7-a4ca-7b35ecdee4fb tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "DELETE /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 404 len: 111 microversion: 2.1 time: 0.032185 Oct 17 16:27:09.877996 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3693/7110] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:27:09 2022] DELETE /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:27:09.884546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:09.885313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] [instance: df4b729d-628f-4fb9-9103-ab7fcbde58fc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:09.894374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:09.894960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:09.895459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:09.896505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:09.896982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:09.897500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:09.913784 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] HTTP exception thrown: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Request method failure captured: Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc HTTP/1.1 Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYHxwBdaeS22eGiuMvsN45enG2GUBi5NfCop4L8-zWgrh3MbrXlProqVwkm38DePpRd3KfM98g_azBOOZ7Rj6zyZLtUfi6_sTSsEg8VlU7LMdNjcvibf9t5dx4mH6l9id1VyNe9KAlqZqOlwWyDLVwtE8Dr6ccHdIc6wnA421H3JD0g Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7fdc55cf759546ff9959237886aec71b Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2022545502 Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7fdc55cf759546ff9959237886aec71b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7fdc55cf759546ff9959237886aec71b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7fdc55cf759546ff9959237886aec71b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7fdc55cf759546ff9959237886aec71b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerDiskConfigTestJSON-2022545502 Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7fdc55cf759546ff9959237886aec71b Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2022545502 Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerDiskConfigTestJSON-2022545502-project Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: abbe475c15af46189d55f43817a72c3e Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerDiskConfigTestJSON-2022545502-project Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'df4b729d-628f-4fb9-9103-ab7fcbde58fc'} Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:27:09.915552 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.920135 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:27:09.920135 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:27:09.920135 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:27:09.920135 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:27:09.920135 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:27:09.920135 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. Oct 17 16:27:09.920135 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:27:09.920135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] Returning 404 to user: Instance df4b729d-628f-4fb9-9103-ab7fcbde58fc could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:27:09.920135 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b625988b-d957-4846-a8da-70a9d0ede8f4 tempest-ServerDiskConfigTestJSON-2022545502 tempest-ServerDiskConfigTestJSON-2022545502-project] 10.222.0.87 "GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc" status: 404 len: 111 microversion: 2.1 time: 0.038315 Oct 17 16:27:09.920994 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3418/7111] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:09 2022] GET /compute/v2.1/servers/df4b729d-628f-4fb9-9103-ab7fcbde58fc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:27:19.599224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7609f752-8b5a-4acb-8f91-a605de8bb86f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'create', calling method: .version_select at 0x7f28bd77bb80>, body: {"keypair": {"name": "tempest-keypair-278774756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2QJsui2qnYuKnqjJ67Z/YqRIJ45FrLdqIJToM0CwAF+wz2z4l54revLbPuF41jinnNwNPa2LgEKMyUFOAQRa+cbichWe29bmpe9ZrRggTf7+U4XMtHrMnWHG89jDitcg=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:27:19.618459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7609f752-8b5a-4acb-8f91-a605de8bb86f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for project 8e6c5e1866204a798695a2ad4b033775. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:27:19.625043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7609f752-8b5a-4acb-8f91-a605de8bb86f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for user 6f67ed748bed490981e06a64cba232cf and project 8e6c5e1866204a798695a2ad4b033775. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:27:19.658392 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7609f752-8b5a-4acb-8f91-a605de8bb86f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.215513 Oct 17 16:27:19.659146 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3694/7112] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:27:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:27:21.529959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:27:21.531504 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:27:21.541581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-902542621", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc21e39d-7500-499a-acc8-9e05f278215f"}], "security_groups": [{"name": "tempest-securitygroup--392649381"}], "key_name": "tempest-keypair-278774756", "user_data": "}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:27:21.682280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] validate_networks() for [('dc21e39d-7500-499a-acc8-9e05f278215f', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:27:22.142458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:27:22.143186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:27:22.143814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:27:22.144706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:27:22.145155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:27:22.155432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:22.155933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:22.156415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:22.157182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:22.157653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:22.158092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:22.176226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for project 8e6c5e1866204a798695a2ad4b033775. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:27:22.183570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for user 6f67ed748bed490981e06a64cba232cf and project 8e6c5e1866204a798695a2ad4b033775. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:27:22.200397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:27:22.203109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:27:22.253280 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-44b362a8-e050-4ddc-8cc1-278df3f020ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.727024 Oct 17 16:27:22.256053 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3419/7113] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:27:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:27:22.263481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:27:22.269920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1bcbd46a-03ba-4225-8fc4-06820abb9e33 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:22.270590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1bcbd46a-03ba-4225-8fc4-06820abb9e33 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:22.341602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1bcbd46a-03ba-4225-8fc4-06820abb9e33 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:22.350228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1bcbd46a-03ba-4225-8fc4-06820abb9e33 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1237 microversion: 2.1 time: 0.087615 Oct 17 16:27:22.351175 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3695/7114] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:22 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:23.378633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:23.380036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:23.389260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:23.389786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:23.390254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:23.391095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:23.391605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:23.392193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:23.465907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:23.475971 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-28510a9c-51bb-4f54-bac4-d15eb50aae1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1289 microversion: 2.1 time: 0.105939 Oct 17 16:27:23.476667 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3420/7115] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:23 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:27:24.516646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:24.518326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:24.528422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:27:24.531047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:24.532190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:24.532880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:24.533432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:24.534778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:24.534778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:24.706314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:24.715454 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c4a41339-8e1f-4d9a-9a8d-f82eaef575de tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1362 microversion: 2.1 time: 0.207190 Oct 17 16:27:24.716427 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3696/7116] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:24 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:25.086622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a73008a5-8941-4519-808f-ec8e10075463 req-00296545-7a83-4385-acb3-61c9083653f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc6e5ba-86f5-4348-a094-05b2dca9b552", "tag": "851a5ac4-2cbf-41bc-868a-69038e68949c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:27:25.103305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a73008a5-8941-4519-808f-ec8e10075463 req-00296545-7a83-4385-acb3-61c9083653f4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:25.104175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a73008a5-8941-4519-808f-ec8e10075463 req-00296545-7a83-4385-acb3-61c9083653f4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:25.105114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a73008a5-8941-4519-808f-ec8e10075463 req-00296545-7a83-4385-acb3-61c9083653f4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:25.122992 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a73008a5-8941-4519-808f-ec8e10075463 req-00296545-7a83-4385-acb3-61c9083653f4 service nova] Creating event network-changed:851a5ac4-2cbf-41bc-868a-69038e68949c for instance edc6e5ba-86f5-4348-a094-05b2dca9b552 on n-h2-854441-12 Oct 17 16:27:25.128834 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a73008a5-8941-4519-808f-ec8e10075463 req-00296545-7a83-4385-acb3-61c9083653f4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046922 Oct 17 16:27:25.130181 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3421/7117] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:27:25.751035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:25.751704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:25.761215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:25.761710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:25.762629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:25.763350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:25.763848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:25.764491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:25.911504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:25.920214 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32fed54b-5c72-4111-aa29-5e7d5855174b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1362 microversion: 2.1 time: 0.174351 Oct 17 16:27:25.921227 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3697/7118] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:25 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:26.954553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:26.955301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:26.962628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:26.963168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:26.963621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:26.964356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:26.964826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:26.965263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:27.120963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:27.130926 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ff543255-b762-4477-bfba-fdbfb67437f2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1362 microversion: 2.1 time: 0.181793 Oct 17 16:27:27.131529 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3422/7119] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:26 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:28.171626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:28.172533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:28.183656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:28.184433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:28.185073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:28.186195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:28.186963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:28.187606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:28.365990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:28.377116 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b2d73222-d9ed-46d0-80ae-9ccec2f209a1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1362 microversion: 2.1 time: 0.212704 Oct 17 16:27:28.377743 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3698/7120] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:28 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:29.403024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:29.403921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:29.416168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:29.416987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:29.417706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:29.418908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:29.419661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:29.420370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:29.575198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:29.583694 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f2500ca7-d282-4b26-9310-76034ef7009d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1362 microversion: 2.1 time: 0.186771 Oct 17 16:27:29.584930 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3423/7121] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:29 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:30.478725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7313014d-f109-4b84-9958-5e5efa69fff3 req-3f8170c8-2095-48b6-b873-c3cf80a3f814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc6e5ba-86f5-4348-a094-05b2dca9b552", "name": "network-vif-plugged", "status": "completed", "tag": "851a5ac4-2cbf-41bc-868a-69038e68949c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:27:30.490255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7313014d-f109-4b84-9958-5e5efa69fff3 req-3f8170c8-2095-48b6-b873-c3cf80a3f814 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:30.490826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7313014d-f109-4b84-9958-5e5efa69fff3 req-3f8170c8-2095-48b6-b873-c3cf80a3f814 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:30.491259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7313014d-f109-4b84-9958-5e5efa69fff3 req-3f8170c8-2095-48b6-b873-c3cf80a3f814 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:30.505158 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7313014d-f109-4b84-9958-5e5efa69fff3 req-3f8170c8-2095-48b6-b873-c3cf80a3f814 service nova] Creating event network-vif-plugged:851a5ac4-2cbf-41bc-868a-69038e68949c for instance edc6e5ba-86f5-4348-a094-05b2dca9b552 on n-h2-854441-12 Oct 17 16:27:30.510679 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7313014d-f109-4b84-9958-5e5efa69fff3 req-3f8170c8-2095-48b6-b873-c3cf80a3f814 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120415 Oct 17 16:27:30.511828 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3699/7122] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:27:30.610263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:30.610952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:30.619873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:30.620389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:30.621069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:30.622008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:30.622488 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:30.622954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:30.795998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:30.805238 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2369d404-d195-4aa2-a9e5-49f1e5ad0982 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1362 microversion: 2.1 time: 0.200615 Oct 17 16:27:30.805860 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3424/7123] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:30 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:31.833111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:31.833944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:31.840876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:31.841367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:31.841803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:31.842567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:31.843022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:31.843467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:31.985308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:27:31.993868 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-033ef4d9-4674-4621-931e-2f6801da9992 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1548 microversion: 2.1 time: 0.168100 Oct 17 16:27:31.994471 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3700/7124] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:27:31 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:27:32.018278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0d03706f-e33e-4e10-90da-eb5c7b624526 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:27:32.018946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0d03706f-e33e-4e10-90da-eb5c7b624526 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:27:32.026254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d03706f-e33e-4e10-90da-eb5c7b624526 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:32.026808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d03706f-e33e-4e10-90da-eb5c7b624526 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:32.027271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d03706f-e33e-4e10-90da-eb5c7b624526 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:32.028011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d03706f-e33e-4e10-90da-eb5c7b624526 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:32.028490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d03706f-e33e-4e10-90da-eb5c7b624526 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:32.028937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0d03706f-e33e-4e10-90da-eb5c7b624526 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:32.117662 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0d03706f-e33e-4e10-90da-eb5c7b624526 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103562 Oct 17 16:27:32.118285 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3425/7125] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 16:27:32 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:27:33.209658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:27:33.273365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5f1c3641-ec79-4b8d-8052-b220f735ec2a req-195aef92-7242-47af-a139-7d0307465e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc6e5ba-86f5-4348-a094-05b2dca9b552", "tag": "851a5ac4-2cbf-41bc-868a-69038e68949c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:27:33.283269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5f1c3641-ec79-4b8d-8052-b220f735ec2a req-195aef92-7242-47af-a139-7d0307465e6f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:27:33.283748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5f1c3641-ec79-4b8d-8052-b220f735ec2a req-195aef92-7242-47af-a139-7d0307465e6f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:27:33.284175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5f1c3641-ec79-4b8d-8052-b220f735ec2a req-195aef92-7242-47af-a139-7d0307465e6f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:27:33.296508 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5f1c3641-ec79-4b8d-8052-b220f735ec2a req-195aef92-7242-47af-a139-7d0307465e6f service nova] Creating event network-changed:851a5ac4-2cbf-41bc-868a-69038e68949c for instance edc6e5ba-86f5-4348-a094-05b2dca9b552 on n-h2-854441-12 Oct 17 16:27:33.301917 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5f1c3641-ec79-4b8d-8052-b220f735ec2a req-195aef92-7242-47af-a139-7d0307465e6f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096927 Oct 17 16:27:33.302580 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3701/7126] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:28:08.361551 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:08.362451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:08.364445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:08.365244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=32 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:08.370078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:08.370730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:08.380059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:08.380563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:08.381009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:08.381734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:08.382198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:08.382665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:08.520477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:08.529358 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb4d2b2e-1807-4748-ad5d-34815b6e7387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1666 microversion: 2.1 time: 0.168632 Oct 17 16:28:08.529939 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3426/7127] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:08 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1666 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:08.553548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:08.554325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:08.556773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=11 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:08.557386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=28 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:08.564500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:08.564990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:08.565420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:08.566139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:08.566609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:08.567042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:08.718663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:08.722476 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eef1146a-af89-4cd2-a31e-99ff42e2dda9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1666 microversion: 2.1 time: 0.173309 Oct 17 16:28:08.723114 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3702/7128] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:08 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1666 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:08.745730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:08.746403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:08.752728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:08.753237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:08.753689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:08.754748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:08.755207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:08.755648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:08.907121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:08.916626 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e6a6460a-6dfd-4df3-a2f7-93b3bf54cd06 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1666 microversion: 2.1 time: 0.174870 Oct 17 16:28:08.917508 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3427/7129] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:08 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1666 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:08.939667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:08.941991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:08.948620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:08.949140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:08.949622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:08.950397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:08.950875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:08.951319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:08.980627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:08.987055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:28:08.994404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:28:08.994875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:28:08.995352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:28:08.995764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:28:08.996181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:28:09.067892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e56e04b-b154-4ad9-94f6-93b0a0227f53 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552/action" status: 202 len: 0 microversion: 2.1 time: 0.132280 Oct 17 16:28:09.068529 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3703/7130] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:28:08 2022] POST /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:28:09.080315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:09.080958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:09.087814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:09.088343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:09.088825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:09.089561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:09.090037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:09.090481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:09.301040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:09.311926 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2ed6af53-05d7-4bc7-9849-9b0066ac1681 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1675 microversion: 2.1 time: 0.238559 Oct 17 16:28:09.312754 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3428/7131] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:09 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:10.348886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:10.349543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:10.359925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:10.360423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:10.360846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:10.361550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:10.361994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:10.362426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:10.517797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:10.526259 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-36b1c991-5aaa-4481-889c-7050a2f95b4c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1675 microversion: 2.1 time: 0.182462 Oct 17 16:28:10.527059 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3704/7132] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:10 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:11.551528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:11.552202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:11.559996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:11.560597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:11.561046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:11.561960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:11.562484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:11.563029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:11.717247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:11.725846 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e4df5fb-9f36-427a-a380-c0ece9259440 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.177984 Oct 17 16:28:11.726837 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3429/7133] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:11 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:12.751465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:12.752100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:12.759903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:12.760393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:12.760828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:12.761530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:12.761988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:12.762403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:12.898775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:12.907054 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a19e1ddd-f63f-4398-bb9a-1a167a6e2ca4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.160521 Oct 17 16:28:12.907662 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3705/7134] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:12 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:13.931938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:13.932513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:13.939912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:13.940416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:13.940869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:13.941588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:13.942054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:13.942523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:14.083417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:14.098449 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a71cdf21-edbb-4708-88d0-e183a90a9022 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.170361 Oct 17 16:28:14.099606 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3430/7135] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:13 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:15.132779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:15.133545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:15.143538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:15.144179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:15.144756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:15.145743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:15.146348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:15.146909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:15.290899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:15.300581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fb832504-6c2b-4d19-a57e-4999e367d11c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.174347 Oct 17 16:28:15.301175 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3706/7136] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:15 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:16.325463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:16.326126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:16.334554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:16.335303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:16.335516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:16.336246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:16.336717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:16.337182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:16.487542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:16.500659 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba64d753-3224-45b8-840d-aa9eed45680c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.179904 Oct 17 16:28:16.501912 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3431/7137] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:16 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:17.526262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:17.526904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:17.534063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:17.534580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:17.535016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:17.535710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:17.536161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:17.536582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:17.682554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:17.691363 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f013b6b9-2651-4086-a41f-ad18321362d8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.169183 Oct 17 16:28:17.691968 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3707/7138] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:17 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:18.715123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:18.715721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:18.723231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:18.723743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:18.724202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:18.724929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:18.725691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:18.725827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:18.865639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:18.874148 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-39eb062f-806c-4df6-9db5-d29a1498119e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.162937 Oct 17 16:28:18.874755 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3432/7139] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:18 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:19.898681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:19.899375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:19.907554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:19.908126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:19.908502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:19.909273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:19.909737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:19.910168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:20.060832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:20.069457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6af2375f-518f-4b11-ab42-403a0276cc76 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.174858 Oct 17 16:28:20.070088 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3708/7140] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:19 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:21.093695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:21.094563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:21.102311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:21.102856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:21.103316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:21.104066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:21.104528 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:21.104998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:21.259146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:21.272870 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-216e1df2-4ab0-45b8-843f-36563a178c85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.183074 Oct 17 16:28:21.273895 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3433/7141] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:21 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:22.297612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:22.298255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:22.305857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:22.306362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:22.306847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:22.307578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:22.308034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:22.308463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:22.464943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:22.474261 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a655cb1-6baa-4fef-b85d-cb7d0153a215 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1680 microversion: 2.1 time: 0.180928 Oct 17 16:28:22.474921 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3709/7142] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:22 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:23.501556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:23.502959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:23.514474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:23.515429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:23.516521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:23.518210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:23.519076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:23.519711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:23.524846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a125337c-574b-4604-b2d7-8db0f890bbac req-5201dd25-df23-4041-8ebd-edd49a1ae9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc6e5ba-86f5-4348-a094-05b2dca9b552", "name": "network-vif-unplugged", "status": "completed", "tag": "851a5ac4-2cbf-41bc-868a-69038e68949c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:23.544309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a125337c-574b-4604-b2d7-8db0f890bbac req-5201dd25-df23-4041-8ebd-edd49a1ae9c5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:23.545327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a125337c-574b-4604-b2d7-8db0f890bbac req-5201dd25-df23-4041-8ebd-edd49a1ae9c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:23.546171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a125337c-574b-4604-b2d7-8db0f890bbac req-5201dd25-df23-4041-8ebd-edd49a1ae9c5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:23.572789 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a125337c-574b-4604-b2d7-8db0f890bbac req-5201dd25-df23-4041-8ebd-edd49a1ae9c5 service nova] Creating event network-vif-unplugged:851a5ac4-2cbf-41bc-868a-69038e68949c for instance edc6e5ba-86f5-4348-a094-05b2dca9b552 on n-h1-854441-12 Oct 17 16:28:23.586345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-a125337c-574b-4604-b2d7-8db0f890bbac req-5201dd25-df23-4041-8ebd-edd49a1ae9c5 service nova] Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:28:23.613488 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a125337c-574b-4604-b2d7-8db0f890bbac req-5201dd25-df23-4041-8ebd-edd49a1ae9c5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.186769 Oct 17 16:28:23.614628 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3434/7143] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:28:23.745329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:23.760744 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d07e1f79-5162-4f3a-b198-b5a4ac1805a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1679 microversion: 2.1 time: 0.263862 Oct 17 16:28:23.761862 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3710/7144] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:23 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1679 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:28:24.786772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:24.787578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:24.795550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:24.796138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:24.796689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:24.797611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:24.798266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:24.798888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:24.970252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:24.985050 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5f987f53-c717-43de-afc8-67954c487142 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1677 microversion: 2.1 time: 0.202512 Oct 17 16:28:24.986141 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3435/7145] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:24 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:25.636205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e6259bee-2b1d-4619-b038-d1fe98eb05ec req-6be8371d-d1b5-4404-8487-79983f949153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc6e5ba-86f5-4348-a094-05b2dca9b552", "tag": "851a5ac4-2cbf-41bc-868a-69038e68949c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:25.647439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e6259bee-2b1d-4619-b038-d1fe98eb05ec req-6be8371d-d1b5-4404-8487-79983f949153 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:25.647920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e6259bee-2b1d-4619-b038-d1fe98eb05ec req-6be8371d-d1b5-4404-8487-79983f949153 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:25.648386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e6259bee-2b1d-4619-b038-d1fe98eb05ec req-6be8371d-d1b5-4404-8487-79983f949153 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:25.662009 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e6259bee-2b1d-4619-b038-d1fe98eb05ec req-6be8371d-d1b5-4404-8487-79983f949153 service nova] Creating event network-changed:851a5ac4-2cbf-41bc-868a-69038e68949c for instance edc6e5ba-86f5-4348-a094-05b2dca9b552 on n-h1-854441-12 Oct 17 16:28:25.668575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-e6259bee-2b1d-4619-b038-d1fe98eb05ec req-6be8371d-d1b5-4404-8487-79983f949153 service nova] Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:28:25.681062 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e6259bee-2b1d-4619-b038-d1fe98eb05ec req-6be8371d-d1b5-4404-8487-79983f949153 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048652 Oct 17 16:28:25.681731 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3711/7146] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:28:26.025424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:26.026108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:26.035286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:26.035892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:26.036431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:26.037259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:26.037956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:26.038689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:26.611768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:26.621513 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-155e2325-9ff5-423d-8a5d-c6be93e01619 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1677 microversion: 2.1 time: 0.600141 Oct 17 16:28:26.622324 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3436/7147] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:26 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1677 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:27.649043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:27.649771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:27.656981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:27.657499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:27.657938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:27.658689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:27.659316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:27.659747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:27.828456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:27.838127 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0a145ad5-b941-4bc9-838a-87770b1c7116 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1674 microversion: 2.1 time: 0.194335 Oct 17 16:28:27.838654 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3712/7148] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:27 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:27.861437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4ab837c8-445a-49b9-824f-ef2cff2940f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:27.862088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4ab837c8-445a-49b9-824f-ef2cff2940f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:27.869315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ab837c8-445a-49b9-824f-ef2cff2940f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:27.869834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ab837c8-445a-49b9-824f-ef2cff2940f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:27.870286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ab837c8-445a-49b9-824f-ef2cff2940f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:27.871049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ab837c8-445a-49b9-824f-ef2cff2940f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:27.871513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ab837c8-445a-49b9-824f-ef2cff2940f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:27.871973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4ab837c8-445a-49b9-824f-ef2cff2940f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:27.940464 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4ab837c8-445a-49b9-824f-ef2cff2940f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552/action" status: 204 len: 0 microversion: 2.1 time: 0.082898 Oct 17 16:28:27.941170 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3437/7149] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:28:27 2022] POST /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:28:27.951266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:27.952057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:27.958902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:27.959394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:27.960012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:27.960804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:27.961392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:27.961912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:28.106214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:28.114670 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0519e3d-e9eb-4795-abc3-903b0685cb83 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1674 microversion: 2.1 time: 0.167589 Oct 17 16:28:28.115278 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3713/7150] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:27 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:29.143851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:29.145850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:29.157149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:29.157663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:29.158114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:29.158901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:29.159367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:29.159792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:29.300346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:29.309479 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-780496b7-a23c-4560-b4b5-93348d7eba1d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1674 microversion: 2.1 time: 0.173949 Oct 17 16:28:29.310079 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3438/7151] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:29 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:30.334204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:30.335078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:30.348485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:30.348997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:30.349435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:30.350172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:30.350649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:30.351075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:30.498066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:30.507342 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b98acb07-239d-46fd-82a0-847f21b40d28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1666 microversion: 2.1 time: 0.177572 Oct 17 16:28:30.507999 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3714/7152] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:30 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1666 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:30.531544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:30.532210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:30.540303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:30.540868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:30.541361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:30.542132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:30.542668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:30.543139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:30.707041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:30.716227 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-090fafd0-6daf-41fb-a023-47c8502932c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1666 microversion: 2.1 time: 0.188812 Oct 17 16:28:30.716862 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3439/7153] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:30 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1666 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:30.739555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:30.740198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:30.746890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:30.747383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:30.747811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:30.748576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:30.749019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:30.749447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:30.767969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-3b0128a1-d39b-4ae9-b8bd-2a1aea8f80ea req-3dd59fde-b9f5-4a2b-be4f-7278f5911341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc6e5ba-86f5-4348-a094-05b2dca9b552", "name": "network-vif-plugged", "status": "completed", "tag": "851a5ac4-2cbf-41bc-868a-69038e68949c"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:30.779053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3b0128a1-d39b-4ae9-b8bd-2a1aea8f80ea req-3dd59fde-b9f5-4a2b-be4f-7278f5911341 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:30.779919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3b0128a1-d39b-4ae9-b8bd-2a1aea8f80ea req-3dd59fde-b9f5-4a2b-be4f-7278f5911341 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:30.780375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-3b0128a1-d39b-4ae9-b8bd-2a1aea8f80ea req-3dd59fde-b9f5-4a2b-be4f-7278f5911341 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:30.795107 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-3b0128a1-d39b-4ae9-b8bd-2a1aea8f80ea req-3dd59fde-b9f5-4a2b-be4f-7278f5911341 service nova] Creating event network-vif-plugged:851a5ac4-2cbf-41bc-868a-69038e68949c for instance edc6e5ba-86f5-4348-a094-05b2dca9b552 on n-h1-854441-12 Oct 17 16:28:30.801372 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-3b0128a1-d39b-4ae9-b8bd-2a1aea8f80ea req-3dd59fde-b9f5-4a2b-be4f-7278f5911341 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037437 Oct 17 16:28:30.802183 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3440/7154] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:28:30.887536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:30.896313 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-509b7841-24d1-4c1f-be6e-cb723829c122 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1666 microversion: 2.1 time: 0.160778 Oct 17 16:28:30.896878 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3715/7155] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:30 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:30.920185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:30.920865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:30.929436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:30.930067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:30.930689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:30.931573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:30.932166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:30.932801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:30.961689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:28:30.987807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:31.053973 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-31eb12d5-d20c-40e6-8987-0fda111243d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "DELETE /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 204 len: 0 microversion: 2.1 time: 0.138002 Oct 17 16:28:31.055180 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3441/7156] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:28:30 2022] DELETE /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:28:31.066117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:31.066937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:31.073661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:31.074328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:31.074809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:31.075501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:31.075956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:31.076444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:31.208364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:31.218471 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-256ec70e-7518-48c8-9881-0197ee790846 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1672 microversion: 2.1 time: 0.157930 Oct 17 16:28:31.219192 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3716/7157] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:31 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:28:32.247287 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:32.248021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:32.256206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:32.256751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:32.257207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:32.257917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:32.258385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:32.258869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:32.398193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:32.407074 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-52107b7f-c4fe-490b-b5c0-6cf0cd3e2df5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1672 microversion: 2.1 time: 0.164107 Oct 17 16:28:32.407682 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3442/7158] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:32 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:33.315493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3a5956ac-3ef4-4e53-af46-5fc0293806c2 req-1aead026-057a-4891-abe0-e6430a2a6509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc6e5ba-86f5-4348-a094-05b2dca9b552", "name": "network-vif-deleted", "tag": "851a5ac4-2cbf-41bc-868a-69038e68949c"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:33.329684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3a5956ac-3ef4-4e53-af46-5fc0293806c2 req-1aead026-057a-4891-abe0-e6430a2a6509 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:33.330378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3a5956ac-3ef4-4e53-af46-5fc0293806c2 req-1aead026-057a-4891-abe0-e6430a2a6509 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:33.330854 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3a5956ac-3ef4-4e53-af46-5fc0293806c2 req-1aead026-057a-4891-abe0-e6430a2a6509 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:33.343947 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3a5956ac-3ef4-4e53-af46-5fc0293806c2 req-1aead026-057a-4891-abe0-e6430a2a6509 service nova] Creating event network-vif-deleted:851a5ac4-2cbf-41bc-868a-69038e68949c for instance edc6e5ba-86f5-4348-a094-05b2dca9b552 on n-h1-854441-12 Oct 17 16:28:33.349873 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3a5956ac-3ef4-4e53-af46-5fc0293806c2 req-1aead026-057a-4891-abe0-e6430a2a6509 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038119 Oct 17 16:28:33.350521 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3717/7159] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:28:33.431898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:33.432652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:33.440354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:33.441064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:33.442233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:33.443113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:33.443670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:33.444199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:33.486691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:33.487363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:33.488010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:33.488726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lazy-loading 'fault' on Instance uuid edc6e5ba-86f5-4348-a094-05b2dca9b552 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:28:33.537929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:33.548065 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ebaa1c80-2631-42a8-9bf4-c6167bcb2d20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 200 len: 1327 microversion: 2.1 time: 0.120365 Oct 17 16:28:33.548942 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3443/7160] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:33 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:28:34.574334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:34.575065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:34.583546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:34.584479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:34.585107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:34.586935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:34.587413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:34.587845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:34.592756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:34.606616 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 HTTP/1.1 Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'edc6e5ba-86f5-4348-a094-05b2dca9b552'} Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:28:34.608465 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9719ef4a-ed72-4844-86db-deeb33c4ed0a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 404 len: 111 microversion: 2.1 time: 0.040044 Oct 17 16:28:34.612794 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3718/7161] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:34 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:28:34.624224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:34.625482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:34.633209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:34.633895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:34.634165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:34.634937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:34.635405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:34.635840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:34.653250 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 HTTP/1.1 Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'edc6e5ba-86f5-4348-a094-05b2dca9b552'} Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:28:34.655081 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.663911 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:28:34.663911 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:28:34.663911 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:28:34.663911 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:28:34.663911 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:28:34.663911 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:28:34.663911 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:28:34.663911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:28:34.663911 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c9a4ebaa-079b-4fe2-ac39-55311c36d2f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 404 len: 111 microversion: 2.1 time: 0.036457 Oct 17 16:28:34.671012 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3444/7162] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:34 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:28:34.708571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-385943821", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "dc21e39d-7500-499a-acc8-9e05f278215f"}], "security_groups": [{"name": "tempest-securitygroup--392649381"}], "key_name": "tempest-keypair-278774756", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:34.825887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] validate_networks() for [('dc21e39d-7500-499a-acc8-9e05f278215f', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:28:35.224144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:28:35.224851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:28:35.225627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:28:35.226101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:28:35.226857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:28:35.240306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:35.241063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:35.241784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:35.242915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:35.243635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:35.244342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:35.263782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for project 8e6c5e1866204a798695a2ad4b033775. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:28:35.269999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for user 6f67ed748bed490981e06a64cba232cf and project 8e6c5e1866204a798695a2ad4b033775. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:28:35.284672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:28:35.287096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:28:35.333880 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-790aafcb-fb14-4e31-8022-7a795a69aa7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.629217 Oct 17 16:28:35.334766 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3719/7163] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:28:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:28:35.346461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7676783f-e852-4627-916c-a48a9eba04c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:35.347117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7676783f-e852-4627-916c-a48a9eba04c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:35.402914 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7676783f-e852-4627-916c-a48a9eba04c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:35.410442 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7676783f-e852-4627-916c-a48a9eba04c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1237 microversion: 2.1 time: 0.067956 Oct 17 16:28:35.422609 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3445/7164] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:35 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:36.435318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:36.435913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:36.444445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:36.445282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:36.445729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:36.446443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:36.446934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:36.447424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:36.513236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:36.522355 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-371e58ee-4302-44ce-8096-6c9337018ae1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1307 microversion: 2.1 time: 0.092476 Oct 17 16:28:36.523599 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3720/7165] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:36 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:37.548994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:37.549737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:37.559886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:37.560507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:37.561003 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:37.561771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:37.563091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:37.563091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:37.773330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:37.782490 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c1630ba9-3f51-4482-9c2c-8ccefbe0580b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1362 microversion: 2.1 time: 0.238264 Oct 17 16:28:37.783125 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3446/7166] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:37 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:28:37.925778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6d2a6d75-87d3-48d0-a003-0631cd9bc9e0 req-556a0c4d-8941-467b-a0bb-49211e64e874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c9669f-70c5-4972-952b-7c86b8ca4d21", "tag": "ff229e9d-669d-403a-8b4b-402be6969873"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:37.938401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d2a6d75-87d3-48d0-a003-0631cd9bc9e0 req-556a0c4d-8941-467b-a0bb-49211e64e874 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:37.946408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d2a6d75-87d3-48d0-a003-0631cd9bc9e0 req-556a0c4d-8941-467b-a0bb-49211e64e874 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:37.947262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6d2a6d75-87d3-48d0-a003-0631cd9bc9e0 req-556a0c4d-8941-467b-a0bb-49211e64e874 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:37.959233 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6d2a6d75-87d3-48d0-a003-0631cd9bc9e0 req-556a0c4d-8941-467b-a0bb-49211e64e874 service nova] Creating event network-changed:ff229e9d-669d-403a-8b4b-402be6969873 for instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 on n-h2-854441-12 Oct 17 16:28:37.964667 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6d2a6d75-87d3-48d0-a003-0631cd9bc9e0 req-556a0c4d-8941-467b-a0bb-49211e64e874 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042929 Oct 17 16:28:37.965330 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3721/7167] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:28:38.808708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:38.809403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:38.812519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:38.818459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:38.818977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:38.819428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:38.820155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:38.820593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:38.821035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:38.966635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:38.975310 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-94b31367-06ce-47f8-a98e-d4996a7f542e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1362 microversion: 2.1 time: 0.170528 Oct 17 16:28:38.975691 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3447/7168] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:38 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:40.000078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:40.000780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:40.003022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:40.009667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:40.010159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:40.010615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:40.011313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:40.011760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:40.012182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:40.150415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:40.159057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1f2cce92-ce0b-44da-a9e8-72c0085ba2c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1362 microversion: 2.1 time: 0.164324 Oct 17 16:28:40.159642 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3722/7169] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:39 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:41.183770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:41.184348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:41.192010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:41.192517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:41.192980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:41.193708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:41.194282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:41.194677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:41.327854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:41.336136 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-007e62d4-ae22-438e-b1bf-04adfcedf2a3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1362 microversion: 2.1 time: 0.156843 Oct 17 16:28:41.336744 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3448/7170] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:41 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:42.360081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:42.360730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:42.368096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:42.368616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:42.369054 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:42.369761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:42.370217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:42.370676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:42.509029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:42.518669 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1cd520e-4300-4298-ae17-7eb187171d97 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1362 microversion: 2.1 time: 0.162602 Oct 17 16:28:42.519266 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3723/7171] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:42 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:43.543096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:43.543767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:43.551693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:43.552213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:43.552639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:43.553472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:43.553963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:43.554414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:43.699779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:43.708158 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1cfeba94-ab28-401e-b852-3a2e976b5f85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1362 microversion: 2.1 time: 0.169480 Oct 17 16:28:43.708791 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3449/7172] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:43 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:44.719557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c9634c84-3a0f-49ec-a0d7-6e26c921d7a6 req-8c3833f9-d208-4f98-823a-98ab6a224de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c9669f-70c5-4972-952b-7c86b8ca4d21", "name": "network-vif-plugged", "status": "completed", "tag": "ff229e9d-669d-403a-8b4b-402be6969873"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:44.732332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c9634c84-3a0f-49ec-a0d7-6e26c921d7a6 req-8c3833f9-d208-4f98-823a-98ab6a224de0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:44.732633 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:44.733094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c9634c84-3a0f-49ec-a0d7-6e26c921d7a6 req-8c3833f9-d208-4f98-823a-98ab6a224de0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:44.733185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:44.733337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c9634c84-3a0f-49ec-a0d7-6e26c921d7a6 req-8c3833f9-d208-4f98-823a-98ab6a224de0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:44.742184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:44.742781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:44.743194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:44.743983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:44.744639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:44.746208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:44.746827 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c9634c84-3a0f-49ec-a0d7-6e26c921d7a6 req-8c3833f9-d208-4f98-823a-98ab6a224de0 service nova] Creating event network-vif-plugged:ff229e9d-669d-403a-8b4b-402be6969873 for instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 on n-h2-854441-12 Oct 17 16:28:44.756193 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c9634c84-3a0f-49ec-a0d7-6e26c921d7a6 req-8c3833f9-d208-4f98-823a-98ab6a224de0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041997 Oct 17 16:28:44.757214 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3724/7173] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:28:44.967347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:44.977480 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-977da832-46f7-4844-9c73-b49cd0f023e9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1362 microversion: 2.1 time: 0.249593 Oct 17 16:28:44.978102 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3450/7174] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:44 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:28:45.999809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:46.000603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:46.006211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:46.006984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:46.014358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:46.014896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:46.015378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:46.016469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:46.016993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:46.017477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:46.154018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:46.162134 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-279cf690-e41d-4e80-ab28-e121c7a004a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1362 microversion: 2.1 time: 0.163308 Oct 17 16:28:46.162741 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3725/7175] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:45 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:47.186077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:47.186759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:47.188955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:28:47.195949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:47.196466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:47.196928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:47.197729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:47.198140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:47.198615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:47.343596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:28:47.352648 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-10df2f37-18c9-4aa3-9d52-8663ab0fb12b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1549 microversion: 2.1 time: 0.170715 Oct 17 16:28:47.353264 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3451/7176] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:28:47 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:28:47.381721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-537e0caa-70e3-48a1-98f1-268ffcf7d0f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:28:47.382401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-537e0caa-70e3-48a1-98f1-268ffcf7d0f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:28:47.389755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537e0caa-70e3-48a1-98f1-268ffcf7d0f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:47.390369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537e0caa-70e3-48a1-98f1-268ffcf7d0f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:47.390857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537e0caa-70e3-48a1-98f1-268ffcf7d0f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:47.391754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537e0caa-70e3-48a1-98f1-268ffcf7d0f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:47.392198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537e0caa-70e3-48a1-98f1-268ffcf7d0f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:47.392632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-537e0caa-70e3-48a1-98f1-268ffcf7d0f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:47.481114 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-537e0caa-70e3-48a1-98f1-268ffcf7d0f3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107955 Oct 17 16:28:47.481775 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3726/7177] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 16:28:47 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:28:48.503175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-63edcf4e-7b2e-4f59-88b2-0d3aa69dbde3 req-4b23e1e7-b4c5-4419-8b5b-be51cd8b2001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c9669f-70c5-4972-952b-7c86b8ca4d21", "tag": "ff229e9d-669d-403a-8b4b-402be6969873"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:28:48.516615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-63edcf4e-7b2e-4f59-88b2-0d3aa69dbde3 req-4b23e1e7-b4c5-4419-8b5b-be51cd8b2001 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:28:48.517166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-63edcf4e-7b2e-4f59-88b2-0d3aa69dbde3 req-4b23e1e7-b4c5-4419-8b5b-be51cd8b2001 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:28:48.517622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-63edcf4e-7b2e-4f59-88b2-0d3aa69dbde3 req-4b23e1e7-b4c5-4419-8b5b-be51cd8b2001 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:28:48.532996 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-63edcf4e-7b2e-4f59-88b2-0d3aa69dbde3 req-4b23e1e7-b4c5-4419-8b5b-be51cd8b2001 service nova] Creating event network-changed:ff229e9d-669d-403a-8b4b-402be6969873 for instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 on n-h2-854441-12 Oct 17 16:28:48.538717 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-63edcf4e-7b2e-4f59-88b2-0d3aa69dbde3 req-4b23e1e7-b4c5-4419-8b5b-be51cd8b2001 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039364 Oct 17 16:28:48.539430 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3452/7178] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:29:22.455166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=9 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:29:22.456349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=34 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:29:22.464134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e99e82ea-1d62-4c36-bce2-f5e54fa5c15d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:29:22.475866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e99e82ea-1d62-4c36-bce2-f5e54fa5c15d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:22.476721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e99e82ea-1d62-4c36-bce2-f5e54fa5c15d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:22.477498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e99e82ea-1d62-4c36-bce2-f5e54fa5c15d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:22.513219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e99e82ea-1d62-4c36-bce2-f5e54fa5c15d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Going to try to stop instance {{(pid=120406) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 16:29:22.562279 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e99e82ea-1d62-4c36-bce2-f5e54fa5c15d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/action" status: 202 len: 0 microversion: 2.1 time: 0.109796 Oct 17 16:29:22.563165 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3727/7179] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:29:22 2022] POST /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:29:22.571836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=11 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:29:22.573018 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:29:22.579622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:22.580489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:22.592986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:22.593585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:22.594102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:22.594873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:22.595345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:22.595781 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:22.758085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:22.766841 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dd415c89-cab2-4468-8d76-44d17332e78d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.198486 Oct 17 16:29:22.767448 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3453/7180] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:22 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:23.792958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:23.793608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:23.800739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:23.801209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:23.801652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:23.802364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:23.802847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:23.803266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:23.947516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:23.956383 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e394a389-e2b4-4502-adb3-aae829a3b068 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.168658 Oct 17 16:29:23.957064 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3728/7181] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:23 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:24.982421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:24.983079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:24.990524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:24.991045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:24.991496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:24.992212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:24.992671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:24.993109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:25.145933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:25.154958 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-218cea07-62cf-4d9c-8c95-2a9f3c6abcb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.177150 Oct 17 16:29:25.155591 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3454/7182] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:24 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:26.179745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:26.180350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:26.188243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:26.188789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:26.189358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:26.190120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:26.190701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:26.191308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:26.336250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:26.345058 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a181f83-291e-42e4-8c8f-bb66f96c4b0c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.169134 Oct 17 16:29:26.345671 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3729/7183] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:26 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:27.369660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:27.370468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:27.378129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:27.378674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:27.379493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:27.380198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:27.380672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:27.381115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:27.527802 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:27.536524 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b20e1d3e-699e-41eb-9d12-96fdccb0d314 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.171082 Oct 17 16:29:27.537137 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3455/7184] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:27 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:28.561089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:28.561898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:28.569221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:28.569728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:28.570170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:28.570943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:28.571415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:28.571846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:28.744448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:28.758648 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9173f236-fe96-4d8c-9ee3-f18c0837fc7f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.201346 Oct 17 16:29:28.759497 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3730/7185] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:28 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:29.796610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:29.797487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:29.806277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:29.806822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:29.807279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:29.808013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:29.808485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:29.808931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:29.970774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:29.979868 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ce4a695e-469d-47f0-9674-21ca32869fc8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.187260 Oct 17 16:29:29.980653 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3456/7186] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:29 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:31.004935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:31.005732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:31.013443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:31.014032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:31.014602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:31.015606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:31.016163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:31.016694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:31.174255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:31.183388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51f613fd-c5fa-4bea-8fa1-4a972eaa0948 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.182911 Oct 17 16:29:31.184089 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3731/7187] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:30 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:32.207555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:32.208335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:32.216676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:32.217264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:32.217762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:32.218916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:32.219444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:32.220007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:32.388161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:32.397276 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02540987-56cd-40d6-93dd-eb06b69bd091 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.193706 Oct 17 16:29:32.397889 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3457/7188] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:32 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:33.422627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:33.423449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:33.431891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:33.432400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:33.432838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:33.433578 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:33.434040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:33.434475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:33.586793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:33.596505 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-216cfe9c-f9e9-4e30-b51f-18b8b11ea7f1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.178535 Oct 17 16:29:33.597136 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3732/7189] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:33 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:34.635545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:34.636230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:34.645059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:34.645582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:34.646040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:34.646850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:34.647317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:34.647762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:34.809383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:34.825196 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa773711-63d1-472c-908f-7e4d20e8fd46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.193344 Oct 17 16:29:34.826425 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3458/7190] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:34 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:35.865286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:35.865928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:35.874954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:35.875687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:35.876204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:35.876998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:35.877475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:35.878022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:36.399535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:36.414556 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1c620014-61ab-48cc-8c04-db538c81d353 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.553248 Oct 17 16:29:36.415642 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3733/7191] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:35 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:37.443070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:37.443780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:37.451606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:37.452134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:37.452622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:37.453374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:37.453847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:37.454293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:37.604990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:37.620809 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8da6a75-7c5b-45d9-a9ce-3e64dbcc09c0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.181374 Oct 17 16:29:37.621897 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3459/7192] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:37 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:38.646063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:38.646723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:38.654415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:38.655029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:38.655458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:38.656191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:38.656684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:38.657090 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:38.810642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:38.819199 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e4b97212-c34a-4fac-ae9c-270bbc63ba85 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1654 microversion: 2.1 time: 0.177130 Oct 17 16:29:38.819815 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3734/7193] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:38 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1654 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:38.843063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:29:38.845376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:38.852698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:38.853210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:38.853667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:38.854406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:38.854907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:38.855351 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:38.886791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:38.894331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Old instance type m1.heat2, new instance type m1.heat {{(pid=120407) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:29:38.902151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:29:38.902623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:29:38.903122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:29:38.903554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:29:38.903986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:29:38.972447 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [4fd6b0cd-3ada-40fc-bd24-4899c09ceebe] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:29:39.980297 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [4fd6b0cd-3ada-40fc-bd24-4899c09ceebe] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 39356. Oct 17 16:29:39.983964 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6ab7f8f2-b1d5-4658-8cbe-07c5553ee37e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/action" status: 202 len: 0 microversion: 2.1 time: 1.145027 Oct 17 16:29:39.984617 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3460/7194] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:29:38 2022] POST /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/action => generated 0 bytes in 1147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:29:39.997466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:39.998664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:40.011231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:40.012282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:40.013239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:40.014697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:40.015785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:40.016532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:40.204352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:40.218146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-662d9bc7-40f6-4691-b6b3-aabd83f8bc30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.227631 Oct 17 16:29:40.219255 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3735/7195] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:39 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:41.247272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:41.250116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:41.262109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:41.263517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:41.264324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:41.265785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:41.267058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:41.267851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:41.448713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:41.463302 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1fe8f946-b0fb-42b3-8e76-282bb31a37ff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1677 microversion: 2.1 time: 0.224118 Oct 17 16:29:41.464339 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3461/7196] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:41 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:29:42.508387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:42.509545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:42.522422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:42.523326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:42.524075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:42.525345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:42.526156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:42.526939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:42.677072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:42.685891 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-318118af-7d53-400e-af86-87a6d69ee6d2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1682 microversion: 2.1 time: 0.186205 Oct 17 16:29:42.686538 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3736/7197] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:42 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:43.711710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:43.712540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:43.720625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:43.721149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:43.721609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:43.722338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:43.722945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:43.723393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:43.886574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:43.896151 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-086ecc7d-3016-4dad-aaa3-c0a193c0c54c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1682 microversion: 2.1 time: 0.188542 Oct 17 16:29:43.899348 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3462/7198] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:43 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:44.923019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:44.925597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:44.937921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:44.938789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:44.939520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:44.940736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:44.941516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:44.942235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:44.977943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9d1b56f1-7160-493c-be80-e1048ad41f81 req-baa354af-8320-4d57-a92c-455c211e91e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c9669f-70c5-4972-952b-7c86b8ca4d21", "name": "network-vif-unplugged", "status": "completed", "tag": "ff229e9d-669d-403a-8b4b-402be6969873"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:29:45.004578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9d1b56f1-7160-493c-be80-e1048ad41f81 req-baa354af-8320-4d57-a92c-455c211e91e7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:45.005399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9d1b56f1-7160-493c-be80-e1048ad41f81 req-baa354af-8320-4d57-a92c-455c211e91e7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:45.006015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9d1b56f1-7160-493c-be80-e1048ad41f81 req-baa354af-8320-4d57-a92c-455c211e91e7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:45.036416 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9d1b56f1-7160-493c-be80-e1048ad41f81 req-baa354af-8320-4d57-a92c-455c211e91e7 service nova] Creating event network-vif-unplugged:ff229e9d-669d-403a-8b4b-402be6969873 for instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 on n-h1-854441-12 Oct 17 16:29:45.051129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-9d1b56f1-7160-493c-be80-e1048ad41f81 req-baa354af-8320-4d57-a92c-455c211e91e7 service nova] Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:29:45.067486 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9d1b56f1-7160-493c-be80-e1048ad41f81 req-baa354af-8320-4d57-a92c-455c211e91e7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105304 Oct 17 16:29:45.068691 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3463/7199] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:29:45.179934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:45.197411 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af2b2990-2636-4f29-9809-00f32d2acc2f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1681 microversion: 2.1 time: 0.279253 Oct 17 16:29:45.198297 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3737/7200] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:44 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:46.226769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:46.227680 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:46.236215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:46.236836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:46.237362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:46.238046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:46.238575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:46.239077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:46.426459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:46.435402 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2deb4d98-e873-45d3-b881-d7c3e2ebd83d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1681 microversion: 2.1 time: 0.212954 Oct 17 16:29:46.436019 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3464/7201] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:46 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:47.091987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0c9dc5a4-9efb-4905-8a0f-d072c0ead255 req-7836e040-9a1e-4e78-8f93-ad0994c55e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c9669f-70c5-4972-952b-7c86b8ca4d21", "tag": "ff229e9d-669d-403a-8b4b-402be6969873"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:29:47.103457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c9dc5a4-9efb-4905-8a0f-d072c0ead255 req-7836e040-9a1e-4e78-8f93-ad0994c55e20 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:47.103948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c9dc5a4-9efb-4905-8a0f-d072c0ead255 req-7836e040-9a1e-4e78-8f93-ad0994c55e20 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:47.104358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0c9dc5a4-9efb-4905-8a0f-d072c0ead255 req-7836e040-9a1e-4e78-8f93-ad0994c55e20 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:47.117619 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0c9dc5a4-9efb-4905-8a0f-d072c0ead255 req-7836e040-9a1e-4e78-8f93-ad0994c55e20 service nova] Creating event network-changed:ff229e9d-669d-403a-8b4b-402be6969873 for instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 on n-h1-854441-12 Oct 17 16:29:47.124283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-0c9dc5a4-9efb-4905-8a0f-d072c0ead255 req-7836e040-9a1e-4e78-8f93-ad0994c55e20 service nova] Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:29:47.136332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0c9dc5a4-9efb-4905-8a0f-d072c0ead255 req-7836e040-9a1e-4e78-8f93-ad0994c55e20 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048444 Oct 17 16:29:47.136966 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3738/7202] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:29:47.463717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:47.465482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:47.480140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:47.481183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:47.482106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:47.483966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:47.484903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:47.486052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:47.913685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:47.925460 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ecd278b7-593d-4bfe-8c69-65f53c8abb29 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1679 microversion: 2.1 time: 0.469750 Oct 17 16:29:47.926304 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3465/7203] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:47 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1679 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:48.955014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:48.955754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:48.962955 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:48.963461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:48.963911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:48.964700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:48.965212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:48.965618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:49.122096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:49.131732 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c94b29c-4d87-46c7-a0a9-a5de92616aaa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1675 microversion: 2.1 time: 0.183197 Oct 17 16:29:49.132353 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3739/7204] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:48 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:49.155809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81b3642f-2e7f-42b2-8152-3b666a7a8b1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:29:49.156646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-81b3642f-2e7f-42b2-8152-3b666a7a8b1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:49.158697 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:29:49.158938 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/action (ip 10.222.0.87) !!! Oct 17 16:29:49.167048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b3642f-2e7f-42b2-8152-3b666a7a8b1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:49.167566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b3642f-2e7f-42b2-8152-3b666a7a8b1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:49.168058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b3642f-2e7f-42b2-8152-3b666a7a8b1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:49.168763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b3642f-2e7f-42b2-8152-3b666a7a8b1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:49.169231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b3642f-2e7f-42b2-8152-3b666a7a8b1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:49.169674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81b3642f-2e7f-42b2-8152-3b666a7a8b1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:49.242093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81b3642f-2e7f-42b2-8152-3b666a7a8b1b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/action" status: 204 len: 0 microversion: 2.1 time: 0.090407 Oct 17 16:29:49.242982 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3466/7205] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:29:49 2022] POST /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 16:29:49.274709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:49.275952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:49.290681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:49.291593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:49.292417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:49.293686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:49.294707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:49.295460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:49.507470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:49.516487 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-600320a4-c006-4317-a809-9fb60e4a6ad5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1675 microversion: 2.1 time: 0.268260 Oct 17 16:29:49.517599 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3740/7206] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:49 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1675 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:50.543654 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:50.544694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:50.552648 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:50.553297 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:50.553833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:50.554753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:50.555304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:50.555830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:50.582726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:29:50.787447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:50.796715 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ccfa2dbc-8e9f-48eb-9fe0-b6f24d3b20ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1675 microversion: 2.1 time: 0.259809 Oct 17 16:29:50.797369 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3467/7207] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:50 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1675 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:29:51.231992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e74180ff-ea01-4117-b919-a0299e1d5bff req-860c876c-eee0-4238-a92c-f267c32258f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c9669f-70c5-4972-952b-7c86b8ca4d21", "name": "network-vif-plugged", "status": "completed", "tag": "ff229e9d-669d-403a-8b4b-402be6969873"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:29:51.247813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e74180ff-ea01-4117-b919-a0299e1d5bff req-860c876c-eee0-4238-a92c-f267c32258f7 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:51.248313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e74180ff-ea01-4117-b919-a0299e1d5bff req-860c876c-eee0-4238-a92c-f267c32258f7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:51.248749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e74180ff-ea01-4117-b919-a0299e1d5bff req-860c876c-eee0-4238-a92c-f267c32258f7 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:51.261943 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e74180ff-ea01-4117-b919-a0299e1d5bff req-860c876c-eee0-4238-a92c-f267c32258f7 service nova] Creating event network-vif-plugged:ff229e9d-669d-403a-8b4b-402be6969873 for instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 on n-h1-854441-12 Oct 17 16:29:51.267565 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e74180ff-ea01-4117-b919-a0299e1d5bff req-860c876c-eee0-4238-a92c-f267c32258f7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043979 Oct 17 16:29:51.268553 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3741/7208] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:29:51.830681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:51.831826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:51.844447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:51.845239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:51.846034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:51.847391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:51.848200 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:51.848999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:51.993524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:52.002184 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-28deef19-881f-4207-8421-27c7670d77c9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1654 microversion: 2.1 time: 0.178807 Oct 17 16:29:52.002880 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3468/7209] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:51 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1654 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:52.026894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:52.027690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:52.034419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:52.034935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:52.035371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:52.036080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:52.036536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:52.036954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:52.181988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:52.190537 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbdb8321-8792-4b05-9d61-eeb785478b20 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1654 microversion: 2.1 time: 0.168706 Oct 17 16:29:52.191154 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3742/7210] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:52 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:52.232083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d55e4d4a-e67e-47e1-8a50-5c585f97ec57 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:29:52.243210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d55e4d4a-e67e-47e1-8a50-5c585f97ec57 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:52.244121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d55e4d4a-e67e-47e1-8a50-5c585f97ec57 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:52.244957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d55e4d4a-e67e-47e1-8a50-5c585f97ec57 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:52.279075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d55e4d4a-e67e-47e1-8a50-5c585f97ec57 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Going to try to start instance {{(pid=120407) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 16:29:52.329433 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d55e4d4a-e67e-47e1-8a50-5c585f97ec57 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/action" status: 202 len: 0 microversion: 2.1 time: 0.103722 Oct 17 16:29:52.330069 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3469/7211] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:29:52 2022] POST /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:29:52.339031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:52.340155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:52.346553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:52.347081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:52.347741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:52.348690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:52.349328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:52.349827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:52.370246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:29:52.514384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:52.527411 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bf361157-2070-4394-a8bf-d475c401a870 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1663 microversion: 2.1 time: 0.192564 Oct 17 16:29:52.529332 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3743/7212] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:52 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1663 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:53.560108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:53.560867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:53.566730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=39 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:29:53.579618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:53.580481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:53.581313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:53.582596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:53.583642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:53.584463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:53.734122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:53.742759 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e8facdaa-029c-4504-b328-1fabe16b3fbb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1667 microversion: 2.1 time: 0.187328 Oct 17 16:29:53.743376 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3470/7213] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:53 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1667 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:53.766648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:53.767256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:53.770293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=35 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:29:53.775928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:53.776429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:53.776863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:53.777843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:53.778321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:53.778793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:53.806086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:29:53.900133 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e7759d9a-4f1b-47b3-855b-5b12d2c76bf5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 204 len: 0 microversion: 2.1 time: 0.137731 Oct 17 16:29:53.900866 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3744/7214] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:29:53 2022] DELETE /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:29:53.909169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:53.909794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:53.916130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:53.916639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:53.917102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:53.917821 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:53.918262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:53.918787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:54.061715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:54.070420 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-49040536-9f12-4d79-ab2f-92511d0e4388 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1673 microversion: 2.1 time: 0.165184 Oct 17 16:29:54.071259 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3471/7215] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:53 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:55.097114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:55.097849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:55.106311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:55.106836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:55.107278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:55.107995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:55.108545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:55.108974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:55.267956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:55.277276 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c905310-84be-420c-9b6f-27e8f25a1877 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1673 microversion: 2.1 time: 0.185344 Oct 17 16:29:55.277892 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3745/7216] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:55 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:56.228675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ea020800-b1ff-4c80-83df-96c9fd52e2cc req-d5c8a987-e4e6-404d-9302-4dedfde1f03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c9669f-70c5-4972-952b-7c86b8ca4d21", "name": "network-vif-deleted", "tag": "ff229e9d-669d-403a-8b4b-402be6969873"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:29:56.238690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ea020800-b1ff-4c80-83df-96c9fd52e2cc req-d5c8a987-e4e6-404d-9302-4dedfde1f03f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:56.239172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ea020800-b1ff-4c80-83df-96c9fd52e2cc req-d5c8a987-e4e6-404d-9302-4dedfde1f03f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:56.239612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ea020800-b1ff-4c80-83df-96c9fd52e2cc req-d5c8a987-e4e6-404d-9302-4dedfde1f03f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:56.251725 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ea020800-b1ff-4c80-83df-96c9fd52e2cc req-d5c8a987-e4e6-404d-9302-4dedfde1f03f service nova] Creating event network-vif-deleted:ff229e9d-669d-403a-8b4b-402be6969873 for instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 on n-h1-854441-12 Oct 17 16:29:56.257509 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ea020800-b1ff-4c80-83df-96c9fd52e2cc req-d5c8a987-e4e6-404d-9302-4dedfde1f03f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032877 Oct 17 16:29:56.258298 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3472/7217] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:29:56.301279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:56.301984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:56.309367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:56.309904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:56.310371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:56.311161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:56.311853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:56.312490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:56.352446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:56.352929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:56.353560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:56.354019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lazy-loading 'fault' on Instance uuid f4c9669f-70c5-4972-952b-7c86b8ca4d21 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:29:56.397646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:56.408939 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d65703d7-f9d3-4dfb-b3d4-0b5762633ca3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 200 len: 1327 microversion: 2.1 time: 0.111598 Oct 17 16:29:56.409550 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3746/7218] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:56 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:29:57.434467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:57.435185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:57.443756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:57.444318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:57.444928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:57.445974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:57.446676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:57.447219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:57.462328 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 HTTP/1.1 Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f4c9669f-70c5-4972-952b-7c86b8ca4d21'} Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:29:57.464041 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-74f3bd5c-7a4c-4701-ae5d-f3df1bb23e54 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 404 len: 111 microversion: 2.1 time: 0.036637 Oct 17 16:29:57.468864 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3473/7219] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:57 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:29:57.483538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:57.484160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:57.491307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:57.491827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:57.492243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:57.492941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:57.493395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:57.493826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:57.508973 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 HTTP/1.1 Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'f4c9669f-70c5-4972-952b-7c86b8ca4d21'} Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:29:57.510726 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c7176a83-cec1-4ed8-a1ca-b0c7326e9ecf tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 404 len: 111 microversion: 2.1 time: 0.032667 Oct 17 16:29:57.516002 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3747/7220] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:57 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:29:57.562216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1298662974", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "dc21e39d-7500-499a-acc8-9e05f278215f"}], "security_groups": [{"name": "tempest-securitygroup--392649381"}], "key_name": "tempest-keypair-278774756", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:29:57.675820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] validate_networks() for [('dc21e39d-7500-499a-acc8-9e05f278215f', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:29:58.058125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:29:58.058578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:29:58.059063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:29:58.059486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:29:58.059910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:29:58.070458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:58.071022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:58.071489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:58.072331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:58.072829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:58.073270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:58.097856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for project 8e6c5e1866204a798695a2ad4b033775. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:29:58.110983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for user 6f67ed748bed490981e06a64cba232cf and project 8e6c5e1866204a798695a2ad4b033775. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:29:58.127508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:29:58.130244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:29:58.179826 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4660cbf3-9ce3-4883-af62-cec424dc9d3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.621669 Oct 17 16:29:58.180481 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3474/7221] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:29:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:29:58.192414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5152345f-1bfa-4458-bd2b-f18ea2155ff8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:58.193084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5152345f-1bfa-4458-bd2b-f18ea2155ff8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:58.247020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5152345f-1bfa-4458-bd2b-f18ea2155ff8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:58.255169 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5152345f-1bfa-4458-bd2b-f18ea2155ff8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1238 microversion: 2.1 time: 0.066817 Oct 17 16:29:58.255761 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3748/7222] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:58 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:29:59.280282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:29:59.280985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:29:59.290941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:59.291464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:59.291916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:59.292653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:29:59.293130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:29:59.293578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:29:59.371875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:29:59.381039 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aa654cb2-b2fa-40d5-a797-3251fcd346ee tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1298 microversion: 2.1 time: 0.105472 Oct 17 16:29:59.381627 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3475/7223] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:29:59 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:00.405803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:00.406399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:00.415202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:00.415726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:00.416167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:00.416899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:00.417358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:00.417785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:00.577672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:00.588814 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ac3385d-3d36-4913-b8da-5319721e6765 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1363 microversion: 2.1 time: 0.186879 Oct 17 16:30:00.589427 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3749/7224] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:00 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:01.148526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f49d9f08-113d-46ba-8bd4-cf8ae4daf6bd req-aef5cd4e-ef4d-4550-9878-f9183c6016dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8490271e-599c-4e4d-99c7-ea3586c1df8d", "tag": "c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:30:01.160308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f49d9f08-113d-46ba-8bd4-cf8ae4daf6bd req-aef5cd4e-ef4d-4550-9878-f9183c6016dd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:01.160806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f49d9f08-113d-46ba-8bd4-cf8ae4daf6bd req-aef5cd4e-ef4d-4550-9878-f9183c6016dd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:01.161424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f49d9f08-113d-46ba-8bd4-cf8ae4daf6bd req-aef5cd4e-ef4d-4550-9878-f9183c6016dd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:01.173850 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f49d9f08-113d-46ba-8bd4-cf8ae4daf6bd req-aef5cd4e-ef4d-4550-9878-f9183c6016dd service nova] Creating event network-changed:c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e for instance 8490271e-599c-4e4d-99c7-ea3586c1df8d on n-h2-854441-12 Oct 17 16:30:01.179540 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f49d9f08-113d-46ba-8bd4-cf8ae4daf6bd req-aef5cd4e-ef4d-4550-9878-f9183c6016dd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035356 Oct 17 16:30:01.180570 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3476/7225] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:30:01.613340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:01.613984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:01.621653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:01.622151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:01.622626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:01.623334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:01.623790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:01.624201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:01.766003 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:01.773929 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4d5e259e-149b-4db1-9362-6962d9c65cb9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1363 microversion: 2.1 time: 0.164715 Oct 17 16:30:01.774521 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3750/7226] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:01 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:02.799188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:02.799910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:02.806636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:02.807231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:02.807692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:02.808416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:02.808890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:02.809333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:02.968478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:02.976813 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a2171e8e-0dc8-482e-a8ba-fd4d6b8693e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1363 microversion: 2.1 time: 0.183217 Oct 17 16:30:02.977425 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3477/7227] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:02 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:04.001497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:04.002093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:04.011004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:04.011496 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:04.011940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:04.012652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:04.013109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:04.013537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:04.160006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:04.170978 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ab5a16f-af23-4ea4-bc23-14b1fcacc4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1363 microversion: 2.1 time: 0.175064 Oct 17 16:30:04.171576 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3751/7228] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:03 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:30:05.195219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:05.195976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:05.204017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:05.204540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:05.205768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:05.206536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:05.207011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:05.207623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:05.346713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:05.355304 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a081a5e0-1daf-48c9-a9c3-02597f67167f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1363 microversion: 2.1 time: 0.164263 Oct 17 16:30:05.355914 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3478/7229] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:05 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:06.380351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:06.381698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:06.389667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:06.390527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:06.391052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:06.391782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:06.392309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:06.392738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:06.538100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:06.546852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb7caff8-9954-4b62-a503-71c0f7297894 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1363 microversion: 2.1 time: 0.171054 Oct 17 16:30:06.547813 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3752/7230] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:06 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:07.216418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cbfe0242-d768-454d-b994-89a6aadee70f req-b485e023-e1ba-47bf-bb1d-181f011e6dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8490271e-599c-4e4d-99c7-ea3586c1df8d", "name": "network-vif-plugged", "status": "completed", "tag": "c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:30:07.229549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cbfe0242-d768-454d-b994-89a6aadee70f req-b485e023-e1ba-47bf-bb1d-181f011e6dc4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:07.230310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cbfe0242-d768-454d-b994-89a6aadee70f req-b485e023-e1ba-47bf-bb1d-181f011e6dc4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:07.231495 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cbfe0242-d768-454d-b994-89a6aadee70f req-b485e023-e1ba-47bf-bb1d-181f011e6dc4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:07.244306 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cbfe0242-d768-454d-b994-89a6aadee70f req-b485e023-e1ba-47bf-bb1d-181f011e6dc4 service nova] Creating event network-vif-plugged:c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e for instance 8490271e-599c-4e4d-99c7-ea3586c1df8d on n-h2-854441-12 Oct 17 16:30:07.249884 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cbfe0242-d768-454d-b994-89a6aadee70f req-b485e023-e1ba-47bf-bb1d-181f011e6dc4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037190 Oct 17 16:30:07.250538 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3479/7231] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:30:07.570957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:07.571518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:07.579076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:07.579630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:07.580102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:07.580819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:07.581270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:07.581697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:07.716881 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:07.725172 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e695c8a4-82a7-4a4d-8c74-6ff6100e9253 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1363 microversion: 2.1 time: 0.158312 Oct 17 16:30:07.725763 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3753/7232] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:07 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:08.746530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:30:08.747324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:30:08.752746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:08.753646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:08.762056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:08.762476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:08.762962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:08.764069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:08.764540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:08.764980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:08.912019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:08.920339 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c8d64c98-13eb-4af7-91a4-a9b52e6006f5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1549 microversion: 2.1 time: 0.174812 Oct 17 16:30:08.920936 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3480/7233] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:08 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:08.943464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76192b25-8837-429d-83e6-e53620093f99 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:08.944179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76192b25-8837-429d-83e6-e53620093f99 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:08.945999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:30:08.952443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76192b25-8837-429d-83e6-e53620093f99 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:08.952934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76192b25-8837-429d-83e6-e53620093f99 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:08.953359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76192b25-8837-429d-83e6-e53620093f99 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:08.954061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76192b25-8837-429d-83e6-e53620093f99 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:08.954575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76192b25-8837-429d-83e6-e53620093f99 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:08.955004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76192b25-8837-429d-83e6-e53620093f99 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:09.041131 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76192b25-8837-429d-83e6-e53620093f99 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101589 Oct 17 16:30:09.041756 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3754/7234] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 16:30:08 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:30:10.368794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-263138b9-63b1-4677-9f7d-e4987309946b req-2db3291e-f27b-426f-9fac-aeedb33d4f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8490271e-599c-4e4d-99c7-ea3586c1df8d", "tag": "c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:30:10.380933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-263138b9-63b1-4677-9f7d-e4987309946b req-2db3291e-f27b-426f-9fac-aeedb33d4f5d service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:10.381433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-263138b9-63b1-4677-9f7d-e4987309946b req-2db3291e-f27b-426f-9fac-aeedb33d4f5d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:10.381868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-263138b9-63b1-4677-9f7d-e4987309946b req-2db3291e-f27b-426f-9fac-aeedb33d4f5d service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:10.393697 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-263138b9-63b1-4677-9f7d-e4987309946b req-2db3291e-f27b-426f-9fac-aeedb33d4f5d service nova] Creating event network-changed:c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e for instance 8490271e-599c-4e4d-99c7-ea3586c1df8d on n-h2-854441-12 Oct 17 16:30:10.399291 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-263138b9-63b1-4677-9f7d-e4987309946b req-2db3291e-f27b-426f-9fac-aeedb33d4f5d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034286 Oct 17 16:30:10.401223 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3481/7235] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:30:44.298388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:30:44.299216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:30:44.303703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:30:44.305972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:44.313794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:44.314270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:44.314763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:44.315613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:44.316062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:44.316484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:44.347773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:44.353748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:30:44.361296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:30:44.361528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:30:44.362217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:30:44.362748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:30:44.363107 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:30:44.430596 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8731294f-e6c6-4e03-9648-ae6caecc5b87 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d/action" status: 202 len: 0 microversion: 2.1 time: 0.134179 Oct 17 16:30:44.431373 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3755/7236] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:30:44 2022] POST /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:30:44.438465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:30:44.439288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:30:44.444819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:44.445046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:44.454041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:44.454656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:44.455254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:44.456027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:44.456505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:44.457243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:44.625789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:44.634745 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ba3946ec-9742-4072-b1d4-01691a5e6ba5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1676 microversion: 2.1 time: 0.198740 Oct 17 16:30:44.635464 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3482/7237] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:44 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:45.658849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:45.659461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:45.667900 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:45.668401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:45.668836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:45.669520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:45.669996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:45.670424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:45.808676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:45.817089 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-358c29a3-30f4-4ae1-b36e-3455f0008387 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1676 microversion: 2.1 time: 0.162470 Oct 17 16:30:45.817682 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3756/7238] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:45 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:46.841820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:46.842437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:46.849831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:46.850344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:46.850827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:46.851614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:46.852085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:46.852514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:46.987549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:46.996240 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6d67278-8b04-4a85-a0f6-d0001a4045f8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.158523 Oct 17 16:30:46.996840 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3483/7239] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:46 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:48.022766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:48.023403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:48.031397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:48.031905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:48.032502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:48.033198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:48.033655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:48.034081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:48.174996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:48.183306 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb317e9c-8a91-42be-89bb-b789c1f7a445 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.165263 Oct 17 16:30:48.183944 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3757/7240] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:48 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:49.206334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:49.206984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:49.216468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:49.217184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:49.217858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:49.219038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:49.219711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:49.220286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:49.373664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:49.384084 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-db562637-ea1b-44e9-be43-33dcfbfe16d5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.181714 Oct 17 16:30:49.384696 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3484/7241] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:49 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:50.407966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:50.408663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:50.416338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:50.416871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:50.417302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:50.418045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:50.418523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:50.418954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:50.563954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:50.572777 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-622fc3a0-7447-4b16-a346-4173e556c3be tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.168990 Oct 17 16:30:50.573388 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3758/7242] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:50 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:51.596957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:51.597577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:51.604825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:51.605326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:51.605775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:51.606490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:51.606997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:51.607426 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:51.756237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:51.764577 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4bbf0326-3c39-4a27-94b1-f7c2623fef28 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.171737 Oct 17 16:30:51.765168 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3485/7243] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:51 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:52.790166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:52.790892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:52.800420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:52.800971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:52.801436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:52.802143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:52.802620 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:52.803043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:52.951264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:52.960676 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a799d45-2525-4523-b54c-4fe349a64a80 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.175913 Oct 17 16:30:52.961295 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3759/7244] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:52 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:53.987035 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:53.987878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:53.998540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:53.999079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:53.999875 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:54.001137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:54.001978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:54.002815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:54.163187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:54.171571 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ebd71244-7494-45ab-b8fd-4f346019b8b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.189033 Oct 17 16:30:54.172128 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3486/7245] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:53 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:55.196092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:55.196730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:55.205047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:55.205655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:55.206086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:55.207070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:55.207597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:55.208116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:55.348633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:55.358473 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-409844cb-cb1d-41a3-b779-12aebd82ba7e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.166948 Oct 17 16:30:55.359113 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3760/7246] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:55 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:56.384320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:56.384961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:56.392362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:56.392895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:56.393355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:56.394113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:56.394629 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:56.395134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:56.564694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:56.573090 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ba71868-311e-40b8-8098-d6a7bff4fb0b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.192949 Oct 17 16:30:56.573693 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3487/7247] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:56 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:57.598354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:57.599139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:57.606484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:57.607009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:57.607451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:57.608167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:57.608658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:57.609086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:57.752393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:57.761033 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2380fde5-a824-49f0-acca-ce58172d2c11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.166949 Oct 17 16:30:57.761635 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3761/7248] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:57 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:58.786398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:58.787398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:58.796878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:58.797395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:58.797845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:58.798732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:58.799423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:58.800069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:58.953160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:30:58.961972 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2a9f490-3d93-4cad-b324-eda720edcb86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.180423 Oct 17 16:30:58.962620 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3488/7249] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:58 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:30:59.985589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:30:59.986180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:30:59.992857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:59.993349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:59.993788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:30:59.994488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:30:59.994985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:30:59.995400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:00.141452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:00.153689 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0309454-7e90-4bcc-bba0-202736f852b7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.172069 Oct 17 16:31:00.154324 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3762/7250] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:30:59 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:01.177959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:01.178666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:01.185976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:01.186477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:01.186953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:01.187671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:01.188135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:01.188605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:01.350218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:01.359931 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed783ca2-ae68-4d9b-a359-07f33c0b7340 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.185970 Oct 17 16:31:01.360554 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3489/7251] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:01 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:02.384445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:02.385081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:02.392566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:02.393055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:02.393495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:02.394205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:02.394692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:02.395109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:02.537130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:02.546315 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-091eb286-76f9-412c-b226-f6fff475dc61 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1681 microversion: 2.1 time: 0.165929 Oct 17 16:31:02.546934 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3763/7252] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:02 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:03.569835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:03.570632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:03.577840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:03.578949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:03.579419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:03.580712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:03.580712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:03.581093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:03.812311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:03.820856 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4a6d408f-3dc0-441c-8db6-c4de6d529ed1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1680 microversion: 2.1 time: 0.255027 Oct 17 16:31:03.821488 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3490/7253] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:03 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:04.047033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-80fac465-c294-405c-bea0-1aa46db6c7e6 req-baacf1c1-a4c8-4ce6-b9a0-9b49adde6fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8490271e-599c-4e4d-99c7-ea3586c1df8d", "name": "network-vif-unplugged", "status": "completed", "tag": "c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:31:04.058805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-80fac465-c294-405c-bea0-1aa46db6c7e6 req-baacf1c1-a4c8-4ce6-b9a0-9b49adde6fd4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:04.059346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-80fac465-c294-405c-bea0-1aa46db6c7e6 req-baacf1c1-a4c8-4ce6-b9a0-9b49adde6fd4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:04.059935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-80fac465-c294-405c-bea0-1aa46db6c7e6 req-baacf1c1-a4c8-4ce6-b9a0-9b49adde6fd4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:04.073787 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-80fac465-c294-405c-bea0-1aa46db6c7e6 req-baacf1c1-a4c8-4ce6-b9a0-9b49adde6fd4 service nova] Creating event network-vif-unplugged:c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e for instance 8490271e-599c-4e4d-99c7-ea3586c1df8d on n-h1-854441-12 Oct 17 16:31:04.080444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-80fac465-c294-405c-bea0-1aa46db6c7e6 req-baacf1c1-a4c8-4ce6-b9a0-9b49adde6fd4 service nova] Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:31:04.092004 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-80fac465-c294-405c-bea0-1aa46db6c7e6 req-baacf1c1-a4c8-4ce6-b9a0-9b49adde6fd4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048702 Oct 17 16:31:04.093042 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3764/7254] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:31:04.845890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:04.846486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:04.853835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:04.854341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:04.854835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:04.855561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:04.856034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:04.856461 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:05.104231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:05.112698 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2155ccf2-6ec9-41ee-bfe8-7eb224f8d4a9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1680 microversion: 2.1 time: 0.271057 Oct 17 16:31:05.113313 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3491/7255] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:04 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:06.111685 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0bf8cf2d-598d-4024-bb9e-e9d87d7caa4c req-d3087542-39ff-4b60-a66d-e05cd7710cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8490271e-599c-4e4d-99c7-ea3586c1df8d", "tag": "c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:31:06.121956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0bf8cf2d-598d-4024-bb9e-e9d87d7caa4c req-d3087542-39ff-4b60-a66d-e05cd7710cc9 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:06.122442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0bf8cf2d-598d-4024-bb9e-e9d87d7caa4c req-d3087542-39ff-4b60-a66d-e05cd7710cc9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:06.122914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0bf8cf2d-598d-4024-bb9e-e9d87d7caa4c req-d3087542-39ff-4b60-a66d-e05cd7710cc9 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:06.136202 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0bf8cf2d-598d-4024-bb9e-e9d87d7caa4c req-d3087542-39ff-4b60-a66d-e05cd7710cc9 service nova] Creating event network-changed:c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e for instance 8490271e-599c-4e4d-99c7-ea3586c1df8d on n-h1-854441-12 Oct 17 16:31:06.139343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:06.140220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:06.142427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-0bf8cf2d-598d-4024-bb9e-e9d87d7caa4c req-d3087542-39ff-4b60-a66d-e05cd7710cc9 service nova] Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:31:06.149490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:06.150029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:06.150757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:06.151896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:06.153101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:06.153581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:06.154358 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0bf8cf2d-598d-4024-bb9e-e9d87d7caa4c req-d3087542-39ff-4b60-a66d-e05cd7710cc9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047839 Oct 17 16:31:06.155197 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3765/7256] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:31:06.386173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:06.397917 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-af2192a3-3e94-4134-ab6d-23446b5e07e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1678 microversion: 2.1 time: 0.263948 Oct 17 16:31:06.398753 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3492/7257] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:06 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1678 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:07.424796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:07.425671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:07.434180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:07.434721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:07.435160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:07.435871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:07.436333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:07.436760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:07.581503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:07.590162 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb95336a-ea5a-4190-8ee8-c6c23efc002d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1675 microversion: 2.1 time: 0.170486 Oct 17 16:31:07.590734 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3766/7258] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:07 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:07.615169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:31:07.615750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:07.623376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:07.623871 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:07.624322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:07.625032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:07.625479 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:07.625939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:07.666437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:07.666969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:07.667427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:07.668161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:07.668628 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:07.669067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:07.689957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for project 8e6c5e1866204a798695a2ad4b033775. Resources: {'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:31:07.695846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for user 6f67ed748bed490981e06a64cba232cf and project 8e6c5e1866204a798695a2ad4b033775. Resources: {'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:31:07.810416 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-06a6aef0-85fd-4ec2-bbe1-ad1329ba43bd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d/action" status: 202 len: 0 microversion: 2.1 time: 0.200396 Oct 17 16:31:07.811207 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3493/7259] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:31:07 2022] POST /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 16:31:07.820929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:07.821907 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:07.830675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:07.831768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:07.832380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:07.833506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:07.834350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:07.835000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:07.986296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:07.994892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4be2ff8d-255e-4a23-8e1c-84dbbb0ef36c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1674 microversion: 2.1 time: 0.178856 Oct 17 16:31:07.995819 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3767/7260] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:07 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:09.020077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:09.021099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:09.030520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:09.031096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:09.031585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:09.032438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:09.032959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:09.033435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:09.176113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:09.185435 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b69abb20-371e-4e47-becb-ffbe8bf11cf2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1674 microversion: 2.1 time: 0.169889 Oct 17 16:31:09.185925 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3494/7261] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:09 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:10.209469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:10.210105 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:10.217848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:10.218365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:10.218828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:10.219538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:10.219996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:10.220414 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:10.370416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:10.379628 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1b305f90-a394-483f-a8c4-b6bb544239e6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1674 microversion: 2.1 time: 0.174132 Oct 17 16:31:10.380337 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3768/7262] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:10 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:11.404166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:11.404832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:11.412031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:11.412534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:11.413160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:11.413900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:11.414374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:11.414850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:11.438450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:31:11.608010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:11.617710 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8d11122c-1947-4ad7-974a-79fdb6812cb0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1674 microversion: 2.1 time: 0.217652 Oct 17 16:31:11.618306 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3495/7263] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:11 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:12.246996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c5b56a81-00d3-45b9-b4f2-591e414dbd3a req-cc223ca9-58d0-4d2a-8602-8111acfeda5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8490271e-599c-4e4d-99c7-ea3586c1df8d", "tag": "c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:31:12.261009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5b56a81-00d3-45b9-b4f2-591e414dbd3a req-cc223ca9-58d0-4d2a-8602-8111acfeda5a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:12.261872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5b56a81-00d3-45b9-b4f2-591e414dbd3a req-cc223ca9-58d0-4d2a-8602-8111acfeda5a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:12.262705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c5b56a81-00d3-45b9-b4f2-591e414dbd3a req-cc223ca9-58d0-4d2a-8602-8111acfeda5a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:12.283939 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c5b56a81-00d3-45b9-b4f2-591e414dbd3a req-cc223ca9-58d0-4d2a-8602-8111acfeda5a service nova] Creating event network-changed:c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e for instance 8490271e-599c-4e4d-99c7-ea3586c1df8d on n-h2-854441-12 Oct 17 16:31:12.292042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-c5b56a81-00d3-45b9-b4f2-591e414dbd3a req-cc223ca9-58d0-4d2a-8602-8111acfeda5a service nova] Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:31:12.304924 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c5b56a81-00d3-45b9-b4f2-591e414dbd3a req-cc223ca9-58d0-4d2a-8602-8111acfeda5a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061601 Oct 17 16:31:12.305552 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3769/7264] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:31:12.649459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:12.650272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:12.664643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:12.665145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:12.665596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:12.666318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:12.666815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:12.667279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:13.046419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:13.061019 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5db729d-b715-40ba-8ea6-515ef4ea0b46 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1674 microversion: 2.1 time: 0.420323 Oct 17 16:31:13.063571 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3496/7265] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:12 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1674 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:31:14.092793 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:14.093501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:14.100417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:14.100906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:14.101344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:14.102046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:14.102515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:14.102943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:14.265115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:14.276531 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-baac2c1d-4be7-4078-8f07-e4f5d7403606 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1674 microversion: 2.1 time: 0.188807 Oct 17 16:31:14.277538 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3770/7266] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:14 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:15.301191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:15.301856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:15.304967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:31:15.310928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:15.311491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:15.311946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:15.312675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:15.313140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:15.313576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:15.566795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:15.584081 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7e19b85c-2266-47e5-bf7c-f7bb08d89dc6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1667 microversion: 2.1 time: 0.286847 Oct 17 16:31:15.584682 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3497/7267] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:15 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1667 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:15.608518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:15.609074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:15.613129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=37 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:31:15.617462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:15.617935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:15.618376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:15.619109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:15.619561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:15.619981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:15.624465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:31:15.822625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:15.831749 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3b1a790f-2a05-4e8f-9c4d-e4685a38abf3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1667 microversion: 2.1 time: 0.227237 Oct 17 16:31:15.832337 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3771/7268] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:15 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1667 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:15.854283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:15.854973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:15.861977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:15.862414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:15.862891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:15.863607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:15.864074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:15.864511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:15.999402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:16.011431 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-481ffbd3-3624-468f-bf5f-8f572646213c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1667 microversion: 2.1 time: 0.160928 Oct 17 16:31:16.012064 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3498/7269] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:15 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:16.040507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:16.040999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:16.047515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:16.048035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:16.048466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:16.049164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:16.049613 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:16.050039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:16.076072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:31:16.158112 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ab39d2a-003a-4f5b-ac9b-d9e3033e316c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 204 len: 0 microversion: 2.1 time: 0.121391 Oct 17 16:31:16.159344 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3772/7270] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:31:16 2022] DELETE /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:31:16.173007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:16.173954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:16.182898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:16.183398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:16.183831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:16.184555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:16.185016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:16.185453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:16.328863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:16.339157 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2dfc94f4-1646-43a6-b59e-2f0a1811df52 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1673 microversion: 2.1 time: 0.174082 Oct 17 16:31:16.339771 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3499/7271] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:16 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:17.364248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:17.364948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:17.372263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:17.372736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:17.373169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:17.373858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:17.374318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:17.374872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:17.518111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:17.527216 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f323e380-6c95-4964-8822-7d8e7921e087 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1673 microversion: 2.1 time: 0.167274 Oct 17 16:31:17.530538 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3773/7272] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:17 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:18.265833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cd07858d-fee7-4cf9-a867-e822980be4c0 req-6350e00c-fa36-4e7e-b103-41f07f29b34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8490271e-599c-4e4d-99c7-ea3586c1df8d", "name": "network-vif-deleted", "tag": "c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:31:18.274183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:31:18.282860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cd07858d-fee7-4cf9-a867-e822980be4c0 req-6350e00c-fa36-4e7e-b103-41f07f29b34c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:18.283361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cd07858d-fee7-4cf9-a867-e822980be4c0 req-6350e00c-fa36-4e7e-b103-41f07f29b34c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:18.283808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cd07858d-fee7-4cf9-a867-e822980be4c0 req-6350e00c-fa36-4e7e-b103-41f07f29b34c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:18.298648 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cd07858d-fee7-4cf9-a867-e822980be4c0 req-6350e00c-fa36-4e7e-b103-41f07f29b34c service nova] Creating event network-vif-deleted:c8e6166d-a42d-4dd8-99ec-c1ffc84ba10e for instance 8490271e-599c-4e4d-99c7-ea3586c1df8d on n-h2-854441-12 Oct 17 16:31:18.305841 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cd07858d-fee7-4cf9-a867-e822980be4c0 req-6350e00c-fa36-4e7e-b103-41f07f29b34c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044773 Oct 17 16:31:18.306866 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3500/7273] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:31:18.550997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:18.552119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:18.559758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:18.560232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:18.560708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:18.561434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:18.561867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:18.562314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:18.598540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:18.599032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:18.599475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:18.599933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lazy-loading 'fault' on Instance uuid 8490271e-599c-4e4d-99c7-ea3586c1df8d {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:31:18.644587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:18.654983 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15ffd408-4cff-4775-94bc-5f23e23019a7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 200 len: 1328 microversion: 2.1 time: 0.107945 Oct 17 16:31:18.655617 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3774/7274] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:18 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:19.679448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:19.680208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:19.687952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:19.688464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:19.688921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:19.689641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:19.690121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:19.690620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:19.704773 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d HTTP/1.1 Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '8490271e-599c-4e4d-99c7-ea3586c1df8d'} Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:31:19.706572 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.711281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:31:19.711281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:31:19.711281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:31:19.711281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:31:19.711281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:31:19.711281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.711281 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.711281 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:31:19.711281 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8591da48-f2d3-41ea-8cff-57d3e3feceff tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 404 len: 111 microversion: 2.1 time: 0.033432 Oct 17 16:31:19.712216 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3501/7275] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:19 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:31:19.725522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:19.726218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:19.733500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:19.733996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:19.734431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:19.735177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:19.735616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:19.736039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:19.750275 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d HTTP/1.1 Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8490271e-599c-4e4d-99c7-ea3586c1df8d'} Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:31:19.751992 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f62faf2e-da1f-46ef-99e2-ee8b3e1b8224 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 404 len: 111 microversion: 2.1 time: 0.032103 Oct 17 16:31:19.756687 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3775/7276] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:19 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:31:19.805877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-85684680", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "dc21e39d-7500-499a-acc8-9e05f278215f"}], "security_groups": [{"name": "tempest-securitygroup--392649381"}], "key_name": "tempest-keypair-278774756", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:31:19.917137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] validate_networks() for [('dc21e39d-7500-499a-acc8-9e05f278215f', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:31:20.354241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:31:20.354672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:31:20.355162 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:31:20.355591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:31:20.356019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:31:20.365571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:20.366086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:20.366561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:20.367354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:20.367824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:20.368270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:20.386647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for project 8e6c5e1866204a798695a2ad4b033775. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:31:20.392109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for user 6f67ed748bed490981e06a64cba232cf and project 8e6c5e1866204a798695a2ad4b033775. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:31:20.405844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:31:20.408289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:31:20.458148 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c97edfa7-33a5-4398-9ad3-da5d5b56d4f0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.656110 Oct 17 16:31:20.458835 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3502/7277] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:31:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:31:20.471015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-15c9c650-3681-4cf1-96d4-3213c9251b01 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:20.471641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-15c9c650-3681-4cf1-96d4-3213c9251b01 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:20.526636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-15c9c650-3681-4cf1-96d4-3213c9251b01 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:20.534054 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-15c9c650-3681-4cf1-96d4-3213c9251b01 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1236 microversion: 2.1 time: 0.067357 Oct 17 16:31:20.534639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3776/7278] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:20 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:21.559718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:21.561318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:21.571407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:21.572348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:21.572999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:21.573904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:21.574780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:21.575227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:21.648977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:21.658321 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a8a122d-ffd9-4e2b-9d13-2d80fdba2240 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1296 microversion: 2.1 time: 0.104416 Oct 17 16:31:21.658967 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3503/7279] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:21 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:22.682984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:22.683575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:22.700422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:22.701028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:22.701503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:22.702560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:22.703056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:22.703614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:22.865234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:22.874325 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-44fdfebd-3ac2-4d1d-8187-b0d7b314a534 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1361 microversion: 2.1 time: 0.195525 Oct 17 16:31:22.875111 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3777/7280] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:22 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:23.402898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-638f731c-2e10-4548-ae34-e1e1a5867edc req-9bf4f058-a8e7-42cb-847a-1ae99c4fa75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9a8b43-918c-48df-8b0d-6d342ba0f871", "tag": "65d436b3-d76d-48e8-8272-8e1773cea4cf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:31:23.416212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-638f731c-2e10-4548-ae34-e1e1a5867edc req-9bf4f058-a8e7-42cb-847a-1ae99c4fa75e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:23.416718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-638f731c-2e10-4548-ae34-e1e1a5867edc req-9bf4f058-a8e7-42cb-847a-1ae99c4fa75e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:23.417173 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-638f731c-2e10-4548-ae34-e1e1a5867edc req-9bf4f058-a8e7-42cb-847a-1ae99c4fa75e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:23.430160 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-638f731c-2e10-4548-ae34-e1e1a5867edc req-9bf4f058-a8e7-42cb-847a-1ae99c4fa75e service nova] Creating event network-changed:65d436b3-d76d-48e8-8272-8e1773cea4cf for instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 on n-h1-854441-12 Oct 17 16:31:23.435373 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-638f731c-2e10-4548-ae34-e1e1a5867edc req-9bf4f058-a8e7-42cb-847a-1ae99c4fa75e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036277 Oct 17 16:31:23.436003 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3504/7281] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:31:23.902791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:23.903421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:23.913999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:23.914739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:23.915379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:23.916429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:23.917101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:23.917716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:24.055893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:24.064540 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d2518477-f584-4b0b-ba76-2ae9ad1eadf4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1361 microversion: 2.1 time: 0.168001 Oct 17 16:31:24.065119 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3778/7282] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:23 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:25.089895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:25.090761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:25.097709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:25.098217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:25.098718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:25.099440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:25.099903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:25.102045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:25.264883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:25.273141 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6e7eee6b-62e2-4701-afe8-96695c647589 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1361 microversion: 2.1 time: 0.188676 Oct 17 16:31:25.273703 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3505/7283] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:25 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:26.297217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:26.297853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:26.305478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:26.305967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:26.306413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:26.307151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:26.307608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:26.308035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:26.446186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:26.455047 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2327f31-4312-4c8b-b8d8-7b51c88b6abb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1361 microversion: 2.1 time: 0.161840 Oct 17 16:31:26.455643 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3779/7284] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:26 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:27.481975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:27.482662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:27.491223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:27.491724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:27.492171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:27.492870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:27.493332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:27.493770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:27.632741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:27.640909 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2883613f-fb7f-4d38-97ec-70bebd47928a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1361 microversion: 2.1 time: 0.165015 Oct 17 16:31:27.641502 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3506/7285] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:27 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:28.665169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:28.665777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:28.672134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:28.672610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:28.673040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:28.673730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:28.674173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:28.674612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:28.810634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:28.818872 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f3566a77-8eb5-4d65-9ee0-cf3b7b6c36c8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1361 microversion: 2.1 time: 0.158094 Oct 17 16:31:28.819433 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3780/7286] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:28 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:29.683926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-25ea01a9-a668-4825-9606-c411bc136ef9 req-2ffd9dc2-64d0-4ea0-9052-07345d460c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9a8b43-918c-48df-8b0d-6d342ba0f871", "name": "network-vif-plugged", "status": "completed", "tag": "65d436b3-d76d-48e8-8272-8e1773cea4cf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:31:29.697068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-25ea01a9-a668-4825-9606-c411bc136ef9 req-2ffd9dc2-64d0-4ea0-9052-07345d460c84 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:29.698260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-25ea01a9-a668-4825-9606-c411bc136ef9 req-2ffd9dc2-64d0-4ea0-9052-07345d460c84 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:29.698767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-25ea01a9-a668-4825-9606-c411bc136ef9 req-2ffd9dc2-64d0-4ea0-9052-07345d460c84 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:29.711871 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-25ea01a9-a668-4825-9606-c411bc136ef9 req-2ffd9dc2-64d0-4ea0-9052-07345d460c84 service nova] Creating event network-vif-plugged:65d436b3-d76d-48e8-8272-8e1773cea4cf for instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 on n-h1-854441-12 Oct 17 16:31:29.717308 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-25ea01a9-a668-4825-9606-c411bc136ef9 req-2ffd9dc2-64d0-4ea0-9052-07345d460c84 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037250 Oct 17 16:31:29.717833 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3507/7287] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:31:29.842890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:29.843278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:29.850828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:29.851312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:29.851740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:29.852433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:29.852882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:29.853300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:29.990617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:29.998609 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8ac7a82a-7c01-4813-a38b-3ea346ae0959 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1361 microversion: 2.1 time: 0.160074 Oct 17 16:31:29.999204 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3781/7288] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:29 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:31.020240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:31:31.021063 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:31:31.027025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:31.027756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:31.035784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:31.036286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:31.036740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:31.037556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:31.038032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:31.038476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:31.189614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:31:31.198061 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-57d92f4e-4fdc-4600-ae9e-f6bd51e4c55b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1548 microversion: 2.1 time: 0.178851 Oct 17 16:31:31.198748 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3508/7289] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:31:31 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:31:31.222102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0fd12985-afa4-4fbc-a4fd-470f14a4d03e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:31:31.222457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0fd12985-afa4-4fbc-a4fd-470f14a4d03e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:31:31.224553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:31:31.230848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fd12985-afa4-4fbc-a4fd-470f14a4d03e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:31.231347 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fd12985-afa4-4fbc-a4fd-470f14a4d03e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:31.231781 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fd12985-afa4-4fbc-a4fd-470f14a4d03e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:31.232483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fd12985-afa4-4fbc-a4fd-470f14a4d03e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:31.232940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fd12985-afa4-4fbc-a4fd-470f14a4d03e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:31.233369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0fd12985-afa4-4fbc-a4fd-470f14a4d03e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:31.314805 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0fd12985-afa4-4fbc-a4fd-470f14a4d03e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096932 Oct 17 16:31:31.315417 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3782/7290] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 16:31:31 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:31:32.278706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b268d47b-3ba9-4b5f-a8a9-dce249243ea7 req-6d86fddb-ed57-4b3a-a6c7-7162511b93c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9a8b43-918c-48df-8b0d-6d342ba0f871", "tag": "65d436b3-d76d-48e8-8272-8e1773cea4cf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:31:32.289507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b268d47b-3ba9-4b5f-a8a9-dce249243ea7 req-6d86fddb-ed57-4b3a-a6c7-7162511b93c2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:31:32.290010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b268d47b-3ba9-4b5f-a8a9-dce249243ea7 req-6d86fddb-ed57-4b3a-a6c7-7162511b93c2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:31:32.290465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b268d47b-3ba9-4b5f-a8a9-dce249243ea7 req-6d86fddb-ed57-4b3a-a6c7-7162511b93c2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:31:32.302790 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b268d47b-3ba9-4b5f-a8a9-dce249243ea7 req-6d86fddb-ed57-4b3a-a6c7-7162511b93c2 service nova] Creating event network-changed:65d436b3-d76d-48e8-8272-8e1773cea4cf for instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 on n-h1-854441-12 Oct 17 16:31:32.308112 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b268d47b-3ba9-4b5f-a8a9-dce249243ea7 req-6d86fddb-ed57-4b3a-a6c7-7162511b93c2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033531 Oct 17 16:31:32.309090 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3509/7291] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:32:06.881808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:06.882872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:06.887136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:06.887795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:06.896338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:06.896842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:06.897273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:06.898027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:06.898571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:06.899000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:07.039703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:07.047985 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da5b1f48-b064-448a-b639-adf26e20b31d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1666 microversion: 2.1 time: 0.168224 Oct 17 16:32:07.048546 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3783/7292] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:06 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1666 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:07.069754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:07.070529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=62 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:07.074989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-54a40069-4642-4b4a-b5b1-66390c197592 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6e0afda-f758-45e9-8a03-dd284d00f1ba"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:32:07.077492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-54a40069-4642-4b4a-b5b1-66390c197592 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:07.085153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a40069-4642-4b4a-b5b1-66390c197592 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:07.085662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a40069-4642-4b4a-b5b1-66390c197592 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:07.086113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a40069-4642-4b4a-b5b1-66390c197592 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:07.086851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a40069-4642-4b4a-b5b1-66390c197592 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:07.087328 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a40069-4642-4b4a-b5b1-66390c197592 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:07.087770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-54a40069-4642-4b4a-b5b1-66390c197592 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:07.358674 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-54a40069-4642-4b4a-b5b1-66390c197592 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291186 Oct 17 16:32:07.359323 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3510/7293] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 16:32:07 2022] POST /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:32:18.143186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:32:18.145450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:18.149493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:18.150137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:18.154209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:18.154732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:18.155175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:18.155882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:18.156331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:18.156755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:18.187742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:18.193730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:32:18.201243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:32:18.201672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:32:18.202139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:32:18.202561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:32:18.202988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:32:18.272567 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-16a748e3-0879-41a7-8678-edc5fd2aeca7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/action" status: 202 len: 0 microversion: 2.1 time: 0.133291 Oct 17 16:32:18.273925 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3784/7294] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:32:18 2022] POST /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:32:18.280674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:18.281631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:18.287981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:18.287981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:18.294645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:18.295150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:18.295595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:18.296403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:18.296856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:18.297282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:18.460443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:18.470196 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-670bffe0-3f4a-4024-a2a4-3848f61cc38b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1721 microversion: 2.1 time: 0.191853 Oct 17 16:32:18.470821 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3511/7295] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:18 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:19.498157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:19.499066 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:19.508391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:19.508893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:19.509363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:19.510058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:19.510529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:19.511676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:19.702686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:19.714850 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-89005379-27a6-4c6e-94a9-1b3b8fc25eb2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1721 microversion: 2.1 time: 0.224554 Oct 17 16:32:19.715780 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3785/7296] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:19 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:20.740142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:20.740770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:20.748263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:20.748764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:20.749248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:20.749960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:20.750431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:20.750866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:20.896094 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:20.905191 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f6257f7d-398b-445d-bfd8-4fe70619c155 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.169287 Oct 17 16:32:20.905820 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3512/7297] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:20 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:21.930471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:21.931097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:21.939205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:21.939768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:21.940242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:21.941170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:21.941629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:21.942056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:22.086238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:22.098356 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-042619c1-fd42-4b43-a37b-af04291b68d6 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.172172 Oct 17 16:32:22.098962 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3786/7298] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:21 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:23.122259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:23.122885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:23.130688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:23.131195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:23.131647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:23.132359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:23.132829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:23.133270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:23.268401 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:23.281019 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bf8ada72-bac3-46b1-900d-58b646318c7d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.162473 Oct 17 16:32:23.281700 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3513/7299] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:23 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:24.305171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:24.305806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:24.313515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:24.314089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:24.314565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:24.315280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:24.315750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:24.316311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:24.456366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:24.465332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-358a4a59-976a-412d-a83d-095ee5b85a30 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.164292 Oct 17 16:32:24.465931 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3787/7300] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:24 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:25.490556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:25.491139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:25.498671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:25.499176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:25.499624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:25.500326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:25.500785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:25.501219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:25.638881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:25.647459 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-70e1dc78-2889-418c-bc6c-0c8027f5cab3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.161024 Oct 17 16:32:25.648073 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3514/7301] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:25 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:26.671520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:26.672429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:26.679722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:26.680385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:26.680927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:26.681753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:26.682305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:26.682875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:26.824477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:26.833389 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6b3b6118-b87b-4512-aebd-a6e8604b174e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.165803 Oct 17 16:32:26.833989 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3788/7302] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:26 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:27.857713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:27.858312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:27.866062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:27.866635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:27.867095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:27.867845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:27.868332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:27.868760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:28.017674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:28.026683 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b2d8b962-140f-434a-a512-76c0d3d916c5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.173136 Oct 17 16:32:28.027323 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3515/7303] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:27 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:29.051622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:29.052204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:29.059815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:29.060368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:29.060932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:29.061647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:29.062149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:29.062714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:29.196700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:29.205581 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7761275f-2ca0-40be-ba17-e9ccc51d766f tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.158168 Oct 17 16:32:29.206185 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3789/7304] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:29 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:30.229856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:30.230631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:30.237812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:30.238342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:30.238800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:30.239538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:30.239997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:30.240453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:30.389006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:30.398274 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e4e55c7d-c3fd-4405-9401-48bc956855e5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.172538 Oct 17 16:32:30.398902 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3516/7305] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:30 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:31.423818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:31.424420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:31.434591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:31.435333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:31.436122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:31.437357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:31.438170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:31.438952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:31.606075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:31.615798 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e516fbb4-11f3-4efa-a680-fc1348bcb10b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.195997 Oct 17 16:32:31.616145 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3790/7306] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:31 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:32.646102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:32.646804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:32.654538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:32.655046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:32.655516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:32.656252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:32.656716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:32.657149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:32.811311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:32.820969 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f150ea96-2031-4278-8ed4-172dd8fc7a7a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.178925 Oct 17 16:32:32.821595 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3517/7307] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:32 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:33.860990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:33.861605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:33.869108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:33.869623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:33.870061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:33.870805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:33.871263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:33.871691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:34.014738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:34.023517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c797d635-b08a-4ce0-b179-08031d2d3ec5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.166940 Oct 17 16:32:34.024162 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3791/7308] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:33 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:35.050376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:35.051104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:35.059807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:35.060320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:35.060779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:35.061518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:35.062260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:35.062968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:35.215512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:35.224790 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d708d6f8-a8f5-4075-86c1-5ee00cb45367 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.178474 Oct 17 16:32:35.225483 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3518/7309] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:35 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:36.262261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:36.263146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:36.273447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:36.274313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:36.275140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:36.276375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:36.277086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:36.277548 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:36.447921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:36.460068 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6e55ce62-a20b-4f19-8479-a667b116e801 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.208002 Oct 17 16:32:36.461277 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3792/7310] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:36 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:37.492463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:37.493402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:37.504690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:37.505514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:37.506037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:37.506963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:37.507788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:37.508441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:37.684264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:37.693619 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5094d81b-17c0-435a-b6af-39934c0ef12e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.207325 Oct 17 16:32:37.694219 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3519/7311] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:37 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:38.730379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:38.731127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:38.739133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:38.739667 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:38.740138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:38.740925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:38.741419 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:38.741841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:38.900724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:38.906874 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2ce1fa5c-236c-49b8-9b72-6340aa34bb42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1726 microversion: 2.1 time: 0.180729 Oct 17 16:32:38.907477 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3793/7312] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:38 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:39.931589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:39.932900 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:39.940607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:39.941133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:39.941815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:39.942757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:39.943505 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:39.943955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:39.978407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4a4fb014-3c19-4c4f-b7f7-e63760fa79b2 req-ef3ab7c2-0d8d-46cb-b49c-a6f030d2d6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9a8b43-918c-48df-8b0d-6d342ba0f871", "name": "network-vif-unplugged", "status": "completed", "tag": "65d436b3-d76d-48e8-8272-8e1773cea4cf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:32:39.997059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4a4fb014-3c19-4c4f-b7f7-e63760fa79b2 req-ef3ab7c2-0d8d-46cb-b49c-a6f030d2d6ef service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:39.997597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4a4fb014-3c19-4c4f-b7f7-e63760fa79b2 req-ef3ab7c2-0d8d-46cb-b49c-a6f030d2d6ef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:39.998081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4a4fb014-3c19-4c4f-b7f7-e63760fa79b2 req-ef3ab7c2-0d8d-46cb-b49c-a6f030d2d6ef service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:40.014134 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4a4fb014-3c19-4c4f-b7f7-e63760fa79b2 req-ef3ab7c2-0d8d-46cb-b49c-a6f030d2d6ef service nova] Creating event network-vif-unplugged:65d436b3-d76d-48e8-8272-8e1773cea4cf for instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 on n-h2-854441-12 Oct 17 16:32:40.019218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-4a4fb014-3c19-4c4f-b7f7-e63760fa79b2 req-ef3ab7c2-0d8d-46cb-b49c-a6f030d2d6ef service nova] Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:32:40.032404 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4a4fb014-3c19-4c4f-b7f7-e63760fa79b2 req-ef3ab7c2-0d8d-46cb-b49c-a6f030d2d6ef service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057516 Oct 17 16:32:40.032741 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3794/7313] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:32:40.263323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:40.271998 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1e35c8f9-1c23-45ae-a822-24ae9303f5c7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1725 microversion: 2.1 time: 0.344554 Oct 17 16:32:40.272571 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3520/7314] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:39 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1725 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:41.298149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:41.299702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:41.305989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:41.306618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:41.307047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:41.307761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:41.308225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:41.308632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:41.444091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:41.453492 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6353ba05-cc29-4ba2-88d1-8ae62d295271 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.160536 Oct 17 16:32:41.454102 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3795/7315] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:41 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:42.080366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-bca49aae-1d06-4238-9213-e850788c8a06 req-e59e44a8-064d-427a-bbf0-e6072df22df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9a8b43-918c-48df-8b0d-6d342ba0f871", "tag": "65d436b3-d76d-48e8-8272-8e1773cea4cf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:32:42.091816 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bca49aae-1d06-4238-9213-e850788c8a06 req-e59e44a8-064d-427a-bbf0-e6072df22df2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:42.092416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bca49aae-1d06-4238-9213-e850788c8a06 req-e59e44a8-064d-427a-bbf0-e6072df22df2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:42.092860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bca49aae-1d06-4238-9213-e850788c8a06 req-e59e44a8-064d-427a-bbf0-e6072df22df2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:42.106178 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bca49aae-1d06-4238-9213-e850788c8a06 req-e59e44a8-064d-427a-bbf0-e6072df22df2 service nova] Creating event network-changed:65d436b3-d76d-48e8-8272-8e1773cea4cf for instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 on n-h2-854441-12 Oct 17 16:32:42.113360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-bca49aae-1d06-4238-9213-e850788c8a06 req-e59e44a8-064d-427a-bbf0-e6072df22df2 service nova] Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:32:42.130857 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-bca49aae-1d06-4238-9213-e850788c8a06 req-e59e44a8-064d-427a-bbf0-e6072df22df2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053594 Oct 17 16:32:42.131825 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3521/7316] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:32:42.478243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:42.479802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:42.487693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:42.488298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:42.488741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:42.489533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:42.489996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:42.490421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:42.652852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:42.663347 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3f0c8930-f7b5-4fc4-918e-e0f0425f7faa tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.189574 Oct 17 16:32:42.664068 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3796/7317] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:42 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:43.689244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:43.689912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:43.696792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:43.697311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:43.697782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:43.698524 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:43.699029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:43.699519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:43.838750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:43.847781 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0ef51dc8-b830-4bbd-aa5d-d91127089f42 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.163879 Oct 17 16:32:43.848362 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3522/7318] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:43 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:44.872051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:44.872708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:44.881236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:44.881741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:44.882184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:44.882959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:44.883449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:44.883875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:45.060159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:45.069492 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90e97a09-715e-41da-a35c-c41845ca34d9 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.201597 Oct 17 16:32:45.070099 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3797/7319] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:44 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:46.093958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:46.094727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:46.102295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:46.102925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:46.105313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:46.106516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:46.107017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:46.107602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:46.253365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:46.262058 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2f0fa939-cf04-4ab7-a21e-ca0d04cb548e tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.172300 Oct 17 16:32:46.262647 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3523/7320] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:46 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:47.288494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:47.289122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:47.297329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:47.297837 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:47.298603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:47.299826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:47.300555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:47.301296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:47.455101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:47.467871 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d02abb62-ce1c-4a54-ae72-1fd33281cedc tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.183164 Oct 17 16:32:47.468701 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3798/7321] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:47 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:48.496607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:48.497377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:48.500273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=27 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:48.506273 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:48.506807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:48.507258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:48.507972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:48.508442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:48.508925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:48.511740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=77 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:48.649483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:48.658262 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-04d3e307-fc2b-4386-8e68-619b9db94205 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.165640 Oct 17 16:32:48.658917 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3524/7322] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:48 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:49.681996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:49.682654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:49.685593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=35 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:49.691463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:49.691957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:49.692448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:49.693155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:49.693609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:49.694034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:49.696954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:32:49.845896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:49.855186 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4946483b-5a34-4d23-be44-aae310467615 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.177463 Oct 17 16:32:49.855922 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3799/7323] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:49 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:50.883391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:50.884361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:50.894762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:50.895675 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:50.896160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:50.896910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:50.897412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:50.897922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:51.042267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:51.051115 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5c2f164e-f5fd-4f02-97dd-d46c75f1f4c1 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.174713 Oct 17 16:32:51.051716 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3525/7324] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:50 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:52.080514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:52.081241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:52.089168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:52.089672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:52.090113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:52.090856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:52.091317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:52.091750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:52.238012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:52.248093 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3c3c4f9d-1842-4d90-acd5-20f1657bd4dd tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1723 microversion: 2.1 time: 0.172093 Oct 17 16:32:52.248677 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3800/7325] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:52 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:53.274634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:53.275298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:53.284268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:53.284836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:53.285242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:53.286007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:53.286445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:53.286961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:53.427848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:53.437672 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4f4e47e8-38ae-4750-9c40-b5920f9d4fa8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1720 microversion: 2.1 time: 0.169272 Oct 17 16:32:53.438263 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3526/7326] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:53 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:53.460735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:32:53.461280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:53.468480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:53.468961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:53.469377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:53.470080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:53.470530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:53.470966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:53.509760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:53.510233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:53.510703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:53.511415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:53.511865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:53.512280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:53.533245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for project 8e6c5e1866204a798695a2ad4b033775. Resources: {'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:32:53.538825 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Getting quotas for user 6f67ed748bed490981e06a64cba232cf and project 8e6c5e1866204a798695a2ad4b033775. Resources: {'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:32:53.658449 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3a5f6856-316a-47c8-8caa-482f175d59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "POST /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/action" status: 202 len: 0 microversion: 2.1 time: 0.201001 Oct 17 16:32:53.659328 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3801/7327] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:32:53 2022] POST /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:32:53.669976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:53.670677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:53.677759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:53.678323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:53.679034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:53.680172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:53.680758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:53.681279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:53.883130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:53.892450 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0ecee36a-bcfb-4737-838b-ef0bcf461f3c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.228174 Oct 17 16:32:53.893414 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3527/7328] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:53 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:54.919657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:54.920365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:54.928467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:54.929002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:54.929466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:54.930199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:54.930791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:54.931213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:55.091241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:55.101580 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d026fd3a-5b6e-4f87-a12f-637055083b89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.187270 Oct 17 16:32:55.102655 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3802/7329] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:54 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:56.115091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-49a0d4b7-d715-4155-8bf6-77cfc78edad2 req-d5007798-b31c-47a1-9154-6ede3b403965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9a8b43-918c-48df-8b0d-6d342ba0f871", "name": "network-vif-plugged", "status": "completed", "tag": "65d436b3-d76d-48e8-8272-8e1773cea4cf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:32:56.126244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-49a0d4b7-d715-4155-8bf6-77cfc78edad2 req-d5007798-b31c-47a1-9154-6ede3b403965 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:56.126684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-49a0d4b7-d715-4155-8bf6-77cfc78edad2 req-d5007798-b31c-47a1-9154-6ede3b403965 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:56.127137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-49a0d4b7-d715-4155-8bf6-77cfc78edad2 req-d5007798-b31c-47a1-9154-6ede3b403965 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:56.132349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:56.133392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:56.140905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:56.141404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:56.141845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:56.142071 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-49a0d4b7-d715-4155-8bf6-77cfc78edad2 req-d5007798-b31c-47a1-9154-6ede3b403965 service nova] Creating event network-vif-plugged:65d436b3-d76d-48e8-8272-8e1773cea4cf for instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 on n-h2-854441-12 Oct 17 16:32:56.142603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:56.143050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:56.143474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:56.148398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-49a0d4b7-d715-4155-8bf6-77cfc78edad2 req-d5007798-b31c-47a1-9154-6ede3b403965 service nova] Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:32:56.159950 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-49a0d4b7-d715-4155-8bf6-77cfc78edad2 req-d5007798-b31c-47a1-9154-6ede3b403965 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112965 Oct 17 16:32:56.160887 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3528/7330] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:32:56.303391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:56.312179 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-13109445-f445-42b5-a143-755050472d89 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.185507 Oct 17 16:32:56.312766 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3803/7331] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:56 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:32:57.342660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:57.343380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:57.350000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:57.350535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:57.350967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:57.351690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:57.352164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:57.352583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:57.499858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:57.510169 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bb4b735c-eb67-4eb8-87ce-ba1a5484b0ac tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.173080 Oct 17 16:32:57.510887 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3529/7332] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:57 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:58.535173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:58.535863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:58.542299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:58.543508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:58.543946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:58.544976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:58.545731 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:58.546158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:58.692535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:58.704460 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f65ce53d-9b04-4f50-a1c5-a450afbd1dab tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.173662 Oct 17 16:32:58.705182 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3804/7333] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:58 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:32:59.671829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a0116450-1a9c-448b-973e-9c4f47c4d29d req-02415b16-7558-4781-8f18-76229738bfeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9a8b43-918c-48df-8b0d-6d342ba0f871", "name": "network-vif-unplugged", "status": "completed", "tag": "65d436b3-d76d-48e8-8272-8e1773cea4cf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:32:59.684230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a0116450-1a9c-448b-973e-9c4f47c4d29d req-02415b16-7558-4781-8f18-76229738bfeb service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:59.684997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a0116450-1a9c-448b-973e-9c4f47c4d29d req-02415b16-7558-4781-8f18-76229738bfeb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:59.685685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a0116450-1a9c-448b-973e-9c4f47c4d29d req-02415b16-7558-4781-8f18-76229738bfeb service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:59.699240 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a0116450-1a9c-448b-973e-9c4f47c4d29d req-02415b16-7558-4781-8f18-76229738bfeb service nova] Creating event network-vif-unplugged:65d436b3-d76d-48e8-8272-8e1773cea4cf for instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 on n-h1-854441-12 Oct 17 16:32:59.705065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-a0116450-1a9c-448b-973e-9c4f47c4d29d req-02415b16-7558-4781-8f18-76229738bfeb service nova] Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:32:59.717382 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a0116450-1a9c-448b-973e-9c4f47c4d29d req-02415b16-7558-4781-8f18-76229738bfeb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049515 Oct 17 16:32:59.718486 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3530/7334] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:32:59.731659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:32:59.732329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:32:59.739364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:59.739851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:59.740285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:59.740983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:32:59.741440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:32:59.741862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:32:59.883617 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:32:59.892588 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49abf26a-3b4c-4ef2-8a89-3b996510d3c2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.164959 Oct 17 16:32:59.893180 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3805/7335] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:32:59 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:00.916376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:00.917233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:00.924688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:00.925191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:00.925669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:00.926387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:00.926882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:00.927316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:01.065603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:01.074365 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3894f3dd-a530-4a5b-a6a3-5eca6fbbde05 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.162322 Oct 17 16:33:01.074958 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3531/7336] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:00 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:01.735251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-58154f5b-f6f9-452e-a5a4-b446afccd346 req-5df6b76d-e9f2-4c8f-9275-f3a00ebc83df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9a8b43-918c-48df-8b0d-6d342ba0f871", "tag": "65d436b3-d76d-48e8-8272-8e1773cea4cf"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:33:01.746743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-58154f5b-f6f9-452e-a5a4-b446afccd346 req-5df6b76d-e9f2-4c8f-9275-f3a00ebc83df service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:01.747895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-58154f5b-f6f9-452e-a5a4-b446afccd346 req-5df6b76d-e9f2-4c8f-9275-f3a00ebc83df service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:01.748379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-58154f5b-f6f9-452e-a5a4-b446afccd346 req-5df6b76d-e9f2-4c8f-9275-f3a00ebc83df service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:01.761885 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-58154f5b-f6f9-452e-a5a4-b446afccd346 req-5df6b76d-e9f2-4c8f-9275-f3a00ebc83df service nova] Creating event network-changed:65d436b3-d76d-48e8-8272-8e1773cea4cf for instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 on n-h1-854441-12 Oct 17 16:33:01.768186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-58154f5b-f6f9-452e-a5a4-b446afccd346 req-5df6b76d-e9f2-4c8f-9275-f3a00ebc83df service nova] Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:33:01.779820 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-58154f5b-f6f9-452e-a5a4-b446afccd346 req-5df6b76d-e9f2-4c8f-9275-f3a00ebc83df service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048214 Oct 17 16:33:01.780662 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3806/7337] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:33:02.098861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:02.099577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:02.113738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:02.115366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:02.116196 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:02.117731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:02.118673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:02.119435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:02.437339 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:02.447701 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea495648-a905-4580-999a-a7ebceefd0fb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.353609 Oct 17 16:33:02.459738 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3532/7338] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:02 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:03.473662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:03.474543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:03.481400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:03.482089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:03.482629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:03.483326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:03.483768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:03.484191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:03.521272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:03.622455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:03.632017 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b18a216d-1c83-4940-8fe6-7161e4c860b4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.163747 Oct 17 16:33:03.632616 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3807/7339] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:03 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:04.656772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:04.657370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:04.665157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:04.665665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:04.666084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:04.666851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:04.667314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:04.667754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:04.810051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:04.822689 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3be6ae6c-0a9c-44c9-85c8-305f547fa839 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.170363 Oct 17 16:33:04.823354 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3533/7340] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:04 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:05.846867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:05.847448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:05.854637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:05.855135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:05.855629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:05.856473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:05.857136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:05.857567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:06.001963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:06.012865 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-83d3cf36-71bd-40df-b1e9-a71ec36b9bb4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.170219 Oct 17 16:33:06.020593 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3808/7341] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:05 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:07.038187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:07.038856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:07.047919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:07.048494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:07.048968 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:07.049738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:07.050218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:07.050704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:07.220587 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:07.230775 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-70bc9421-c897-40ea-903b-81580c00885c tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.196678 Oct 17 16:33:07.231441 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3534/7342] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:07 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:08.257940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:08.258743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:08.266099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:08.266677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:08.267111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:08.267893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:08.268350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:08.268768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:08.416364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:08.425698 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed7fca7d-deae-4087-9332-91e64c302d12 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.171808 Oct 17 16:33:08.426262 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3809/7343] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:08 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:09.456256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:09.456962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:09.465313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:09.465828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:09.466280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:09.467061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:09.467538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:09.467986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:09.605312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:09.614780 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-21721173-d11a-4427-abfa-3225c39d5ce7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.162796 Oct 17 16:33:09.615380 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3535/7344] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:09 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:10.638133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:10.638779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:10.642059 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:33:10.642224 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:33:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 (ip 10.222.0.87) !!! Oct 17 16:33:10.651343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:10.651343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:10.651343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:10.651864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:10.652318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:10.652737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:10.794981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:10.804321 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-53c08d4f-8cf1-4e2a-bdad-a1fef42270ae tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.170129 Oct 17 16:33:10.804947 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3810/7345] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:10 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:11.828341 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:11.828952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:11.831168 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:33:11.831306 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:33:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 (ip 10.222.0.87) !!! Oct 17 16:33:11.838610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:11.839071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:11.839521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:11.840244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:11.840735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:11.841174 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:11.990236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:11.999653 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ef427ed-dcab-45df-92a1-0e163007ae6a tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1719 microversion: 2.1 time: 0.175449 Oct 17 16:33:12.000263 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3536/7346] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:11 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:13.024510 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:13.025352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:13.032775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.033269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.033718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.034422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.034908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.035333 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.178491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:13.187323 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ccfd7e6d-e9e8-410f-b22a-117450222ab5 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1712 microversion: 2.1 time: 0.166813 Oct 17 16:33:13.187927 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3811/7347] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:13 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1712 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:13.210415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:13.211097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:13.218797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.219353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.219780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.220516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.220992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.221438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.367218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:13.375803 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-716a2482-9313-44d6-8219-59031680ac6d tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1712 microversion: 2.1 time: 0.169389 Oct 17 16:33:13.376314 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3537/7348] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:13 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1712 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:13.401505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:13.402633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:13.411971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.412730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.413402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.414332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.415060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.415734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.561326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:13.572779 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8866e55f-3f48-438c-ac61-a93144bf5345 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1712 microversion: 2.1 time: 0.177477 Oct 17 16:33:13.573671 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3812/7349] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:13 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1712 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:13.659666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:13.660186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:13.666462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.667041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.667501 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.668221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.668683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.669130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.694810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:33:13.780045 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8a64a89a-ab23-4d51-bb27-f3c9158e6ba2 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 204 len: 0 microversion: 2.1 time: 0.123991 Oct 17 16:33:13.781010 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3538/7350] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:33:13 2022] DELETE /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:33:13.790114 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:13.790762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:13.797594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.798089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.798593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.799262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:13.799713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:13.800172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:13.804178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:13.946144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:13.956169 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d7ea0a1d-6137-4b77-afd7-b69c044ca5d7 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1718 microversion: 2.1 time: 0.170024 Oct 17 16:33:13.956757 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3813/7351] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:13 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1718 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:14.989771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:14.990473 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:14.998621 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:14.999013 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:14.999510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:15.000248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:15.000701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:15.001138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:15.151533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:15.154142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:15.162590 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bae0a36b-d834-4c9e-9754-d96a225639b0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1718 microversion: 2.1 time: 0.177808 Oct 17 16:33:15.163294 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3539/7352] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:14 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1718 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:16.186291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:16.187680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:16.195125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:16.195628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:16.196068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:16.196942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:16.197598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:16.198034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:16.230839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5a879cb0-db23-4467-977e-b98d02eec673 req-d61faa08-5f79-44ba-b912-c24c577e11a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9a8b43-918c-48df-8b0d-6d342ba0f871", "name": "network-vif-deleted", "tag": "65d436b3-d76d-48e8-8272-8e1773cea4cf"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:33:16.242772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5a879cb0-db23-4467-977e-b98d02eec673 req-d61faa08-5f79-44ba-b912-c24c577e11a6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:16.243582 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5a879cb0-db23-4467-977e-b98d02eec673 req-d61faa08-5f79-44ba-b912-c24c577e11a6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:16.244184 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5a879cb0-db23-4467-977e-b98d02eec673 req-d61faa08-5f79-44ba-b912-c24c577e11a6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:16.260457 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5a879cb0-db23-4467-977e-b98d02eec673 req-d61faa08-5f79-44ba-b912-c24c577e11a6 service nova] Creating event network-vif-deleted:65d436b3-d76d-48e8-8272-8e1773cea4cf for instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 on n-h1-854441-12 Oct 17 16:33:16.267108 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5a879cb0-db23-4467-977e-b98d02eec673 req-d61faa08-5f79-44ba-b912-c24c577e11a6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040464 Oct 17 16:33:16.267740 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3540/7353] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:33:16.273298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:16.283214 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbfafd65-6437-4e8a-ab2a-f4725a40aa11 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1651 microversion: 2.1 time: 0.101332 Oct 17 16:33:16.284478 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3814/7354] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:16 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1651 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:17.309611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:17.310562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:17.317659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:17.318170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:17.318653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:17.319392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:17.319872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:17.320540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:17.387861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:17.396820 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2d3700ab-4967-43b1-9618-1cbb3afc59e0 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1367 microversion: 2.1 time: 0.093045 Oct 17 16:33:17.397380 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3541/7355] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:17 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:18.419853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:18.420675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:18.428932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:18.429438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:18.429879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:18.430676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:18.431138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:18.431566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:18.501822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:18.511231 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f40137c-8452-47cf-bdc8-c2a4fbf74d44 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1367 microversion: 2.1 time: 0.095659 Oct 17 16:33:18.511931 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3815/7356] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:18 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:19.535204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:19.535870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:19.539413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:19.545807 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:19.546329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:19.546847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:19.547593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:19.548068 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:19.548538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:19.618980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67ed748bed490981e06a64cba232cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6c5e1866204a798695a2ad4b033775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:19.628339 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b5bba6e9-1916-4cba-be6f-82d99b1eab86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 200 len: 1367 microversion: 2.1 time: 0.096956 Oct 17 16:33:19.628932 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3542/7357] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:19 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:20.652295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:20.653143 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:20.656023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:20.662873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:20.663771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:20.664328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:20.665329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:20.665734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:20.666273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:20.682886 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 HTTP/1.1 Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6b9a8b43-918c-48df-8b0d-6d342ba0f871'} Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:20.684688 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-91cdf222-b3b1-4401-84f2-9a1f1db2b163 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 404 len: 111 microversion: 2.1 time: 0.038142 Oct 17 16:33:20.689196 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3816/7358] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:20 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:33:20.752182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:20.755177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:20.763075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:20.763593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:20.764045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:20.764789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:20.765259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:20.765701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:20.780253 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/os-volume_attachments HTTP/1.1 Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'server_id': '6b9a8b43-918c-48df-8b0d-6d342ba0f871'} Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:20.782019 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d80d27c4-86cb-47f2-8f7b-aed1342c59cb tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035663 Oct 17 16:33:20.786698 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3543/7359] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:33:20 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:33:24.150301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:24.150958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:24.158712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.159218 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.159656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.160401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.160856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.161269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.182961 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 HTTP/1.1 Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '6b9a8b43-918c-48df-8b0d-6d342ba0f871'} Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:24.185074 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e6003ca8-926e-4517-a79d-2d8447670fa3 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "DELETE /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 404 len: 111 microversion: 2.1 time: 0.040266 Oct 17 16:33:24.189654 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3817/7360] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:33:24 2022] DELETE /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:33:24.196956 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:24.197619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 6b9a8b43-918c-48df-8b0d-6d342ba0f871] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:24.204879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.205372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.205820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.206557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.207025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.207459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.222158 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 HTTP/1.1 Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '6b9a8b43-918c-48df-8b0d-6d342ba0f871'} Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.223770 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance 6b9a8b43-918c-48df-8b0d-6d342ba0f871 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bb62bf54-62cf-4dc9-b9ea-16181d9ad8a4 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871" status: 404 len: 111 microversion: 2.1 time: 0.033259 Oct 17 16:33:24.229786 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3544/7361] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:24 2022] GET /compute/v2.1/servers/6b9a8b43-918c-48df-8b0d-6d342ba0f871 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:33:24.241706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:24.242234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:24.248791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.249289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.249725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.250426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.250903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.251326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.275938 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d HTTP/1.1 Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8490271e-599c-4e4d-99c7-ea3586c1df8d'} Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:24.277555 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-56353bf7-2dbf-4f9a-a605-7f3fe165443b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 404 len: 111 microversion: 2.1 time: 0.048034 Oct 17 16:33:24.281557 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3818/7362] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:33:24 2022] DELETE /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:33:24.288924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:24.289579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: 8490271e-599c-4e4d-99c7-ea3586c1df8d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:24.296917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.297405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.297860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.298698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.299152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.299594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.319490 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d HTTP/1.1 Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '8490271e-599c-4e4d-99c7-ea3586c1df8d'} Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.321126 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance 8490271e-599c-4e4d-99c7-ea3586c1df8d could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-673ce538-2ec2-4738-bb7d-eaaf2a21b791 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d" status: 404 len: 111 microversion: 2.1 time: 0.038145 Oct 17 16:33:24.326560 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3545/7363] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:24 2022] GET /compute/v2.1/servers/8490271e-599c-4e4d-99c7-ea3586c1df8d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:33:24.333968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:24.334612 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:24.341559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.342149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.342630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.343344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.343804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.344229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.360268 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 HTTP/1.1 Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'f4c9669f-70c5-4972-952b-7c86b8ca4d21'} Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:24.362529 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c75e993-3b51-4b91-9b82-98b0243314a8 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 404 len: 111 microversion: 2.1 time: 0.035312 Oct 17 16:33:24.372539 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3819/7364] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:33:24 2022] DELETE /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:33:24.375511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:24.375511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: f4c9669f-70c5-4972-952b-7c86b8ca4d21] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:24.382093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.382667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.383125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.383844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.384312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.384747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.399749 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 HTTP/1.1 Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f4c9669f-70c5-4972-952b-7c86b8ca4d21'} Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.401325 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance f4c9669f-70c5-4972-952b-7c86b8ca4d21 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-02db6ef4-f3fa-4da0-970c-b2a004f71216 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21" status: 404 len: 111 microversion: 2.1 time: 0.032500 Oct 17 16:33:24.406715 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3546/7365] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:24 2022] GET /compute/v2.1/servers/f4c9669f-70c5-4972-952b-7c86b8ca4d21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:33:24.412404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:24.413015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:24.419560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.420131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.420570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.421282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.421743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.422166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.437457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 HTTP/1.1 Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'edc6e5ba-86f5-4348-a094-05b2dca9b552'} Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:24.439140 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-63d56703-89c3-4f72-b9fc-8f1a1c7fd50b tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "DELETE /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 404 len: 111 microversion: 2.1 time: 0.032295 Oct 17 16:33:24.443339 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3820/7366] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:33:24 2022] DELETE /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:33:24.450983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:24.451619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] [instance: edc6e5ba-86f5-4348-a094-05b2dca9b552] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:24.458438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.458982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.459431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.460152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:24.460625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:24.461069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:24.476568 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] HTTP exception thrown: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Request method failure captured: Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 HTTP/1.1 Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYJn53K-eOws2h5YJLvi8aPVbmX08378c4WUSUTk7fNl8Y-lf_OSKv1WqNBbysaE1Kz1nhxiDW6Rx7iCuBN5GIR2ABFZv-ByOF6cpDZecwJQk3eX_5yLyuVT97UR9RKXWAdkqXELHVzFUOe5X4I3wz86N0TpdnrFIy5fK_cy75u4Xqc Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8e6c5e1866204a798695a2ad4b033775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 8e6c5e1866204a798695a2ad4b033775 Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServerActionsTestJSON-1352215718 Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 6f67ed748bed490981e06a64cba232cf Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServerActionsTestJSON-1352215718-project Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'edc6e5ba-86f5-4348-a094-05b2dca9b552'} Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:33:24.478778 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Returning 404 to user: Instance edc6e5ba-86f5-4348-a094-05b2dca9b552 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7f49f884-1332-4bb0-a151-b28934d0c899 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552" status: 404 len: 111 microversion: 2.1 time: 0.033269 Oct 17 16:33:24.485021 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3547/7367] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:24 2022] GET /compute/v2.1/servers/edc6e5ba-86f5-4348-a094-05b2dca9b552 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:33:24.492936 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90c8a7d5-fc1f-44b7-8a4c-854ebeb55a86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] Calling method '.version_select at 0x7f28beb84040>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:24.520556 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90c8a7d5-fc1f-44b7-8a4c-854ebeb55a86 tempest-ServerActionsTestJSON-1352215718 tempest-ServerActionsTestJSON-1352215718-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-278774756" status: 202 len: 0 microversion: 2.1 time: 0.031934 Oct 17 16:33:24.521416 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3821/7368] 10.222.0.87 () {58 vars in 1218 bytes} [Mon Oct 17 16:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-278774756 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:33:34.789553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=11 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:34.790729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=25 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:34.947270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-438014634", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "ccbd2d8c-7d08-479b-969f-6c55134dc2f2"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:33:35.008151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] validate_networks() for [('ccbd2d8c-7d08-479b-969f-6c55134dc2f2', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:33:35.425671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:33:35.426107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:33:35.426640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:33:35.427065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:33:35.427542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:33:35.437692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:35.438197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:35.438759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:35.439503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:35.439977 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:35.440415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:35.458955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Getting quotas for project 5b0eeba1987d43f3b7627f0fac30a653. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:33:35.465347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Getting quotas for user 0aef05e0921d4f1384e07c8ad3238990 and project 5b0eeba1987d43f3b7627f0fac30a653. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:33:35.478878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:33:35.481348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:33:35.537337 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee2b3f05-d449-4d6e-b726-2a2c3e3c3e39 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755762 Oct 17 16:33:35.538230 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3548/7369] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:33:35.550839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90b42a33-70b9-4d68-a39b-7ba4105d5d15 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:35.551696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90b42a33-70b9-4d68-a39b-7ba4105d5d15 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:35.554170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=27 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:35.555222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:35.630687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-90b42a33-70b9-4d68-a39b-7ba4105d5d15 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:35.638281 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90b42a33-70b9-4d68-a39b-7ba4105d5d15 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1216 microversion: 2.1 time: 0.092333 Oct 17 16:33:35.639020 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3822/7370] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:35 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:33:36.661429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:36.662066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:36.669855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:36.670357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:36.671010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:36.671736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:36.672362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:36.672795 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:36.790007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:36.812551 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8207e16e-608a-4803-b33f-6fc865814197 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1268 microversion: 2.1 time: 0.155014 Oct 17 16:33:36.815539 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3549/7371] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:36 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:37.841073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:37.842434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:37.850135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:37.851045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:37.851485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:37.852207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:37.852671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:37.853100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:37.999844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:38.008788 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-97d41ff5-fed9-48b2-9e1c-c62324542732 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1316 microversion: 2.1 time: 0.171772 Oct 17 16:33:38.010041 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3823/7372] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:37 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:38.347975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-66ae5dc2-cd04-4933-9908-83f146f0f245 req-eb3a4510-c3bc-46ee-b703-2a572c00138b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f07d4e3-c023-4e6a-a210-78ccfcd888a7", "tag": "5b431abd-8ce4-485a-92ca-3f323000100b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:33:38.358110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-66ae5dc2-cd04-4933-9908-83f146f0f245 req-eb3a4510-c3bc-46ee-b703-2a572c00138b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:38.358737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-66ae5dc2-cd04-4933-9908-83f146f0f245 req-eb3a4510-c3bc-46ee-b703-2a572c00138b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:38.359249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-66ae5dc2-cd04-4933-9908-83f146f0f245 req-eb3a4510-c3bc-46ee-b703-2a572c00138b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:38.371876 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-66ae5dc2-cd04-4933-9908-83f146f0f245 req-eb3a4510-c3bc-46ee-b703-2a572c00138b service nova] Creating event network-changed:5b431abd-8ce4-485a-92ca-3f323000100b for instance 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 on n-h2-854441-12 Oct 17 16:33:38.377147 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-66ae5dc2-cd04-4933-9908-83f146f0f245 req-eb3a4510-c3bc-46ee-b703-2a572c00138b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096087 Oct 17 16:33:38.378298 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3550/7373] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:33:39.032798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:39.033475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:39.040981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:39.041468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:39.041896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:39.042823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:39.043223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:39.043719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:39.188702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:39.196888 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-32ec8f8e-f0a0-4224-a957-79c442fb4469 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1316 microversion: 2.1 time: 0.168111 Oct 17 16:33:39.197493 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3824/7374] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:39 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:40.221840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:40.222565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:40.232987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:40.233651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:40.234134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:40.234963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:40.235434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:40.235847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:40.391261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:40.399258 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b30f541-9b5b-4494-9662-5842b008aa35 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1316 microversion: 2.1 time: 0.182859 Oct 17 16:33:40.399869 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3551/7375] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:40 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:41.421636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:41.422282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:41.429862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:41.430415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:41.430896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:41.431603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:41.432057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:41.432485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:41.577011 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:41.585964 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a0449d9-ebe7-4b29-a57c-caf3bfa635ed tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1316 microversion: 2.1 time: 0.168284 Oct 17 16:33:41.586568 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3825/7376] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:41 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:42.609380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:42.610026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:42.622562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:42.623199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:42.623550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:42.624310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:42.624997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:42.625452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:42.767892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:42.776416 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1e6451e6-90fe-41ee-8d24-551694899e0f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1316 microversion: 2.1 time: 0.171151 Oct 17 16:33:42.777025 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3552/7377] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:42 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:43.800081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:43.800759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:43.808425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:43.808920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:43.809336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:43.810058 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:43.810524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:43.810969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:43.985182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:43.993600 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-157e594b-bed1-4baa-a0fa-9a07e8685bd3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1316 microversion: 2.1 time: 0.197425 Oct 17 16:33:43.994206 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3826/7378] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:43 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:44.261984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-44e7ab81-75ed-451f-bf83-d47f46d5420c req-80453da9-9f01-41a9-8e7f-19a013c552b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f07d4e3-c023-4e6a-a210-78ccfcd888a7", "name": "network-vif-plugged", "status": "completed", "tag": "5b431abd-8ce4-485a-92ca-3f323000100b"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:33:44.274427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-44e7ab81-75ed-451f-bf83-d47f46d5420c req-80453da9-9f01-41a9-8e7f-19a013c552b1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:44.275101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-44e7ab81-75ed-451f-bf83-d47f46d5420c req-80453da9-9f01-41a9-8e7f-19a013c552b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:44.275552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-44e7ab81-75ed-451f-bf83-d47f46d5420c req-80453da9-9f01-41a9-8e7f-19a013c552b1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:44.289699 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-44e7ab81-75ed-451f-bf83-d47f46d5420c req-80453da9-9f01-41a9-8e7f-19a013c552b1 service nova] Creating event network-vif-plugged:5b431abd-8ce4-485a-92ca-3f323000100b for instance 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 on n-h2-854441-12 Oct 17 16:33:44.295046 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-44e7ab81-75ed-451f-bf83-d47f46d5420c req-80453da9-9f01-41a9-8e7f-19a013c552b1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037086 Oct 17 16:33:44.295695 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3553/7379] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:33:45.017882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:45.019229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:45.026913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:45.027395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:45.027868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:45.028567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:45.029097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:45.029724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:45.171725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:45.179852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bc06f9ba-f625-40a8-b9b4-af9341e226dd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1316 microversion: 2.1 time: 0.165994 Oct 17 16:33:45.180458 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3827/7380] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:45 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:46.201201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:46.202407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:46.207988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:46.208725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:46.216438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:46.216947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:46.217397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:46.218126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:46.218681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:46.219097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:46.363470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:46.372589 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-53898619-2335-412d-8b28-e495a63573c7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1505 microversion: 2.1 time: 0.173190 Oct 17 16:33:46.373203 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3554/7381] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:46 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:46.440002 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639444482", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "ccbd2d8c-7d08-479b-969f-6c55134dc2f2"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:33:46.449272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:46.498236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] validate_networks() for [('ccbd2d8c-7d08-479b-969f-6c55134dc2f2', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:33:46.944628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:33:46.945068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:33:46.945534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:33:46.945924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:33:46.946334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:33:46.955947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:46.956435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:46.956877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:46.957601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:46.958050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:46.958474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:46.976125 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Getting quotas for project 5b0eeba1987d43f3b7627f0fac30a653. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:33:46.981663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Getting quotas for user 0aef05e0921d4f1384e07c8ad3238990 and project 5b0eeba1987d43f3b7627f0fac30a653. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:33:46.994805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:33:46.997298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:33:47.049763 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8283f47a-08a2-4173-8672-7e3143c69cd9 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614275 Oct 17 16:33:47.050517 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3828/7382] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:33:47.062371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4020663a-bf08-48e7-8e07-0d464a38e467 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:47.063043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4020663a-bf08-48e7-8e07-0d464a38e467 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:47.128664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4020663a-bf08-48e7-8e07-0d464a38e467 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:47.137656 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4020663a-bf08-48e7-8e07-0d464a38e467 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1216 microversion: 2.1 time: 0.079578 Oct 17 16:33:47.138259 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3555/7383] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:47 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:33:48.161533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:48.162119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:48.169602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:48.170088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:48.170546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:48.171262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:48.171711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:48.172140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:48.240852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:48.249160 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3d9daa4-db43-42db-aa4e-e85a8d399c6d tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1268 microversion: 2.1 time: 0.091878 Oct 17 16:33:48.249754 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3829/7384] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:48 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1268 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:49.274110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:49.274751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:49.282992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:49.283497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:49.283947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:49.284658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:49.285153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:49.285594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:49.496571 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:49.506420 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bf4ec12c-b0af-4922-b6e0-93edde3e1b1f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1316 microversion: 2.1 time: 0.236685 Oct 17 16:33:49.507287 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3556/7385] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:49 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:49.804808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bcbe1871-a43d-4ca0-92e6-4f3607ef25e5 req-5dc97d64-5afc-40a6-bbf0-199b35999ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d69e2e-4fb6-4737-8e3e-0f899101aed8", "tag": "0dbc8971-029b-4caa-b8dd-dc1ac6a7dc77"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:33:49.819249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bcbe1871-a43d-4ca0-92e6-4f3607ef25e5 req-5dc97d64-5afc-40a6-bbf0-199b35999ad1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:49.820529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bcbe1871-a43d-4ca0-92e6-4f3607ef25e5 req-5dc97d64-5afc-40a6-bbf0-199b35999ad1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:49.820951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bcbe1871-a43d-4ca0-92e6-4f3607ef25e5 req-5dc97d64-5afc-40a6-bbf0-199b35999ad1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:49.836230 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bcbe1871-a43d-4ca0-92e6-4f3607ef25e5 req-5dc97d64-5afc-40a6-bbf0-199b35999ad1 service nova] Creating event network-changed:0dbc8971-029b-4caa-b8dd-dc1ac6a7dc77 for instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 on n-h1-854441-12 Oct 17 16:33:49.842229 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bcbe1871-a43d-4ca0-92e6-4f3607ef25e5 req-5dc97d64-5afc-40a6-bbf0-199b35999ad1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041697 Oct 17 16:33:49.843113 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3830/7386] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:33:50.530288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:50.530899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:50.538074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:50.538598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:50.539045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:50.539770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:50.540239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:50.540677 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:50.680274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:50.688773 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3bfce70-ef1a-4575-aae2-c33f4d6380e8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1316 microversion: 2.1 time: 0.162628 Oct 17 16:33:50.689375 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3557/7387] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:50 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:51.711989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:51.712581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:51.720018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:51.720536 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:51.721089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:51.721792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:51.722240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:51.722662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:51.867216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:51.875196 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec3247b7-747f-48b9-83f1-209d2455a0cb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1316 microversion: 2.1 time: 0.167632 Oct 17 16:33:51.875801 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3831/7388] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:51 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:52.899190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:52.899823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:52.907371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:52.907882 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:52.908384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:52.909093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:52.909570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:52.910022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:53.045484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:53.054269 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-706b65f8-17a4-443f-b026-9727339e90bc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1316 microversion: 2.1 time: 0.159183 Oct 17 16:33:53.054887 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3558/7389] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:52 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:54.083027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:54.083693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:54.091308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:54.091807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:54.092268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:54.092988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:54.093438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:54.094041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:54.231117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:54.239717 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-755c449f-7dbc-474b-8b53-fd3c16081df8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1316 microversion: 2.1 time: 0.160795 Oct 17 16:33:54.240305 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3832/7390] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:54 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:55.264600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:55.265217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:55.272207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:55.272725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:55.273180 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:55.273889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:55.274364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:55.274833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:55.767167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:55.778633 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dece7633-6536-4663-8dfb-56feb2a8a792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1316 microversion: 2.1 time: 0.518298 Oct 17 16:33:55.779250 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3559/7391] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:55 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:56.456120 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5c3381a5-bb97-4a79-8d53-9fde78b14fbb req-90f024dc-bc33-41aa-a02a-9e156dd00b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d69e2e-4fb6-4737-8e3e-0f899101aed8", "name": "network-vif-plugged", "status": "completed", "tag": "0dbc8971-029b-4caa-b8dd-dc1ac6a7dc77"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:33:56.467526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5c3381a5-bb97-4a79-8d53-9fde78b14fbb req-90f024dc-bc33-41aa-a02a-9e156dd00b64 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:56.468785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5c3381a5-bb97-4a79-8d53-9fde78b14fbb req-90f024dc-bc33-41aa-a02a-9e156dd00b64 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:56.468785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5c3381a5-bb97-4a79-8d53-9fde78b14fbb req-90f024dc-bc33-41aa-a02a-9e156dd00b64 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:56.480515 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5c3381a5-bb97-4a79-8d53-9fde78b14fbb req-90f024dc-bc33-41aa-a02a-9e156dd00b64 service nova] Creating event network-vif-plugged:0dbc8971-029b-4caa-b8dd-dc1ac6a7dc77 for instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 on n-h1-854441-12 Oct 17 16:33:56.485844 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5c3381a5-bb97-4a79-8d53-9fde78b14fbb req-90f024dc-bc33-41aa-a02a-9e156dd00b64 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033554 Oct 17 16:33:56.486750 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3833/7392] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:33:56.804221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:56.805231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:56.812122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:56.812992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:56.813454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:56.814206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:56.814683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:56.815131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:56.964125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:56.973627 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bdac2968-6be6-4ca8-a42e-1e1f22bbdbaa tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1316 microversion: 2.1 time: 0.173911 Oct 17 16:33:56.974271 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3560/7393] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:56 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:57.994166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:57.994937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:58.000224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:58.000931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:58.008638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:58.009127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:58.009553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:58.010241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:58.010732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:58.011159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:58.154418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:58.162624 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-61f63ad0-9fbe-4d90-bbb6-fd1d9dd46aab tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1504 microversion: 2.1 time: 0.169463 Oct 17 16:33:58.163231 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3834/7394] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:57 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:58.185359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:58.185963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:58.187855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:33:58.194449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:58.195002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:58.195464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:58.196188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:58.196702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:58.197212 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:58.228157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:33:58.319032 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ec7577b-ca2d-45a7-a2b1-fd6215755bd0 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "DELETE /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 204 len: 0 microversion: 2.1 time: 0.137160 Oct 17 16:33:58.319627 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3561/7395] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:33:58 2022] DELETE /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:33:58.330561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:58.331512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:58.337848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:58.338344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:58.338814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:58.339524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:58.339976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:58.340432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:58.474490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:58.482724 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1efd82b5-d0db-47ee-9cd8-90446a3aa2b8 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1510 microversion: 2.1 time: 0.158118 Oct 17 16:33:58.483308 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3835/7396] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:58 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:33:59.508774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:33:59.509618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:33:59.517012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:59.517540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:59.517974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:59.518731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:33:59.519266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:33:59.519712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:33:59.727147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:33:59.736277 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4019c976-a0cc-45b6-96a7-dcaf79a39285 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 200 len: 1510 microversion: 2.1 time: 0.231783 Oct 17 16:33:59.736794 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3562/7397] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:33:59 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:00.134749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-18c23477-c5cd-4a1b-be90-470668f2689a req-1f3ab4ca-6230-41df-94f4-fe827a33c252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d69e2e-4fb6-4737-8e3e-0f899101aed8", "name": "network-vif-deleted", "tag": "0dbc8971-029b-4caa-b8dd-dc1ac6a7dc77"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:00.149792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-18c23477-c5cd-4a1b-be90-470668f2689a req-1f3ab4ca-6230-41df-94f4-fe827a33c252 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:00.150984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-18c23477-c5cd-4a1b-be90-470668f2689a req-1f3ab4ca-6230-41df-94f4-fe827a33c252 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:00.152132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-18c23477-c5cd-4a1b-be90-470668f2689a req-1f3ab4ca-6230-41df-94f4-fe827a33c252 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:00.171569 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-18c23477-c5cd-4a1b-be90-470668f2689a req-1f3ab4ca-6230-41df-94f4-fe827a33c252 service nova] Creating event network-vif-deleted:0dbc8971-029b-4caa-b8dd-dc1ac6a7dc77 for instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 on n-h1-854441-12 Oct 17 16:34:00.177790 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-18c23477-c5cd-4a1b-be90-470668f2689a req-1f3ab4ca-6230-41df-94f4-fe827a33c252 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047246 Oct 17 16:34:00.178731 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3836/7398] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:34:00.760267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:00.760876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:00.768583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:00.769079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:00.769537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:00.770276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:00.770799 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:00.771283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:00.786014 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] HTTP exception thrown: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Request method failure captured: Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 HTTP/1.1 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYPegsTt35YJ186jiGW09rlssQeAHr_05dD-8aLWUPVuwnPDgwneiKnpoQ9-PJGKnVXQK133rMI1G3vbM6vY1MOKvX7gbAxIAFmggJNz5UVoei9SPZVom8Hu76wsgm9Y-13c8QQ2GhLYNCLVbKyNU-vbDnT9HmcJJmjY-gFe0JXtE-E Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0aef05e0921d4f1384e07c8ad3238990 Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '33d69e2e-4fb6-4737-8e3e-0f899101aed8'} Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:00.791847 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Returning 404 to user: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c57b3626-97bc-4d47-8dad-82caba98f288 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 404 len: 111 microversion: 2.1 time: 0.036945 Oct 17 16:34:00.797058 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3563/7399] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:00 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:34:00.803150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:00.804048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:00.810680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:00.811180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:00.811609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:00.812307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:00.812751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:00.813156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:00.948440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:00.956971 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff0d9d8b-8667-4b35-8598-14c347c6efdd tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1505 microversion: 2.1 time: 0.158070 Oct 17 16:34:00.957630 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3837/7400] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:00 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:00.980626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3386b16-c753-469e-a1a3-b24558c2e1e3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:00.983051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3386b16-c753-469e-a1a3-b24558c2e1e3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 7cd7b7c1-b516-46ca-940c-183708fbd00d] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:00.988937 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-e3386b16-c753-469e-a1a3-b24558c2e1e3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] HTTP exception thrown: Instance 7cd7b7c1-b516-46ca-940c-183708fbd00d could not be found. Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3386b16-c753-469e-a1a3-b24558c2e1e3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Request method failure captured: Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/7cd7b7c1-b516-46ca-940c-183708fbd00d/action HTTP/1.1 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 32 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYPegsTt35YJ186jiGW09rlssQeAHr_05dD-8aLWUPVuwnPDgwneiKnpoQ9-PJGKnVXQK133rMI1G3vbM6vY1MOKvX7gbAxIAFmggJNz5UVoei9SPZVom8Hu76wsgm9Y-13c8QQ2GhLYNCLVbKyNU-vbDnT9HmcJJmjY-gFe0JXtE-E Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0aef05e0921d4f1384e07c8ad3238990 Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: {"resize": {"flavorRef": "452"}} Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 7cd7b7c1-b516-46ca-940c-183708fbd00d could not be found. Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '7cd7b7c1-b516-46ca-940c-183708fbd00d', 'body': {'resize': {'flavorRef': '452'}}} Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd7b7c1-b516-46ca-940c-183708fbd00d could not be found. Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:34:00.990575 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd7b7c1-b516-46ca-940c-183708fbd00d could not be found. Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd7b7c1-b516-46ca-940c-183708fbd00d could not be found. Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3386b16-c753-469e-a1a3-b24558c2e1e3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Returning 404 to user: Instance 7cd7b7c1-b516-46ca-940c-183708fbd00d could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3386b16-c753-469e-a1a3-b24558c2e1e3 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "POST /compute/v2.1/servers/7cd7b7c1-b516-46ca-940c-183708fbd00d/action" status: 404 len: 111 microversion: 2.1 time: 0.015723 Oct 17 16:34:00.995703 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3564/7401] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:34:00 2022] POST /compute/v2.1/servers/7cd7b7c1-b516-46ca-940c-183708fbd00d/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:34:01.002196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:01.003378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:01.009830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.010321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.010770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.011476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.011945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.012359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.154043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:01.162651 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a80528fa-6cdb-4321-b63b-961d0b9925ef tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1505 microversion: 2.1 time: 0.164276 Oct 17 16:34:01.163295 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3838/7402] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:00 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:34:01.186242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:01.186923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:01.195888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.196430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.196963 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.197599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.198071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.198661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.336082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:01.344719 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9527b3d7-2f52-4ad5-84fc-9587acbcb792 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1505 microversion: 2.1 time: 0.162372 Oct 17 16:34:01.345333 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3565/7403] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:01 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:01.367956 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "bd6c785d-684f-4b44-8d66-5ffdd59ae58e"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:01.370296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:01.376845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.377343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.378154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.378931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.379378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.379772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.409161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:01.414554 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] HTTP exception thrown: Flavor bd6c785d-684f-4b44-8d66-5ffdd59ae58e could not be found. Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Request method failure captured: Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: request: POST /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7/action HTTP/1.1 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 65 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYPegsTt35YJ186jiGW09rlssQeAHr_05dD-8aLWUPVuwnPDgwneiKnpoQ9-PJGKnVXQK133rMI1G3vbM6vY1MOKvX7gbAxIAFmggJNz5UVoei9SPZVom8Hu76wsgm9Y-13c8QQ2GhLYNCLVbKyNU-vbDnT9HmcJJmjY-gFe0JXtE-E Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 0aef05e0921d4f1384e07c8ad3238990 Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: {"resize": {"flavorRef": "bd6c785d-684f-4b44-8d66-5ffdd59ae58e"}} Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: exception: Flavor bd6c785d-684f-4b44-8d66-5ffdd59ae58e could not be found. Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8f07d4e3-c023-4e6a-a210-78ccfcd888a7', 'body': {'resize': {'flavorRef': 'bd6c785d-684f-4b44-8d66-5ffdd59ae58e'}}} Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:34:01.416488 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bd6c785d-684f-4b44-8d66-5ffdd59ae58e could not be found. Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor bd6c785d-684f-4b44-8d66-5ffdd59ae58e could not be found. Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bd6c785d-684f-4b44-8d66-5ffdd59ae58e could not be found. Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Returning 400 to user: Flavor bd6c785d-684f-4b44-8d66-5ffdd59ae58e could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4b9165cf-49b0-4406-8055-de0a6aa1aeb7 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "POST /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7/action" status: 400 len: 107 microversion: 2.1 time: 0.054175 Oct 17 16:34:01.421526 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3839/7404] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:34:01 2022] POST /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7/action => generated 107 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 16:34:01.427246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:01.427916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:01.434257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.434791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.435243 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.435958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.436458 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.436893 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.575801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:01.584518 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a293bbe0-b1d4-4714-8a4c-8df673fa617a tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1505 microversion: 2.1 time: 0.161179 Oct 17 16:34:01.585066 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3566/7405] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:01 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:34:01.608117 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:01.608725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:01.615052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.615550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.615974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.616669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.617097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.617541 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.757678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:01.766235 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-86d4093d-e6b5-4835-932a-fb487dbb2c4b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1505 microversion: 2.1 time: 0.161976 Oct 17 16:34:01.766842 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3840/7406] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:01 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:01.805565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ea3eaba-382c-40bd-8527-68af961dbefc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ea3eaba-382c-40bd-8527-68af961dbefc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Request method failure captured: Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: request: POST /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7/action HTTP/1.1 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 29 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYPegsTt35YJ186jiGW09rlssQeAHr_05dD-8aLWUPVuwnPDgwneiKnpoQ9-PJGKnVXQK133rMI1G3vbM6vY1MOKvX7gbAxIAFmggJNz5UVoei9SPZVom8Hu76wsgm9Y-13c8QQ2GhLYNCLVbKyNU-vbDnT9HmcJJmjY-gFe0JXtE-E Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0aef05e0921d4f1384e07c8ad3238990 Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: {"resize": {"flavorRef": ""}} Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '8f07d4e3-c023-4e6a-a210-78ccfcd888a7', 'body': {'resize': {'flavorRef': ''}}} Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise error Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi '' Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.810141 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ea3eaba-382c-40bd-8527-68af961dbefc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ea3eaba-382c-40bd-8527-68af961dbefc tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "POST /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7/action" status: 400 len: 113 microversion: 2.1 time: 0.010702 Oct 17 16:34:01.815206 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3567/7407] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:34:01 2022] POST /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7/action => generated 113 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 16:34:01.826877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:01.828089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:01.836291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.836787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.837224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.837934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:01.838395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:01.838877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:01.979997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:01.988636 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a83d8378-cb75-4aaf-8140-e90dd7b685eb tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1505 microversion: 2.1 time: 0.169293 Oct 17 16:34:01.989244 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3841/7408] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:01 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:02.016040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:02.016557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:02.024396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:02.024938 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:02.025380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:02.026116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:02.026624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:02.027071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:02.041694 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] HTTP exception thrown: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Request method failure captured: Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 HTTP/1.1 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYPegsTt35YJ186jiGW09rlssQeAHr_05dD-8aLWUPVuwnPDgwneiKnpoQ9-PJGKnVXQK133rMI1G3vbM6vY1MOKvX7gbAxIAFmggJNz5UVoei9SPZVom8Hu76wsgm9Y-13c8QQ2GhLYNCLVbKyNU-vbDnT9HmcJJmjY-gFe0JXtE-E Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 0aef05e0921d4f1384e07c8ad3238990 Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '33d69e2e-4fb6-4737-8e3e-0f899101aed8'} Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:34:02.043344 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Returning 404 to user: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-93973a6a-5018-45a1-8e11-d30d1422f80b tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "DELETE /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 404 len: 111 microversion: 2.1 time: 0.033603 Oct 17 16:34:02.047502 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3568/7409] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:34:02 2022] DELETE /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:34:02.054860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:02.055503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 33d69e2e-4fb6-4737-8e3e-0f899101aed8] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:02.062250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:02.062776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:02.063322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:02.064040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:02.064488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:02.064904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:02.079621 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] HTTP exception thrown: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Request method failure captured: Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 HTTP/1.1 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYPegsTt35YJ186jiGW09rlssQeAHr_05dD-8aLWUPVuwnPDgwneiKnpoQ9-PJGKnVXQK133rMI1G3vbM6vY1MOKvX7gbAxIAFmggJNz5UVoei9SPZVom8Hu76wsgm9Y-13c8QQ2GhLYNCLVbKyNU-vbDnT9HmcJJmjY-gFe0JXtE-E Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 0aef05e0921d4f1384e07c8ad3238990 Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '33d69e2e-4fb6-4737-8e3e-0f899101aed8'} Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:02.081185 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Returning 404 to user: Instance 33d69e2e-4fb6-4737-8e3e-0f899101aed8 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-90a2eed6-dba6-41a0-8aee-9ae9d8c70e67 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8" status: 404 len: 111 microversion: 2.1 time: 0.031999 Oct 17 16:34:02.085794 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3842/7410] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:02 2022] GET /compute/v2.1/servers/33d69e2e-4fb6-4737-8e3e-0f899101aed8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:34:02.092298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:02.092814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:02.099604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:02.100118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:02.100567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:02.101306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:02.101775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:02.102218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:02.107104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:34:02.137450 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:34:02.226522 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-19af9cac-4844-4cbc-a44b-bdb912dfdaca tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 204 len: 0 microversion: 2.1 time: 0.137926 Oct 17 16:34:02.227318 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3569/7411] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:34:02 2022] DELETE /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:34:02.236908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:02.237888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:02.245523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:02.246022 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:02.246457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:02.247227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:02.247680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:02.248121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:02.253339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=100 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:34:02.390401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:02.399219 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-67b9fb7a-1758-403b-98cd-778358023828 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1511 microversion: 2.1 time: 0.167370 Oct 17 16:34:02.399810 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3843/7412] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:02 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:03.427037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:03.427790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:03.435376 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:03.435884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:03.436340 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:03.437059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:03.437538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:03.437985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:03.579826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:03.588784 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab4a37be-c6f3-42a7-80f8-2e3c54c6bb3f tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1511 microversion: 2.1 time: 0.168399 Oct 17 16:34:03.589432 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3570/7413] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:03 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:04.139450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-bb727c09-26cd-4331-929d-b41794123e4b req-e61a573c-7357-49f8-a635-245b2a5e94af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f07d4e3-c023-4e6a-a210-78ccfcd888a7", "name": "network-vif-deleted", "tag": "5b431abd-8ce4-485a-92ca-3f323000100b"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:04.152170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bb727c09-26cd-4331-929d-b41794123e4b req-e61a573c-7357-49f8-a635-245b2a5e94af service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:04.152790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bb727c09-26cd-4331-929d-b41794123e4b req-e61a573c-7357-49f8-a635-245b2a5e94af service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:04.153277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-bb727c09-26cd-4331-929d-b41794123e4b req-e61a573c-7357-49f8-a635-245b2a5e94af service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:04.170412 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-bb727c09-26cd-4331-929d-b41794123e4b req-e61a573c-7357-49f8-a635-245b2a5e94af service nova] Creating event network-vif-deleted:5b431abd-8ce4-485a-92ca-3f323000100b for instance 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 on n-h2-854441-12 Oct 17 16:34:04.188312 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-bb727c09-26cd-4331-929d-b41794123e4b req-e61a573c-7357-49f8-a635-245b2a5e94af service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055972 Oct 17 16:34:04.189457 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3844/7414] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:34:04.620604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:04.621226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:04.628943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:04.629467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:04.629980 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:04.630749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:04.631226 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:04.631663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:04.663835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:04.664332 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:04.664786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:04.665256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lazy-loading 'fault' on Instance uuid 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:34:04.707309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aef05e0921d4f1384e07c8ad3238990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b0eeba1987d43f3b7627f0fac30a653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:04.715510 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5a9b0bd1-7f1a-413f-b6aa-4260e141ae83 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 200 len: 1306 microversion: 2.1 time: 0.098975 Oct 17 16:34:04.716088 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3571/7415] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:04 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:05.739810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:05.740473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] [instance: 8f07d4e3-c023-4e6a-a210-78ccfcd888a7] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:05.743443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:34:05.751637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:05.752137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:05.752962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:05.753676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:05.754145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:05.754588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:05.769047 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] HTTP exception thrown: Instance 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 could not be found. Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Request method failure captured: Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 HTTP/1.1 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYPegsTt35YJ186jiGW09rlssQeAHr_05dD-8aLWUPVuwnPDgwneiKnpoQ9-PJGKnVXQK133rMI1G3vbM6vY1MOKvX7gbAxIAFmggJNz5UVoei9SPZVom8Hu76wsgm9Y-13c8QQ2GhLYNCLVbKyNU-vbDnT9HmcJJmjY-gFe0JXtE-E Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/5b0eeba1987d43f3b7627f0fac30a653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 5b0eeba1987d43f3b7627f0fac30a653 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1436417332 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 0aef05e0921d4f1384e07c8ad3238990 Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-ServersNegativeTestJSON-1436417332-project Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 could not be found. Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '8f07d4e3-c023-4e6a-a210-78ccfcd888a7'} Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 could not be found. Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 could not be found. Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:34:05.770800 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 could not be found. Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] Returning 404 to user: Instance 8f07d4e3-c023-4e6a-a210-78ccfcd888a7 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec03eb3f-049b-47d6-847e-ae0ac7bcca51 tempest-ServersNegativeTestJSON-1436417332 tempest-ServersNegativeTestJSON-1436417332-project] 10.222.0.87 "GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7" status: 404 len: 111 microversion: 2.1 time: 0.037021 Oct 17 16:34:05.776149 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3845/7416] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:05 2022] GET /compute/v2.1/servers/8f07d4e3-c023-4e6a-a210-78ccfcd888a7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:34:37.979161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:34:37.980418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:34:38.170652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b1a9977-1ba6-4a63-8bf9-2d5e7a2302d6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Action: 'create', calling method: .version_select at 0x7f28bdf7d8b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-449599847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZMTetj8DrctKtKMDFaa2bg8afRrwkIxDSVON/ADhW+OMzV9o6TPW7O9ft6+S881tYnSSg8VzhuGI001JoJIBYo3euTOqGgwphvPy1aDdiN9o6SWyNvXkluH/7iOEo6Eg=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:38.187028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-0b1a9977-1ba6-4a63-8bf9-2d5e7a2302d6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for project 177e29e2fed7491f93ec3fef02213252. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:34:38.192737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-0b1a9977-1ba6-4a63-8bf9-2d5e7a2302d6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for user 1af5b015bc914ee09380638a20c4f66e and project 177e29e2fed7491f93ec3fef02213252. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:34:38.223866 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b1a9977-1ba6-4a63-8bf9-2d5e7a2302d6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.250235 Oct 17 16:34:38.224584 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3572/7417] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:34:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:34:38.280394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-376497197", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-449599847", "networks": [{"uuid": "2ecf7c75-2391-4862-be61-ecef66e3fd6d"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:38.293779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:34:38.294735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:34:38.340169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] validate_networks() for [('2ecf7c75-2391-4862-be61-ecef66e3fd6d', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:34:38.739499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:34:38.739921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:34:38.740509 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:34:38.740920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:34:38.741670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:34:38.754359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:38.754908 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:38.755345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:38.756075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:38.756530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:38.756957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:38.773973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for project 177e29e2fed7491f93ec3fef02213252. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:34:38.779675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for user 1af5b015bc914ee09380638a20c4f66e and project 177e29e2fed7491f93ec3fef02213252. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:34:38.792317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:34:38.794720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:34:38.844956 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-52c71fc3-7252-4c1a-b67b-42bab595c10a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571687 Oct 17 16:34:38.845616 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3846/7418] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:34:38.857070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0045cadb-25f4-4e02-889a-92af50524b06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:38.857703 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0045cadb-25f4-4e02-889a-92af50524b06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:38.918984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0045cadb-25f4-4e02-889a-92af50524b06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:38.942171 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0045cadb-25f4-4e02-889a-92af50524b06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1261 microversion: 2.1 time: 0.083771 Oct 17 16:34:38.942867 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3573/7419] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:38 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:39.968168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:39.969470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:39.977142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:39.978013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:39.978663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:39.979551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:39.980006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:39.980432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:40.059688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:40.067995 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cf2ace66-9d75-4e7e-b41d-decce245d3f0 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1321 microversion: 2.1 time: 0.107023 Oct 17 16:34:40.083169 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3847/7420] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:39 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1321 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:41.099600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:41.101159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:41.112015 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:41.112830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:41.113470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:41.114378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:41.115044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:41.115649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:41.355622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:41.363877 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ab26b776-6154-46e2-9006-37c66c63a002 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1361 microversion: 2.1 time: 0.270567 Oct 17 16:34:41.364606 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3574/7421] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:41 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:41.534252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-62d36b5c-b730-4a53-8d8e-4c32b7785eed req-a191bd9b-d1da-4ca8-9bf0-7a12e0281618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a60d34da-5dc5-44ec-9b00-4a9e4f210629", "tag": "71d68cc2-9994-4a08-9f40-3dc9a4c3da9d"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:41.547337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-62d36b5c-b730-4a53-8d8e-4c32b7785eed req-a191bd9b-d1da-4ca8-9bf0-7a12e0281618 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:41.547833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-62d36b5c-b730-4a53-8d8e-4c32b7785eed req-a191bd9b-d1da-4ca8-9bf0-7a12e0281618 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:41.548267 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-62d36b5c-b730-4a53-8d8e-4c32b7785eed req-a191bd9b-d1da-4ca8-9bf0-7a12e0281618 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:41.566161 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-62d36b5c-b730-4a53-8d8e-4c32b7785eed req-a191bd9b-d1da-4ca8-9bf0-7a12e0281618 service nova] Creating event network-changed:71d68cc2-9994-4a08-9f40-3dc9a4c3da9d for instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 on n-h1-854441-12 Oct 17 16:34:41.571876 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-62d36b5c-b730-4a53-8d8e-4c32b7785eed req-a191bd9b-d1da-4ca8-9bf0-7a12e0281618 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041850 Oct 17 16:34:41.572715 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3848/7422] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:34:42.392301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:42.392879 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:42.400252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:42.400768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:42.401230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:42.402011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:42.402487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:42.402961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:42.547151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:42.558093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36b94b87-4c36-4951-942e-08b5fd211f06 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1361 microversion: 2.1 time: 0.169929 Oct 17 16:34:42.558778 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3575/7423] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:42 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:43.587487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:43.588327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:43.595278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:43.595745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:43.596184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:43.596894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:43.597374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:43.597802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:43.737933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:43.746095 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d4fdebd9-14e6-4f3d-adb3-2cc3bad8e12b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1361 microversion: 2.1 time: 0.163874 Oct 17 16:34:43.746734 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3849/7424] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:43 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:44.772289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:44.773513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:44.780711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:44.781219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:44.781674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:44.782400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:44.782911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:44.783623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:44.934903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:44.945616 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-386292c8-1ecb-4c5b-a8fe-c2628c541d68 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1361 microversion: 2.1 time: 0.177794 Oct 17 16:34:44.961929 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3576/7425] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:44 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:45.968921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:45.969574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:45.976993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:45.977493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:45.977927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:45.978680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:45.979136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:45.979680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:46.122039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:46.130607 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-594d9da5-77e5-4e27-a5ec-ec3196e0e160 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1361 microversion: 2.1 time: 0.165662 Oct 17 16:34:46.131199 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3850/7426] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:45 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:46.682710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-44b0a7a9-5e1f-493c-9909-5ffe9e5b42c4 req-b44a03ff-e30e-4ae3-a958-c67a9d3ead1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60d34da-5dc5-44ec-9b00-4a9e4f210629", "name": "network-vif-plugged", "status": "completed", "tag": "71d68cc2-9994-4a08-9f40-3dc9a4c3da9d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:46.693661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-44b0a7a9-5e1f-493c-9909-5ffe9e5b42c4 req-b44a03ff-e30e-4ae3-a958-c67a9d3ead1c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:46.694159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-44b0a7a9-5e1f-493c-9909-5ffe9e5b42c4 req-b44a03ff-e30e-4ae3-a958-c67a9d3ead1c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:46.694630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-44b0a7a9-5e1f-493c-9909-5ffe9e5b42c4 req-b44a03ff-e30e-4ae3-a958-c67a9d3ead1c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:46.711294 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-44b0a7a9-5e1f-493c-9909-5ffe9e5b42c4 req-b44a03ff-e30e-4ae3-a958-c67a9d3ead1c service nova] Creating event network-vif-plugged:71d68cc2-9994-4a08-9f40-3dc9a4c3da9d for instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 on n-h1-854441-12 Oct 17 16:34:46.717901 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-44b0a7a9-5e1f-493c-9909-5ffe9e5b42c4 req-b44a03ff-e30e-4ae3-a958-c67a9d3ead1c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038077 Oct 17 16:34:46.717901 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3577/7427] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:34:47.154319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:47.154902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:47.162528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:47.163055 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:47.163499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:47.164327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:47.164776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:47.165203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:47.314662 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:47.322910 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-92f3d280-3c5f-47fc-aaf0-eb966c53c30c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1361 microversion: 2.1 time: 0.172772 Oct 17 16:34:47.323515 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3851/7428] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:47 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:48.347203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:48.347891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:48.354797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:48.355298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:48.355749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:48.356454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:48.356916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:48.357346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:48.490116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:48.498801 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-327fd5ab-641c-4ce7-9fce-bea35fbf7dae tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1552 microversion: 2.1 time: 0.156925 Oct 17 16:34:48.499362 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3578/7429] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:48 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:48.533989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:34:48.534920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:48.544767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:48.545261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:48.545720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:48.546422 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:48.546906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:48.547329 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:48.685507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:34:48.693778 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7942a43e-3468-4430-a51f-993b19f258e8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1552 microversion: 2.1 time: 0.166071 Oct 17 16:34:48.694382 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3852/7430] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:34:48 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:34:50.427208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-87142472-c73b-4c52-9a2e-90218e714bb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77685c8e-ffdf-4b49-b1bf-1afd40f3c248"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:34:50.429624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-87142472-c73b-4c52-9a2e-90218e714bb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:34:50.431700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:34:50.439517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87142472-c73b-4c52-9a2e-90218e714bb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:50.440057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87142472-c73b-4c52-9a2e-90218e714bb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:50.440681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87142472-c73b-4c52-9a2e-90218e714bb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:50.441724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87142472-c73b-4c52-9a2e-90218e714bb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:34:50.442363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87142472-c73b-4c52-9a2e-90218e714bb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:34:50.442997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-87142472-c73b-4c52-9a2e-90218e714bb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:34:50.719840 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-87142472-c73b-4c52-9a2e-90218e714bb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "POST /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296649 Oct 17 16:34:50.720476 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3579/7431] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 16:34:50 2022] POST /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:01.484403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:01.484953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:01.487244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:01.487934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:01.489310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:01.490017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=34 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:01.497020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:01.497508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:01.497954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:01.498699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:01.499183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:01.499640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:01.591024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lazy-loading 'services' on Instance uuid a60d34da-5dc5-44ec-9b00-4a9e4f210629 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:35:01.669111 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ce21e401-5d07-4ef9-80aa-15f77731cd37 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments/77685c8e-ffdf-4b49-b1bf-1afd40f3c248" status: 202 len: 0 microversion: 2.1 time: 0.188534 Oct 17 16:35:01.670092 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3853/7432] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:35:01 2022] DELETE /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments/77685c8e-ffdf-4b49-b1bf-1afd40f3c248 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:35:01.677056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:01.678019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:01.682737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8af93f7-3be5-4c36-9b16-9599abfdde0e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:01.685373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8af93f7-3be5-4c36-9b16-9599abfdde0e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:01.694125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8af93f7-3be5-4c36-9b16-9599abfdde0e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:01.694813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8af93f7-3be5-4c36-9b16-9599abfdde0e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:01.695268 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8af93f7-3be5-4c36-9b16-9599abfdde0e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:01.695967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8af93f7-3be5-4c36-9b16-9599abfdde0e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:01.696430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8af93f7-3be5-4c36-9b16-9599abfdde0e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:01.697008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8af93f7-3be5-4c36-9b16-9599abfdde0e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:01.730056 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8af93f7-3be5-4c36-9b16-9599abfdde0e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055187 Oct 17 16:35:01.730674 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3580/7433] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:01 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:02.745254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5fb3057a-147a-449b-bc6e-1d8a3b611d3d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:02.747652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5fb3057a-147a-449b-bc6e-1d8a3b611d3d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:02.754834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fb3057a-147a-449b-bc6e-1d8a3b611d3d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:02.755317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fb3057a-147a-449b-bc6e-1d8a3b611d3d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:02.755745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fb3057a-147a-449b-bc6e-1d8a3b611d3d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:02.756432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fb3057a-147a-449b-bc6e-1d8a3b611d3d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:02.756878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fb3057a-147a-449b-bc6e-1d8a3b611d3d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:02.757293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fb3057a-147a-449b-bc6e-1d8a3b611d3d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:02.789254 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5fb3057a-147a-449b-bc6e-1d8a3b611d3d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049176 Oct 17 16:35:02.790070 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3854/7434] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:02 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:35:03.801552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a45f1d4c-9635-4627-ba86-7900c173682c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:03.803877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a45f1d4c-9635-4627-ba86-7900c173682c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:03.811373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45f1d4c-9635-4627-ba86-7900c173682c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:03.811895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45f1d4c-9635-4627-ba86-7900c173682c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:03.812386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45f1d4c-9635-4627-ba86-7900c173682c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:03.813123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45f1d4c-9635-4627-ba86-7900c173682c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:03.813699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45f1d4c-9635-4627-ba86-7900c173682c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:03.814111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a45f1d4c-9635-4627-ba86-7900c173682c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:03.847472 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a45f1d4c-9635-4627-ba86-7900c173682c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049880 Oct 17 16:35:03.848033 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3581/7435] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:03 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:04.864017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-02751cfc-a868-4e56-aede-65d1e1a23591 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:04.866242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-02751cfc-a868-4e56-aede-65d1e1a23591 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:04.873463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02751cfc-a868-4e56-aede-65d1e1a23591 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:04.873958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02751cfc-a868-4e56-aede-65d1e1a23591 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:04.874402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02751cfc-a868-4e56-aede-65d1e1a23591 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:04.875200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02751cfc-a868-4e56-aede-65d1e1a23591 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:04.875663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02751cfc-a868-4e56-aede-65d1e1a23591 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:04.876078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-02751cfc-a868-4e56-aede-65d1e1a23591 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:04.908041 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-02751cfc-a868-4e56-aede-65d1e1a23591 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050715 Oct 17 16:35:04.908622 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3855/7436] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:04 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:05.921274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-06f9ffa7-9935-47ff-bbd7-fd3326c2cabe tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:05.924235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-06f9ffa7-9935-47ff-bbd7-fd3326c2cabe tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:05.931717 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06f9ffa7-9935-47ff-bbd7-fd3326c2cabe tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:05.932224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06f9ffa7-9935-47ff-bbd7-fd3326c2cabe tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:05.932678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06f9ffa7-9935-47ff-bbd7-fd3326c2cabe tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:05.933395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06f9ffa7-9935-47ff-bbd7-fd3326c2cabe tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:05.933857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06f9ffa7-9935-47ff-bbd7-fd3326c2cabe tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:05.934305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-06f9ffa7-9935-47ff-bbd7-fd3326c2cabe tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:05.965731 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-06f9ffa7-9935-47ff-bbd7-fd3326c2cabe tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048537 Oct 17 16:35:05.966343 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3582/7437] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:05 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:06.978545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1cc33f3-f9df-4cb9-b85f-fa95c8bc7095 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:06.980808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1cc33f3-f9df-4cb9-b85f-fa95c8bc7095 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:06.988050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1cc33f3-f9df-4cb9-b85f-fa95c8bc7095 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:06.988592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1cc33f3-f9df-4cb9-b85f-fa95c8bc7095 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:06.989027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1cc33f3-f9df-4cb9-b85f-fa95c8bc7095 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:06.989721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1cc33f3-f9df-4cb9-b85f-fa95c8bc7095 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:06.990193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1cc33f3-f9df-4cb9-b85f-fa95c8bc7095 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:06.990707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1cc33f3-f9df-4cb9-b85f-fa95c8bc7095 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:07.022101 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1cc33f3-f9df-4cb9-b85f-fa95c8bc7095 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047700 Oct 17 16:35:07.022709 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3856/7438] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:06 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 16:35:07.033716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:07.034294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:07.041856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:07.042364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:07.042848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:07.043576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:07.044041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:07.044485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:07.129369 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] HTTP exception thrown: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 is not attached to volume 77685c8e-ffdf-4b49-b1bf-1afd40f3c248 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Request method failure captured: Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments/77685c8e-ffdf-4b49-b1bf-1afd40f3c248 HTTP/1.1 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYQYZUxWc-c2oi-rKbq3ZibZpg5x24hcm7UgTnaPER5oPvdA1ywNvyBpy0VCDvFFf_YM4LJqoXEXscjusvcEsEom9W52tMWchMLtkb7vx-ZzR3c2RxPAfBOAWuED81NWfKbz1iVRMuf81TlT8dlIh8noEGxuowJycxrUIxPch-y90pw Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_177e29e2fed7491f93ec3fef02213252"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 1af5b015bc914ee09380638a20c4f66e Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 is not attached to volume 77685c8e-ffdf-4b49-b1bf-1afd40f3c248 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'server_id': 'a60d34da-5dc5-44ec-9b00-4a9e4f210629', 'id': '77685c8e-ffdf-4b49-b1bf-1afd40f3c248'} Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 77685c8e-ffdf-4b49-b1bf-1afd40f3c248. Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 is not attached to volume 77685c8e-ffdf-4b49-b1bf-1afd40f3c248 Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:35:07.136755 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:35:07.141101 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:35:07.141101 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:35:07.141101 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 is not attached to volume 77685c8e-ffdf-4b49-b1bf-1afd40f3c248 Oct 17 16:35:07.141101 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:07.141101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Returning 404 to user: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 is not attached to volume 77685c8e-ffdf-4b49-b1bf-1afd40f3c248 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:35:07.141101 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-908e7259-3ae0-4a16-976a-220ec58012aa tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments/77685c8e-ffdf-4b49-b1bf-1afd40f3c248" status: 404 len: 154 microversion: 2.1 time: 0.108876 Oct 17 16:35:07.141101 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3583/7439] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:35:07 2022] DELETE /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629/os-volume_attachments/77685c8e-ffdf-4b49-b1bf-1afd40f3c248 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:35:10.499024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:10.499556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:10.507148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:10.507640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:10.508075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:10.508765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:10.509219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:10.509640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:10.535370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:35:10.634723 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c01c52a4-1b41-45e0-a372-57f45060fd26 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 204 len: 0 microversion: 2.1 time: 0.139595 Oct 17 16:35:10.635254 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3857/7440] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:35:10 2022] DELETE /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:35:10.644145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:10.644997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:10.652993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:10.653499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:10.654223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:10.655051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:10.655500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:10.655946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:10.800100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:10.808454 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5a4212ff-d8cf-42ad-a558-9cba5ee2bc95 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1558 microversion: 2.1 time: 0.168586 Oct 17 16:35:10.809049 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3584/7441] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:10 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:35:11.832726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:11.833503 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:11.842576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:11.843034 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:11.843553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:11.845015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:11.846264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:11.846914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:12.003423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:12.012757 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-982331d9-a3a4-4161-8234-75aad1c40038 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1558 microversion: 2.1 time: 0.184457 Oct 17 16:35:12.013351 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3858/7442] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:11 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:12.795279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-f376bc8a-1736-4d87-a767-34bdc08d095a req-1a1441de-6d8a-470b-a0c4-afb8d11d450b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60d34da-5dc5-44ec-9b00-4a9e4f210629", "name": "network-vif-deleted", "tag": "71d68cc2-9994-4a08-9f40-3dc9a4c3da9d"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:12.809455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f376bc8a-1736-4d87-a767-34bdc08d095a req-1a1441de-6d8a-470b-a0c4-afb8d11d450b service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:12.809964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f376bc8a-1736-4d87-a767-34bdc08d095a req-1a1441de-6d8a-470b-a0c4-afb8d11d450b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:12.810422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-f376bc8a-1736-4d87-a767-34bdc08d095a req-1a1441de-6d8a-470b-a0c4-afb8d11d450b service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:12.824671 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-f376bc8a-1736-4d87-a767-34bdc08d095a req-1a1441de-6d8a-470b-a0c4-afb8d11d450b service nova] Creating event network-vif-deleted:71d68cc2-9994-4a08-9f40-3dc9a4c3da9d for instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 on n-h1-854441-12 Oct 17 16:35:12.831442 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-f376bc8a-1736-4d87-a767-34bdc08d095a req-1a1441de-6d8a-470b-a0c4-afb8d11d450b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039769 Oct 17 16:35:12.832434 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3585/7443] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:13.037219 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:13.037769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:13.045383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:13.045845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:13.046308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:13.047063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:13.047557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:13.047983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:13.081939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:13.082415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:13.082876 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:13.083365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lazy-loading 'fault' on Instance uuid a60d34da-5dc5-44ec-9b00-4a9e4f210629 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:35:13.125796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:13.134541 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3ce15fae-2a79-49d3-a304-5f2d04717a2b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 200 len: 1351 microversion: 2.1 time: 0.101463 Oct 17 16:35:13.135158 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3859/7444] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:13 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:14.162065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:14.162881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: a60d34da-5dc5-44ec-9b00-4a9e4f210629] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:14.170636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:14.171147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:14.171598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:14.172322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:14.172792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:14.173233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:14.187363 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] HTTP exception thrown: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 could not be found. Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Request method failure captured: Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 HTTP/1.1 Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYQYZUxWc-c2oi-rKbq3ZibZpg5x24hcm7UgTnaPER5oPvdA1ywNvyBpy0VCDvFFf_YM4LJqoXEXscjusvcEsEom9W52tMWchMLtkb7vx-ZzR3c2RxPAfBOAWuED81NWfKbz1iVRMuf81TlT8dlIh8noEGxuowJycxrUIxPch-y90pw Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_177e29e2fed7491f93ec3fef02213252"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 1af5b015bc914ee09380638a20c4f66e Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 could not be found. Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'a60d34da-5dc5-44ec-9b00-4a9e4f210629'} Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 could not be found. Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 could not be found. Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:14.189042 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 could not be found. Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Returning 404 to user: Instance a60d34da-5dc5-44ec-9b00-4a9e4f210629 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-428ace05-996b-4eaa-a64b-4b273be0aaab tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629" status: 404 len: 111 microversion: 2.1 time: 0.035517 Oct 17 16:35:14.194300 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3586/7445] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:14 2022] GET /compute/v2.1/servers/a60d34da-5dc5-44ec-9b00-4a9e4f210629 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:35:14.200384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0a21b67-fbbe-45c9-96fb-62a8fbf9c72b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '.version_select at 0x7f28be107700>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:14.223056 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0a21b67-fbbe-45c9-96fb-62a8fbf9c72b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-449599847" status: 202 len: 0 microversion: 2.1 time: 0.026588 Oct 17 16:35:14.223653 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3860/7446] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 16:35:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-449599847 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:35:14.240928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7069cfc6-ef8a-44f1-8ab8-c504df0fd490 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Action: 'create', calling method: .version_select at 0x7f28bdbe0310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-895176751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlwLju6MwAV5APxR/m4J1xIov17O9DXrqLcTlOOJ3hJZvE42tq8QlzQI/ogyHPBFSf8fSVxkIJmgLH2TaNARmJ3WjQSKcZcz4mywZvolPeywWQmo/LxiAunsBAnXlA56g=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:14.257408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-7069cfc6-ef8a-44f1-8ab8-c504df0fd490 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for project 177e29e2fed7491f93ec3fef02213252. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:35:14.262842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-7069cfc6-ef8a-44f1-8ab8-c504df0fd490 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for user 1af5b015bc914ee09380638a20c4f66e and project 177e29e2fed7491f93ec3fef02213252. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:35:14.293614 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7069cfc6-ef8a-44f1-8ab8-c504df0fd490 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.057012 Oct 17 16:35:14.294196 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3587/7447] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:35:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:14.353394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1622137320", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-895176751", "networks": [{"uuid": "2ecf7c75-2391-4862-be61-ecef66e3fd6d"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:14.413321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] validate_networks() for [('2ecf7c75-2391-4862-be61-ecef66e3fd6d', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:35:14.809582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:35:14.810008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:35:14.810487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:35:14.810921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:35:14.811336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:35:14.823815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:14.824493 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:14.825093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:14.826151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:14.826871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:14.827506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:14.847693 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for project 177e29e2fed7491f93ec3fef02213252. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:35:14.854181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for user 1af5b015bc914ee09380638a20c4f66e and project 177e29e2fed7491f93ec3fef02213252. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:35:14.867043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:35:14.869391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:35:14.917228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eac82560-0ab7-4e2c-9a07-1a6f463da1bd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567848 Oct 17 16:35:14.918068 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3861/7448] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:35:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:35:14.932218 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-210c0241-a386-4739-ad05-f5f9cda8e111 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:14.932862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-210c0241-a386-4739-ad05-f5f9cda8e111 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:14.989668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-210c0241-a386-4739-ad05-f5f9cda8e111 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:14.997941 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-210c0241-a386-4739-ad05-f5f9cda8e111 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1262 microversion: 2.1 time: 0.069772 Oct 17 16:35:14.998531 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3588/7449] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:14 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:16.023312 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:16.024096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:16.030943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:16.031428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:16.031857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:16.032549 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:16.033024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:16.033442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:16.097413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:16.105661 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0e083040-48fa-425b-a1e2-55e54c131a89 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1314 microversion: 2.1 time: 0.087482 Oct 17 16:35:16.106273 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3862/7450] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:16 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1314 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:17.130550 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:17.131193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:17.138538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:17.139081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:17.139532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:17.140255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:17.140720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:17.141157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:17.367285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:17.375538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bdd1c18f-3330-409b-92f1-05eabbd26967 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1362 microversion: 2.1 time: 0.249825 Oct 17 16:35:17.376125 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3589/7451] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:17 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:17.567424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5e948bfb-aeff-431c-9b9a-8e32aad01ad1 req-88e9f8bf-4268-4f0e-bce4-dfa5e84791a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d49f80-a2f0-41ff-9376-ee3f45372f28", "tag": "e7fc9fe9-330b-4752-8aba-1dad1c96921e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:17.578648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5e948bfb-aeff-431c-9b9a-8e32aad01ad1 req-88e9f8bf-4268-4f0e-bce4-dfa5e84791a6 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:17.580469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5e948bfb-aeff-431c-9b9a-8e32aad01ad1 req-88e9f8bf-4268-4f0e-bce4-dfa5e84791a6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:17.581161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5e948bfb-aeff-431c-9b9a-8e32aad01ad1 req-88e9f8bf-4268-4f0e-bce4-dfa5e84791a6 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:17.598310 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5e948bfb-aeff-431c-9b9a-8e32aad01ad1 req-88e9f8bf-4268-4f0e-bce4-dfa5e84791a6 service nova] Creating event network-changed:e7fc9fe9-330b-4752-8aba-1dad1c96921e for instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 on n-h2-854441-12 Oct 17 16:35:17.605086 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5e948bfb-aeff-431c-9b9a-8e32aad01ad1 req-88e9f8bf-4268-4f0e-bce4-dfa5e84791a6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042374 Oct 17 16:35:17.606186 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3863/7452] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:18.399864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:18.400440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:18.407822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:18.408323 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:18.408779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:18.409499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:18.409961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:18.410407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:18.551121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:18.559801 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f2b59d4-66e9-4523-94a3-42bfb91cc25b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1362 microversion: 2.1 time: 0.164166 Oct 17 16:35:18.560385 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3590/7453] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:18 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:19.584494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:19.585170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:19.596738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:19.597474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:19.598052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:19.599334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:19.599790 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:19.600211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:19.750243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:19.762904 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e97c5c3e-22d0-44ec-bb08-7bf6696214e6 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1362 microversion: 2.1 time: 0.182289 Oct 17 16:35:19.763664 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3864/7454] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:19 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:20.785692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:20.786298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:20.793997 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:20.794523 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:20.794974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:20.795693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:20.796167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:20.796608 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:20.941388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:20.950141 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ea670ac2-9c32-4e20-91b8-9bd526a86bff tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1362 microversion: 2.1 time: 0.168270 Oct 17 16:35:20.950801 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3591/7455] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:20 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:21.973288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:21.973924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:21.981539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:21.982061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:21.982464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:21.983197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:21.983651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:21.985070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:22.129627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:22.138484 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-bb42744f-aa8f-4193-8191-399c0fcdeaf9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1362 microversion: 2.1 time: 0.169110 Oct 17 16:35:22.139112 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3865/7456] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:21 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:22.790363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2555f6c7-cf2e-4aad-83f4-ddfcac9a0648 req-b0d7b784-1c4b-44c0-a032-b165f6fe582c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d49f80-a2f0-41ff-9376-ee3f45372f28", "name": "network-vif-plugged", "status": "completed", "tag": "e7fc9fe9-330b-4752-8aba-1dad1c96921e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:22.801827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2555f6c7-cf2e-4aad-83f4-ddfcac9a0648 req-b0d7b784-1c4b-44c0-a032-b165f6fe582c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:22.802338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2555f6c7-cf2e-4aad-83f4-ddfcac9a0648 req-b0d7b784-1c4b-44c0-a032-b165f6fe582c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:22.802826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2555f6c7-cf2e-4aad-83f4-ddfcac9a0648 req-b0d7b784-1c4b-44c0-a032-b165f6fe582c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:22.814431 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2555f6c7-cf2e-4aad-83f4-ddfcac9a0648 req-b0d7b784-1c4b-44c0-a032-b165f6fe582c service nova] Creating event network-vif-plugged:e7fc9fe9-330b-4752-8aba-1dad1c96921e for instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 on n-h2-854441-12 Oct 17 16:35:22.819887 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2555f6c7-cf2e-4aad-83f4-ddfcac9a0648 req-b0d7b784-1c4b-44c0-a032-b165f6fe582c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033389 Oct 17 16:35:22.820513 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3592/7457] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:23.164559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:23.165164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:23.172390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:23.172875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:23.173315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:23.173995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:23.174441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:23.174901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:23.311372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:23.319980 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2da59fd2-1779-42ba-9069-d325253ed011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1362 microversion: 2.1 time: 0.160583 Oct 17 16:35:23.320558 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3866/7458] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:23 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:24.342913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:24.343652 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:24.351228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:24.351749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:24.352271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:24.352922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:24.353396 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:24.353846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:24.485214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:24.497324 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4f4866db-aaff-4e87-84d2-74034347a76b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1552 microversion: 2.1 time: 0.158785 Oct 17 16:35:24.499075 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3593/7459] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:24 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:24.521779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:24.522465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:24.530065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:24.530595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:24.531039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:24.531739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:24.532194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:24.532621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:24.675502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:24.685868 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd1d6591-c5eb-4b9a-95fd-801f9a51707e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1552 microversion: 2.1 time: 0.167298 Oct 17 16:35:24.686486 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3867/7460] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:24 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:26.235565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97010d06-c8b0-4e36-9c6f-4e38d37a747d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0580ae6d-a580-4bfa-8e60-3fa93832d29f"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:26.237923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97010d06-c8b0-4e36-9c6f-4e38d37a747d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:26.240078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:26.248996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97010d06-c8b0-4e36-9c6f-4e38d37a747d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:26.249783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97010d06-c8b0-4e36-9c6f-4e38d37a747d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:26.250474 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97010d06-c8b0-4e36-9c6f-4e38d37a747d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:26.251609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97010d06-c8b0-4e36-9c6f-4e38d37a747d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:26.252670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97010d06-c8b0-4e36-9c6f-4e38d37a747d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:26.253337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97010d06-c8b0-4e36-9c6f-4e38d37a747d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:26.519987 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97010d06-c8b0-4e36-9c6f-4e38d37a747d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "POST /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288617 Oct 17 16:35:26.520972 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3594/7461] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 16:35:26 2022] POST /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:37.286153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:37.286833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:37.289135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:37.289799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:37.290740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:37.291478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:37.299078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:37.299561 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:37.299989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:37.300678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:37.301127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:37.301545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:37.393789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lazy-loading 'services' on Instance uuid 65d49f80-a2f0-41ff-9376-ee3f45372f28 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:35:37.467364 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c0e5df7-6149-407e-96b8-1a8ccc93d735 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments/0580ae6d-a580-4bfa-8e60-3fa93832d29f" status: 202 len: 0 microversion: 2.1 time: 0.185151 Oct 17 16:35:37.468145 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3868/7462] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:35:37 2022] DELETE /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments/0580ae6d-a580-4bfa-8e60-3fa93832d29f => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:35:37.478639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fcdeabf3-ea0e-4fa1-b271-282132d6b651 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:37.481065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fcdeabf3-ea0e-4fa1-b271-282132d6b651 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:37.484874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:37.485708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:35:37.491729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcdeabf3-ea0e-4fa1-b271-282132d6b651 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:37.492316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcdeabf3-ea0e-4fa1-b271-282132d6b651 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:37.492943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcdeabf3-ea0e-4fa1-b271-282132d6b651 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:37.493983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcdeabf3-ea0e-4fa1-b271-282132d6b651 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:37.494466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcdeabf3-ea0e-4fa1-b271-282132d6b651 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:37.494939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fcdeabf3-ea0e-4fa1-b271-282132d6b651 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:37.528546 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fcdeabf3-ea0e-4fa1-b271-282132d6b651 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054332 Oct 17 16:35:37.529121 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3595/7463] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:37 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:38.543515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-50137b60-2924-4077-9ddd-47a1dd955cb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:38.545894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-50137b60-2924-4077-9ddd-47a1dd955cb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:38.552838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50137b60-2924-4077-9ddd-47a1dd955cb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:38.553331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50137b60-2924-4077-9ddd-47a1dd955cb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:38.553772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50137b60-2924-4077-9ddd-47a1dd955cb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:38.554483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50137b60-2924-4077-9ddd-47a1dd955cb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:38.554973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50137b60-2924-4077-9ddd-47a1dd955cb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:38.555399 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-50137b60-2924-4077-9ddd-47a1dd955cb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:38.591689 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-50137b60-2924-4077-9ddd-47a1dd955cb8 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053608 Oct 17 16:35:38.592283 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3869/7464] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:38 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:39.605002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-151920fe-2d43-4eb5-ad2e-172994182398 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:39.607460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-151920fe-2d43-4eb5-ad2e-172994182398 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:39.614901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151920fe-2d43-4eb5-ad2e-172994182398 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:39.615419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151920fe-2d43-4eb5-ad2e-172994182398 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:39.615878 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151920fe-2d43-4eb5-ad2e-172994182398 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:39.616603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151920fe-2d43-4eb5-ad2e-172994182398 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:39.617066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151920fe-2d43-4eb5-ad2e-172994182398 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:39.617516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-151920fe-2d43-4eb5-ad2e-172994182398 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:39.653183 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-151920fe-2d43-4eb5-ad2e-172994182398 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052425 Oct 17 16:35:39.653789 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3596/7465] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:39 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:40.666282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cbc711fa-257c-45e5-8f53-40be9b73e8ea tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:40.668917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cbc711fa-257c-45e5-8f53-40be9b73e8ea tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:40.676357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc711fa-257c-45e5-8f53-40be9b73e8ea tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:40.676847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc711fa-257c-45e5-8f53-40be9b73e8ea tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:40.677388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc711fa-257c-45e5-8f53-40be9b73e8ea tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:40.678088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc711fa-257c-45e5-8f53-40be9b73e8ea tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:40.678556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc711fa-257c-45e5-8f53-40be9b73e8ea tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:40.679000 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cbc711fa-257c-45e5-8f53-40be9b73e8ea tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:40.711652 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cbc711fa-257c-45e5-8f53-40be9b73e8ea tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049380 Oct 17 16:35:40.712254 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3870/7466] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:40 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:41.724774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-770fe7c0-7e8e-455a-b9a1-1043abaf1f6d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:41.727262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-770fe7c0-7e8e-455a-b9a1-1043abaf1f6d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:41.734995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-770fe7c0-7e8e-455a-b9a1-1043abaf1f6d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:41.735500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-770fe7c0-7e8e-455a-b9a1-1043abaf1f6d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:41.736095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-770fe7c0-7e8e-455a-b9a1-1043abaf1f6d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:41.736813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-770fe7c0-7e8e-455a-b9a1-1043abaf1f6d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:41.737279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-770fe7c0-7e8e-455a-b9a1-1043abaf1f6d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:41.737716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-770fe7c0-7e8e-455a-b9a1-1043abaf1f6d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:41.774237 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-770fe7c0-7e8e-455a-b9a1-1043abaf1f6d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053529 Oct 17 16:35:41.775116 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3597/7467] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:41 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:42.787575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1445c607-795b-4b0c-9a3c-61df0ae9f6cc tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:42.789885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1445c607-795b-4b0c-9a3c-61df0ae9f6cc tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:42.797570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1445c607-795b-4b0c-9a3c-61df0ae9f6cc tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:42.798052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1445c607-795b-4b0c-9a3c-61df0ae9f6cc tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:42.798530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1445c607-795b-4b0c-9a3c-61df0ae9f6cc tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:42.799239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1445c607-795b-4b0c-9a3c-61df0ae9f6cc tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:42.799688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1445c607-795b-4b0c-9a3c-61df0ae9f6cc tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:42.800122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1445c607-795b-4b0c-9a3c-61df0ae9f6cc tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:42.832889 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1445c607-795b-4b0c-9a3c-61df0ae9f6cc tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049351 Oct 17 16:35:42.833450 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3871/7468] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:35:42 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 16:35:42.844864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:42.845424 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:42.852724 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:42.853220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:42.853664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:42.854325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:42.854818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:42.855253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:42.937378 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] HTTP exception thrown: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 is not attached to volume 0580ae6d-a580-4bfa-8e60-3fa93832d29f Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Request method failure captured: Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments/0580ae6d-a580-4bfa-8e60-3fa93832d29f HTTP/1.1 Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYQYZUxWc-c2oi-rKbq3ZibZpg5x24hcm7UgTnaPER5oPvdA1ywNvyBpy0VCDvFFf_YM4LJqoXEXscjusvcEsEom9W52tMWchMLtkb7vx-ZzR3c2RxPAfBOAWuED81NWfKbz1iVRMuf81TlT8dlIh8noEGxuowJycxrUIxPch-y90pw Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_177e29e2fed7491f93ec3fef02213252"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 1af5b015bc914ee09380638a20c4f66e Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 is not attached to volume 0580ae6d-a580-4bfa-8e60-3fa93832d29f Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'server_id': '65d49f80-a2f0-41ff-9376-ee3f45372f28', 'id': '0580ae6d-a580-4bfa-8e60-3fa93832d29f'} Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0580ae6d-a580-4bfa-8e60-3fa93832d29f. Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 is not attached to volume 0580ae6d-a580-4bfa-8e60-3fa93832d29f Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:35:42.939160 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:35:42.944082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:35:42.944082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:35:42.944082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 is not attached to volume 0580ae6d-a580-4bfa-8e60-3fa93832d29f Oct 17 16:35:42.944082 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:35:42.944082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Returning 404 to user: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 is not attached to volume 0580ae6d-a580-4bfa-8e60-3fa93832d29f {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:35:42.944082 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-81881fe4-f379-4c53-bc9c-fbd55dcc2ae5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments/0580ae6d-a580-4bfa-8e60-3fa93832d29f" status: 404 len: 154 microversion: 2.1 time: 0.100214 Oct 17 16:35:42.944082 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3598/7469] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:35:42 2022] DELETE /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28/os-volume_attachments/0580ae6d-a580-4bfa-8e60-3fa93832d29f => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:35:46.299159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:46.299737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:46.306661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:46.307147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:46.307583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:46.308272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:46.308716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:46.309140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:46.336311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:35:46.423230 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-29939c1c-024e-4157-b657-72d075189aa5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 204 len: 0 microversion: 2.1 time: 0.127799 Oct 17 16:35:46.424266 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3872/7470] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:35:46 2022] DELETE /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:35:46.432620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:46.433270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:46.440644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:46.441150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:46.441601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:46.442313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:46.442813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:46.443252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:46.946619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:46.959903 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cd771a77-3f99-4775-a4ba-28ddfead12e2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1558 microversion: 2.1 time: 0.530897 Oct 17 16:35:46.960844 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3599/7471] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:46 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1558 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:35:47.997156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:47.997855 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:48.006457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:48.006985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:48.007427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:48.008141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:48.008590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:48.009018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:48.145408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:48.153571 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1eef880e-74ad-4964-aa01-8565a3230954 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 200 len: 1558 microversion: 2.1 time: 0.160878 Oct 17 16:35:48.154207 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3873/7472] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:47 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:48.531925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-975e118a-c8eb-42a9-b84d-deabbebadf04 req-cc095ffd-7be8-4a2e-b030-6eafc6c2904c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d49f80-a2f0-41ff-9376-ee3f45372f28", "name": "network-vif-deleted", "tag": "e7fc9fe9-330b-4752-8aba-1dad1c96921e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:48.546988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-975e118a-c8eb-42a9-b84d-deabbebadf04 req-cc095ffd-7be8-4a2e-b030-6eafc6c2904c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:48.549112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-975e118a-c8eb-42a9-b84d-deabbebadf04 req-cc095ffd-7be8-4a2e-b030-6eafc6c2904c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:48.549588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-975e118a-c8eb-42a9-b84d-deabbebadf04 req-cc095ffd-7be8-4a2e-b030-6eafc6c2904c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:48.577066 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-975e118a-c8eb-42a9-b84d-deabbebadf04 req-cc095ffd-7be8-4a2e-b030-6eafc6c2904c service nova] Creating event network-vif-deleted:e7fc9fe9-330b-4752-8aba-1dad1c96921e for instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 on n-h2-854441-12 Oct 17 16:35:48.583455 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-975e118a-c8eb-42a9-b84d-deabbebadf04 req-cc095ffd-7be8-4a2e-b030-6eafc6c2904c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055221 Oct 17 16:35:48.584063 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3600/7473] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:49.178200 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:49.178860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: 65d49f80-a2f0-41ff-9376-ee3f45372f28] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:49.186166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:49.186607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:49.187040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:49.187729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:49.188174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:49.188595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:49.204040 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] HTTP exception thrown: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 could not be found. Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Request method failure captured: Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 HTTP/1.1 Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYQYZUxWc-c2oi-rKbq3ZibZpg5x24hcm7UgTnaPER5oPvdA1ywNvyBpy0VCDvFFf_YM4LJqoXEXscjusvcEsEom9W52tMWchMLtkb7vx-ZzR3c2RxPAfBOAWuED81NWfKbz1iVRMuf81TlT8dlIh8noEGxuowJycxrUIxPch-y90pw Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_177e29e2fed7491f93ec3fef02213252"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 1af5b015bc914ee09380638a20c4f66e Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 could not be found. Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': '65d49f80-a2f0-41ff-9376-ee3f45372f28'} Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 could not be found. Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 could not be found. Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:35:49.205864 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 could not be found. Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Returning 404 to user: Instance 65d49f80-a2f0-41ff-9376-ee3f45372f28 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:35:49.210817 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ebb335de-fe25-4338-9848-41df0698659d tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28" status: 404 len: 111 microversion: 2.1 time: 0.033162 Oct 17 16:35:49.211714 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3874/7474] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:49 2022] GET /compute/v2.1/servers/65d49f80-a2f0-41ff-9376-ee3f45372f28 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:35:49.218922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80038ed3-7ed0-475e-bfb3-0625eee04e42 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '.version_select at 0x7f28c2e5caf0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:49.246316 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80038ed3-7ed0-475e-bfb3-0625eee04e42 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-895176751" status: 202 len: 0 microversion: 2.1 time: 0.032955 Oct 17 16:35:49.247028 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3601/7475] 10.222.0.87 () {58 vars in 1275 bytes} [Mon Oct 17 16:35:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-895176751 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:35:49.265406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-de364b65-c3a5-4817-946f-eeb96b983ed5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Action: 'create', calling method: .version_select at 0x7f28bd519d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1758637713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZm9g3853iNaTnUrNg01/d7bTw/WPlyyWOzBIkCCRQawU2hNE8awsC6cbXpqAt9G60pgA4wbJSoMXt663WSqr4PTTbJnKXO74NZ4bOxFkFR+5XPcG2a/31obZUE68kFUQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:49.282299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-de364b65-c3a5-4817-946f-eeb96b983ed5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for project 177e29e2fed7491f93ec3fef02213252. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:35:49.288404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-de364b65-c3a5-4817-946f-eeb96b983ed5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for user 1af5b015bc914ee09380638a20c4f66e and project 177e29e2fed7491f93ec3fef02213252. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:35:49.316854 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-de364b65-c3a5-4817-946f-eeb96b983ed5 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055530 Oct 17 16:35:49.317661 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3875/7476] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:35:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:49.375637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1749147184", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1758637713", "networks": [{"uuid": "2ecf7c75-2391-4862-be61-ecef66e3fd6d"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:49.431774 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] validate_networks() for [('2ecf7c75-2391-4862-be61-ecef66e3fd6d', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:35:49.837686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:35:49.838260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:35:49.838632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:35:49.839086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:35:49.839503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:35:49.849000 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:49.849493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:49.849933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:49.850685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:49.851149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:49.851711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:49.870392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for project 177e29e2fed7491f93ec3fef02213252. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:35:49.875859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Getting quotas for user 1af5b015bc914ee09380638a20c4f66e and project 177e29e2fed7491f93ec3fef02213252. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:35:49.888507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:35:49.891062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:35:49.940166 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-453a6ea0-e0b6-489d-b750-07a3f3ae7b6b tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568747 Oct 17 16:35:49.940821 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3602/7477] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:35:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 16:35:49.952594 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-512ad71f-0f8b-4b3a-88af-591172ce476e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:49.953812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-512ad71f-0f8b-4b3a-88af-591172ce476e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:50.011890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-512ad71f-0f8b-4b3a-88af-591172ce476e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:50.019892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-512ad71f-0f8b-4b3a-88af-591172ce476e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1263 microversion: 2.1 time: 0.071788 Oct 17 16:35:50.020467 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3876/7478] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:49 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:51.043563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:51.044153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:51.052831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:51.053350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:51.053836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:51.054737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:51.055171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:51.055662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:51.161860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:51.170013 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c5a005f3-4aad-44d4-8620-637d12299288 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1323 microversion: 2.1 time: 0.131334 Oct 17 16:35:51.170650 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3603/7479] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:51 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1323 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:52.195018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:52.195637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:52.203406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:52.203927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:52.204688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:52.205062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:52.205515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:52.205945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:52.343975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:52.352174 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8caaff4d-ec70-4de4-9d14-4c7b828ff656 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1363 microversion: 2.1 time: 0.161454 Oct 17 16:35:52.352786 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3877/7480] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:52 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:52.534612 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b03fa0c8-a8c5-4ce1-a8f7-aeea063f5f45 req-253294c5-455e-4fb6-83b9-7fad1fe396d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "addfe4b3-405b-47de-b8bd-205587b5884c", "tag": "1d270e22-1b26-45df-aaf9-209c0ab59a8e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:52.549413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b03fa0c8-a8c5-4ce1-a8f7-aeea063f5f45 req-253294c5-455e-4fb6-83b9-7fad1fe396d5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:52.549836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b03fa0c8-a8c5-4ce1-a8f7-aeea063f5f45 req-253294c5-455e-4fb6-83b9-7fad1fe396d5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:52.550521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b03fa0c8-a8c5-4ce1-a8f7-aeea063f5f45 req-253294c5-455e-4fb6-83b9-7fad1fe396d5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:52.562764 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b03fa0c8-a8c5-4ce1-a8f7-aeea063f5f45 req-253294c5-455e-4fb6-83b9-7fad1fe396d5 service nova] Creating event network-changed:1d270e22-1b26-45df-aaf9-209c0ab59a8e for instance addfe4b3-405b-47de-b8bd-205587b5884c on n-h1-854441-12 Oct 17 16:35:52.568930 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b03fa0c8-a8c5-4ce1-a8f7-aeea063f5f45 req-253294c5-455e-4fb6-83b9-7fad1fe396d5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039827 Oct 17 16:35:52.569624 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3604/7481] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:53.375459 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:53.376052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:53.383961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:53.384441 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:53.384871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:53.385584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:53.386030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:53.386444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:53.526206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:53.534614 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-076b9ac7-a090-44d1-966e-91dc7a49a610 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1363 microversion: 2.1 time: 0.163094 Oct 17 16:35:53.535195 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3878/7482] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:53 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:54.560456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:54.561153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:54.568164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:54.568662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:54.569120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:54.569841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:54.570315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:54.570788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:54.710638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:54.718766 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-60efa19d-a181-4c3e-9774-4bdb4891acdd tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1363 microversion: 2.1 time: 0.163534 Oct 17 16:35:54.719358 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3605/7483] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:54 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:55.741902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:55.742492 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:55.749928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:55.750411 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:55.750885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:55.751592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:55.752405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:55.752829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:55.900385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:55.908273 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-11214044-350c-4e7f-9549-914d925c738c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1363 microversion: 2.1 time: 0.170564 Oct 17 16:35:55.908829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3879/7484] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:55 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:56.931812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:56.932445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:56.939466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:56.940004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:56.940465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:56.941208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:56.941686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:56.942117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:57.078270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:57.086435 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4eccb210-dea6-45ac-bf00-5eb85f550c83 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1363 microversion: 2.1 time: 0.158834 Oct 17 16:35:57.087078 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3606/7485] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:56 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:58.110302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:58.110926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:58.118166 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:58.118834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:58.119512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:58.120507 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:58.120957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:58.121376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:58.261559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:58.269512 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-349fdecc-a7c3-40e6-81b1-0757e1e6090a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1363 microversion: 2.1 time: 0.163146 Oct 17 16:35:58.270097 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3880/7486] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:58 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:35:59.145107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b168d3cb-7ac3-44ae-a605-04d46feb002e req-83bfad4c-871e-48a5-a44c-346d8db480d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "addfe4b3-405b-47de-b8bd-205587b5884c", "name": "network-vif-plugged", "status": "completed", "tag": "1d270e22-1b26-45df-aaf9-209c0ab59a8e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:35:59.157583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b168d3cb-7ac3-44ae-a605-04d46feb002e req-83bfad4c-871e-48a5-a44c-346d8db480d3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:59.158113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b168d3cb-7ac3-44ae-a605-04d46feb002e req-83bfad4c-871e-48a5-a44c-346d8db480d3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:59.158584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b168d3cb-7ac3-44ae-a605-04d46feb002e req-83bfad4c-871e-48a5-a44c-346d8db480d3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:59.171718 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b168d3cb-7ac3-44ae-a605-04d46feb002e req-83bfad4c-871e-48a5-a44c-346d8db480d3 service nova] Creating event network-vif-plugged:1d270e22-1b26-45df-aaf9-209c0ab59a8e for instance addfe4b3-405b-47de-b8bd-205587b5884c on n-h1-854441-12 Oct 17 16:35:59.179859 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b168d3cb-7ac3-44ae-a605-04d46feb002e req-83bfad4c-871e-48a5-a44c-346d8db480d3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040373 Oct 17 16:35:59.181936 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3607/7487] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:35:59.295436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:35:59.296076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:35:59.307623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:59.308124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:59.308560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:59.309270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:35:59.309722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:35:59.310153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:35:59.470544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:35:59.479261 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9b043618-5d79-4f64-9e8a-60afa746e174 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1363 microversion: 2.1 time: 0.187730 Oct 17 16:35:59.479742 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3881/7488] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:35:59 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:36:00.500366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:00.501431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:00.508100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:00.508904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:00.516833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:00.517365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:00.517825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:00.518557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:00.519036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:00.519480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:00.664366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:00.673075 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-97b7420e-1905-4fc4-9c51-32c0aa8e98fb tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1553 microversion: 2.1 time: 0.173848 Oct 17 16:36:00.673684 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3608/7489] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:00 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:36:00.696050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:00.696829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:00.699062 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:00.706614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:00.707281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:00.707736 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:00.708472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:00.708964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:00.709469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:00.854966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:00.863237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b53064ab-849d-4e17-b026-8ecd83c80825 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1553 microversion: 2.1 time: 0.171354 Oct 17 16:36:00.863853 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3882/7490] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:00 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:36:02.415549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a4e018e-2a07-40fa-9c7c-3b669f6748e9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e54b9fc1-4229-4de3-a49f-d5db01f7da16"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:36:02.417937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a4e018e-2a07-40fa-9c7c-3b669f6748e9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:02.425262 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e018e-2a07-40fa-9c7c-3b669f6748e9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:02.425695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e018e-2a07-40fa-9c7c-3b669f6748e9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:02.426142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e018e-2a07-40fa-9c7c-3b669f6748e9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:02.426867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e018e-2a07-40fa-9c7c-3b669f6748e9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:02.427329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e018e-2a07-40fa-9c7c-3b669f6748e9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:02.427874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a4e018e-2a07-40fa-9c7c-3b669f6748e9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:02.694778 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a4e018e-2a07-40fa-9c7c-3b669f6748e9 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "POST /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282833 Oct 17 16:36:02.695432 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3609/7491] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 16:36:02 2022] POST /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:36:13.465674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:13.466360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:13.469231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:13.470151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:13.476711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:13.477182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:13.477619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:13.478326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:13.478813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:13.479236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:13.577255 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lazy-loading 'services' on Instance uuid addfe4b3-405b-47de-b8bd-205587b5884c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:36:13.668640 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-60554451-3c50-46e3-bc05-557e2c3ada11 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments/e54b9fc1-4229-4de3-a49f-d5db01f7da16" status: 202 len: 0 microversion: 2.1 time: 0.206819 Oct 17 16:36:13.669260 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3883/7492] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:36:13 2022] DELETE /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments/e54b9fc1-4229-4de3-a49f-d5db01f7da16 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:36:13.682768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5d67ea80-3322-4a8c-a34a-b9f4b0cee89a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:13.687051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5d67ea80-3322-4a8c-a34a-b9f4b0cee89a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:13.692252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:13.693545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:13.704483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d67ea80-3322-4a8c-a34a-b9f4b0cee89a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:13.705238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d67ea80-3322-4a8c-a34a-b9f4b0cee89a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:13.705832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d67ea80-3322-4a8c-a34a-b9f4b0cee89a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:13.706800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d67ea80-3322-4a8c-a34a-b9f4b0cee89a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:13.707375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d67ea80-3322-4a8c-a34a-b9f4b0cee89a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:13.707910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5d67ea80-3322-4a8c-a34a-b9f4b0cee89a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:13.744828 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5d67ea80-3322-4a8c-a34a-b9f4b0cee89a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070330 Oct 17 16:36:13.745445 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3610/7493] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:36:13 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:36:14.759728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6dd46d32-6bbf-49a6-bc8b-6e812347d7e3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:14.762190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6dd46d32-6bbf-49a6-bc8b-6e812347d7e3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:14.769491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd46d32-6bbf-49a6-bc8b-6e812347d7e3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:14.769980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd46d32-6bbf-49a6-bc8b-6e812347d7e3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:14.770418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd46d32-6bbf-49a6-bc8b-6e812347d7e3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:14.771159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd46d32-6bbf-49a6-bc8b-6e812347d7e3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:14.771615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd46d32-6bbf-49a6-bc8b-6e812347d7e3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:14.772046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6dd46d32-6bbf-49a6-bc8b-6e812347d7e3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:14.808276 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6dd46d32-6bbf-49a6-bc8b-6e812347d7e3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054121 Oct 17 16:36:14.808881 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3884/7494] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:36:14 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:36:15.821220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c004626-dc5a-4dec-8bbe-8340d29ced8c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:15.823482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0c004626-dc5a-4dec-8bbe-8340d29ced8c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:15.830843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c004626-dc5a-4dec-8bbe-8340d29ced8c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:15.831353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c004626-dc5a-4dec-8bbe-8340d29ced8c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:15.831800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c004626-dc5a-4dec-8bbe-8340d29ced8c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:15.832506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c004626-dc5a-4dec-8bbe-8340d29ced8c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:15.832964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c004626-dc5a-4dec-8bbe-8340d29ced8c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:15.833405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c004626-dc5a-4dec-8bbe-8340d29ced8c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:15.867517 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0c004626-dc5a-4dec-8bbe-8340d29ced8c tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050268 Oct 17 16:36:15.868022 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3611/7495] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:36:15 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:36:16.881643 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed9c4be6-4a24-4af4-bef8-dfd8a48469ce tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:16.884115 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed9c4be6-4a24-4af4-bef8-dfd8a48469ce tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:16.891373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c4be6-4a24-4af4-bef8-dfd8a48469ce tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:16.891877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c4be6-4a24-4af4-bef8-dfd8a48469ce tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:16.892377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c4be6-4a24-4af4-bef8-dfd8a48469ce tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:16.893104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c4be6-4a24-4af4-bef8-dfd8a48469ce tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:16.893558 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c4be6-4a24-4af4-bef8-dfd8a48469ce tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:16.893985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9c4be6-4a24-4af4-bef8-dfd8a48469ce tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:16.928633 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed9c4be6-4a24-4af4-bef8-dfd8a48469ce tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052164 Oct 17 16:36:16.929269 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3885/7496] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:36:16 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:36:17.945841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc3d0536-a84a-41d3-afe3-9a012e4b9180 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:17.948217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cc3d0536-a84a-41d3-afe3-9a012e4b9180 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:17.955637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc3d0536-a84a-41d3-afe3-9a012e4b9180 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:17.956225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc3d0536-a84a-41d3-afe3-9a012e4b9180 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:17.956687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc3d0536-a84a-41d3-afe3-9a012e4b9180 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:17.957379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc3d0536-a84a-41d3-afe3-9a012e4b9180 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:17.957834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc3d0536-a84a-41d3-afe3-9a012e4b9180 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:17.958264 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cc3d0536-a84a-41d3-afe3-9a012e4b9180 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:17.992690 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc3d0536-a84a-41d3-afe3-9a012e4b9180 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051185 Oct 17 16:36:17.993310 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3612/7497] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:36:17 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:36:19.008014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-231ec3c6-e7b8-4355-a58c-d29f5ed688d2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:19.010276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-231ec3c6-e7b8-4355-a58c-d29f5ed688d2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:19.018928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-231ec3c6-e7b8-4355-a58c-d29f5ed688d2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:19.019634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-231ec3c6-e7b8-4355-a58c-d29f5ed688d2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:19.020224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-231ec3c6-e7b8-4355-a58c-d29f5ed688d2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:19.020997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-231ec3c6-e7b8-4355-a58c-d29f5ed688d2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:19.021517 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-231ec3c6-e7b8-4355-a58c-d29f5ed688d2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:19.022079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-231ec3c6-e7b8-4355-a58c-d29f5ed688d2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:19.053549 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-231ec3c6-e7b8-4355-a58c-d29f5ed688d2 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050645 Oct 17 16:36:19.054157 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3886/7498] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:36:19 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 16:36:19.070954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:19.071800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:19.082786 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:19.083563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:19.084283 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:19.085489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:19.086161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:19.086644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:19.231315 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] HTTP exception thrown: Instance addfe4b3-405b-47de-b8bd-205587b5884c is not attached to volume e54b9fc1-4229-4de3-a49f-d5db01f7da16 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Request method failure captured: Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: request: DELETE /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments/e54b9fc1-4229-4de3-a49f-d5db01f7da16 HTTP/1.1 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYQYZUxWc-c2oi-rKbq3ZibZpg5x24hcm7UgTnaPER5oPvdA1ywNvyBpy0VCDvFFf_YM4LJqoXEXscjusvcEsEom9W52tMWchMLtkb7vx-ZzR3c2RxPAfBOAWuED81NWfKbz1iVRMuf81TlT8dlIh8noEGxuowJycxrUIxPch-y90pw Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_177e29e2fed7491f93ec3fef02213252"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 1af5b015bc914ee09380638a20c4f66e Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance addfe4b3-405b-47de-b8bd-205587b5884c is not attached to volume e54b9fc1-4229-4de3-a49f-d5db01f7da16 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'server_id': 'addfe4b3-405b-47de-b8bd-205587b5884c', 'id': 'e54b9fc1-4229-4de3-a49f-d5db01f7da16'} Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e54b9fc1-4229-4de3-a49f-d5db01f7da16. Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance addfe4b3-405b-47de-b8bd-205587b5884c is not attached to volume e54b9fc1-4229-4de3-a49f-d5db01f7da16 Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:36:19.233001 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:36:19.237518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:36:19.237518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:36:19.237518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance addfe4b3-405b-47de-b8bd-205587b5884c is not attached to volume e54b9fc1-4229-4de3-a49f-d5db01f7da16 Oct 17 16:36:19.237518 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:19.237518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Returning 404 to user: Instance addfe4b3-405b-47de-b8bd-205587b5884c is not attached to volume e54b9fc1-4229-4de3-a49f-d5db01f7da16 {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:36:19.237518 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6dc1e5fc-3661-4195-a8a7-b5c4bf7d89c3 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments/e54b9fc1-4229-4de3-a49f-d5db01f7da16" status: 404 len: 154 microversion: 2.1 time: 0.169822 Oct 17 16:36:19.237518 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3613/7499] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:36:19 2022] DELETE /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c/os-volume_attachments/e54b9fc1-4229-4de3-a49f-d5db01f7da16 => generated 154 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:36:22.604913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:22.605448 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:22.612663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:22.613150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:22.613579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:22.614278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:22.614756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:22.615176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:22.644436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:36:22.735444 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ca2e515-a74a-4e9d-aea8-db5a4b8cd011 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 204 len: 0 microversion: 2.1 time: 0.134026 Oct 17 16:36:22.736239 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3887/7500] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:36:22 2022] DELETE /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:36:22.746367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:22.747326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:22.756066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:22.756560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:22.757004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:22.757738 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:22.758201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:22.758720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:22.895227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:22.903955 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0fcc96f2-c7a6-4f98-8bc1-9270aa9fb9af tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1559 microversion: 2.1 time: 0.163344 Oct 17 16:36:22.904619 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3614/7501] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:22 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:36:23.928227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:23.928814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:23.936258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:23.936745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:23.937175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:23.937872 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:23.938318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:23.938770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:24.178438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:24.186851 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d0b31558-769c-4987-a113-3ebfbf89c49a tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1559 microversion: 2.1 time: 0.262939 Oct 17 16:36:24.187456 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3888/7502] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:23 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1559 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:36:24.817442 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d93fc228-490d-4f81-ae62-81c3508b4c43 req-a3b977fc-efcb-4ac5-aaf3-03261bd256c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "addfe4b3-405b-47de-b8bd-205587b5884c", "name": "network-vif-deleted", "tag": "1d270e22-1b26-45df-aaf9-209c0ab59a8e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:36:24.829206 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d93fc228-490d-4f81-ae62-81c3508b4c43 req-a3b977fc-efcb-4ac5-aaf3-03261bd256c1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:24.830026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d93fc228-490d-4f81-ae62-81c3508b4c43 req-a3b977fc-efcb-4ac5-aaf3-03261bd256c1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:24.830565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d93fc228-490d-4f81-ae62-81c3508b4c43 req-a3b977fc-efcb-4ac5-aaf3-03261bd256c1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:24.843108 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d93fc228-490d-4f81-ae62-81c3508b4c43 req-a3b977fc-efcb-4ac5-aaf3-03261bd256c1 service nova] Creating event network-vif-deleted:1d270e22-1b26-45df-aaf9-209c0ab59a8e for instance addfe4b3-405b-47de-b8bd-205587b5884c on n-h1-854441-12 Oct 17 16:36:24.848566 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d93fc228-490d-4f81-ae62-81c3508b4c43 req-a3b977fc-efcb-4ac5-aaf3-03261bd256c1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034745 Oct 17 16:36:24.850704 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3615/7503] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:36:25.210758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:25.211382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:25.218902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:25.219326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:25.219773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:25.220462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:25.220913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:25.221340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:25.254791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:25.255287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:25.255723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:25.256165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lazy-loading 'fault' on Instance uuid addfe4b3-405b-47de-b8bd-205587b5884c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:36:25.311762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af5b015bc914ee09380638a20c4f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177e29e2fed7491f93ec3fef02213252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:25.319818 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-51896742-7bff-4fc4-848e-56af3d40522e tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 200 len: 1353 microversion: 2.1 time: 0.113164 Oct 17 16:36:25.320415 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3889/7504] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:25 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 1353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:36:26.345688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:26.346390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] [instance: addfe4b3-405b-47de-b8bd-205587b5884c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:26.355183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:26.355686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:26.356145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:26.356845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:26.357305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:26.357733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:26.372864 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] HTTP exception thrown: Instance addfe4b3-405b-47de-b8bd-205587b5884c could not be found. Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Request method failure captured: Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c HTTP/1.1 Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYQYZUxWc-c2oi-rKbq3ZibZpg5x24hcm7UgTnaPER5oPvdA1ywNvyBpy0VCDvFFf_YM4LJqoXEXscjusvcEsEom9W52tMWchMLtkb7vx-ZzR3c2RxPAfBOAWuED81NWfKbz1iVRMuf81TlT8dlIh8noEGxuowJycxrUIxPch-y90pw Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_177e29e2fed7491f93ec3fef02213252"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/177e29e2fed7491f93ec3fef02213252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 177e29e2fed7491f93ec3fef02213252 Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095780854 Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 1af5b015bc914ee09380638a20c4f66e Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095780854-project Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance addfe4b3-405b-47de-b8bd-205587b5884c could not be found. Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'addfe4b3-405b-47de-b8bd-205587b5884c'} Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance addfe4b3-405b-47de-b8bd-205587b5884c could not be found. Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance addfe4b3-405b-47de-b8bd-205587b5884c could not be found. Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:26.374602 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance addfe4b3-405b-47de-b8bd-205587b5884c could not be found. Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Returning 404 to user: Instance addfe4b3-405b-47de-b8bd-205587b5884c could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f6f120c5-09b8-4393-b478-77a71fbd62d4 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c" status: 404 len: 111 microversion: 2.1 time: 0.036211 Oct 17 16:36:26.380449 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3616/7505] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:26 2022] GET /compute/v2.1/servers/addfe4b3-405b-47de-b8bd-205587b5884c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:36:26.387691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d7290de-3415-4dd2-8fd9-7a091947e3c7 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] Calling method '.version_select at 0x7f28bd4edb80>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:26.410892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d7290de-3415-4dd2-8fd9-7a091947e3c7 tempest-TestEncryptedCinderVolumes-1095780854 tempest-TestEncryptedCinderVolumes-1095780854-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1758637713" status: 202 len: 0 microversion: 2.1 time: 0.027457 Oct 17 16:36:26.411489 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3890/7506] 10.222.0.87 () {58 vars in 1278 bytes} [Mon Oct 17 16:36:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1758637713 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:36:54.497284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cc3ba2fc-dd74-40df-8e82-03997077328c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'create', calling method: .version_select at 0x7f28bdf7d700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-900151876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbSLrSwZCe3ZPgiwOAtohJgnN+FYTCTS4jqAYuT4c1zEzc3UK/DCKo4pULWk5mkAfn3CfBiUN00iTc/8UO7qSXRD/d7Y4KCDKtiCs/IvS2uFwaX1216KRqDOJ9tpXRlnQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:36:54.504169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=14 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:54.504899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=34 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:54.517752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-cc3ba2fc-dd74-40df-8e82-03997077328c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Getting quotas for project e870c0e4a8454467a10712afd06d3557. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:36:54.524233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-cc3ba2fc-dd74-40df-8e82-03997077328c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Getting quotas for user c0d45985ec414548b3e4a8706789e472 and project e870c0e4a8454467a10712afd06d3557. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:36:54.552174 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cc3ba2fc-dd74-40df-8e82-03997077328c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059247 Oct 17 16:36:54.552775 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3617/7507] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:36:54 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:36:54.607656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:54.608469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:36:54.614360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1296604818", "imageRef": "c7a61127-8bc7-4cf8-80fa-a46fa0680c0b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-900151876", "networks": [{"uuid": "db9806c1-ebe9-427d-814e-05f2eeffac3b"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:36:54.670033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] validate_networks() for [('db9806c1-ebe9-427d-814e-05f2eeffac3b', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:36:55.056768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:36:55.057232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:36:55.057911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:36:55.058279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:36:55.058940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:36:55.068528 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:55.069010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:55.069442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:55.070164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:55.070637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:55.071056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:55.093426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Getting quotas for project e870c0e4a8454467a10712afd06d3557. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:36:55.099582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Getting quotas for user c0d45985ec414548b3e4a8706789e472 and project e870c0e4a8454467a10712afd06d3557. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:36:55.114817 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:36:55.117038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7a61127-8bc7-4cf8-80fa-a46fa0680c0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:36:55.171864 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-59f2ab74-ca8a-4f11-8301-508730778096 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566692 Oct 17 16:36:55.172547 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3891/7508] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:36:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:36:55.184105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7b7134e1-9c7d-4915-93e7-c6e6a485ad79 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:55.185030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7b7134e1-9c7d-4915-93e7-c6e6a485ad79 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:55.243909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7b7134e1-9c7d-4915-93e7-c6e6a485ad79 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:55.251772 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7b7134e1-9c7d-4915-93e7-c6e6a485ad79 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1258 microversion: 2.1 time: 0.071495 Oct 17 16:36:55.252365 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3618/7509] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:55 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:36:56.275806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:56.277181 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:56.283889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:56.284373 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:56.284806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:56.285759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:56.286202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:56.286683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:56.354912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:56.366232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-23789e84-fe86-4c64-b294-3b4ea97e5490 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1318 microversion: 2.1 time: 0.095145 Oct 17 16:36:56.367077 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3892/7510] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:56 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:36:57.390116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:57.391022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:57.397516 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:57.398016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:57.398464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:57.399198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:57.399659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:57.400091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:57.539078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:57.551432 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-77c83223-dd4b-4865-83cb-0a97ca09aa58 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.165727 Oct 17 16:36:57.552049 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3619/7511] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:57 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:36:58.575386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:58.576205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:58.582808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:58.583310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:58.583750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:58.584455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:58.584906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:58.585725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:58.728892 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:58.738902 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-953e9917-bc5c-4ee8-a0a9-6b3efb408294 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.167721 Oct 17 16:36:58.739700 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3893/7512] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:58 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:36:59.766785 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:36:59.767683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:36:59.775033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:59.775540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:59.776002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:59.776715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:36:59.777176 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:36:59.777606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:36:59.929672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:36:59.939290 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dfa57717-4cf8-4c5d-930f-0b2881ccd3d9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.179097 Oct 17 16:36:59.940145 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3620/7513] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:36:59 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:00.962689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:00.964135 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:00.972271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:00.973205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:00.973934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:00.974588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:00.975215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:00.975860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:01.120716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:01.129767 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-18f0fe34-69e8-4406-9855-68ba5219fb3b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.171454 Oct 17 16:37:01.130371 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3894/7514] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:00 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:02.153388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:02.154435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:02.161920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:02.162422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:02.162916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:02.163841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:02.164491 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:02.165117 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:02.304952 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:02.313009 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-393c0583-90a0-451e-9fbe-236dc6dded0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.163546 Oct 17 16:37:02.313604 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3621/7515] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:02 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:03.337341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:03.338948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:03.347484 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:03.348426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:03.349072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:03.349997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:03.350456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:03.350891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:03.495786 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:03.505036 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-059075f4-1c39-4d98-b902-6daa16b1a9ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.172068 Oct 17 16:37:03.505639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3895/7516] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:03 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:04.529803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:04.530435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:04.538321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:04.538834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:04.539333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:04.539990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:04.540452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:04.540887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:04.694679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:04.703149 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2adf5372-11b8-49af-a2de-31d1beda5295 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.177379 Oct 17 16:37:04.703829 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3622/7517] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:04 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:05.383608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-b970590d-134c-41b9-8a6b-cb31b98e8601 req-39c9d0f3-d732-4c1e-8716-bd094ee4e8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc117b27-0f9a-42ce-aaeb-add0ea9f19b6", "tag": "a19cc3c2-5306-4066-830b-1e28a0a2306e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:37:05.391542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:37:05.392391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:37:05.398259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b970590d-134c-41b9-8a6b-cb31b98e8601 req-39c9d0f3-d732-4c1e-8716-bd094ee4e8f3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:05.398871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b970590d-134c-41b9-8a6b-cb31b98e8601 req-39c9d0f3-d732-4c1e-8716-bd094ee4e8f3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:05.399506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-b970590d-134c-41b9-8a6b-cb31b98e8601 req-39c9d0f3-d732-4c1e-8716-bd094ee4e8f3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:05.412275 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-b970590d-134c-41b9-8a6b-cb31b98e8601 req-39c9d0f3-d732-4c1e-8716-bd094ee4e8f3 service nova] Creating event network-changed:a19cc3c2-5306-4066-830b-1e28a0a2306e for instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 on n-h1-854441-12 Oct 17 16:37:05.417457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-b970590d-134c-41b9-8a6b-cb31b98e8601 req-39c9d0f3-d732-4c1e-8716-bd094ee4e8f3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037582 Oct 17 16:37:05.418071 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3896/7518] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:37:05.727253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:05.728119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:05.730309 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:37:05.736754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:05.737252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:05.737694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:05.738433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:05.738922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:05.739355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:05.894075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:05.902383 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0c217bd0-fad4-429f-89f5-e0e03a3fe889 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.179332 Oct 17 16:37:05.903015 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3623/7519] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:05 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:06.932027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:06.933480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:06.943395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:06.943897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:06.944331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:06.945038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:06.945741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:06.946161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:07.097783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:07.106127 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54382cff-2f6b-4249-893f-e23e41236beb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.182893 Oct 17 16:37:07.106752 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3897/7520] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:06 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:08.130877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:08.131728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:08.142020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:08.142573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:08.143036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:08.143780 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:08.144256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:08.144710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:08.292041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:08.300281 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-404767f0-0146-4e97-a6ba-72dda72ebc18 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.174697 Oct 17 16:37:08.300856 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3624/7521] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:08 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:09.327367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:09.328131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:09.336024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:09.336590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:09.337128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:09.337765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:09.338220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:09.338683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:09.482159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:09.491116 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cd08c9dc-e8e9-408c-8cb2-7155423c0984 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.169644 Oct 17 16:37:09.491750 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3898/7522] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:09 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:10.515179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:10.515823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:10.523405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:10.523907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:10.524358 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:10.525071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:10.525534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:10.525972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:10.677022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:10.689312 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4e2b4325-c014-452d-aae3-b0659c59a971 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.177859 Oct 17 16:37:10.689980 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3625/7523] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:10 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:11.521124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-4a890ea1-3e99-4cf1-bf99-92732e15e040 req-e6b37c83-958d-4031-8f6b-e239aa5fc3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc117b27-0f9a-42ce-aaeb-add0ea9f19b6", "name": "network-vif-plugged", "status": "completed", "tag": "a19cc3c2-5306-4066-830b-1e28a0a2306e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:37:11.532245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4a890ea1-3e99-4cf1-bf99-92732e15e040 req-e6b37c83-958d-4031-8f6b-e239aa5fc3ee service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:11.532738 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4a890ea1-3e99-4cf1-bf99-92732e15e040 req-e6b37c83-958d-4031-8f6b-e239aa5fc3ee service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:11.533263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-4a890ea1-3e99-4cf1-bf99-92732e15e040 req-e6b37c83-958d-4031-8f6b-e239aa5fc3ee service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:11.545274 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-4a890ea1-3e99-4cf1-bf99-92732e15e040 req-e6b37c83-958d-4031-8f6b-e239aa5fc3ee service nova] Creating event network-vif-plugged:a19cc3c2-5306-4066-830b-1e28a0a2306e for instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 on n-h1-854441-12 Oct 17 16:37:11.550677 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-4a890ea1-3e99-4cf1-bf99-92732e15e040 req-e6b37c83-958d-4031-8f6b-e239aa5fc3ee service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033582 Oct 17 16:37:11.551490 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3899/7524] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:37:11.719791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:11.720432 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:11.727597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:11.728103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:11.728560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:11.729272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:11.729746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:11.730190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:12.232161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:12.242326 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6cbf8e23-ec26-4857-8dc9-ae05f9dfa8ca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1358 microversion: 2.1 time: 0.526675 Oct 17 16:37:12.242963 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3626/7525] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:11 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1358 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:13.267242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:13.267840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:13.274695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:13.275175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:13.275604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:13.276294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:13.276721 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:13.277159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:13.416939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:13.427394 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-fd01c624-d040-4d26-be92-b391727e06a8 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1547 microversion: 2.1 time: 0.165290 Oct 17 16:37:13.428042 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3900/7526] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:13 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:13.450149 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:13.450788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:13.458719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:13.459235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:13.459690 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:13.460565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:13.461229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:13.461839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:13.621236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:13.633388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fc95fdee-3328-412e-93a9-ba2dfec5cd88 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1547 microversion: 2.1 time: 0.187321 Oct 17 16:37:13.634147 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3627/7527] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:13 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1547 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:13.663619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:13.668402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:13.669205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Searching by: {'deleted': False, 'project_id': 'e870c0e4a8454467a10712afd06d3557'} {{(pid=120406) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 16:37:13.675265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:13.675777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:13.676222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:13.676951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:13.677501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:13.677937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:13.703132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.multi_cell_list [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 16:37:13.731309 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74497f8c-8399-4c42-9d39-eb5d8e104e2a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071766 Oct 17 16:37:13.731904 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3901/7528] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 16:37:13 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:37:13.746984 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:13.747707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:13.754429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:13.755002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:13.755439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:13.756156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:13.756627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:13.757080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:13.904253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:13.916314 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-abe97358-ec8b-4b5a-a265-07dff1f7ee8c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1547 microversion: 2.1 time: 0.173249 Oct 17 16:37:13.917069 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3628/7529] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:13 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:15.502206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-799ea92e-d70c-46a7-afa2-1fb0cd357826 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a0fd632-e781-42cf-b041-2e808cf3b2a2"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:37:15.504636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-799ea92e-d70c-46a7-afa2-1fb0cd357826 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:15.511791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-799ea92e-d70c-46a7-afa2-1fb0cd357826 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:15.512285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-799ea92e-d70c-46a7-afa2-1fb0cd357826 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:15.512723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-799ea92e-d70c-46a7-afa2-1fb0cd357826 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:15.513456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-799ea92e-d70c-46a7-afa2-1fb0cd357826 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:15.513964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-799ea92e-d70c-46a7-afa2-1fb0cd357826 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:15.514310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-799ea92e-d70c-46a7-afa2-1fb0cd357826 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:15.767078 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-799ea92e-d70c-46a7-afa2-1fb0cd357826 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268968 Oct 17 16:37:15.767720 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3902/7530] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 16:37:15 2022] POST /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:37:28.873362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:28.873991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:28.877382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:37:28.878048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=60 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:37:28.885012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:28.885538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:28.885988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:28.886740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:28.887305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:28.887747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:29.023465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:29.032203 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a8ab795d-f2fe-4af1-8565-92e13ea0ef12 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1593 microversion: 2.1 time: 0.163032 Oct 17 16:37:29.032798 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3629/7531] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:28 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1593 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:30.786139 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-808d167f-a9d2-4928-be14-ab8d829df094 req-f24ead0b-db5e-4268-b140-75e05ad4f756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc117b27-0f9a-42ce-aaeb-add0ea9f19b6", "tag": "a19cc3c2-5306-4066-830b-1e28a0a2306e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:37:30.797886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:37:30.799004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:37:30.799722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:37:30.806434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-808d167f-a9d2-4928-be14-ab8d829df094 req-f24ead0b-db5e-4268-b140-75e05ad4f756 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:30.807261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-808d167f-a9d2-4928-be14-ab8d829df094 req-f24ead0b-db5e-4268-b140-75e05ad4f756 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:30.807814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-808d167f-a9d2-4928-be14-ab8d829df094 req-f24ead0b-db5e-4268-b140-75e05ad4f756 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:30.820959 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-808d167f-a9d2-4928-be14-ab8d829df094 req-f24ead0b-db5e-4268-b140-75e05ad4f756 service nova] Creating event network-changed:a19cc3c2-5306-4066-830b-1e28a0a2306e for instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 on n-h1-854441-12 Oct 17 16:37:30.827015 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-808d167f-a9d2-4928-be14-ab8d829df094 req-f24ead0b-db5e-4268-b140-75e05ad4f756 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045087 Oct 17 16:37:30.827642 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3903/7532] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:37:31.948831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2088348703"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:37:31.949669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:31.957189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:31.957784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:31.958298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:31.959147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:31.959678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:31.960179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:32.093007 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.network.security_group_api [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Adding security group 1d029876-b14c-4453-9046-31a49224d25c to port a19cc3c2-5306-4066-830b-1e28a0a2306e Oct 17 16:37:32.424789 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-134ea4be-4a8a-49ad-96a4-5c80f5bed99b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/action" status: 202 len: 0 microversion: 2.1 time: 0.480445 Oct 17 16:37:32.425551 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3630/7533] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:37:31 2022] POST /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:37:32.437647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:37:32.438225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:37:32.445149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:32.445659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:32.446262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:32.447478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:32.447478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:32.447935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:32.605024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:37:32.613777 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8244025d-ee05-4c02-9f71-9168bac5250b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1758 microversion: 2.1 time: 0.183354 Oct 17 16:37:32.614383 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3904/7534] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:37:32 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:37:32.846863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5d4198c8-f6bd-41b9-ac27-7dc9abbbb122 req-e5ddb320-f8b5-4bba-83f8-95952322ce76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc117b27-0f9a-42ce-aaeb-add0ea9f19b6", "tag": "a19cc3c2-5306-4066-830b-1e28a0a2306e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:37:32.864079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5d4198c8-f6bd-41b9-ac27-7dc9abbbb122 req-e5ddb320-f8b5-4bba-83f8-95952322ce76 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:37:32.864862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5d4198c8-f6bd-41b9-ac27-7dc9abbbb122 req-e5ddb320-f8b5-4bba-83f8-95952322ce76 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:37:32.865646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5d4198c8-f6bd-41b9-ac27-7dc9abbbb122 req-e5ddb320-f8b5-4bba-83f8-95952322ce76 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:37:32.888343 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5d4198c8-f6bd-41b9-ac27-7dc9abbbb122 req-e5ddb320-f8b5-4bba-83f8-95952322ce76 service nova] Creating event network-changed:a19cc3c2-5306-4066-830b-1e28a0a2306e for instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 on n-h1-854441-12 Oct 17 16:37:32.897105 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5d4198c8-f6bd-41b9-ac27-7dc9abbbb122 req-e5ddb320-f8b5-4bba-83f8-95952322ce76 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056792 Oct 17 16:37:32.898166 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3631/7535] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:39:10.839755 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:39:10.840449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=8 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:39:10.841818 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:39:10.841979 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:39:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/action (ip 10.222.0.87) !!! Oct 17 16:39:10.846933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-958b9333-0c13-4792-9402-54f13e5a31f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:39:10.849185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-958b9333-0c13-4792-9402-54f13e5a31f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:39:10.860162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b9333-0c13-4792-9402-54f13e5a31f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:39:10.860651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b9333-0c13-4792-9402-54f13e5a31f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:39:10.861096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b9333-0c13-4792-9402-54f13e5a31f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:39:10.861945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b9333-0c13-4792-9402-54f13e5a31f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:39:10.862380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b9333-0c13-4792-9402-54f13e5a31f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:39:10.862832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-958b9333-0c13-4792-9402-54f13e5a31f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:39:10.944910 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-958b9333-0c13-4792-9402-54f13e5a31f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/action" status: 202 len: 0 microversion: 2.1 time: 0.107116 Oct 17 16:39:10.945587 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3905/7536] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:39:10 2022] POST /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:39:10.953107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:39:10.953981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=12 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:39:10.955563 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:39:10.955705 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:39:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 (ip 10.222.0.87) !!! Oct 17 16:39:10.961487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:39:10.962201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:39:10.970189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:39:10.970710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:39:10.971163 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:39:10.971870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:39:10.972329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:39:10.972768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:39:11.232258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:39:11.241093 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7a623c5d-d54e-477d-8ed1-12902b345b5f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1760 microversion: 2.1 time: 0.290705 Oct 17 16:39:11.241668 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3632/7537] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:39:10 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1760 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:39:12.269692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:39:12.270400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:39:12.277393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:39:12.277906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:39:12.278344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:39:12.279073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:39:12.279527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:39:12.279953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:39:12.448148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:39:12.457804 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1fc2ef05-9551-4450-906a-79ce767a7aca tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1765 microversion: 2.1 time: 0.195585 Oct 17 16:39:12.458407 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3906/7538] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:39:12 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1765 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:39:13.484739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:39:13.485429 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:39:13.493702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:39:13.494399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:39:13.495022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:39:13.495847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:39:13.496312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:39:13.496752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:39:13.654409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:39:13.665593 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5af73321-17b4-489e-99d9-18f8a5ef645b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1758 microversion: 2.1 time: 0.184687 Oct 17 16:39:13.666324 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3633/7539] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:39:13 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:26.459628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:40:26.460397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:40:26.464715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2088348703"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:40:26.465261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:26.472642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:26.473158 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:26.473596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:26.474263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:26.474775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:26.475201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:26.612523 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.network.security_group_api [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Removing security group 1d029876-b14c-4453-9046-31a49224d25c from port a19cc3c2-5306-4066-830b-1e28a0a2306e Oct 17 16:40:26.953852 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4466357d-5302-4b60-b435-b1b847aeb0ba tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/action" status: 202 len: 0 microversion: 2.1 time: 0.496197 Oct 17 16:40:26.954927 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3907/7540] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:40:26 2022] POST /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:40:26.964512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:40:26.965577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=12 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:40:27.171838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cd9030bb-dd8c-4c6a-ae2d-af91d5a22fbd req-90cce5e1-3e88-44f3-bd33-69e6645f5930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc117b27-0f9a-42ce-aaeb-add0ea9f19b6", "tag": "a19cc3c2-5306-4066-830b-1e28a0a2306e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:40:27.188640 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cd9030bb-dd8c-4c6a-ae2d-af91d5a22fbd req-90cce5e1-3e88-44f3-bd33-69e6645f5930 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:27.190267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cd9030bb-dd8c-4c6a-ae2d-af91d5a22fbd req-90cce5e1-3e88-44f3-bd33-69e6645f5930 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:27.190975 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cd9030bb-dd8c-4c6a-ae2d-af91d5a22fbd req-90cce5e1-3e88-44f3-bd33-69e6645f5930 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:27.204576 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cd9030bb-dd8c-4c6a-ae2d-af91d5a22fbd req-90cce5e1-3e88-44f3-bd33-69e6645f5930 service nova] Creating event network-changed:a19cc3c2-5306-4066-830b-1e28a0a2306e for instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 on n-h1-854441-12 Oct 17 16:40:27.208449 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [req-cd9030bb-dd8c-4c6a-ae2d-af91d5a22fbd req-90cce5e1-3e88-44f3-bd33-69e6645f5930 service nova] [4f77fbb2-14ae-4263-94c4-d5d493f6644b] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:40:28.056413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:28.057123 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:28.063975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:28.064475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:28.064917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:28.065735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:28.066194 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:28.066655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:28.156089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lazy-loading 'services' on Instance uuid cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:40:28.219622 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [req-cd9030bb-dd8c-4c6a-ae2d-af91d5a22fbd req-90cce5e1-3e88-44f3-bd33-69e6645f5930 service nova] [4f77fbb2-14ae-4263-94c4-d5d493f6644b] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 41238. Oct 17 16:40:28.227445 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cd9030bb-dd8c-4c6a-ae2d-af91d5a22fbd req-90cce5e1-3e88-44f3-bd33-69e6645f5930 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.264484 Oct 17 16:40:28.228586 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3634/7541] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:40:28.250276 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8a9da20e-432f-4914-88bc-199b6da21cbd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments/0a0fd632-e781-42cf-b041-2e808cf3b2a2" status: 202 len: 0 microversion: 2.1 time: 0.198185 Oct 17 16:40:28.251396 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3908/7542] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:40:28 2022] DELETE /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments/0a0fd632-e781-42cf-b041-2e808cf3b2a2 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 16:40:28.266239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-615b6400-a09b-4baa-9fb0-fc8c6cfdd3c3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:28.271389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-615b6400-a09b-4baa-9fb0-fc8c6cfdd3c3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:28.282839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615b6400-a09b-4baa-9fb0-fc8c6cfdd3c3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:28.283752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615b6400-a09b-4baa-9fb0-fc8c6cfdd3c3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:28.284565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615b6400-a09b-4baa-9fb0-fc8c6cfdd3c3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:28.285695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615b6400-a09b-4baa-9fb0-fc8c6cfdd3c3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:28.286527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615b6400-a09b-4baa-9fb0-fc8c6cfdd3c3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:28.287364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-615b6400-a09b-4baa-9fb0-fc8c6cfdd3c3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:28.356471 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-615b6400-a09b-4baa-9fb0-fc8c6cfdd3c3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097938 Oct 17 16:40:28.362682 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3635/7543] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:40:28 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:40:29.375553 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42bcbbf0-24f8-4ce1-b792-62acc2dab27e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:29.378337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42bcbbf0-24f8-4ce1-b792-62acc2dab27e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:29.385128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42bcbbf0-24f8-4ce1-b792-62acc2dab27e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:29.385615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42bcbbf0-24f8-4ce1-b792-62acc2dab27e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:29.386048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42bcbbf0-24f8-4ce1-b792-62acc2dab27e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:29.386787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42bcbbf0-24f8-4ce1-b792-62acc2dab27e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:29.387235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42bcbbf0-24f8-4ce1-b792-62acc2dab27e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:29.387656 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-42bcbbf0-24f8-4ce1-b792-62acc2dab27e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:29.421356 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42bcbbf0-24f8-4ce1-b792-62acc2dab27e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050287 Oct 17 16:40:29.421840 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3909/7544] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:40:29 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:40:30.247487 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-4a5e8311-9983-456d-9810-f9702354595b req-eb2a4f1b-bb50-4d9f-b64f-3ff8675ea1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc117b27-0f9a-42ce-aaeb-add0ea9f19b6", "tag": "a19cc3c2-5306-4066-830b-1e28a0a2306e"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:40:30.259115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4a5e8311-9983-456d-9810-f9702354595b req-eb2a4f1b-bb50-4d9f-b64f-3ff8675ea1c2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:30.259606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4a5e8311-9983-456d-9810-f9702354595b req-eb2a4f1b-bb50-4d9f-b64f-3ff8675ea1c2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:30.260091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4a5e8311-9983-456d-9810-f9702354595b req-eb2a4f1b-bb50-4d9f-b64f-3ff8675ea1c2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:30.272607 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-4a5e8311-9983-456d-9810-f9702354595b req-eb2a4f1b-bb50-4d9f-b64f-3ff8675ea1c2 service nova] Creating event network-changed:a19cc3c2-5306-4066-830b-1e28a0a2306e for instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 on n-h1-854441-12 Oct 17 16:40:30.278563 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-4a5e8311-9983-456d-9810-f9702354595b req-eb2a4f1b-bb50-4d9f-b64f-3ff8675ea1c2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035071 Oct 17 16:40:30.279369 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3636/7545] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:40:30.434064 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7ad16aa1-bdfe-4adf-b4f4-d8d949b6b79f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:30.437188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7ad16aa1-bdfe-4adf-b4f4-d8d949b6b79f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:30.444518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad16aa1-bdfe-4adf-b4f4-d8d949b6b79f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:30.445359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad16aa1-bdfe-4adf-b4f4-d8d949b6b79f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:30.445798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad16aa1-bdfe-4adf-b4f4-d8d949b6b79f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:30.446593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad16aa1-bdfe-4adf-b4f4-d8d949b6b79f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:30.447144 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad16aa1-bdfe-4adf-b4f4-d8d949b6b79f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:30.447564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7ad16aa1-bdfe-4adf-b4f4-d8d949b6b79f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:30.486417 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7ad16aa1-bdfe-4adf-b4f4-d8d949b6b79f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056484 Oct 17 16:40:30.487004 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3910/7546] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:40:30 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:40:31.502790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-816c4f02-fcc3-4aac-b55e-563148367159 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:31.505270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-816c4f02-fcc3-4aac-b55e-563148367159 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:31.512359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-816c4f02-fcc3-4aac-b55e-563148367159 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:31.512867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-816c4f02-fcc3-4aac-b55e-563148367159 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:31.513387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-816c4f02-fcc3-4aac-b55e-563148367159 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:31.514134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-816c4f02-fcc3-4aac-b55e-563148367159 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:31.514619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-816c4f02-fcc3-4aac-b55e-563148367159 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:31.515077 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-816c4f02-fcc3-4aac-b55e-563148367159 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:31.549747 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-816c4f02-fcc3-4aac-b55e-563148367159 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053230 Oct 17 16:40:31.550356 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3637/7547] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:40:31 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:40:32.565301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e14453d5-fb25-4877-b14f-0b7a77e0bd0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:32.568929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e14453d5-fb25-4877-b14f-0b7a77e0bd0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:32.578358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e14453d5-fb25-4877-b14f-0b7a77e0bd0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:32.579317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e14453d5-fb25-4877-b14f-0b7a77e0bd0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:32.580071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e14453d5-fb25-4877-b14f-0b7a77e0bd0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:32.581175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e14453d5-fb25-4877-b14f-0b7a77e0bd0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:32.581885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e14453d5-fb25-4877-b14f-0b7a77e0bd0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:32.582467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e14453d5-fb25-4877-b14f-0b7a77e0bd0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:32.925518 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e14453d5-fb25-4877-b14f-0b7a77e0bd0e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.366517 Oct 17 16:40:32.926581 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3911/7548] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:40:32 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments => generated 197 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:40:33.940138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d094392e-99e3-47de-925f-30a0a97358aa tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:33.942453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d094392e-99e3-47de-925f-30a0a97358aa tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:33.950525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d094392e-99e3-47de-925f-30a0a97358aa tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:33.951039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d094392e-99e3-47de-925f-30a0a97358aa tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:33.951500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d094392e-99e3-47de-925f-30a0a97358aa tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:33.952227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d094392e-99e3-47de-925f-30a0a97358aa tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:33.952699 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d094392e-99e3-47de-925f-30a0a97358aa tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:33.953145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d094392e-99e3-47de-925f-30a0a97358aa tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:33.983947 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d094392e-99e3-47de-925f-30a0a97358aa tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048411 Oct 17 16:40:33.984558 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3638/7549] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:40:33 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 16:40:33.997103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:33.997800 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:34.006918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:34.007407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:34.007834 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:34.008532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:34.008983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:34.009389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:34.087914 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] HTTP exception thrown: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 is not attached to volume 0a0fd632-e781-42cf-b041-2e808cf3b2a2 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Request method failure captured: Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments/0a0fd632-e781-42cf-b041-2e808cf3b2a2 HTTP/1.1 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYSXNqiIwqsaCBZGkErP2zhuQsqZEBKWO6OjkqiuDcVg9xM84siNpG4J0QTseq_UqjujxMg7ueQDtbYYtEeXFBHuHfWHM1rSA1K-Ku6549w695JyRR-CWu1LETgMdAeuyE-vduE0pCq2P4Enr_pVlIUVmAAVMFTZ3bjoPY6c9aUu3wE Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: e870c0e4a8454467a10712afd06d3557 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e870c0e4a8454467a10712afd06d3557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: e870c0e4a8454467a10712afd06d3557 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestMinimumBasicScenario-966891594-project Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: c0d45985ec414548b3e4a8706789e472 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestMinimumBasicScenario-966891594-project Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 is not attached to volume 0a0fd632-e781-42cf-b041-2e808cf3b2a2 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': 'cc117b27-0f9a-42ce-aaeb-add0ea9f19b6', 'id': '0a0fd632-e781-42cf-b041-2e808cf3b2a2'} Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0a0fd632-e781-42cf-b041-2e808cf3b2a2. Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 is not attached to volume 0a0fd632-e781-42cf-b041-2e808cf3b2a2 Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:40:34.090165 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:40:34.095069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:40:34.095069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:40:34.095069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 is not attached to volume 0a0fd632-e781-42cf-b041-2e808cf3b2a2 Oct 17 16:40:34.095069 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:34.095069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Returning 404 to user: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 is not attached to volume 0a0fd632-e781-42cf-b041-2e808cf3b2a2 {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:40:34.095069 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04958bed-cf6c-46a6-9c7f-db300dabe89f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments/0a0fd632-e781-42cf-b041-2e808cf3b2a2" status: 404 len: 154 microversion: 2.1 time: 0.099654 Oct 17 16:40:34.095069 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3912/7550] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:40:33 2022] DELETE /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6/os-volume_attachments/0a0fd632-e781-42cf-b041-2e808cf3b2a2 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:40:37.392435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:37.393107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:37.400710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:37.401254 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:37.401709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:37.402435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:37.402925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:37.403368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:37.431113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:40:37.518123 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-00db0e1e-ce09-44da-9c8a-3d770c2afdb2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 204 len: 0 microversion: 2.1 time: 0.141071 Oct 17 16:40:37.522174 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3639/7551] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:40:37 2022] DELETE /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:40:37.529931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:37.530683 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:37.538351 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:37.538874 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:37.539314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:37.539994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:37.540442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:37.540865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:37.696889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:37.705892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cdc16981-3b11-4977-8b44-4710b51dd7d0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1553 microversion: 2.1 time: 0.181628 Oct 17 16:40:37.706476 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3913/7552] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:37 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:38.731497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:38.732334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:38.741100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:38.741613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:38.742069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:38.742831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:38.743307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:38.743755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:38.887577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:38.896153 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-aff48821-a35e-481b-bbbe-8e3c221c8c67 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1553 microversion: 2.1 time: 0.169301 Oct 17 16:40:38.896774 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3640/7553] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:38 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:39.805475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-71b764b9-5538-4b01-95e0-4d0eb91ba34a req-5e7fef9e-f59e-4fc3-a729-fee1e5c72f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc117b27-0f9a-42ce-aaeb-add0ea9f19b6", "name": "network-vif-deleted", "tag": "a19cc3c2-5306-4066-830b-1e28a0a2306e"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:40:39.816076 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-71b764b9-5538-4b01-95e0-4d0eb91ba34a req-5e7fef9e-f59e-4fc3-a729-fee1e5c72f52 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:39.817136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-71b764b9-5538-4b01-95e0-4d0eb91ba34a req-5e7fef9e-f59e-4fc3-a729-fee1e5c72f52 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:39.817805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-71b764b9-5538-4b01-95e0-4d0eb91ba34a req-5e7fef9e-f59e-4fc3-a729-fee1e5c72f52 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:39.830987 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-71b764b9-5538-4b01-95e0-4d0eb91ba34a req-5e7fef9e-f59e-4fc3-a729-fee1e5c72f52 service nova] Creating event network-vif-deleted:a19cc3c2-5306-4066-830b-1e28a0a2306e for instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 on n-h1-854441-12 Oct 17 16:40:39.836210 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-71b764b9-5538-4b01-95e0-4d0eb91ba34a req-5e7fef9e-f59e-4fc3-a729-fee1e5c72f52 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098827 Oct 17 16:40:39.837384 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3914/7554] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:40:39.919824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:39.920558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:39.928197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:39.928706 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:39.929157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:39.929886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:39.930356 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:39.930832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:39.963132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:39.963548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:39.963999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:39.964471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lazy-loading 'fault' on Instance uuid cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:40:40.010333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:40.018945 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-142a34fd-e2fc-4d4f-9558-9345be93b3b3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 200 len: 1348 microversion: 2.1 time: 0.103264 Oct 17 16:40:40.019579 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3641/7555] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:39 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:41.042307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:41.043045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: cc117b27-0f9a-42ce-aaeb-add0ea9f19b6] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:41.051184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:41.051726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:41.052203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:41.052945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:41.053464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:41.053944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:41.069435 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] HTTP exception thrown: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 could not be found. Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Request method failure captured: Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 HTTP/1.1 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYSXNqiIwqsaCBZGkErP2zhuQsqZEBKWO6OjkqiuDcVg9xM84siNpG4J0QTseq_UqjujxMg7ueQDtbYYtEeXFBHuHfWHM1rSA1K-Ku6549w695JyRR-CWu1LETgMdAeuyE-vduE0pCq2P4Enr_pVlIUVmAAVMFTZ3bjoPY6c9aUu3wE Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: e870c0e4a8454467a10712afd06d3557 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e870c0e4a8454467a10712afd06d3557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: e870c0e4a8454467a10712afd06d3557 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestMinimumBasicScenario-966891594-project Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: c0d45985ec414548b3e4a8706789e472 Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestMinimumBasicScenario-966891594-project Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 could not be found. Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'cc117b27-0f9a-42ce-aaeb-add0ea9f19b6'} Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 could not be found. Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 could not be found. Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:40:41.071242 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 could not be found. Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Returning 404 to user: Instance cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c3b42f5f-9895-4c9d-b1ab-abcf251fea5b tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6" status: 404 len: 111 microversion: 2.1 time: 0.034797 Oct 17 16:40:41.076148 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3915/7556] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:41 2022] GET /compute/v2.1/servers/cc117b27-0f9a-42ce-aaeb-add0ea9f19b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 16:40:41.082689 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47cf7b58-9df2-4622-8817-1bcb45e87df0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '.version_select at 0x7f28bdb71ca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:41.087679 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-47cf7b58-9df2-4622-8817-1bcb45e87df0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [ea61a45a-9ea1-4441-b009-8bc505706b50] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:40:42.099336 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [None req-47cf7b58-9df2-4622-8817-1bcb45e87df0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [ea61a45a-9ea1-4441-b009-8bc505706b50] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 41284. Oct 17 16:40:42.120809 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-47cf7b58-9df2-4622-8817-1bcb45e87df0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900151876" status: 202 len: 0 microversion: 2.1 time: 1.042387 Oct 17 16:40:42.121426 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3642/7557] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 16:40:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900151876 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:40:51.373925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-962300b9-624d-422a-a33c-9bf841a4d8a2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'create', calling method: .version_select at 0x7f28bd538e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-247215496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY2uHZR7YggQkINPTkBgc4xGZwAvifeWE/a/IyH3rIKEx0XebdZ+nJK1xudGKWIM/q/FPYmt5ZcCcPnRMtAgyYAvEPhklg+TTrRVjmAx8OuwCXKp5tb0IbGx0RMREM7jQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:40:51.381746 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:40:51.381950 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:40:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.87) !!! Oct 17 16:40:51.383099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=18 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:40:51.383760 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:40:51.399486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-962300b9-624d-422a-a33c-9bf841a4d8a2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Getting quotas for project e870c0e4a8454467a10712afd06d3557. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:40:51.405019 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-962300b9-624d-422a-a33c-9bf841a4d8a2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Getting quotas for user c0d45985ec414548b3e4a8706789e472 and project e870c0e4a8454467a10712afd06d3557. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:40:51.443519 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-962300b9-624d-422a-a33c-9bf841a4d8a2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.073449 Oct 17 16:40:51.444134 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3916/7558] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:40:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:40:51.496542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:40:51.501331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1078196228", "imageRef": "a6bf7382-a3e4-4240-8ec9-830b102c49aa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-247215496", "networks": [{"uuid": "db9806c1-ebe9-427d-814e-05f2eeffac3b"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:40:51.561383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] validate_networks() for [('db9806c1-ebe9-427d-814e-05f2eeffac3b', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:40:52.031611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:40:52.032050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:40:52.032547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:40:52.032973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:40:52.033397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:40:52.043868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:52.044378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:52.044838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:52.045673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:52.049854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:52.049854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:52.064367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Getting quotas for project e870c0e4a8454467a10712afd06d3557. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:40:52.070056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Getting quotas for user c0d45985ec414548b3e4a8706789e472 and project e870c0e4a8454467a10712afd06d3557. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:40:52.084702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:40:52.087425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6bf7382-a3e4-4240-8ec9-830b102c49aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:40:52.139652 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c207377e-ffbb-4cf2-a461-41e42317045c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644895 Oct 17 16:40:52.140331 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3643/7559] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:40:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:40:52.151845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-076a530e-7a56-4b89-baf0-cd93602be314 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:52.152473 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-076a530e-7a56-4b89-baf0-cd93602be314 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:52.212627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-076a530e-7a56-4b89-baf0-cd93602be314 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:52.220004 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-076a530e-7a56-4b89-baf0-cd93602be314 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1258 microversion: 2.1 time: 0.072205 Oct 17 16:40:52.220582 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3917/7560] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:52 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:53.244360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:53.244948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:53.252642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:53.253127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:53.253595 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:53.254303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:53.254808 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:53.255246 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:53.378477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:53.388833 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d94a7b2-8c74-485b-8d6c-3c1a30d6f387 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1310 microversion: 2.1 time: 0.150334 Oct 17 16:40:53.389446 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3644/7561] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:53 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1310 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:54.412997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:54.413897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:54.422188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:54.423136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:54.423860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:54.424709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:54.425431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:54.426320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:54.580405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:54.589425 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b88f3b24-e830-4446-8d1a-ee7a5c0d7a62 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.180481 Oct 17 16:40:54.590222 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3918/7562] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:54 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:55.613190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:55.613823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:55.620747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:55.621228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:55.621713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:55.622436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:55.622950 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:55.623395 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:55.763622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:55.773542 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c6f75c37-0518-4a40-bd1e-c19e4c40c3f9 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.164378 Oct 17 16:40:55.774485 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3645/7563] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:55 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:56.797772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:56.798385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:56.805311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:56.805795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:56.806220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:56.806950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:56.807395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:56.807811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:56.968395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:56.976799 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8c263a33-f773-46c6-9c82-12710913f2c0 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.183216 Oct 17 16:40:56.977528 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3919/7564] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:56 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:58.000451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:58.001064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:58.004004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:40:58.009693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:58.010270 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:58.010761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:58.011489 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:58.011957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:58.012397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:58.176404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:58.185837 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e76509d-39c2-42d4-8066-e894d5b59c34 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.189417 Oct 17 16:40:58.202433 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3646/7565] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:57 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:40:59.209476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:40:59.210091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:40:59.216849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:59.217338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:59.217775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:59.218470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:40:59.218967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:40:59.219389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:40:59.355822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:40:59.364888 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-10b0dbf8-efb7-4653-9cd5-8d5576d1b681 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.159531 Oct 17 16:40:59.365397 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3920/7566] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:40:59 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:00.388844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:00.390318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:00.399472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:00.400544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:00.401625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:00.402940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:00.403880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:00.404884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:00.546026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:00.556532 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d1961527-ba29-43fa-b943-e11e43438b23 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.170965 Oct 17 16:41:00.561535 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3647/7567] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:00 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:41:01.599421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:01.600439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:01.607705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:01.608240 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:01.608748 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:01.609436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:01.609877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:01.610299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:01.745494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:01.754094 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d3e406be-f089-408c-9919-fffdedc0fe38 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.158723 Oct 17 16:41:01.754690 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3921/7568] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:01 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:02.789769 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:02.790572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:02.793718 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:02.794418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:02.801085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:02.802627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:02.804478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:02.806613 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:02.807123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:02.807581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:02.955031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:02.964098 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f7e4efe-9e10-4bd0-b8aa-dd2c96c2b7bb tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.182515 Oct 17 16:41:02.964782 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3648/7569] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:02 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:03.988981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:03.989670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:03.991758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:03.998177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:03.998702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:03.999155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:03.999862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:04.000313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:04.000735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:04.147899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:04.156235 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b231430b-b2a3-4089-8ee7-04dfad3c54b7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.171305 Oct 17 16:41:04.156829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3922/7570] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:03 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:04.348856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-28120dcf-cd11-44cc-b4d3-a51ac8d3cb57 req-a64f6644-aa68-44de-ae1f-2578be1fa687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51d8d62-cf85-4f79-856d-22a74f29bc64", "tag": "74212fe7-f917-4fc2-9c25-494ad8ca5252"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:41:04.361919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-28120dcf-cd11-44cc-b4d3-a51ac8d3cb57 req-a64f6644-aa68-44de-ae1f-2578be1fa687 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:04.362678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-28120dcf-cd11-44cc-b4d3-a51ac8d3cb57 req-a64f6644-aa68-44de-ae1f-2578be1fa687 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:04.363189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-28120dcf-cd11-44cc-b4d3-a51ac8d3cb57 req-a64f6644-aa68-44de-ae1f-2578be1fa687 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:04.379239 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-28120dcf-cd11-44cc-b4d3-a51ac8d3cb57 req-a64f6644-aa68-44de-ae1f-2578be1fa687 service nova] Creating event network-changed:74212fe7-f917-4fc2-9c25-494ad8ca5252 for instance e51d8d62-cf85-4f79-856d-22a74f29bc64 on n-h2-854441-12 Oct 17 16:41:04.384727 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-28120dcf-cd11-44cc-b4d3-a51ac8d3cb57 req-a64f6644-aa68-44de-ae1f-2578be1fa687 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040524 Oct 17 16:41:04.385860 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3649/7571] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:41:05.178973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:05.179608 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:05.187963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:05.188460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:05.188903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:05.189623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:05.190077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:05.190543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:05.329421 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:05.338080 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0bfedd73-5952-45a1-aa31-18a5a2885164 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.163270 Oct 17 16:41:05.338812 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3923/7572] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:05 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:06.373790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:06.374604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:06.382772 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:06.383417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:06.383948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:06.384746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:06.385440 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:06.386095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:06.541059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:06.550135 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6e928952-4bd1-4b35-825d-55ebaf58e412 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.184253 Oct 17 16:41:06.550765 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3650/7573] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:06 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:07.576440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:07.577476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:07.585273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:07.585770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:07.586674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:07.586944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:07.587401 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:07.587827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:07.726877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:07.743307 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6209ce36-fdcd-48b8-9ad3-499c672428a3 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.173003 Oct 17 16:41:07.743906 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3924/7574] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:07 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:08.385451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-871ee2d1-84cd-4db8-91ae-c2503b7bc3ee req-47958426-e7f0-4785-8d99-b613370ba13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51d8d62-cf85-4f79-856d-22a74f29bc64", "name": "network-vif-plugged", "status": "completed", "tag": "74212fe7-f917-4fc2-9c25-494ad8ca5252"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:41:08.396236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-871ee2d1-84cd-4db8-91ae-c2503b7bc3ee req-47958426-e7f0-4785-8d99-b613370ba13e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:08.396746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-871ee2d1-84cd-4db8-91ae-c2503b7bc3ee req-47958426-e7f0-4785-8d99-b613370ba13e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:08.397213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-871ee2d1-84cd-4db8-91ae-c2503b7bc3ee req-47958426-e7f0-4785-8d99-b613370ba13e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:08.409436 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-871ee2d1-84cd-4db8-91ae-c2503b7bc3ee req-47958426-e7f0-4785-8d99-b613370ba13e service nova] Creating event network-vif-plugged:74212fe7-f917-4fc2-9c25-494ad8ca5252 for instance e51d8d62-cf85-4f79-856d-22a74f29bc64 on n-h2-854441-12 Oct 17 16:41:08.415028 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-871ee2d1-84cd-4db8-91ae-c2503b7bc3ee req-47958426-e7f0-4785-8d99-b613370ba13e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128451 Oct 17 16:41:08.415677 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3651/7575] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:41:08.774271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:08.774960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:08.783309 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:08.784061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:08.784724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:08.785559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:08.786241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:08.786918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:08.932700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:08.941591 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a23ddb55-f770-4354-84be-31083fb81184 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1358 microversion: 2.1 time: 0.171290 Oct 17 16:41:08.942329 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3925/7576] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:08 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:09.966827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:09.968022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:09.977187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:09.977708 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:09.978164 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:09.978933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:09.979404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:09.979876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:10.135566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:10.148417 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0545040a-eb0f-4cb5-b293-392665f53edd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1547 microversion: 2.1 time: 0.186604 Oct 17 16:41:10.149111 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3652/7577] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:09 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1547 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:10.184445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:10.185140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:10.192843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:10.193340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:10.193775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:10.194486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:10.194966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:10.195384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:10.346488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:10.355022 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-380fe465-b131-4c78-a79c-0b4f35eb936e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1547 microversion: 2.1 time: 0.174467 Oct 17 16:41:10.355632 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3926/7578] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:10 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:10.378069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:10.383244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:10.384056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Searching by: {'deleted': False, 'project_id': 'e870c0e4a8454467a10712afd06d3557'} {{(pid=120407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 16:41:10.390433 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:10.390970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:10.391418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:10.392155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:10.392619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:10.393053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:10.420678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.multi_cell_list [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 16:41:10.453398 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8996990a-a0ec-4384-8b2a-3bf8c8022087 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.079570 Oct 17 16:41:10.454077 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3653/7579] 10.222.0.87 () {58 vars in 1125 bytes} [Mon Oct 17 16:41:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:41:10.466124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:10.466792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:10.473108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:10.473593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:10.474024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:10.474757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:10.475208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:10.475625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:10.625840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:10.641207 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b213a977-f875-4a64-a558-004ac0e05de4 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1547 microversion: 2.1 time: 0.178635 Oct 17 16:41:10.642109 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3927/7580] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:10 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:12.246707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-09fcfe82-56e7-4db0-9672-c5b7edda63d2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eabd8fb6-a566-4137-97a4-aa5698aa698a"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:41:12.249147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-09fcfe82-56e7-4db0-9672-c5b7edda63d2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:12.257299 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09fcfe82-56e7-4db0-9672-c5b7edda63d2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:12.257805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09fcfe82-56e7-4db0-9672-c5b7edda63d2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:12.258252 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09fcfe82-56e7-4db0-9672-c5b7edda63d2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:12.259039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09fcfe82-56e7-4db0-9672-c5b7edda63d2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:12.259500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09fcfe82-56e7-4db0-9672-c5b7edda63d2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:12.259972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-09fcfe82-56e7-4db0-9672-c5b7edda63d2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:12.542588 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-09fcfe82-56e7-4db0-9672-c5b7edda63d2 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299843 Oct 17 16:41:12.543260 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3654/7581] 10.222.0.87 () {60 vars in 1323 bytes} [Mon Oct 17 16:41:12 2022] POST /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:41:23.422937 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:23.423627 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:23.427894 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:23.428792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=60 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:23.439261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:23.439981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:23.440645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:23.441665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:23.442327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:23.442947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:23.595133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:23.604551 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2cd02b78-8c24-4edd-b5e7-f18c791fb067 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1593 microversion: 2.1 time: 0.187141 Oct 17 16:41:23.605170 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3928/7582] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:23 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1593 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:25.639234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:25.640258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=17 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:25.641338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:25.645110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b3f1fa5e-dca3-4295-88ab-ed92ed2ac210 req-4d694f5d-b212-44f6-b63b-198f2541cf66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51d8d62-cf85-4f79-856d-22a74f29bc64", "tag": "74212fe7-f917-4fc2-9c25-494ad8ca5252"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:41:25.655835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b3f1fa5e-dca3-4295-88ab-ed92ed2ac210 req-4d694f5d-b212-44f6-b63b-198f2541cf66 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:25.656333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b3f1fa5e-dca3-4295-88ab-ed92ed2ac210 req-4d694f5d-b212-44f6-b63b-198f2541cf66 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:25.656782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b3f1fa5e-dca3-4295-88ab-ed92ed2ac210 req-4d694f5d-b212-44f6-b63b-198f2541cf66 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:25.669680 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b3f1fa5e-dca3-4295-88ab-ed92ed2ac210 req-4d694f5d-b212-44f6-b63b-198f2541cf66 service nova] Creating event network-changed:74212fe7-f917-4fc2-9c25-494ad8ca5252 for instance e51d8d62-cf85-4f79-856d-22a74f29bc64 on n-h2-854441-12 Oct 17 16:41:25.675775 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b3f1fa5e-dca3-4295-88ab-ed92ed2ac210 req-4d694f5d-b212-44f6-b63b-198f2541cf66 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038433 Oct 17 16:41:25.676590 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3655/7583] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:41:26.879038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1847615302"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:41:26.879691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:26.886566 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:26.887061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:26.887498 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:26.888204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:26.888654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:26.889081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:27.119419 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.network.security_group_api [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Adding security group 134f45c7-faa4-4354-ba08-986d2ef8779c to port 74212fe7-f917-4fc2-9c25-494ad8ca5252 Oct 17 16:41:27.470696 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9082203e-5373-476e-be94-3ff23126ddcd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/action" status: 202 len: 0 microversion: 2.1 time: 0.596766 Oct 17 16:41:27.471790 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3929/7584] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:41:26 2022] POST /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:41:27.483545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:27.484346 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:27.491445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:27.492055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:27.492513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:27.493475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:27.494227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:27.495224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:27.693254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-9fffebfa-426e-4cf9-9e12-da545f9463f9 req-8188d2e3-2529-46c9-b240-a42382574144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51d8d62-cf85-4f79-856d-22a74f29bc64", "tag": "74212fe7-f917-4fc2-9c25-494ad8ca5252"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:41:27.704157 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fffebfa-426e-4cf9-9e12-da545f9463f9 req-8188d2e3-2529-46c9-b240-a42382574144 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:27.705145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fffebfa-426e-4cf9-9e12-da545f9463f9 req-8188d2e3-2529-46c9-b240-a42382574144 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:27.705769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-9fffebfa-426e-4cf9-9e12-da545f9463f9 req-8188d2e3-2529-46c9-b240-a42382574144 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:27.719072 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-9fffebfa-426e-4cf9-9e12-da545f9463f9 req-8188d2e3-2529-46c9-b240-a42382574144 service nova] Creating event network-changed:74212fe7-f917-4fc2-9c25-494ad8ca5252 for instance e51d8d62-cf85-4f79-856d-22a74f29bc64 on n-h2-854441-12 Oct 17 16:41:27.725183 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-9fffebfa-426e-4cf9-9e12-da545f9463f9 req-8188d2e3-2529-46c9-b240-a42382574144 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036206 Oct 17 16:41:27.726427 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3930/7585] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:41:27.761972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:27.766440 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cf2bd589-a8e8-44f0-b72b-f629512e6c94 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1759 microversion: 2.1 time: 0.288071 Oct 17 16:41:27.767182 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3656/7586] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:27 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1759 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:43.621958 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac0a07ff-7a15-4651-9394-b7854521cfed] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:41:43.623051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:43.624318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:43.637868 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-79c15daa-6180-4491-936e-b7309bc9f14c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:41:43.640564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-79c15daa-6180-4491-936e-b7309bc9f14c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:43.648749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c15daa-6180-4491-936e-b7309bc9f14c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:43.649248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c15daa-6180-4491-936e-b7309bc9f14c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:43.649713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c15daa-6180-4491-936e-b7309bc9f14c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:43.650416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c15daa-6180-4491-936e-b7309bc9f14c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:43.650920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c15daa-6180-4491-936e-b7309bc9f14c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:43.651327 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-79c15daa-6180-4491-936e-b7309bc9f14c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:43.733389 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-79c15daa-6180-4491-936e-b7309bc9f14c tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/action" status: 202 len: 0 microversion: 2.1 time: 0.115051 Oct 17 16:41:43.737168 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3931/7587] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:41:43 2022] POST /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:41:43.742985 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:43.743691 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:43.747122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:43.747961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=8 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:41:43.754070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:43.754813 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:43.755329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:43.756138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:43.756601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:43.757058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:44.011722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:44.020910 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-556782db-bdd2-42d1-ad6b-a22d61798949 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1751 microversion: 2.1 time: 0.282160 Oct 17 16:41:44.021511 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3657/7588] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:43 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1751 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:45.053444 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac0a07ff-7a15-4651-9394-b7854521cfed] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 41556. Oct 17 16:41:45.093489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:45.094455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:45.101968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:45.102463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:45.103085 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:45.103812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:45.104265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:45.104674 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:45.259694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:45.268319 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c254bf1b-512d-4fbd-87f3-bb76d27b9a4e tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1756 microversion: 2.1 time: 0.227259 Oct 17 16:41:45.268916 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3932/7589] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:45 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:46.292343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:46.292976 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:46.300282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:46.300923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:46.301337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:46.301992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:46.302588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:46.303160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:46.461416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:46.475112 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cfa7ad4f-9275-4d12-9a87-573826822465 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1756 microversion: 2.1 time: 0.186307 Oct 17 16:41:46.475977 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3658/7590] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:46 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:47.502695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:47.503614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:47.511179 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:47.511658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:47.512093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:47.512787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:47.513210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:47.513641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:47.665818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:47.674673 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d45376cf-391a-4fe8-b95b-e68c992f5172 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1756 microversion: 2.1 time: 0.175977 Oct 17 16:41:47.675204 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3933/7591] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:47 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:48.699060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:48.699702 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:48.707814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:48.708374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:48.708779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:48.709497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:48.709964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:48.710435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:48.873041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:48.885318 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ca4f3ed4-a18b-49b7-afbd-247f6889e525 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1756 microversion: 2.1 time: 0.190765 Oct 17 16:41:48.885975 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3659/7592] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:48 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:49.909799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:49.910412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:49.917886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:49.918379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:49.918852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:49.919550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:49.920006 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:49.920430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:50.078461 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:50.087570 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd8fcf82-2530-4674-b830-d2b995616b1a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1756 microversion: 2.1 time: 0.181878 Oct 17 16:41:50.088115 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3934/7593] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:49 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:51.116227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:51.117137 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:51.125302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:51.125854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:51.126307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:51.127080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:51.127757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:51.128549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:51.284520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:51.297197 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c32b861b-9225-4ef2-9f4d-923c8d096d06 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1756 microversion: 2.1 time: 0.187399 Oct 17 16:41:51.297780 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3660/7594] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:51 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:52.323336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:52.323974 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:52.333585 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:52.334188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:52.334787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:52.335635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:52.336224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:52.336782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:52.489580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:52.498355 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58c57552-6d0b-456c-bf35-95c4af538863 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1756 microversion: 2.1 time: 0.181278 Oct 17 16:41:52.498981 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3935/7595] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:52 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:53.528197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:53.528838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:53.536239 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:53.536746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:53.537195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:53.537902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:53.538366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:53.538830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:53.697788 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:53.706288 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a113b65-9b50-4025-9c85-d3959a37148a tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1756 microversion: 2.1 time: 0.182190 Oct 17 16:41:53.706907 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3661/7596] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:53 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:54.729778 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:54.730396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:54.738110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:54.738618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:54.739050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:54.739741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:54.740185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:54.740607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:54.912233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:54.920924 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-12487b37-5f14-45ef-87c2-2940180307f7 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1756 microversion: 2.1 time: 0.195214 Oct 17 16:41:54.921538 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3936/7597] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:54 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:41:55.949862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:41:55.950512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:41:55.957907 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:55.958418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:55.958910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:55.959662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:41:55.960110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:41:55.960558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:41:56.122944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:41:56.132249 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cee3350a-5c4d-40cb-9712-a57cf36b65dd tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1759 microversion: 2.1 time: 0.190413 Oct 17 16:41:56.132844 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3662/7598] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:41:55 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:42:28.299097 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1847615302"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:42:28.299756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:28.302036 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=12 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:42:28.302792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:42:28.309406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:28.309891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:28.310338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:28.311079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:28.311537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:28.311965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:28.446140 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.network.security_group_api [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Removing security group 134f45c7-faa4-4354-ba08-986d2ef8779c from port 74212fe7-f917-4fc2-9c25-494ad8ca5252 Oct 17 16:42:28.770614 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f76b60f6-c948-45e8-85c1-d4bb99c6520d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "POST /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/action" status: 202 len: 0 microversion: 2.1 time: 0.476283 Oct 17 16:42:28.771596 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3937/7599] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:42:28 2022] POST /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:42:28.781662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a260a7ec-a882-4db7-9129-c1254f8ee8f8 req-2ce6843b-b683-4e09-9c41-9ae51d84b9fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51d8d62-cf85-4f79-856d-22a74f29bc64", "tag": "74212fe7-f917-4fc2-9c25-494ad8ca5252"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:42:28.800850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=12 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:42:28.802944 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=36 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:42:28.806911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a260a7ec-a882-4db7-9129-c1254f8ee8f8 req-2ce6843b-b683-4e09-9c41-9ae51d84b9fd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:28.807412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a260a7ec-a882-4db7-9129-c1254f8ee8f8 req-2ce6843b-b683-4e09-9c41-9ae51d84b9fd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:28.807870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a260a7ec-a882-4db7-9129-c1254f8ee8f8 req-2ce6843b-b683-4e09-9c41-9ae51d84b9fd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:28.831686 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a260a7ec-a882-4db7-9129-c1254f8ee8f8 req-2ce6843b-b683-4e09-9c41-9ae51d84b9fd service nova] Creating event network-changed:74212fe7-f917-4fc2-9c25-494ad8ca5252 for instance e51d8d62-cf85-4f79-856d-22a74f29bc64 on n-h2-854441-12 Oct 17 16:42:28.847109 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a260a7ec-a882-4db7-9129-c1254f8ee8f8 req-2ce6843b-b683-4e09-9c41-9ae51d84b9fd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068519 Oct 17 16:42:28.848370 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3663/7600] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:42:29.971740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:29.972247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:29.978435 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:29.978988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:29.979429 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:29.980127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:29.980583 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:29.981293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:30.063172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lazy-loading 'services' on Instance uuid e51d8d62-cf85-4f79-856d-22a74f29bc64 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:42:30.140290 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d4ba668-e2ff-40f6-88e4-74ab2144a7f5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments/eabd8fb6-a566-4137-97a4-aa5698aa698a" status: 202 len: 0 microversion: 2.1 time: 0.173254 Oct 17 16:42:30.144072 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3938/7601] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:42:29 2022] DELETE /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments/eabd8fb6-a566-4137-97a4-aa5698aa698a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:42:30.152600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-85ca8b07-22e9-4b46-b7b4-8994ddcf0b08 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:30.155835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-85ca8b07-22e9-4b46-b7b4-8994ddcf0b08 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:30.163409 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ca8b07-22e9-4b46-b7b4-8994ddcf0b08 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:30.164029 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ca8b07-22e9-4b46-b7b4-8994ddcf0b08 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:30.164644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ca8b07-22e9-4b46-b7b4-8994ddcf0b08 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:30.165557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ca8b07-22e9-4b46-b7b4-8994ddcf0b08 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:30.166006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ca8b07-22e9-4b46-b7b4-8994ddcf0b08 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:30.166609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-85ca8b07-22e9-4b46-b7b4-8994ddcf0b08 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:30.199602 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-85ca8b07-22e9-4b46-b7b4-8994ddcf0b08 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051949 Oct 17 16:42:30.200389 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3664/7602] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:42:30 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:42:30.873214 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8f320872-78aa-4dbe-bda2-8757c323d6eb req-799a0d33-09e0-48c2-8345-995ca133f107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51d8d62-cf85-4f79-856d-22a74f29bc64", "tag": "74212fe7-f917-4fc2-9c25-494ad8ca5252"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:42:30.884494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f320872-78aa-4dbe-bda2-8757c323d6eb req-799a0d33-09e0-48c2-8345-995ca133f107 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:30.884997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f320872-78aa-4dbe-bda2-8757c323d6eb req-799a0d33-09e0-48c2-8345-995ca133f107 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:30.885539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8f320872-78aa-4dbe-bda2-8757c323d6eb req-799a0d33-09e0-48c2-8345-995ca133f107 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:30.901136 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8f320872-78aa-4dbe-bda2-8757c323d6eb req-799a0d33-09e0-48c2-8345-995ca133f107 service nova] Creating event network-changed:74212fe7-f917-4fc2-9c25-494ad8ca5252 for instance e51d8d62-cf85-4f79-856d-22a74f29bc64 on n-h2-854441-12 Oct 17 16:42:30.906326 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8f320872-78aa-4dbe-bda2-8757c323d6eb req-799a0d33-09e0-48c2-8345-995ca133f107 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037456 Oct 17 16:42:30.907210 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3939/7603] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:42:31.213735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-183060e9-4b25-41c9-b78b-ced7a6a307c6 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:31.216661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-183060e9-4b25-41c9-b78b-ced7a6a307c6 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:31.224086 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-183060e9-4b25-41c9-b78b-ced7a6a307c6 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:31.224758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-183060e9-4b25-41c9-b78b-ced7a6a307c6 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:31.225219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-183060e9-4b25-41c9-b78b-ced7a6a307c6 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:31.226105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-183060e9-4b25-41c9-b78b-ced7a6a307c6 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:31.226603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-183060e9-4b25-41c9-b78b-ced7a6a307c6 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:31.227059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-183060e9-4b25-41c9-b78b-ced7a6a307c6 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:31.258887 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-183060e9-4b25-41c9-b78b-ced7a6a307c6 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049564 Oct 17 16:42:31.259295 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3665/7604] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:42:31 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:42:32.279675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09a4158e-29ca-4af0-a612-055145478059 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:32.283033 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09a4158e-29ca-4af0-a612-055145478059 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:32.291264 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09a4158e-29ca-4af0-a612-055145478059 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:32.291840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09a4158e-29ca-4af0-a612-055145478059 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:32.292288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09a4158e-29ca-4af0-a612-055145478059 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:32.293029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09a4158e-29ca-4af0-a612-055145478059 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:32.293501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09a4158e-29ca-4af0-a612-055145478059 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:32.293942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09a4158e-29ca-4af0-a612-055145478059 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:32.328739 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09a4158e-29ca-4af0-a612-055145478059 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059780 Oct 17 16:42:32.329350 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3940/7605] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:42:32 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:42:33.343242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c253eec4-b034-4bf9-9c22-fcb844381642 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:33.345387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c253eec4-b034-4bf9-9c22-fcb844381642 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:33.353457 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c253eec4-b034-4bf9-9c22-fcb844381642 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:33.354091 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c253eec4-b034-4bf9-9c22-fcb844381642 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:33.354566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c253eec4-b034-4bf9-9c22-fcb844381642 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:33.355291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c253eec4-b034-4bf9-9c22-fcb844381642 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:33.355756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c253eec4-b034-4bf9-9c22-fcb844381642 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:33.356195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c253eec4-b034-4bf9-9c22-fcb844381642 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:33.387832 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c253eec4-b034-4bf9-9c22-fcb844381642 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048980 Oct 17 16:42:33.388390 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3666/7606] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:42:33 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:42:34.401392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-09d015a7-9237-43a7-98db-1e9121969d3f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:34.403857 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-09d015a7-9237-43a7-98db-1e9121969d3f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:34.411138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09d015a7-9237-43a7-98db-1e9121969d3f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:34.412231 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09d015a7-9237-43a7-98db-1e9121969d3f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:34.413653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09d015a7-9237-43a7-98db-1e9121969d3f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:34.414374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09d015a7-9237-43a7-98db-1e9121969d3f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:34.414850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09d015a7-9237-43a7-98db-1e9121969d3f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:34.415268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-09d015a7-9237-43a7-98db-1e9121969d3f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:34.450966 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-09d015a7-9237-43a7-98db-1e9121969d3f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054030 Oct 17 16:42:34.451709 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3941/7607] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:42:34 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:42:35.464947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a3efb14-9f89-4957-a81e-c0b2aa05f51d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:35.467385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a3efb14-9f89-4957-a81e-c0b2aa05f51d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:35.475570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3efb14-9f89-4957-a81e-c0b2aa05f51d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:35.476107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3efb14-9f89-4957-a81e-c0b2aa05f51d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:35.476565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3efb14-9f89-4957-a81e-c0b2aa05f51d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:35.477302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3efb14-9f89-4957-a81e-c0b2aa05f51d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:35.477779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3efb14-9f89-4957-a81e-c0b2aa05f51d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:35.478240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a3efb14-9f89-4957-a81e-c0b2aa05f51d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:35.510557 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a3efb14-9f89-4957-a81e-c0b2aa05f51d tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049838 Oct 17 16:42:35.511169 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3667/7608] 10.222.0.87 () {58 vars in 1302 bytes} [Mon Oct 17 16:42:35 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 16:42:35.525941 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:35.526649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:35.535226 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:35.535799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:35.536374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:35.537093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:35.537764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:35.538308 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:35.622756 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] HTTP exception thrown: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 is not attached to volume eabd8fb6-a566-4137-97a4-aa5698aa698a Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Request method failure captured: Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: request: DELETE /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments/eabd8fb6-a566-4137-97a4-aa5698aa698a HTTP/1.1 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYSXNqiIwqsaCBZGkErP2zhuQsqZEBKWO6OjkqiuDcVg9xM84siNpG4J0QTseq_UqjujxMg7ueQDtbYYtEeXFBHuHfWHM1rSA1K-Ku6549w695JyRR-CWu1LETgMdAeuyE-vduE0pCq2P4Enr_pVlIUVmAAVMFTZ3bjoPY6c9aUu3wE Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: e870c0e4a8454467a10712afd06d3557 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e870c0e4a8454467a10712afd06d3557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: e870c0e4a8454467a10712afd06d3557 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestMinimumBasicScenario-966891594-project Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: c0d45985ec414548b3e4a8706789e472 Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestMinimumBasicScenario-966891594-project Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 is not attached to volume eabd8fb6-a566-4137-97a4-aa5698aa698a Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'server_id': 'e51d8d62-cf85-4f79-856d-22a74f29bc64', 'id': 'eabd8fb6-a566-4137-97a4-aa5698aa698a'} Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eabd8fb6-a566-4137-97a4-aa5698aa698a. Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 is not attached to volume eabd8fb6-a566-4137-97a4-aa5698aa698a Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:42:35.624575 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:42:35.630335 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:42:35.630335 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:42:35.630335 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 is not attached to volume eabd8fb6-a566-4137-97a4-aa5698aa698a Oct 17 16:42:35.630335 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:35.630335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Returning 404 to user: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 is not attached to volume eabd8fb6-a566-4137-97a4-aa5698aa698a {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:42:35.630335 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b64dd1f7-e92a-47c6-a0bd-cd531f628a1f tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments/eabd8fb6-a566-4137-97a4-aa5698aa698a" status: 404 len: 154 microversion: 2.1 time: 0.108014 Oct 17 16:42:35.630335 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3942/7609] 10.222.0.87 () {58 vars in 1416 bytes} [Mon Oct 17 16:42:35 2022] DELETE /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64/os-volume_attachments/eabd8fb6-a566-4137-97a4-aa5698aa698a => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:42:38.896422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:38.897036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:38.905402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:38.906238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:38.907182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:38.908229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:38.908931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:38.909669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:38.941249 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:42:39.034550 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c820185-c169-4c3b-ac0b-2b041069b572 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 204 len: 0 microversion: 2.1 time: 0.141917 Oct 17 16:42:39.035191 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3668/7610] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:42:38 2022] DELETE /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:42:39.044658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:39.045525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:39.053909 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:39.054415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:39.054929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:39.055684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:39.056147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:39.056575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:39.200307 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:42:39.208892 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-da3c01c6-bee6-477e-bbef-f69bdee7f9a1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1553 microversion: 2.1 time: 0.168464 Oct 17 16:42:39.209470 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3943/7611] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:42:39 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:42:40.234177 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:40.234921 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:40.243119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:40.243736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:40.244312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:40.245170 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:40.245630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:40.246073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:40.398075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:42:40.408186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4543c7d1-f24b-4a5b-b548-9dce21ac9eb5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1553 microversion: 2.1 time: 0.178349 Oct 17 16:42:40.408805 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3669/7612] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:42:40 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:42:41.292959 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-7babb50d-7675-4cae-b6b6-f360d5790101 req-c9c96887-0ccd-4be1-9afd-2d924a88d513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51d8d62-cf85-4f79-856d-22a74f29bc64", "name": "network-vif-deleted", "tag": "74212fe7-f917-4fc2-9c25-494ad8ca5252"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:42:41.303885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7babb50d-7675-4cae-b6b6-f360d5790101 req-c9c96887-0ccd-4be1-9afd-2d924a88d513 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:41.304463 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7babb50d-7675-4cae-b6b6-f360d5790101 req-c9c96887-0ccd-4be1-9afd-2d924a88d513 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:41.304957 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-7babb50d-7675-4cae-b6b6-f360d5790101 req-c9c96887-0ccd-4be1-9afd-2d924a88d513 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:41.319218 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-7babb50d-7675-4cae-b6b6-f360d5790101 req-c9c96887-0ccd-4be1-9afd-2d924a88d513 service nova] Creating event network-vif-deleted:74212fe7-f917-4fc2-9c25-494ad8ca5252 for instance e51d8d62-cf85-4f79-856d-22a74f29bc64 on n-h2-854441-12 Oct 17 16:42:41.325283 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-7babb50d-7675-4cae-b6b6-f360d5790101 req-c9c96887-0ccd-4be1-9afd-2d924a88d513 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036514 Oct 17 16:42:41.325899 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3944/7613] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:42:41.432140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:41.432735 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:41.440407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:41.440918 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:41.441391 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:41.442125 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:41.442636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:41.443071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:41.480625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:41.481059 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:41.481520 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:41.481978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lazy-loading 'fault' on Instance uuid e51d8d62-cf85-4f79-856d-22a74f29bc64 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:42:41.523957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d45985ec414548b3e4a8706789e472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870c0e4a8454467a10712afd06d3557', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:42:41.532255 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-add347f3-0a4b-4fdc-9e37-638490cfeca5 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 200 len: 1348 microversion: 2.1 time: 0.104250 Oct 17 16:42:41.532856 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3670/7614] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:42:41 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:42:42.562879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:42.563518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] [instance: e51d8d62-cf85-4f79-856d-22a74f29bc64] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:42.572250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:42.573013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:42.573636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:42.574759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:42.575393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:42.575968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:42.592389 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] HTTP exception thrown: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 could not be found. Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Request method failure captured: Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 HTTP/1.1 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYSXNqiIwqsaCBZGkErP2zhuQsqZEBKWO6OjkqiuDcVg9xM84siNpG4J0QTseq_UqjujxMg7ueQDtbYYtEeXFBHuHfWHM1rSA1K-Ku6549w695JyRR-CWu1LETgMdAeuyE-vduE0pCq2P4Enr_pVlIUVmAAVMFTZ3bjoPY6c9aUu3wE Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: e870c0e4a8454467a10712afd06d3557 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e870c0e4a8454467a10712afd06d3557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e870c0e4a8454467a10712afd06d3557"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: e870c0e4a8454467a10712afd06d3557 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestMinimumBasicScenario-966891594 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestMinimumBasicScenario-966891594-project Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: c0d45985ec414548b3e4a8706789e472 Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestMinimumBasicScenario-966891594-project Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 could not be found. Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e51d8d62-cf85-4f79-856d-22a74f29bc64'} Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 could not be found. Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 could not be found. Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:42:42.594101 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 could not be found. Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Returning 404 to user: Instance e51d8d62-cf85-4f79-856d-22a74f29bc64 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-03b2df5b-6215-4572-828e-3de3a2e64873 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64" status: 404 len: 111 microversion: 2.1 time: 0.039290 Oct 17 16:42:42.599423 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3945/7615] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:42:42 2022] GET /compute/v2.1/servers/e51d8d62-cf85-4f79-856d-22a74f29bc64 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:42:42.604909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-72559c2f-c6f9-43a2-917b-fc0d053288e1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] Calling method '.version_select at 0x7f28bdba6ca0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:42.632021 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-72559c2f-c6f9-43a2-917b-fc0d053288e1 tempest-TestMinimumBasicScenario-966891594 tempest-TestMinimumBasicScenario-966891594-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-247215496" status: 202 len: 0 microversion: 2.1 time: 0.030650 Oct 17 16:42:42.632837 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3671/7616] 10.222.0.87 () {58 vars in 1269 bytes} [Mon Oct 17 16:42:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-247215496 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:42:52.219041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-78d706c5-19b7-4913-acba-e8cdca051054 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: .version_select at 0x7f28be098040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1000396681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbPELQ089jvzMTZE0GRNBUbq/moU1lMMBOLiZCzX9lFTwjwMUek5CJ++v1iedXCJr84gp7gq9yqrBx5s+vvgfZ0n7Mr/oMUTrDfj6xZaKbS2JvGsj1np/WBOZyaNOtGIw=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:42:52.236073 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-78d706c5-19b7-4913-acba-e8cdca051054 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:42:52.241647 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-78d706c5-19b7-4913-acba-e8cdca051054 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:42:52.270870 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-78d706c5-19b7-4913-acba-e8cdca051054 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.255293 Oct 17 16:42:52.271386 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3946/7617] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:42:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:42:58.888260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:42:58.889049 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:42:58.894026 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1952823814", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "6078abe1-befe-4ee9-ad39-85e21b14c5fe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1000396681", "security_groups": [{"name": "tempest-secgroup-smoke-489264773"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:42:59.012512 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] validate_networks() for [('6078abe1-befe-4ee9-ad39-85e21b14c5fe', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:42:59.433750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:42:59.434607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:42:59.435314 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:42:59.435895 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:42:59.441659 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:42:59.452119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:59.452916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:59.453373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:59.454330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:42:59.454856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:42:59.455329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:42:59.479873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:42:59.487743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:42:59.503005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:42:59.505839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:42:59.557981 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9b3627e4-6b37-41bc-8ac3-a01cc16dba9d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.672010 Oct 17 16:42:59.559194 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3672/7618] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:42:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:42:59.571239 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74b626c2-9e65-4f1e-9736-529a8093f4b2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:42:59.573032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-74b626c2-9e65-4f1e-9736-529a8093f4b2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:42:59.576196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:42:59.578802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:42:59.655739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-74b626c2-9e65-4f1e-9736-529a8093f4b2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:42:59.666832 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74b626c2-9e65-4f1e-9736-529a8093f4b2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1267 microversion: 2.1 time: 0.099710 Oct 17 16:42:59.683279 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3947/7619] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:42:59 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:00.693555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:00.694203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:00.704428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:00.705289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:00.705971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:00.707075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:00.707561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:00.708065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:00.782991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:00.791442 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f2e9e5dc-ed43-415b-b37b-31fad8317ef2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1319 microversion: 2.1 time: 0.103290 Oct 17 16:43:00.792138 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3673/7620] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:00 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1319 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:01.818101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:01.819306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:01.840901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:01.841813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:01.842602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:01.843869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:01.844913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:01.845860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:02.013921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:02.022366 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2f6d2afb-58bd-48f5-a5be-21327f6a3ed7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1392 microversion: 2.1 time: 0.211610 Oct 17 16:43:02.023007 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3948/7621] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:01 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:02.667683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cab9de0b-5239-4eae-8204-f3578dd65f71 req-f7d1cd83-19fd-44a1-ab4d-0f8e48931b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae11d1d8-bd9c-428f-823d-5d2509e3f638", "tag": "8a6e5bc7-239f-438f-b399-95bba7ed09c0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:02.680060 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cab9de0b-5239-4eae-8204-f3578dd65f71 req-f7d1cd83-19fd-44a1-ab4d-0f8e48931b84 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:02.680588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cab9de0b-5239-4eae-8204-f3578dd65f71 req-f7d1cd83-19fd-44a1-ab4d-0f8e48931b84 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:02.681277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cab9de0b-5239-4eae-8204-f3578dd65f71 req-f7d1cd83-19fd-44a1-ab4d-0f8e48931b84 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:02.693781 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cab9de0b-5239-4eae-8204-f3578dd65f71 req-f7d1cd83-19fd-44a1-ab4d-0f8e48931b84 service nova] Creating event network-changed:8a6e5bc7-239f-438f-b399-95bba7ed09c0 for instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 on n-h1-854441-12 Oct 17 16:43:02.699538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cab9de0b-5239-4eae-8204-f3578dd65f71 req-f7d1cd83-19fd-44a1-ab4d-0f8e48931b84 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035791 Oct 17 16:43:02.700669 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3674/7622] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:43:03.045864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:03.046838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:03.054068 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:03.054590 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:03.055031 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:03.055733 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:03.056174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:03.056596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:03.209767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:03.218165 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-af807821-d6f3-4eba-8b9f-0b0562380ae9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1392 microversion: 2.1 time: 0.176439 Oct 17 16:43:03.218811 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3949/7623] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:03 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:04.245260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:04.246533 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:04.254235 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:04.254854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:04.255354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:04.256195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:04.256991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:04.257435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:04.523330 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:04.531630 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-53e7d79d-bdf7-4370-b273-dfee43584e22 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1392 microversion: 2.1 time: 0.291607 Oct 17 16:43:04.532255 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3675/7624] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:04 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1392 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:05.565861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:05.566538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:05.573869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:05.574372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:05.574830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:05.575542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:05.576004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:05.576428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:05.720237 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:05.728645 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5c2906fa-b415-47cd-81f6-c533c1acbd17 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1392 microversion: 2.1 time: 0.166798 Oct 17 16:43:05.729192 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3950/7625] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:05 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:06.753152 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:06.754134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:06.762830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:06.763369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:06.763857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:06.764604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:06.765263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:06.765739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:06.919255 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:06.927696 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a334d883-cb0f-432c-9cda-1fced23babef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1392 microversion: 2.1 time: 0.179265 Oct 17 16:43:06.928316 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3676/7626] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:06 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:07.140928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-22c3eacc-32c6-44dd-9803-3df71ff3d339 req-dfa03edc-82ee-462a-83af-df7664700fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae11d1d8-bd9c-428f-823d-5d2509e3f638", "name": "network-vif-plugged", "status": "completed", "tag": "8a6e5bc7-239f-438f-b399-95bba7ed09c0"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:07.152363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-22c3eacc-32c6-44dd-9803-3df71ff3d339 req-dfa03edc-82ee-462a-83af-df7664700fde service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:07.152856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-22c3eacc-32c6-44dd-9803-3df71ff3d339 req-dfa03edc-82ee-462a-83af-df7664700fde service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:07.153325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-22c3eacc-32c6-44dd-9803-3df71ff3d339 req-dfa03edc-82ee-462a-83af-df7664700fde service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:07.165388 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-22c3eacc-32c6-44dd-9803-3df71ff3d339 req-dfa03edc-82ee-462a-83af-df7664700fde service nova] Creating event network-vif-plugged:8a6e5bc7-239f-438f-b399-95bba7ed09c0 for instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 on n-h1-854441-12 Oct 17 16:43:07.170936 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-22c3eacc-32c6-44dd-9803-3df71ff3d339 req-dfa03edc-82ee-462a-83af-df7664700fde service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033864 Oct 17 16:43:07.171846 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3951/7627] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:43:07.952531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:07.953154 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:07.960872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:07.961386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:07.961845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:07.962604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:07.963083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:07.963529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:08.114847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:08.125840 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2299e28e-ddb9-411f-899b-70f640a31352 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1392 microversion: 2.1 time: 0.177320 Oct 17 16:43:08.126411 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3677/7628] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:07 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:09.151017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:09.151746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:09.159233 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:09.159820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:09.160266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:09.160992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:09.161499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:09.161929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:09.313991 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:09.322389 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1523335b-2d19-4a29-989f-fa7539c8775f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1563 microversion: 2.1 time: 0.176669 Oct 17 16:43:09.323032 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3952/7629] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:09 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:09.344989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:09.345619 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:09.353199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:09.353715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:09.354166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:09.354925 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:09.355397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:09.355894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:09.466470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:43:09.492342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:09.494856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:43:09.502415 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c37ba57-2c25-4494-b432-abaf6c785b54 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1563 microversion: 2.1 time: 0.161311 Oct 17 16:43:09.503069 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3678/7630] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:09 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:11.548456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-0d71325b-8c46-46f9-9147-5a6fe794b5a8 req-eedf1064-36fe-46bd-b140-435ea9f4f5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae11d1d8-bd9c-428f-823d-5d2509e3f638", "tag": "8a6e5bc7-239f-438f-b399-95bba7ed09c0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:11.552934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:11.553542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:11.555654 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:43:11.567477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:11.568380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:11.568380 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:11.569103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:11.569546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:11.569964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:11.575118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0d71325b-8c46-46f9-9147-5a6fe794b5a8 req-eedf1064-36fe-46bd-b140-435ea9f4f5a4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:11.576632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0d71325b-8c46-46f9-9147-5a6fe794b5a8 req-eedf1064-36fe-46bd-b140-435ea9f4f5a4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:11.576632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-0d71325b-8c46-46f9-9147-5a6fe794b5a8 req-eedf1064-36fe-46bd-b140-435ea9f4f5a4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:11.591741 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-0d71325b-8c46-46f9-9147-5a6fe794b5a8 req-eedf1064-36fe-46bd-b140-435ea9f4f5a4 service nova] Creating event network-changed:8a6e5bc7-239f-438f-b399-95bba7ed09c0 for instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 on n-h1-854441-12 Oct 17 16:43:11.597183 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-0d71325b-8c46-46f9-9147-5a6fe794b5a8 req-eedf1064-36fe-46bd-b140-435ea9f4f5a4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052111 Oct 17 16:43:11.598268 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3679/7631] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:43:11.739827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:11.748855 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-181f1a4c-1a76-4e49-acd4-a47a4f523192 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1563 microversion: 2.1 time: 0.207665 Oct 17 16:43:11.749453 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3953/7632] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:11 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:33.088897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:43:33.089683 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=36 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:43:33.094304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-851e73a9-0929-4c56-b211-e74dd12c20a2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:33.096917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-851e73a9-0929-4c56-b211-e74dd12c20a2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:33.105331 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-851e73a9-0929-4c56-b211-e74dd12c20a2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:33.105888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-851e73a9-0929-4c56-b211-e74dd12c20a2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:33.106399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-851e73a9-0929-4c56-b211-e74dd12c20a2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:33.107244 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-851e73a9-0929-4c56-b211-e74dd12c20a2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:33.107758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-851e73a9-0929-4c56-b211-e74dd12c20a2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:33.108259 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-851e73a9-0929-4c56-b211-e74dd12c20a2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:33.166441 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-851e73a9-0929-4c56-b211-e74dd12c20a2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action" status: 200 len: 24568 microversion: 2.1 time: 0.079418 Oct 17 16:43:33.167161 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3680/7633] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:43:33 2022] POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action => generated 24568 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:43:44.231559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-363da8d2-50e7-45ba-a991-6193e7d79566 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:44.232788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-363da8d2-50e7-45ba-a991-6193e7d79566 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:44.235152 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=15 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:43:44.235852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:43:44.241783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-363da8d2-50e7-45ba-a991-6193e7d79566 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:44.242279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-363da8d2-50e7-45ba-a991-6193e7d79566 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:44.242763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-363da8d2-50e7-45ba-a991-6193e7d79566 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:44.243483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-363da8d2-50e7-45ba-a991-6193e7d79566 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:44.243945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-363da8d2-50e7-45ba-a991-6193e7d79566 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:44.244374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-363da8d2-50e7-45ba-a991-6193e7d79566 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:44.334387 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-363da8d2-50e7-45ba-a991-6193e7d79566 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action" status: 202 len: 0 microversion: 2.1 time: 0.106892 Oct 17 16:43:44.338588 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3954/7634] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:43:44 2022] POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:43:44.346066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:44.347427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:44.351363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:43:44.352238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:43:44.360859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:44.361532 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:44.362156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:44.362982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:44.363607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:44.364378 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:44.519996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:44.528838 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b03e26b0-e995-4256-b4d7-10f9acba9a13 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1687 microversion: 2.1 time: 0.188118 Oct 17 16:43:44.529469 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3681/7635] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:44 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:45.558844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:45.559465 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:45.567289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:45.567972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:45.568714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:45.569839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:45.570607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:45.571250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:45.709782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:45.720337 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e973ce3-6cc7-4494-869e-dad6ee969644 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1667 microversion: 2.1 time: 0.170037 Oct 17 16:43:45.721127 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3955/7636] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:45 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:46.818293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-20ccf059-65b9-4bb5-acea-6932e34b263c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:46.821172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-20ccf059-65b9-4bb5-acea-6932e34b263c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:46.830119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20ccf059-65b9-4bb5-acea-6932e34b263c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:46.830665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20ccf059-65b9-4bb5-acea-6932e34b263c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:46.831199 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20ccf059-65b9-4bb5-acea-6932e34b263c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:46.831899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20ccf059-65b9-4bb5-acea-6932e34b263c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:46.832465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20ccf059-65b9-4bb5-acea-6932e34b263c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:46.832797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-20ccf059-65b9-4bb5-acea-6932e34b263c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:46.889979 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-20ccf059-65b9-4bb5-acea-6932e34b263c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action" status: 200 len: 32640 microversion: 2.1 time: 0.077837 Oct 17 16:43:46.890598 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3682/7637] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:43:46 2022] POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action => generated 32640 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:43:46.902753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9bded003-fc85-4bb0-ae9d-fee96523c22d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:46.903425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9bded003-fc85-4bb0-ae9d-fee96523c22d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:46.910440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bded003-fc85-4bb0-ae9d-fee96523c22d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:46.910947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bded003-fc85-4bb0-ae9d-fee96523c22d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:46.911378 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bded003-fc85-4bb0-ae9d-fee96523c22d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:46.912067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bded003-fc85-4bb0-ae9d-fee96523c22d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:46.912514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bded003-fc85-4bb0-ae9d-fee96523c22d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:46.912934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9bded003-fc85-4bb0-ae9d-fee96523c22d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:46.990458 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9bded003-fc85-4bb0-ae9d-fee96523c22d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action" status: 202 len: 0 microversion: 2.1 time: 0.091551 Oct 17 16:43:46.991206 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3956/7638] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:43:46 2022] POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:43:47.003618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:47.005023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:47.014525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:47.015129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:47.015591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:47.016367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:47.016835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:47.017248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:47.167926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:47.177120 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-55274f63-a42e-48f4-b2ae-a9df84d5bda2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1674 microversion: 2.1 time: 0.178596 Oct 17 16:43:47.177738 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3683/7639] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:46 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:48.202802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:48.203454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:48.210690 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:48.211182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:48.211645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:48.212535 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:48.212986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:48.213405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:48.354661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:48.367531 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d62c6d60-9b1d-4a2a-8f63-22010d29ca9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1682 microversion: 2.1 time: 0.169560 Oct 17 16:43:48.368439 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3957/7640] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:48 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:48.471104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80ff2716-2d72-4411-9715-7e4fbb3444a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:48.473310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-80ff2716-2d72-4411-9715-7e4fbb3444a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:48.481563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ff2716-2d72-4411-9715-7e4fbb3444a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:48.482074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ff2716-2d72-4411-9715-7e4fbb3444a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:48.482563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ff2716-2d72-4411-9715-7e4fbb3444a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:48.483302 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ff2716-2d72-4411-9715-7e4fbb3444a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:48.483770 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ff2716-2d72-4411-9715-7e4fbb3444a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:48.484214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80ff2716-2d72-4411-9715-7e4fbb3444a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:48.538256 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80ff2716-2d72-4411-9715-7e4fbb3444a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action" status: 200 len: 38368 microversion: 2.1 time: 0.070627 Oct 17 16:43:48.539227 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3684/7641] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:43:48 2022] POST /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638/action => generated 38368 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:43:49.635630 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:49.637032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:49.640303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-04920b90-3a37-452a-8d86-3c993587c0e7 req-68322a17-dbd2-462d-8c92-94e0dc86a8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae11d1d8-bd9c-428f-823d-5d2509e3f638", "tag": "8a6e5bc7-239f-438f-b399-95bba7ed09c0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:49.646787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:49.648039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:49.648039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:49.648722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:49.649216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:49.649699 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:49.653335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-04920b90-3a37-452a-8d86-3c993587c0e7 req-68322a17-dbd2-462d-8c92-94e0dc86a8e1 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:49.654141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-04920b90-3a37-452a-8d86-3c993587c0e7 req-68322a17-dbd2-462d-8c92-94e0dc86a8e1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:49.654642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-04920b90-3a37-452a-8d86-3c993587c0e7 req-68322a17-dbd2-462d-8c92-94e0dc86a8e1 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:49.667838 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-04920b90-3a37-452a-8d86-3c993587c0e7 req-68322a17-dbd2-462d-8c92-94e0dc86a8e1 service nova] Creating event network-changed:8a6e5bc7-239f-438f-b399-95bba7ed09c0 for instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 on n-h1-854441-12 Oct 17 16:43:49.674021 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-04920b90-3a37-452a-8d86-3c993587c0e7 req-68322a17-dbd2-462d-8c92-94e0dc86a8e1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039327 Oct 17 16:43:49.674974 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3685/7642] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:43:49.692020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:43:49.782575 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-49767375-acf7-4e43-91dd-ce86543b3756 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 204 len: 0 microversion: 2.1 time: 0.150960 Oct 17 16:43:49.784817 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3958/7643] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:43:49 2022] DELETE /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:43:49.795213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:49.797034 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:49.807257 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:49.807942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:49.808407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:49.809171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:49.809660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:49.810102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:49.963645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:49.972014 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-13ec78fe-3aea-40f1-9329-cab8bcbd360d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1688 microversion: 2.1 time: 0.182102 Oct 17 16:43:49.972711 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3686/7644] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:49 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:50.997709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:50.998452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:51.006383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:51.007060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:51.007365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:51.008078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:51.008542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:51.009025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:51.159946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:51.171276 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4701a665-615d-40a6-8307-c4f6447b3363 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1688 microversion: 2.1 time: 0.178012 Oct 17 16:43:51.171924 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3959/7645] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:50 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:51.934549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-90481c89-c138-41a9-bc1a-f0744bb34312 req-a44c49f9-0988-44df-ad95-6ee55c3fa635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae11d1d8-bd9c-428f-823d-5d2509e3f638", "name": "network-vif-deleted", "tag": "8a6e5bc7-239f-438f-b399-95bba7ed09c0"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:51.950267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-90481c89-c138-41a9-bc1a-f0744bb34312 req-a44c49f9-0988-44df-ad95-6ee55c3fa635 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:51.950809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-90481c89-c138-41a9-bc1a-f0744bb34312 req-a44c49f9-0988-44df-ad95-6ee55c3fa635 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:51.951499 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-90481c89-c138-41a9-bc1a-f0744bb34312 req-a44c49f9-0988-44df-ad95-6ee55c3fa635 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:51.964983 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-90481c89-c138-41a9-bc1a-f0744bb34312 req-a44c49f9-0988-44df-ad95-6ee55c3fa635 service nova] Creating event network-vif-deleted:8a6e5bc7-239f-438f-b399-95bba7ed09c0 for instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 on n-h1-854441-12 Oct 17 16:43:51.971755 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-90481c89-c138-41a9-bc1a-f0744bb34312 req-a44c49f9-0988-44df-ad95-6ee55c3fa635 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041086 Oct 17 16:43:51.972561 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3687/7646] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:43:52.196204 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:52.196843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:52.204482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:52.204963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:52.206028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:52.206940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:52.207288 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:52.207744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:52.246042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:52.246555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:52.246998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:52.247464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lazy-loading 'fault' on Instance uuid ae11d1d8-bd9c-428f-823d-5d2509e3f638 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:43:52.293071 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:43:52.301792 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7d28b148-224f-44c1-ad66-059033f499f6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 200 len: 1357 microversion: 2.1 time: 0.109671 Oct 17 16:43:52.302406 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3960/7647] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:52 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 1357 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:43:53.326892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:53.327624 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: ae11d1d8-bd9c-428f-823d-5d2509e3f638] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:43:53.337801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:53.338317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:53.338812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:53.339542 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:43:53.340019 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:43:53.340467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:43:53.355203 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] HTTP exception thrown: Instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 could not be found. Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Request method failure captured: Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 HTTP/1.1 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYYLuOLLXIuQTkzyWw0LnoZrEZX3TRZJYNUUWQX-PZQpk-DWm4Gi96GxRyZvpzhFJYE24RCuB9E9lEW8pl0DrmmLHVemSNFojHFYHEw3cfQ4wOYbg-IHQIb6AuTQwGf9aR7mE8N8ddDz3bvtUYh6xb5jAN9H5eb4rEy8FoQEK3QvJP0 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ead73cf4fa65485b8a4878642c2c3aed Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 could not be found. Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'ae11d1d8-bd9c-428f-823d-5d2509e3f638'} Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 could not be found. Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 could not be found. Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:43:53.356899 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 could not be found. Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Returning 404 to user: Instance ae11d1d8-bd9c-428f-823d-5d2509e3f638 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dd09ce14-aae1-4425-a466-4d108607018b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638" status: 404 len: 111 microversion: 2.1 time: 0.035909 Oct 17 16:43:53.364400 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3688/7648] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:43:53 2022] GET /compute/v2.1/servers/ae11d1d8-bd9c-428f-823d-5d2509e3f638 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:43:57.073134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d04a6123-5ffa-4caa-8ad0-2957356b985d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '.version_select at 0x7f28bd862ee0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:43:57.103165 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d04a6123-5ffa-4caa-8ad0-2957356b985d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1000396681" status: 202 len: 0 microversion: 2.1 time: 0.038804 Oct 17 16:43:57.103814 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3961/7649] 10.222.0.87 () {58 vars in 1284 bytes} [Mon Oct 17 16:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1000396681 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:43:57.133760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ab20c7c-ad4e-4022-a794-4b2ae94eacbc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: .version_select at 0x7f28bdb711f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2114801171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwk1QRhgugSTR4yEiJGclc2kirVdnRKtWYLePnypEN8cHM4uOMfTKwy7+Y4MkL63rsL76BjPtB8Drb/OyEjjeKIdouPTjdslk49vxQr4tcTEHumtL/ywlefGpQl/KOnXA=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:43:57.154623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3ab20c7c-ad4e-4022-a794-4b2ae94eacbc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:43:57.161538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-3ab20c7c-ad4e-4022-a794-4b2ae94eacbc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:43:57.187272 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ab20c7c-ad4e-4022-a794-4b2ae94eacbc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057741 Oct 17 16:43:57.188335 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3689/7650] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:43:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:44:03.527945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:03.532302 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-273136568", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "6c9b92fe-6b14-41f4-98c8-0908f0b306ea"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2114801171", "security_groups": [{"name": "tempest-secgroup-smoke-1049302208"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:44:03.663109 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] validate_networks() for [('6c9b92fe-6b14-41f4-98c8-0908f0b306ea', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:44:04.326747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:44:04.327514 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:44:04.327999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:44:04.328431 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:44:04.331964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:44:04.342340 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:04.343224 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:04.343673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:04.344450 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:04.344914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:04.345345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:04.368394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:44:04.374546 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:44:04.389819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:44:04.392292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:44:04.441534 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [21803a1b-e1a4-4b0e-800f-a5d69ae60f09] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:44:05.449625 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [21803a1b-e1a4-4b0e-800f-a5d69ae60f09] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 41994. Oct 17 16:44:05.454165 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9445ae61-bd73-4dfa-91b8-7fb7f132ff55 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.928274 Oct 17 16:44:05.455002 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3962/7651] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:44:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:44:05.469169 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=32 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:05.477862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-116b32c5-1601-44b9-abc8-bafe18e3601e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:05.479282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-116b32c5-1601-44b9-abc8-bafe18e3601e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:05.582411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-116b32c5-1601-44b9-abc8-bafe18e3601e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:05.591370 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-116b32c5-1601-44b9-abc8-bafe18e3601e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1266 microversion: 2.1 time: 0.125626 Oct 17 16:44:05.591981 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3690/7652] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:05 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:06.643569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:06.644897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:06.662343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:06.663379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:06.664452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:06.666151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:06.667345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:06.668420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:06.819150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:06.845222 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f879ed4a-ef6a-4d7d-aded-67d7647d3f73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1326 microversion: 2.1 time: 0.222749 Oct 17 16:44:06.855905 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3963/7653] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:06 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1326 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:44:07.871709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:07.872588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:07.886343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:07.887190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:07.887649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:07.888403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:07.888889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:07.889326 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:08.050342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:08.059690 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a7fcd1bd-537c-4a22-bd41-4d7545c74104 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1392 microversion: 2.1 time: 0.192926 Oct 17 16:44:08.060522 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3691/7654] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:07 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:08.534451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6874122e-5597-4149-977b-b40821f4736c req-ca482e87-1e8a-43a4-83e2-e99905a0f0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e65a83-f808-4752-9f4c-13d61ef24168", "tag": "e557ab16-c14b-4bb8-980f-a33d025b0568"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:44:08.549206 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6874122e-5597-4149-977b-b40821f4736c req-ca482e87-1e8a-43a4-83e2-e99905a0f0e5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:08.550360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6874122e-5597-4149-977b-b40821f4736c req-ca482e87-1e8a-43a4-83e2-e99905a0f0e5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:08.550830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6874122e-5597-4149-977b-b40821f4736c req-ca482e87-1e8a-43a4-83e2-e99905a0f0e5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:08.569045 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6874122e-5597-4149-977b-b40821f4736c req-ca482e87-1e8a-43a4-83e2-e99905a0f0e5 service nova] Creating event network-changed:e557ab16-c14b-4bb8-980f-a33d025b0568 for instance 32e65a83-f808-4752-9f4c-13d61ef24168 on n-h1-854441-12 Oct 17 16:44:08.574782 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6874122e-5597-4149-977b-b40821f4736c req-ca482e87-1e8a-43a4-83e2-e99905a0f0e5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044165 Oct 17 16:44:08.575653 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3964/7655] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:44:09.083046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:09.083694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:09.091826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:09.092364 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:09.092819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:09.093567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:09.094046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:09.094526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:09.262445 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:09.271149 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3dce5270-70ba-4709-a49e-28103995ad73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1392 microversion: 2.1 time: 0.192127 Oct 17 16:44:09.271664 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3692/7656] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:09 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:10.295584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:10.296283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:10.303146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:10.303649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:10.304096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:10.304809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:10.305265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:10.305700 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:10.530238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:10.538867 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b94ee7b5-5e6c-46e1-b192-8998e1239558 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1392 microversion: 2.1 time: 0.248719 Oct 17 16:44:10.539474 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3965/7657] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:10 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1392 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:11.561954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:11.562593 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:11.570237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:11.570782 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:11.571216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:11.571966 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:11.572446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:11.572889 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:11.719046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:11.727351 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c82f33bb-5271-4873-b560-8ed29f745d83 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1392 microversion: 2.1 time: 0.169286 Oct 17 16:44:11.727980 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3693/7658] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:11 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:44:12.750885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:12.751502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:12.759838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:12.760328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:12.760821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:12.761526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:12.761980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:12.762407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:12.901810 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:12.910160 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9c9f4b12-5ca7-40c8-b940-b887238733c4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1392 microversion: 2.1 time: 0.163351 Oct 17 16:44:12.910813 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3966/7659] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:12 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:13.354285 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a16994d8-6205-4ac1-8494-72def016902e req-3292d1c4-cf71-453c-b1a5-b688d9debf92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e65a83-f808-4752-9f4c-13d61ef24168", "name": "network-vif-plugged", "status": "completed", "tag": "e557ab16-c14b-4bb8-980f-a33d025b0568"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:44:13.368085 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a16994d8-6205-4ac1-8494-72def016902e req-3292d1c4-cf71-453c-b1a5-b688d9debf92 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:13.368759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a16994d8-6205-4ac1-8494-72def016902e req-3292d1c4-cf71-453c-b1a5-b688d9debf92 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:13.369764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a16994d8-6205-4ac1-8494-72def016902e req-3292d1c4-cf71-453c-b1a5-b688d9debf92 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:13.386018 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a16994d8-6205-4ac1-8494-72def016902e req-3292d1c4-cf71-453c-b1a5-b688d9debf92 service nova] Creating event network-vif-plugged:e557ab16-c14b-4bb8-980f-a33d025b0568 for instance 32e65a83-f808-4752-9f4c-13d61ef24168 on n-h1-854441-12 Oct 17 16:44:13.392175 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a16994d8-6205-4ac1-8494-72def016902e req-3292d1c4-cf71-453c-b1a5-b688d9debf92 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042267 Oct 17 16:44:13.393045 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3694/7660] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:44:13.941806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:13.942407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:13.949867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:13.950348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:13.950812 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:13.951499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:13.951943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:13.952363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:14.092480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:14.100736 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5b30ce12-a2a7-43b8-bd35-ff193fdff786 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1392 microversion: 2.1 time: 0.163025 Oct 17 16:44:14.101360 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3967/7661] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:13 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:15.126521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:15.127210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:15.129610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:15.135787 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:15.136295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:15.136746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:15.137460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:15.137948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:15.138833 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:15.291422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:15.306013 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8f2a336-155b-4952-bcee-8db775bd588a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1564 microversion: 2.1 time: 0.184630 Oct 17 16:44:15.306664 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3695/7662] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:15 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:15.330579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:15.331203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:15.333552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:15.334286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:15.335519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:15.342280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:15.342799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:15.343249 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:15.343951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:15.344409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:15.344836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:15.495628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:15.507861 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35b88803-6343-41f9-b95a-83af6eacfe39 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1564 microversion: 2.1 time: 0.180918 Oct 17 16:44:15.508721 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3968/7663] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:15 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:17.189097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:17.189845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:17.190737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-05a87c55-ac74-418b-a60d-c77d9016095c req-21436d01-28ad-445b-b388-a7f21f050aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e65a83-f808-4752-9f4c-13d61ef24168", "tag": "e557ab16-c14b-4bb8-980f-a33d025b0568"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:44:17.192171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:17.199660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:17.200166 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:17.200937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:17.205195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:17.205362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-05a87c55-ac74-418b-a60d-c77d9016095c req-21436d01-28ad-445b-b388-a7f21f050aa0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:17.205538 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:17.205689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-05a87c55-ac74-418b-a60d-c77d9016095c req-21436d01-28ad-445b-b388-a7f21f050aa0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:17.205853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:17.206012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-05a87c55-ac74-418b-a60d-c77d9016095c req-21436d01-28ad-445b-b388-a7f21f050aa0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:17.215895 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-05a87c55-ac74-418b-a60d-c77d9016095c req-21436d01-28ad-445b-b388-a7f21f050aa0 service nova] Creating event network-changed:e557ab16-c14b-4bb8-980f-a33d025b0568 for instance 32e65a83-f808-4752-9f4c-13d61ef24168 on n-h1-854441-12 Oct 17 16:44:17.221245 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-05a87c55-ac74-418b-a60d-c77d9016095c req-21436d01-28ad-445b-b388-a7f21f050aa0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034495 Oct 17 16:44:17.221872 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3969/7664] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:44:17.368897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:17.379096 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7bfccea7-29d4-48ea-9d7b-34b02f978b65 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1564 microversion: 2.1 time: 0.193835 Oct 17 16:44:17.379992 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3696/7665] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:17 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1564 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:38.648522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:38.649391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:38.654720 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e407d1bb-4088-4c98-a572-7f8e9b916021 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:44:38.657359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-e407d1bb-4088-4c98-a572-7f8e9b916021 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:38.665789 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e407d1bb-4088-4c98-a572-7f8e9b916021 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:38.666366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e407d1bb-4088-4c98-a572-7f8e9b916021 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:38.667160 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e407d1bb-4088-4c98-a572-7f8e9b916021 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:38.667792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e407d1bb-4088-4c98-a572-7f8e9b916021 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:38.668303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e407d1bb-4088-4c98-a572-7f8e9b916021 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:38.668821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-e407d1bb-4088-4c98-a572-7f8e9b916021 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:38.724808 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e407d1bb-4088-4c98-a572-7f8e9b916021 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168/action" status: 200 len: 24562 microversion: 2.1 time: 0.078619 Oct 17 16:44:38.725759 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3970/7666] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:44:38 2022] POST /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168/action => generated 24562 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:44:49.838850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6af92e36-8dbe-498f-bd93-7bddbc13b5df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:44:49.840981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6af92e36-8dbe-498f-bd93-7bddbc13b5df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:49.843191 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:49.843905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=32 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:49.850280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af92e36-8dbe-498f-bd93-7bddbc13b5df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:49.850804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af92e36-8dbe-498f-bd93-7bddbc13b5df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:49.851256 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af92e36-8dbe-498f-bd93-7bddbc13b5df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:49.851962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af92e36-8dbe-498f-bd93-7bddbc13b5df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:49.852419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af92e36-8dbe-498f-bd93-7bddbc13b5df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:49.852851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6af92e36-8dbe-498f-bd93-7bddbc13b5df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:49.933404 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6af92e36-8dbe-498f-bd93-7bddbc13b5df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168/action" status: 202 len: 0 microversion: 2.1 time: 0.098673 Oct 17 16:44:49.934135 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3697/7667] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:44:49 2022] POST /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:44:49.943121 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:49.944593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:49.946796 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:49.947743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:44:49.953512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:49.954057 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:49.954603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:49.955245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:49.955705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:49.956147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:50.181101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:50.190466 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0cf0d1cf-a098-4f98-9652-2963ee5d5fc1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1675 microversion: 2.1 time: 0.251644 Oct 17 16:44:50.191223 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3971/7668] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:49 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:51.217809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:51.218709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:51.225854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:51.226357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:51.226823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:51.227560 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:51.228030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:51.228469 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:51.368941 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:51.377199 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-fd977d61-7716-43b1-90c9-f466a9e6cdf9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.164772 Oct 17 16:44:51.377762 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3698/7669] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:51 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:52.402858 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:52.403525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:52.412328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:52.412818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:52.413254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:52.413939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:52.414400 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:52.414917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:52.551285 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:52.559344 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a901599a-4598-43c6-8f2c-d39257ba9d14 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.160782 Oct 17 16:44:52.559898 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3972/7670] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:52 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:53.583348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:53.583903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:53.591988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:53.592513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:53.592983 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:53.593736 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:53.594210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:53.594692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:53.736289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:53.744733 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-cfcc76cd-1328-4a6b-887e-49eacb8a8687 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.165486 Oct 17 16:44:53.745341 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3699/7671] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:53 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:54.769024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:54.769650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:54.777424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:54.778443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:54.779149 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:54.780168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:54.780774 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:54.781246 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:54.922664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:54.931183 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4fdcd4de-ff77-4dc8-8b3f-02c32e53d39e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.166153 Oct 17 16:44:54.931762 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3973/7672] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:54 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:55.956606 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:55.957710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:55.965912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:55.966465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:55.966967 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:55.967686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:55.968161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:55.968594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:56.122805 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:56.131525 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-de134905-e279-4ccd-a18b-6e92b524d191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.180331 Oct 17 16:44:56.132142 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3700/7673] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:55 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:57.157187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:57.157843 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:57.164980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:57.165462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:57.165897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:57.166691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:57.167138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:57.167568 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:57.315924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:57.327228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ecb84d84-b4d0-411e-b749-f25984160f6f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.173841 Oct 17 16:44:57.327867 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3974/7674] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:57 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:58.356017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:58.356635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:58.363755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:58.364236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:58.364712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:58.365421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:58.365885 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:58.366325 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:58.523962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:58.537234 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-61bf6d1f-f808-42b3-9bb8-024b6bf79f5b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.185821 Oct 17 16:44:58.537977 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3701/7675] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:58 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:44:59.563170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:44:59.564009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:44:59.574208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:59.574835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:59.575360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:59.576175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:44:59.576708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:44:59.577201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:44:59.723495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:44:59.732006 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-939170b5-d42a-406b-b633-f24013f99381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.173041 Oct 17 16:44:59.732598 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3975/7676] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:44:59 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:00.759308 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:00.759929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:00.776496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:00.777342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:00.777803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:00.778544 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:00.779521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:00.779521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:00.924338 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:00.934838 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-525343e1-68f0-46c0-ab25-ee331be1c86d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.182200 Oct 17 16:45:00.935462 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3702/7677] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:00 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:01.961370 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:01.962270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:01.974290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:01.975101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:01.975750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:01.976898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:01.977636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:01.978360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:02.130137 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:02.138360 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7da8b48f-5b1c-4b8b-9c27-fc1aeba535a1 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.183562 Oct 17 16:45:02.138983 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3976/7678] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:01 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:03.180434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:03.181083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:03.188459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:03.188962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:03.189970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:03.190710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:03.191202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:03.191636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:03.337460 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:03.345473 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b1d46312-dc61-48af-86f0-c740229acbd9 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.170140 Oct 17 16:45:03.346074 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3703/7679] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:03 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:04.369406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:04.369969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:04.377436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:04.377934 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:04.378376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:04.379126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:04.379958 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:04.380389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:04.527377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:04.535541 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f27be2e3-17c1-4083-99dc-64d64febf436 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.170343 Oct 17 16:45:04.536168 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3977/7680] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:04 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:05.559853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:05.560472 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:05.567995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:05.568500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:05.568940 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:05.569650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:05.570102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:05.570590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:05.713589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:05.722749 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-44abeedf-5178-49ee-a3e0-650e505b8285 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1680 microversion: 2.1 time: 0.167362 Oct 17 16:45:05.723402 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3704/7681] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:05 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:06.748761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:06.750992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:06.758234 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:06.758777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:06.759225 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:06.759968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:06.761104 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:06.761523 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:06.898297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:06.906741 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2e70975a-b289-4e41-8a75-9030dcbc7659 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1683 microversion: 2.1 time: 0.163660 Oct 17 16:45:06.907341 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3978/7682] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:06 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:31.110667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84930732-16e6-421a-81e5-3cf9154f7501 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:45:31.112840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-84930732-16e6-421a-81e5-3cf9154f7501 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:31.116036 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=16 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:45:31.116764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:45:31.124465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84930732-16e6-421a-81e5-3cf9154f7501 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:31.124994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84930732-16e6-421a-81e5-3cf9154f7501 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:31.125438 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84930732-16e6-421a-81e5-3cf9154f7501 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:31.126161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84930732-16e6-421a-81e5-3cf9154f7501 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:31.126701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84930732-16e6-421a-81e5-3cf9154f7501 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:31.127145 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84930732-16e6-421a-81e5-3cf9154f7501 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:31.190289 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-84930732-16e6-421a-81e5-3cf9154f7501 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168/action" status: 200 len: 68835 microversion: 2.1 time: 0.083574 Oct 17 16:45:31.191020 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3705/7683] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:45:31 2022] POST /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168/action => generated 68835 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:45:38.715604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:38.716365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:38.717773 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a562429c-c8cb-41c2-928d-3920067faae6 req-258df3f1-e57c-436b-8120-84894babbf23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e65a83-f808-4752-9f4c-13d61ef24168", "tag": "e557ab16-c14b-4bb8-980f-a33d025b0568"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:45:38.720056 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=16 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:45:38.720759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=48 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:45:38.725513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:38.726386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:38.727439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:38.728168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:38.729336 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:38.729772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:38.730881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a562429c-c8cb-41c2-928d-3920067faae6 req-258df3f1-e57c-436b-8120-84894babbf23 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:38.731387 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a562429c-c8cb-41c2-928d-3920067faae6 req-258df3f1-e57c-436b-8120-84894babbf23 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:38.731838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a562429c-c8cb-41c2-928d-3920067faae6 req-258df3f1-e57c-436b-8120-84894babbf23 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:38.746137 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a562429c-c8cb-41c2-928d-3920067faae6 req-258df3f1-e57c-436b-8120-84894babbf23 service nova] Creating event network-changed:e557ab16-c14b-4bb8-980f-a33d025b0568 for instance 32e65a83-f808-4752-9f4c-13d61ef24168 on n-h1-854441-12 Oct 17 16:45:38.752013 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a562429c-c8cb-41c2-928d-3920067faae6 req-258df3f1-e57c-436b-8120-84894babbf23 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039984 Oct 17 16:45:38.752975 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3706/7684] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:45:38.758639 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:45:38.856485 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dbb4d8cf-cd6f-4be9-86a4-2fd70e35f78c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 204 len: 0 microversion: 2.1 time: 0.146204 Oct 17 16:45:38.861860 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3979/7685] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:45:38 2022] DELETE /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:45:38.868352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:38.869081 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:38.876033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:38.876546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:38.876993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:38.877715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:38.878182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:38.878660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:39.018729 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:39.027018 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0e2c0c5d-17d8-40e4-8aa9-36f165798aff tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1689 microversion: 2.1 time: 0.163887 Oct 17 16:45:39.027587 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3707/7686] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:38 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:45:40.051746 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:40.052446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:40.060122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:40.060609 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:40.061047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:40.061747 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:40.062205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:40.062651 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:40.257628 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:40.266104 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4185db03-fd2b-4c41-9764-94c5d77dea37 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1689 microversion: 2.1 time: 0.218673 Oct 17 16:45:40.266780 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3980/7687] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:40 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1689 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:40.872484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-bce9f8dc-656b-42bc-aa78-71bf482cb09f req-c8fd75a5-b82d-4ef4-87c2-9119f28ab136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e65a83-f808-4752-9f4c-13d61ef24168", "name": "network-vif-deleted", "tag": "e557ab16-c14b-4bb8-980f-a33d025b0568"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:45:40.885552 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bce9f8dc-656b-42bc-aa78-71bf482cb09f req-c8fd75a5-b82d-4ef4-87c2-9119f28ab136 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:40.886151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bce9f8dc-656b-42bc-aa78-71bf482cb09f req-c8fd75a5-b82d-4ef4-87c2-9119f28ab136 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:40.886684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bce9f8dc-656b-42bc-aa78-71bf482cb09f req-c8fd75a5-b82d-4ef4-87c2-9119f28ab136 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:40.901191 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bce9f8dc-656b-42bc-aa78-71bf482cb09f req-c8fd75a5-b82d-4ef4-87c2-9119f28ab136 service nova] Creating event network-vif-deleted:e557ab16-c14b-4bb8-980f-a33d025b0568 for instance 32e65a83-f808-4752-9f4c-13d61ef24168 on n-h1-854441-12 Oct 17 16:45:40.906387 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-bce9f8dc-656b-42bc-aa78-71bf482cb09f req-c8fd75a5-b82d-4ef4-87c2-9119f28ab136 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142255 Oct 17 16:45:40.907064 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3708/7688] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:45:41.290660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:41.291212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:41.298468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:41.298979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:41.299415 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:41.300101 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:41.300547 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:41.300963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:41.333030 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:41.333513 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:41.333944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:41.334410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lazy-loading 'fault' on Instance uuid 32e65a83-f808-4752-9f4c-13d61ef24168 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:45:41.375739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:41.384519 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-317658a8-bd02-417d-b26c-eb2800e4c938 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 200 len: 1356 microversion: 2.1 time: 0.097989 Oct 17 16:45:41.385129 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3981/7689] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:41 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:42.408337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:42.409058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 32e65a83-f808-4752-9f4c-13d61ef24168] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:42.417039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:42.417563 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:42.417992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:42.418745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:42.419219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:42.419662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:42.433840 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] HTTP exception thrown: Instance 32e65a83-f808-4752-9f4c-13d61ef24168 could not be found. Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Request method failure captured: Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 HTTP/1.1 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYYLuOLLXIuQTkzyWw0LnoZrEZX3TRZJYNUUWQX-PZQpk-DWm4Gi96GxRyZvpzhFJYE24RCuB9E9lEW8pl0DrmmLHVemSNFojHFYHEw3cfQ4wOYbg-IHQIb6AuTQwGf9aR7mE8N8ddDz3bvtUYh6xb5jAN9H5eb4rEy8FoQEK3QvJP0 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ead73cf4fa65485b8a4878642c2c3aed Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 32e65a83-f808-4752-9f4c-13d61ef24168 could not be found. Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '32e65a83-f808-4752-9f4c-13d61ef24168'} Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e65a83-f808-4752-9f4c-13d61ef24168 could not be found. Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e65a83-f808-4752-9f4c-13d61ef24168 could not be found. Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:45:42.435863 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e65a83-f808-4752-9f4c-13d61ef24168 could not be found. Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Returning 404 to user: Instance 32e65a83-f808-4752-9f4c-13d61ef24168 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-47bdabaf-462a-4412-8d72-767f773fdb36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168" status: 404 len: 111 microversion: 2.1 time: 0.033397 Oct 17 16:45:42.441760 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3709/7690] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:42 2022] GET /compute/v2.1/servers/32e65a83-f808-4752-9f4c-13d61ef24168 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:45:45.905007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-e1ebc08e-0a5f-4899-8ade-6248773de8ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '.version_select at 0x7f28bd4d88b0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:45.931743 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-e1ebc08e-0a5f-4899-8ade-6248773de8ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2114801171" status: 202 len: 0 microversion: 2.1 time: 0.031238 Oct 17 16:45:45.932953 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3982/7691] 10.222.0.87 () {58 vars in 1284 bytes} [Mon Oct 17 16:45:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2114801171 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:45:45.958854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8408397a-c296-4f47-9982-d407ce426935 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: .version_select at 0x7f28bdbd2dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-966398523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMP7KKSwePzZTnt2G6rI1cKAWXLTGlS4yyQyk96x4q9V+e+T5KL6EpMj4Vvr+R7KkpW86/y2kR4uGUzG2KQQakPz46uHuVhOZ+sI8z7CN2nXBS95mTeGVQ+ERQPDBjrqw=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:45:45.977031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8408397a-c296-4f47-9982-d407ce426935 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:45:45.982530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8408397a-c296-4f47-9982-d407ce426935 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:45:46.014075 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8408397a-c296-4f47-9982-d407ce426935 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059226 Oct 17 16:45:46.014728 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3710/7692] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:45:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:45:51.686279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1767365154", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "c3d4f3ce-9293-45cf-95a1-96d63b2ec55a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-966398523", "security_groups": [{"name": "tempest-secgroup-smoke-728763598"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:45:51.708687 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:45:51.805377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] validate_networks() for [('c3d4f3ce-9293-45cf-95a1-96d63b2ec55a', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:45:52.225906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:45:52.226328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:45:52.226839 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:45:52.227377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:45:52.227980 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:45:52.238447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:52.238975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:52.239408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:52.240376 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:52.241084 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:52.241573 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:52.266289 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:45:52.277588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:45:52.293318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:45:52.295702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:45:52.347382 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5da21648-dcb0-4810-86f3-5ccb51f5537a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.664912 Oct 17 16:45:52.348639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3983/7693] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:45:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:45:52.361130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4c7c13f2-73c4-4ead-9d54-f2468937cd66 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:52.362812 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4c7c13f2-73c4-4ead-9d54-f2468937cd66 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:52.426478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=16 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:45:52.431996 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4c7c13f2-73c4-4ead-9d54-f2468937cd66 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:52.439801 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4c7c13f2-73c4-4ead-9d54-f2468937cd66 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1266 microversion: 2.1 time: 0.083579 Oct 17 16:45:52.440810 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3711/7694] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:52 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:53.463616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:53.464950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:53.475661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:53.476621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:53.478275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:53.479671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:53.480417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:53.481205 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:53.569124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:53.583871 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3d490e06-7929-4d98-a70c-4da29f37ce18 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1326 microversion: 2.1 time: 0.124923 Oct 17 16:45:53.585197 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3984/7695] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:53 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:54.608388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:54.609028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:54.613250 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:45:54.613563 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:45:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 (ip 10.222.0.87) !!! Oct 17 16:45:54.625485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:54.626002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:54.626467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:54.627240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:54.627713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:54.628347 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:54.905043 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:54.913447 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1e3adcf4-512f-4908-b774-02e722f9f179 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1391 microversion: 2.1 time: 0.309385 Oct 17 16:45:54.914017 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3712/7696] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:54 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1391 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:55.131368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-e3b833d6-5b62-4f13-b7af-df03c439f4e2 req-53009388-5be3-4477-b19c-d5d75e928efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415f3d57-8cc1-4231-9b24-a1cf4baf93a9", "tag": "27b765c8-0743-4269-ab13-0e46244a5ee4"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:45:55.143339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e3b833d6-5b62-4f13-b7af-df03c439f4e2 req-53009388-5be3-4477-b19c-d5d75e928efd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:55.143830 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e3b833d6-5b62-4f13-b7af-df03c439f4e2 req-53009388-5be3-4477-b19c-d5d75e928efd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:55.144406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-e3b833d6-5b62-4f13-b7af-df03c439f4e2 req-53009388-5be3-4477-b19c-d5d75e928efd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:55.157502 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-e3b833d6-5b62-4f13-b7af-df03c439f4e2 req-53009388-5be3-4477-b19c-d5d75e928efd service nova] Creating event network-changed:27b765c8-0743-4269-ab13-0e46244a5ee4 for instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 on n-h2-854441-12 Oct 17 16:45:55.163056 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-e3b833d6-5b62-4f13-b7af-df03c439f4e2 req-53009388-5be3-4477-b19c-d5d75e928efd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037180 Oct 17 16:45:55.163686 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3985/7697] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:45:55.937894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:55.938463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:55.945864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:55.946371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:55.946857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:55.947605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:55.948071 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:55.948643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:56.100909 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:56.109737 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8c1e0de-3026-4720-95e2-2b520a8cdf36 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1391 microversion: 2.1 time: 0.175973 Oct 17 16:45:56.110357 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3713/7698] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:55 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:57.138984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:57.139734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:57.149364 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:57.150081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:57.150803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:57.152078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:57.152534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:57.152988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:57.295544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:57.303863 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-676f72c1-0ae5-41b1-a377-aaec47f5d931 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1391 microversion: 2.1 time: 0.173603 Oct 17 16:45:57.304445 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3986/7699] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:57 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:58.327942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:58.328545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:58.335919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:58.336456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:58.336904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:58.337610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:58.338079 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:58.338545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:58.472105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:58.480270 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2a5ad265-5210-4872-98cd-ed86c3da7ec3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1391 microversion: 2.1 time: 0.156478 Oct 17 16:45:58.480846 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3714/7700] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:58 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:45:59.503984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:45:59.504611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:45:59.512243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:59.512702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:59.513131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:59.513838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:45:59.514286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:45:59.514735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:45:59.660451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:45:59.668960 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-01cd9194-e4aa-48ff-8bca-7bc79141a83b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1391 microversion: 2.1 time: 0.169055 Oct 17 16:45:59.669573 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3987/7701] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:45:59 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:00.695213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:00.695859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:00.704428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:00.704939 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:00.705394 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:00.706111 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:00.706611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:00.707053 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:00.843083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:00.851188 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d15c9e20-e1e3-4f44-bdcf-51bbd93d3157 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1391 microversion: 2.1 time: 0.162415 Oct 17 16:46:00.851778 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3715/7702] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:00 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:01.435208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-6bb80be7-47d0-4545-865e-b1e7d98a3b16 req-1ffb497b-9483-41e1-81b7-fee33af9f657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415f3d57-8cc1-4231-9b24-a1cf4baf93a9", "name": "network-vif-plugged", "status": "completed", "tag": "27b765c8-0743-4269-ab13-0e46244a5ee4"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:46:01.446761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6bb80be7-47d0-4545-865e-b1e7d98a3b16 req-1ffb497b-9483-41e1-81b7-fee33af9f657 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:01.447244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6bb80be7-47d0-4545-865e-b1e7d98a3b16 req-1ffb497b-9483-41e1-81b7-fee33af9f657 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:01.447671 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-6bb80be7-47d0-4545-865e-b1e7d98a3b16 req-1ffb497b-9483-41e1-81b7-fee33af9f657 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:01.459497 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-6bb80be7-47d0-4545-865e-b1e7d98a3b16 req-1ffb497b-9483-41e1-81b7-fee33af9f657 service nova] Creating event network-vif-plugged:27b765c8-0743-4269-ab13-0e46244a5ee4 for instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 on n-h2-854441-12 Oct 17 16:46:01.464589 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-6bb80be7-47d0-4545-865e-b1e7d98a3b16 req-1ffb497b-9483-41e1-81b7-fee33af9f657 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Oct 17 16:46:01.465217 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3988/7703] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:46:01.877507 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:01.878104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:01.882141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:01.888561 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:01.889078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:01.889502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:01.890216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:01.890714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:01.891148 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:02.032874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:02.040875 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-096987d3-33f4-4afb-9b26-77f32badb381 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1391 microversion: 2.1 time: 0.169564 Oct 17 16:46:02.041499 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3716/7704] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:01 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:03.062306 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:03.063047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:03.068252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:03.069353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:03.076785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:03.077279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:03.077724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:03.078418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:03.078913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:03.079344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:03.220890 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:03.229387 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c082131e-0da7-4afa-8824-4961fa0e24ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1562 microversion: 2.1 time: 0.168162 Oct 17 16:46:03.229932 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3989/7705] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:03 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:03.254483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:03.255600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:03.258620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:03.267951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:03.268722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:03.269171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:03.270182 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:03.270905 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:03.271486 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:03.420446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:03.428685 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a3ae2b14-fac7-45e4-aded-f852f6b32d75 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1562 microversion: 2.1 time: 0.180454 Oct 17 16:46:03.429270 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3717/7706] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:03 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1562 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:05.390427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:05.391202 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:05.398719 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:05.399195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:05.399877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:05.400616 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:05.401208 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:05.401634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:05.452615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-435ff282-0ed9-49a1-b4ed-fc072bc0198d req-3bc647e3-8f1f-47e6-9061-f41b89a02121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415f3d57-8cc1-4231-9b24-a1cf4baf93a9", "tag": "27b765c8-0743-4269-ab13-0e46244a5ee4"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:46:05.462623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-435ff282-0ed9-49a1-b4ed-fc072bc0198d req-3bc647e3-8f1f-47e6-9061-f41b89a02121 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:05.463120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-435ff282-0ed9-49a1-b4ed-fc072bc0198d req-3bc647e3-8f1f-47e6-9061-f41b89a02121 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:05.463562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-435ff282-0ed9-49a1-b4ed-fc072bc0198d req-3bc647e3-8f1f-47e6-9061-f41b89a02121 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:05.475258 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-435ff282-0ed9-49a1-b4ed-fc072bc0198d req-3bc647e3-8f1f-47e6-9061-f41b89a02121 service nova] Creating event network-changed:27b765c8-0743-4269-ab13-0e46244a5ee4 for instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 on n-h2-854441-12 Oct 17 16:46:05.480610 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-435ff282-0ed9-49a1-b4ed-fc072bc0198d req-3bc647e3-8f1f-47e6-9061-f41b89a02121 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091893 Oct 17 16:46:05.481257 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3718/7707] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:46:05.565704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:05.574957 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-93ea13a0-0f32-4158-aa95-16e396f2e717 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1562 microversion: 2.1 time: 0.188905 Oct 17 16:46:05.575556 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3990/7708] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:05 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1562 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:26.833681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=5 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:26.834653 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=38 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:26.840555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-edd14ba6-1362-489c-b871-97ad46b8e8e0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:46:26.843721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-edd14ba6-1362-489c-b871-97ad46b8e8e0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:26.851873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd14ba6-1362-489c-b871-97ad46b8e8e0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:26.852381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd14ba6-1362-489c-b871-97ad46b8e8e0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:26.852847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd14ba6-1362-489c-b871-97ad46b8e8e0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:26.853553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd14ba6-1362-489c-b871-97ad46b8e8e0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:26.854020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd14ba6-1362-489c-b871-97ad46b8e8e0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:26.854459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-edd14ba6-1362-489c-b871-97ad46b8e8e0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:26.911844 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-edd14ba6-1362-489c-b871-97ad46b8e8e0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9/action" status: 200 len: 24536 microversion: 2.1 time: 0.079874 Oct 17 16:46:26.912524 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3719/7709] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:46:26 2022] POST /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9/action => generated 24536 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:46:37.868377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:46:37.870832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:37.873172 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:37.873851 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:37.880635 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:37.880954 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:37.881409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:37.882113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:37.882645 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:37.883141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:37.930280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:37.937005 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120406) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 16:46:37.944743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:46:37.945168 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:46:37.945648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:46:37.946060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:46:37.946682 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:46:38.017460 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-df9dc4ee-7d70-4587-b821-b7a80884cdd7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9/action" status: 202 len: 0 microversion: 2.1 time: 0.153380 Oct 17 16:46:38.018088 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3991/7710] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:46:37 2022] POST /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:46:38.027313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:38.028040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:38.031067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:38.032276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=4 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:46:38.040102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:38.040692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:38.041247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:38.041949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:38.042529 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:38.043105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:38.253765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:38.262996 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-86a6816c-8a45-4785-b468-2899ac5c06df tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1690 microversion: 2.1 time: 0.240090 Oct 17 16:46:38.263602 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3720/7711] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:38 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:39.289552 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:39.290193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:39.297625 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:39.298110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:39.299020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:39.299479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:39.299950 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:39.300529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:39.493282 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:39.501825 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0cddd27-6f23-433d-a1ce-39b01e87a695 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1690 microversion: 2.1 time: 0.217078 Oct 17 16:46:39.502413 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3992/7712] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:39 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:40.525634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:40.526296 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:40.533671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:40.534179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:40.534672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:40.535392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:40.535866 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:40.536310 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:40.683923 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:40.691944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-66e953b9-2469-4a44-8062-4daaf224b9ef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.170351 Oct 17 16:46:40.692545 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3721/7713] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:40 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:41.716697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:41.717317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:41.725718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:41.726244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:41.726722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:41.727439 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:41.727896 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:41.728324 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:41.883718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:41.892432 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0165be5-82fa-47a9-97af-b5b91675a337 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.179863 Oct 17 16:46:41.893052 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3993/7714] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:41 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:42.917665 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:42.918274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:42.926011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:42.926594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:42.927016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:42.927749 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:42.928230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:42.928674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:43.070197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:43.078743 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-62d80ce3-4d47-4e6c-a5b8-d4b6de5c1f4d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.165852 Oct 17 16:46:43.079338 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3722/7715] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:42 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:44.103254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:44.103946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:44.111599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:44.112075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:44.112504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:44.113215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:44.113677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:44.114127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:44.257969 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:44.268557 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab571266-e478-4500-88d0-2bc5f4db316d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.169780 Oct 17 16:46:44.269154 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3994/7716] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:44 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:45.296960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:45.297588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:45.305620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:45.306108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:45.306620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:45.307615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:45.308337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:45.308933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:45.451083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:45.459577 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9652b8a8-c741-44bd-82d7-b583d6aa3da0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.167314 Oct 17 16:46:45.460189 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3723/7717] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:45 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:46.485192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:46.485884 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:46.493043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:46.493527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:46.493963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:46.494729 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:46.495185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:46.495606 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:46.654265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:46.663394 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-04475b63-2967-4019-ab6a-d8bb2b4dec92 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.182332 Oct 17 16:46:46.664018 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3995/7718] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:46 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:47.688768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:47.689404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:47.698305 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:47.698839 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:47.699290 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:47.700138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:47.700824 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:47.701381 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:47.844912 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:47.857952 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7a65ea4-6874-4e9a-8c93-1334253fac03 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.173717 Oct 17 16:46:47.858838 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3724/7719] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:47 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:48.889443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:48.890052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:48.897710 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:48.898184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:48.898686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:48.899379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:48.899852 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:48.900276 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:49.037965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:49.046369 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6797d60-1a1f-43f1-bede-37680475e5e7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.162385 Oct 17 16:46:49.046993 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3996/7720] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:48 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:50.070352 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:50.071016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:50.079183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:50.079716 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:50.080216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:50.081083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:50.081600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:50.082092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:50.225527 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:50.233773 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-60b9ffae-1550-4dc1-9a01-7e4be5d33c0a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.167904 Oct 17 16:46:50.234471 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3725/7721] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:50 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:51.257966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:51.258638 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:51.266016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:51.266530 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:51.266983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:51.267663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:51.268147 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:51.268567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:51.413678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:51.422035 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-013a1265-34c1-491e-93c1-9347dd8f9b23 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.168390 Oct 17 16:46:51.422810 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3997/7722] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:51 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:52.447374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:52.448920 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:52.458014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:52.458597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:52.459010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:52.459734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:52.460209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:52.460656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:52.610416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:52.619090 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e2fc651-3398-4ff3-95c9-1b2afe4cc73d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.176975 Oct 17 16:46:52.619728 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3726/7723] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:52 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:53.644665 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:53.645290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:53.653050 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:53.653551 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:53.654023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:53.654814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:53.655279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:53.655749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:53.811873 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:53.820739 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-94e95d45-049e-4b53-8d41-9d7366d42b8f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.180084 Oct 17 16:46:53.821344 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3998/7724] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:53 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:54.845625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:54.846292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:54.853946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:54.854462 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:54.854987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:54.855739 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:54.856198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:54.856641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:55.004584 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:55.013388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7550228-47bd-421d-81e1-2f040c94a932 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.171860 Oct 17 16:46:55.013999 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3727/7725] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:54 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:56.038374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:56.039029 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:56.046709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:56.047182 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:56.047650 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:56.048360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:56.048823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:56.049252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:56.197344 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:56.205768 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dfbcdbfd-096c-4002-bb18-c5ddc25f4b40 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1695 microversion: 2.1 time: 0.171466 Oct 17 16:46:56.206330 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 3999/7726] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:56 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:57.231678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:57.232329 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:57.239714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:57.240232 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:57.240685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:57.241383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:57.241859 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:57.242377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:57.439441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:57.447746 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-409defe7-2fe5-4dbe-a739-1b63158ce7ae tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1694 microversion: 2.1 time: 0.220096 Oct 17 16:46:57.448305 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3728/7727] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:57 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1694 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:57.726257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-c88607fa-53f0-47f5-b763-0e1ab9553539 req-24523a2b-bb79-4ad4-8fcd-3401eed4593c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415f3d57-8cc1-4231-9b24-a1cf4baf93a9", "name": "network-vif-unplugged", "status": "completed", "tag": "27b765c8-0743-4269-ab13-0e46244a5ee4"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:46:57.737945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c88607fa-53f0-47f5-b763-0e1ab9553539 req-24523a2b-bb79-4ad4-8fcd-3401eed4593c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:57.739481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c88607fa-53f0-47f5-b763-0e1ab9553539 req-24523a2b-bb79-4ad4-8fcd-3401eed4593c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:57.741338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-c88607fa-53f0-47f5-b763-0e1ab9553539 req-24523a2b-bb79-4ad4-8fcd-3401eed4593c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:57.755927 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-c88607fa-53f0-47f5-b763-0e1ab9553539 req-24523a2b-bb79-4ad4-8fcd-3401eed4593c service nova] Creating event network-vif-unplugged:27b765c8-0743-4269-ab13-0e46244a5ee4 for instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 on n-h1-854441-12 Oct 17 16:46:57.761681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [req-c88607fa-53f0-47f5-b763-0e1ab9553539 req-24523a2b-bb79-4ad4-8fcd-3401eed4593c service nova] Instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:46:57.773205 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-c88607fa-53f0-47f5-b763-0e1ab9553539 req-24523a2b-bb79-4ad4-8fcd-3401eed4593c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050780 Oct 17 16:46:57.773842 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4000/7728] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:46:58.474348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:58.475054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:58.482419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:58.482989 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:58.483449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:58.484156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:58.484797 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:58.485423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:58.676234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:58.687686 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9a45824a-7481-4f6c-b525-1db2389da554 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1694 microversion: 2.1 time: 0.217244 Oct 17 16:46:58.688577 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3729/7729] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:58 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:46:59.719632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:46:59.720245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:46:59.727222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:59.727704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:59.728142 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:59.728835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:59.729254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:59.729722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:59.806354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-feab7456-0b6c-4ea2-a718-c126112de0d6 req-32467d68-952c-45bb-baee-9e5b4c716aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415f3d57-8cc1-4231-9b24-a1cf4baf93a9", "tag": "27b765c8-0743-4269-ab13-0e46244a5ee4"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:46:59.817048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-feab7456-0b6c-4ea2-a718-c126112de0d6 req-32467d68-952c-45bb-baee-9e5b4c716aa5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:46:59.817553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-feab7456-0b6c-4ea2-a718-c126112de0d6 req-32467d68-952c-45bb-baee-9e5b4c716aa5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:46:59.818006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-feab7456-0b6c-4ea2-a718-c126112de0d6 req-32467d68-952c-45bb-baee-9e5b4c716aa5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:46:59.830343 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-feab7456-0b6c-4ea2-a718-c126112de0d6 req-32467d68-952c-45bb-baee-9e5b4c716aa5 service nova] Creating event network-changed:27b765c8-0743-4269-ab13-0e46244a5ee4 for instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 on n-h1-854441-12 Oct 17 16:46:59.836207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [req-feab7456-0b6c-4ea2-a718-c126112de0d6 req-32467d68-952c-45bb-baee-9e5b4c716aa5 service nova] Instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854441-12', 'n-h1-854441-12'} {{(pid=120407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 16:46:59.847283 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-feab7456-0b6c-4ea2-a718-c126112de0d6 req-32467d68-952c-45bb-baee-9e5b4c716aa5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044612 Oct 17 16:46:59.847901 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3730/7730] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:46:59.872067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:46:59.881188 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-38e10baa-25c8-4cb7-9ee7-ceffedd79dd6 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1692 microversion: 2.1 time: 0.167128 Oct 17 16:46:59.881826 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4001/7731] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:46:59 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:00.906334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:00.907076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:00.914361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:00.914932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:00.915392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:00.916123 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:00.916601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:00.917046 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:01.117656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:01.126148 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f2fde706-0c9e-49b9-ba4e-50571b8d7759 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1692 microversion: 2.1 time: 0.225140 Oct 17 16:47:01.126954 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3731/7732] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:00 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1692 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:02.151880 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:02.152462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:02.160384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:02.160915 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:02.161346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:02.162532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:02.163035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:02.163829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:02.306416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:02.318144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f227c839-c476-47e4-95f2-88384e07fdd5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1689 microversion: 2.1 time: 0.170158 Oct 17 16:47:02.318986 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4002/7733] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:02 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:02.341116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-838a09c2-2dde-4dcf-8266-eee6f34dff3f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:02.341661 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-838a09c2-2dde-4dcf-8266-eee6f34dff3f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:02.348910 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-838a09c2-2dde-4dcf-8266-eee6f34dff3f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:02.349418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-838a09c2-2dde-4dcf-8266-eee6f34dff3f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:02.349876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-838a09c2-2dde-4dcf-8266-eee6f34dff3f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:02.350645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-838a09c2-2dde-4dcf-8266-eee6f34dff3f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:02.351096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-838a09c2-2dde-4dcf-8266-eee6f34dff3f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:02.351558 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-838a09c2-2dde-4dcf-8266-eee6f34dff3f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:02.417485 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-838a09c2-2dde-4dcf-8266-eee6f34dff3f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9/action" status: 204 len: 0 microversion: 2.1 time: 0.080137 Oct 17 16:47:02.418347 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3732/7734] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:47:02 2022] POST /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:47:02.429332 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:02.434472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:02.441311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:02.441818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:02.442490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:02.443227 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:02.443701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:02.444110 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:02.590516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:02.599490 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a93b8af7-0526-4262-a6f8-22300f9e9002 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1689 microversion: 2.1 time: 0.174506 Oct 17 16:47:02.600102 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4003/7735] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:02 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:02.622814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:02.623546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:02.631096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:02.631949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:02.632476 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:02.633203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:02.633678 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:02.634122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:02.848565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:02.856847 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f2ca6286-4142-4a0f-ba18-01a6facb1edf tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1689 microversion: 2.1 time: 0.238604 Oct 17 16:47:02.857662 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3733/7736] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:02 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:03.881412 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:03.882083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:03.889438 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:03.889927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:03.890385 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:03.891156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:03.891659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:03.892112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:04.032291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:04.041316 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-33e4d555-98b5-428c-aacc-e2d52dd0d0e8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1681 microversion: 2.1 time: 0.164484 Oct 17 16:47:04.041957 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4004/7737] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:03 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:04.265240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-8dd2937f-d2b6-414e-94a6-56c7684a3366 req-fa221813-d309-40df-8615-59aa5adffa34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415f3d57-8cc1-4231-9b24-a1cf4baf93a9", "name": "network-vif-plugged", "status": "completed", "tag": "27b765c8-0743-4269-ab13-0e46244a5ee4"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:04.275130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8dd2937f-d2b6-414e-94a6-56c7684a3366 req-fa221813-d309-40df-8615-59aa5adffa34 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:04.275623 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8dd2937f-d2b6-414e-94a6-56c7684a3366 req-fa221813-d309-40df-8615-59aa5adffa34 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:04.276064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-8dd2937f-d2b6-414e-94a6-56c7684a3366 req-fa221813-d309-40df-8615-59aa5adffa34 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:04.287146 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-8dd2937f-d2b6-414e-94a6-56c7684a3366 req-fa221813-d309-40df-8615-59aa5adffa34 service nova] Creating event network-vif-plugged:27b765c8-0743-4269-ab13-0e46244a5ee4 for instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 on n-h1-854441-12 Oct 17 16:47:04.292490 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-8dd2937f-d2b6-414e-94a6-56c7684a3366 req-fa221813-d309-40df-8615-59aa5adffa34 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089965 Oct 17 16:47:04.293035 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3734/7738] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:47:26.243404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f86a5a99-d1ea-4a4d-ac6a-2940fb43e8ab tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:26.245655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f86a5a99-d1ea-4a4d-ac6a-2940fb43e8ab tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:26.248348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:26.249007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:26.254960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f86a5a99-d1ea-4a4d-ac6a-2940fb43e8ab tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:26.255814 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f86a5a99-d1ea-4a4d-ac6a-2940fb43e8ab tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:26.256247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f86a5a99-d1ea-4a4d-ac6a-2940fb43e8ab tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:26.256981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f86a5a99-d1ea-4a4d-ac6a-2940fb43e8ab tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:26.257394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f86a5a99-d1ea-4a4d-ac6a-2940fb43e8ab tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:26.257813 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f86a5a99-d1ea-4a4d-ac6a-2940fb43e8ab tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:26.314032 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f86a5a99-d1ea-4a4d-ac6a-2940fb43e8ab tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9/action" status: 200 len: 24570 microversion: 2.1 time: 0.076421 Oct 17 16:47:26.314727 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4005/7739] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:47:26 2022] POST /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9/action => generated 24570 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:47:33.437506 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=30 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:33.438261 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:33.441579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-14abb992-3add-4f71-af46-121b131b3eea req-a2315d0a-ecf7-4652-a939-129affe9ad44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415f3d57-8cc1-4231-9b24-a1cf4baf93a9", "tag": "27b765c8-0743-4269-ab13-0e46244a5ee4"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:33.445098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:33.445711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:33.454100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-14abb992-3add-4f71-af46-121b131b3eea req-a2315d0a-ecf7-4652-a939-129affe9ad44 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:33.454709 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-14abb992-3add-4f71-af46-121b131b3eea req-a2315d0a-ecf7-4652-a939-129affe9ad44 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:33.455150 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-14abb992-3add-4f71-af46-121b131b3eea req-a2315d0a-ecf7-4652-a939-129affe9ad44 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:33.455566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:33.456064 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:33.456709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:33.457645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:33.458103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:33.458762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:33.468125 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-14abb992-3add-4f71-af46-121b131b3eea req-a2315d0a-ecf7-4652-a939-129affe9ad44 service nova] Creating event network-changed:27b765c8-0743-4269-ab13-0e46244a5ee4 for instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 on n-h1-854441-12 Oct 17 16:47:33.473550 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-14abb992-3add-4f71-af46-121b131b3eea req-a2315d0a-ecf7-4652-a939-129affe9ad44 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036278 Oct 17 16:47:33.474178 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4006/7740] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:47:33.492568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Going to try to terminate instance {{(pid=120407) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:47:33.590814 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3e759818-cb76-4c59-87fc-a0c4b76fc35c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 204 len: 0 microversion: 2.1 time: 0.155612 Oct 17 16:47:33.594866 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3735/7741] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:47:33 2022] DELETE /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:47:33.601992 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:33.602745 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:33.615838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:33.616713 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:33.617559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:33.618478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:33.619262 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:33.621041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:33.770691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:33.779737 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-1062e4b3-3b3a-4525-857b-d638a6785cba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1687 microversion: 2.1 time: 0.183223 Oct 17 16:47:33.793641 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4007/7742] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:33 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:34.820067 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:34.820810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:34.829913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:34.830413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:34.830906 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:34.831638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:34.832078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:34.832513 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:35.049656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:35.060781 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6ec4e007-0de4-485b-9c77-b8001688907c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 200 len: 1687 microversion: 2.1 time: 0.245864 Oct 17 16:47:35.061681 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3736/7743] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:34 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 1687 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:35.489129 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-60780563-8e5b-43fe-b020-a72a4486437f req-668643ba-a900-49c9-9358-055ecdfd8f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415f3d57-8cc1-4231-9b24-a1cf4baf93a9", "name": "network-vif-deleted", "tag": "27b765c8-0743-4269-ab13-0e46244a5ee4"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:35.500051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60780563-8e5b-43fe-b020-a72a4486437f req-668643ba-a900-49c9-9358-055ecdfd8f7a service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:35.500586 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60780563-8e5b-43fe-b020-a72a4486437f req-668643ba-a900-49c9-9358-055ecdfd8f7a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:35.501015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-60780563-8e5b-43fe-b020-a72a4486437f req-668643ba-a900-49c9-9358-055ecdfd8f7a service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:35.513895 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-60780563-8e5b-43fe-b020-a72a4486437f req-668643ba-a900-49c9-9358-055ecdfd8f7a service nova] Creating event network-vif-deleted:27b765c8-0743-4269-ab13-0e46244a5ee4 for instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 on n-h1-854441-12 Oct 17 16:47:35.519517 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-60780563-8e5b-43fe-b020-a72a4486437f req-668643ba-a900-49c9-9358-055ecdfd8f7a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034144 Oct 17 16:47:35.520137 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4008/7744] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:47:36.089095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:36.089942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 415f3d57-8cc1-4231-9b24-a1cf4baf93a9] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:36.099572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:36.100089 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:36.100545 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:36.101779 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:36.102399 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:36.102931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:36.117991 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] HTTP exception thrown: Instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 could not be found. Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Request method failure captured: Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 HTTP/1.1 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYYLuOLLXIuQTkzyWw0LnoZrEZX3TRZJYNUUWQX-PZQpk-DWm4Gi96GxRyZvpzhFJYE24RCuB9E9lEW8pl0DrmmLHVemSNFojHFYHEw3cfQ4wOYbg-IHQIb6AuTQwGf9aR7mE8N8ddDz3bvtUYh6xb5jAN9H5eb4rEy8FoQEK3QvJP0 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ead73cf4fa65485b8a4878642c2c3aed Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 could not be found. Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '415f3d57-8cc1-4231-9b24-a1cf4baf93a9'} Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 could not be found. Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 could not be found. Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:47:36.119721 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 could not be found. Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Returning 404 to user: Instance 415f3d57-8cc1-4231-9b24-a1cf4baf93a9 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-71650fad-2413-4589-a4a8-fae801a4399a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9" status: 404 len: 111 microversion: 2.1 time: 0.038218 Oct 17 16:47:36.125548 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3737/7745] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:36 2022] GET /compute/v2.1/servers/415f3d57-8cc1-4231-9b24-a1cf4baf93a9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:47:39.566222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d1ff7124-2bfb-47ef-ba77-2188dc76cb69 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '.version_select at 0x7f28bd862670>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:39.603846 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d1ff7124-2bfb-47ef-ba77-2188dc76cb69 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-966398523" status: 202 len: 0 microversion: 2.1 time: 0.042225 Oct 17 16:47:39.615056 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4009/7746] 10.222.0.87 () {58 vars in 1281 bytes} [Mon Oct 17 16:47:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-966398523 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:47:39.644416 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-216db76c-0cb9-49f6-9305-43b4e9ee3237 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: .version_select at 0x7f28bc032940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1152640370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhtVS+B8e/WwcpJBsuUY6y3SX1mnTBiJedHosKBz81O81z6+vEu+5oUr+Pzj1g6zViytDYBbV1jTUSJLhlMQ/7LUTGlMh27Ewb4PQIz/mQhFFc6umLBLS8Bh1nlK0z74Q=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:39.667061 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-216db76c-0cb9-49f6-9305-43b4e9ee3237 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:47:39.674057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-216db76c-0cb9-49f6-9305-43b4e9ee3237 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:47:39.703437 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-216db76c-0cb9-49f6-9305-43b4e9ee3237 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063130 Oct 17 16:47:39.704080 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3738/7747] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:47:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:47:45.416663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-61188505", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "fe75a84f-92a1-42e0-9328-4bb35ba17225"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1152640370", "security_groups": [{"name": "tempest-secgroup-smoke-1415039620"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:45.510317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=14 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:45.574640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] validate_networks() for [('fe75a84f-92a1-42e0-9328-4bb35ba17225', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:47:46.062299 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:47:46.062769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:47:46.063436 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:47:46.063849 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:47:46.064648 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:47:46.075134 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:46.076021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:46.076652 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:46.077391 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:46.077848 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:46.078280 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:46.100570 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:47:46.108116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:47:46.123694 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:47:46.126386 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:47:46.178232 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f1cf3bb-006a-45aa-899e-08bc9429c330 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.767274 Oct 17 16:47:46.179038 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4010/7748] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:47:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:47:46.188583 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:46.193573 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-deac3c55-ad50-4a6c-be38-35984647e879 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:46.194185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-deac3c55-ad50-4a6c-be38-35984647e879 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:46.277258 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-deac3c55-ad50-4a6c-be38-35984647e879 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:46.285493 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-deac3c55-ad50-4a6c-be38-35984647e879 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1265 microversion: 2.1 time: 0.098789 Oct 17 16:47:46.286192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3739/7749] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:46 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:47:47.310037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:47.311352 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:47.318832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:47.319369 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:47.320752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:47.321497 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:47.322010 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:47.322406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:47.392212 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:47.402971 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-cb2b0af3-1255-4c17-a691-69dd6ec9da0d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1325 microversion: 2.1 time: 0.098090 Oct 17 16:47:47.404192 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4011/7750] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:47 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1325 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:48.432618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:48.433973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:48.443159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:48.444098 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:48.444957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:48.447856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:48.448715 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:48.450478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:48.678421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:48.687819 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-597bc333-c325-4007-84d1-afbcffbaeb24 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1391 microversion: 2.1 time: 0.263070 Oct 17 16:47:48.688416 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3740/7751] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:48 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1391 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:49.064297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-ad1b03f3-98c1-483c-8f95-7288e6afd3c0 req-2b847c47-6709-49a6-b77c-8a7667294036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d2860d-7a2a-483e-a583-eb906bc19196", "tag": "25aaa070-20b7-4ef4-8f78-81a72c3c2111"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:49.077618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad1b03f3-98c1-483c-8f95-7288e6afd3c0 req-2b847c47-6709-49a6-b77c-8a7667294036 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:49.078189 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad1b03f3-98c1-483c-8f95-7288e6afd3c0 req-2b847c47-6709-49a6-b77c-8a7667294036 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:49.078906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-ad1b03f3-98c1-483c-8f95-7288e6afd3c0 req-2b847c47-6709-49a6-b77c-8a7667294036 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:49.091860 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-ad1b03f3-98c1-483c-8f95-7288e6afd3c0 req-2b847c47-6709-49a6-b77c-8a7667294036 service nova] Creating event network-changed:25aaa070-20b7-4ef4-8f78-81a72c3c2111 for instance 53d2860d-7a2a-483e-a583-eb906bc19196 on n-h2-854441-12 Oct 17 16:47:49.097414 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-ad1b03f3-98c1-483c-8f95-7288e6afd3c0 req-2b847c47-6709-49a6-b77c-8a7667294036 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037209 Oct 17 16:47:49.098363 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4012/7752] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:47:49.712075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:49.712759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:49.721368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:49.721904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:49.722359 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:49.723122 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:49.723598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:49.724039 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:49.936193 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:49.944499 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-acef3a30-1092-408f-bef5-580fc9d19ac3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1391 microversion: 2.1 time: 0.236490 Oct 17 16:47:49.945191 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3741/7753] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:49 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:50.969032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:50.969716 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:50.976244 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:50.976770 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:50.977209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:50.977906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:50.978356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:50.978804 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:51.125210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:51.134628 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-748d15bf-d9d1-4e06-bb7f-599e6d9fbd76 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1391 microversion: 2.1 time: 0.170655 Oct 17 16:47:51.136010 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4013/7754] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:50 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:52.159004 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:52.159639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:52.167382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:52.167899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:52.168362 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:52.169147 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:52.169626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:52.170185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:52.379562 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:52.388447 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e13a5d2f-e650-4698-9181-e514692f6e62 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1391 microversion: 2.1 time: 0.233364 Oct 17 16:47:52.389046 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3742/7755] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:52 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1391 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:53.412130 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:53.412777 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:53.421086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:53.421589 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:53.422209 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:53.423261 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:53.423698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:53.424118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:53.567545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:53.576360 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1d4b7b8-1094-47e3-b3a3-2e8480c095f0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1391 microversion: 2.1 time: 0.168677 Oct 17 16:47:53.576963 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4014/7756] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:53 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:54.025454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5fd79be1-a4b8-4883-b5fd-6e9eb2841ad6 req-231d000a-6bb0-45da-832d-bb2965f95d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d2860d-7a2a-483e-a583-eb906bc19196", "name": "network-vif-plugged", "status": "completed", "tag": "25aaa070-20b7-4ef4-8f78-81a72c3c2111"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:54.041189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5fd79be1-a4b8-4883-b5fd-6e9eb2841ad6 req-231d000a-6bb0-45da-832d-bb2965f95d90 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:54.041704 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5fd79be1-a4b8-4883-b5fd-6e9eb2841ad6 req-231d000a-6bb0-45da-832d-bb2965f95d90 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:54.042151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5fd79be1-a4b8-4883-b5fd-6e9eb2841ad6 req-231d000a-6bb0-45da-832d-bb2965f95d90 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:54.054707 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5fd79be1-a4b8-4883-b5fd-6e9eb2841ad6 req-231d000a-6bb0-45da-832d-bb2965f95d90 service nova] Creating event network-vif-plugged:25aaa070-20b7-4ef4-8f78-81a72c3c2111 for instance 53d2860d-7a2a-483e-a583-eb906bc19196 on n-h2-854441-12 Oct 17 16:47:54.061573 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5fd79be1-a4b8-4883-b5fd-6e9eb2841ad6 req-231d000a-6bb0-45da-832d-bb2965f95d90 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039239 Oct 17 16:47:54.062233 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3743/7757] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:47:54.603462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:54.604116 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:54.611527 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:54.612021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:54.612471 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:54.613185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:54.613637 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:54.614092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:54.758906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:54.767365 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0354027a-89a2-4ecc-b0fa-6af5a3063d74 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1391 microversion: 2.1 time: 0.167947 Oct 17 16:47:54.767945 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4015/7758] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:54 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:55.791126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:55.791746 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:55.799991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:55.800500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:55.800973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:55.801692 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:55.802160 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:55.802622 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:55.950701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:55.960582 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ee9b9387-b1dd-4665-9421-b296c0d9a09a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1562 microversion: 2.1 time: 0.174286 Oct 17 16:47:55.961223 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3744/7759] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:55 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:55.984023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:55.984602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:55.991791 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:55.992284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:55.992724 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:55.993417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:55.993871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:55.994297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:56.085963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:56.118077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:56.143744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:56.152291 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2934a215-d69a-4c66-9ada-f071e988320a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1562 microversion: 2.1 time: 0.172276 Oct 17 16:47:56.152903 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4016/7760] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:55 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:47:57.908694 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:47:57.909602 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:47:57.911433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-07a833b2-ff9e-4133-9d55-8e245d12cc86 req-e2126a3e-a81f-43ab-b396-2fb636322ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d2860d-7a2a-483e-a583-eb906bc19196", "tag": "25aaa070-20b7-4ef4-8f78-81a72c3c2111"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:47:57.913306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:57.917904 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:57.918417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:57.918894 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:57.920115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:57.920598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:57.921109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:57.921358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:47:57.924277 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07a833b2-ff9e-4133-9d55-8e245d12cc86 req-e2126a3e-a81f-43ab-b396-2fb636322ee5 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:47:57.924765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07a833b2-ff9e-4133-9d55-8e245d12cc86 req-e2126a3e-a81f-43ab-b396-2fb636322ee5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:47:57.925417 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-07a833b2-ff9e-4133-9d55-8e245d12cc86 req-e2126a3e-a81f-43ab-b396-2fb636322ee5 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:47:57.938093 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-07a833b2-ff9e-4133-9d55-8e245d12cc86 req-e2126a3e-a81f-43ab-b396-2fb636322ee5 service nova] Creating event network-changed:25aaa070-20b7-4ef4-8f78-81a72c3c2111 for instance 53d2860d-7a2a-483e-a583-eb906bc19196 on n-h2-854441-12 Oct 17 16:47:57.943823 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-07a833b2-ff9e-4133-9d55-8e245d12cc86 req-e2126a3e-a81f-43ab-b396-2fb636322ee5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036731 Oct 17 16:47:57.944806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4017/7761] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:47:58.161083 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:47:58.169969 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4133cf68-e01f-41a0-a569-469b119bdd80 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1562 microversion: 2.1 time: 0.265257 Oct 17 16:47:58.170587 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3745/7762] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:47:57 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1562 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:21.435026 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=36 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:48:21.441623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-58b36d70-0bd5-426c-ac6d-5fccb9bceb2c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:48:21.445213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-58b36d70-0bd5-426c-ac6d-5fccb9bceb2c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:21.455476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b36d70-0bd5-426c-ac6d-5fccb9bceb2c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:21.456193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b36d70-0bd5-426c-ac6d-5fccb9bceb2c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:21.456768 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b36d70-0bd5-426c-ac6d-5fccb9bceb2c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:21.458611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b36d70-0bd5-426c-ac6d-5fccb9bceb2c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:21.458611 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b36d70-0bd5-426c-ac6d-5fccb9bceb2c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:21.458853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-58b36d70-0bd5-426c-ac6d-5fccb9bceb2c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:21.515980 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-58b36d70-0bd5-426c-ac6d-5fccb9bceb2c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action" status: 200 len: 24569 microversion: 2.1 time: 0.084058 Oct 17 16:48:21.516638 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4018/7763] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:48:21 2022] POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action => generated 24569 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:48:27.836033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6a5859d8-1b49-4d17-b15b-99efa2efec7e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:48:27.838097 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:48:27.838872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=32 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:48:27.845845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a5859d8-1b49-4d17-b15b-99efa2efec7e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:27.846530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a5859d8-1b49-4d17-b15b-99efa2efec7e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:27.846913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6a5859d8-1b49-4d17-b15b-99efa2efec7e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:27.871844 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6a5859d8-1b49-4d17-b15b-99efa2efec7e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Going to try to stop instance {{(pid=120407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 16:48:27.924082 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6a5859d8-1b49-4d17-b15b-99efa2efec7e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action" status: 202 len: 0 microversion: 2.1 time: 0.091850 Oct 17 16:48:27.924945 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3746/7764] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:48:27 2022] POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:48:27.934216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:27.935043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:27.943311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:27.943827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:27.944321 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:27.945035 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:27.945491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:27.945920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:28.082780 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:28.091673 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-779973a7-075c-4c1d-8795-7f66dc62408a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1690 microversion: 2.1 time: 0.161808 Oct 17 16:48:28.092183 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4019/7765] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:27 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:29.120017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:29.120791 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:29.131298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:29.131954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:29.132778 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:29.133519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:29.133994 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:29.134428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:29.302856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:29.313837 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-92b13bd4-54e3-45fe-864e-e0b4c2debbef tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1690 microversion: 2.1 time: 0.201393 Oct 17 16:48:29.314834 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3747/7766] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:29 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:30.337906 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:30.338550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:30.346847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:30.347405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:30.347878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:30.348575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:30.349065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:30.349480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:30.495824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:30.507866 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-45a8951c-9c81-492c-b15e-2c1a1ab79fd0 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1690 microversion: 2.1 time: 0.173870 Oct 17 16:48:30.508689 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4020/7767] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:30 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:31.534669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:31.535425 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:31.544427 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:31.545025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:31.545578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:31.546579 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:31.547224 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:31.547819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:31.686335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:31.698351 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6091bc56-2b89-49ff-a821-f00f58e5a191 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1690 microversion: 2.1 time: 0.168515 Oct 17 16:48:31.699133 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3748/7768] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:31 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:32.728387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:32.729478 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:32.737102 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:32.737599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:32.738047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:32.738798 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:32.739260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:32.739703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:32.890018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:32.898179 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-b9d41569-2eb1-43b7-9cb4-a67ba5ebef73 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1690 microversion: 2.1 time: 0.174141 Oct 17 16:48:32.898806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4021/7769] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:32 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:33.921930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:33.922722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:33.930570 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:33.931101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:33.931553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:33.932267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:33.932857 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:33.933333 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:34.076106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:34.084669 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ad048bc2-c7bb-4e76-95e1-8f2b157ad3c8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1690 microversion: 2.1 time: 0.166816 Oct 17 16:48:34.085262 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3749/7770] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:33 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:35.109291 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:35.109944 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:35.117356 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:35.117869 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:35.118278 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:35.119061 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:35.119518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:35.119951 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:35.270564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:35.283606 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a1fad880-73fc-4b67-8145-077b8c9d08a3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1690 microversion: 2.1 time: 0.178162 Oct 17 16:48:35.284612 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4022/7771] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:35 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:36.314210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:36.315197 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:36.326229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:36.326804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:36.327260 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:36.327987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:36.328459 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:36.328887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:36.469485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:36.482728 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc394aa6-53e6-462f-a541-246d98818a3d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1690 microversion: 2.1 time: 0.174222 Oct 17 16:48:36.483499 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3750/7772] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:36 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:37.507575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:37.508220 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:37.515726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:37.516223 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:37.516670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:37.517367 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:37.517831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:37.518263 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:37.662295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:37.670525 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c1138531-d2da-48e9-8ebe-da03cf564048 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1690 microversion: 2.1 time: 0.167311 Oct 17 16:48:37.671115 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4023/7773] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:37 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:38.694056 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:38.694672 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:38.702592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:38.703138 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:38.703660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:38.704405 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:38.704869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:38.705360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:38.858108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:38.867240 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-55cac63a-8453-4fb1-b2cf-ec3948d3f3a5 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1667 microversion: 2.1 time: 0.177363 Oct 17 16:48:38.867827 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3751/7774] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:38 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1667 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:39.969409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d9b83030-e005-4503-9e9a-dd2f19c892da tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:48:39.971973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d9b83030-e005-4503-9e9a-dd2f19c892da tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:39.980133 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b83030-e005-4503-9e9a-dd2f19c892da tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:39.980670 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b83030-e005-4503-9e9a-dd2f19c892da tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:39.981140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b83030-e005-4503-9e9a-dd2f19c892da tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:39.981882 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b83030-e005-4503-9e9a-dd2f19c892da tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:39.982396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b83030-e005-4503-9e9a-dd2f19c892da tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:39.982932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d9b83030-e005-4503-9e9a-dd2f19c892da tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:40.039904 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d9b83030-e005-4503-9e9a-dd2f19c892da tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action" status: 200 len: 35472 microversion: 2.1 time: 0.074708 Oct 17 16:48:40.040639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4024/7775] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:48:39 2022] POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action => generated 35472 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:48:40.054596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79f9a4cd-6d32-450d-ad3e-00465b11b97d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:48:40.062470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79f9a4cd-6d32-450d-ad3e-00465b11b97d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:40.063052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79f9a4cd-6d32-450d-ad3e-00465b11b97d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:40.063531 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79f9a4cd-6d32-450d-ad3e-00465b11b97d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:40.087121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-79f9a4cd-6d32-450d-ad3e-00465b11b97d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Going to try to start instance {{(pid=120407) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 16:48:40.142577 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-79f9a4cd-6d32-450d-ad3e-00465b11b97d tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action" status: 202 len: 0 microversion: 2.1 time: 0.091373 Oct 17 16:48:40.143755 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3752/7776] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:48:40 2022] POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:48:40.153772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:40.154526 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:40.162866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:40.163363 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:40.163826 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:40.164534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:40.165127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:40.165537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:40.317971 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:40.327228 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0ed615fb-f022-4095-b637-5aa7573dab9e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1676 microversion: 2.1 time: 0.178198 Oct 17 16:48:40.328596 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4025/7777] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:40 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:41.353748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:41.354737 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:41.362130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:41.362642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:41.363101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:41.363823 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:41.364295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:41.364761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:41.867116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:41.875725 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3a01f2fa-f06b-46fe-baa8-696b4745355c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1676 microversion: 2.1 time: 0.526379 Oct 17 16:48:41.876297 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3753/7778] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:41 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1676 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:48:42.900559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:48:42.901154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:48:42.908820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:42.909323 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:42.909846 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:42.910576 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:48:42.911025 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:48:42.911444 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:48:43.050145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:48:43.058857 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9dbc4bc5-868a-41a0-a8c3-9db0be0d6911 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1680 microversion: 2.1 time: 0.162689 Oct 17 16:48:43.059451 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4026/7779] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:48:42 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:07.288041 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-65645e6c-0b40-4233-8fb6-66f996c6928b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:49:07.291220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-65645e6c-0b40-4233-8fb6-66f996c6928b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:07.294829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=16 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:07.295625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:07.301695 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65645e6c-0b40-4233-8fb6-66f996c6928b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:07.302151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65645e6c-0b40-4233-8fb6-66f996c6928b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:07.302701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65645e6c-0b40-4233-8fb6-66f996c6928b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:07.303446 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65645e6c-0b40-4233-8fb6-66f996c6928b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:07.303908 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65645e6c-0b40-4233-8fb6-66f996c6928b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:07.304344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-65645e6c-0b40-4233-8fb6-66f996c6928b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:07.363482 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-65645e6c-0b40-4233-8fb6-66f996c6928b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action" status: 200 len: 60039 microversion: 2.1 time: 0.079455 Oct 17 16:49:07.364194 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3754/7780] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:49:07 2022] POST /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196/action => generated 60039 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:49:14.435945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:14.436500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:14.438646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5f9ca9a4-c0cb-43a3-9918-2145ca7c942d req-b30f964d-e408-422f-b1ac-9b4712fb46c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d2860d-7a2a-483e-a583-eb906bc19196", "tag": "25aaa070-20b7-4ef4-8f78-81a72c3c2111"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:49:14.439286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=19 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:14.439927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=50 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:14.446521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:14.447014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:14.447454 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:14.448136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:14.448801 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:14.449469 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:14.452316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5f9ca9a4-c0cb-43a3-9918-2145ca7c942d req-b30f964d-e408-422f-b1ac-9b4712fb46c8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:14.452826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5f9ca9a4-c0cb-43a3-9918-2145ca7c942d req-b30f964d-e408-422f-b1ac-9b4712fb46c8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:14.453272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5f9ca9a4-c0cb-43a3-9918-2145ca7c942d req-b30f964d-e408-422f-b1ac-9b4712fb46c8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:14.465490 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5f9ca9a4-c0cb-43a3-9918-2145ca7c942d req-b30f964d-e408-422f-b1ac-9b4712fb46c8 service nova] Creating event network-changed:25aaa070-20b7-4ef4-8f78-81a72c3c2111 for instance 53d2860d-7a2a-483e-a583-eb906bc19196 on n-h2-854441-12 Oct 17 16:49:14.472069 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5f9ca9a4-c0cb-43a3-9918-2145ca7c942d req-b30f964d-e408-422f-b1ac-9b4712fb46c8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037589 Oct 17 16:49:14.472958 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3755/7781] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:49:14.478358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:49:14.582587 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2a219834-1606-414c-998d-51e8e23fdbb2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 204 len: 0 microversion: 2.1 time: 0.146419 Oct 17 16:49:14.583661 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4027/7782] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:49:14 2022] DELETE /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:49:14.592493 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:14.593217 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:14.600304 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:14.600810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:14.601267 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:14.601990 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:14.602468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:14.602973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:14.758522 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:14.767177 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2c265128-d8b0-4642-af46-310e2ed9f065 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1686 microversion: 2.1 time: 0.178939 Oct 17 16:49:14.767775 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3756/7783] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:14 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:15.792506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:15.793217 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:15.800191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:15.800692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:15.801127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:15.801832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:15.802290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:15.802757 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:15.950060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:15.958452 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-347747f1-30df-4664-92d6-81c849a05f6e tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1686 microversion: 2.1 time: 0.170443 Oct 17 16:49:15.959111 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4028/7784] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:15 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:16.741478 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d41b62d4-a063-4f31-bd5e-74288d5ab3f4 req-3d87b419-cb7c-4831-bca6-4fb0a76a0d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d2860d-7a2a-483e-a583-eb906bc19196", "name": "network-vif-deleted", "tag": "25aaa070-20b7-4ef4-8f78-81a72c3c2111"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:49:16.750399 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:49:16.750675 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:49:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.87) !!! Oct 17 16:49:16.760809 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d41b62d4-a063-4f31-bd5e-74288d5ab3f4 req-3d87b419-cb7c-4831-bca6-4fb0a76a0d49 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:16.761372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d41b62d4-a063-4f31-bd5e-74288d5ab3f4 req-3d87b419-cb7c-4831-bca6-4fb0a76a0d49 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:16.761830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d41b62d4-a063-4f31-bd5e-74288d5ab3f4 req-3d87b419-cb7c-4831-bca6-4fb0a76a0d49 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:16.776987 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d41b62d4-a063-4f31-bd5e-74288d5ab3f4 req-3d87b419-cb7c-4831-bca6-4fb0a76a0d49 service nova] Creating event network-vif-deleted:25aaa070-20b7-4ef4-8f78-81a72c3c2111 for instance 53d2860d-7a2a-483e-a583-eb906bc19196 on n-h2-854441-12 Oct 17 16:49:16.781993 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d41b62d4-a063-4f31-bd5e-74288d5ab3f4 req-3d87b419-cb7c-4831-bca6-4fb0a76a0d49 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044247 Oct 17 16:49:16.782639 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3757/7785] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:49:16.982933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:16.983540 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:16.991319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:16.991811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:16.992256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:16.992929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:16.993404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:16.993867 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:17.030864 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:17.031396 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:17.031835 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:17.032295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lazy-loading 'fault' on Instance uuid 53d2860d-7a2a-483e-a583-eb906bc19196 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:49:17.075539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:17.084019 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-696e7e44-925d-4446-a773-b3b47c568915 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 200 len: 1355 microversion: 2.1 time: 0.105203 Oct 17 16:49:17.084634 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4029/7786] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:16 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:18.109928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:18.110684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: 53d2860d-7a2a-483e-a583-eb906bc19196] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:18.118050 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:18.118655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:18.119158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:18.119937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:18.120444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:18.120972 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:18.136247 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] HTTP exception thrown: Instance 53d2860d-7a2a-483e-a583-eb906bc19196 could not be found. Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Request method failure captured: Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 HTTP/1.1 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYYLuOLLXIuQTkzyWw0LnoZrEZX3TRZJYNUUWQX-PZQpk-DWm4Gi96GxRyZvpzhFJYE24RCuB9E9lEW8pl0DrmmLHVemSNFojHFYHEw3cfQ4wOYbg-IHQIb6AuTQwGf9aR7mE8N8ddDz3bvtUYh6xb5jAN9H5eb4rEy8FoQEK3QvJP0 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: ead73cf4fa65485b8a4878642c2c3aed Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 53d2860d-7a2a-483e-a583-eb906bc19196 could not be found. Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '53d2860d-7a2a-483e-a583-eb906bc19196'} Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d2860d-7a2a-483e-a583-eb906bc19196 could not be found. Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d2860d-7a2a-483e-a583-eb906bc19196 could not be found. Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:49:18.137926 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d2860d-7a2a-483e-a583-eb906bc19196 could not be found. Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Returning 404 to user: Instance 53d2860d-7a2a-483e-a583-eb906bc19196 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ccf6aff0-917c-4f1a-b98d-60437ec625ed tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196" status: 404 len: 111 microversion: 2.1 time: 0.034832 Oct 17 16:49:18.143229 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3758/7787] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:18 2022] GET /compute/v2.1/servers/53d2860d-7a2a-483e-a583-eb906bc19196 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:49:21.603601 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-412e30fe-d11d-4ba0-9866-6a6ec19db85c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '.version_select at 0x7f28bedbe0d0>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:21.627144 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-412e30fe-d11d-4ba0-9866-6a6ec19db85c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1152640370" status: 202 len: 0 microversion: 2.1 time: 0.027517 Oct 17 16:49:21.627743 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4030/7788] 10.222.0.87 () {58 vars in 1284 bytes} [Mon Oct 17 16:49:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1152640370 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:49:21.661924 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b0149a32-8355-4f0f-94c6-06a791b28083 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: .version_select at 0x7f28bc02e790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-535247917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPexGWruzUOx5GNrFntwfrWMRZK6AAjhjbMrKdG7upagru8YPk55pq2kk0NjREd5MkcfXd+DkcW/vX6Pve+Il/GXnDVjF2OprrMDPKWHLIW+ak2DRmgwLDVOvEEREca5RQ=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:49:21.682202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b0149a32-8355-4f0f-94c6-06a791b28083 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:49:21.688423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-b0149a32-8355-4f0f-94c6-06a791b28083 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:49:21.716131 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b0149a32-8355-4f0f-94c6-06a791b28083 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058253 Oct 17 16:49:21.716758 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3759/7789] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:49:21 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:49:27.048779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-971052472", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "networks": [{"uuid": "65df664a-645e-4205-aa55-708b49d34329"}], "key_name": "tempest-TestNetworkAdvancedServerOps-535247917", "security_groups": [{"name": "tempest-secgroup-smoke-193134466"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:49:27.079779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:27.177046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] validate_networks() for [('65df664a-645e-4205-aa55-708b49d34329', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:49:27.667437 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:49:27.667853 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:49:27.668326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:49:27.669078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:49:27.669673 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:49:27.681744 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:27.682395 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:27.683014 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:27.683587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:27.684027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:27.684452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:27.703433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:49:27.709767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Getting quotas for user ead73cf4fa65485b8a4878642c2c3aed and project 7084b55cf35d44848f86a6f461bd8d47. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:49:27.727180 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:49:27.729402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:49:27.788917 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3cbbd1aa-b4f9-4238-b843-861174bfda38 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.742955 Oct 17 16:49:27.789449 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4031/7790] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:49:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 16:49:27.803726 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a387534-d07c-4885-bb58-8bd66e33271b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:27.804363 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a387534-d07c-4885-bb58-8bd66e33271b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:27.882215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1a387534-d07c-4885-bb58-8bd66e33271b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:27.892189 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a387534-d07c-4885-bb58-8bd66e33271b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1265 microversion: 2.1 time: 0.095762 Oct 17 16:49:27.907299 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3760/7791] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:27 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:28.917479 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:28.918398 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:28.926470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:28.926989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:28.927427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:28.928190 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:28.928649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:28.929067 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:29.031604 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:29.045002 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd76ffbd-902b-49e9-bd1c-51a3b0818404 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1325 microversion: 2.1 time: 0.131482 Oct 17 16:49:29.047299 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4032/7792] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:28 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1325 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:30.069711 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:30.070336 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:30.073707 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=16 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:30.080380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:30.081204 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:30.081864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:30.083112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:30.083750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:30.084373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:30.239348 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:30.261816 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8b0b6786-33bf-43ba-a6c2-7dc6d24112d4 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1390 microversion: 2.1 time: 0.195843 Oct 17 16:49:30.262788 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3761/7793] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:30 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1390 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:30.936070 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-8cbcc492-ffac-4c21-9b85-3ec2ca3de1d2 req-60f75d10-fad5-4824-aba5-f1f0834a49bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9011e19-4971-42eb-91f3-7542245864bc", "tag": "01533056-2f92-4677-a84c-23fa6a93b5a4"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:49:30.951483 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8cbcc492-ffac-4c21-9b85-3ec2ca3de1d2 req-60f75d10-fad5-4824-aba5-f1f0834a49bd service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:30.952245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8cbcc492-ffac-4c21-9b85-3ec2ca3de1d2 req-60f75d10-fad5-4824-aba5-f1f0834a49bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:30.952875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-8cbcc492-ffac-4c21-9b85-3ec2ca3de1d2 req-60f75d10-fad5-4824-aba5-f1f0834a49bd service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:30.965398 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-8cbcc492-ffac-4c21-9b85-3ec2ca3de1d2 req-60f75d10-fad5-4824-aba5-f1f0834a49bd service nova] Creating event network-changed:01533056-2f92-4677-a84c-23fa6a93b5a4 for instance e9011e19-4971-42eb-91f3-7542245864bc on n-h1-854441-12 Oct 17 16:49:30.971095 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-8cbcc492-ffac-4c21-9b85-3ec2ca3de1d2 req-60f75d10-fad5-4824-aba5-f1f0834a49bd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038859 Oct 17 16:49:30.972285 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4033/7794] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:49:31.286451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:31.287247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:31.295556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:31.296509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:31.296979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:31.297725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:31.298195 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:31.298673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:31.443470 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:31.452038 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-58fb3ff9-5206-4c0f-bc06-9c13e7b34b8b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1390 microversion: 2.1 time: 0.169978 Oct 17 16:49:31.452606 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3762/7795] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:31 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:32.476844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:32.477515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:32.485038 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:32.485792 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:32.486266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:32.487008 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:32.487466 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:32.487889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:32.732803 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:32.741958 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-64782518-7dc3-44be-bba8-d899e7434e6a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1390 microversion: 2.1 time: 0.270318 Oct 17 16:49:32.753383 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4034/7796] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:32 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1390 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:33.766155 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:33.766758 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:33.774100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:33.774662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:33.775127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:33.775884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:33.776360 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:33.776804 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:33.921660 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:33.930153 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e1ae4620-4cc3-4425-8e7b-3c9efbc4c041 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1390 microversion: 2.1 time: 0.168088 Oct 17 16:49:33.930792 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3763/7797] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:33 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:34.954077 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:34.954797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:34.962113 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:34.962653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:34.963098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:34.963811 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:34.964271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:34.964701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:34.971253 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-227261e5-a49d-402f-96d4-151df5fa2049 req-f2f60b00-2893-4c35-9e01-90dbda606464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9011e19-4971-42eb-91f3-7542245864bc", "name": "network-vif-plugged", "status": "completed", "tag": "01533056-2f92-4677-a84c-23fa6a93b5a4"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:49:34.988858 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-227261e5-a49d-402f-96d4-151df5fa2049 req-f2f60b00-2893-4c35-9e01-90dbda606464 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:34.989806 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-227261e5-a49d-402f-96d4-151df5fa2049 req-f2f60b00-2893-4c35-9e01-90dbda606464 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:34.990988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-227261e5-a49d-402f-96d4-151df5fa2049 req-f2f60b00-2893-4c35-9e01-90dbda606464 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:35.004911 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-227261e5-a49d-402f-96d4-151df5fa2049 req-f2f60b00-2893-4c35-9e01-90dbda606464 service nova] Creating event network-vif-plugged:01533056-2f92-4677-a84c-23fa6a93b5a4 for instance e9011e19-4971-42eb-91f3-7542245864bc on n-h1-854441-12 Oct 17 16:49:35.014325 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-227261e5-a49d-402f-96d4-151df5fa2049 req-f2f60b00-2893-4c35-9e01-90dbda606464 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046949 Oct 17 16:49:35.015310 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3764/7798] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:49:35.186243 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:35.194989 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3af699a2-83e1-4b27-9c3c-ad345a1bcc3b tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1390 microversion: 2.1 time: 0.245554 Oct 17 16:49:35.195581 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4035/7799] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:34 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1390 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:36.222379 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:36.223093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:36.231130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:36.231634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:36.232084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:36.232810 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:36.233272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:36.233705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:36.386732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:36.395271 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c9134168-b93b-472d-ad27-6b5c727530a7 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1562 microversion: 2.1 time: 0.179080 Oct 17 16:49:36.395851 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3765/7800] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:36 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:36.417389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:36.418024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:36.425176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:36.425751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:36.426199 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:36.426927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:36.427384 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:36.427818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:36.566952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:36.579099 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6ee6053a-04f6-4998-87aa-52c719f6a1c2 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1562 microversion: 2.1 time: 0.165455 Oct 17 16:49:36.579995 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4036/7801] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:36 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:38.228603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:49:38.229215 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:38.229878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-3acf5d83-bed5-43fa-afa8-95905e3da007 req-a8901788-6467-478c-b8a8-6957eba80af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9011e19-4971-42eb-91f3-7542245864bc", "tag": "01533056-2f92-4677-a84c-23fa6a93b5a4"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:49:38.233345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:38.234087 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:38.238526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:38.239384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:38.239937 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:38.240974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:38.241658 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:38.242109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:38.242614 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:38.243657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:38.246428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3acf5d83-bed5-43fa-afa8-95905e3da007 req-a8901788-6467-478c-b8a8-6957eba80af4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:38.247161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3acf5d83-bed5-43fa-afa8-95905e3da007 req-a8901788-6467-478c-b8a8-6957eba80af4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:38.247806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-3acf5d83-bed5-43fa-afa8-95905e3da007 req-a8901788-6467-478c-b8a8-6957eba80af4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:38.263699 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-3acf5d83-bed5-43fa-afa8-95905e3da007 req-a8901788-6467-478c-b8a8-6957eba80af4 service nova] Creating event network-changed:01533056-2f92-4677-a84c-23fa6a93b5a4 for instance e9011e19-4971-42eb-91f3-7542245864bc on n-h1-854441-12 Oct 17 16:49:38.269135 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-3acf5d83-bed5-43fa-afa8-95905e3da007 req-a8901788-6467-478c-b8a8-6957eba80af4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043486 Oct 17 16:49:38.270165 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4037/7802] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:49:38.399240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:49:38.407726 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-3ceeb444-da44-47d6-ae9b-1483abd03af3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1562 microversion: 2.1 time: 0.183954 Oct 17 16:49:38.409141 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3766/7803] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:49:38 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1562 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:49:59.696961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:59.697772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=30 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:49:59.702341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a7b6111a-3275-4922-8394-3fb74000b8f8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:49:59.704940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a7b6111a-3275-4922-8394-3fb74000b8f8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:49:59.712829 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7b6111a-3275-4922-8394-3fb74000b8f8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:59.713319 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7b6111a-3275-4922-8394-3fb74000b8f8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:59.713737 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7b6111a-3275-4922-8394-3fb74000b8f8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:59.714426 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7b6111a-3275-4922-8394-3fb74000b8f8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:49:59.714921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7b6111a-3275-4922-8394-3fb74000b8f8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:49:59.715560 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a7b6111a-3275-4922-8394-3fb74000b8f8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:49:59.773626 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a7b6111a-3275-4922-8394-3fb74000b8f8 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action" status: 200 len: 24571 microversion: 2.1 time: 0.078493 Oct 17 16:49:59.774320 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4038/7804] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:49:59 2022] POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action => generated 24571 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:50:10.868208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:10.868826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:10.871272 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:50:10.871954 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=32 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:50:10.877175 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:10.877684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:10.878183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:10.879120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:10.879390 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:10.879832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:10.908032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lazy-loading 'flavor' on Instance uuid e9011e19-4971-42eb-91f3-7542245864bc {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:50:10.992243 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-43687194-3291-47c2-99d1-562a0c959346 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action" status: 202 len: 0 microversion: 2.1 time: 0.127879 Oct 17 16:50:10.993134 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3767/7805] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:50:10 2022] POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:50:11.002538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:11.003405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:11.007842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:50:11.008491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:50:11.014482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:11.015537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:11.015990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:11.016711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:11.017173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:11.017840 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:11.161375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:11.169618 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5fdbb68b-2898-4067-86e9-61e71ad3b0ba tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1689 microversion: 2.1 time: 0.172126 Oct 17 16:50:11.170200 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4039/7806] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:10 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:12.199934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:12.200727 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:12.208419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:12.208929 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:12.209377 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:12.210088 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:12.210555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:12.210993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:12.379768 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:12.390430 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f3412491-3efa-4a83-b343-5b9e2f12b3fc tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1672 microversion: 2.1 time: 0.199739 Oct 17 16:50:12.391221 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3768/7807] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:12 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1672 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:13.491408 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be7aaabb-b0dc-4cf5-ae7c-0a911bd897fe tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:13.493663 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be7aaabb-b0dc-4cf5-ae7c-0a911bd897fe tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:13.502087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be7aaabb-b0dc-4cf5-ae7c-0a911bd897fe tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:13.502615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be7aaabb-b0dc-4cf5-ae7c-0a911bd897fe tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:13.503059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be7aaabb-b0dc-4cf5-ae7c-0a911bd897fe tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:13.503764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be7aaabb-b0dc-4cf5-ae7c-0a911bd897fe tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:13.504301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be7aaabb-b0dc-4cf5-ae7c-0a911bd897fe tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:13.504730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be7aaabb-b0dc-4cf5-ae7c-0a911bd897fe tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:13.557803 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be7aaabb-b0dc-4cf5-ae7c-0a911bd897fe tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action" status: 200 len: 38357 microversion: 2.1 time: 0.070294 Oct 17 16:50:13.558483 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4040/7808] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:50:13 2022] POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action => generated 38357 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:50:13.573714 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4acb5444-9061-4dfa-9af3-ba3bf240ce9f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:13.574279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4acb5444-9061-4dfa-9af3-ba3bf240ce9f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:13.582386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4acb5444-9061-4dfa-9af3-ba3bf240ce9f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:13.582917 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4acb5444-9061-4dfa-9af3-ba3bf240ce9f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:13.583404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4acb5444-9061-4dfa-9af3-ba3bf240ce9f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:13.584100 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4acb5444-9061-4dfa-9af3-ba3bf240ce9f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:13.584611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4acb5444-9061-4dfa-9af3-ba3bf240ce9f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:13.585051 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4acb5444-9061-4dfa-9af3-ba3bf240ce9f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:13.932329 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4acb5444-9061-4dfa-9af3-ba3bf240ce9f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action" status: 202 len: 0 microversion: 2.1 time: 0.362327 Oct 17 16:50:13.932950 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3769/7809] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:50:13 2022] POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:50:13.943740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:13.944460 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:13.952695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:13.953297 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:13.953948 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:13.954994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:13.955658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:13.956260 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:14.188290 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:14.197021 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec1102f3-6331-4897-acf2-0356fd619f43 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1678 microversion: 2.1 time: 0.258216 Oct 17 16:50:14.197639 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4041/7810] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:13 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1678 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:15.222888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:15.223627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:15.230300 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:15.230931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:15.231419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:15.232128 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:15.232589 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:15.233023 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:15.379835 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:15.388283 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7d075c78-7625-46a9-808d-aeb438589d44 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1678 microversion: 2.1 time: 0.170744 Oct 17 16:50:15.388864 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3770/7811] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:15 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:16.412183 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:16.412828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:16.420163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:16.420664 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:16.421103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:16.421809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:16.422256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:16.422717 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:16.565413 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:16.574200 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0200e272-eedf-438d-97a3-8c7573a5bb67 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1681 microversion: 2.1 time: 0.166253 Oct 17 16:50:16.574849 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4042/7812] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:16 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:16.679021 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b8a6a9fc-dd30-4bcc-91bd-7f697279b34c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:16.681327 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b8a6a9fc-dd30-4bcc-91bd-7f697279b34c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:16.689161 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a6a9fc-dd30-4bcc-91bd-7f697279b34c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:16.689662 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a6a9fc-dd30-4bcc-91bd-7f697279b34c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:16.690095 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a6a9fc-dd30-4bcc-91bd-7f697279b34c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:16.690842 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a6a9fc-dd30-4bcc-91bd-7f697279b34c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:16.691318 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a6a9fc-dd30-4bcc-91bd-7f697279b34c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:16.691750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b8a6a9fc-dd30-4bcc-91bd-7f697279b34c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:16.735331 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b8a6a9fc-dd30-4bcc-91bd-7f697279b34c tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action" status: 200 len: 38357 microversion: 2.1 time: 0.060265 Oct 17 16:50:16.735997 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3771/7813] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:50:16 2022] POST /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc/action => generated 38357 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 16:50:18.123773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:18.124341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:18.127165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-56893be4-2b27-4fa1-b99b-7319c61bf904 req-aa187eb3-881a-4e7b-9f80-459a3dd1ca64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9011e19-4971-42eb-91f3-7542245864bc", "tag": "01533056-2f92-4677-a84c-23fa6a93b5a4"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:18.132099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:18.132603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:18.133043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:18.133766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:18.134335 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:18.135171 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:18.140998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-56893be4-2b27-4fa1-b99b-7319c61bf904 req-aa187eb3-881a-4e7b-9f80-459a3dd1ca64 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:18.141482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-56893be4-2b27-4fa1-b99b-7319c61bf904 req-aa187eb3-881a-4e7b-9f80-459a3dd1ca64 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:18.141933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-56893be4-2b27-4fa1-b99b-7319c61bf904 req-aa187eb3-881a-4e7b-9f80-459a3dd1ca64 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:18.157010 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-56893be4-2b27-4fa1-b99b-7319c61bf904 req-aa187eb3-881a-4e7b-9f80-459a3dd1ca64 service nova] Creating event network-changed:01533056-2f92-4677-a84c-23fa6a93b5a4 for instance e9011e19-4971-42eb-91f3-7542245864bc on n-h1-854441-12 Oct 17 16:50:18.163323 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-56893be4-2b27-4fa1-b99b-7319c61bf904 req-aa187eb3-881a-4e7b-9f80-459a3dd1ca64 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040862 Oct 17 16:50:18.164862 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3772/7814] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:50:18.168706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:50:18.271347 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e92faa0-30f1-4f15-b879-b548937fa75f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 204 len: 0 microversion: 2.1 time: 0.151198 Oct 17 16:50:18.272797 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4043/7815] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:50:18 2022] DELETE /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:50:18.282441 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:18.283783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:18.292406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:18.292927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:18.293380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:18.294820 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:18.295357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:18.295814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:18.502603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:18.512586 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b3dd3b64-57fe-432a-bf27-821d649e3cc3 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1687 microversion: 2.1 time: 0.235110 Oct 17 16:50:18.513220 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3773/7816] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:18 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:50:19.537684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:19.538387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:19.545782 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:19.546283 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:19.546762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:19.547508 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:19.547962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:19.548393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:19.771080 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead73cf4fa65485b8a4878642c2c3aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7084b55cf35d44848f86a6f461bd8d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:19.779832 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-210f8cef-8f16-45de-82d6-fdf4b5608f0f tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 200 len: 1687 microversion: 2.1 time: 0.246683 Oct 17 16:50:19.780830 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4044/7817] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:19 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 1687 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:20.249133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-74d5c1fa-851e-442d-baac-f348579a264e req-1cf681da-a80f-4f1d-a887-a5744609c366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9011e19-4971-42eb-91f3-7542245864bc", "name": "network-vif-deleted", "tag": "01533056-2f92-4677-a84c-23fa6a93b5a4"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:20.261082 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-74d5c1fa-851e-442d-baac-f348579a264e req-1cf681da-a80f-4f1d-a887-a5744609c366 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:20.261321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-74d5c1fa-851e-442d-baac-f348579a264e req-1cf681da-a80f-4f1d-a887-a5744609c366 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:20.261713 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-74d5c1fa-851e-442d-baac-f348579a264e req-1cf681da-a80f-4f1d-a887-a5744609c366 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:20.274091 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-74d5c1fa-851e-442d-baac-f348579a264e req-1cf681da-a80f-4f1d-a887-a5744609c366 service nova] Creating event network-vif-deleted:01533056-2f92-4677-a84c-23fa6a93b5a4 for instance e9011e19-4971-42eb-91f3-7542245864bc on n-h1-854441-12 Oct 17 16:50:20.279599 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-74d5c1fa-851e-442d-baac-f348579a264e req-1cf681da-a80f-4f1d-a887-a5744609c366 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034073 Oct 17 16:50:20.280214 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3774/7818] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:50:20.811192 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:20.811898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] [instance: e9011e19-4971-42eb-91f3-7542245864bc] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:20.819480 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:20.819982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:20.820440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:20.821409 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:20.821602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:20.822048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:20.837701 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] HTTP exception thrown: Instance e9011e19-4971-42eb-91f3-7542245864bc could not be found. Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Request method failure captured: Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc HTTP/1.1 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYYLuOLLXIuQTkzyWw0LnoZrEZX3TRZJYNUUWQX-PZQpk-DWm4Gi96GxRyZvpzhFJYE24RCuB9E9lEW8pl0DrmmLHVemSNFojHFYHEw3cfQ4wOYbg-IHQIb6AuTQwGf9aR7mE8N8ddDz3bvtUYh6xb5jAN9H5eb4rEy8FoQEK3QvJP0 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/7084b55cf35d44848f86a6f461bd8d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 7084b55cf35d44848f86a6f461bd8d47 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-352095308 Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: ead73cf4fa65485b8a4878642c2c3aed Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-352095308-project Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance e9011e19-4971-42eb-91f3-7542245864bc could not be found. Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'e9011e19-4971-42eb-91f3-7542245864bc'} Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9011e19-4971-42eb-91f3-7542245864bc could not be found. Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9011e19-4971-42eb-91f3-7542245864bc could not be found. Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:50:20.839565 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9011e19-4971-42eb-91f3-7542245864bc could not be found. Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Returning 404 to user: Instance e9011e19-4971-42eb-91f3-7542245864bc could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3bdb14f1-dc5f-429f-b750-ac49f29bd209 tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc" status: 404 len: 111 microversion: 2.1 time: 0.034194 Oct 17 16:50:20.845088 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4045/7819] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:20 2022] GET /compute/v2.1/servers/e9011e19-4971-42eb-91f3-7542245864bc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:50:24.405540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d54a530-a93a-4d53-8d77-fb999d48bf3a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] Calling method '.version_select at 0x7f28bf11e550>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:24.429123 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2d54a530-a93a-4d53-8d77-fb999d48bf3a tempest-TestNetworkAdvancedServerOps-352095308 tempest-TestNetworkAdvancedServerOps-352095308-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-535247917" status: 202 len: 0 microversion: 2.1 time: 0.029439 Oct 17 16:50:24.429742 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3775/7820] 10.222.0.87 () {58 vars in 1281 bytes} [Mon Oct 17 16:50:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-535247917 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:50:37.599136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:50:37.601106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:50:37.848095 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3060185f-d130-4514-a4bd-edcd48df8b7b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Action: 'create', calling method: .version_select at 0x7f28be029ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-553806373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPiDXAff8EG14lLG0OIQstSo6RKu2tPbdxpZwiVuHiUAKVnvgQeVLBm7jbxygjm5g0FaAi3n+2YF77Ro8Q4GCoycmflF24MW4Vy0LgT4AcAPex5B6VA9HvEQvKdlPd1MQ=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:37.867593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3060185f-d130-4514-a4bd-edcd48df8b7b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Getting quotas for project 72cc53658d094ce9b09b22385511d74b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:50:37.876472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-3060185f-d130-4514-a4bd-edcd48df8b7b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Getting quotas for user 58f98f921c804e1daeb3189ee1047f95 and project 72cc53658d094ce9b09b22385511d74b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:50:37.910378 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3060185f-d130-4514-a4bd-edcd48df8b7b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.317469 Oct 17 16:50:37.911188 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4046/7821] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:50:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:50:39.122946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:50:39.123848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:50:39.129106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1168976195", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-553806373", "security_groups": [{"name": "tempest-secgroup-smoke-960770315"}], "networks": [{"uuid": "707a00fb-519b-4b7d-be6a-381b79c65493"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:39.254721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] validate_networks() for [('707a00fb-519b-4b7d-be6a-381b79c65493', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:50:39.804666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:50:39.805103 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:50:39.805581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:50:39.805995 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:50:39.806443 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:50:39.815723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:39.816342 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:39.816784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:39.817741 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:39.818190 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:39.818674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:39.840928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Getting quotas for project 72cc53658d094ce9b09b22385511d74b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:50:39.846559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Getting quotas for user 58f98f921c804e1daeb3189ee1047f95 and project 72cc53658d094ce9b09b22385511d74b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:50:39.861010 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:50:39.863601 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:50:39.915991 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e3440903-2b19-482c-b098-321dd86b5bd2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.794696 Oct 17 16:50:39.917192 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3776/7822] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:50:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:50:39.929743 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-82bd8d43-0b87-4aed-ba5d-c743d3832ee1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:39.931343 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-82bd8d43-0b87-4aed-ba5d-c743d3832ee1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:40.008131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-82bd8d43-0b87-4aed-ba5d-c743d3832ee1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:40.018298 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-82bd8d43-0b87-4aed-ba5d-c743d3832ee1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1246 microversion: 2.1 time: 0.093383 Oct 17 16:50:40.019487 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4047/7823] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:39 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:41.043646 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:41.044508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:41.051647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:41.052186 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:41.052639 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:41.053375 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:41.053901 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:41.054555 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:41.137800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:41.146544 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-362d9b0f-67ef-4fd0-be8b-ab2de122a4e0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1298 microversion: 2.1 time: 0.108285 Oct 17 16:50:41.147179 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3777/7824] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:41 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:42.175953 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:42.176707 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:42.189092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:42.190049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:42.190818 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:42.192018 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:42.192596 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:42.193525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:42.337753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:42.346545 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-35f321b6-f1a2-4e17-a7a4-cd20063a1b31 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1371 microversion: 2.1 time: 0.180349 Oct 17 16:50:42.347402 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4048/7825] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:42 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:42.959794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-4cf8deeb-a418-468a-9e3c-e9c19325d683 req-985d3388-fe26-49a9-adbf-b31aff6268e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37e5719-9420-4add-bd10-7271a1dfe162", "tag": "6cd58a74-e280-4a64-beb3-02bdd187df94"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:42.970605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4cf8deeb-a418-468a-9e3c-e9c19325d683 req-985d3388-fe26-49a9-adbf-b31aff6268e2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:42.971119 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4cf8deeb-a418-468a-9e3c-e9c19325d683 req-985d3388-fe26-49a9-adbf-b31aff6268e2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:42.971574 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-4cf8deeb-a418-468a-9e3c-e9c19325d683 req-985d3388-fe26-49a9-adbf-b31aff6268e2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:42.984739 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-4cf8deeb-a418-468a-9e3c-e9c19325d683 req-985d3388-fe26-49a9-adbf-b31aff6268e2 service nova] Creating event network-changed:6cd58a74-e280-4a64-beb3-02bdd187df94 for instance f37e5719-9420-4add-bd10-7271a1dfe162 on n-h1-854441-12 Oct 17 16:50:42.991101 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-4cf8deeb-a418-468a-9e3c-e9c19325d683 req-985d3388-fe26-49a9-adbf-b31aff6268e2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111287 Oct 17 16:50:42.991722 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3778/7826] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:50:43.373245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:43.373897 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:43.383045 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:43.383533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:43.383965 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:43.384657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:43.385089 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:43.385505 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:43.530766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:43.538871 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7dfcae44-7092-42ba-ae8f-37c9a0109146 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1371 microversion: 2.1 time: 0.172458 Oct 17 16:50:43.539488 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4049/7827] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:43 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:44.567306 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:44.568861 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:44.576430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:44.577120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:44.577756 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:44.578543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:44.579033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:44.579481 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:44.761911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:44.770482 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c7ae1f1a-1dd0-4d3e-ad2d-b99ee956c833 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1371 microversion: 2.1 time: 0.211831 Oct 17 16:50:44.771109 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3779/7828] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:44 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:45.793602 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:45.794464 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:45.801753 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:45.802241 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:45.802712 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:45.803418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:45.803878 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:45.804275 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:45.953919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:45.962592 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-4c0939df-f98b-47be-b08e-892a643d17e8 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1371 microversion: 2.1 time: 0.172919 Oct 17 16:50:45.963216 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4050/7829] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:45 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:46.993609 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:46.994289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:47.001757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:47.002265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:47.002730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:47.003492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:47.003955 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:47.004388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:47.159992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:47.168878 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5e63f628-5c2c-4647-821d-62e413ee1e00 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1371 microversion: 2.1 time: 0.179132 Oct 17 16:50:47.169481 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3780/7830] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:46 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:47.272339 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-752dcb68-63cb-4631-8a71-3a4622ae2263 req-4f70286d-0399-4144-8ee5-4bee19866bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37e5719-9420-4add-bd10-7271a1dfe162", "name": "network-vif-plugged", "status": "completed", "tag": "6cd58a74-e280-4a64-beb3-02bdd187df94"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:47.284788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-752dcb68-63cb-4631-8a71-3a4622ae2263 req-4f70286d-0399-4144-8ee5-4bee19866bbf service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:47.285749 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-752dcb68-63cb-4631-8a71-3a4622ae2263 req-4f70286d-0399-4144-8ee5-4bee19866bbf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:47.286146 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-752dcb68-63cb-4631-8a71-3a4622ae2263 req-4f70286d-0399-4144-8ee5-4bee19866bbf service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:47.304142 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-752dcb68-63cb-4631-8a71-3a4622ae2263 req-4f70286d-0399-4144-8ee5-4bee19866bbf service nova] Creating event network-vif-plugged:6cd58a74-e280-4a64-beb3-02bdd187df94 for instance f37e5719-9420-4add-bd10-7271a1dfe162 on n-h1-854441-12 Oct 17 16:50:47.311168 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-752dcb68-63cb-4631-8a71-3a4622ae2263 req-4f70286d-0399-4144-8ee5-4bee19866bbf service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042864 Oct 17 16:50:47.312105 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4051/7831] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:50:48.193383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:48.194048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:48.201436 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:48.201986 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:48.202397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:48.203150 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:48.203620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:48.204057 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:48.357389 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:48.365895 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8f7c888c-5c52-4cf9-903e-048a5d2c68f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1371 microversion: 2.1 time: 0.176424 Oct 17 16:50:48.366485 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3781/7832] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:48 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:49.394750 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:49.395446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:49.405119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:49.405735 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:49.406269 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:49.407331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:49.408020 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:49.408593 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:49.552807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:49.562748 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-924cd94c-d5df-44f1-b5f7-a3f757871712 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1555 microversion: 2.1 time: 0.175728 Oct 17 16:50:49.563592 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4052/7833] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:49 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:49.586343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:50:49.587011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:50:49.594540 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:49.595074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:49.595526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:49.596288 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:49.596761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:49.597201 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:49.745679 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:50:49.757583 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-dfe9cedb-586c-4782-8c6f-fd8a57cb99bf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1555 microversion: 2.1 time: 0.175238 Oct 17 16:50:49.758408 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3782/7834] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:50:49 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:50:51.847870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-296b33d7-d077-44f0-8fc1-087a3e15fe59 req-59c8f119-0eea-4759-b0b6-39bbe2d68e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37e5719-9420-4add-bd10-7271a1dfe162", "tag": "6cd58a74-e280-4a64-beb3-02bdd187df94"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:50:51.853007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:50:51.859902 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-296b33d7-d077-44f0-8fc1-087a3e15fe59 req-59c8f119-0eea-4759-b0b6-39bbe2d68e5e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:50:51.860387 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-296b33d7-d077-44f0-8fc1-087a3e15fe59 req-59c8f119-0eea-4759-b0b6-39bbe2d68e5e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:50:51.860819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-296b33d7-d077-44f0-8fc1-087a3e15fe59 req-59c8f119-0eea-4759-b0b6-39bbe2d68e5e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:50:51.872810 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-296b33d7-d077-44f0-8fc1-087a3e15fe59 req-59c8f119-0eea-4759-b0b6-39bbe2d68e5e service nova] Creating event network-changed:6cd58a74-e280-4a64-beb3-02bdd187df94 for instance f37e5719-9420-4add-bd10-7271a1dfe162 on n-h1-854441-12 Oct 17 16:50:51.877984 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-296b33d7-d077-44f0-8fc1-087a3e15fe59 req-59c8f119-0eea-4759-b0b6-39bbe2d68e5e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033897 Oct 17 16:50:51.878626 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4053/7835] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:52:46.257543 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70d19fdb-2e68-4188-b296-5d4cb59f3ab3] AMQP server on 10.222.0.87:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 16:52:46.258213 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:52:46.259142 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:52:46.260966 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 16:52:46.261199 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:52:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162/action (ip 10.222.0.87) !!! Oct 17 16:52:46.265183 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:52:46.266397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=34 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:52:46.272599 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:52:46.273146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:46.287874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:46.288511 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:46.288958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:46.289687 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:46.290159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:46.290631 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:46.315615 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lazy-loading 'flavor' on Instance uuid f37e5719-9420-4add-bd10-7271a1dfe162 {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:52:46.729831 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-321c8b59-8e23-4b5e-9744-99be3e917acf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "POST /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162/action" status: 202 len: 0 microversion: 2.1 time: 0.475208 Oct 17 16:52:46.730450 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3783/7836] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:52:46 2022] POST /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:52:46.737141 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac0a07ff-7a15-4651-9394-b7854521cfed] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:52:46.738146 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e330c2f8-e85a-4877-b463-0418903a3ce8] AMQP server on 10.222.0.87:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 16:52:46.739724 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 16:52:46.739858 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:52:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 (ip 10.222.0.87) !!! Oct 17 16:52:46.740982 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:52:46.742317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=28 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:52:46.747822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:46.748622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:46.759430 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:46.759914 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:46.760346 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:46.761049 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:46.761501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:46.761916 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:46.996598 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:47.008817 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-be66ecec-ac5e-435f-9482-101e3cf1e686 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.273505 Oct 17 16:52:47.009463 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4054/7837] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:46 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:48.043666 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:48.044371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:48.052870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:48.053367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:48.053803 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:48.054668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:48.055153 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:48.055591 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:48.059288 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] [70d19fdb-2e68-4188-b296-5d4cb59f3ab3] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 42956. Oct 17 16:52:48.201047 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:48.212470 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8204c7f2-959e-47dd-ab48-4aef472e880d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.175066 Oct 17 16:52:48.213084 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3784/7838] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:48 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:49.236248 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:49.236996 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:49.247642 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:49.248169 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:49.248607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:49.249317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:49.249769 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:49.250193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:49.254353 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [e330c2f8-e85a-4877-b463-0418903a3ce8] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 42962. Oct 17 16:52:49.258883 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac0a07ff-7a15-4651-9394-b7854521cfed] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 42960. Oct 17 16:52:49.390808 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:49.399287 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-981b962d-1aa3-44fe-af80-0c7f008241d5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.167066 Oct 17 16:52:49.399885 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4055/7839] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:49 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:50.423961 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:50.424625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:50.432553 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:50.433062 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:50.433509 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:50.434230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:50.434732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:50.435168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:50.594870 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:50.603390 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a8a92f8f-894c-44d6-a050-cf570548ed3c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.183828 Oct 17 16:52:50.604010 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3785/7840] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:50 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:51.627534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:51.628195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:51.636362 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:51.636860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:51.637273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:51.638023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:51.638486 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:51.638947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:51.792141 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:51.800395 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9d589064-9c33-44c1-b97c-98fa86b3c36a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.176928 Oct 17 16:52:51.800977 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4056/7841] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:51 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:52.824530 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:52.825171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:52.832890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:52.833400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:52.833828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:52.834743 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:52.835536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:52.836131 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:52.996974 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:53.006402 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e4eddefc-afea-492e-aabb-c951e809be38 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.185652 Oct 17 16:52:53.007306 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3786/7842] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:52 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:54.031119 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:54.031767 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:54.039379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:54.039877 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:54.040326 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:54.041040 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:54.041494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:54.041928 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:54.178094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:54.186343 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-68b640cd-67dd-4387-bb09-e3354f11b9de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.159373 Oct 17 16:52:54.186947 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4057/7843] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:54 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:55.210345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:55.211028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:55.218800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:55.219344 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:55.219831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:55.220556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:55.221028 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:55.221503 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:55.368642 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:55.377229 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f22f766b-ff8d-4748-994d-af24c8bb5726 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.170842 Oct 17 16:52:55.377808 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3787/7844] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:55 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:56.401669 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:56.402305 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:56.409945 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:56.410443 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:56.410917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:56.411610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:56.412078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:56.412474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:56.565841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:56.574582 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d97e5157-21bc-4148-9aec-17a060db7195 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.176995 Oct 17 16:52:56.575170 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4058/7845] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:56 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:57.598634 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:57.599301 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:57.606868 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:57.607398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:57.607867 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:57.608557 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:57.609022 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:57.609455 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:57.752840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:57.761812 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e41e7011-6f08-45e4-8a73-2ada7520045c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1699 microversion: 2.1 time: 0.167138 Oct 17 16:52:57.762402 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3788/7846] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:57 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1699 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:58.785762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:58.786432 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:58.793754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:58.794236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:58.794703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:58.795397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:58.795841 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:58.796258 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:58.940554 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:52:58.949090 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f36a10b0-406e-4562-92aa-211d1767f927 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1699 microversion: 2.1 time: 0.167334 Oct 17 16:52:58.949710 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4059/7847] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:58 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1699 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:52:59.972517 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:52:59.973192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:52:59.981596 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:59.982109 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:59.982590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:52:59.983349 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:52:59.983819 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:52:59.984238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:00.153732 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:00.164488 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-984e48bf-59f4-463c-b318-ce130a7e85cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1694 microversion: 2.1 time: 0.196196 Oct 17 16:53:00.166695 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3789/7848] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:52:59 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:01.193094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:01.195455 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:01.204984 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:01.205481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:01.205921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:01.206676 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:01.207131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:01.207559 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:01.364929 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:01.373460 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3869a767-437e-4560-ab54-a2872cc53390 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1694 microversion: 2.1 time: 0.184343 Oct 17 16:53:01.377996 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4060/7849] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:01 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:01.951185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-939085dd-165f-410e-8307-12f1e257b693 req-a04375d6-28c3-46b4-a4fc-bc29c50047de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37e5719-9420-4add-bd10-7271a1dfe162", "name": "network-vif-plugged", "status": "completed", "tag": "6cd58a74-e280-4a64-beb3-02bdd187df94"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:53:01.974172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-939085dd-165f-410e-8307-12f1e257b693 req-a04375d6-28c3-46b4-a4fc-bc29c50047de service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:01.974720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-939085dd-165f-410e-8307-12f1e257b693 req-a04375d6-28c3-46b4-a4fc-bc29c50047de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:01.975448 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-939085dd-165f-410e-8307-12f1e257b693 req-a04375d6-28c3-46b4-a4fc-bc29c50047de service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:01.987914 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-939085dd-165f-410e-8307-12f1e257b693 req-a04375d6-28c3-46b4-a4fc-bc29c50047de service nova] Creating event network-vif-plugged:6cd58a74-e280-4a64-beb3-02bdd187df94 for instance f37e5719-9420-4add-bd10-7271a1dfe162 on n-h1-854441-12 Oct 17 16:53:01.996800 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-939085dd-165f-410e-8307-12f1e257b693 req-a04375d6-28c3-46b4-a4fc-bc29c50047de service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126934 Oct 17 16:53:01.997513 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3790/7850] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:53:02.406723 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:02.407579 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:02.415502 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:02.416317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:02.416756 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:02.417714 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:02.418213 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:02.418666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:02.579925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:02.590526 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-282d12cc-de04-41e0-b8bb-c4070be0f930 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1694 microversion: 2.1 time: 0.190114 Oct 17 16:53:02.591159 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4061/7851] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:02 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1694 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:03.617298 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:03.618767 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:03.625828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:03.626943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:03.627693 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:03.628720 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:03.629475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:03.630221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:03.808271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:03.817303 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6f87c154-f5a8-457c-afc5-70a745d35e6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1694 microversion: 2.1 time: 0.205447 Oct 17 16:53:03.831930 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3791/7852] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:03 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:04.845354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:04.846741 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:04.854904 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:04.855632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:04.856136 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:04.857074 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:04.857521 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:04.857940 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:05.029574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:05.040638 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95b35139-28e8-4bb6-b945-678a9fa9cdf7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1694 microversion: 2.1 time: 0.200800 Oct 17 16:53:05.050047 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4062/7853] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:04 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:06.064345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:06.064964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:06.073482 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:06.074024 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:06.074484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:06.075368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:06.075846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:06.076289 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:06.256521 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:06.265162 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb09689e-43fc-43cc-8175-969559ca5a35 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1694 microversion: 2.1 time: 0.204714 Oct 17 16:53:06.267171 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3792/7854] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:06 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1694 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:07.293964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:07.295151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:07.305659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:07.306314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:07.306795 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:07.307512 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:07.307968 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:07.308393 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:07.478960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:07.487804 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7c3be9f8-ed7e-4d48-8046-0f57cdccb124 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1694 microversion: 2.1 time: 0.197956 Oct 17 16:53:07.488369 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4063/7855] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:07 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:08.514641 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:08.517385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:08.527454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:08.528203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:08.528644 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:08.529556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:08.530014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:08.530453 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:08.711406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:08.724167 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1613dc15-05bd-4bce-96a9-096fdddcac2b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1694 microversion: 2.1 time: 0.212574 Oct 17 16:53:08.724821 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3793/7856] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:08 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1694 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:09.748859 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:09.749488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:09.756995 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:09.757476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:09.757918 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:09.758658 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:09.759112 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:09.759537 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:09.901701 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:09.910157 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f2c53ee3-4888-4a47-b19d-634b11700545 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1676 microversion: 2.1 time: 0.165309 Oct 17 16:53:09.910789 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4064/7857] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:09 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:10.935435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:10.936129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:10.944657 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:10.945171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:10.945627 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:10.946357 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:10.946873 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:10.947366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:11.090943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:11.100919 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-401e2b6b-4da6-4193-8190-3c2ca533a166 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1676 microversion: 2.1 time: 0.169290 Oct 17 16:53:11.101652 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3794/7858] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:10 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:11.862923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-fabda797-9ef5-47c3-9f16-f01e852ec5f3 req-a1869b2c-6020-48bc-8ab1-a02621a26c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37e5719-9420-4add-bd10-7271a1dfe162", "name": "network-vif-unplugged", "status": "completed", "tag": "6cd58a74-e280-4a64-beb3-02bdd187df94"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:53:11.878993 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fabda797-9ef5-47c3-9f16-f01e852ec5f3 req-a1869b2c-6020-48bc-8ab1-a02621a26c04 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:11.879470 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fabda797-9ef5-47c3-9f16-f01e852ec5f3 req-a1869b2c-6020-48bc-8ab1-a02621a26c04 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:11.879919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-fabda797-9ef5-47c3-9f16-f01e852ec5f3 req-a1869b2c-6020-48bc-8ab1-a02621a26c04 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:11.914127 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-fabda797-9ef5-47c3-9f16-f01e852ec5f3 req-a1869b2c-6020-48bc-8ab1-a02621a26c04 service nova] Creating event network-vif-unplugged:6cd58a74-e280-4a64-beb3-02bdd187df94 for instance f37e5719-9420-4add-bd10-7271a1dfe162 on n-h1-854441-12 Oct 17 16:53:11.924670 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-fabda797-9ef5-47c3-9f16-f01e852ec5f3 req-a1869b2c-6020-48bc-8ab1-a02621a26c04 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065748 Oct 17 16:53:11.926749 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4065/7859] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:53:12.125947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:12.126611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:12.135888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:12.136535 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:12.136847 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:12.137577 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:12.138058 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:12.138525 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:12.285033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:12.293201 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1acbbf0b-a75e-4bb1-a4ba-f3ddd5e0b560 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1619 microversion: 2.1 time: 0.171228 Oct 17 16:53:12.293780 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3795/7860] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:12 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1619 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:12.316805 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:53:12.317516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:12.324093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:12.324581 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:12.325023 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:12.325726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:12.326176 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:12.326636 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:12.372543 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120406) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 16:53:12.445619 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ff999ca2-3bfb-4969-873f-27ec787071cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "POST /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162/action" status: 202 len: 0 microversion: 2.1 time: 0.133140 Oct 17 16:53:12.446876 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4066/7861] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:53:12 2022] POST /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:53:12.455335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:12.455945 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:12.462315 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:12.462843 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:12.463292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:12.464016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:12.464475 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:12.464903 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:12.619800 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:12.628718 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-46193e3e-472d-4021-ad86-93e22dce7f81 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1627 microversion: 2.1 time: 0.177135 Oct 17 16:53:12.629335 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3796/7862] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:12 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1627 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:13.665310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:13.665925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:13.673053 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:13.673557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:13.674634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:13.675423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:13.675970 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:13.676389 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:13.824449 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:13.833438 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ab39b4ba-bdb6-4b5c-aea2-fe6a2114ea16 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.172917 Oct 17 16:53:13.834027 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4067/7863] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:13 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:14.857838 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:14.859168 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:14.867052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:14.867927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:14.868585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:14.869526 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:14.870203 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:14.870883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:15.086733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:15.096784 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-381f283b-27fb-40f5-9111-b3dcb745226d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.242999 Oct 17 16:53:15.097777 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3797/7864] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:14 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:53:16.140823 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:16.142655 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:16.151862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:16.152903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:16.153338 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:16.154059 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:16.154532 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:16.154963 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:16.310132 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:16.324057 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f67e0c7c-7755-4ea3-b3e3-b93e391a1fbb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.188669 Oct 17 16:53:16.324833 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4068/7865] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:16 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:17.357669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:17.359370 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:17.370139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=31 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:53:17.372789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:17.374114 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:17.374840 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:17.375876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:17.376483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:17.377066 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:17.385568 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:53:17.543598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:17.553833 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8e306303-6eaa-4e50-94a7-553e1f20561c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.205493 Oct 17 16:53:17.554621 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3798/7866] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:17 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:18.588434 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:18.589016 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:18.591316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:53:18.598485 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:18.598999 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:18.599491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:18.600406 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:18.600845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:18.601272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:18.620931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:53:18.761949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:18.770758 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84c3dcae-f022-417c-8714-78721a78bf8b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.190145 Oct 17 16:53:18.771577 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4069/7867] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:18 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:19.794320 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:19.795065 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:19.802428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:19.802979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:19.803610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:19.804355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:19.804829 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:19.805278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:19.952674 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:19.961186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-998ecbc5-0469-4dc1-af81-3bfe6c7f95c5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.170992 Oct 17 16:53:19.962000 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3799/7868] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:19 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:20.991580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:20.992879 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:21.003740 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:21.004301 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:21.004765 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:21.005495 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:21.006265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:21.006725 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:21.178247 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:21.186643 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-08593b13-e103-4adb-b8ba-333c1680796d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.201984 Oct 17 16:53:21.187456 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4070/7869] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:20 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:22.213831 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:22.214663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:22.223862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:22.224537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:22.225127 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:22.225998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:22.226632 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:22.227209 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:22.386837 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:22.396205 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8d441a9c-02a6-4927-a1d9-e7cb037a01e9 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.189722 Oct 17 16:53:22.407700 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3800/7870] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:22 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:23.422836 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:23.423705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:23.433698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:23.434272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:23.434794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:23.435696 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:23.436350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:23.436762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:23.579997 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:23.589796 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dd47c6f4-41e8-4e2f-baf6-cf079f9d514f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.171494 Oct 17 16:53:23.590738 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4071/7871] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:23 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:24.621723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:24.622431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:24.629456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:24.629960 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:24.630413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:24.631502 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:24.631979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:24.632419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:24.776237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:24.784883 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b85133f5-48ef-4386-924d-5043a6238beb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.169708 Oct 17 16:53:24.786442 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3801/7872] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:24 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:25.808752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:25.809337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:25.816550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:25.817032 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:25.817488 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:25.818197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:25.818688 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:25.819118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:25.967238 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:25.979013 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a2da5343-233c-4c4f-a422-39b20ef1a200 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.174150 Oct 17 16:53:25.979811 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4072/7873] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:25 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:27.004548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:27.005222 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:27.013158 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:27.013667 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:27.014110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:27.014830 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:27.015317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:27.015754 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:27.155722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:27.163892 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-36332c9a-b717-4e34-93c9-9f58b0191d82 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.163385 Oct 17 16:53:27.164481 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3802/7874] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:26 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:53:28.190359 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:28.191063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:28.199538 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:28.200017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:28.200457 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:28.201178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:28.201624 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:28.202047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:28.345273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:28.353168 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-733bb011-b1cd-416f-a88b-c2e1d0e53e7d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.169353 Oct 17 16:53:28.353779 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4073/7875] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:28 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:29.380237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:29.382113 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:29.389915 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:29.390604 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:29.391006 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:29.391760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:29.392228 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:29.392668 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:29.531428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:29.539702 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eae659c8-d0c1-4e2a-a33c-81db5eb67bdf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.166570 Oct 17 16:53:29.540616 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3803/7876] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:29 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:30.007600 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-81331f9b-0cf2-4a5c-8035-bb07500dc2d3 req-77acb7aa-e5e4-4f71-a1b5-9502a4abd20f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37e5719-9420-4add-bd10-7271a1dfe162", "name": "network-vif-plugged", "status": "completed", "tag": "6cd58a74-e280-4a64-beb3-02bdd187df94"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:53:30.019310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-81331f9b-0cf2-4a5c-8035-bb07500dc2d3 req-77acb7aa-e5e4-4f71-a1b5-9502a4abd20f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:30.019728 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-81331f9b-0cf2-4a5c-8035-bb07500dc2d3 req-77acb7aa-e5e4-4f71-a1b5-9502a4abd20f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:30.020354 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-81331f9b-0cf2-4a5c-8035-bb07500dc2d3 req-77acb7aa-e5e4-4f71-a1b5-9502a4abd20f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:30.033507 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-81331f9b-0cf2-4a5c-8035-bb07500dc2d3 req-77acb7aa-e5e4-4f71-a1b5-9502a4abd20f service nova] Creating event network-vif-plugged:6cd58a74-e280-4a64-beb3-02bdd187df94 for instance f37e5719-9420-4add-bd10-7271a1dfe162 on n-h1-854441-12 Oct 17 16:53:30.039004 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-81331f9b-0cf2-4a5c-8035-bb07500dc2d3 req-77acb7aa-e5e4-4f71-a1b5-9502a4abd20f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035480 Oct 17 16:53:30.039626 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4074/7877] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:53:30.564002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:30.564891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:30.572311 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:30.572825 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:30.573266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:30.573999 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:30.574463 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:30.574951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:30.712444 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:30.720692 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-a21dddc7-3998-438a-b7f0-ce997556b3fe tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.160977 Oct 17 16:53:30.721286 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3804/7878] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:30 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:53:31.746404 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:31.747281 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:31.755094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:31.755657 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:31.756456 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:31.757659 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:31.758491 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:31.758998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:31.910783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:31.919422 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-37162223-1838-4095-973f-883278d71105 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1685 microversion: 2.1 time: 0.178551 Oct 17 16:53:31.920077 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4075/7879] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:31 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:53:32.943361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:53:32.943951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:53:32.951490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:32.952012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:32.952467 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:32.953198 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:53:32.953671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:53:32.954107 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:53:33.092269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:53:33.100923 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-80c7695e-a78c-4bd4-b7f3-75f28de504ac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1672 microversion: 2.1 time: 0.161556 Oct 17 16:53:33.101532 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3805/7880] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:53:32 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:54:43.266317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=13 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:54:43.267164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=37 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:54:43.268611 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:54:43.268881 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:54:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 (ip 10.222.0.87) !!! Oct 17 16:54:43.269380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=15 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:54:43.271902 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=47 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:54:43.274039 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:54:43.274287 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:54:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.87) !!! Oct 17 16:54:43.274695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:54:43.276156 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:54:43.291946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:43.292766 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:43.293595 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:43.294122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:43.294783 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:43.295372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:43.324235 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:54:43.354295 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-c5c6e08d-72fa-4d3b-825d-d073635692fa req-ac7db508-72af-4faa-98a0-462a20c6bb8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37e5719-9420-4add-bd10-7271a1dfe162", "tag": "6cd58a74-e280-4a64-beb3-02bdd187df94"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:54:43.364981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c5c6e08d-72fa-4d3b-825d-d073635692fa req-ac7db508-72af-4faa-98a0-462a20c6bb8f service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:43.365514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c5c6e08d-72fa-4d3b-825d-d073635692fa req-ac7db508-72af-4faa-98a0-462a20c6bb8f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:43.366251 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-c5c6e08d-72fa-4d3b-825d-d073635692fa req-ac7db508-72af-4faa-98a0-462a20c6bb8f service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:43.380007 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-c5c6e08d-72fa-4d3b-825d-d073635692fa req-ac7db508-72af-4faa-98a0-462a20c6bb8f service nova] Creating event network-changed:6cd58a74-e280-4a64-beb3-02bdd187df94 for instance f37e5719-9420-4add-bd10-7271a1dfe162 on n-h1-854441-12 Oct 17 16:54:43.387724 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-c5c6e08d-72fa-4d3b-825d-d073635692fa req-ac7db508-72af-4faa-98a0-462a20c6bb8f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120539 Oct 17 16:54:43.388645 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3806/7881] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:54:43.415081 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-31d4a947-37a1-4cf9-bec5-8eeae448376a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 204 len: 0 microversion: 2.1 time: 0.150498 Oct 17 16:54:43.415946 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4076/7882] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:54:43 2022] DELETE /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:54:43.425016 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:54:43.425734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:54:43.432650 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:43.433146 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:43.433592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:43.434303 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:43.434794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:43.435230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:43.582757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:54:43.595768 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c26207ef-823c-45ee-a477-69c93042cebb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.174995 Oct 17 16:54:43.596478 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3807/7883] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:54:43 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:54:44.621357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:54:44.622167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:54:44.629708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:44.630294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:44.631174 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:44.631985 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:44.632506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:44.633009 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:44.902279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:54:44.911954 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6f147cf2-2d21-4f74-8f9b-5f3e4e8037c6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 200 len: 1678 microversion: 2.1 time: 0.295862 Oct 17 16:54:44.912580 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4077/7884] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:54:44 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 1678 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:54:45.408771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-140d891d-4d4c-42e0-b23b-f505f8e16095 req-22a58422-a6ff-42b9-a7b5-168279029211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37e5719-9420-4add-bd10-7271a1dfe162", "name": "network-vif-deleted", "tag": "6cd58a74-e280-4a64-beb3-02bdd187df94"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:54:45.428214 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-140d891d-4d4c-42e0-b23b-f505f8e16095 req-22a58422-a6ff-42b9-a7b5-168279029211 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:45.428854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-140d891d-4d4c-42e0-b23b-f505f8e16095 req-22a58422-a6ff-42b9-a7b5-168279029211 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:45.429313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-140d891d-4d4c-42e0-b23b-f505f8e16095 req-22a58422-a6ff-42b9-a7b5-168279029211 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:45.445107 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-140d891d-4d4c-42e0-b23b-f505f8e16095 req-22a58422-a6ff-42b9-a7b5-168279029211 service nova] Creating event network-vif-deleted:6cd58a74-e280-4a64-beb3-02bdd187df94 for instance f37e5719-9420-4add-bd10-7271a1dfe162 on n-h1-854441-12 Oct 17 16:54:45.451274 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-140d891d-4d4c-42e0-b23b-f505f8e16095 req-22a58422-a6ff-42b9-a7b5-168279029211 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047796 Oct 17 16:54:45.451969 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3808/7885] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:54:45.950773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:54:45.951397 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: f37e5719-9420-4add-bd10-7271a1dfe162] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:54:45.958911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:45.959407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:45.959844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:45.960567 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:54:45.961015 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:54:45.961433 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:54:45.977061 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.wsgi [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] HTTP exception thrown: Instance f37e5719-9420-4add-bd10-7271a1dfe162 could not be found. Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Request method failure captured: Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: request: GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 HTTP/1.1 Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: Accept: application/json Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: Accept-Encoding: identity Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: Connection: close Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: Content-Length: 0 Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: Content-Type: application/json Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: Host: 10.222.0.87 Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: Openstack-System-Scope: None Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: User-Agent: python-urllib3/1.26.12 Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Auth-Token: gAAAAABjTYfXLTglze-PDEG2sCeMfs6ZO8mQ3jscyosH1DthebuXTAXSfJUcnuehJd7jsx2lK26_bbqYS1zcMbcXCPWoXTnyREylEI1gwEVMYikWvnLWDyLs_uuTFW_fHUb384RlcU_8X6xJl0zS4Woe4ZjIpNeSUN1gWe_ePMcWn6pLA5XFdB4 Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Id: None Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Domain-Name: None Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Identity-Status: Confirmed Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Is-Admin-Project: True Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Id: default Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Domain-Name: Default Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Id: 72cc53658d094ce9b09b22385511d74b Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Project-Name: tempest-TestShelveInstance-352351832 Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Role: member,reader Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Roles: member,reader Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72cc53658d094ce9b09b22385511d74b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/72cc53658d094ce9b09b22385511d74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_72cc53658d094ce9b09b22385511d74b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72cc53658d094ce9b09b22385511d74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant: tempest-TestShelveInstance-352351832 Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Id: 72cc53658d094ce9b09b22385511d74b Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-Tenant-Name: tempest-TestShelveInstance-352351832 Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-User: tempest-TestShelveInstance-352351832-project Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Id: default Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-User-Domain-Name: Default Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-User-Id: 58f98f921c804e1daeb3189ee1047f95 Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: X-User-Name: tempest-TestShelveInstance-352351832-project Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: method: > Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: exception: Instance f37e5719-9420-4add-bd10-7271a1dfe162 could not be found. Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: action_args: {'id': 'f37e5719-9420-4add-bd10-7271a1dfe162'} Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37e5719-9420-4add-bd10-7271a1dfe162 could not be found. Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37e5719-9420-4add-bd10-7271a1dfe162 could not be found. Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:54:45.978921 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37e5719-9420-4add-bd10-7271a1dfe162 could not be found. Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: ERROR nova.api.openstack.wsgi Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Returning 404 to user: Instance f37e5719-9420-4add-bd10-7271a1dfe162 could not be found. {{(pid=120406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8fd5d0c7-975f-4f1e-92df-064305164074 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162" status: 404 len: 111 microversion: 2.1 time: 0.034106 Oct 17 16:54:45.984905 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4078/7886] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:54:45 2022] GET /compute/v2.1/servers/f37e5719-9420-4add-bd10-7271a1dfe162 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:54:46.167406 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-183f0360-e9e4-44b3-9038-20456163ff87 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '.version_select at 0x7f28c2e30af0>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:54:46.199094 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-183f0360-e9e4-44b3-9038-20456163ff87 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-553806373" status: 202 len: 0 microversion: 2.1 time: 0.036546 Oct 17 16:54:46.200998 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3809/7887] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 16:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-553806373 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:54:46.226259 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7f8eab84-0ec6-4a82-bb62-5b2d1ff58310 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Action: 'create', calling method: .version_select at 0x7f28be0fac10>, body: {"keypair": {"name": "tempest-TestShelveInstance-354643361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrnQIR9NGyhJ2v49COdBlAf/Hg9/bdA7tUbzJ2GwWAmhdz92JEfi9WUfWtgnL3buxhABBdkLxea9ikMuUptH607EaM5dvhkpHMxyQh8GMxYMK+8dW1a4+OY7eH8Qanf6A=="}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:54:46.243083 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7f8eab84-0ec6-4a82-bb62-5b2d1ff58310 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Getting quotas for project 72cc53658d094ce9b09b22385511d74b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:54:46.248939 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-7f8eab84-0ec6-4a82-bb62-5b2d1ff58310 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Getting quotas for user 58f98f921c804e1daeb3189ee1047f95 and project 72cc53658d094ce9b09b22385511d74b. Resources: {'key_pairs'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:54:46.283607 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7f8eab84-0ec6-4a82-bb62-5b2d1ff58310 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.061199 Oct 17 16:54:46.284237 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4079/7888] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:54:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:55:03.695789 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=10 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:55:03.696581 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:55:03.702233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-232539250", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-354643361", "security_groups": [{"name": "tempest-secgroup-smoke-266027570"}], "networks": [{"uuid": "707a00fb-519b-4b7d-be6a-381b79c65493"}], "block_device_mapping_v2": [{"uuid": "c4d90708-644b-4ba6-897f-c01d254fc329", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:55:03.824697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] validate_networks() for [('707a00fb-519b-4b7d-be6a-381b79c65493', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:55:04.248247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:55:04.248686 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:55:04.249207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:55:04.249614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:55:04.250044 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:55:04.259783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:04.260284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:04.260740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:04.261490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:04.261981 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:04.262407 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:04.280510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Getting quotas for project 72cc53658d094ce9b09b22385511d74b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:55:04.287070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Getting quotas for user 58f98f921c804e1daeb3189ee1047f95 and project 72cc53658d094ce9b09b22385511d74b. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:55:04.348403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:55:04.350710 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4d90708-644b-4ba6-897f-c01d254fc329',volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:55:04.507388 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-79743327-805f-4600-8e73-bc9615de1193 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.814638 Oct 17 16:55:04.508032 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3810/7889] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:55:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:55:04.517603 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:55:04.518520 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=4 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:55:04.519394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:55:04.526440 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-42d8d070-82e6-4f0a-9441-8a40af101379 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:04.527122 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-42d8d070-82e6-4f0a-9441-8a40af101379 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:04.592533 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-42d8d070-82e6-4f0a-9441-8a40af101379 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:04.600302 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-42d8d070-82e6-4f0a-9441-8a40af101379 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1087 microversion: 2.1 time: 0.084677 Oct 17 16:55:04.600945 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4080/7890] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:04 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1087 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:05.625620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:05.626543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:05.635828 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:05.636485 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:05.636969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:05.637688 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:05.638319 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:05.638811 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:05.703132 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:05.711208 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5ec8993e-2d82-4a8d-9609-46af7328908e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1193 microversion: 2.1 time: 0.091190 Oct 17 16:55:05.719577 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3811/7891] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:05 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:06.735919 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:06.737775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:06.747943 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:06.748831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:06.749952 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:06.750911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:06.752126 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:06.752806 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:06.993949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:07.004205 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9883e6df-5393-48a9-b5db-e82cee28c483 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1270 microversion: 2.1 time: 0.274432 Oct 17 16:55:07.006006 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4081/7892] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:06 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1270 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:07.248223 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a98d5da0-df99-410f-b587-08db5167f2ab req-7c58f9f8-9ae2-4f72-984a-50462b6c3d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74262a45-7eef-4b8a-ae82-f0ffb957f43f", "tag": "bc7bff14-ae64-4395-a89e-2fe991924062"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:55:07.262970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a98d5da0-df99-410f-b587-08db5167f2ab req-7c58f9f8-9ae2-4f72-984a-50462b6c3d45 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:07.264031 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a98d5da0-df99-410f-b587-08db5167f2ab req-7c58f9f8-9ae2-4f72-984a-50462b6c3d45 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:07.266055 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a98d5da0-df99-410f-b587-08db5167f2ab req-7c58f9f8-9ae2-4f72-984a-50462b6c3d45 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:07.280781 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-a98d5da0-df99-410f-b587-08db5167f2ab req-7c58f9f8-9ae2-4f72-984a-50462b6c3d45 service nova] Creating event network-changed:bc7bff14-ae64-4395-a89e-2fe991924062 for instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f on n-h2-854441-12 Oct 17 16:55:07.288617 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a98d5da0-df99-410f-b587-08db5167f2ab req-7c58f9f8-9ae2-4f72-984a-50462b6c3d45 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045061 Oct 17 16:55:07.290036 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3812/7893] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:55:08.028692 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:08.029372 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:08.037093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:08.037584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:08.038229 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:08.039161 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:08.039787 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:08.040210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:08.287703 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:08.296721 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-881e78d6-2e34-45e5-9241-feade1819e4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1270 microversion: 2.1 time: 0.272030 Oct 17 16:55:08.297308 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4082/7894] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:08 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:09.321663 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:09.322266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:09.329008 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:09.329510 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:09.329959 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:09.330728 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:09.331194 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:09.331614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:09.466408 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:09.474782 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-756e4615-2977-4a91-93a9-38ee09aec663 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1270 microversion: 2.1 time: 0.158466 Oct 17 16:55:09.475417 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3813/7895] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:09 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:10.498069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:10.498911 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:10.508159 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:10.508661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:10.509111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:10.509847 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:10.510287 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:10.510762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:10.660236 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:10.671272 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a81aa361-8c1a-417a-a524-08b5b40a5cac tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1270 microversion: 2.1 time: 0.177633 Oct 17 16:55:10.671992 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4083/7896] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:10 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:11.696020 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:11.696712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:11.704372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:11.704874 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:11.705384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:11.706181 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:11.706750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:11.707221 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:11.852883 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:11.865480 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5012b133-abe3-4c4c-9fbe-b69be99dd32c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.173702 Oct 17 16:55:11.866070 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3814/7897] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:11 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:12.890973 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:12.891574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:12.901201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:12.901695 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:12.902128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:12.902862 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:12.903311 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:12.903734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:13.051266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:13.059899 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb2f5c15-8eb1-4f70-9d3f-21c4afb55598 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.174752 Oct 17 16:55:13.060446 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4084/7898] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:12 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:14.083383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:14.084038 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:14.091647 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:14.092134 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:14.092614 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:14.093322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:14.093793 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:14.094234 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:14.255350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:14.264538 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-56168718-c90f-453b-8a82-befd6ccefd0e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.185069 Oct 17 16:55:14.265170 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3815/7899] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:14 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:15.290424 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:15.291197 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:15.293883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:55:15.300524 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:15.301250 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:15.301976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:15.302979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:15.303704 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:15.304186 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:15.439898 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:15.448092 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-40eaf212-cd4a-47fb-9fec-45424423e2f2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.161735 Oct 17 16:55:15.448911 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4085/7900] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:15 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:16.472093 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:16.472638 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:16.474723 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:55:16.475519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:55:16.482826 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:16.483337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:16.483798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:16.484514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:16.484992 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:16.485437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:16.635594 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:16.643740 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0673bd93-2b7b-455d-b3fa-b723c7dfe02f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.175824 Oct 17 16:55:16.644322 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3816/7901] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:16 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:17.668341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:17.668938 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:17.676476 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:17.676967 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:17.677403 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:17.678103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:17.678550 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:17.678986 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:17.831007 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:17.844244 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-409e677e-6e10-4754-9622-66f34d7df2b2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.180095 Oct 17 16:55:17.845072 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4086/7902] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:17 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:18.870435 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:18.871030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:18.878202 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:18.878753 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:18.879208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:18.879927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:18.880373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:18.881219 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:19.020987 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:19.030160 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-0b67ecb3-a5e6-4f7d-8a19-c0556c5ccb9a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.165191 Oct 17 16:55:19.030815 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3817/7903] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:18 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:20.053051 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:20.053632 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:20.063098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:20.063891 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:20.064349 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:20.065072 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:20.065534 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:20.065964 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:20.204833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:20.213666 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6aaa6d45-ff46-4be0-8ac0-be40d02881cc tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.165035 Oct 17 16:55:20.214273 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4087/7904] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:20 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:21.237620 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:21.238233 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:21.246069 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:21.246681 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:21.247126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:21.247854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:21.248322 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:21.248760 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:21.397934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:21.409652 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-5f4f9e75-1b12-4e93-ba14-0a40e418fd8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.175621 Oct 17 16:55:21.410478 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3818/7905] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:21 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:22.036337 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-db279f8f-76f6-4aa9-87f6-9cc3bbbc4b5d req-7c8b3240-9a66-4b17-b0d0-ea8734126061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74262a45-7eef-4b8a-ae82-f0ffb957f43f", "name": "network-vif-plugged", "status": "completed", "tag": "bc7bff14-ae64-4395-a89e-2fe991924062"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:55:22.049580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-db279f8f-76f6-4aa9-87f6-9cc3bbbc4b5d req-7c8b3240-9a66-4b17-b0d0-ea8734126061 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:22.050063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-db279f8f-76f6-4aa9-87f6-9cc3bbbc4b5d req-7c8b3240-9a66-4b17-b0d0-ea8734126061 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:22.050477 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-db279f8f-76f6-4aa9-87f6-9cc3bbbc4b5d req-7c8b3240-9a66-4b17-b0d0-ea8734126061 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:22.062868 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-db279f8f-76f6-4aa9-87f6-9cc3bbbc4b5d req-7c8b3240-9a66-4b17-b0d0-ea8734126061 service nova] Creating event network-vif-plugged:bc7bff14-ae64-4395-a89e-2fe991924062 for instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f on n-h2-854441-12 Oct 17 16:55:22.068153 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-db279f8f-76f6-4aa9-87f6-9cc3bbbc4b5d req-7c8b3240-9a66-4b17-b0d0-ea8734126061 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036286 Oct 17 16:55:22.068949 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4088/7906] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:55:22.433110 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:22.433712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:22.441383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:22.441896 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:22.442354 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:22.443120 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:22.443588 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:22.444045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:22.593118 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:22.601145 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-79e4d83f-bf02-4d67-a7ef-e9c54f9a1bc0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1258 microversion: 2.1 time: 0.172270 Oct 17 16:55:22.601730 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3819/7907] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:22 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:23.625506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:23.626215 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:23.634118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:23.634763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:23.635211 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:23.635917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:23.636402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:23.636850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:23.790677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:23.799194 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d6010fb7-4c2b-4b6d-a7bf-da020f4c2fc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1443 microversion: 2.1 time: 0.178074 Oct 17 16:55:23.799790 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4089/7908] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:23 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1443 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:23.823757 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:55:23.824383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:55:23.832106 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:23.832645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:23.833135 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:23.833957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:23.834383 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:23.835074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:23.985814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:55:23.995214 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-42f9cd07-7a71-4299-bb78-51e3f7fd2b8a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1443 microversion: 2.1 time: 0.177282 Oct 17 16:55:23.995805 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3820/7909] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:55:23 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1443 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:55:26.020584 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-94613371-5788-472f-a393-a88bd2aeab16 req-3641885b-bf40-4bda-bdc7-176e683fab3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74262a45-7eef-4b8a-ae82-f0ffb957f43f", "tag": "bc7bff14-ae64-4395-a89e-2fe991924062"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:55:26.031727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-94613371-5788-472f-a393-a88bd2aeab16 req-3641885b-bf40-4bda-bdc7-176e683fab3c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:55:26.032300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-94613371-5788-472f-a393-a88bd2aeab16 req-3641885b-bf40-4bda-bdc7-176e683fab3c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:55:26.032809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-94613371-5788-472f-a393-a88bd2aeab16 req-3641885b-bf40-4bda-bdc7-176e683fab3c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:55:26.047767 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-94613371-5788-472f-a393-a88bd2aeab16 req-3641885b-bf40-4bda-bdc7-176e683fab3c service nova] Creating event network-changed:bc7bff14-ae64-4395-a89e-2fe991924062 for instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f on n-h2-854441-12 Oct 17 16:55:26.052997 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-94613371-5788-472f-a393-a88bd2aeab16 req-3641885b-bf40-4bda-bdc7-176e683fab3c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036315 Oct 17 16:55:26.053638 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4090/7910] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:57:23.078062 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3696dc72-21c5-4039-90de-2d8678c5bdb0] AMQP server on 10.222.0.87:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 16:57:23.079179 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70d19fdb-2e68-4188-b296-5d4cb59f3ab3] AMQP server on 10.222.0.87:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 16:57:23.079887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:57:23.081151 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=58 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:57:23.082448 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 16:57:23.082664 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 16:57:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f/action (ip 10.222.0.87) !!! Oct 17 16:57:23.158993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:57:23.159534 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:23.165856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:23.166372 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:23.166850 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:23.167565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:23.168037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:23.168500 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:23.191898 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.objects.instance [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lazy-loading 'flavor' on Instance uuid 74262a45-7eef-4b8a-ae82-f0ffb957f43f {{(pid=120407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:57:23.273066 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f6dee6e5-9c27-43cb-aea9-ea75f17b54a0 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "POST /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f/action" status: 202 len: 0 microversion: 2.1 time: 0.198169 Oct 17 16:57:23.273904 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3821/7911] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:57:23 2022] POST /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:57:23.280721 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e330c2f8-e85a-4877-b463-0418903a3ce8] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:57:23.281564 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac0a07ff-7a15-4651-9394-b7854521cfed] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 16:57:23.282162 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=24 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:57:23.283048 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=52 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:57:23.284348 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:57:23.284494 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:57:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f (ip 10.222.0.87) !!! Oct 17 16:57:23.291041 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:23.291759 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:23.300605 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:23.301099 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:23.301539 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:23.302245 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:23.302758 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:23.303185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:23.458407 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:23.466798 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8e4e15f-0b8f-4e86-987a-9ebd3847f265 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.188071 Oct 17 16:57:23.467390 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4091/7912] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:23 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:57:24.490630 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:24.491382 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:24.501129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:24.501651 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:24.502116 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:24.502856 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:24.503316 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:24.503733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:24.515422 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] [3696dc72-21c5-4039-90de-2d8678c5bdb0] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 43486. Oct 17 16:57:24.525431 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] [70d19fdb-2e68-4188-b296-5d4cb59f3ab3] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 43488. Oct 17 16:57:24.652099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:24.660454 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-07b0c1e0-a996-459d-bca0-4587eb48a63e tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.174374 Oct 17 16:57:24.660925 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3822/7913] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:24 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:25.688942 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:25.689564 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:25.699087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:25.699580 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:25.700027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:25.700739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:25.701188 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:25.701618 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:25.707949 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac0a07ff-7a15-4651-9394-b7854521cfed] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 43496. Oct 17 16:57:25.719513 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [e330c2f8-e85a-4877-b463-0418903a3ce8] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 43494. Oct 17 16:57:25.841822 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:25.850080 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ec73ca72-1dee-4bcd-96b1-b9f3ebf05ca5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.165227 Oct 17 16:57:25.850690 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4092/7914] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:25 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:26.876241 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:26.876881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:26.887547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:26.888278 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:26.888916 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:26.889822 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:26.890403 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:26.890946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:27.031335 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:27.041935 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-6d7fb274-73d5-4929-90bb-6f03451801ee tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.171855 Oct 17 16:57:27.042512 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3823/7915] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:26 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:28.071802 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:28.072452 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:28.079932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:28.080451 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:28.080893 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:28.081597 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:28.082069 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:28.082489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:28.222140 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:28.233859 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5d622a28-8ef5-4e33-8e1c-e8225e90f081 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.167900 Oct 17 16:57:28.234587 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4093/7916] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:28 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:29.262750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:29.263414 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:29.274141 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:29.274684 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:29.275140 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:29.275864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:29.276337 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:29.276784 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:29.419367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:29.429870 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d6c81958-f3b8-48a5-8c60-85768dc33d51 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.172891 Oct 17 16:57:29.430544 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3824/7917] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:29 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:30.455684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:30.456350 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:30.465257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:30.465763 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:30.466207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:30.466947 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:30.467410 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:30.467845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:30.602292 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:30.610332 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-539e18df-f6ac-440f-b17f-9af3c9059c9b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.160132 Oct 17 16:57:30.610958 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4094/7918] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:30 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:31.634580 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:31.635207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:31.642227 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:31.642783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:31.643242 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:31.643962 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:31.644439 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:31.644880 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:31.791578 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:31.799932 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f698d59a-8323-4451-9c5c-cad5ba48cdc5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.169835 Oct 17 16:57:31.800559 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3825/7919] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:31 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:32.826266 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:32.826949 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:32.836961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:32.837615 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:32.838087 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:32.838827 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:32.839284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:32.839715 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:32.979092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:32.987593 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-5e2b0ca4-aea6-49ac-a130-61c6f731d49f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.167518 Oct 17 16:57:32.988165 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4095/7920] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:32 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:34.012979 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:34.013610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:34.021037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:34.021546 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:34.022002 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:34.022759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:34.023231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:34.023673 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:34.162554 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:34.174177 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e42140d4-62ae-40de-bcde-8e7336c20594 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.165589 Oct 17 16:57:34.174971 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3826/7921] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:34 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:35.203124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:35.204046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:35.214100 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:35.214686 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:35.215118 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:35.215809 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:35.216254 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:35.216672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:35.360711 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:35.369134 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a4823f50-95d6-4f5e-9f03-dd9b3dc292cb tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.172124 Oct 17 16:57:35.369757 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4096/7922] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:35 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:36.396078 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:36.396765 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:36.404730 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:36.405248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:36.405701 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:36.406451 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:36.406964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:36.407434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:36.555919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:36.564771 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c8e5e613-45b3-4ce9-9f31-6a39567946b3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.173706 Oct 17 16:57:36.565608 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3827/7923] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:36 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:37.588191 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:37.588820 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:37.596145 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:37.596640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:37.597081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:37.597815 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:37.598274 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:37.598754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:37.737912 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:37.749031 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-131237c2-686b-4521-a0ab-5c374d2c2a6f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1568 microversion: 2.1 time: 0.164677 Oct 17 16:57:37.749889 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4097/7924] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:37 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:37.776092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:57:37.776676 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:37.783794 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:37.784291 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:37.784748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:37.785466 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:37.785931 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:37.786367 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:37.873005 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120407) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 16:57:37.944604 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-eb327ca2-c131-416c-a303-c0953f94aa3a tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "POST /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f/action" status: 202 len: 0 microversion: 2.1 time: 0.172826 Oct 17 16:57:37.945250 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3828/7925] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 16:57:37 2022] POST /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:57:37.953629 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:37.954591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:37.960924 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:37.961416 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:37.961850 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:37.962572 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:37.963037 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:37.963474 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:38.121377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:38.129556 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-0346920f-5cc6-48ed-936f-95868de44aa7 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1516 microversion: 2.1 time: 0.179799 Oct 17 16:57:38.130160 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4098/7926] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:37 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:39.154410 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:39.155045 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:39.161884 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:39.162397 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:39.162877 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:39.163655 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:39.164130 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:39.164572 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:39.304236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:39.314186 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7bfff0fb-a7eb-4e0e-8836-8ca0413c8fa2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1518 microversion: 2.1 time: 0.164628 Oct 17 16:57:39.314861 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3829/7927] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:39 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:40.338861 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:40.339574 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:40.347325 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:40.347828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:40.348268 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:40.348998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:40.349458 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:40.349885 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:40.490722 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:40.499245 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6cc2cb94-af3c-4619-bdec-f8d5cf674e50 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1518 microversion: 2.1 time: 0.164606 Oct 17 16:57:40.500088 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4099/7928] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:40 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:40.573371 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-a27ede70-1530-4713-becc-6044a382d3ec req-0da5ba2e-2f92-4cda-ab2a-c41536b244d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74262a45-7eef-4b8a-ae82-f0ffb957f43f", "name": "network-vif-unplugged", "status": "completed", "tag": "bc7bff14-ae64-4395-a89e-2fe991924062"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:57:40.585872 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a27ede70-1530-4713-becc-6044a382d3ec req-0da5ba2e-2f92-4cda-ab2a-c41536b244d2 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:40.586892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a27ede70-1530-4713-becc-6044a382d3ec req-0da5ba2e-2f92-4cda-ab2a-c41536b244d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:40.586892 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-a27ede70-1530-4713-becc-6044a382d3ec req-0da5ba2e-2f92-4cda-ab2a-c41536b244d2 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:40.599494 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.compute.server_external_events [req-a27ede70-1530-4713-becc-6044a382d3ec req-0da5ba2e-2f92-4cda-ab2a-c41536b244d2 service nova] Unable to find a host for instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f. Dropping event network-vif-unplugged {{(pid=120407) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 16:57:40.600336 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-a27ede70-1530-4713-becc-6044a382d3ec req-0da5ba2e-2f92-4cda-ab2a-c41536b244d2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031554 Oct 17 16:57:40.600934 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3830/7929] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 16:57:41.523060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:41.523677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:41.535004 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:41.535931 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:41.536425 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:41.537187 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:41.537691 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:41.538103 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:41.681708 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:41.690643 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8d41363-4601-47f9-8e14-52164539c98f tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1518 microversion: 2.1 time: 0.171640 Oct 17 16:57:41.691325 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4100/7930] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:41 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:42.714052 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:42.714755 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:42.723815 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:42.724312 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:42.724759 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:42.725477 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:42.725936 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:42.726365 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:42.891722 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:42.901015 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c3f669a3-6dd4-4e15-bc52-aa259f8052f6 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1518 microversion: 2.1 time: 0.190901 Oct 17 16:57:42.901596 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3831/7931] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:42 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:43.924677 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:43.925489 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:43.932975 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:43.933482 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:43.933920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:43.935039 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:43.935138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:43.935764 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:44.080475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:44.098185 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c2ceb0f4-3b6e-4ec0-b366-9ba43e1c4003 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.176382 Oct 17 16:57:44.098971 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4101/7932] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:43 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:44.883851 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-93b92956-936e-49e1-b092-8196e410a35d req-a89371de-2140-4fe2-892d-5a17b0e9f1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74262a45-7eef-4b8a-ae82-f0ffb957f43f", "tag": "bc7bff14-ae64-4395-a89e-2fe991924062"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:57:44.896104 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-93b92956-936e-49e1-b092-8196e410a35d req-a89371de-2140-4fe2-892d-5a17b0e9f1a3 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:44.896796 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-93b92956-936e-49e1-b092-8196e410a35d req-a89371de-2140-4fe2-892d-5a17b0e9f1a3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:44.897280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-93b92956-936e-49e1-b092-8196e410a35d req-a89371de-2140-4fe2-892d-5a17b0e9f1a3 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:44.909929 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-93b92956-936e-49e1-b092-8196e410a35d req-a89371de-2140-4fe2-892d-5a17b0e9f1a3 service nova] Creating event network-changed:bc7bff14-ae64-4395-a89e-2fe991924062 for instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f on n-h1-854441-12 Oct 17 16:57:44.915672 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-93b92956-936e-49e1-b092-8196e410a35d req-a89371de-2140-4fe2-892d-5a17b0e9f1a3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093532 Oct 17 16:57:44.916322 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3832/7933] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:57:45.122232 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:45.124328 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:45.132128 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:45.132633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:45.133078 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:45.133856 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:45.134322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:45.134799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:45.302640 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:45.314891 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-95cf2cc4-43b1-4de5-953d-5d9bae96fcc1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.197098 Oct 17 16:57:45.315829 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4102/7934] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:45 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:46.340547 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:46.341269 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:46.348888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:46.349392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:46.349836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:46.350610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:46.351102 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:46.351541 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:46.495814 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:46.506911 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f8e41cd6-4783-49fc-9c80-02ea0e8250db tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.170715 Oct 17 16:57:46.507543 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3833/7935] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:46 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:47.531666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:47.532272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:47.542300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:47.542828 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:47.543265 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:47.543979 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:47.544447 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:47.544866 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:47.739079 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:47.747846 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-c9d09557-fc54-40e7-97e6-66095a48b520 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.220410 Oct 17 16:57:47.748450 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4103/7936] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:47 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:48.771537 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:48.772171 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:48.779761 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:48.780275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:48.780748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:48.781496 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:48.781973 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:48.782422 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:48.973040 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:48.981947 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-33e7f173-9e46-489d-b584-c5ab0eefb4d1 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.214448 Oct 17 16:57:48.982557 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3834/7937] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:48 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:50.010779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:50.011610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:50.022151 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:50.022797 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:50.023388 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:50.024423 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:50.025075 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:50.025525 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:50.184390 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:50.192573 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-068f2535-214b-48da-b87d-fe9b9b8b7577 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.190162 Oct 17 16:57:50.193171 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4104/7938] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:50 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:51.223070 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:51.223712 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:51.231645 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:51.232207 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:51.232685 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:51.233421 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:51.233897 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:51.234343 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:51.377411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:51.381431 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:57:51.387077 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-381f7bf3-fe45-4257-9080-e7681171de4d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.168129 Oct 17 16:57:51.387685 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3835/7939] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:51 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:52.411420 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:52.412131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:52.419641 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:52.420154 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:52.420591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:52.421293 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:52.421752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:52.422173 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:52.560819 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:52.569535 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76991947-6bf0-4aef-af53-b288362f8544 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.162702 Oct 17 16:57:52.570129 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4105/7940] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:52 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:53.602762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:53.602762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:53.602762 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:57:53.606398 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:53.606927 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:53.607380 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:53.608284 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:53.608750 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:53.609237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:53.752862 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:53.761434 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-96ffed77-a756-4c46-8e8a-4cc125d387cf tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.171456 Oct 17 16:57:53.762038 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3836/7941] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:53 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:54.784779 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:54.785445 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:54.788196 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=31 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:57:54.794164 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:54.794689 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:54.795127 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:54.795860 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:54.796314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:54.796739 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:54.799542 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=91 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:57:54.944353 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:54.953967 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f7d4c52a-4425-4eea-a4dc-27edbb79ff15 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.173143 Oct 17 16:57:54.954549 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4106/7942] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:54 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:55.166129 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-5e408db4-4e9f-440d-b947-74a522dc4c42 req-09a69f3e-2efd-4270-a307-3eb928a7e9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74262a45-7eef-4b8a-ae82-f0ffb957f43f", "name": "network-vif-plugged", "status": "completed", "tag": "bc7bff14-ae64-4395-a89e-2fe991924062"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:57:55.177037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5e408db4-4e9f-440d-b947-74a522dc4c42 req-09a69f3e-2efd-4270-a307-3eb928a7e9d0 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:55.177539 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5e408db4-4e9f-440d-b947-74a522dc4c42 req-09a69f3e-2efd-4270-a307-3eb928a7e9d0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:55.177988 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-5e408db4-4e9f-440d-b947-74a522dc4c42 req-09a69f3e-2efd-4270-a307-3eb928a7e9d0 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:55.189698 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-5e408db4-4e9f-440d-b947-74a522dc4c42 req-09a69f3e-2efd-4270-a307-3eb928a7e9d0 service nova] Creating event network-vif-plugged:bc7bff14-ae64-4395-a89e-2fe991924062 for instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f on n-h1-854441-12 Oct 17 16:57:55.195099 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-5e408db4-4e9f-440d-b947-74a522dc4c42 req-09a69f3e-2efd-4270-a307-3eb928a7e9d0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 Oct 17 16:57:55.195580 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3837/7943] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:57:55.977776 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:55.978365 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:55.985371 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:55.985865 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:55.986303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:55.987043 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:55.987499 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:55.987930 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:56.133167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:56.146011 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-554effa9-56d2-4214-9977-fe316013b6fd tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1574 microversion: 2.1 time: 0.172090 Oct 17 16:57:56.146880 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4107/7944] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:55 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:57:57.173293 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:57:57.174189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:57:57.182366 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:57.183033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:57.183637 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:57.184656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:57:57.185115 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:57:57.185556 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:57:57.343514 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:57:57.351680 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4e1b5715-507e-450d-a8e7-747bbf235f8c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1561 microversion: 2.1 time: 0.183975 Oct 17 16:57:57.352307 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3838/7945] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:57:57 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:12.070726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:12.071481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=11 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:12.075682 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=5 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:12.076465 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=14 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:12.077661 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:59:12.077827 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:59:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f (ip 10.222.0.87) !!! Oct 17 16:59:12.084368 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-b02887d9-7112-4102-b326-a3a19ec87a77 req-9599a06a-3a34-4693-8546-bf4cbd2e61da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74262a45-7eef-4b8a-ae82-f0ffb957f43f", "tag": "bc7bff14-ae64-4395-a89e-2fe991924062"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:59:12.087216 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 16:59:12.087416 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 16:59:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f (ip 10.222.0.87) !!! Oct 17 16:59:12.092467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:12.092976 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:12.103184 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:12.103660 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:12.103957 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b02887d9-7112-4102-b326-a3a19ec87a77 req-9599a06a-3a34-4693-8546-bf4cbd2e61da service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:12.104098 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:12.104471 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b02887d9-7112-4102-b326-a3a19ec87a77 req-9599a06a-3a34-4693-8546-bf4cbd2e61da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:12.104794 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:12.105279 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-b02887d9-7112-4102-b326-a3a19ec87a77 req-9599a06a-3a34-4693-8546-bf4cbd2e61da service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:12.105402 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:12.105989 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:12.122675 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-b02887d9-7112-4102-b326-a3a19ec87a77 req-9599a06a-3a34-4693-8546-bf4cbd2e61da service nova] Creating event network-changed:bc7bff14-ae64-4395-a89e-2fe991924062 for instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f on n-h1-854441-12 Oct 17 16:59:12.128267 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-b02887d9-7112-4102-b326-a3a19ec87a77 req-9599a06a-3a34-4693-8546-bf4cbd2e61da service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055084 Oct 17 16:59:12.129114 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3839/7946] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:59:12.137481 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 16:59:12.228310 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-54d2c316-3cc6-426c-86d8-4c4b5c26c57d tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "DELETE /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 204 len: 0 microversion: 2.1 time: 0.159234 Oct 17 16:59:12.230915 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4108/7947] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 16:59:12 2022] DELETE /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 16:59:12.241033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:12.242012 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:12.249220 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:12.249733 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:12.250179 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:12.250947 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:12.251413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:12.251876 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:12.407032 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:12.415910 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-e6351702-1cc6-4650-b763-bd49ed1848e5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.180516 Oct 17 16:59:12.416562 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3840/7948] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:12 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:59:13.440935 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:13.441666 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:13.449569 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:13.450138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:13.450702 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:13.451501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:13.452001 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:13.452472 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:13.598316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:13.607211 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-6a365017-85b4-4b57-b7e7-58b662e685de tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1567 microversion: 2.1 time: 0.170649 Oct 17 16:59:13.608139 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4109/7949] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:13 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:14.479345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-cc3b249c-43a2-4856-b795-d1f1cc8314f5 req-2c32cd26-be6a-4b21-86e1-2aba8197d9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74262a45-7eef-4b8a-ae82-f0ffb957f43f", "name": "network-vif-deleted", "tag": "bc7bff14-ae64-4395-a89e-2fe991924062"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:59:14.490934 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cc3b249c-43a2-4856-b795-d1f1cc8314f5 req-2c32cd26-be6a-4b21-86e1-2aba8197d9ac service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:14.491437 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cc3b249c-43a2-4856-b795-d1f1cc8314f5 req-2c32cd26-be6a-4b21-86e1-2aba8197d9ac service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:14.491887 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-cc3b249c-43a2-4856-b795-d1f1cc8314f5 req-2c32cd26-be6a-4b21-86e1-2aba8197d9ac service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:14.504445 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-cc3b249c-43a2-4856-b795-d1f1cc8314f5 req-2c32cd26-be6a-4b21-86e1-2aba8197d9ac service nova] Creating event network-vif-deleted:bc7bff14-ae64-4395-a89e-2fe991924062 for instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f on n-h1-854441-12 Oct 17 16:59:14.511290 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-cc3b249c-43a2-4856-b795-d1f1cc8314f5 req-2c32cd26-be6a-4b21-86e1-2aba8197d9ac service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035753 Oct 17 16:59:14.512098 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3841/7950] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:59:14.630771 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:14.631394 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:14.638960 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:14.639462 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:14.639899 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:14.640607 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:14.641063 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:14.641487 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:14.708923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:14.717489 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-dbbe3e3f-76c9-45b0-b2d6-3f960acb7cc2 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1218 microversion: 2.1 time: 0.091171 Oct 17 16:59:14.718806 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4110/7951] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:14 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:15.743454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:15.744172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:15.750978 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:15.751480 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:15.751935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:15.752670 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:15.753126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:15.753566 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:15.824969 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:15.833449 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-bc9b5aa2-9f5a-406f-8128-c0dd0fc9a05b tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1218 microversion: 2.1 time: 0.095519 Oct 17 16:59:15.834031 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3842/7952] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:15 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:16.856298 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:16.856983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:16.864680 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:16.865178 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:16.865619 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:16.866357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:16.866832 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:16.867257 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:16.937742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:16.946352 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-9ccccd10-46cb-4345-8504-669e744b1463 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1218 microversion: 2.1 time: 0.094499 Oct 17 16:59:16.946995 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4111/7953] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:16 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:17.969240 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:17.970099 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:17.977636 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:17.978139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:17.978616 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:17.979324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:17.979792 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:17.980271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:18.045971 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:18.054620 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-b0dd8739-8a64-41a8-8fad-fe52fec401f5 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1218 microversion: 2.1 time: 0.089380 Oct 17 16:59:18.055213 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3843/7954] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:17 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:19.079138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:19.079831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:19.087284 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:19.087754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:19.088358 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:19.089094 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:19.089555 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:19.090175 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:19.126322 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:19.126923 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:19.127427 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:19.128762 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lazy-loading 'fault' on Instance uuid 74262a45-7eef-4b8a-ae82-f0ffb957f43f {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 16:59:19.179726 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f98f921c804e1daeb3189ee1047f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cc53658d094ce9b09b22385511d74b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:19.187687 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-948bede9-d6c5-4006-8208-01e720be888c tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 200 len: 1177 microversion: 2.1 time: 0.113924 Oct 17 16:59:19.188746 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4112/7955] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:19 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 1177 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:20.211590 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:20.212245 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] [instance: 74262a45-7eef-4b8a-ae82-f0ffb957f43f] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:20.219747 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:20.220263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:20.220721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:20.221464 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:20.221933 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:20.222418 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:20.237336 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] HTTP exception thrown: Instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f could not be found. Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Request method failure captured: Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f HTTP/1.1 Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYfXLTglze-PDEG2sCeMfs6ZO8mQ3jscyosH1DthebuXTAXSfJUcnuehJd7jsx2lK26_bbqYS1zcMbcXCPWoXTnyREylEI1gwEVMYikWvnLWDyLs_uuTFW_fHUb384RlcU_8X6xJl0zS4Woe4ZjIpNeSUN1gWe_ePMcWn6pLA5XFdB4 Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 72cc53658d094ce9b09b22385511d74b Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestShelveInstance-352351832 Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72cc53658d094ce9b09b22385511d74b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/72cc53658d094ce9b09b22385511d74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_72cc53658d094ce9b09b22385511d74b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/72cc53658d094ce9b09b22385511d74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestShelveInstance-352351832 Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 72cc53658d094ce9b09b22385511d74b Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestShelveInstance-352351832 Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestShelveInstance-352351832-project Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 58f98f921c804e1daeb3189ee1047f95 Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestShelveInstance-352351832-project Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f could not be found. Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': '74262a45-7eef-4b8a-ae82-f0ffb957f43f'} Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f could not be found. Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f could not be found. Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 16:59:20.239139 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f could not be found. Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Returning 404 to user: Instance 74262a45-7eef-4b8a-ae82-f0ffb957f43f could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-7c2f07ac-b2be-417d-b24e-c429c54f6923 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f" status: 404 len: 111 microversion: 2.1 time: 0.033479 Oct 17 16:59:20.245998 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3844/7956] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:20 2022] GET /compute/v2.1/servers/74262a45-7eef-4b8a-ae82-f0ffb957f43f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 16:59:20.408163 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-74af4fd7-e750-4ea3-98b0-ddbeb0f43ff3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] Calling method '.version_select at 0x7f28c0f95550>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:20.444177 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-74af4fd7-e750-4ea3-98b0-ddbeb0f43ff3 tempest-TestShelveInstance-352351832 tempest-TestShelveInstance-352351832-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-354643361" status: 202 len: 0 microversion: 2.1 time: 0.040388 Oct 17 16:59:20.444911 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4113/7957] 10.222.0.87 () {58 vars in 1251 bytes} [Mon Oct 17 16:59:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-354643361 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 16:59:38.519353 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=12 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:38.520942 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=24 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:38.716598 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-399257a9-7900-457e-8a4e-fa0fd2ff51f9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Action: 'create', calling method: .version_select at 0x7f28bdf7d670>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-345906765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3TFfvE/4B5uyv/ua8iixCzNhQ4jtXq08BKl/lnQZlvR8lflcBtKdMqgAbSsgClh2q9kSUB0XA4DGjTYK3lmgiE4j97zCuztS00H44PPhMv9pWswVQOtyA3Jbk9pPPC8Q=="}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:59:38.737355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-399257a9-7900-457e-8a4e-fa0fd2ff51f9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Getting quotas for project 77f62a5c6121410e9ec1f54b97803093. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:59:38.745864 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-399257a9-7900-457e-8a4e-fa0fd2ff51f9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Getting quotas for user 80ac40200dd14a1f9bfcba424b906d3e and project 77f62a5c6121410e9ec1f54b97803093. Resources: {'key_pairs'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:59:38.778360 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-399257a9-7900-457e-8a4e-fa0fd2ff51f9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.266595 Oct 17 16:59:38.779037 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3845/7958] 10.222.0.87 () {60 vars in 1159 bytes} [Mon Oct 17 16:59:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:59:39.807926 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:39.808925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:39.813314 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-511399646", "imageRef": "c489ef08-d3af-4c49-859b-7a55ed37ba8d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-345906765", "security_groups": [{"name": "tempest-secgroup-smoke-1725623689"}], "networks": [{"uuid": "2d4f96fa-7df5-424b-8f16-05a8816d8d51"}]}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:59:39.938271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.network.neutron [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] validate_networks() for [('2d4f96fa-7df5-424b-8f16-05a8816d8d51', None, None, None, None, None)] {{(pid=120406) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 16:59:40.441167 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Flavor limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 16:59:40.441592 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Image limits 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 16:59:40.442091 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Flavor pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 16:59:40.442529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Image pref 0:0:0 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 16:59:40.442933 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.virt.hardware [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 16:59:40.452170 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:40.452653 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:40.453086 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:40.453807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:40.454256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:40.454706 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:40.473571 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Getting quotas for project 77f62a5c6121410e9ec1f54b97803093. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 16:59:40.479024 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.quota [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Getting quotas for user 80ac40200dd14a1f9bfcba424b906d3e and project 77f62a5c6121410e9ec1f54b97803093. Resources: {'instances', 'ram', 'cores'} {{(pid=120406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 16:59:40.492222 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Going to run 1 instances... {{(pid=120406) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 16:59:40.494799 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c489ef08-d3af-4c49-859b-7a55ed37ba8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 16:59:40.543999 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d86ba7a1-0405-4eff-9027-f8b05b35dd0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737958 Oct 17 16:59:40.544730 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4114/7959] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 16:59:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 16:59:40.567449 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-c22368fb-e795-4644-99e3-f4a3894f279c tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:40.568274 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-c22368fb-e795-4644-99e3-f4a3894f279c tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:40.633280 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-c22368fb-e795-4644-99e3-f4a3894f279c tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:40.648115 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-c22368fb-e795-4644-99e3-f4a3894f279c tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1247 microversion: 2.1 time: 0.090367 Oct 17 16:59:40.648115 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3846/7960] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:40 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:41.667679 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:41.668310 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:41.676251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:41.676672 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:41.677111 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:41.677824 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:41.678270 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:41.678727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:41.761623 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:41.772726 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed7c9f68-020b-412b-a4b1-f466e9b06241 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1299 microversion: 2.1 time: 0.109973 Oct 17 16:59:41.773361 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4115/7961] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:41 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:42.796231 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:42.796848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:42.804709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:42.805237 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:42.805698 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:42.806428 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:42.806943 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:42.807392 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:42.882617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:42.892620 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1a028e4e-9abe-4e3a-b92e-b3ffb04f4723 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1305 microversion: 2.1 time: 0.100899 Oct 17 16:59:42.893291 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3847/7962] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:42 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 16:59:43.920073 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:43.920751 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:43.928434 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:43.929027 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:43.930266 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:43.931321 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:43.931958 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:43.932567 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:43.999185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-5d1c2c7d-0d02-456e-a1e9-0eff21bdd948 req-ea3ee48d-daa4-4d37-b514-92bacabb11e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9640195-6b1e-4d15-ae86-737ca4fcdc67", "tag": "b001dad4-1d87-4017-be78-e7a7fb5e5860"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:59:44.013518 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d1c2c7d-0d02-456e-a1e9-0eff21bdd948 req-ea3ee48d-daa4-4d37-b514-92bacabb11e8 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:44.014028 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d1c2c7d-0d02-456e-a1e9-0eff21bdd948 req-ea3ee48d-daa4-4d37-b514-92bacabb11e8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:44.014468 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-5d1c2c7d-0d02-456e-a1e9-0eff21bdd948 req-ea3ee48d-daa4-4d37-b514-92bacabb11e8 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:44.045747 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-5d1c2c7d-0d02-456e-a1e9-0eff21bdd948 req-ea3ee48d-daa4-4d37-b514-92bacabb11e8 service nova] Creating event network-changed:b001dad4-1d87-4017-be78-e7a7fb5e5860 for instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 on n-h1-854441-12 Oct 17 16:59:44.058983 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-5d1c2c7d-0d02-456e-a1e9-0eff21bdd948 req-ea3ee48d-daa4-4d37-b514-92bacabb11e8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188543 Oct 17 16:59:44.060722 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4116/7963] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 16:59:44.107076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:44.122663 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-42a45d44-1f7a-4fb4-a1a0-4c63d598b7a5 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1373 microversion: 2.1 time: 0.207800 Oct 17 16:59:44.123801 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3848/7964] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:43 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1373 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:45.161972 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:45.162644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:45.169286 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:45.169772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:45.170210 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:45.170910 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:45.171357 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:45.171785 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:45.317545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:45.326107 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-336dffed-57cd-4593-b02f-9bc062653117 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1373 microversion: 2.1 time: 0.169798 Oct 17 16:59:45.326745 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4117/7965] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:45 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:46.349832 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:46.350423 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:46.358074 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:46.358625 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:46.359092 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:46.359834 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:46.360307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:46.360748 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:46.507891 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:46.518721 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-1f08dc04-a163-4da2-a05b-8f40e6912f11 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1373 microversion: 2.1 time: 0.172868 Oct 17 16:59:46.519546 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3849/7966] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:46 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:47.541705 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:47.542315 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:47.549490 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:47.549987 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:47.550428 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:47.551216 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:47.551631 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:47.552052 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:47.697501 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:47.706135 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-2b9c0bbe-cc5d-40a9-8a45-cf98857ce3f1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1373 microversion: 2.1 time: 0.168389 Oct 17 16:59:47.706764 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4118/7967] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:47 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:48.729576 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:48.730210 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:48.737752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:48.738271 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:48.738771 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:48.739492 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:48.739993 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:48.740447 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:48.890881 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:48.902261 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d3f8a051-6a33-40ab-912e-0611b3c403d9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1373 microversion: 2.1 time: 0.176551 Oct 17 16:59:48.903151 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3850/7968] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:48 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:49.731903 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-11aac20b-772d-46ef-acfa-b02d109f21f1 req-750ddc5b-ea84-4f92-8545-b8b77257914e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9640195-6b1e-4d15-ae86-737ca4fcdc67", "name": "network-vif-plugged", "status": "completed", "tag": "b001dad4-1d87-4017-be78-e7a7fb5e5860"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:59:49.741863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-11aac20b-772d-46ef-acfa-b02d109f21f1 req-750ddc5b-ea84-4f92-8545-b8b77257914e service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:49.742355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-11aac20b-772d-46ef-acfa-b02d109f21f1 req-750ddc5b-ea84-4f92-8545-b8b77257914e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:49.743313 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-11aac20b-772d-46ef-acfa-b02d109f21f1 req-750ddc5b-ea84-4f92-8545-b8b77257914e service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:49.755237 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-11aac20b-772d-46ef-acfa-b02d109f21f1 req-750ddc5b-ea84-4f92-8545-b8b77257914e service nova] Creating event network-vif-plugged:b001dad4-1d87-4017-be78-e7a7fb5e5860 for instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 on n-h1-854441-12 Oct 17 16:59:49.760381 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-11aac20b-772d-46ef-acfa-b02d109f21f1 req-750ddc5b-ea84-4f92-8545-b8b77257914e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091615 Oct 17 16:59:49.761002 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4119/7969] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 16:59:49.930592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:49.931275 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:49.939112 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:49.939618 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:49.940076 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:49.940798 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:49.941265 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:49.941700 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:50.077948 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:50.087696 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-ed44887b-3180-4852-97ee-671b5929c299 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1373 microversion: 2.1 time: 0.160735 Oct 17 16:59:50.088334 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3851/7970] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:49 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:51.117761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:51.119684 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=6 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:51.129599 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:51.132366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:51.148272 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:51.148475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:51.148863 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:51.149582 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:51.150106 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:51.150545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:51.290988 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:51.299330 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-24de26fe-1963-47bb-9ada-2175b88a3534 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1557 microversion: 2.1 time: 0.182525 Oct 17 16:59:51.300047 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4120/7971] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:51 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1557 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:51.322277 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 16:59:51.322949 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 16:59:51.324886 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 16:59:51.332025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:51.332536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:51.333048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:51.333740 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:51.334247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:51.334719 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:51.474386 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 16:59:51.482963 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-403e4531-1fec-4df1-b99d-6246ea48d65a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1557 microversion: 2.1 time: 0.164786 Oct 17 16:59:51.483592 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3852/7972] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 16:59:51 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 16:59:53.236017 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-982a38e7-9a08-4691-bfc1-c94cd6b1624c req-573e32a1-65c4-4c8b-8c4c-735748023932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9640195-6b1e-4d15-ae86-737ca4fcdc67", "tag": "b001dad4-1d87-4017-be78-e7a7fb5e5860"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 16:59:53.246807 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-982a38e7-9a08-4691-bfc1-c94cd6b1624c req-573e32a1-65c4-4c8b-8c4c-735748023932 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 16:59:53.247295 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-982a38e7-9a08-4691-bfc1-c94cd6b1624c req-573e32a1-65c4-4c8b-8c4c-735748023932 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 16:59:53.247732 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-982a38e7-9a08-4691-bfc1-c94cd6b1624c req-573e32a1-65c4-4c8b-8c4c-735748023932 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 16:59:53.260430 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-982a38e7-9a08-4691-bfc1-c94cd6b1624c req-573e32a1-65c4-4c8b-8c4c-735748023932 service nova] Creating event network-changed:b001dad4-1d87-4017-be78-e7a7fb5e5860 for instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 on n-h1-854441-12 Oct 17 16:59:53.265628 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-982a38e7-9a08-4691-bfc1-c94cd6b1624c req-573e32a1-65c4-4c8b-8c4c-735748023932 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033536 Oct 17 16:59:53.266250 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4121/7973] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 16:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:01:50.632749 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3696dc72-21c5-4039-90de-2d8678c5bdb0] AMQP server on 10.222.0.87:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 17:01:50.633774 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70d19fdb-2e68-4188-b296-5d4cb59f3ab3] AMQP server on 10.222.0.87:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 17:01:50.634721 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:01:50.635605 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=36 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:01:50.636877 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 17:01:50.637197 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 17:01:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67/action (ip 10.222.0.87) !!! Oct 17 17:01:50.639275 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 17:01:50.639389 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 17:01:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67/action (ip 10.222.0.87) !!! Oct 17 17:01:50.647669 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-d4496d9f-4045-4d56-92e3-2e37cb21e908 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-823148477"}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:01:50.650216 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-d4496d9f-4045-4d56-92e3-2e37cb21e908 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:01:50.665454 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4496d9f-4045-4d56-92e3-2e37cb21e908 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:01:50.665964 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4496d9f-4045-4d56-92e3-2e37cb21e908 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:01:50.666417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4496d9f-4045-4d56-92e3-2e37cb21e908 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:01:50.667185 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4496d9f-4045-4d56-92e3-2e37cb21e908 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:01:50.667664 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4496d9f-4045-4d56-92e3-2e37cb21e908 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:01:50.668108 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-d4496d9f-4045-4d56-92e3-2e37cb21e908 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:01:50.899058 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-d4496d9f-4045-4d56-92e3-2e37cb21e908 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "POST /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67/action" status: 202 len: 0 microversion: 2.1 time: 0.268022 Oct 17 17:01:50.899736 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3853/7974] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 17:01:50 2022] POST /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 17:01:56.413445 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac0a07ff-7a15-4651-9394-b7854521cfed] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 17:01:56.415379 n-d-854441-12 devstack@n-api.service[120406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e330c2f8-e85a-4877-b463-0418903a3ce8] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 17:01:56.416331 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:01:56.418303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=32 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:01:56.427348 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-52cefb49-aa42-4703-9992-9846f749cb44 req-7c832635-17a1-4472-825c-d0091bee7fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9640195-6b1e-4d15-ae86-737ca4fcdc67", "name": "network-vif-plugged", "status": "completed", "tag": "b001dad4-1d87-4017-be78-e7a7fb5e5860"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:01:56.441355 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-52cefb49-aa42-4703-9992-9846f749cb44 req-7c832635-17a1-4472-825c-d0091bee7fa4 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:01:56.442317 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-52cefb49-aa42-4703-9992-9846f749cb44 req-7c832635-17a1-4472-825c-d0091bee7fa4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:01:56.442981 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-52cefb49-aa42-4703-9992-9846f749cb44 req-7c832635-17a1-4472-825c-d0091bee7fa4 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:01:56.463513 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-52cefb49-aa42-4703-9992-9846f749cb44 req-7c832635-17a1-4472-825c-d0091bee7fa4 service nova] Creating event network-vif-plugged:b001dad4-1d87-4017-be78-e7a7fb5e5860 for instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 on n-h1-854441-12 Oct 17 17:01:56.469568 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-52cefb49-aa42-4703-9992-9846f749cb44 req-7c832635-17a1-4472-825c-d0091bee7fa4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058741 Oct 17 17:01:56.470696 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4122/7975] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:02:04.500157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:02:04.500946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:02:04.506361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1523887378", "imageRef": "296b613a-cc27-4844-b8d9-9d0bd2c03910", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-345906765", "security_groups": [{"name": "tempest-secgroup-smoke-1725623689"}], "networks": [{"uuid": "2d4f96fa-7df5-424b-8f16-05a8816d8d51"}]}} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:02:04.533826 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] [70d19fdb-2e68-4188-b296-5d4cb59f3ab3] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 43994. Oct 17 17:02:04.539798 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] [3696dc72-21c5-4039-90de-2d8678c5bdb0] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 43992. Oct 17 17:02:04.627913 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.network.neutron [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] validate_networks() for [('2d4f96fa-7df5-424b-8f16-05a8816d8d51', None, None, None, None, None)] {{(pid=120407) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:02:05.057919 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Flavor limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:02:05.058373 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Image limits 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:02:05.058930 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Flavor pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:02:05.059404 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Image pref 0:0:0 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:02:05.059841 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.virt.hardware [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:02:05.070156 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:05.070709 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:05.071172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:05.071932 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:05.072411 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:05.072865 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:05.091836 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Getting quotas for project 77f62a5c6121410e9ec1f54b97803093. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:02:05.098725 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.quota [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Getting quotas for user 80ac40200dd14a1f9bfcba424b906d3e and project 77f62a5c6121410e9ec1f54b97803093. Resources: {'instances', 'ram', 'cores'} {{(pid=120407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:02:05.112075 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Going to run 1 instances... {{(pid=120407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:02:05.114731 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='296b613a-cc27-4844-b8d9-9d0bd2c03910',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:02:05.166379 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8d67e2e9-821f-410e-8d19-90e8fd30c486 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.668356 Oct 17 17:02:05.167085 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3854/7976] 10.222.0.87 () {60 vars in 1147 bytes} [Mon Oct 17 17:02:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 17:02:05.180588 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-7e43de24-0af5-4507-bf6d-a387868b1104 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:05.181279 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-7e43de24-0af5-4507-bf6d-a387868b1104 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:05.206342 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac0a07ff-7a15-4651-9394-b7854521cfed] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 44008. Oct 17 17:02:05.208278 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] [e330c2f8-e85a-4877-b463-0418903a3ce8] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 44010. Oct 17 17:02:05.259442 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-7e43de24-0af5-4507-bf6d-a387868b1104 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:05.267609 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-7e43de24-0af5-4507-bf6d-a387868b1104 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1248 microversion: 2.1 time: 0.092892 Oct 17 17:02:05.268267 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4123/7977] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:05 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:06.292121 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:06.293848 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:06.301935 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:06.302777 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:06.303536 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:06.304610 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:06.305286 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:06.305783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:06.377991 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:06.389175 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-4a5fb47c-7dc6-48a5-bcdc-c08d3337ae05 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1308 microversion: 2.1 time: 0.102327 Oct 17 17:02:06.390602 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3855/7978] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:06 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:07.415271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:07.415913 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:07.419060 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:02:07.436752 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:07.438698 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:07.439634 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:07.441494 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:07.443925 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:07.447681 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:07.721831 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:07.746652 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-403d7d0e-8bc6-44bc-997e-f9e5102e0093 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.333837 Oct 17 17:02:07.749338 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4124/7979] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:07 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:08.258017 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-2640a8a0-4618-4205-88df-297df2031b63 req-0b353f2b-1dac-42d8-913d-427316ff11ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9640195-6b1e-4d15-ae86-737ca4fcdc67", "name": "network-vif-unplugged", "status": "completed", "tag": "b001dad4-1d87-4017-be78-e7a7fb5e5860"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:02:08.271649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2640a8a0-4618-4205-88df-297df2031b63 req-0b353f2b-1dac-42d8-913d-427316ff11ba service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:08.272497 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2640a8a0-4618-4205-88df-297df2031b63 req-0b353f2b-1dac-42d8-913d-427316ff11ba service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:08.272946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-2640a8a0-4618-4205-88df-297df2031b63 req-0b353f2b-1dac-42d8-913d-427316ff11ba service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:08.291147 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-2640a8a0-4618-4205-88df-297df2031b63 req-0b353f2b-1dac-42d8-913d-427316ff11ba service nova] Creating event network-vif-unplugged:b001dad4-1d87-4017-be78-e7a7fb5e5860 for instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 on n-h1-854441-12 Oct 17 17:02:08.298277 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-2640a8a0-4618-4205-88df-297df2031b63 req-0b353f2b-1dac-42d8-913d-427316ff11ba service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044989 Oct 17 17:02:08.299032 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3856/7980] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:02:08.771932 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:08.772875 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:08.780251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:08.780751 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:08.781193 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:08.781901 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:08.782545 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:08.783155 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:08.931021 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:08.939919 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-12a1ef06-19d3-4eb0-8158-a78b974d1702 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.171809 Oct 17 17:02:08.946433 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4125/7981] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:08 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:09.966033 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:09.966845 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:09.973635 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:09.974263 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:09.975011 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:09.975946 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:09.976518 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:09.977009 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:10.128374 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:10.136944 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-18de155b-67e9-4e1c-a0d3-7d091e76224b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.177201 Oct 17 17:02:10.137791 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3857/7982] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:09 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:11.161998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:11.162730 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:11.170207 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:11.170821 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:11.171334 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:11.172046 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:11.172504 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:11.172927 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:11.319379 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:11.327747 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-96c92906-eb0b-48be-9b44-a62832489bae tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.169798 Oct 17 17:02:11.339960 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4126/7983] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:11 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:12.351452 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:12.352313 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:12.359643 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:12.360159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:12.360617 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:12.361350 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:12.361790 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:12.362597 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:12.509928 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:12.518168 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2d74372a-ba9b-4e62-a48e-c4e35dc7dc97 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.170836 Oct 17 17:02:12.519004 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3858/7984] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:12 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:02:13.541727 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:13.542341 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:13.550303 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:13.550754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:13.551203 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:13.551917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:13.552375 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:13.552788 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:13.708883 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:13.719004 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-39a52f29-2d34-445b-91e0-4ffb93bff0d1 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.181481 Oct 17 17:02:13.724723 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4127/7985] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:13 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:02:14.744430 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:14.745054 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:14.752775 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:14.753276 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:14.753763 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:14.754846 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:14.755324 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:14.755752 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:14.899165 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:14.908539 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-63b77bad-b9e8-401a-b069-5b3b18fe619b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.169452 Oct 17 17:02:14.909511 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3859/7986] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:14 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:15.177644 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [req-0dd51322-2ab2-4eab-91b0-26dd03ca8dac req-d432a58d-63a9-4ee3-90d7-7f5ea79ab12c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f758ea6b-2f6a-49a3-bfde-782e24fd5e4c", "tag": "4a157894-a73d-47d0-a7d2-52183aa73b18"}]} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:02:15.190516 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0dd51322-2ab2-4eab-91b0-26dd03ca8dac req-d432a58d-63a9-4ee3-90d7-7f5ea79ab12c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:15.191185 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0dd51322-2ab2-4eab-91b0-26dd03ca8dac req-d432a58d-63a9-4ee3-90d7-7f5ea79ab12c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:15.191633 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [req-0dd51322-2ab2-4eab-91b0-26dd03ca8dac req-d432a58d-63a9-4ee3-90d7-7f5ea79ab12c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:15.204089 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.compute.server_external_events [req-0dd51322-2ab2-4eab-91b0-26dd03ca8dac req-d432a58d-63a9-4ee3-90d7-7f5ea79ab12c service nova] Creating event network-changed:4a157894-a73d-47d0-a7d2-52183aa73b18 for instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c on n-h2-854441-12 Oct 17 17:02:15.209381 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [req-0dd51322-2ab2-4eab-91b0-26dd03ca8dac req-d432a58d-63a9-4ee3-90d7-7f5ea79ab12c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035999 Oct 17 17:02:15.210252 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4128/7987] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:02:15.932970 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:15.933565 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:15.935705 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=2 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:02:15.936402 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell0:SELECT=6 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:02:15.943855 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:15.944361 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:15.944827 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:15.945603 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:15.946080 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:15.946600 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:16.095393 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:16.103865 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8554ba63-e3b7-48e2-bf68-48b29779fbfd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.174857 Oct 17 17:02:16.104462 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3860/7988] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:15 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:17.124345 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell0:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:02:17.129661 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:17.130871 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:17.139833 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:17.140544 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:17.141124 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:17.142092 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:17.142761 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:17.143392 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:17.285966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:17.294158 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-76a12cdf-0b2b-46d4-998e-c48f480d552d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.170867 Oct 17 17:02:17.294788 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4129/7989] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:17 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:18.317188 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:18.317869 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:18.325385 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:18.325890 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:18.326334 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:18.327105 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:18.327626 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:18.328048 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:18.465417 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:18.476484 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-84ff4b9e-b8ff-4325-bd79-b52de9139b40 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.163056 Oct 17 17:02:18.477235 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3861/7990] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:18 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:19.500108 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:19.500734 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:19.509013 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:19.509519 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:19.509961 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:19.510718 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:19.511221 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:19.511784 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:19.976382 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:19.985982 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-d9b228dc-a0db-47ac-b801-e544dd727e53 req-5fd014ca-6e99-4b3a-a068-251aba033d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f758ea6b-2f6a-49a3-bfde-782e24fd5e4c", "name": "network-vif-plugged", "status": "completed", "tag": "4a157894-a73d-47d0-a7d2-52183aa73b18"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:02:20.000025 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d9b228dc-a0db-47ac-b801-e544dd727e53 req-5fd014ca-6e99-4b3a-a068-251aba033d12 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:20.000508 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d9b228dc-a0db-47ac-b801-e544dd727e53 req-5fd014ca-6e99-4b3a-a068-251aba033d12 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:20.001133 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-d9b228dc-a0db-47ac-b801-e544dd727e53 req-5fd014ca-6e99-4b3a-a068-251aba033d12 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:20.004971 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-d5299358-7205-4ea2-9236-fdeb20df8ddb tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.506761 Oct 17 17:02:20.005622 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4130/7991] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:19 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:20.018560 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-d9b228dc-a0db-47ac-b801-e544dd727e53 req-5fd014ca-6e99-4b3a-a068-251aba033d12 service nova] Creating event network-vif-plugged:4a157894-a73d-47d0-a7d2-52183aa73b18 for instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c on n-h2-854441-12 Oct 17 17:02:20.025134 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-d9b228dc-a0db-47ac-b801-e544dd727e53 req-5fd014ca-6e99-4b3a-a068-251aba033d12 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043833 Oct 17 17:02:20.026530 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3862/7992] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:02:21.030368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:21.030990 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:21.038610 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:21.039093 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:21.039575 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:21.040374 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:21.040844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:21.041251 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:21.212646 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:21.221588 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-3535d86c-f972-4359-b00a-a45cc5ba3f89 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1374 microversion: 2.1 time: 0.195595 Oct 17 17:02:21.222189 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4131/7993] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:21 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:22.247484 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:22.248172 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:22.257282 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:22.257783 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:22.258468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:22.259247 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:22.259734 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:22.260167 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:22.409007 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:22.417294 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-f6c60925-27f3-498b-bc2d-7a0cc1dbaf9e tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1558 microversion: 2.1 time: 0.175480 Oct 17 17:02:22.417946 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3863/7994] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:22 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:22.443917 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:02:22.444772 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:02:22.451922 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:22.452446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:22.452888 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:22.453587 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:22.454042 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:22.454475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:22.601557 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:02:22.609995 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-8f89ce29-6645-464b-ab99-b32552f4ac44 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1558 microversion: 2.1 time: 0.170153 Oct 17 17:02:22.610589 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4132/7995] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:02:22 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:02:24.655548 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-9cc0e735-5a71-44f1-8f4b-4ebadd2bacdd req-967d98c9-5f46-47e4-96f0-1e975d0efc2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f758ea6b-2f6a-49a3-bfde-782e24fd5e4c", "tag": "4a157894-a73d-47d0-a7d2-52183aa73b18"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:02:24.666585 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9cc0e735-5a71-44f1-8f4b-4ebadd2bacdd req-967d98c9-5f46-47e4-96f0-1e975d0efc2c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:02:24.667189 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9cc0e735-5a71-44f1-8f4b-4ebadd2bacdd req-967d98c9-5f46-47e4-96f0-1e975d0efc2c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:02:24.667649 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-9cc0e735-5a71-44f1-8f4b-4ebadd2bacdd req-967d98c9-5f46-47e4-96f0-1e975d0efc2c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:02:24.680107 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-9cc0e735-5a71-44f1-8f4b-4ebadd2bacdd req-967d98c9-5f46-47e4-96f0-1e975d0efc2c service nova] Creating event network-changed:4a157894-a73d-47d0-a7d2-52183aa73b18 for instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c on n-h2-854441-12 Oct 17 17:02:24.685707 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-9cc0e735-5a71-44f1-8f4b-4ebadd2bacdd req-967d98c9-5f46-47e4-96f0-1e975d0efc2c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034057 Oct 17 17:02:24.686335 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3864/7996] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:04:03.100994 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=24 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:04:03.101742 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=50 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:04:03.102614 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 17:04:03.102769 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 17:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c/action (ip 10.222.0.87) !!! Oct 17 17:04:03.103707 n-d-854441-12 devstack@n-api.service[120406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 17:04:03.103959 n-d-854441-12 devstack@n-api.service[120406]: Mon Oct 17 17:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c/action (ip 10.222.0.87) !!! Oct 17 17:04:03.109500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-98d15ffc-416e-49ff-8d06-7929fb348355 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-705859567"}} {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:04:03.111870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-98d15ffc-416e-49ff-8d06-7929fb348355 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:03.121153 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d15ffc-416e-49ff-8d06-7929fb348355 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:03.121649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d15ffc-416e-49ff-8d06-7929fb348355 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:03.122195 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d15ffc-416e-49ff-8d06-7929fb348355 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:03.123529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d15ffc-416e-49ff-8d06-7929fb348355 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:03.124294 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d15ffc-416e-49ff-8d06-7929fb348355 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:03.125012 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-98d15ffc-416e-49ff-8d06-7929fb348355 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:03.521457 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-98d15ffc-416e-49ff-8d06-7929fb348355 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "POST /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c/action" status: 202 len: 0 microversion: 2.1 time: 0.422261 Oct 17 17:04:03.522111 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4133/7997] 10.222.0.87 () {60 vars in 1278 bytes} [Mon Oct 17 17:04:03 2022] POST /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 17:04:08.501516 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70d19fdb-2e68-4188-b296-5d4cb59f3ab3] AMQP server on 10.222.0.87:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 17:04:08.503261 n-d-854441-12 devstack@n-api.service[120407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3696dc72-21c5-4039-90de-2d8678c5bdb0] AMQP server on 10.222.0.87:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 17:04:08.504559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:04:08.505549 n-d-854441-12 devstack@n-api.service[120407]: DEBUG dbcounter [-] [120407] Writing DB stats nova_cell1:SELECT=50 {{(pid=120407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:04:08.507318 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 17:04:08.507541 n-d-854441-12 devstack@n-api.service[120407]: Mon Oct 17 17:04:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.87) !!! Oct 17 17:04:08.520656 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-fc549750-e070-4edd-b287-afa1727d25de req-59e98b73-650f-4b14-9f9e-d9ab74788011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f758ea6b-2f6a-49a3-bfde-782e24fd5e4c", "name": "network-vif-plugged", "status": "completed", "tag": "4a157894-a73d-47d0-a7d2-52183aa73b18"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:04:08.536307 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-fc549750-e070-4edd-b287-afa1727d25de req-59e98b73-650f-4b14-9f9e-d9ab74788011 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:08.537187 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-fc549750-e070-4edd-b287-afa1727d25de req-59e98b73-650f-4b14-9f9e-d9ab74788011 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:08.537853 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-fc549750-e070-4edd-b287-afa1727d25de req-59e98b73-650f-4b14-9f9e-d9ab74788011 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:08.556510 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-fc549750-e070-4edd-b287-afa1727d25de req-59e98b73-650f-4b14-9f9e-d9ab74788011 service nova] Creating event network-vif-plugged:4a157894-a73d-47d0-a7d2-52183aa73b18 for instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c on n-h2-854441-12 Oct 17 17:04:08.568587 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-fc549750-e070-4edd-b287-afa1727d25de req-59e98b73-650f-4b14-9f9e-d9ab74788011 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069602 Oct 17 17:04:08.569791 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3865/7998] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:04:18.285515 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_api:SELECT=2 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:04:18.286626 n-d-854441-12 devstack@n-api.service[120406]: DEBUG dbcounter [-] [120406] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:04:18.294300 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:18.294983 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:18.302483 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] [70d19fdb-2e68-4188-b296-5d4cb59f3ab3] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 44306. Oct 17 17:04:18.303396 n-d-854441-12 devstack@n-api.service[120407]: INFO oslo.messaging._drivers.impl_rabbit [-] [3696dc72-21c5-4039-90de-2d8678c5bdb0] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 44308. Oct 17 17:04:18.314529 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:18.315065 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:18.315506 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:18.316296 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:18.316889 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:18.317252 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:18.346198 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 17:04:18.361238 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-ceaac73b-1f30-409d-97ea-07851a6faec3 req-2a4b35b9-2a44-4c6f-9d77-59539e890c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f758ea6b-2f6a-49a3-bfde-782e24fd5e4c", "tag": "4a157894-a73d-47d0-a7d2-52183aa73b18"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:04:18.376607 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ceaac73b-1f30-409d-97ea-07851a6faec3 req-2a4b35b9-2a44-4c6f-9d77-59539e890c85 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:18.377030 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ceaac73b-1f30-409d-97ea-07851a6faec3 req-2a4b35b9-2a44-4c6f-9d77-59539e890c85 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:18.377592 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-ceaac73b-1f30-409d-97ea-07851a6faec3 req-2a4b35b9-2a44-4c6f-9d77-59539e890c85 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:18.392140 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-ceaac73b-1f30-409d-97ea-07851a6faec3 req-2a4b35b9-2a44-4c6f-9d77-59539e890c85 service nova] Creating event network-changed:4a157894-a73d-47d0-a7d2-52183aa73b18 for instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c on n-h2-854441-12 Oct 17 17:04:18.398146 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-ceaac73b-1f30-409d-97ea-07851a6faec3 req-2a4b35b9-2a44-4c6f-9d77-59539e890c85 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108689 Oct 17 17:04:18.402740 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3866/7999] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:04:18.436187 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-84ec5a04-729e-4e20-9f53-03775b3f340b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 204 len: 0 microversion: 2.1 time: 0.152712 Oct 17 17:04:18.440356 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4134/8000] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 17:04:18 2022] DELETE /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 17:04:18.449248 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:18.451192 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:18.459355 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:18.460037 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:18.460543 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:18.461922 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:18.462697 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:18.463159 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:18.701860 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:04:18.710546 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-2b84c84b-f3bb-48f3-b2fc-a7b477205f2a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1683 microversion: 2.1 time: 0.268417 Oct 17 17:04:18.711374 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3867/8001] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:04:18 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1683 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:04:19.733998 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:19.735475 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:19.742201 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:19.742754 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:19.743256 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:19.743966 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:19.744418 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:19.744844 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:19.886773 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:04:19.894984 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a8d37d19-3902-4eba-bd73-bc21f74fd4a0 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1683 microversion: 2.1 time: 0.165326 Oct 17 17:04:19.898787 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4135/8002] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:04:19 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:04:20.461413 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-bf8f6e5e-19d5-4afc-a5a8-c35df8220a3b req-c070b974-18b0-4b93-8146-869f8e6dfa25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f758ea6b-2f6a-49a3-bfde-782e24fd5e4c", "name": "network-vif-deleted", "tag": "4a157894-a73d-47d0-a7d2-52183aa73b18"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:04:20.472388 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf8f6e5e-19d5-4afc-a5a8-c35df8220a3b req-c070b974-18b0-4b93-8146-869f8e6dfa25 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:20.472888 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf8f6e5e-19d5-4afc-a5a8-c35df8220a3b req-c070b974-18b0-4b93-8146-869f8e6dfa25 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:20.473801 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf8f6e5e-19d5-4afc-a5a8-c35df8220a3b req-c070b974-18b0-4b93-8146-869f8e6dfa25 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:20.486407 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bf8f6e5e-19d5-4afc-a5a8-c35df8220a3b req-c070b974-18b0-4b93-8146-869f8e6dfa25 service nova] Creating event network-vif-deleted:4a157894-a73d-47d0-a7d2-52183aa73b18 for instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c on n-h2-854441-12 Oct 17 17:04:20.492675 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-bf8f6e5e-19d5-4afc-a5a8-c35df8220a3b req-c070b974-18b0-4b93-8146-869f8e6dfa25 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034987 Oct 17 17:04:20.493299 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3868/8003] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:04:20.921675 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:20.923047 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:20.931522 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:20.932027 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:20.932511 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:20.933361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:20.933895 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:20.934446 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:20.974361 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:20.974920 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:20.975368 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:20.975838 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lazy-loading 'fault' on Instance uuid f758ea6b-2f6a-49a3-bfde-782e24fd5e4c {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:04:21.026697 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:04:21.039478 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ad43814f-895e-459c-83c6-91675d868934 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 200 len: 1338 microversion: 2.1 time: 0.123466 Oct 17 17:04:21.040542 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4136/8004] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:04:20 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 1338 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:04:22.077294 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:22.078014 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: f758ea6b-2f6a-49a3-bfde-782e24fd5e4c] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:22.084899 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:22.085400 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:22.085854 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:22.086611 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:22.087084 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:22.087519 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:22.101955 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] HTTP exception thrown: Instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c could not be found. Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Request method failure captured: Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c HTTP/1.1 Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYn1x0j6EFd_udQhyASXEqQhRpfDakjinxO453MnTu8SOmDe-pgy-9zzMNaRI_k5cxsbkMp9m0dBjuOpFCuydETRy8qRtcm5kApSU11Vjr-ebge6yR38gfURovgMkMSCCZsQ6y20vI6p_63QH2r7QEQLraBcH9SRG43sb_rdM2hczdc Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 77f62a5c6121410e9ec1f54b97803093 Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestSnapshotPattern-1848904536 Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/77f62a5c6121410e9ec1f54b97803093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/77f62a5c6121410e9ec1f54b97803093"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_77f62a5c6121410e9ec1f54b97803093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/77f62a5c6121410e9ec1f54b97803093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestSnapshotPattern-1848904536 Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 77f62a5c6121410e9ec1f54b97803093 Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestSnapshotPattern-1848904536 Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestSnapshotPattern-1848904536-project Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 80ac40200dd14a1f9bfcba424b906d3e Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestSnapshotPattern-1848904536-project Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c could not be found. Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'f758ea6b-2f6a-49a3-bfde-782e24fd5e4c'} Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c could not be found. Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c could not be found. Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:04:22.103745 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c could not be found. Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Returning 404 to user: Instance f758ea6b-2f6a-49a3-bfde-782e24fd5e4c could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-9760c46d-8ace-478c-a8f1-40455cc16cf9 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c" status: 404 len: 111 microversion: 2.1 time: 0.035277 Oct 17 17:04:22.107468 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3869/8005] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:04:22 2022] GET /compute/v2.1/servers/f758ea6b-2f6a-49a3-bfde-782e24fd5e4c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:04:23.860273 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:23.860775 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:23.862292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-93887959-603d-4b25-9a93-33aa99ed868e req-2a70b8ee-87a4-4db1-b3d4-c25d1b5b8814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9640195-6b1e-4d15-ae86-737ca4fcdc67", "tag": "b001dad4-1d87-4017-be78-e7a7fb5e5860"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:04:23.867842 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:23.868591 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:23.869096 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:23.870316 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:23.870870 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:23.871366 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:23.875096 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-93887959-603d-4b25-9a93-33aa99ed868e req-2a70b8ee-87a4-4db1-b3d4-c25d1b5b8814 service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:23.875764 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-93887959-603d-4b25-9a93-33aa99ed868e req-2a70b8ee-87a4-4db1-b3d4-c25d1b5b8814 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:23.876419 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-93887959-603d-4b25-9a93-33aa99ed868e req-2a70b8ee-87a4-4db1-b3d4-c25d1b5b8814 service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:23.888297 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-93887959-603d-4b25-9a93-33aa99ed868e req-2a70b8ee-87a4-4db1-b3d4-c25d1b5b8814 service nova] Creating event network-changed:b001dad4-1d87-4017-be78-e7a7fb5e5860 for instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 on n-h1-854441-12 Oct 17 17:04:23.893738 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-93887959-603d-4b25-9a93-33aa99ed868e req-2a70b8ee-87a4-4db1-b3d4-c25d1b5b8814 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034997 Oct 17 17:04:23.894863 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3870/8006] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:04:23.903946 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Going to try to terminate instance {{(pid=120406) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 17:04:23.999929 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-eb8ae76d-c119-4071-99a4-a2ff425a1a7b tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 204 len: 0 microversion: 2.1 time: 0.143508 Oct 17 17:04:24.001422 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4137/8007] 10.222.0.87 () {58 vars in 1239 bytes} [Mon Oct 17 17:04:23 2022] DELETE /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 17:04:24.011230 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:24.012317 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:24.019483 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:24.020236 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:24.020911 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:24.021818 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:24.022456 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:24.023101 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:24.168490 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.policy [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120407) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:04:24.176697 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-8094e8ba-bb8e-4dd3-80be-309dec70cfcd tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1681 microversion: 2.1 time: 0.170537 Oct 17 17:04:24.177303 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3871/8008] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:04:24 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:04:25.202556 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:25.203320 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:25.211622 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:25.212138 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:25.212621 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:25.213377 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:25.213845 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:25.214271 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:25.392081 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:04:25.401146 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-ed9a18fc-e2f4-4dc8-b368-e05a232c2a0a tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1681 microversion: 2.1 time: 0.203316 Oct 17 17:04:25.401769 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4138/8009] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:04:25 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:04:25.989369 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [req-bf0a4293-459f-4d93-8b82-b4bf73532366 req-bc102f32-1bac-47f3-a6c9-aa85cd0b7b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9640195-6b1e-4d15-ae86-737ca4fcdc67", "name": "network-vif-deleted", "tag": "b001dad4-1d87-4017-be78-e7a7fb5e5860"}]} {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:04:26.001384 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf0a4293-459f-4d93-8b82-b4bf73532366 req-bc102f32-1bac-47f3-a6c9-aa85cd0b7b2c service nova] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:26.001953 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf0a4293-459f-4d93-8b82-b4bf73532366 req-bc102f32-1bac-47f3-a6c9-aa85cd0b7b2c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:26.002345 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [req-bf0a4293-459f-4d93-8b82-b4bf73532366 req-bc102f32-1bac-47f3-a6c9-aa85cd0b7b2c service nova] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:26.017517 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.compute.server_external_events [req-bf0a4293-459f-4d93-8b82-b4bf73532366 req-bc102f32-1bac-47f3-a6c9-aa85cd0b7b2c service nova] Creating event network-vif-deleted:b001dad4-1d87-4017-be78-e7a7fb5e5860 for instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 on n-h1-854441-12 Oct 17 17:04:26.022754 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [req-bf0a4293-459f-4d93-8b82-b4bf73532366 req-bc102f32-1bac-47f3-a6c9-aa85cd0b7b2c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037185 Oct 17 17:04:26.023425 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3872/8010] 10.222.0.87 () {64 vars in 1317 bytes} [Mon Oct 17 17:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:04:26.425500 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:26.426131 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.compute.api [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120406) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:26.436383 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:26.437177 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:26.437649 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:26.438342 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:26.438887 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:26.439318 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:26.475467 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:26.475962 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:26.476405 n-d-854441-12 devstack@n-api.service[120406]: DEBUG oslo_concurrency.lockutils [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:26.476886 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.objects.instance [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lazy-loading 'fault' on Instance uuid c9640195-6b1e-4d15-ae86-737ca4fcdc67 {{(pid=120406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:04:26.523360 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.policy [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ac40200dd14a1f9bfcba424b906d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f62a5c6121410e9ec1f54b97803093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120406) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:04:26.531029 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-a3257d49-91e5-48e3-8327-9a0db10b5ae4 tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 200 len: 1337 microversion: 2.1 time: 0.109457 Oct 17 17:04:26.531621 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4139/8011] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:04:26 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 1337 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:04:27.556559 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '>' {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:27.557208 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.compute.api [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] [instance: c9640195-6b1e-4d15-ae86-737ca4fcdc67] Fetching instance by UUID {{(pid=120407) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:04:27.564415 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:27.564951 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:27.565412 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:27.566157 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Acquiring lock "4ec06080-01b5-4793-9448-66de7d08c56d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:04:27.566671 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:04:27.567126 n-d-854441-12 devstack@n-api.service[120407]: DEBUG oslo_concurrency.lockutils [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Lock "4ec06080-01b5-4793-9448-66de7d08c56d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:04:27.583589 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.wsgi [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] HTTP exception thrown: Instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 could not be found. Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Request method failure captured: Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: request: GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 HTTP/1.1 Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: Accept: application/json Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: Accept-Encoding: identity Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: Connection: close Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: Content-Length: 0 Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: Content-Type: application/json Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: Host: 10.222.0.87 Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: Openstack-System-Scope: None Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: User-Agent: python-urllib3/1.26.12 Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Auth-Token: gAAAAABjTYn1x0j6EFd_udQhyASXEqQhRpfDakjinxO453MnTu8SOmDe-pgy-9zzMNaRI_k5cxsbkMp9m0dBjuOpFCuydETRy8qRtcm5kApSU11Vjr-ebge6yR38gfURovgMkMSCCZsQ6y20vI6p_63QH2r7QEQLraBcH9SRG43sb_rdM2hczdc Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Id: None Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Domain-Name: None Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Identity-Status: Confirmed Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Is-Admin-Project: True Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Id: default Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Domain-Name: Default Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Id: 77f62a5c6121410e9ec1f54b97803093 Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Project-Name: tempest-TestSnapshotPattern-1848904536 Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Role: member,reader Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Roles: member,reader Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/77f62a5c6121410e9ec1f54b97803093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/77f62a5c6121410e9ec1f54b97803093"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_77f62a5c6121410e9ec1f54b97803093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/77f62a5c6121410e9ec1f54b97803093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/networking"}]}] Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant: tempest-TestSnapshotPattern-1848904536 Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Id: 77f62a5c6121410e9ec1f54b97803093 Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-Tenant-Name: tempest-TestSnapshotPattern-1848904536 Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-User: tempest-TestSnapshotPattern-1848904536-project Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Id: default Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-User-Domain-Name: Default Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-User-Id: 80ac40200dd14a1f9bfcba424b906d3e Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: X-User-Name: tempest-TestSnapshotPattern-1848904536-project Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: method: > Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: exception: Instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 could not be found. Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: action_args: {'id': 'c9640195-6b1e-4d15-ae86-737ca4fcdc67'} Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: {{(pid=120407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 could not be found. Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 could not be found. Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:04:27.585292 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 could not be found. Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: ERROR nova.api.openstack.wsgi Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: DEBUG nova.api.openstack.wsgi [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Returning 404 to user: Instance c9640195-6b1e-4d15-ae86-737ca4fcdc67 could not be found. {{(pid=120407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: INFO nova.api.openstack.requestlog [None req-092769a8-baa3-4c6f-a9d0-b772da16656f tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67" status: 404 len: 111 microversion: 2.1 time: 0.035798 Oct 17 17:04:27.589225 n-d-854441-12 devstack@n-api.service[120407]: [pid: 120407|app: 0|req: 3873/8012] 10.222.0.87 () {58 vars in 1236 bytes} [Mon Oct 17 17:04:27 2022] GET /compute/v2.1/servers/c9640195-6b1e-4d15-ae86-737ca4fcdc67 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:04:27.768678 n-d-854441-12 devstack@n-api.service[120406]: DEBUG nova.api.openstack.wsgi [None req-f0711d7a-3877-47a9-8de1-f02727b3dc1d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] Calling method '.version_select at 0x7f28bebd3a60>' {{(pid=120406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:04:27.794097 n-d-854441-12 devstack@n-api.service[120406]: INFO nova.api.openstack.requestlog [None req-f0711d7a-3877-47a9-8de1-f02727b3dc1d tempest-TestSnapshotPattern-1848904536 tempest-TestSnapshotPattern-1848904536-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-345906765" status: 202 len: 0 microversion: 2.1 time: 0.029444 Oct 17 17:04:27.794792 n-d-854441-12 devstack@n-api.service[120406]: [pid: 120406|app: 0|req: 4140/8013] 10.222.0.87 () {58 vars in 1254 bytes} [Mon Oct 17 17:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-345906765 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)